2023-11-28T11:40:06.459 INFO:root:teuthology version: 0.0.1.dev209+g5ae09a5 2023-11-28T11:40:06.460 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --archive /home/teuthworker/archive/neesingh-2023-11-28_11:27:19-fs-wip-neesingh-testing-231123-distro-default-smithi/7469966 --name neesingh-2023-11-28_11:27:19-fs-wip-neesingh-testing-231123-distro-default-smithi --owner scheduled_neesingh@teuthology --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/forward-scrub} -- /home/teuthworker/archive/neesingh-2023-11-28_11:27:19-fs-wip-neesingh-testing-231123-distro-default-smithi/7469966/orig.config.yaml 2023-11-28T11:40:06.505 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T11:40:06.603 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/neesingh-2023-11-28_11:27:19-fs-wip-neesingh-testing-231123-distro-default-smithi/7469966 branch: wip-neesingh-testing-231123 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/forward-scrub} email: neesingh@redhat.com first_in_suite: false job_id: '7469966' kernel: client: branch: testing kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: neesingh-2023-11-28_11:27:19-fs-wip-neesingh-testing-231123-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 8.stream overrides: admin_socket: branch: wip-neesingh-testing-231123 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - inode wrongly marked free - bad backtrace on inode - inode table repaired for inode - Scrub error on inode - Scrub error on dir - Metadata damage detected sha1: 2f5f6028b893ad41357cd06e827373f0fe2a1232 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 2f5f6028b893ad41357cd06e827373f0fe2a1232 kclient: syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: issue_54557 sha1: 17c45c858c4cb3105f973d12c6c74f8d5037aa89 owner: scheduled_neesingh@teuthology priority: 10 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 4140 sha1: 2f5f6028b893ad41357cd06e827373f0fe2a1232 sleep_before_teardown: 0 suite: fs suite_branch: issue_54557 suite_path: /home/teuthworker/src/github.com_neesingh-rh_ceph_17c45c858c4cb3105f973d12c6c74f8d5037aa89/qa suite_relpath: qa suite_repo: https://github.com/neesingh-rh/ceph suite_sha1: 17c45c858c4cb3105f973d12c6c74f8d5037aa89 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi045.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHtRyX/J4dXuPgQZgnkRgI+j6ljTtxie2rq92X9POlWrfA6Kzs8mueTUo+MwatEEj3SVyJCJZQNKF0ZFSK7Xsmk= smithi152.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFsEDIPxrgkagg2Jhwa4+SjOQ7xHIEWtHfSMxrtjNX2cprFC975JqW+8AYf+cIfR+qWWqSDVm1y1ZDG3RVOIMPI= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: null - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_forward_scrub teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 5ae09a5cc7064ca2bf994df19f3006b79794789a timestamp: 2023-11-28_11:27:19 tube: smithi user: neesingh verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.232157 2023-11-28T11:40:06.603 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_neesingh-rh_ceph_17c45c858c4cb3105f973d12c6c74f8d5037aa89/qa; will attempt to use it 2023-11-28T11:40:06.604 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_neesingh-rh_ceph_17c45c858c4cb3105f973d12c6c74f8d5037aa89/qa/tasks 2023-11-28T11:40:06.604 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-11-28T11:40:06.606 INFO:teuthology.task.internal:Checking packages... 2023-11-28T11:40:06.633 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '2f5f6028b893ad41357cd06e827373f0fe2a1232' 2023-11-28T11:40:06.634 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-11-28T11:40:06.634 INFO:teuthology.packaging:ref: None 2023-11-28T11:40:06.634 INFO:teuthology.packaging:tag: None 2023-11-28T11:40:06.634 INFO:teuthology.packaging:branch: wip-neesingh-testing-231123 2023-11-28T11:40:06.634 INFO:teuthology.packaging:sha1: 2f5f6028b893ad41357cd06e827373f0fe2a1232 2023-11-28T11:40:06.634 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-neesingh-testing-231123 2023-11-28T11:40:06.868 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-2697.g2f5f6028 2023-11-28T11:40:06.868 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-11-28T11:40:06.874 INFO:teuthology.task.internal:no buildpackages task found 2023-11-28T11:40:06.874 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-11-28T11:40:06.894 INFO:teuthology.task.internal:Saving configuration 2023-11-28T11:40:06.911 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-11-28T11:40:06.933 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-28T11:40:06.959 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi045.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/neesingh-2023-11-28_11:27:19-fs-wip-neesingh-testing-231123-distro-default-smithi/7469966', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-28 11:34:49.975068', 'locked_by': 'scheduled_neesingh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHtRyX/J4dXuPgQZgnkRgI+j6ljTtxie2rq92X9POlWrfA6Kzs8mueTUo+MwatEEj3SVyJCJZQNKF0ZFSK7Xsmk='} 2023-11-28T11:40:06.980 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi152.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/neesingh-2023-11-28_11:27:19-fs-wip-neesingh-testing-231123-distro-default-smithi/7469966', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-28 11:34:49.976822', 'locked_by': 'scheduled_neesingh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFsEDIPxrgkagg2Jhwa4+SjOQ7xHIEWtHfSMxrtjNX2cprFC975JqW+8AYf+cIfR+qWWqSDVm1y1ZDG3RVOIMPI='} 2023-11-28T11:40:06.980 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-11-28T11:40:06.986 INFO:teuthology.task.internal:roles: ubuntu@smithi045.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-11-28T11:40:06.986 INFO:teuthology.task.internal:roles: ubuntu@smithi152.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-11-28T11:40:06.986 INFO:teuthology.run_tasks:Running task console_log... 2023-11-28T11:40:07.122 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f5011de4a60>, signals=[15]) 2023-11-28T11:40:07.122 INFO:teuthology.run_tasks:Running task internal.connect... 2023-11-28T11:40:07.128 INFO:teuthology.task.internal:Opening connections... 2023-11-28T11:40:07.128 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi045.front.sepia.ceph.com 2023-11-28T11:40:07.129 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T11:40:07.201 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi152.front.sepia.ceph.com 2023-11-28T11:40:07.202 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T11:40:07.271 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-11-28T11:40:07.280 DEBUG:teuthology.orchestra.run.smithi045:> uname -m 2023-11-28T11:40:07.304 INFO:teuthology.orchestra.run.smithi045.stdout:x86_64 2023-11-28T11:40:07.304 DEBUG:teuthology.orchestra.run.smithi045:> cat /etc/os-release 2023-11-28T11:40:07.367 INFO:teuthology.orchestra.run.smithi045.stdout:NAME="CentOS Stream" 2023-11-28T11:40:07.367 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION="8" 2023-11-28T11:40:07.367 INFO:teuthology.orchestra.run.smithi045.stdout:ID="centos" 2023-11-28T11:40:07.367 INFO:teuthology.orchestra.run.smithi045.stdout:ID_LIKE="rhel fedora" 2023-11-28T11:40:07.367 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION_ID="8" 2023-11-28T11:40:07.367 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM_ID="platform:el8" 2023-11-28T11:40:07.367 INFO:teuthology.orchestra.run.smithi045.stdout:PRETTY_NAME="CentOS Stream 8" 2023-11-28T11:40:07.368 INFO:teuthology.orchestra.run.smithi045.stdout:ANSI_COLOR="0;31" 2023-11-28T11:40:07.368 INFO:teuthology.orchestra.run.smithi045.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-11-28T11:40:07.368 INFO:teuthology.orchestra.run.smithi045.stdout:HOME_URL="https://centos.org/" 2023-11-28T11:40:07.368 INFO:teuthology.orchestra.run.smithi045.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-28T11:40:07.368 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-28T11:40:07.368 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-28T11:40:07.369 INFO:teuthology.lock.ops:Updating smithi045.front.sepia.ceph.com on lock server 2023-11-28T11:40:07.390 DEBUG:teuthology.orchestra.run.smithi152:> uname -m 2023-11-28T11:40:07.412 INFO:teuthology.orchestra.run.smithi152.stdout:x86_64 2023-11-28T11:40:07.412 DEBUG:teuthology.orchestra.run.smithi152:> cat /etc/os-release 2023-11-28T11:40:07.472 INFO:teuthology.orchestra.run.smithi152.stdout:NAME="CentOS Stream" 2023-11-28T11:40:07.473 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION="8" 2023-11-28T11:40:07.473 INFO:teuthology.orchestra.run.smithi152.stdout:ID="centos" 2023-11-28T11:40:07.473 INFO:teuthology.orchestra.run.smithi152.stdout:ID_LIKE="rhel fedora" 2023-11-28T11:40:07.473 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_ID="8" 2023-11-28T11:40:07.473 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM_ID="platform:el8" 2023-11-28T11:40:07.473 INFO:teuthology.orchestra.run.smithi152.stdout:PRETTY_NAME="CentOS Stream 8" 2023-11-28T11:40:07.473 INFO:teuthology.orchestra.run.smithi152.stdout:ANSI_COLOR="0;31" 2023-11-28T11:40:07.473 INFO:teuthology.orchestra.run.smithi152.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-11-28T11:40:07.473 INFO:teuthology.orchestra.run.smithi152.stdout:HOME_URL="https://centos.org/" 2023-11-28T11:40:07.473 INFO:teuthology.orchestra.run.smithi152.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-28T11:40:07.473 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-28T11:40:07.473 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-28T11:40:07.474 INFO:teuthology.lock.ops:Updating smithi152.front.sepia.ceph.com on lock server 2023-11-28T11:40:07.489 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-11-28T11:40:07.499 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-11-28T11:40:07.504 INFO:teuthology.task.internal:Checking for old test directory... 2023-11-28T11:40:07.504 DEBUG:teuthology.orchestra.run.smithi045:> test '!' -e /home/ubuntu/cephtest 2023-11-28T11:40:07.506 DEBUG:teuthology.orchestra.run.smithi152:> test '!' -e /home/ubuntu/cephtest 2023-11-28T11:40:07.532 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-11-28T11:40:07.539 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-11-28T11:40:07.539 DEBUG:teuthology.orchestra.run.smithi045:> test -z $(ls -A /var/lib/ceph) 2023-11-28T11:40:07.569 DEBUG:teuthology.orchestra.run.smithi152:> test -z $(ls -A /var/lib/ceph) 2023-11-28T11:40:07.600 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-11-28T11:40:07.664 INFO:teuthology.run_tasks:Running task kernel... 2023-11-28T11:40:07.679 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'} 2023-11-28T11:40:07.679 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2023-11-28T11:40:07.679 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2023-11-28T11:40:07.679 DEBUG:teuthology.orchestra.run.smithi045:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-28T11:40:07.680 DEBUG:teuthology.orchestra.run.smithi152:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-28T11:40:07.699 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T11:40:07.700 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&ref=testing 2023-11-28T11:40:07.703 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T11:40:07.704 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&ref=testing 2023-11-28T11:40:07.862 DEBUG:teuthology.task.kernel:sha1 for client.1 is 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-28T11:40:07.862 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "8247bbb5b470f7e2a1f3eefcc16e24cf1338f606"... 2023-11-28T11:40:07.862 DEBUG:teuthology.orchestra.run.smithi152:> uname -r 2023-11-28T11:40:07.874 DEBUG:teuthology.task.kernel:sha1 for client.0 is 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-28T11:40:07.874 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "8247bbb5b470f7e2a1f3eefcc16e24cf1338f606"... 2023-11-28T11:40:07.875 DEBUG:teuthology.orchestra.run.smithi045:> uname -r 2023-11-28T11:40:07.883 INFO:teuthology.orchestra.run.smithi152.stdout:4.18.0-489.el8.x86_64 2023-11-28T11:40:07.883 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-489.el8.x86_64 vs 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-28T11:40:07.884 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-11-28T11:40:07.884 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum upgrade -y linux-firmware 2023-11-28T11:40:07.897 INFO:teuthology.orchestra.run.smithi045.stdout:4.18.0-489.el8.x86_64 2023-11-28T11:40:07.898 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-489.el8.x86_64 vs 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-28T11:40:07.898 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-11-28T11:40:07.898 DEBUG:teuthology.orchestra.run.smithi045:> sudo yum upgrade -y linux-firmware 2023-11-28T11:42:15.043 INFO:teuthology.orchestra.run.smithi045.stdout:CentOS Stream 8 - AppStream 281 kB/s | 34 MB 02:04 2023-11-28T11:42:24.033 INFO:teuthology.orchestra.run.smithi045.stdout:CentOS Stream 8 - BaseOS 23 MB/s | 55 MB 00:02 2023-11-28T11:42:32.617 INFO:teuthology.orchestra.run.smithi045.stdout:CentOS Stream 8 - Extras 61 kB/s | 18 kB 00:00 2023-11-28T11:42:32.951 INFO:teuthology.orchestra.run.smithi045.stdout:CentOS Stream 8 - Extras common packages 49 kB/s | 6.9 kB 00:00 2023-11-28T11:42:33.236 INFO:teuthology.orchestra.run.smithi045.stdout:Copr repo for python3-asyncssh owned by ceph 29 kB/s | 3.5 kB 00:00 2023-11-28T11:42:33.904 INFO:teuthology.orchestra.run.smithi045.stdout:Extra Packages for Enterprise Linux 32 MB/s | 16 MB 00:00 2023-11-28T11:42:37.911 INFO:teuthology.orchestra.run.smithi045.stdout:lab-extras 557 kB/s | 24 kB 00:00 2023-11-28T11:42:42.082 INFO:teuthology.orchestra.run.smithi045.stdout:Dependencies resolved. 2023-11-28T11:42:42.082 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2023-11-28T11:42:42.082 INFO:teuthology.orchestra.run.smithi045.stdout: Package Arch Version Repo Size 2023-11-28T11:42:42.083 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2023-11-28T11:42:42.083 INFO:teuthology.orchestra.run.smithi045.stdout:Upgrading: 2023-11-28T11:42:42.083 INFO:teuthology.orchestra.run.smithi045.stdout: linux-firmware noarch 20230824-118.git0e048b06.el8 baseos 286 M 2023-11-28T11:42:42.083 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T11:42:42.083 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction Summary 2023-11-28T11:42:42.083 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2023-11-28T11:42:42.083 INFO:teuthology.orchestra.run.smithi045.stdout:Upgrade 1 Package 2023-11-28T11:42:42.083 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T11:42:42.085 INFO:teuthology.orchestra.run.smithi045.stdout:Total download size: 286 M 2023-11-28T11:42:42.085 INFO:teuthology.orchestra.run.smithi045.stdout:Downloading Packages: 2023-11-28T11:42:55.312 INFO:teuthology.orchestra.run.smithi045.stdout:linux-firmware-20230824-118.git0e048b06.el8.noa 22 MB/s | 286 MB 00:13 2023-11-28T11:42:55.312 INFO:teuthology.orchestra.run.smithi045.stdout:-------------------------------------------------------------------------------- 2023-11-28T11:42:55.312 INFO:teuthology.orchestra.run.smithi045.stdout:Total 22 MB/s | 286 MB 00:13 2023-11-28T11:42:57.099 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction check 2023-11-28T11:42:57.172 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction check succeeded. 2023-11-28T11:42:57.172 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction test 2023-11-28T11:42:59.041 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction test succeeded. 2023-11-28T11:42:59.070 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction 2023-11-28T11:43:19.537 INFO:teuthology.orchestra.run.smithi045.stdout: Preparing : 1/1 2023-11-28T11:43:19.931 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : linux-firmware-20230824-118.git0e048b06.el8.noarch 1/2 2023-11-28T11:43:20.161 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-11-28T11:43:20.438 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-11-28T11:43:20.438 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : linux-firmware-20230824-118.git0e048b06.el8.noarch 1/2 2023-11-28T11:43:21.378 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-11-28T11:43:21.378 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T11:43:21.378 INFO:teuthology.orchestra.run.smithi045.stdout:Upgraded: 2023-11-28T11:43:21.378 INFO:teuthology.orchestra.run.smithi045.stdout: linux-firmware-20230824-118.git0e048b06.el8.noarch 2023-11-28T11:43:21.378 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T11:43:21.378 INFO:teuthology.orchestra.run.smithi045.stdout:Complete! 2023-11-28T11:43:21.548 INFO:teuthology.task.kernel:Downloading kernel 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 on client.0... 2023-11-28T11:43:21.549 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-28T11:43:21.771 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/centos/8/flavors/default/x86_64/ 2023-11-28T11:43:21.771 DEBUG:teuthology.orchestra.run.smithi045:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.6.0_g8247bbb5b470-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/centos/8/flavors/default/x86_64/ --input-file=- 2023-11-28T11:43:21.775 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi045.front.sepia.ceph.com to complete... 2023-11-28T11:43:27.459 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 8 - AppStream 178 kB/s | 34 MB 03:16 2023-11-28T11:43:34.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28 11:43:34 URL:https://4.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/centos/8/flavors/default/x86_64/kernel-6.6.0_g8247bbb5b470-1.x86_64.rpm [383178732/383178732] -> "/tmp/kernel.x86_64.rpm" [1] 2023-11-28T11:43:34.929 INFO:teuthology.orchestra.run.smithi045.stderr:FINISHED --2023-11-28 11:43:34-- 2023-11-28T11:43:34.929 INFO:teuthology.orchestra.run.smithi045.stderr:Total wall clock time: 13s 2023-11-28T11:43:34.929 INFO:teuthology.orchestra.run.smithi045.stderr:Downloaded: 1 files, 365M in 13s (28.4 MB/s) 2023-11-28T11:43:34.931 INFO:teuthology.task.kernel:Installing kernel 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 on client.0... 2023-11-28T11:43:34.931 DEBUG:teuthology.orchestra.run.smithi045:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-11-28T11:43:35.925 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 8 - BaseOS 24 MB/s | 55 MB 00:02 2023-11-28T11:43:36.711 INFO:teuthology.orchestra.run.smithi045.stdout:Verifying... ######################################## 2023-11-28T11:43:36.756 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing... ######################################## 2023-11-28T11:43:36.872 INFO:teuthology.orchestra.run.smithi045.stdout:Updating / installing... 2023-11-28T11:43:43.983 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 8 - Extras 62 kB/s | 18 kB 00:00 2023-11-28T11:43:44.467 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 8 - Extras common packages 23 kB/s | 6.9 kB 00:00 2023-11-28T11:43:44.802 INFO:teuthology.orchestra.run.smithi152.stdout:Copr repo for python3-asyncssh owned by ceph 19 kB/s | 3.5 kB 00:00 2023-11-28T11:43:46.386 INFO:teuthology.orchestra.run.smithi152.stdout:Extra Packages for Enterprise Linux 11 MB/s | 16 MB 00:01 2023-11-28T11:43:50.170 INFO:teuthology.orchestra.run.smithi152.stdout:lab-extras 393 kB/s | 24 kB 00:00 2023-11-28T11:43:54.169 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2023-11-28T11:43:54.170 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-11-28T11:43:54.170 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repo Size 2023-11-28T11:43:54.170 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-11-28T11:43:54.170 INFO:teuthology.orchestra.run.smithi152.stdout:Upgrading: 2023-11-28T11:43:54.170 INFO:teuthology.orchestra.run.smithi152.stdout: linux-firmware noarch 20230824-118.git0e048b06.el8 baseos 286 M 2023-11-28T11:43:54.170 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-11-28T11:43:54.170 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2023-11-28T11:43:54.171 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2023-11-28T11:43:54.171 INFO:teuthology.orchestra.run.smithi152.stdout:Upgrade 1 Package 2023-11-28T11:43:54.171 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-11-28T11:43:54.171 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 286 M 2023-11-28T11:43:54.171 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2023-11-28T11:44:07.612 INFO:teuthology.orchestra.run.smithi152.stdout:linux-firmware-20230824-118.git0e048b06.el8.noa 21 MB/s | 286 MB 00:13 2023-11-28T11:44:07.612 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2023-11-28T11:44:07.612 INFO:teuthology.orchestra.run.smithi152.stdout:Total 21 MB/s | 286 MB 00:13 2023-11-28T11:44:09.357 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2023-11-28T11:44:09.441 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2023-11-28T11:44:09.441 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2023-11-28T11:44:11.241 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2023-11-28T11:44:11.266 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2023-11-28T11:44:17.633 INFO:teuthology.orchestra.run.smithi045.stdout:kernel-6.6.0_g8247bbb5b470-1 ######################################## 2023-11-28T11:44:21.886 INFO:teuthology.orchestra.run.smithi045.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2023-11-28T11:44:30.336 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2023-11-28T11:44:30.696 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : linux-firmware-20230824-118.git0e048b06.el8.noarch 1/2 2023-11-28T11:44:30.917 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-11-28T11:44:31.156 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-11-28T11:44:31.156 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : linux-firmware-20230824-118.git0e048b06.el8.noarch 1/2 2023-11-28T11:44:31.971 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-11-28T11:44:31.971 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-11-28T11:44:31.972 INFO:teuthology.orchestra.run.smithi152.stdout:Upgraded: 2023-11-28T11:44:31.972 INFO:teuthology.orchestra.run.smithi152.stdout: linux-firmware-20230824-118.git0e048b06.el8.noarch 2023-11-28T11:44:31.972 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-11-28T11:44:31.972 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2023-11-28T11:44:32.148 INFO:teuthology.task.kernel:Downloading kernel 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 on client.1... 2023-11-28T11:44:32.149 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-28T11:44:32.423 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/centos/8/flavors/default/x86_64/ 2023-11-28T11:44:32.423 DEBUG:teuthology.orchestra.run.smithi152:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.6.0_g8247bbb5b470-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/centos/8/flavors/default/x86_64/ --input-file=- 2023-11-28T11:44:32.426 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi152.front.sepia.ceph.com to complete... 2023-11-28T11:44:41.781 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi045.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-11-28T11:44:41.781 DEBUG:teuthology.orchestra.run.smithi045:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-11-28T11:44:41.839 INFO:teuthology.orchestra.run.smithi045.stdout:/boot/System.map-6.6.0-g8247bbb5b470 2023-11-28T11:44:41.839 INFO:teuthology.orchestra.run.smithi045.stdout:/boot/config-6.6.0-g8247bbb5b470 2023-11-28T11:44:41.839 INFO:teuthology.orchestra.run.smithi045.stdout:/boot/vmlinuz-6.6.0-g8247bbb5b470 2023-11-28T11:44:41.839 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470 2023-11-28T11:44:41.840 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel 2023-11-28T11:44:41.840 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch 2023-11-28T11:44:41.840 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86 2023-11-28T11:44:41.840 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto 2023-11-28T11:44:41.840 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-11-28T11:44:41.840 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-11-28T11:44:41.840 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-11-28T11:44:41.840 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-11-28T11:44:41.840 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-11-28T11:44:41.840 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-11-28T11:44:41.840 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-11-28T11:44:41.841 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crc32c-intel.ko 2023-11-28T11:44:41.841 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-11-28T11:44:41.841 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-11-28T11:44:41.841 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-11-28T11:44:41.841 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-11-28T11:44:41.841 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-avx2.ko 2023-11-28T11:44:41.841 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-11-28T11:44:41.841 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-11-28T11:44:41.841 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-11-28T11:44:41.841 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-11-28T11:44:41.841 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-11-28T11:44:41.841 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-11-28T11:44:41.842 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-11-28T11:44:41.842 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel 2023-11-28T11:44:41.842 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu 2023-11-28T11:44:41.842 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/mce 2023-11-28T11:44:41.842 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-11-28T11:44:41.842 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm 2023-11-28T11:44:41.842 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm-amd.ko 2023-11-28T11:44:41.842 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm-intel.ko 2023-11-28T11:44:41.842 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm.ko 2023-11-28T11:44:41.842 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto 2023-11-28T11:44:41.842 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ansi_cprng.ko 2023-11-28T11:44:41.843 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/anubis.ko 2023-11-28T11:44:41.843 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/arc4.ko 2023-11-28T11:44:41.843 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx 2023-11-28T11:44:41.843 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_memcpy.ko 2023-11-28T11:44:41.843 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_pq.ko 2023-11-28T11:44:41.843 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_raid6_recov.ko 2023-11-28T11:44:41.843 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_tx.ko 2023-11-28T11:44:41.843 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_xor.ko 2023-11-28T11:44:41.843 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/raid6test.ko 2023-11-28T11:44:41.843 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/authenc.ko 2023-11-28T11:44:41.843 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/authencesn.ko 2023-11-28T11:44:41.843 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blake2b_generic.ko 2023-11-28T11:44:41.844 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blowfish_common.ko 2023-11-28T11:44:41.844 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blowfish_generic.ko 2023-11-28T11:44:41.844 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/camellia_generic.ko 2023-11-28T11:44:41.844 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast5_generic.ko 2023-11-28T11:44:41.844 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast6_generic.ko 2023-11-28T11:44:41.844 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast_common.ko 2023-11-28T11:44:41.844 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ccm.ko 2023-11-28T11:44:41.844 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cmac.ko 2023-11-28T11:44:41.844 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crc32_generic.ko 2023-11-28T11:44:41.844 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_engine.ko 2023-11-28T11:44:41.844 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_user.ko 2023-11-28T11:44:41.845 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cts.ko 2023-11-28T11:44:41.845 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/des_generic.ko 2023-11-28T11:44:41.845 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/dh_generic.ko 2023-11-28T11:44:41.845 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/echainiv.ko 2023-11-28T11:44:41.845 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/essiv.ko 2023-11-28T11:44:41.845 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/fcrypt.ko 2023-11-28T11:44:41.845 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/khazad.ko 2023-11-28T11:44:41.845 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lz4.ko 2023-11-28T11:44:41.845 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lz4hc.ko 2023-11-28T11:44:41.845 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/md4.ko 2023-11-28T11:44:41.845 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/michael_mic.ko 2023-11-28T11:44:41.845 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/pcbc.ko 2023-11-28T11:44:41.846 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/pcrypt.ko 2023-11-28T11:44:41.846 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/rmd160.ko 2023-11-28T11:44:41.846 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/seed.ko 2023-11-28T11:44:41.846 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/serpent_generic.ko 2023-11-28T11:44:41.846 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/tcrypt.ko 2023-11-28T11:44:41.846 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/tea.ko 2023-11-28T11:44:41.846 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/twofish_common.ko 2023-11-28T11:44:41.846 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/twofish_generic.ko 2023-11-28T11:44:41.846 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/vmac.ko 2023-11-28T11:44:41.846 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/wp512.ko 2023-11-28T11:44:41.846 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xcbc.ko 2023-11-28T11:44:41.846 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xor.ko 2023-11-28T11:44:41.847 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xxhash_generic.ko 2023-11-28T11:44:41.847 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers 2023-11-28T11:44:41.847 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi 2023-11-28T11:44:41.847 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_ipmi.ko 2023-11-28T11:44:41.847 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_pad.ko 2023-11-28T11:44:41.847 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/custom_method.ko 2023-11-28T11:44:41.847 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/ec_sys.ko 2023-11-28T11:44:41.847 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/platform_profile.ko 2023-11-28T11:44:41.847 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/sbs.ko 2023-11-28T11:44:41.847 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/sbshc.ko 2023-11-28T11:44:41.847 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/video.ko 2023-11-28T11:44:41.847 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata 2023-11-28T11:44:41.848 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/acard-ahci.ko 2023-11-28T11:44:41.848 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ahci_platform.ko 2023-11-28T11:44:41.848 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ata_generic.ko 2023-11-28T11:44:41.848 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/libahci_platform.ko 2023-11-28T11:44:41.848 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_acpi.ko 2023-11-28T11:44:41.848 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ali.ko 2023-11-28T11:44:41.848 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_amd.ko 2023-11-28T11:44:41.848 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_artop.ko 2023-11-28T11:44:41.848 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_atiixp.ko 2023-11-28T11:44:41.848 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_atp867x.ko 2023-11-28T11:44:41.848 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cmd640.ko 2023-11-28T11:44:41.848 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cmd64x.ko 2023-11-28T11:44:41.849 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cypress.ko 2023-11-28T11:44:41.849 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_efar.ko 2023-11-28T11:44:41.849 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt366.ko 2023-11-28T11:44:41.849 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt37x.ko 2023-11-28T11:44:41.849 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt3x2n.ko 2023-11-28T11:44:41.849 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt3x3.ko 2023-11-28T11:44:41.849 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_it8213.ko 2023-11-28T11:44:41.849 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_it821x.ko 2023-11-28T11:44:41.849 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_jmicron.ko 2023-11-28T11:44:41.850 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_marvell.ko 2023-11-28T11:44:41.850 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_mpiix.ko 2023-11-28T11:44:41.850 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_netcell.ko 2023-11-28T11:44:41.850 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ninja32.ko 2023-11-28T11:44:41.850 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ns87410.ko 2023-11-28T11:44:41.850 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ns87415.ko 2023-11-28T11:44:41.850 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_oldpiix.ko 2023-11-28T11:44:41.850 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_opti.ko 2023-11-28T11:44:41.850 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_optidma.ko 2023-11-28T11:44:41.850 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pcmcia.ko 2023-11-28T11:44:41.850 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pdc2027x.ko 2023-11-28T11:44:41.851 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-11-28T11:44:41.851 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_piccolo.ko 2023-11-28T11:44:41.851 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_rdc.ko 2023-11-28T11:44:41.851 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sch.ko 2023-11-28T11:44:41.851 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_serverworks.ko 2023-11-28T11:44:41.851 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sil680.ko 2023-11-28T11:44:41.851 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sis.ko 2023-11-28T11:44:41.851 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sl82c105.ko 2023-11-28T11:44:41.851 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_triflex.ko 2023-11-28T11:44:41.851 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_via.ko 2023-11-28T11:44:41.852 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pdc_adma.ko 2023-11-28T11:44:41.852 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_inic162x.ko 2023-11-28T11:44:41.852 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_mv.ko 2023-11-28T11:44:41.852 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_nv.ko 2023-11-28T11:44:41.852 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_promise.ko 2023-11-28T11:44:41.852 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_qstor.ko 2023-11-28T11:44:41.852 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sil.ko 2023-11-28T11:44:41.852 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sil24.ko 2023-11-28T11:44:41.852 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sis.ko 2023-11-28T11:44:41.852 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_svw.ko 2023-11-28T11:44:41.852 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sx4.ko 2023-11-28T11:44:41.852 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_uli.ko 2023-11-28T11:44:41.853 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_via.ko 2023-11-28T11:44:41.853 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_vsc.ko 2023-11-28T11:44:41.853 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/auxdisplay 2023-11-28T11:44:41.853 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/auxdisplay/ks0108.ko 2023-11-28T11:44:41.853 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/base 2023-11-28T11:44:41.853 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/base/regmap 2023-11-28T11:44:41.853 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/base/regmap/regmap-i2c.ko 2023-11-28T11:44:41.853 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/base/regmap/regmap-mmio.ko 2023-11-28T11:44:41.853 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/bcma 2023-11-28T11:44:41.853 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/bcma/bcma.ko 2023-11-28T11:44:41.853 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block 2023-11-28T11:44:41.853 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/aoe 2023-11-28T11:44:41.854 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/aoe/aoe.ko 2023-11-28T11:44:41.854 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/brd.ko 2023-11-28T11:44:41.854 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/drbd 2023-11-28T11:44:41.854 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/drbd/drbd.ko 2023-11-28T11:44:41.854 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/floppy.ko 2023-11-28T11:44:41.854 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/loop.ko 2023-11-28T11:44:41.854 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/mtip32xx 2023-11-28T11:44:41.854 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-11-28T11:44:41.854 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/nbd.ko 2023-11-28T11:44:41.854 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/null_blk 2023-11-28T11:44:41.854 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/null_blk/null_blk.ko 2023-11-28T11:44:41.855 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/pktcdvd.ko 2023-11-28T11:44:41.855 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/rbd.ko 2023-11-28T11:44:41.855 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/virtio_blk.ko 2023-11-28T11:44:41.855 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkback 2023-11-28T11:44:41.855 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-11-28T11:44:41.855 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkfront.ko 2023-11-28T11:44:41.855 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/zram 2023-11-28T11:44:41.855 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/zram/zram.ko 2023-11-28T11:44:41.855 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char 2023-11-28T11:44:41.855 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hangcheck-timer.ko 2023-11-28T11:44:41.855 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random 2023-11-28T11:44:41.856 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/amd-rng.ko 2023-11-28T11:44:41.856 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/intel-rng.ko 2023-11-28T11:44:41.856 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-11-28T11:44:41.856 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/via-rng.ko 2023-11-28T11:44:41.856 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/virtio-rng.ko 2023-11-28T11:44:41.856 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi 2023-11-28T11:44:41.856 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-11-28T11:44:41.856 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-11-28T11:44:41.856 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-11-28T11:44:41.856 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_si.ko 2023-11-28T11:44:41.856 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-11-28T11:44:41.856 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-11-28T11:44:41.857 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/lp.ko 2023-11-28T11:44:41.857 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/mwave 2023-11-28T11:44:41.857 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/mwave/mwave.ko 2023-11-28T11:44:41.857 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ppdev.ko 2023-11-28T11:44:41.857 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tlclk.ko 2023-11-28T11:44:41.857 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm 2023-11-28T11:44:41.857 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm.ko 2023-11-28T11:44:41.857 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_atmel.ko 2023-11-28T11:44:41.857 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_infineon.ko 2023-11-28T11:44:41.857 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_nsc.ko 2023-11-28T11:44:41.857 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_tis.ko 2023-11-28T11:44:41.858 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-11-28T11:44:41.858 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/uv_mmtimer.ko 2023-11-28T11:44:41.858 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/virtio_console.ko 2023-11-28T11:44:41.858 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq 2023-11-28T11:44:41.858 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-11-28T11:44:41.858 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-11-28T11:44:41.858 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/p4-clockmod.ko 2023-11-28T11:44:41.858 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-11-28T11:44:41.858 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/powernow-k8.ko 2023-11-28T11:44:41.858 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/speedstep-lib.ko 2023-11-28T11:44:41.858 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto 2023-11-28T11:44:41.858 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp 2023-11-28T11:44:41.859 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-11-28T11:44:41.859 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ccp.ko 2023-11-28T11:44:41.859 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel 2023-11-28T11:44:41.859 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat 2023-11-28T11:44:41.859 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_common 2023-11-28T11:44:41.859 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-11-28T11:44:41.859 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-11-28T11:44:41.859 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-11-28T11:44:41.859 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/padlock-aes.ko 2023-11-28T11:44:41.859 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/padlock-sha.ko 2023-11-28T11:44:41.859 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/virtio 2023-11-28T11:44:41.859 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-11-28T11:44:41.860 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dca 2023-11-28T11:44:41.860 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dca/dca.ko 2023-11-28T11:44:41.860 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/devfreq 2023-11-28T11:44:41.860 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-11-28T11:44:41.860 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma 2023-11-28T11:44:41.860 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/dw 2023-11-28T11:44:41.860 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/dw/dw_dmac.ko 2023-11-28T11:44:41.860 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ioat 2023-11-28T11:44:41.860 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ioat/ioatdma.ko 2023-11-28T11:44:41.860 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac 2023-11-28T11:44:41.860 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/amd64_edac.ko 2023-11-28T11:44:41.860 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/e752x_edac.ko 2023-11-28T11:44:41.861 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/edac_mce_amd.ko 2023-11-28T11:44:41.861 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i3000_edac.ko 2023-11-28T11:44:41.861 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i3200_edac.ko 2023-11-28T11:44:41.861 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i5100_edac.ko 2023-11-28T11:44:41.861 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i5400_edac.ko 2023-11-28T11:44:41.861 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i7300_edac.ko 2023-11-28T11:44:41.861 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i7core_edac.ko 2023-11-28T11:44:41.861 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i82975x_edac.ko 2023-11-28T11:44:41.861 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/ie31200_edac.ko 2023-11-28T11:44:41.861 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/sb_edac.ko 2023-11-28T11:44:41.861 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/x38_edac.ko 2023-11-28T11:44:41.861 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware 2023-11-28T11:44:41.862 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/edd.ko 2023-11-28T11:44:41.862 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/iscsi_ibft.ko 2023-11-28T11:44:41.862 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio 2023-11-28T11:44:41.862 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-ich.ko 2023-11-28T11:44:41.862 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-viperboard.ko 2023-11-28T11:44:41.862 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid 2023-11-28T11:44:41.862 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-appleir.ko 2023-11-28T11:44:41.862 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-aureal.ko 2023-11-28T11:44:41.862 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-axff.ko 2023-11-28T11:44:41.862 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-dr.ko 2023-11-28T11:44:41.862 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-elecom.ko 2023-11-28T11:44:41.862 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-elo.ko 2023-11-28T11:44:41.863 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-emsff.ko 2023-11-28T11:44:41.863 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gaff.ko 2023-11-28T11:44:41.863 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gt683r.ko 2023-11-28T11:44:41.863 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gyration.ko 2023-11-28T11:44:41.863 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtek-kbd.ko 2023-11-28T11:44:41.863 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtek-mouse.ko 2023-11-28T11:44:41.863 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtekff.ko 2023-11-28T11:44:41.863 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-hyperv.ko 2023-11-28T11:44:41.863 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-icade.ko 2023-11-28T11:44:41.863 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-keytouch.ko 2023-11-28T11:44:41.863 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-kye.ko 2023-11-28T11:44:41.863 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lcpower.ko 2023-11-28T11:44:41.864 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-led.ko 2023-11-28T11:44:41.864 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lenovo.ko 2023-11-28T11:44:41.864 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech-dj.ko 2023-11-28T11:44:41.864 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-11-28T11:44:41.864 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-multitouch.ko 2023-11-28T11:44:41.864 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ortek.ko 2023-11-28T11:44:41.864 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-penmount.ko 2023-11-28T11:44:41.864 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-petalynx.ko 2023-11-28T11:44:41.864 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-picolcd.ko 2023-11-28T11:44:41.864 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-pl.ko 2023-11-28T11:44:41.864 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-plantronics.ko 2023-11-28T11:44:41.864 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-primax.ko 2023-11-28T11:44:41.865 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-rmi.ko 2023-11-28T11:44:41.865 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-arvo.ko 2023-11-28T11:44:41.865 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-common.ko 2023-11-28T11:44:41.865 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-isku.ko 2023-11-28T11:44:41.865 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-kone.ko 2023-11-28T11:44:41.865 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-11-28T11:44:41.865 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-konepure.ko 2023-11-28T11:44:41.865 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-11-28T11:44:41.865 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-lua.ko 2023-11-28T11:44:41.865 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-pyra.ko 2023-11-28T11:44:41.865 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-ryos.ko 2023-11-28T11:44:41.865 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-savu.ko 2023-11-28T11:44:41.866 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat.ko 2023-11-28T11:44:41.866 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-saitek.ko 2023-11-28T11:44:41.866 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-samsung.ko 2023-11-28T11:44:41.866 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sensor-hub.ko 2023-11-28T11:44:41.866 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sjoy.ko 2023-11-28T11:44:41.866 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sony.ko 2023-11-28T11:44:41.866 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-speedlink.ko 2023-11-28T11:44:41.866 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-steelseries.ko 2023-11-28T11:44:41.866 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sunplus.ko 2023-11-28T11:44:41.866 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-thrustmaster.ko 2023-11-28T11:44:41.866 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-tivo.ko 2023-11-28T11:44:41.867 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-tmff.ko 2023-11-28T11:44:41.867 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-topseed.ko 2023-11-28T11:44:41.867 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-twinhan.ko 2023-11-28T11:44:41.867 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-uclogic.ko 2023-11-28T11:44:41.867 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-waltop.ko 2023-11-28T11:44:41.867 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-wiimote.ko 2023-11-28T11:44:41.867 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-xinmo.ko 2023-11-28T11:44:41.867 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-zpff.ko 2023-11-28T11:44:41.867 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-zydacron.ko 2023-11-28T11:44:41.867 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/uhid.ko 2023-11-28T11:44:41.867 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/wacom.ko 2023-11-28T11:44:41.867 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv 2023-11-28T11:44:41.868 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_balloon.ko 2023-11-28T11:44:41.868 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_utils.ko 2023-11-28T11:44:41.868 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_vmbus.ko 2023-11-28T11:44:41.868 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon 2023-11-28T11:44:41.868 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/abituguru.ko 2023-11-28T11:44:41.868 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/abituguru3.ko 2023-11-28T11:44:41.868 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/acpi_power_meter.ko 2023-11-28T11:44:41.868 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ad7414.ko 2023-11-28T11:44:41.868 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ad7418.ko 2023-11-28T11:44:41.868 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adc128d818.ko 2023-11-28T11:44:41.868 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1025.ko 2023-11-28T11:44:41.868 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1026.ko 2023-11-28T11:44:41.869 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1029.ko 2023-11-28T11:44:41.869 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1031.ko 2023-11-28T11:44:41.869 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm9240.ko 2023-11-28T11:44:41.869 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ads7828.ko 2023-11-28T11:44:41.869 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7410.ko 2023-11-28T11:44:41.869 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7411.ko 2023-11-28T11:44:41.869 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7462.ko 2023-11-28T11:44:41.869 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7470.ko 2023-11-28T11:44:41.869 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7475.ko 2023-11-28T11:44:41.869 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7x10.ko 2023-11-28T11:44:41.869 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/amc6821.ko 2023-11-28T11:44:41.870 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/applesmc.ko 2023-11-28T11:44:41.870 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asb100.ko 2023-11-28T11:44:41.870 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asc7621.ko 2023-11-28T11:44:41.870 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asus_atk0110.ko 2023-11-28T11:44:41.870 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/atxp1.ko 2023-11-28T11:44:41.870 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/coretemp.ko 2023-11-28T11:44:41.870 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-11-28T11:44:41.870 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/dme1737.ko 2023-11-28T11:44:41.870 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ds1621.ko 2023-11-28T11:44:41.870 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ds620.ko 2023-11-28T11:44:41.870 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc1403.ko 2023-11-28T11:44:41.870 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc6w201.ko 2023-11-28T11:44:41.871 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f71805f.ko 2023-11-28T11:44:41.871 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f71882fg.ko 2023-11-28T11:44:41.871 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f75375s.ko 2023-11-28T11:44:41.871 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/fam15h_power.ko 2023-11-28T11:44:41.871 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/fschmd.ko 2023-11-28T11:44:41.871 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/g760a.ko 2023-11-28T11:44:41.871 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/g762.ko 2023-11-28T11:44:41.871 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/gl518sm.ko 2023-11-28T11:44:41.871 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/gl520sm.ko 2023-11-28T11:44:41.871 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/hwmon-vid.ko 2023-11-28T11:44:41.871 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/i5500_temp.ko 2023-11-28T11:44:41.871 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/i5k_amb.ko 2023-11-28T11:44:41.872 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ibmaem.ko 2023-11-28T11:44:41.872 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ibmpex.ko 2023-11-28T11:44:41.872 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ina209.ko 2023-11-28T11:44:41.872 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ina2xx.ko 2023-11-28T11:44:41.872 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/it87.ko 2023-11-28T11:44:41.872 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/k10temp.ko 2023-11-28T11:44:41.872 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/k8temp.ko 2023-11-28T11:44:41.872 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lineage-pem.ko 2023-11-28T11:44:41.872 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm63.ko 2023-11-28T11:44:41.872 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm73.ko 2023-11-28T11:44:41.872 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm75.ko 2023-11-28T11:44:41.872 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm77.ko 2023-11-28T11:44:41.873 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm78.ko 2023-11-28T11:44:41.873 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm80.ko 2023-11-28T11:44:41.873 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm83.ko 2023-11-28T11:44:41.873 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm85.ko 2023-11-28T11:44:41.873 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm87.ko 2023-11-28T11:44:41.873 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm90.ko 2023-11-28T11:44:41.873 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm92.ko 2023-11-28T11:44:41.873 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm93.ko 2023-11-28T11:44:41.873 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95234.ko 2023-11-28T11:44:41.873 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95241.ko 2023-11-28T11:44:41.873 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95245.ko 2023-11-28T11:44:41.873 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc2945.ko 2023-11-28T11:44:41.874 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4151.ko 2023-11-28T11:44:41.874 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4215.ko 2023-11-28T11:44:41.874 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4222.ko 2023-11-28T11:44:41.874 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4245.ko 2023-11-28T11:44:41.874 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4260.ko 2023-11-28T11:44:41.874 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4261.ko 2023-11-28T11:44:41.874 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max16065.ko 2023-11-28T11:44:41.874 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max1619.ko 2023-11-28T11:44:41.874 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max1668.ko 2023-11-28T11:44:41.874 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max197.ko 2023-11-28T11:44:41.874 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6639.ko 2023-11-28T11:44:41.874 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6650.ko 2023-11-28T11:44:41.875 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6697.ko 2023-11-28T11:44:41.875 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/mcp3021.ko 2023-11-28T11:44:41.875 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6683.ko 2023-11-28T11:44:41.875 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6775-core.ko 2023-11-28T11:44:41.875 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6775.ko 2023-11-28T11:44:41.875 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct7802.ko 2023-11-28T11:44:41.875 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pc87360.ko 2023-11-28T11:44:41.875 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pc87427.ko 2023-11-28T11:44:41.875 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pcf8591.ko 2023-11-28T11:44:41.875 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus 2023-11-28T11:44:41.875 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-11-28T11:44:41.875 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-11-28T11:44:41.876 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-11-28T11:44:41.876 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max16064.ko 2023-11-28T11:44:41.876 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max34440.ko 2023-11-28T11:44:41.876 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max8688.ko 2023-11-28T11:44:41.876 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-11-28T11:44:41.876 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-11-28T11:44:41.876 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-11-28T11:44:41.876 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-11-28T11:44:41.876 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-11-28T11:44:41.876 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-11-28T11:44:41.876 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/powr1220.ko 2023-11-28T11:44:41.876 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch5627.ko 2023-11-28T11:44:41.877 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch5636.ko 2023-11-28T11:44:41.877 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch56xx-common.ko 2023-11-28T11:44:41.877 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sht15.ko 2023-11-28T11:44:41.877 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sht21.ko 2023-11-28T11:44:41.877 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/shtc1.ko 2023-11-28T11:44:41.877 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sis5595.ko 2023-11-28T11:44:41.877 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47b397.ko 2023-11-28T11:44:41.877 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47m1.ko 2023-11-28T11:44:41.877 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47m192.ko 2023-11-28T11:44:41.877 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/thmc50.ko 2023-11-28T11:44:41.877 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp102.ko 2023-11-28T11:44:41.877 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp103.ko 2023-11-28T11:44:41.878 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp401.ko 2023-11-28T11:44:41.878 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp421.ko 2023-11-28T11:44:41.878 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/via-cputemp.ko 2023-11-28T11:44:41.878 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/via686a.ko 2023-11-28T11:44:41.878 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/vt1211.ko 2023-11-28T11:44:41.878 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/vt8231.ko 2023-11-28T11:44:41.878 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83627ehf.ko 2023-11-28T11:44:41.878 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83627hf.ko 2023-11-28T11:44:41.878 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83781d.ko 2023-11-28T11:44:41.878 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83791d.ko 2023-11-28T11:44:41.878 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83792d.ko 2023-11-28T11:44:41.879 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83793.ko 2023-11-28T11:44:41.879 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83795.ko 2023-11-28T11:44:41.879 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83l785ts.ko 2023-11-28T11:44:41.879 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83l786ng.ko 2023-11-28T11:44:41.879 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c 2023-11-28T11:44:41.879 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos 2023-11-28T11:44:41.879 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-11-28T11:44:41.879 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-11-28T11:44:41.879 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses 2023-11-28T11:44:41.879 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-11-28T11:44:41.879 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-11-28T11:44:41.879 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-11-28T11:44:41.879 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-11-28T11:44:41.880 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-11-28T11:44:41.880 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-11-28T11:44:41.880 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-11-28T11:44:41.880 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-11-28T11:44:41.880 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-i801.ko 2023-11-28T11:44:41.880 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-isch.ko 2023-11-28T11:44:41.880 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-11-28T11:44:41.880 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-11-28T11:44:41.880 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-11-28T11:44:41.880 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-parport.ko 2023-11-28T11:44:41.880 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-11-28T11:44:41.880 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-11-28T11:44:41.881 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-11-28T11:44:41.881 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-11-28T11:44:41.881 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-11-28T11:44:41.881 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-11-28T11:44:41.881 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-via.ko 2023-11-28T11:44:41.881 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-11-28T11:44:41.881 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-11-28T11:44:41.881 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-dev.ko 2023-11-28T11:44:41.881 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-mux.ko 2023-11-28T11:44:41.881 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-11-28T11:44:41.881 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-smbus.ko 2023-11-28T11:44:41.881 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-stub.ko 2023-11-28T11:44:41.882 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband 2023-11-28T11:44:41.882 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core 2023-11-28T11:44:41.882 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_cm.ko 2023-11-28T11:44:41.882 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_core.ko 2023-11-28T11:44:41.882 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_umad.ko 2023-11-28T11:44:41.882 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-11-28T11:44:41.882 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/iw_cm.ko 2023-11-28T11:44:41.882 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/rdma_cm.ko 2023-11-28T11:44:41.882 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-11-28T11:44:41.882 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw 2023-11-28T11:44:41.882 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/cxgb4 2023-11-28T11:44:41.883 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-11-28T11:44:41.883 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx4 2023-11-28T11:44:41.883 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-11-28T11:44:41.883 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx5 2023-11-28T11:44:41.883 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-11-28T11:44:41.883 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mthca 2023-11-28T11:44:41.883 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-11-28T11:44:41.883 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp 2023-11-28T11:44:41.883 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ipoib 2023-11-28T11:44:41.883 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-11-28T11:44:41.883 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/iser 2023-11-28T11:44:41.883 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-11-28T11:44:41.884 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/isert 2023-11-28T11:44:41.884 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-11-28T11:44:41.884 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srp 2023-11-28T11:44:41.884 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-11-28T11:44:41.884 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srpt 2023-11-28T11:44:41.884 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-11-28T11:44:41.884 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input 2023-11-28T11:44:41.884 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport 2023-11-28T11:44:41.884 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-11-28T11:44:41.884 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/fm801-gp.ko 2023-11-28T11:44:41.884 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/gameport.ko 2023-11-28T11:44:41.884 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/joydev.ko 2023-11-28T11:44:41.885 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard 2023-11-28T11:44:41.885 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/gpio_keys.ko 2023-11-28T11:44:41.885 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse 2023-11-28T11:44:41.885 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/appletouch.ko 2023-11-28T11:44:41.885 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/bcm5974.ko 2023-11-28T11:44:41.885 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/cyapatp.ko 2023-11-28T11:44:41.885 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/elan_i2c.ko 2023-11-28T11:44:41.885 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/sermouse.ko 2023-11-28T11:44:41.885 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-11-28T11:44:41.885 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/synaptics_usb.ko 2023-11-28T11:44:41.885 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/vsxxxaa.ko 2023-11-28T11:44:41.885 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/rmi4 2023-11-28T11:44:41.886 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/rmi4/rmi_core.ko 2023-11-28T11:44:41.886 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio 2023-11-28T11:44:41.886 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/altera_ps2.ko 2023-11-28T11:44:41.886 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/arc_ps2.ko 2023-11-28T11:44:41.886 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-11-28T11:44:41.886 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/serio_raw.ko 2023-11-28T11:44:41.886 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/sparse-keymap.ko 2023-11-28T11:44:41.886 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu 2023-11-28T11:44:41.886 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/amd 2023-11-28T11:44:41.886 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/amd/iommu_v2.ko 2023-11-28T11:44:41.886 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds 2023-11-28T11:44:41.886 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-blinkm.ko 2023-11-28T11:44:41.887 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3530.ko 2023-11-28T11:44:41.887 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lp3944.ko 2023-11-28T11:44:41.887 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-ss4200.ko 2023-11-28T11:44:41.887 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger 2023-11-28T11:44:41.887 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-11-28T11:44:41.887 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-11-28T11:44:41.887 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-11-28T11:44:41.887 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-11-28T11:44:41.887 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-11-28T11:44:41.887 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-11-28T11:44:41.887 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-11-28T11:44:41.888 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-11-28T11:44:41.888 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md 2023-11-28T11:44:41.888 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/bcache 2023-11-28T11:44:41.888 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/bcache/bcache.ko 2023-11-28T11:44:41.888 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-bio-prison.ko 2023-11-28T11:44:41.888 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-cache-smq.ko 2023-11-28T11:44:41.888 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-cache.ko 2023-11-28T11:44:41.888 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-crypt.ko 2023-11-28T11:44:41.888 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-delay.ko 2023-11-28T11:44:41.888 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-flakey.ko 2023-11-28T11:44:41.888 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-log-userspace.ko 2023-11-28T11:44:41.888 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-multipath.ko 2023-11-28T11:44:41.889 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-queue-length.ko 2023-11-28T11:44:41.889 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-raid.ko 2023-11-28T11:44:41.889 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-round-robin.ko 2023-11-28T11:44:41.889 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-service-time.ko 2023-11-28T11:44:41.889 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-switch.ko 2023-11-28T11:44:41.889 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-thin-pool.ko 2023-11-28T11:44:41.889 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-verity.ko 2023-11-28T11:44:41.889 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/faulty.ko 2023-11-28T11:44:41.889 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/linear.ko 2023-11-28T11:44:41.889 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/multipath.ko 2023-11-28T11:44:41.889 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/persistent-data 2023-11-28T11:44:41.889 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-11-28T11:44:41.890 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid0.ko 2023-11-28T11:44:41.890 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid1.ko 2023-11-28T11:44:41.890 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid10.ko 2023-11-28T11:44:41.890 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid456.ko 2023-11-28T11:44:41.890 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message 2023-11-28T11:44:41.890 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion 2023-11-28T11:44:41.890 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptbase.ko 2023-11-28T11:44:41.890 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptctl.ko 2023-11-28T11:44:41.890 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptfc.ko 2023-11-28T11:44:41.890 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptlan.ko 2023-11-28T11:44:41.890 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptsas.ko 2023-11-28T11:44:41.890 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptscsih.ko 2023-11-28T11:44:41.891 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptspi.ko 2023-11-28T11:44:41.891 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd 2023-11-28T11:44:41.891 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lpc_ich.ko 2023-11-28T11:44:41.891 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lpc_sch.ko 2023-11-28T11:44:41.891 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/mfd-core.ko 2023-11-28T11:44:41.891 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/sm501.ko 2023-11-28T11:44:41.891 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/viperboard.ko 2023-11-28T11:44:41.891 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/vx855.ko 2023-11-28T11:44:41.891 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/wl1273-core.ko 2023-11-28T11:44:41.891 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc 2023-11-28T11:44:41.891 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/altera-stapl 2023-11-28T11:44:41.891 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-11-28T11:44:41.892 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/apds9802als.ko 2023-11-28T11:44:41.892 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/apds990x.ko 2023-11-28T11:44:41.892 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/bh1770glc.ko 2023-11-28T11:44:41.892 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/cb710 2023-11-28T11:44:41.892 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/cb710/cb710.ko 2023-11-28T11:44:41.892 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom 2023-11-28T11:44:41.892 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/at24.ko 2023-11-28T11:44:41.892 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/eeprom.ko 2023-11-28T11:44:41.892 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-11-28T11:44:41.892 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/max6875.ko 2023-11-28T11:44:41.892 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/enclosure.ko 2023-11-28T11:44:41.893 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/hpilo.ko 2023-11-28T11:44:41.893 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/isl29003.ko 2023-11-28T11:44:41.893 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/isl29020.ko 2023-11-28T11:44:41.893 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d 2023-11-28T11:44:41.893 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-11-28T11:44:41.893 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-11-28T11:44:41.893 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei 2023-11-28T11:44:41.893 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei-me.ko 2023-11-28T11:44:41.893 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei-txe.ko 2023-11-28T11:44:41.893 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei.ko 2023-11-28T11:44:41.893 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/sgi-gru 2023-11-28T11:44:41.893 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/sgi-gru/gru.ko 2023-11-28T11:44:41.894 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/sgi-xp 2023-11-28T11:44:41.894 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/sgi-xp/xp.ko 2023-11-28T11:44:41.894 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/sgi-xp/xpc.ko 2023-11-28T11:44:41.894 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-11-28T11:44:41.894 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tifm_7xx1.ko 2023-11-28T11:44:41.894 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tifm_core.ko 2023-11-28T11:44:41.894 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tsl2550.ko 2023-11-28T11:44:41.894 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_balloon.ko 2023-11-28T11:44:41.894 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_vmci 2023-11-28T11:44:41.894 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-11-28T11:44:41.894 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net 2023-11-28T11:44:41.894 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/bonding 2023-11-28T11:44:41.895 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/bonding/bonding.ko 2023-11-28T11:44:41.895 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa 2023-11-28T11:44:41.895 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/b53 2023-11-28T11:44:41.895 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/b53/b53_common.ko 2023-11-28T11:44:41.895 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/bcm-sf2.ko 2023-11-28T11:44:41.895 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6060.ko 2023-11-28T11:44:41.895 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6xxx 2023-11-28T11:44:41.895 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-11-28T11:44:41.895 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dummy.ko 2023-11-28T11:44:41.895 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/eql.ko 2023-11-28T11:44:41.895 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet 2023-11-28T11:44:41.895 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com 2023-11-28T11:44:41.895 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-11-28T11:44:41.896 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-11-28T11:44:41.896 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-11-28T11:44:41.896 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-11-28T11:44:41.896 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390 2023-11-28T11:44:41.896 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/8390.ko 2023-11-28T11:44:41.896 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-11-28T11:44:41.896 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-11-28T11:44:41.896 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-11-28T11:44:41.896 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/adaptec 2023-11-28T11:44:41.896 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-11-28T11:44:41.896 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/agere 2023-11-28T11:44:41.896 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/agere/et131x.ko 2023-11-28T11:44:41.897 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/alteon 2023-11-28T11:44:41.897 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-11-28T11:44:41.897 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/altera 2023-11-28T11:44:41.897 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-11-28T11:44:41.897 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd 2023-11-28T11:44:41.897 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-11-28T11:44:41.897 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-11-28T11:44:41.897 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-11-28T11:44:41.897 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros 2023-11-28T11:44:41.897 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/alx 2023-11-28T11:44:41.897 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-11-28T11:44:41.897 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1c 2023-11-28T11:44:41.898 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-11-28T11:44:41.898 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1e 2023-11-28T11:44:41.898 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-11-28T11:44:41.898 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx 2023-11-28T11:44:41.898 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-11-28T11:44:41.898 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-11-28T11:44:41.898 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom 2023-11-28T11:44:41.898 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-11-28T11:44:41.898 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-11-28T11:44:41.898 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-11-28T11:44:41.898 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-11-28T11:44:41.899 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-11-28T11:44:41.899 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/genet 2023-11-28T11:44:41.899 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-11-28T11:44:41.899 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-11-28T11:44:41.899 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade 2023-11-28T11:44:41.899 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/bna 2023-11-28T11:44:41.899 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-11-28T11:44:41.899 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio 2023-11-28T11:44:41.899 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb 2023-11-28T11:44:41.899 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-11-28T11:44:41.899 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-11-28T11:44:41.899 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-11-28T11:44:41.899 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-11-28T11:44:41.900 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-11-28T11:44:41.900 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-11-28T11:44:41.900 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-11-28T11:44:41.900 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-11-28T11:44:41.900 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-11-28T11:44:41.900 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco 2023-11-28T11:44:41.900 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/enic 2023-11-28T11:44:41.900 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-11-28T11:44:41.900 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec 2023-11-28T11:44:41.900 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip 2023-11-28T11:44:41.900 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-11-28T11:44:41.900 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-11-28T11:44:41.901 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-11-28T11:44:41.901 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-11-28T11:44:41.901 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-11-28T11:44:41.901 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-11-28T11:44:41.901 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink 2023-11-28T11:44:41.901 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-11-28T11:44:41.901 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-11-28T11:44:41.901 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dnet.ko 2023-11-28T11:44:41.901 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex 2023-11-28T11:44:41.901 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/benet 2023-11-28T11:44:41.901 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-11-28T11:44:41.901 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ethoc.ko 2023-11-28T11:44:41.902 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fealnx.ko 2023-11-28T11:44:41.902 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel 2023-11-28T11:44:41.902 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e100.ko 2023-11-28T11:44:41.902 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000 2023-11-28T11:44:41.902 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-11-28T11:44:41.902 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000e 2023-11-28T11:44:41.902 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-11-28T11:44:41.902 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/fm10k 2023-11-28T11:44:41.902 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-11-28T11:44:41.902 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/i40e 2023-11-28T11:44:41.902 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-11-28T11:44:41.903 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/iavf 2023-11-28T11:44:41.903 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-11-28T11:44:41.903 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igb 2023-11-28T11:44:41.903 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-11-28T11:44:41.903 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igbvf 2023-11-28T11:44:41.903 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-11-28T11:44:41.903 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbe 2023-11-28T11:44:41.903 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-11-28T11:44:41.903 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbevf 2023-11-28T11:44:41.903 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-11-28T11:44:41.903 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/jme.ko 2023-11-28T11:44:41.903 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell 2023-11-28T11:44:41.903 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-11-28T11:44:41.904 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/skge.ko 2023-11-28T11:44:41.904 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-11-28T11:44:41.904 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox 2023-11-28T11:44:41.904 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4 2023-11-28T11:44:41.904 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-11-28T11:44:41.904 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-11-28T11:44:41.904 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5 2023-11-28T11:44:41.904 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-11-28T11:44:41.904 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-11-28T11:44:41.904 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel 2023-11-28T11:44:41.904 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-11-28T11:44:41.904 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom 2023-11-28T11:44:41.905 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/myri10ge 2023-11-28T11:44:41.905 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-11-28T11:44:41.905 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi 2023-11-28T11:44:41.905 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-11-28T11:44:41.905 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-11-28T11:44:41.905 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/neterion 2023-11-28T11:44:41.905 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-11-28T11:44:41.905 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/nvidia 2023-11-28T11:44:41.905 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-11-28T11:44:41.905 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines 2023-11-28T11:44:41.905 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-11-28T11:44:41.905 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-11-28T11:44:41.906 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic 2023-11-28T11:44:41.906 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/netxen 2023-11-28T11:44:41.906 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-11-28T11:44:41.906 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-11-28T11:44:41.906 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-11-28T11:44:41.906 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-11-28T11:44:41.906 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rdc 2023-11-28T11:44:41.906 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-11-28T11:44:41.907 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek 2023-11-28T11:44:41.907 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-11-28T11:44:41.907 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-11-28T11:44:41.907 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/atp.ko 2023-11-28T11:44:41.907 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-11-28T11:44:41.907 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rocker 2023-11-28T11:44:41.907 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-11-28T11:44:41.907 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sfc 2023-11-28T11:44:41.907 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-11-28T11:44:41.907 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/silan 2023-11-28T11:44:41.907 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-11-28T11:44:41.907 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis 2023-11-28T11:44:41.908 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/sis190.ko 2023-11-28T11:44:41.908 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/sis900.ko 2023-11-28T11:44:41.908 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc 2023-11-28T11:44:41.908 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-11-28T11:44:41.908 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-11-28T11:44:41.908 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-11-28T11:44:41.908 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-11-28T11:44:41.908 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro 2023-11-28T11:44:41.908 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac 2023-11-28T11:44:41.908 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-11-28T11:44:41.908 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-11-28T11:44:41.908 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun 2023-11-28T11:44:41.908 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/cassini.ko 2023-11-28T11:44:41.909 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/niu.ko 2023-11-28T11:44:41.909 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/sungem.ko 2023-11-28T11:44:41.909 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-11-28T11:44:41.909 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/tehuti 2023-11-28T11:44:41.909 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-11-28T11:44:41.909 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ti 2023-11-28T11:44:41.909 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ti/tlan.ko 2023-11-28T11:44:41.909 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via 2023-11-28T11:44:41.909 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-11-28T11:44:41.909 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-11-28T11:44:41.909 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet 2023-11-28T11:44:41.910 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-11-28T11:44:41.910 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-11-28T11:44:41.910 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/xircom 2023-11-28T11:44:41.910 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-11-28T11:44:41.910 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/geneve.ko 2023-11-28T11:44:41.910 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/hyperv 2023-11-28T11:44:41.910 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-11-28T11:44:41.910 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ieee802154 2023-11-28T11:44:41.910 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ieee802154/fakelb.ko 2023-11-28T11:44:41.910 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ifb.ko 2023-11-28T11:44:41.910 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ipvlan 2023-11-28T11:44:41.910 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ipvlan/ipvlan.ko 2023-11-28T11:44:41.911 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/macvlan.ko 2023-11-28T11:44:41.911 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/macvtap.ko 2023-11-28T11:44:41.911 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio 2023-11-28T11:44:41.911 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio.ko 2023-11-28T11:44:41.911 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-11-28T11:44:41.911 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-11-28T11:44:41.911 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-regmap.ko 2023-11-28T11:44:41.911 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mii.ko 2023-11-28T11:44:41.911 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/net_failover.ko 2023-11-28T11:44:41.911 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/netconsole.ko 2023-11-28T11:44:41.911 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/nlmon.ko 2023-11-28T11:44:41.912 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs 2023-11-28T11:44:41.912 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/pcs-lynx.ko 2023-11-28T11:44:41.912 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-11-28T11:44:41.912 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy 2023-11-28T11:44:41.912 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/amd.ko 2023-11-28T11:44:41.912 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-11-28T11:44:41.912 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-11-28T11:44:41.912 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm7xxx.ko 2023-11-28T11:44:41.913 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm87xx.ko 2023-11-28T11:44:41.913 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/broadcom.ko 2023-11-28T11:44:41.913 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/cicada.ko 2023-11-28T11:44:41.913 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/davicom.ko 2023-11-28T11:44:41.913 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/dp83640.ko 2023-11-28T11:44:41.913 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/et1011c.ko 2023-11-28T11:44:41.913 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/icplus.ko 2023-11-28T11:44:41.913 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/lxt.ko 2023-11-28T11:44:41.913 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/marvell.ko 2023-11-28T11:44:41.913 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/micrel.ko 2023-11-28T11:44:41.913 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/national.ko 2023-11-28T11:44:41.913 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/phylink.ko 2023-11-28T11:44:41.913 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/qsemi.ko 2023-11-28T11:44:41.914 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/realtek.ko 2023-11-28T11:44:41.914 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/smsc.ko 2023-11-28T11:44:41.914 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/ste10Xp.ko 2023-11-28T11:44:41.914 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/vitesse.ko 2023-11-28T11:44:41.914 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp 2023-11-28T11:44:41.914 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/bsd_comp.ko 2023-11-28T11:44:41.914 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_async.ko 2023-11-28T11:44:41.914 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_deflate.ko 2023-11-28T11:44:41.914 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_generic.ko 2023-11-28T11:44:41.914 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_mppe.ko 2023-11-28T11:44:41.914 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_synctty.ko 2023-11-28T11:44:41.915 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pppoe.ko 2023-11-28T11:44:41.915 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pppox.ko 2023-11-28T11:44:41.915 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pptp.ko 2023-11-28T11:44:41.915 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip 2023-11-28T11:44:41.915 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip/slhc.ko 2023-11-28T11:44:41.915 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip/slip.ko 2023-11-28T11:44:41.915 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/sungem_phy.ko 2023-11-28T11:44:41.915 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/tap.ko 2023-11-28T11:44:41.915 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team 2023-11-28T11:44:41.915 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team.ko 2023-11-28T11:44:41.915 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_activebackup.ko 2023-11-28T11:44:41.915 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_broadcast.ko 2023-11-28T11:44:41.915 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-11-28T11:44:41.916 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_random.ko 2023-11-28T11:44:41.916 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-11-28T11:44:41.916 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/tun.ko 2023-11-28T11:44:41.916 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/veth.ko 2023-11-28T11:44:41.916 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/virtio_net.ko 2023-11-28T11:44:41.916 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vmxnet3 2023-11-28T11:44:41.916 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-11-28T11:44:41.916 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vxlan 2023-11-28T11:44:41.916 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vxlan/vxlan.ko 2023-11-28T11:44:41.916 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netback 2023-11-28T11:44:41.916 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netback/xen-netback.ko 2023-11-28T11:44:41.916 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netfront.ko 2023-11-28T11:44:41.917 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ntb 2023-11-28T11:44:41.917 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ntb/ntb.ko 2023-11-28T11:44:41.917 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme 2023-11-28T11:44:41.917 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host 2023-11-28T11:44:41.917 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/nvme-core.ko 2023-11-28T11:44:41.917 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/nvme.ko 2023-11-28T11:44:41.917 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport 2023-11-28T11:44:41.917 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport.ko 2023-11-28T11:44:41.917 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_cs.ko 2023-11-28T11:44:41.917 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_pc.ko 2023-11-28T11:44:41.917 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_serial.ko 2023-11-28T11:44:41.917 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci 2023-11-28T11:44:41.918 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug 2023-11-28T11:44:41.918 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-11-28T11:44:41.918 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/pcie 2023-11-28T11:44:41.918 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/pcie/aer_inject.ko 2023-11-28T11:44:41.918 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/xen-pcifront.ko 2023-11-28T11:44:41.918 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia 2023-11-28T11:44:41.918 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/i82092.ko 2023-11-28T11:44:41.918 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pd6729.ko 2023-11-28T11:44:41.918 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/yenta_socket.ko 2023-11-28T11:44:41.918 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl 2023-11-28T11:44:41.918 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/intel 2023-11-28T11:44:41.918 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-11-28T11:44:41.919 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform 2023-11-28T11:44:41.919 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86 2023-11-28T11:44:41.919 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/acer-wmi.ko 2023-11-28T11:44:41.919 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/acerhdf.ko 2023-11-28T11:44:41.919 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/apple-gmux.ko 2023-11-28T11:44:41.919 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-laptop.ko 2023-11-28T11:44:41.919 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-11-28T11:44:41.919 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-wmi.ko 2023-11-28T11:44:41.919 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/classmate-laptop.ko 2023-11-28T11:44:41.919 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-11-28T11:44:41.919 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-11-28T11:44:41.919 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-11-28T11:44:41.920 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-11-28T11:44:41.920 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/hdaps.ko 2023-11-28T11:44:41.920 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel 2023-11-28T11:44:41.920 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-11-28T11:44:41.920 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel_ips.ko 2023-11-28T11:44:41.920 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/msi-wmi.ko 2023-11-28T11:44:41.920 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/mxm-wmi.ko 2023-11-28T11:44:41.920 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-11-28T11:44:41.920 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/samsung-laptop.ko 2023-11-28T11:44:41.920 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/samsung-q10.ko 2023-11-28T11:44:41.920 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/topstar-laptop.ko 2023-11-28T11:44:41.920 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-11-28T11:44:41.921 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/toshiba_haps.ko 2023-11-28T11:44:41.921 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/wmi-bmof.ko 2023-11-28T11:44:41.921 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/wmi.ko 2023-11-28T11:44:41.921 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap 2023-11-28T11:44:41.921 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/intel_rapl_common.ko 2023-11-28T11:44:41.921 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/intel_rapl_msr.ko 2023-11-28T11:44:41.921 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps 2023-11-28T11:44:41.921 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients 2023-11-28T11:44:41.921 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps-gpio.ko 2023-11-28T11:44:41.921 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps-ldisc.ko 2023-11-28T11:44:41.921 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps_parport.ko 2023-11-28T11:44:41.922 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/pps_core.ko 2023-11-28T11:44:41.922 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp 2023-11-28T11:44:41.922 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ptp.ko 2023-11-28T11:44:41.922 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ptp_kvm.ko 2023-11-28T11:44:41.922 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc 2023-11-28T11:44:41.922 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-bq32k.ko 2023-11-28T11:44:41.922 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1286.ko 2023-11-28T11:44:41.922 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1307.ko 2023-11-28T11:44:41.922 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1374.ko 2023-11-28T11:44:41.922 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1511.ko 2023-11-28T11:44:41.922 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1553.ko 2023-11-28T11:44:41.922 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1672.ko 2023-11-28T11:44:41.923 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1742.ko 2023-11-28T11:44:41.923 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds2404.ko 2023-11-28T11:44:41.923 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds3232.ko 2023-11-28T11:44:41.923 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-em3027.ko 2023-11-28T11:44:41.923 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-fm3130.ko 2023-11-28T11:44:41.923 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-isl12022.ko 2023-11-28T11:44:41.923 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-isl1208.ko 2023-11-28T11:44:41.923 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m41t80.ko 2023-11-28T11:44:41.923 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t35.ko 2023-11-28T11:44:41.923 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t59.ko 2023-11-28T11:44:41.923 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max6900.ko 2023-11-28T11:44:41.923 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-msm6242.ko 2023-11-28T11:44:41.923 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf2127.ko 2023-11-28T11:44:41.924 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf85063.ko 2023-11-28T11:44:41.924 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8523.ko 2023-11-28T11:44:41.924 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8563.ko 2023-11-28T11:44:41.924 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8583.ko 2023-11-28T11:44:41.924 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rp5c01.ko 2023-11-28T11:44:41.924 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rs5c372.ko 2023-11-28T11:44:41.924 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-11-28T11:44:41.924 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rx8025.ko 2023-11-28T11:44:41.924 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rx8581.ko 2023-11-28T11:44:41.924 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-11-28T11:44:41.924 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-x1205.ko 2023-11-28T11:44:41.924 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi 2023-11-28T11:44:41.925 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-9xxx.ko 2023-11-28T11:44:41.925 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-sas.ko 2023-11-28T11:44:41.925 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-xxxx.ko 2023-11-28T11:44:41.925 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/BusLogic.ko 2023-11-28T11:44:41.925 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/a100u2w.ko 2023-11-28T11:44:41.925 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aacraid 2023-11-28T11:44:41.925 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aacraid/aacraid.ko 2023-11-28T11:44:41.925 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/advansys.ko 2023-11-28T11:44:41.925 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx 2023-11-28T11:44:41.925 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-11-28T11:44:41.925 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-11-28T11:44:41.925 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/am53c974.ko 2023-11-28T11:44:41.926 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/arcmsr 2023-11-28T11:44:41.926 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-11-28T11:44:41.926 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/atp870u.ko 2023-11-28T11:44:41.926 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/be2iscsi 2023-11-28T11:44:41.926 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-11-28T11:44:41.926 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bfa 2023-11-28T11:44:41.926 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bfa/bfa.ko 2023-11-28T11:44:41.926 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2fc 2023-11-28T11:44:41.926 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-11-28T11:44:41.926 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2i 2023-11-28T11:44:41.926 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-11-28T11:44:41.926 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ch.ko 2023-11-28T11:44:41.927 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/csiostor 2023-11-28T11:44:41.927 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/csiostor/csiostor.ko 2023-11-28T11:44:41.927 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi 2023-11-28T11:44:41.927 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb3i 2023-11-28T11:44:41.927 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-11-28T11:44:41.927 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb4i 2023-11-28T11:44:41.927 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-11-28T11:44:41.927 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-11-28T11:44:41.927 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/dc395x.ko 2023-11-28T11:44:41.927 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/device_handler 2023-11-28T11:44:41.927 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-11-28T11:44:41.927 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-11-28T11:44:41.928 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-11-28T11:44:41.928 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-11-28T11:44:41.928 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/dmx3191d.ko 2023-11-28T11:44:41.928 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esas2r 2023-11-28T11:44:41.928 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esas2r/esas2r.ko 2023-11-28T11:44:41.928 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esp_scsi.ko 2023-11-28T11:44:41.928 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe 2023-11-28T11:44:41.928 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/fcoe.ko 2023-11-28T11:44:41.928 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-11-28T11:44:41.928 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fnic 2023-11-28T11:44:41.928 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fnic/fnic.ko 2023-11-28T11:44:41.928 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hpsa.ko 2023-11-28T11:44:41.928 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hptiop.ko 2023-11-28T11:44:41.929 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hv_storvsc.ko 2023-11-28T11:44:41.929 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/initio.ko 2023-11-28T11:44:41.929 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ipr.ko 2023-11-28T11:44:41.929 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ips.ko 2023-11-28T11:44:41.929 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/isci 2023-11-28T11:44:41.929 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/isci/isci.ko 2023-11-28T11:44:41.929 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-11-28T11:44:41.929 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/iscsi_tcp.ko 2023-11-28T11:44:41.929 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libfc 2023-11-28T11:44:41.929 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libfc/libfc.ko 2023-11-28T11:44:41.929 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libiscsi.ko 2023-11-28T11:44:41.929 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libiscsi_tcp.ko 2023-11-28T11:44:41.930 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libsas 2023-11-28T11:44:41.930 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libsas/libsas.ko 2023-11-28T11:44:41.930 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/lpfc 2023-11-28T11:44:41.930 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/lpfc/lpfc.ko 2023-11-28T11:44:41.930 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid 2023-11-28T11:44:41.930 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid.ko 2023-11-28T11:44:41.930 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-11-28T11:44:41.930 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-11-28T11:44:41.930 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-11-28T11:44:41.930 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mpt3sas 2023-11-28T11:44:41.930 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-11-28T11:44:41.930 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvsas 2023-11-28T11:44:41.931 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvsas/mvsas.ko 2023-11-28T11:44:41.931 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvumi.ko 2023-11-28T11:44:41.931 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pm8001 2023-11-28T11:44:41.931 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-11-28T11:44:41.931 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pmcraid.ko 2023-11-28T11:44:41.931 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla1280.ko 2023-11-28T11:44:41.931 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx 2023-11-28T11:44:41.931 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-11-28T11:44:41.931 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-11-28T11:44:41.931 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla4xxx 2023-11-28T11:44:41.931 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-11-28T11:44:41.931 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/raid_class.ko 2023-11-28T11:44:41.932 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_debug.ko 2023-11-28T11:44:41.932 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_fc.ko 2023-11-28T11:44:41.932 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-11-28T11:44:41.932 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_sas.ko 2023-11-28T11:44:41.932 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_spi.ko 2023-11-28T11:44:41.932 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_srp.ko 2023-11-28T11:44:41.932 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ses.ko 2023-11-28T11:44:41.932 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/st.ko 2023-11-28T11:44:41.932 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/stex.ko 2023-11-28T11:44:41.932 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/sym53c8xx_2 2023-11-28T11:44:41.932 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-11-28T11:44:41.932 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/virtio_scsi.ko 2023-11-28T11:44:41.932 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/vmw_pvscsi.ko 2023-11-28T11:44:41.933 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/wd719x.ko 2023-11-28T11:44:41.933 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ssb 2023-11-28T11:44:41.933 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ssb/ssb.ko 2023-11-28T11:44:41.933 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target 2023-11-28T11:44:41.933 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/iscsi 2023-11-28T11:44:41.933 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-11-28T11:44:41.933 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/loopback 2023-11-28T11:44:41.933 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/loopback/tcm_loop.ko 2023-11-28T11:44:41.933 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_file.ko 2023-11-28T11:44:41.933 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_iblock.ko 2023-11-28T11:44:41.933 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_mod.ko 2023-11-28T11:44:41.933 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_pscsi.ko 2023-11-28T11:44:41.934 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_user.ko 2023-11-28T11:44:41.934 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/tcm_fc 2023-11-28T11:44:41.934 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-11-28T11:44:41.934 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal 2023-11-28T11:44:41.934 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel 2023-11-28T11:44:41.934 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal 2023-11-28T11:44:41.934 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-11-28T11:44:41.934 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-11-28T11:44:41.934 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-11-28T11:44:41.934 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-11-28T11:44:41.934 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-11-28T11:44:41.934 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-11-28T11:44:41.935 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-11-28T11:44:41.935 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-11-28T11:44:41.935 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-11-28T11:44:41.935 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-11-28T11:44:41.935 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-11-28T11:44:41.935 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-11-28T11:44:41.935 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-11-28T11:44:41.935 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-11-28T11:44:41.935 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-11-28T11:44:41.935 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty 2023-11-28T11:44:41.935 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ipwireless 2023-11-28T11:44:41.935 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-11-28T11:44:41.936 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/n_gsm.ko 2023-11-28T11:44:41.936 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/n_hdlc.ko 2023-11-28T11:44:41.936 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/nozomi.ko 2023-11-28T11:44:41.936 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial 2023-11-28T11:44:41.936 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250 2023-11-28T11:44:41.936 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-11-28T11:44:41.936 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/arc_uart.ko 2023-11-28T11:44:41.936 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/jsm 2023-11-28T11:44:41.936 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/jsm/jsm.ko 2023-11-28T11:44:41.936 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs 2023-11-28T11:44:41.936 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/core 2023-11-28T11:44:41.936 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/core/ufshcd-core.ko 2023-11-28T11:44:41.936 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host 2023-11-28T11:44:41.937 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-11-28T11:44:41.937 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio 2023-11-28T11:44:41.937 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio.ko 2023-11-28T11:44:41.937 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_aec.ko 2023-11-28T11:44:41.937 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_cif.ko 2023-11-28T11:44:41.937 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_pci_generic.ko 2023-11-28T11:44:41.937 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_sercos3.ko 2023-11-28T11:44:41.937 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb 2023-11-28T11:44:41.937 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class 2023-11-28T11:44:41.937 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/cdc-acm.ko 2023-11-28T11:44:41.937 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/cdc-wdm.ko 2023-11-28T11:44:41.937 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/usblp.ko 2023-11-28T11:44:41.938 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/usbtmc.ko 2023-11-28T11:44:41.938 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host 2023-11-28T11:44:41.938 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/sl811-hcd.ko 2023-11-28T11:44:41.938 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image 2023-11-28T11:44:41.938 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/mdc800.ko 2023-11-28T11:44:41.938 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/microtek.ko 2023-11-28T11:44:41.938 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc 2023-11-28T11:44:41.938 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/adutux.ko 2023-11-28T11:44:41.938 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/appledisplay.ko 2023-11-28T11:44:41.938 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/emi26.ko 2023-11-28T11:44:41.938 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/emi62.ko 2023-11-28T11:44:41.938 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ezusb.ko 2023-11-28T11:44:41.939 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/idmouse.ko 2023-11-28T11:44:41.939 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/iowarrior.ko 2023-11-28T11:44:41.939 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/isight_firmware.ko 2023-11-28T11:44:41.939 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ldusb.ko 2023-11-28T11:44:41.939 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/legousbtower.ko 2023-11-28T11:44:41.939 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/sisusbvga 2023-11-28T11:44:41.939 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-11-28T11:44:41.939 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/trancevibrator.ko 2023-11-28T11:44:41.939 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usb3503.ko 2023-11-28T11:44:41.939 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usblcd.ko 2023-11-28T11:44:41.939 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usbsevseg.ko 2023-11-28T11:44:41.939 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/uss720.ko 2023-11-28T11:44:41.940 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/yurex.ko 2023-11-28T11:44:41.940 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy 2023-11-28T11:44:41.940 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-generic.ko 2023-11-28T11:44:41.940 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial 2023-11-28T11:44:41.940 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/aircable.ko 2023-11-28T11:44:41.940 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ark3116.ko 2023-11-28T11:44:41.940 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/belkin_sa.ko 2023-11-28T11:44:41.940 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ch341.ko 2023-11-28T11:44:41.940 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cp210x.ko 2023-11-28T11:44:41.940 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cyberjack.ko 2023-11-28T11:44:41.940 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cypress_m8.ko 2023-11-28T11:44:41.940 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/digi_acceleport.ko 2023-11-28T11:44:41.941 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/empeg.ko 2023-11-28T11:44:41.941 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ftdi_sio.ko 2023-11-28T11:44:41.941 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/garmin_gps.ko 2023-11-28T11:44:41.941 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/io_edgeport.ko 2023-11-28T11:44:41.941 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/io_ti.ko 2023-11-28T11:44:41.941 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ipaq.ko 2023-11-28T11:44:41.941 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ipw.ko 2023-11-28T11:44:41.941 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ir-usb.ko 2023-11-28T11:44:41.941 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-11-28T11:44:41.941 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/keyspan.ko 2023-11-28T11:44:41.941 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/keyspan_pda.ko 2023-11-28T11:44:41.942 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/kl5kusb105.ko 2023-11-28T11:44:41.942 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/kobil_sct.ko 2023-11-28T11:44:41.942 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mct_u232.ko 2023-11-28T11:44:41.942 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mos7720.ko 2023-11-28T11:44:41.942 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mos7840.ko 2023-11-28T11:44:41.942 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/navman.ko 2023-11-28T11:44:41.942 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/omninet.ko 2023-11-28T11:44:41.942 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/opticon.ko 2023-11-28T11:44:41.942 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/option.ko 2023-11-28T11:44:41.942 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/oti6858.ko 2023-11-28T11:44:41.942 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/pl2303.ko 2023-11-28T11:44:41.942 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/qcaux.ko 2023-11-28T11:44:41.943 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/qcserial.ko 2023-11-28T11:44:41.943 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/quatech2.ko 2023-11-28T11:44:41.943 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/safe_serial.ko 2023-11-28T11:44:41.943 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/sierra.ko 2023-11-28T11:44:41.943 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/spcp8x5.ko 2023-11-28T11:44:41.943 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ssu100.ko 2023-11-28T11:44:41.943 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/symbolserial.ko 2023-11-28T11:44:41.943 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-11-28T11:44:41.943 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-11-28T11:44:41.943 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb_debug.ko 2023-11-28T11:44:41.943 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb_wwan.ko 2023-11-28T11:44:41.943 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/visor.ko 2023-11-28T11:44:41.944 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/whiteheat.ko 2023-11-28T11:44:41.944 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/xsens_mt.ko 2023-11-28T11:44:41.944 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage 2023-11-28T11:44:41.944 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/uas.ko 2023-11-28T11:44:41.944 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-alauda.ko 2023-11-28T11:44:41.944 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-cypress.ko 2023-11-28T11:44:41.944 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-datafab.ko 2023-11-28T11:44:41.944 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-11-28T11:44:41.944 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-freecom.ko 2023-11-28T11:44:41.944 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-isd200.ko 2023-11-28T11:44:41.944 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-11-28T11:44:41.944 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-karma.ko 2023-11-28T11:44:41.944 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-onetouch.ko 2023-11-28T11:44:41.945 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-realtek.ko 2023-11-28T11:44:41.945 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-sddr09.ko 2023-11-28T11:44:41.945 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-sddr55.ko 2023-11-28T11:44:41.945 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-usbat.ko 2023-11-28T11:44:41.945 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/usb-storage.ko 2023-11-28T11:44:41.945 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip 2023-11-28T11:44:41.945 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/usbip-core.ko 2023-11-28T11:44:41.945 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/usbip-host.ko 2023-11-28T11:44:41.945 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-11-28T11:44:41.945 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio 2023-11-28T11:44:41.945 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci 2023-11-28T11:44:41.945 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-11-28T11:44:41.946 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/vfio-pci.ko 2023-11-28T11:44:41.946 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/vfio.ko 2023-11-28T11:44:41.946 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-11-28T11:44:41.946 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost 2023-11-28T11:44:41.946 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost.ko 2023-11-28T11:44:41.946 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_iotlb.ko 2023-11-28T11:44:41.946 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_net.ko 2023-11-28T11:44:41.946 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_scsi.ko 2023-11-28T11:44:41.946 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video 2023-11-28T11:44:41.946 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight 2023-11-28T11:44:41.946 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/apple_bl.ko 2023-11-28T11:44:41.946 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lcd.ko 2023-11-28T11:44:41.947 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/platform_lcd.ko 2023-11-28T11:44:41.947 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio 2023-11-28T11:44:41.947 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio.ko 2023-11-28T11:44:41.947 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio_balloon.ko 2023-11-28T11:44:41.947 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio_mmio.ko 2023-11-28T11:44:41.947 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio_pci.ko 2023-11-28T11:44:41.947 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-11-28T11:44:41.947 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-11-28T11:44:41.947 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio_ring.ko 2023-11-28T11:44:41.947 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1 2023-11-28T11:44:41.947 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters 2023-11-28T11:44:41.947 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ds2482.ko 2023-11-28T11:44:41.947 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ds2490.ko 2023-11-28T11:44:41.948 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves 2023-11-28T11:44:41.948 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-11-28T11:44:41.948 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-11-28T11:44:41.948 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-11-28T11:44:41.948 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-11-28T11:44:41.948 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-11-28T11:44:41.948 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-11-28T11:44:41.948 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-11-28T11:44:41.948 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-11-28T11:44:41.948 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-11-28T11:44:41.948 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_smem.ko 2023-11-28T11:44:41.948 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_therm.ko 2023-11-28T11:44:41.949 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/wire.ko 2023-11-28T11:44:41.949 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog 2023-11-28T11:44:41.949 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/alim1535_wdt.ko 2023-11-28T11:44:41.949 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/alim7101_wdt.ko 2023-11-28T11:44:41.949 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/f71808e_wdt.ko 2023-11-28T11:44:41.949 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/hpwdt.ko 2023-11-28T11:44:41.949 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/i6300esb.ko 2023-11-28T11:44:41.949 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-11-28T11:44:41.949 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/iTCO_wdt.ko 2023-11-28T11:44:41.949 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ib700wdt.ko 2023-11-28T11:44:41.949 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ibmasr.ko 2023-11-28T11:44:41.949 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-11-28T11:44:41.950 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/it8712f_wdt.ko 2023-11-28T11:44:41.950 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/it87_wdt.ko 2023-11-28T11:44:41.950 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/machzwd.ko 2023-11-28T11:44:41.950 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/nv_tco.ko 2023-11-28T11:44:41.950 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pcwd_pci.ko 2023-11-28T11:44:41.950 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pcwd_usb.ko 2023-11-28T11:44:41.950 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-11-28T11:44:41.950 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sch311x_wdt.ko 2023-11-28T11:44:41.950 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/softdog.ko 2023-11-28T11:44:41.950 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sp5100_tco.ko 2023-11-28T11:44:41.950 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/via_wdt.ko 2023-11-28T11:44:41.950 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-11-28T11:44:41.951 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83877f_wdt.ko 2023-11-28T11:44:41.951 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83977f_wdt.ko 2023-11-28T11:44:41.951 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wdt_pci.ko 2023-11-28T11:44:41.951 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/xen_wdt.ko 2023-11-28T11:44:41.951 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen 2023-11-28T11:44:41.951 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-acpi-processor.ko 2023-11-28T11:44:41.951 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-evtchn.ko 2023-11-28T11:44:41.951 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-gntalloc.ko 2023-11-28T11:44:41.951 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-gntdev.ko 2023-11-28T11:44:41.951 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-pciback 2023-11-28T11:44:41.951 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-11-28T11:44:41.951 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-privcmd.ko 2023-11-28T11:44:41.952 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xenfs 2023-11-28T11:44:41.952 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xenfs/xenfs.ko 2023-11-28T11:44:41.952 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs 2023-11-28T11:44:41.952 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/9p 2023-11-28T11:44:41.952 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/9p/9p.ko 2023-11-28T11:44:41.952 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/affs 2023-11-28T11:44:41.952 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/affs/affs.ko 2023-11-28T11:44:41.952 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/befs 2023-11-28T11:44:41.952 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/befs/befs.ko 2023-11-28T11:44:41.952 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/binfmt_misc.ko 2023-11-28T11:44:41.952 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/btrfs 2023-11-28T11:44:41.952 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/btrfs/btrfs.ko 2023-11-28T11:44:41.952 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cachefiles 2023-11-28T11:44:41.953 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cachefiles/cachefiles.ko 2023-11-28T11:44:41.953 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ceph 2023-11-28T11:44:41.953 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ceph/ceph.ko 2023-11-28T11:44:41.953 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/coda 2023-11-28T11:44:41.953 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/coda/coda.ko 2023-11-28T11:44:41.953 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cramfs 2023-11-28T11:44:41.953 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cramfs/cramfs.ko 2023-11-28T11:44:41.953 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/dlm 2023-11-28T11:44:41.953 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/dlm/dlm.ko 2023-11-28T11:44:41.953 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ecryptfs 2023-11-28T11:44:41.953 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ecryptfs/ecryptfs.ko 2023-11-28T11:44:41.953 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/f2fs 2023-11-28T11:44:41.954 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/f2fs/f2fs.ko 2023-11-28T11:44:41.954 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat 2023-11-28T11:44:41.954 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/fat.ko 2023-11-28T11:44:41.954 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/msdos.ko 2023-11-28T11:44:41.954 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/vfat.ko 2023-11-28T11:44:41.954 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fscache 2023-11-28T11:44:41.954 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fscache/fscache.ko 2023-11-28T11:44:41.954 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse 2023-11-28T11:44:41.955 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse/cuse.ko 2023-11-28T11:44:41.955 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse/fuse.ko 2023-11-28T11:44:41.955 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/gfs2 2023-11-28T11:44:41.955 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/gfs2/gfs2.ko 2023-11-28T11:44:41.955 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfs 2023-11-28T11:44:41.955 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfs/hfs.ko 2023-11-28T11:44:41.955 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfsplus 2023-11-28T11:44:41.955 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfsplus/hfsplus.ko 2023-11-28T11:44:41.955 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/isofs 2023-11-28T11:44:41.955 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/isofs/isofs.ko 2023-11-28T11:44:41.955 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/jfs 2023-11-28T11:44:41.955 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/jfs/jfs.ko 2023-11-28T11:44:41.956 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/lockd 2023-11-28T11:44:41.956 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/lockd/lockd.ko 2023-11-28T11:44:41.956 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/minix 2023-11-28T11:44:41.956 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/minix/minix.ko 2023-11-28T11:44:41.956 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/netfs 2023-11-28T11:44:41.956 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/netfs/netfs.ko 2023-11-28T11:44:41.956 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs 2023-11-28T11:44:41.956 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/blocklayout 2023-11-28T11:44:41.956 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-11-28T11:44:41.956 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/filelayout 2023-11-28T11:44:41.956 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-11-28T11:44:41.957 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/flexfilelayout 2023-11-28T11:44:41.957 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-11-28T11:44:41.957 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfs.ko 2023-11-28T11:44:41.957 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv3.ko 2023-11-28T11:44:41.957 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv4.ko 2023-11-28T11:44:41.957 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common 2023-11-28T11:44:41.957 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/grace.ko 2023-11-28T11:44:41.957 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/nfs_acl.ko 2023-11-28T11:44:41.957 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfsd 2023-11-28T11:44:41.957 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfsd/nfsd.ko 2023-11-28T11:44:41.957 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nilfs2 2023-11-28T11:44:41.957 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nilfs2/nilfs2.ko 2023-11-28T11:44:41.958 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls 2023-11-28T11:44:41.958 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-celtic.ko 2023-11-28T11:44:41.958 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-centeuro.ko 2023-11-28T11:44:41.958 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-croatian.ko 2023-11-28T11:44:41.958 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-cyrillic.ko 2023-11-28T11:44:41.958 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-gaelic.ko 2023-11-28T11:44:41.958 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-greek.ko 2023-11-28T11:44:41.958 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-iceland.ko 2023-11-28T11:44:41.958 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-inuit.ko 2023-11-28T11:44:41.958 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-roman.ko 2023-11-28T11:44:41.958 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-romanian.ko 2023-11-28T11:44:41.958 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-turkish.ko 2023-11-28T11:44:41.958 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1250.ko 2023-11-28T11:44:41.959 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1251.ko 2023-11-28T11:44:41.959 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1255.ko 2023-11-28T11:44:41.959 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp737.ko 2023-11-28T11:44:41.959 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp775.ko 2023-11-28T11:44:41.959 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp850.ko 2023-11-28T11:44:41.959 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp852.ko 2023-11-28T11:44:41.959 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp855.ko 2023-11-28T11:44:41.959 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp857.ko 2023-11-28T11:44:41.959 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp860.ko 2023-11-28T11:44:41.959 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp861.ko 2023-11-28T11:44:41.959 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp862.ko 2023-11-28T11:44:41.959 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp863.ko 2023-11-28T11:44:41.960 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp864.ko 2023-11-28T11:44:41.960 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp865.ko 2023-11-28T11:44:41.960 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp866.ko 2023-11-28T11:44:41.960 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp869.ko 2023-11-28T11:44:41.960 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp874.ko 2023-11-28T11:44:41.960 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp932.ko 2023-11-28T11:44:41.960 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp936.ko 2023-11-28T11:44:41.960 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp949.ko 2023-11-28T11:44:41.960 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp950.ko 2023-11-28T11:44:41.960 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_euc-jp.ko 2023-11-28T11:44:41.960 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-1.ko 2023-11-28T11:44:41.960 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-13.ko 2023-11-28T11:44:41.961 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-14.ko 2023-11-28T11:44:41.961 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-15.ko 2023-11-28T11:44:41.961 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-2.ko 2023-11-28T11:44:41.961 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-3.ko 2023-11-28T11:44:41.961 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-4.ko 2023-11-28T11:44:41.961 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-5.ko 2023-11-28T11:44:41.961 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-6.ko 2023-11-28T11:44:41.961 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-7.ko 2023-11-28T11:44:41.961 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-9.ko 2023-11-28T11:44:41.961 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-r.ko 2023-11-28T11:44:41.961 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-ru.ko 2023-11-28T11:44:41.961 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-u.ko 2023-11-28T11:44:41.961 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_ucs2_utils.ko 2023-11-28T11:44:41.962 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_utf8.ko 2023-11-28T11:44:41.962 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2 2023-11-28T11:44:41.962 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/cluster 2023-11-28T11:44:41.962 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-11-28T11:44:41.962 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlm 2023-11-28T11:44:41.962 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-11-28T11:44:41.962 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlmfs 2023-11-28T11:44:41.962 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-11-28T11:44:41.962 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2.ko 2023-11-28T11:44:41.962 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-11-28T11:44:41.962 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-11-28T11:44:41.962 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-11-28T11:44:41.963 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/overlayfs 2023-11-28T11:44:41.963 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/overlayfs/overlay.ko 2023-11-28T11:44:41.963 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/pstore 2023-11-28T11:44:41.963 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/pstore/ramoops.ko 2023-11-28T11:44:41.963 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/reiserfs 2023-11-28T11:44:41.963 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/reiserfs/reiserfs.ko 2023-11-28T11:44:41.963 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/romfs 2023-11-28T11:44:41.963 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/romfs/romfs.ko 2023-11-28T11:44:41.963 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb 2023-11-28T11:44:41.963 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/client 2023-11-28T11:44:41.963 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/client/cifs.ko 2023-11-28T11:44:41.963 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common 2023-11-28T11:44:41.964 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/cifs_arc4.ko 2023-11-28T11:44:41.964 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/cifs_md4.ko 2023-11-28T11:44:41.964 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/squashfs 2023-11-28T11:44:41.964 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/squashfs/squashfs.ko 2023-11-28T11:44:41.964 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/sysv 2023-11-28T11:44:41.964 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/sysv/sysv.ko 2023-11-28T11:44:41.964 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/udf 2023-11-28T11:44:41.964 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/udf/udf.ko 2023-11-28T11:44:41.964 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ufs 2023-11-28T11:44:41.964 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ufs/ufs.ko 2023-11-28T11:44:41.964 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/xfs 2023-11-28T11:44:41.964 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/xfs/xfs.ko 2023-11-28T11:44:41.965 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/kernel 2023-11-28T11:44:41.965 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/rcu 2023-11-28T11:44:41.965 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/rcu/rcutorture.ko 2023-11-28T11:44:41.965 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/torture.ko 2023-11-28T11:44:41.965 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/trace 2023-11-28T11:44:41.965 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-11-28T11:44:41.965 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib 2023-11-28T11:44:41.965 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/asn1_encoder.ko 2023-11-28T11:44:41.965 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc-itu-t.ko 2023-11-28T11:44:41.965 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc8.ko 2023-11-28T11:44:41.965 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto 2023-11-28T11:44:41.966 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/libarc4.ko 2023-11-28T11:44:41.966 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/libdes.ko 2023-11-28T11:44:41.966 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/libcrc32c.ko 2023-11-28T11:44:41.966 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lru_cache.ko 2023-11-28T11:44:41.966 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4 2023-11-28T11:44:41.966 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/lz4_compress.ko 2023-11-28T11:44:41.966 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/lz4hc_compress.ko 2023-11-28T11:44:41.966 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/math 2023-11-28T11:44:41.966 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/math/cordic.ko 2023-11-28T11:44:41.966 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/raid6 2023-11-28T11:44:41.966 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/raid6/raid6_pq.ko 2023-11-28T11:44:41.966 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/reed_solomon 2023-11-28T11:44:41.967 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/reed_solomon/reed_solomon.ko 2023-11-28T11:44:41.967 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_bm.ko 2023-11-28T11:44:41.967 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_fsm.ko 2023-11-28T11:44:41.967 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_kmp.ko 2023-11-28T11:44:41.967 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/zstd 2023-11-28T11:44:41.967 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/zstd/zstd_compress.ko 2023-11-28T11:44:41.967 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/mm 2023-11-28T11:44:41.967 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/mm/hwpoison-inject.ko 2023-11-28T11:44:41.967 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net 2023-11-28T11:44:41.967 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan 2023-11-28T11:44:41.967 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/6lowpan.ko 2023-11-28T11:44:41.967 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_dest.ko 2023-11-28T11:44:41.968 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_fragment.ko 2023-11-28T11:44:41.968 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_hop.ko 2023-11-28T11:44:41.968 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_ipv6.ko 2023-11-28T11:44:41.968 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_mobility.ko 2023-11-28T11:44:41.968 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_routing.ko 2023-11-28T11:44:41.968 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_udp.ko 2023-11-28T11:44:41.968 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/802 2023-11-28T11:44:41.968 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/garp.ko 2023-11-28T11:44:41.968 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/mrp.ko 2023-11-28T11:44:41.968 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/p8022.ko 2023-11-28T11:44:41.968 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/psnap.ko 2023-11-28T11:44:41.968 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/stp.ko 2023-11-28T11:44:41.969 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/8021q 2023-11-28T11:44:41.969 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/8021q/8021q.ko 2023-11-28T11:44:41.969 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p 2023-11-28T11:44:41.969 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet.ko 2023-11-28T11:44:41.969 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_fd.ko 2023-11-28T11:44:41.969 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_rdma.ko 2023-11-28T11:44:41.969 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_virtio.ko 2023-11-28T11:44:41.969 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/batman-adv 2023-11-28T11:44:41.969 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/batman-adv/batman-adv.ko 2023-11-28T11:44:41.969 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge 2023-11-28T11:44:41.969 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/br_netfilter.ko 2023-11-28T11:44:41.969 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/bridge.ko 2023-11-28T11:44:41.970 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter 2023-11-28T11:44:41.970 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-11-28T11:44:41.970 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_among.ko 2023-11-28T11:44:41.970 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_arp.ko 2023-11-28T11:44:41.970 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-11-28T11:44:41.970 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-11-28T11:44:41.970 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_ip.ko 2023-11-28T11:44:41.970 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-11-28T11:44:41.970 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_limit.ko 2023-11-28T11:44:41.970 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_log.ko 2023-11-28T11:44:41.970 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_mark.ko 2023-11-28T11:44:41.970 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-11-28T11:44:41.971 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-11-28T11:44:41.971 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-11-28T11:44:41.971 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-11-28T11:44:41.971 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_snat.ko 2023-11-28T11:44:41.971 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_stp.ko 2023-11-28T11:44:41.971 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-11-28T11:44:41.971 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-11-28T11:44:41.971 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-11-28T11:44:41.971 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-11-28T11:44:41.971 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtables.ko 2023-11-28T11:44:41.971 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-11-28T11:44:41.971 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-11-28T11:44:41.972 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-11-28T11:44:41.972 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ceph 2023-11-28T11:44:41.972 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ceph/libceph.ko 2023-11-28T11:44:41.972 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/core 2023-11-28T11:44:41.972 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/core/failover.ko 2023-11-28T11:44:41.972 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/core/pktgen.ko 2023-11-28T11:44:41.972 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp 2023-11-28T11:44:41.972 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp.ko 2023-11-28T11:44:41.972 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_diag.ko 2023-11-28T11:44:41.972 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_ipv4.ko 2023-11-28T11:44:41.972 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_ipv6.ko 2023-11-28T11:44:41.972 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dns_resolver 2023-11-28T11:44:41.973 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dns_resolver/dns_resolver.ko 2023-11-28T11:44:41.973 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa 2023-11-28T11:44:41.973 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/dsa_core.ko 2023-11-28T11:44:41.973 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_brcm.ko 2023-11-28T11:44:41.973 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_dsa.ko 2023-11-28T11:44:41.973 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_none.ko 2023-11-28T11:44:41.973 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_trailer.ko 2023-11-28T11:44:41.973 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154 2023-11-28T11:44:41.973 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/6lowpan 2023-11-28T11:44:41.973 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-11-28T11:44:41.973 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ieee802154.ko 2023-11-28T11:44:41.973 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ieee802154_socket.ko 2023-11-28T11:44:41.974 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4 2023-11-28T11:44:41.974 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ah4.ko 2023-11-28T11:44:41.974 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/esp4.ko 2023-11-28T11:44:41.974 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/fou.ko 2023-11-28T11:44:41.974 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/gre.ko 2023-11-28T11:44:41.974 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/inet_diag.ko 2023-11-28T11:44:41.974 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_gre.ko 2023-11-28T11:44:41.974 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_tunnel.ko 2023-11-28T11:44:41.974 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_vti.ko 2023-11-28T11:44:41.974 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ipcomp.ko 2023-11-28T11:44:41.974 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ipip.ko 2023-11-28T11:44:41.974 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter 2023-11-28T11:44:41.975 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arp_tables.ko 2023-11-28T11:44:41.975 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-11-28T11:44:41.975 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-11-28T11:44:41.975 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-11-28T11:44:41.975 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-11-28T11:44:41.975 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-11-28T11:44:41.975 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-11-28T11:44:41.975 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-11-28T11:44:41.975 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-11-28T11:44:41.975 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-11-28T11:44:41.975 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_security.ko 2023-11-28T11:44:41.975 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-11-28T11:44:41.976 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-11-28T11:44:41.976 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-11-28T11:44:41.976 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-11-28T11:44:41.976 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-11-28T11:44:41.976 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-11-28T11:44:41.976 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-11-28T11:44:41.976 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-11-28T11:44:41.976 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-11-28T11:44:41.976 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-11-28T11:44:41.976 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_bic.ko 2023-11-28T11:44:41.976 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_dctcp.ko 2023-11-28T11:44:41.976 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_diag.ko 2023-11-28T11:44:41.977 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_highspeed.ko 2023-11-28T11:44:41.977 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_htcp.ko 2023-11-28T11:44:41.977 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_hybla.ko 2023-11-28T11:44:41.977 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_illinois.ko 2023-11-28T11:44:41.977 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_lp.ko 2023-11-28T11:44:41.977 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_scalable.ko 2023-11-28T11:44:41.977 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_vegas.ko 2023-11-28T11:44:41.977 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_veno.ko 2023-11-28T11:44:41.977 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_westwood.ko 2023-11-28T11:44:41.977 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_yeah.ko 2023-11-28T11:44:41.977 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tunnel4.ko 2023-11-28T11:44:41.977 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/udp_diag.ko 2023-11-28T11:44:41.978 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/udp_tunnel.ko 2023-11-28T11:44:41.978 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/xfrm4_tunnel.ko 2023-11-28T11:44:41.978 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6 2023-11-28T11:44:41.978 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ah6.ko 2023-11-28T11:44:41.978 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/esp6.ko 2023-11-28T11:44:41.978 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/fou6.ko 2023-11-28T11:44:41.978 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_tunnel.ko 2023-11-28T11:44:41.978 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-11-28T11:44:41.978 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_vti.ko 2023-11-28T11:44:41.978 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ipcomp6.ko 2023-11-28T11:44:41.978 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter 2023-11-28T11:44:41.978 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-11-28T11:44:41.979 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-11-28T11:44:41.979 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-11-28T11:44:41.979 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-11-28T11:44:41.979 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-11-28T11:44:41.979 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-11-28T11:44:41.979 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-11-28T11:44:41.979 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-11-28T11:44:41.979 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-11-28T11:44:41.979 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-11-28T11:44:41.979 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-11-28T11:44:41.979 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-11-28T11:44:41.979 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-11-28T11:44:41.979 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-11-28T11:44:41.980 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-11-28T11:44:41.980 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-11-28T11:44:41.980 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-11-28T11:44:41.980 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-11-28T11:44:41.980 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-11-28T11:44:41.980 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-11-28T11:44:41.980 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-11-28T11:44:41.980 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-11-28T11:44:41.980 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-11-28T11:44:41.980 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-11-28T11:44:41.980 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/sit.ko 2023-11-28T11:44:41.981 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/tunnel6.ko 2023-11-28T11:44:41.981 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/xfrm6_tunnel.ko 2023-11-28T11:44:41.981 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/key 2023-11-28T11:44:41.981 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/key/af_key.ko 2023-11-28T11:44:41.981 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp 2023-11-28T11:44:41.981 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_core.ko 2023-11-28T11:44:41.981 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_debugfs.ko 2023-11-28T11:44:41.981 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_eth.ko 2023-11-28T11:44:41.981 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ip.ko 2023-11-28T11:44:41.981 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ip6.ko 2023-11-28T11:44:41.981 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_netlink.ko 2023-11-28T11:44:41.981 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ppp.ko 2023-11-28T11:44:41.981 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc 2023-11-28T11:44:41.982 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/llc.ko 2023-11-28T11:44:41.982 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/mac802154 2023-11-28T11:44:41.982 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/mac802154/mac802154.ko 2023-11-28T11:44:41.982 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/mpls 2023-11-28T11:44:41.982 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/mpls/mpls_gso.ko 2023-11-28T11:44:41.982 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter 2023-11-28T11:44:41.982 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset 2023-11-28T11:44:41.982 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set.ko 2023-11-28T11:44:41.982 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-11-28T11:44:41.982 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-11-28T11:44:41.982 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-11-28T11:44:41.982 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-11-28T11:44:41.982 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-11-28T11:44:41.983 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-11-28T11:44:41.983 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-11-28T11:44:41.983 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-11-28T11:44:41.983 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-11-28T11:44:41.983 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-11-28T11:44:41.983 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-11-28T11:44:41.983 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-11-28T11:44:41.983 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-11-28T11:44:41.983 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-11-28T11:44:41.983 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-11-28T11:44:41.983 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs 2023-11-28T11:44:41.983 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs.ko 2023-11-28T11:44:41.984 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-11-28T11:44:41.984 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-11-28T11:44:41.984 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-11-28T11:44:41.984 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-11-28T11:44:41.984 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-11-28T11:44:41.984 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-11-28T11:44:41.984 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-11-28T11:44:41.984 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-11-28T11:44:41.984 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-11-28T11:44:41.984 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-11-28T11:44:41.984 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-11-28T11:44:41.984 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-11-28T11:44:41.985 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-11-28T11:44:41.985 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conncount.ko 2023-11-28T11:44:41.985 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack.ko 2023-11-28T11:44:41.985 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-11-28T11:44:41.985 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-11-28T11:44:41.985 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-11-28T11:44:41.985 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_h323.ko 2023-11-28T11:44:41.985 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_irc.ko 2023-11-28T11:44:41.985 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-11-28T11:44:41.985 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-11-28T11:44:41.985 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-11-28T11:44:41.985 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_sane.ko 2023-11-28T11:44:41.986 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_sip.ko 2023-11-28T11:44:41.986 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-11-28T11:44:41.986 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-11-28T11:44:41.986 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_dup_netdev.ko 2023-11-28T11:44:41.986 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_flow_table.ko 2023-11-28T11:44:41.986 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_flow_table_inet.ko 2023-11-28T11:44:41.986 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_log_syslog.ko 2023-11-28T11:44:41.986 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat.ko 2023-11-28T11:44:41.986 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_amanda.ko 2023-11-28T11:44:41.986 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_ftp.ko 2023-11-28T11:44:41.986 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_irc.ko 2023-11-28T11:44:41.986 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_sip.ko 2023-11-28T11:44:41.987 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_tftp.ko 2023-11-28T11:44:41.987 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_synproxy_core.ko 2023-11-28T11:44:41.987 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_tables.ko 2023-11-28T11:44:41.987 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink.ko 2023-11-28T11:44:41.987 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_acct.ko 2023-11-28T11:44:41.987 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_log.ko 2023-11-28T11:44:41.987 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_osf.ko 2023-11-28T11:44:41.987 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_queue.ko 2023-11-28T11:44:41.987 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_chain_nat.ko 2023-11-28T11:44:41.987 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_compat.ko 2023-11-28T11:44:41.987 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_ct.ko 2023-11-28T11:44:41.987 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_dup_netdev.ko 2023-11-28T11:44:41.987 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_fib.ko 2023-11-28T11:44:41.988 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_fwd_netdev.ko 2023-11-28T11:44:41.988 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_hash.ko 2023-11-28T11:44:41.988 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_limit.ko 2023-11-28T11:44:41.988 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_log.ko 2023-11-28T11:44:41.988 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_masq.ko 2023-11-28T11:44:41.988 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_nat.ko 2023-11-28T11:44:41.988 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_numgen.ko 2023-11-28T11:44:41.988 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_queue.ko 2023-11-28T11:44:41.988 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_quota.ko 2023-11-28T11:44:41.988 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_redir.ko 2023-11-28T11:44:41.988 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_reject.ko 2023-11-28T11:44:41.989 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_reject_inet.ko 2023-11-28T11:44:41.989 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_socket.ko 2023-11-28T11:44:41.989 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_tunnel.ko 2023-11-28T11:44:41.989 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_AUDIT.ko 2023-11-28T11:44:41.989 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CHECKSUM.ko 2023-11-28T11:44:41.989 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CLASSIFY.ko 2023-11-28T11:44:41.989 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-11-28T11:44:41.989 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CT.ko 2023-11-28T11:44:41.989 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_DSCP.ko 2023-11-28T11:44:41.989 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_HL.ko 2023-11-28T11:44:41.989 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_HMARK.ko 2023-11-28T11:44:41.989 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_IDLETIMER.ko 2023-11-28T11:44:41.990 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_LED.ko 2023-11-28T11:44:41.990 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_LOG.ko 2023-11-28T11:44:41.990 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_MASQUERADE.ko 2023-11-28T11:44:41.990 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NETMAP.ko 2023-11-28T11:44:41.990 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NFLOG.ko 2023-11-28T11:44:41.990 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NFQUEUE.ko 2023-11-28T11:44:41.990 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_RATEEST.ko 2023-11-28T11:44:41.990 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_REDIRECT.ko 2023-11-28T11:44:41.990 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_SECMARK.ko 2023-11-28T11:44:41.990 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TCPMSS.ko 2023-11-28T11:44:41.990 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-11-28T11:44:41.990 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TEE.ko 2023-11-28T11:44:41.991 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TPROXY.ko 2023-11-28T11:44:41.991 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TRACE.ko 2023-11-28T11:44:41.991 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_addrtype.ko 2023-11-28T11:44:41.991 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_bpf.ko 2023-11-28T11:44:41.991 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cgroup.ko 2023-11-28T11:44:41.991 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cluster.ko 2023-11-28T11:44:41.991 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_comment.ko 2023-11-28T11:44:41.991 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connbytes.ko 2023-11-28T11:44:41.991 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connlabel.ko 2023-11-28T11:44:41.991 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connlimit.ko 2023-11-28T11:44:41.991 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connmark.ko 2023-11-28T11:44:41.991 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_conntrack.ko 2023-11-28T11:44:41.992 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cpu.ko 2023-11-28T11:44:41.992 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_dccp.ko 2023-11-28T11:44:41.992 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_devgroup.ko 2023-11-28T11:44:41.992 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_dscp.ko 2023-11-28T11:44:41.992 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ecn.ko 2023-11-28T11:44:41.992 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_esp.ko 2023-11-28T11:44:41.992 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_hashlimit.ko 2023-11-28T11:44:41.992 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_helper.ko 2023-11-28T11:44:41.992 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_hl.ko 2023-11-28T11:44:41.992 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ipcomp.ko 2023-11-28T11:44:41.992 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_iprange.ko 2023-11-28T11:44:41.992 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ipvs.ko 2023-11-28T11:44:41.993 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_l2tp.ko 2023-11-28T11:44:41.993 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_length.ko 2023-11-28T11:44:41.993 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_limit.ko 2023-11-28T11:44:41.993 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_mac.ko 2023-11-28T11:44:41.993 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_mark.ko 2023-11-28T11:44:41.993 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_multiport.ko 2023-11-28T11:44:41.993 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_nat.ko 2023-11-28T11:44:41.993 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_nfacct.ko 2023-11-28T11:44:41.993 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_osf.ko 2023-11-28T11:44:41.993 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_owner.ko 2023-11-28T11:44:41.993 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_physdev.ko 2023-11-28T11:44:41.993 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_pkttype.ko 2023-11-28T11:44:41.994 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_policy.ko 2023-11-28T11:44:41.994 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_quota.ko 2023-11-28T11:44:41.994 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_rateest.ko 2023-11-28T11:44:41.994 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_realm.ko 2023-11-28T11:44:41.994 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_recent.ko 2023-11-28T11:44:41.997 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_sctp.ko 2023-11-28T11:44:41.997 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_set.ko 2023-11-28T11:44:41.997 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_socket.ko 2023-11-28T11:44:41.997 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_state.ko 2023-11-28T11:44:41.997 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_statistic.ko 2023-11-28T11:44:41.997 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_string.ko 2023-11-28T11:44:41.997 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_tcpmss.ko 2023-11-28T11:44:41.997 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_time.ko 2023-11-28T11:44:41.997 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_u32.ko 2023-11-28T11:44:41.998 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netlink 2023-11-28T11:44:41.998 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netlink/netlink_diag.ko 2023-11-28T11:44:41.998 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/nsh 2023-11-28T11:44:41.998 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/nsh/nsh.ko 2023-11-28T11:44:41.998 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch 2023-11-28T11:44:41.998 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/openvswitch.ko 2023-11-28T11:44:41.998 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-geneve.ko 2023-11-28T11:44:41.998 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-gre.ko 2023-11-28T11:44:41.998 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-vxlan.ko 2023-11-28T11:44:41.998 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/packet 2023-11-28T11:44:41.998 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/packet/af_packet_diag.ko 2023-11-28T11:44:41.998 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds 2023-11-28T11:44:41.999 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds.ko 2023-11-28T11:44:41.999 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds_rdma.ko 2023-11-28T11:44:41.999 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds_tcp.ko 2023-11-28T11:44:41.999 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched 2023-11-28T11:44:41.999 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_csum.ko 2023-11-28T11:44:41.999 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_gact.ko 2023-11-28T11:44:41.999 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_ipt.ko 2023-11-28T11:44:41.999 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_mirred.ko 2023-11-28T11:44:41.999 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_nat.ko 2023-11-28T11:44:41.999 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_pedit.ko 2023-11-28T11:44:41.999 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_police.ko 2023-11-28T11:44:41.999 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_simple.ko 2023-11-28T11:44:42.000 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_skbedit.ko 2023-11-28T11:44:42.000 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_vlan.ko 2023-11-28T11:44:42.000 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_basic.ko 2023-11-28T11:44:42.000 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_bpf.ko 2023-11-28T11:44:42.000 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_flow.ko 2023-11-28T11:44:42.000 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_fw.ko 2023-11-28T11:44:42.000 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_route.ko 2023-11-28T11:44:42.000 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_u32.ko 2023-11-28T11:44:42.000 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_cmp.ko 2023-11-28T11:44:42.000 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_ipset.ko 2023-11-28T11:44:42.000 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_meta.ko 2023-11-28T11:44:42.000 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_nbyte.ko 2023-11-28T11:44:42.001 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_text.ko 2023-11-28T11:44:42.001 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_u32.ko 2023-11-28T11:44:42.001 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_choke.ko 2023-11-28T11:44:42.001 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_codel.ko 2023-11-28T11:44:42.001 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_drr.ko 2023-11-28T11:44:42.001 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_fq.ko 2023-11-28T11:44:42.001 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_gred.ko 2023-11-28T11:44:42.001 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_hfsc.ko 2023-11-28T11:44:42.001 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_hhf.ko 2023-11-28T11:44:42.001 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_htb.ko 2023-11-28T11:44:42.001 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_ingress.ko 2023-11-28T11:44:42.001 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_mqprio.ko 2023-11-28T11:44:42.001 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_mqprio_lib.ko 2023-11-28T11:44:42.002 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_multiq.ko 2023-11-28T11:44:42.002 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_netem.ko 2023-11-28T11:44:42.002 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_pie.ko 2023-11-28T11:44:42.002 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_plug.ko 2023-11-28T11:44:42.002 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_prio.ko 2023-11-28T11:44:42.002 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_qfq.ko 2023-11-28T11:44:42.002 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_red.ko 2023-11-28T11:44:42.002 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_sfb.ko 2023-11-28T11:44:42.002 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_sfq.ko 2023-11-28T11:44:42.002 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_tbf.ko 2023-11-28T11:44:42.002 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_teql.ko 2023-11-28T11:44:42.003 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp 2023-11-28T11:44:42.003 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/sctp.ko 2023-11-28T11:44:42.003 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/sctp_diag.ko 2023-11-28T11:44:42.003 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc 2023-11-28T11:44:42.003 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss 2023-11-28T11:44:42.003 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-11-28T11:44:42.003 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-11-28T11:44:42.003 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/sunrpc.ko 2023-11-28T11:44:42.003 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/xprtrdma 2023-11-28T11:44:42.003 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-11-28T11:44:42.003 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc 2023-11-28T11:44:42.003 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/diag.ko 2023-11-28T11:44:42.003 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/tipc.ko 2023-11-28T11:44:42.004 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/unix 2023-11-28T11:44:42.004 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/unix/unix_diag.ko 2023-11-28T11:44:42.004 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock 2023-11-28T11:44:42.004 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-11-28T11:44:42.004 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-11-28T11:44:42.004 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock.ko 2023-11-28T11:44:42.004 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock_diag.ko 2023-11-28T11:44:42.004 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock_loopback.ko 2023-11-28T11:44:42.004 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm 2023-11-28T11:44:42.004 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_ipcomp.ko 2023-11-28T11:44:42.004 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/security 2023-11-28T11:44:42.004 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/security/keys 2023-11-28T11:44:42.005 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/security/keys/encrypted-keys 2023-11-28T11:44:42.005 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-11-28T11:44:42.005 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/security/keys/trusted-keys 2023-11-28T11:44:42.005 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/security/keys/trusted-keys/trusted.ko 2023-11-28T11:44:42.005 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/virt 2023-11-28T11:44:42.005 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/virt/lib 2023-11-28T11:44:42.005 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/virt/lib/irqbypass.ko 2023-11-28T11:44:42.005 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.alias 2023-11-28T11:44:42.005 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.alias.bin 2023-11-28T11:44:42.005 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.builtin 2023-11-28T11:44:42.005 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.builtin.bin 2023-11-28T11:44:42.005 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.builtin.modinfo 2023-11-28T11:44:42.006 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.dep 2023-11-28T11:44:42.006 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.dep.bin 2023-11-28T11:44:42.006 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.devname 2023-11-28T11:44:42.006 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.order 2023-11-28T11:44:42.006 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.softdep 2023-11-28T11:44:42.006 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.symbols 2023-11-28T11:44:42.006 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.symbols.bin 2023-11-28T11:44:42.007 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-g8247bbb5b470 2023-11-28T11:44:42.007 DEBUG:teuthology.orchestra.run.smithi045:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-11-28T11:44:42.034 INFO:teuthology.orchestra.run.smithi045.stdout:postinstall scriptlet (using /bin/sh): 2023-11-28T11:44:42.034 INFO:teuthology.orchestra.run.smithi045.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.6.0-g8247bbb5b470 -a -r /boot/System.map-6.6.0-g8247bbb5b470 ]; then 2023-11-28T11:44:42.034 INFO:teuthology.orchestra.run.smithi045.stdout:cp /boot/vmlinuz-6.6.0-g8247bbb5b470 /boot/.vmlinuz-6.6.0-g8247bbb5b470-rpm 2023-11-28T11:44:42.035 INFO:teuthology.orchestra.run.smithi045.stdout:cp /boot/System.map-6.6.0-g8247bbb5b470 /boot/.System.map-6.6.0-g8247bbb5b470-rpm 2023-11-28T11:44:42.035 INFO:teuthology.orchestra.run.smithi045.stdout:rm -f /boot/vmlinuz-6.6.0-g8247bbb5b470 /boot/System.map-6.6.0-g8247bbb5b470 2023-11-28T11:44:42.035 INFO:teuthology.orchestra.run.smithi045.stdout:/sbin/installkernel 6.6.0-g8247bbb5b470 /boot/.vmlinuz-6.6.0-g8247bbb5b470-rpm /boot/.System.map-6.6.0-g8247bbb5b470-rpm 2023-11-28T11:44:42.035 INFO:teuthology.orchestra.run.smithi045.stdout:rm -f /boot/.vmlinuz-6.6.0-g8247bbb5b470-rpm /boot/.System.map-6.6.0-g8247bbb5b470-rpm 2023-11-28T11:44:42.035 INFO:teuthology.orchestra.run.smithi045.stdout:fi 2023-11-28T11:44:42.035 INFO:teuthology.orchestra.run.smithi045.stdout:preuninstall scriptlet (using /bin/sh): 2023-11-28T11:44:42.035 INFO:teuthology.orchestra.run.smithi045.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-11-28T11:44:42.035 INFO:teuthology.orchestra.run.smithi045.stdout:new-kernel-pkg --remove 6.6.0-g8247bbb5b470 --rminitrd --initrdfile=/boot/initramfs-6.6.0-g8247bbb5b470.img 2023-11-28T11:44:42.035 INFO:teuthology.orchestra.run.smithi045.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-11-28T11:44:42.035 INFO:teuthology.orchestra.run.smithi045.stdout:kernel-install remove 6.6.0-g8247bbb5b470 2023-11-28T11:44:42.035 INFO:teuthology.orchestra.run.smithi045.stdout:fi 2023-11-28T11:44:42.036 INFO:teuthology.orchestra.run.smithi045.stdout:postuninstall scriptlet (using /bin/sh): 2023-11-28T11:44:42.036 INFO:teuthology.orchestra.run.smithi045.stdout:if [ -x /sbin/update-bootloader ]; then 2023-11-28T11:44:42.036 INFO:teuthology.orchestra.run.smithi045.stdout:/sbin/update-bootloader --remove 6.6.0-g8247bbb5b470 2023-11-28T11:44:42.036 INFO:teuthology.orchestra.run.smithi045.stdout:fi 2023-11-28T11:44:42.037 DEBUG:teuthology.orchestra.run.smithi045:> sudo rpm -qi grub2-tools 2023-11-28T11:44:42.115 INFO:teuthology.orchestra.run.smithi045.stdout:Name : grub2-tools 2023-11-28T11:44:42.115 INFO:teuthology.orchestra.run.smithi045.stdout:Epoch : 1 2023-11-28T11:44:42.115 INFO:teuthology.orchestra.run.smithi045.stdout:Version : 2.02 2023-11-28T11:44:42.116 INFO:teuthology.orchestra.run.smithi045.stdout:Release : 129.el8 2023-11-28T11:44:42.116 INFO:teuthology.orchestra.run.smithi045.stdout:Architecture: x86_64 2023-11-28T11:44:42.116 INFO:teuthology.orchestra.run.smithi045.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-11-28T11:44:42.116 INFO:teuthology.orchestra.run.smithi045.stdout:Group : System Environment/Base 2023-11-28T11:44:42.116 INFO:teuthology.orchestra.run.smithi045.stdout:Size : 9265586 2023-11-28T11:44:42.116 INFO:teuthology.orchestra.run.smithi045.stdout:License : GPLv3+ 2023-11-28T11:44:42.116 INFO:teuthology.orchestra.run.smithi045.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-11-28T11:44:42.116 INFO:teuthology.orchestra.run.smithi045.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-11-28T11:44:42.116 INFO:teuthology.orchestra.run.smithi045.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-11-28T11:44:42.116 INFO:teuthology.orchestra.run.smithi045.stdout:Build Host : kbuilder.bsys.centos.org 2023-11-28T11:44:42.116 INFO:teuthology.orchestra.run.smithi045.stdout:Relocations : (not relocatable) 2023-11-28T11:44:42.116 INFO:teuthology.orchestra.run.smithi045.stdout:Packager : CentOS BuildSystem 2023-11-28T11:44:42.117 INFO:teuthology.orchestra.run.smithi045.stdout:Vendor : CentOS 2023-11-28T11:44:42.117 INFO:teuthology.orchestra.run.smithi045.stdout:URL : http://www.gnu.org/software/grub/ 2023-11-28T11:44:42.117 INFO:teuthology.orchestra.run.smithi045.stdout:Summary : Support tools for GRUB. 2023-11-28T11:44:42.117 INFO:teuthology.orchestra.run.smithi045.stdout:Description : 2023-11-28T11:44:42.117 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T11:44:42.117 INFO:teuthology.orchestra.run.smithi045.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-11-28T11:44:42.117 INFO:teuthology.orchestra.run.smithi045.stdout:customizable bootloader with modular architecture. It supports a rich 2023-11-28T11:44:42.117 INFO:teuthology.orchestra.run.smithi045.stdout:variety of kernel formats, file systems, computer architectures and 2023-11-28T11:44:42.117 INFO:teuthology.orchestra.run.smithi045.stdout:hardware devices. 2023-11-28T11:44:42.117 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T11:44:42.117 INFO:teuthology.orchestra.run.smithi045.stdout:This subpackage provides tools for support of all platforms. 2023-11-28T11:44:42.118 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-11-28T11:44:42.118 INFO:teuthology.task.kernel:Updating grub on smithi045 to boot 6.6.0-g8247bbb5b470 2023-11-28T11:44:42.119 DEBUG:teuthology.orchestra.run.smithi045:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-11-28T11:44:45.371 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28 11:44:45 URL:https://4.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/centos/8/flavors/default/x86_64/kernel-6.6.0_g8247bbb5b470-1.x86_64.rpm [383178732/383178732] -> "/tmp/kernel.x86_64.rpm" [1] 2023-11-28T11:44:45.371 INFO:teuthology.orchestra.run.smithi152.stderr:FINISHED --2023-11-28 11:44:45-- 2023-11-28T11:44:45.371 INFO:teuthology.orchestra.run.smithi152.stderr:Total wall clock time: 13s 2023-11-28T11:44:45.372 INFO:teuthology.orchestra.run.smithi152.stderr:Downloaded: 1 files, 365M in 13s (28.9 MB/s) 2023-11-28T11:44:45.374 INFO:teuthology.task.kernel:Installing kernel 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 on client.1... 2023-11-28T11:44:45.375 DEBUG:teuthology.orchestra.run.smithi152:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-11-28T11:44:46.900 INFO:teuthology.orchestra.run.smithi045.stderr:Generating grub configuration file ... 2023-11-28T11:44:47.054 INFO:teuthology.orchestra.run.smithi152.stdout:Verifying... ######################################## 2023-11-28T11:44:47.098 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing... ######################################## 2023-11-28T11:44:47.207 INFO:teuthology.orchestra.run.smithi152.stdout:Updating / installing... 2023-11-28T11:44:49.085 INFO:teuthology.orchestra.run.smithi045.stderr:done 2023-11-28T11:44:49.086 DEBUG:teuthology.orchestra.run.smithi045:> mktemp 2023-11-28T11:44:49.107 INFO:teuthology.orchestra.run.smithi045.stdout:/tmp/tmp.rf41KAat9n 2023-11-28T11:44:49.108 DEBUG:teuthology.orchestra.run.smithi045:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.rf41KAat9n 2023-11-28T11:44:49.215 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 0666 /tmp/tmp.rf41KAat9n 2023-11-28T11:44:49.320 DEBUG:teuthology.orchestra.remote:smithi045:/tmp/tmp.rf41KAat9n is 6KB 2023-11-28T11:44:49.373 DEBUG:teuthology.orchestra.run.smithi045:> rm -fr /tmp/tmp.rf41KAat9n 2023-11-28T11:44:49.391 DEBUG:teuthology.orchestra.run.smithi045:> sudo /bin/ls /boot/loader/entries || true 2023-11-28T11:44:49.463 INFO:teuthology.orchestra.run.smithi045.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-11-28T11:44:49.464 INFO:teuthology.orchestra.run.smithi045.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-11-28T11:44:49.464 INFO:teuthology.orchestra.run.smithi045.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-11-28T11:44:49.464 INFO:teuthology.orchestra.run.smithi045.stdout:a1b29d6c289747bdb22930598d39874a-6.6.0-g8247bbb5b470.conf 2023-11-28T11:44:49.466 DEBUG:teuthology.orchestra.run.smithi045:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-6.6.0-g8247bbb5b470 2023-11-28T11:44:49.631 DEBUG:teuthology.orchestra.run.smithi045:> sudo shutdown -r now 2023-11-28T11:45:19.634 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-11-28T11:45:19.634 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi045.front.sepia.ceph.com' 2023-11-28T11:45:19.635 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T11:45:25.492 INFO:teuthology.orchestra.run.smithi152.stdout:kernel-6.6.0_g8247bbb5b470-1 ######################################## 2023-11-28T11:45:29.812 INFO:teuthology.orchestra.run.smithi152.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2023-11-28T11:45:38.146 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.45 2023-11-28T11:45:47.149 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi045.front.sepia.ceph.com' 2023-11-28T11:45:47.149 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T11:45:49.172 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi152.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-11-28T11:45:49.173 DEBUG:teuthology.orchestra.run.smithi152:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-11-28T11:45:49.222 INFO:teuthology.orchestra.run.smithi152.stdout:/boot/System.map-6.6.0-g8247bbb5b470 2023-11-28T11:45:49.222 INFO:teuthology.orchestra.run.smithi152.stdout:/boot/config-6.6.0-g8247bbb5b470 2023-11-28T11:45:49.222 INFO:teuthology.orchestra.run.smithi152.stdout:/boot/vmlinuz-6.6.0-g8247bbb5b470 2023-11-28T11:45:49.222 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470 2023-11-28T11:45:49.222 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel 2023-11-28T11:45:49.222 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch 2023-11-28T11:45:49.223 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86 2023-11-28T11:45:49.223 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto 2023-11-28T11:45:49.223 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-11-28T11:45:49.223 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-11-28T11:45:49.223 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-11-28T11:45:49.223 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-11-28T11:45:49.223 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-11-28T11:45:49.223 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-11-28T11:45:49.223 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-11-28T11:45:49.223 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crc32c-intel.ko 2023-11-28T11:45:49.224 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-11-28T11:45:49.224 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-11-28T11:45:49.224 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-11-28T11:45:49.224 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-11-28T11:45:49.224 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-avx2.ko 2023-11-28T11:45:49.224 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-11-28T11:45:49.224 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-11-28T11:45:49.224 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-11-28T11:45:49.224 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-11-28T11:45:49.224 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-11-28T11:45:49.224 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-11-28T11:45:49.225 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-11-28T11:45:49.225 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel 2023-11-28T11:45:49.225 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu 2023-11-28T11:45:49.225 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/mce 2023-11-28T11:45:49.225 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-11-28T11:45:49.225 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm 2023-11-28T11:45:49.225 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm-amd.ko 2023-11-28T11:45:49.225 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm-intel.ko 2023-11-28T11:45:49.225 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm.ko 2023-11-28T11:45:49.225 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto 2023-11-28T11:45:49.225 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ansi_cprng.ko 2023-11-28T11:45:49.226 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/anubis.ko 2023-11-28T11:45:49.226 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/arc4.ko 2023-11-28T11:45:49.226 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx 2023-11-28T11:45:49.226 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_memcpy.ko 2023-11-28T11:45:49.226 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_pq.ko 2023-11-28T11:45:49.226 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_raid6_recov.ko 2023-11-28T11:45:49.226 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_tx.ko 2023-11-28T11:45:49.226 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_xor.ko 2023-11-28T11:45:49.226 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/raid6test.ko 2023-11-28T11:45:49.226 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/authenc.ko 2023-11-28T11:45:49.226 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/authencesn.ko 2023-11-28T11:45:49.227 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blake2b_generic.ko 2023-11-28T11:45:49.227 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blowfish_common.ko 2023-11-28T11:45:49.227 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blowfish_generic.ko 2023-11-28T11:45:49.227 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/camellia_generic.ko 2023-11-28T11:45:49.227 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast5_generic.ko 2023-11-28T11:45:49.227 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast6_generic.ko 2023-11-28T11:45:49.227 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast_common.ko 2023-11-28T11:45:49.227 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ccm.ko 2023-11-28T11:45:49.227 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cmac.ko 2023-11-28T11:45:49.227 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crc32_generic.ko 2023-11-28T11:45:49.227 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_engine.ko 2023-11-28T11:45:49.227 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_user.ko 2023-11-28T11:45:49.228 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cts.ko 2023-11-28T11:45:49.228 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/des_generic.ko 2023-11-28T11:45:49.228 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/dh_generic.ko 2023-11-28T11:45:49.228 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/echainiv.ko 2023-11-28T11:45:49.228 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/essiv.ko 2023-11-28T11:45:49.228 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/fcrypt.ko 2023-11-28T11:45:49.228 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/khazad.ko 2023-11-28T11:45:49.228 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lz4.ko 2023-11-28T11:45:49.228 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lz4hc.ko 2023-11-28T11:45:49.228 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/md4.ko 2023-11-28T11:45:49.228 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/michael_mic.ko 2023-11-28T11:45:49.228 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/pcbc.ko 2023-11-28T11:45:49.229 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/pcrypt.ko 2023-11-28T11:45:49.229 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/rmd160.ko 2023-11-28T11:45:49.229 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/seed.ko 2023-11-28T11:45:49.229 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/serpent_generic.ko 2023-11-28T11:45:49.229 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/tcrypt.ko 2023-11-28T11:45:49.229 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/tea.ko 2023-11-28T11:45:49.229 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/twofish_common.ko 2023-11-28T11:45:49.229 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/twofish_generic.ko 2023-11-28T11:45:49.229 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/vmac.ko 2023-11-28T11:45:49.229 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/wp512.ko 2023-11-28T11:45:49.229 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xcbc.ko 2023-11-28T11:45:49.229 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xor.ko 2023-11-28T11:45:49.229 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xxhash_generic.ko 2023-11-28T11:45:49.230 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers 2023-11-28T11:45:49.230 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi 2023-11-28T11:45:49.230 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_ipmi.ko 2023-11-28T11:45:49.230 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_pad.ko 2023-11-28T11:45:49.230 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/custom_method.ko 2023-11-28T11:45:49.230 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/ec_sys.ko 2023-11-28T11:45:49.230 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/platform_profile.ko 2023-11-28T11:45:49.230 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/sbs.ko 2023-11-28T11:45:49.230 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/sbshc.ko 2023-11-28T11:45:49.230 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/video.ko 2023-11-28T11:45:49.231 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata 2023-11-28T11:45:49.231 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/acard-ahci.ko 2023-11-28T11:45:49.231 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ahci_platform.ko 2023-11-28T11:45:49.231 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ata_generic.ko 2023-11-28T11:45:49.231 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/libahci_platform.ko 2023-11-28T11:45:49.232 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_acpi.ko 2023-11-28T11:45:49.232 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ali.ko 2023-11-28T11:45:49.232 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_amd.ko 2023-11-28T11:45:49.232 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_artop.ko 2023-11-28T11:45:49.232 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_atiixp.ko 2023-11-28T11:45:49.232 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_atp867x.ko 2023-11-28T11:45:49.232 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cmd640.ko 2023-11-28T11:45:49.232 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cmd64x.ko 2023-11-28T11:45:49.232 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cypress.ko 2023-11-28T11:45:49.232 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_efar.ko 2023-11-28T11:45:49.232 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt366.ko 2023-11-28T11:45:49.233 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt37x.ko 2023-11-28T11:45:49.233 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt3x2n.ko 2023-11-28T11:45:49.233 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt3x3.ko 2023-11-28T11:45:49.233 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_it8213.ko 2023-11-28T11:45:49.233 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_it821x.ko 2023-11-28T11:45:49.233 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_jmicron.ko 2023-11-28T11:45:49.233 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_marvell.ko 2023-11-28T11:45:49.233 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_mpiix.ko 2023-11-28T11:45:49.233 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_netcell.ko 2023-11-28T11:45:49.233 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ninja32.ko 2023-11-28T11:45:49.233 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ns87410.ko 2023-11-28T11:45:49.233 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ns87415.ko 2023-11-28T11:45:49.234 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_oldpiix.ko 2023-11-28T11:45:49.234 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_opti.ko 2023-11-28T11:45:49.234 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_optidma.ko 2023-11-28T11:45:49.234 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pcmcia.ko 2023-11-28T11:45:49.234 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pdc2027x.ko 2023-11-28T11:45:49.234 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-11-28T11:45:49.234 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_piccolo.ko 2023-11-28T11:45:49.234 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_rdc.ko 2023-11-28T11:45:49.234 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sch.ko 2023-11-28T11:45:49.234 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_serverworks.ko 2023-11-28T11:45:49.234 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sil680.ko 2023-11-28T11:45:49.234 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sis.ko 2023-11-28T11:45:49.235 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sl82c105.ko 2023-11-28T11:45:49.235 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_triflex.ko 2023-11-28T11:45:49.235 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_via.ko 2023-11-28T11:45:49.235 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pdc_adma.ko 2023-11-28T11:45:49.235 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_inic162x.ko 2023-11-28T11:45:49.235 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_mv.ko 2023-11-28T11:45:49.235 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_nv.ko 2023-11-28T11:45:49.235 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_promise.ko 2023-11-28T11:45:49.235 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_qstor.ko 2023-11-28T11:45:49.235 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sil.ko 2023-11-28T11:45:49.235 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sil24.ko 2023-11-28T11:45:49.235 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sis.ko 2023-11-28T11:45:49.235 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_svw.ko 2023-11-28T11:45:49.236 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sx4.ko 2023-11-28T11:45:49.236 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_uli.ko 2023-11-28T11:45:49.236 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_via.ko 2023-11-28T11:45:49.236 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_vsc.ko 2023-11-28T11:45:49.236 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/auxdisplay 2023-11-28T11:45:49.236 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/auxdisplay/ks0108.ko 2023-11-28T11:45:49.236 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/base 2023-11-28T11:45:49.236 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/base/regmap 2023-11-28T11:45:49.236 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/base/regmap/regmap-i2c.ko 2023-11-28T11:45:49.236 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/base/regmap/regmap-mmio.ko 2023-11-28T11:45:49.236 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/bcma 2023-11-28T11:45:49.236 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/bcma/bcma.ko 2023-11-28T11:45:49.237 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block 2023-11-28T11:45:49.237 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/aoe 2023-11-28T11:45:49.237 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/aoe/aoe.ko 2023-11-28T11:45:49.237 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/brd.ko 2023-11-28T11:45:49.237 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/drbd 2023-11-28T11:45:49.237 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/drbd/drbd.ko 2023-11-28T11:45:49.237 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/floppy.ko 2023-11-28T11:45:49.237 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/loop.ko 2023-11-28T11:45:49.237 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/mtip32xx 2023-11-28T11:45:49.237 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-11-28T11:45:49.238 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/nbd.ko 2023-11-28T11:45:49.238 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/null_blk 2023-11-28T11:45:49.238 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/null_blk/null_blk.ko 2023-11-28T11:45:49.238 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/pktcdvd.ko 2023-11-28T11:45:49.238 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/rbd.ko 2023-11-28T11:45:49.238 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/virtio_blk.ko 2023-11-28T11:45:49.238 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkback 2023-11-28T11:45:49.238 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-11-28T11:45:49.238 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkfront.ko 2023-11-28T11:45:49.238 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/zram 2023-11-28T11:45:49.238 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/zram/zram.ko 2023-11-28T11:45:49.238 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char 2023-11-28T11:45:49.239 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hangcheck-timer.ko 2023-11-28T11:45:49.239 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random 2023-11-28T11:45:49.239 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/amd-rng.ko 2023-11-28T11:45:49.239 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/intel-rng.ko 2023-11-28T11:45:49.239 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-11-28T11:45:49.239 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/via-rng.ko 2023-11-28T11:45:49.239 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/virtio-rng.ko 2023-11-28T11:45:49.239 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi 2023-11-28T11:45:49.239 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-11-28T11:45:49.239 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-11-28T11:45:49.239 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-11-28T11:45:49.239 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_si.ko 2023-11-28T11:45:49.239 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-11-28T11:45:49.240 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-11-28T11:45:49.240 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/lp.ko 2023-11-28T11:45:49.240 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/mwave 2023-11-28T11:45:49.240 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/mwave/mwave.ko 2023-11-28T11:45:49.240 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ppdev.ko 2023-11-28T11:45:49.240 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tlclk.ko 2023-11-28T11:45:49.240 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm 2023-11-28T11:45:49.240 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm.ko 2023-11-28T11:45:49.240 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_atmel.ko 2023-11-28T11:45:49.240 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_infineon.ko 2023-11-28T11:45:49.240 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_nsc.ko 2023-11-28T11:45:49.240 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_tis.ko 2023-11-28T11:45:49.241 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-11-28T11:45:49.241 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/uv_mmtimer.ko 2023-11-28T11:45:49.241 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/virtio_console.ko 2023-11-28T11:45:49.241 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq 2023-11-28T11:45:49.241 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-11-28T11:45:49.241 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-11-28T11:45:49.241 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/p4-clockmod.ko 2023-11-28T11:45:49.241 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-11-28T11:45:49.241 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/powernow-k8.ko 2023-11-28T11:45:49.241 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/speedstep-lib.ko 2023-11-28T11:45:49.241 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto 2023-11-28T11:45:49.241 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp 2023-11-28T11:45:49.241 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-11-28T11:45:49.242 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ccp.ko 2023-11-28T11:45:49.242 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel 2023-11-28T11:45:49.242 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat 2023-11-28T11:45:49.242 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_common 2023-11-28T11:45:49.242 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-11-28T11:45:49.242 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-11-28T11:45:49.242 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-11-28T11:45:49.242 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/padlock-aes.ko 2023-11-28T11:45:49.242 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/padlock-sha.ko 2023-11-28T11:45:49.242 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/virtio 2023-11-28T11:45:49.242 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-11-28T11:45:49.242 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dca 2023-11-28T11:45:49.243 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dca/dca.ko 2023-11-28T11:45:49.243 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/devfreq 2023-11-28T11:45:49.243 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-11-28T11:45:49.243 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma 2023-11-28T11:45:49.243 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/dw 2023-11-28T11:45:49.243 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/dw/dw_dmac.ko 2023-11-28T11:45:49.243 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ioat 2023-11-28T11:45:49.243 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ioat/ioatdma.ko 2023-11-28T11:45:49.243 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac 2023-11-28T11:45:49.243 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/amd64_edac.ko 2023-11-28T11:45:49.243 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/e752x_edac.ko 2023-11-28T11:45:49.243 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/edac_mce_amd.ko 2023-11-28T11:45:49.243 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i3000_edac.ko 2023-11-28T11:45:49.244 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i3200_edac.ko 2023-11-28T11:45:49.244 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i5100_edac.ko 2023-11-28T11:45:49.244 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i5400_edac.ko 2023-11-28T11:45:49.244 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i7300_edac.ko 2023-11-28T11:45:49.244 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i7core_edac.ko 2023-11-28T11:45:49.244 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i82975x_edac.ko 2023-11-28T11:45:49.244 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/ie31200_edac.ko 2023-11-28T11:45:49.244 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/sb_edac.ko 2023-11-28T11:45:49.244 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/x38_edac.ko 2023-11-28T11:45:49.244 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware 2023-11-28T11:45:49.245 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/edd.ko 2023-11-28T11:45:49.245 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/iscsi_ibft.ko 2023-11-28T11:45:49.245 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio 2023-11-28T11:45:49.245 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-ich.ko 2023-11-28T11:45:49.245 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-viperboard.ko 2023-11-28T11:45:49.245 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid 2023-11-28T11:45:49.245 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-appleir.ko 2023-11-28T11:45:49.245 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-aureal.ko 2023-11-28T11:45:49.245 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-axff.ko 2023-11-28T11:45:49.245 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-dr.ko 2023-11-28T11:45:49.245 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-elecom.ko 2023-11-28T11:45:49.245 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-elo.ko 2023-11-28T11:45:49.246 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-emsff.ko 2023-11-28T11:45:49.246 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gaff.ko 2023-11-28T11:45:49.246 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gt683r.ko 2023-11-28T11:45:49.246 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gyration.ko 2023-11-28T11:45:49.246 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtek-kbd.ko 2023-11-28T11:45:49.246 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtek-mouse.ko 2023-11-28T11:45:49.246 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtekff.ko 2023-11-28T11:45:49.246 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-hyperv.ko 2023-11-28T11:45:49.246 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-icade.ko 2023-11-28T11:45:49.246 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-keytouch.ko 2023-11-28T11:45:49.246 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-kye.ko 2023-11-28T11:45:49.246 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lcpower.ko 2023-11-28T11:45:49.246 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-led.ko 2023-11-28T11:45:49.247 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lenovo.ko 2023-11-28T11:45:49.247 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech-dj.ko 2023-11-28T11:45:49.247 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-11-28T11:45:49.247 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-multitouch.ko 2023-11-28T11:45:49.247 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ortek.ko 2023-11-28T11:45:49.247 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-penmount.ko 2023-11-28T11:45:49.247 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-petalynx.ko 2023-11-28T11:45:49.247 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-picolcd.ko 2023-11-28T11:45:49.247 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-pl.ko 2023-11-28T11:45:49.247 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-plantronics.ko 2023-11-28T11:45:49.247 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-primax.ko 2023-11-28T11:45:49.247 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-rmi.ko 2023-11-28T11:45:49.247 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-arvo.ko 2023-11-28T11:45:49.248 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-common.ko 2023-11-28T11:45:49.248 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-isku.ko 2023-11-28T11:45:49.248 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-kone.ko 2023-11-28T11:45:49.248 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-11-28T11:45:49.248 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-konepure.ko 2023-11-28T11:45:49.248 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-11-28T11:45:49.248 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-lua.ko 2023-11-28T11:45:49.248 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-pyra.ko 2023-11-28T11:45:49.248 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-ryos.ko 2023-11-28T11:45:49.248 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-savu.ko 2023-11-28T11:45:49.248 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat.ko 2023-11-28T11:45:49.248 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-saitek.ko 2023-11-28T11:45:49.249 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-samsung.ko 2023-11-28T11:45:49.249 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sensor-hub.ko 2023-11-28T11:45:49.249 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sjoy.ko 2023-11-28T11:45:49.249 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sony.ko 2023-11-28T11:45:49.249 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-speedlink.ko 2023-11-28T11:45:49.249 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-steelseries.ko 2023-11-28T11:45:49.249 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sunplus.ko 2023-11-28T11:45:49.249 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-thrustmaster.ko 2023-11-28T11:45:49.249 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-tivo.ko 2023-11-28T11:45:49.249 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-tmff.ko 2023-11-28T11:45:49.249 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-topseed.ko 2023-11-28T11:45:49.249 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-twinhan.ko 2023-11-28T11:45:49.249 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-uclogic.ko 2023-11-28T11:45:49.250 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-waltop.ko 2023-11-28T11:45:49.250 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-wiimote.ko 2023-11-28T11:45:49.250 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-xinmo.ko 2023-11-28T11:45:49.250 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-zpff.ko 2023-11-28T11:45:49.250 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-zydacron.ko 2023-11-28T11:45:49.250 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/uhid.ko 2023-11-28T11:45:49.250 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/wacom.ko 2023-11-28T11:45:49.250 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv 2023-11-28T11:45:49.250 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_balloon.ko 2023-11-28T11:45:49.250 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_utils.ko 2023-11-28T11:45:49.250 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_vmbus.ko 2023-11-28T11:45:49.250 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon 2023-11-28T11:45:49.250 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/abituguru.ko 2023-11-28T11:45:49.251 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/abituguru3.ko 2023-11-28T11:45:49.251 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/acpi_power_meter.ko 2023-11-28T11:45:49.251 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ad7414.ko 2023-11-28T11:45:49.251 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ad7418.ko 2023-11-28T11:45:49.251 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adc128d818.ko 2023-11-28T11:45:49.251 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1025.ko 2023-11-28T11:45:49.251 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1026.ko 2023-11-28T11:45:49.251 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1029.ko 2023-11-28T11:45:49.251 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1031.ko 2023-11-28T11:45:49.251 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm9240.ko 2023-11-28T11:45:49.251 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ads7828.ko 2023-11-28T11:45:49.251 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7410.ko 2023-11-28T11:45:49.251 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7411.ko 2023-11-28T11:45:49.252 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7462.ko 2023-11-28T11:45:49.252 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7470.ko 2023-11-28T11:45:49.252 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7475.ko 2023-11-28T11:45:49.252 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7x10.ko 2023-11-28T11:45:49.252 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/amc6821.ko 2023-11-28T11:45:49.252 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/applesmc.ko 2023-11-28T11:45:49.252 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asb100.ko 2023-11-28T11:45:49.252 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asc7621.ko 2023-11-28T11:45:49.252 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asus_atk0110.ko 2023-11-28T11:45:49.252 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/atxp1.ko 2023-11-28T11:45:49.253 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/coretemp.ko 2023-11-28T11:45:49.253 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-11-28T11:45:49.253 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/dme1737.ko 2023-11-28T11:45:49.253 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ds1621.ko 2023-11-28T11:45:49.253 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ds620.ko 2023-11-28T11:45:49.253 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc1403.ko 2023-11-28T11:45:49.253 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc6w201.ko 2023-11-28T11:45:49.253 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f71805f.ko 2023-11-28T11:45:49.253 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f71882fg.ko 2023-11-28T11:45:49.253 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f75375s.ko 2023-11-28T11:45:49.253 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/fam15h_power.ko 2023-11-28T11:45:49.253 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/fschmd.ko 2023-11-28T11:45:49.253 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/g760a.ko 2023-11-28T11:45:49.254 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/g762.ko 2023-11-28T11:45:49.254 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/gl518sm.ko 2023-11-28T11:45:49.254 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/gl520sm.ko 2023-11-28T11:45:49.254 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/hwmon-vid.ko 2023-11-28T11:45:49.254 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/i5500_temp.ko 2023-11-28T11:45:49.254 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/i5k_amb.ko 2023-11-28T11:45:49.254 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ibmaem.ko 2023-11-28T11:45:49.254 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ibmpex.ko 2023-11-28T11:45:49.254 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ina209.ko 2023-11-28T11:45:49.254 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ina2xx.ko 2023-11-28T11:45:49.254 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/it87.ko 2023-11-28T11:45:49.255 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/k10temp.ko 2023-11-28T11:45:49.255 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/k8temp.ko 2023-11-28T11:45:49.255 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lineage-pem.ko 2023-11-28T11:45:49.255 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm63.ko 2023-11-28T11:45:49.255 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm73.ko 2023-11-28T11:45:49.255 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm75.ko 2023-11-28T11:45:49.255 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm77.ko 2023-11-28T11:45:49.255 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm78.ko 2023-11-28T11:45:49.255 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm80.ko 2023-11-28T11:45:49.255 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm83.ko 2023-11-28T11:45:49.255 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm85.ko 2023-11-28T11:45:49.255 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm87.ko 2023-11-28T11:45:49.255 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm90.ko 2023-11-28T11:45:49.256 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm92.ko 2023-11-28T11:45:49.256 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm93.ko 2023-11-28T11:45:49.256 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95234.ko 2023-11-28T11:45:49.256 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95241.ko 2023-11-28T11:45:49.256 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95245.ko 2023-11-28T11:45:49.256 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc2945.ko 2023-11-28T11:45:49.256 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4151.ko 2023-11-28T11:45:49.256 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4215.ko 2023-11-28T11:45:49.256 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4222.ko 2023-11-28T11:45:49.256 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4245.ko 2023-11-28T11:45:49.256 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4260.ko 2023-11-28T11:45:49.256 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4261.ko 2023-11-28T11:45:49.256 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max16065.ko 2023-11-28T11:45:49.257 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max1619.ko 2023-11-28T11:45:49.257 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max1668.ko 2023-11-28T11:45:49.257 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max197.ko 2023-11-28T11:45:49.257 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6639.ko 2023-11-28T11:45:49.257 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6650.ko 2023-11-28T11:45:49.257 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6697.ko 2023-11-28T11:45:49.257 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/mcp3021.ko 2023-11-28T11:45:49.257 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6683.ko 2023-11-28T11:45:49.257 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6775-core.ko 2023-11-28T11:45:49.257 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6775.ko 2023-11-28T11:45:49.257 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct7802.ko 2023-11-28T11:45:49.257 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pc87360.ko 2023-11-28T11:45:49.257 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pc87427.ko 2023-11-28T11:45:49.258 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pcf8591.ko 2023-11-28T11:45:49.258 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus 2023-11-28T11:45:49.258 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-11-28T11:45:49.258 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-11-28T11:45:49.258 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-11-28T11:45:49.258 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max16064.ko 2023-11-28T11:45:49.258 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max34440.ko 2023-11-28T11:45:49.258 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max8688.ko 2023-11-28T11:45:49.258 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-11-28T11:45:49.258 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-11-28T11:45:49.258 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-11-28T11:45:49.258 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-11-28T11:45:49.259 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-11-28T11:45:49.259 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-11-28T11:45:49.259 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/powr1220.ko 2023-11-28T11:45:49.259 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch5627.ko 2023-11-28T11:45:49.259 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch5636.ko 2023-11-28T11:45:49.259 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch56xx-common.ko 2023-11-28T11:45:49.259 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sht15.ko 2023-11-28T11:45:49.259 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sht21.ko 2023-11-28T11:45:49.259 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/shtc1.ko 2023-11-28T11:45:49.259 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sis5595.ko 2023-11-28T11:45:49.259 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47b397.ko 2023-11-28T11:45:49.259 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47m1.ko 2023-11-28T11:45:49.259 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47m192.ko 2023-11-28T11:45:49.260 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/thmc50.ko 2023-11-28T11:45:49.260 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp102.ko 2023-11-28T11:45:49.260 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp103.ko 2023-11-28T11:45:49.260 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp401.ko 2023-11-28T11:45:49.260 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp421.ko 2023-11-28T11:45:49.260 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/via-cputemp.ko 2023-11-28T11:45:49.260 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/via686a.ko 2023-11-28T11:45:49.260 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/vt1211.ko 2023-11-28T11:45:49.260 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/vt8231.ko 2023-11-28T11:45:49.260 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83627ehf.ko 2023-11-28T11:45:49.260 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83627hf.ko 2023-11-28T11:45:49.260 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83781d.ko 2023-11-28T11:45:49.261 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83791d.ko 2023-11-28T11:45:49.261 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83792d.ko 2023-11-28T11:45:49.261 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83793.ko 2023-11-28T11:45:49.261 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83795.ko 2023-11-28T11:45:49.261 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83l785ts.ko 2023-11-28T11:45:49.261 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83l786ng.ko 2023-11-28T11:45:49.261 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c 2023-11-28T11:45:49.261 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos 2023-11-28T11:45:49.261 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-11-28T11:45:49.261 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-11-28T11:45:49.261 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses 2023-11-28T11:45:49.261 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-11-28T11:45:49.261 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-11-28T11:45:49.262 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-11-28T11:45:49.262 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-11-28T11:45:49.262 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-11-28T11:45:49.262 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-11-28T11:45:49.262 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-11-28T11:45:49.262 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-11-28T11:45:49.262 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-i801.ko 2023-11-28T11:45:49.262 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-isch.ko 2023-11-28T11:45:49.262 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-11-28T11:45:49.262 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-11-28T11:45:49.262 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-11-28T11:45:49.262 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-parport.ko 2023-11-28T11:45:49.262 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-11-28T11:45:49.263 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-11-28T11:45:49.263 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-11-28T11:45:49.263 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-11-28T11:45:49.263 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-11-28T11:45:49.263 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-11-28T11:45:49.263 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-via.ko 2023-11-28T11:45:49.263 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-11-28T11:45:49.263 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-11-28T11:45:49.263 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-dev.ko 2023-11-28T11:45:49.263 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-mux.ko 2023-11-28T11:45:49.263 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-11-28T11:45:49.263 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-smbus.ko 2023-11-28T11:45:49.263 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-stub.ko 2023-11-28T11:45:49.264 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband 2023-11-28T11:45:49.264 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core 2023-11-28T11:45:49.264 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_cm.ko 2023-11-28T11:45:49.264 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_core.ko 2023-11-28T11:45:49.264 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_umad.ko 2023-11-28T11:45:49.264 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-11-28T11:45:49.264 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/iw_cm.ko 2023-11-28T11:45:49.264 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/rdma_cm.ko 2023-11-28T11:45:49.264 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-11-28T11:45:49.264 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw 2023-11-28T11:45:49.264 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/cxgb4 2023-11-28T11:45:49.264 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-11-28T11:45:49.265 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx4 2023-11-28T11:45:49.265 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-11-28T11:45:49.265 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx5 2023-11-28T11:45:49.265 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-11-28T11:45:49.265 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mthca 2023-11-28T11:45:49.265 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-11-28T11:45:49.265 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp 2023-11-28T11:45:49.265 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ipoib 2023-11-28T11:45:49.265 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-11-28T11:45:49.265 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/iser 2023-11-28T11:45:49.265 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-11-28T11:45:49.265 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/isert 2023-11-28T11:45:49.266 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-11-28T11:45:49.266 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srp 2023-11-28T11:45:49.266 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-11-28T11:45:49.266 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srpt 2023-11-28T11:45:49.266 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-11-28T11:45:49.266 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input 2023-11-28T11:45:49.266 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport 2023-11-28T11:45:49.266 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-11-28T11:45:49.266 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/fm801-gp.ko 2023-11-28T11:45:49.266 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/gameport.ko 2023-11-28T11:45:49.267 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/joydev.ko 2023-11-28T11:45:49.267 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard 2023-11-28T11:45:49.267 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/gpio_keys.ko 2023-11-28T11:45:49.267 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse 2023-11-28T11:45:49.267 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/appletouch.ko 2023-11-28T11:45:49.267 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/bcm5974.ko 2023-11-28T11:45:49.267 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/cyapatp.ko 2023-11-28T11:45:49.267 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/elan_i2c.ko 2023-11-28T11:45:49.267 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/sermouse.ko 2023-11-28T11:45:49.267 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-11-28T11:45:49.267 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/synaptics_usb.ko 2023-11-28T11:45:49.267 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/vsxxxaa.ko 2023-11-28T11:45:49.268 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/rmi4 2023-11-28T11:45:49.268 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/rmi4/rmi_core.ko 2023-11-28T11:45:49.268 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio 2023-11-28T11:45:49.268 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/altera_ps2.ko 2023-11-28T11:45:49.268 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/arc_ps2.ko 2023-11-28T11:45:49.268 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-11-28T11:45:49.268 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/serio_raw.ko 2023-11-28T11:45:49.268 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/sparse-keymap.ko 2023-11-28T11:45:49.268 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu 2023-11-28T11:45:49.268 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/amd 2023-11-28T11:45:49.268 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/amd/iommu_v2.ko 2023-11-28T11:45:49.268 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds 2023-11-28T11:45:49.269 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-blinkm.ko 2023-11-28T11:45:49.269 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3530.ko 2023-11-28T11:45:49.269 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lp3944.ko 2023-11-28T11:45:49.269 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-ss4200.ko 2023-11-28T11:45:49.269 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger 2023-11-28T11:45:49.269 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-11-28T11:45:49.269 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-11-28T11:45:49.269 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-11-28T11:45:49.269 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-11-28T11:45:49.269 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-11-28T11:45:49.269 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-11-28T11:45:49.269 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-11-28T11:45:49.269 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-11-28T11:45:49.270 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md 2023-11-28T11:45:49.270 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/bcache 2023-11-28T11:45:49.270 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/bcache/bcache.ko 2023-11-28T11:45:49.270 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-bio-prison.ko 2023-11-28T11:45:49.270 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-cache-smq.ko 2023-11-28T11:45:49.270 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-cache.ko 2023-11-28T11:45:49.270 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-crypt.ko 2023-11-28T11:45:49.270 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-delay.ko 2023-11-28T11:45:49.270 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-flakey.ko 2023-11-28T11:45:49.270 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-log-userspace.ko 2023-11-28T11:45:49.270 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-multipath.ko 2023-11-28T11:45:49.270 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-queue-length.ko 2023-11-28T11:45:49.271 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-raid.ko 2023-11-28T11:45:49.271 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-round-robin.ko 2023-11-28T11:45:49.271 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-service-time.ko 2023-11-28T11:45:49.271 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-switch.ko 2023-11-28T11:45:49.271 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-thin-pool.ko 2023-11-28T11:45:49.271 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-verity.ko 2023-11-28T11:45:49.271 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/faulty.ko 2023-11-28T11:45:49.271 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/linear.ko 2023-11-28T11:45:49.271 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/multipath.ko 2023-11-28T11:45:49.271 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/persistent-data 2023-11-28T11:45:49.271 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-11-28T11:45:49.272 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid0.ko 2023-11-28T11:45:49.272 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid1.ko 2023-11-28T11:45:49.272 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid10.ko 2023-11-28T11:45:49.272 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid456.ko 2023-11-28T11:45:49.272 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message 2023-11-28T11:45:49.272 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion 2023-11-28T11:45:49.272 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptbase.ko 2023-11-28T11:45:49.272 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptctl.ko 2023-11-28T11:45:49.272 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptfc.ko 2023-11-28T11:45:49.272 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptlan.ko 2023-11-28T11:45:49.272 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptsas.ko 2023-11-28T11:45:49.272 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptscsih.ko 2023-11-28T11:45:49.273 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptspi.ko 2023-11-28T11:45:49.273 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd 2023-11-28T11:45:49.273 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lpc_ich.ko 2023-11-28T11:45:49.273 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lpc_sch.ko 2023-11-28T11:45:49.273 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/mfd-core.ko 2023-11-28T11:45:49.273 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/sm501.ko 2023-11-28T11:45:49.273 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/viperboard.ko 2023-11-28T11:45:49.273 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/vx855.ko 2023-11-28T11:45:49.273 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/wl1273-core.ko 2023-11-28T11:45:49.273 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc 2023-11-28T11:45:49.273 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/altera-stapl 2023-11-28T11:45:49.273 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-11-28T11:45:49.273 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/apds9802als.ko 2023-11-28T11:45:49.274 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/apds990x.ko 2023-11-28T11:45:49.274 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/bh1770glc.ko 2023-11-28T11:45:49.274 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/cb710 2023-11-28T11:45:49.274 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/cb710/cb710.ko 2023-11-28T11:45:49.274 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom 2023-11-28T11:45:49.274 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/at24.ko 2023-11-28T11:45:49.274 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/eeprom.ko 2023-11-28T11:45:49.274 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-11-28T11:45:49.274 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/max6875.ko 2023-11-28T11:45:49.274 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/enclosure.ko 2023-11-28T11:45:49.274 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/hpilo.ko 2023-11-28T11:45:49.274 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/isl29003.ko 2023-11-28T11:45:49.275 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/isl29020.ko 2023-11-28T11:45:49.275 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d 2023-11-28T11:45:49.275 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-11-28T11:45:49.275 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-11-28T11:45:49.275 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei 2023-11-28T11:45:49.275 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei-me.ko 2023-11-28T11:45:49.275 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei-txe.ko 2023-11-28T11:45:49.275 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei.ko 2023-11-28T11:45:49.275 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/sgi-gru 2023-11-28T11:45:49.275 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/sgi-gru/gru.ko 2023-11-28T11:45:49.275 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/sgi-xp 2023-11-28T11:45:49.275 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/sgi-xp/xp.ko 2023-11-28T11:45:49.276 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/sgi-xp/xpc.ko 2023-11-28T11:45:49.276 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-11-28T11:45:49.276 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tifm_7xx1.ko 2023-11-28T11:45:49.276 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tifm_core.ko 2023-11-28T11:45:49.276 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tsl2550.ko 2023-11-28T11:45:49.276 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_balloon.ko 2023-11-28T11:45:49.276 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_vmci 2023-11-28T11:45:49.276 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-11-28T11:45:49.276 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net 2023-11-28T11:45:49.276 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/bonding 2023-11-28T11:45:49.276 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/bonding/bonding.ko 2023-11-28T11:45:49.276 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa 2023-11-28T11:45:49.276 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/b53 2023-11-28T11:45:49.277 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/b53/b53_common.ko 2023-11-28T11:45:49.277 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/bcm-sf2.ko 2023-11-28T11:45:49.277 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6060.ko 2023-11-28T11:45:49.277 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6xxx 2023-11-28T11:45:49.277 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-11-28T11:45:49.277 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dummy.ko 2023-11-28T11:45:49.277 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/eql.ko 2023-11-28T11:45:49.277 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet 2023-11-28T11:45:49.277 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com 2023-11-28T11:45:49.277 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-11-28T11:45:49.277 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-11-28T11:45:49.277 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-11-28T11:45:49.278 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-11-28T11:45:49.278 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390 2023-11-28T11:45:49.278 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/8390.ko 2023-11-28T11:45:49.278 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-11-28T11:45:49.278 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-11-28T11:45:49.278 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-11-28T11:45:49.278 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/adaptec 2023-11-28T11:45:49.278 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-11-28T11:45:49.278 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/agere 2023-11-28T11:45:49.279 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/agere/et131x.ko 2023-11-28T11:45:49.279 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/alteon 2023-11-28T11:45:49.279 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-11-28T11:45:49.279 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/altera 2023-11-28T11:45:49.279 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-11-28T11:45:49.279 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd 2023-11-28T11:45:49.279 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-11-28T11:45:49.279 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-11-28T11:45:49.279 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-11-28T11:45:49.279 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros 2023-11-28T11:45:49.279 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/alx 2023-11-28T11:45:49.280 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-11-28T11:45:49.280 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1c 2023-11-28T11:45:49.280 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-11-28T11:45:49.280 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1e 2023-11-28T11:45:49.280 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-11-28T11:45:49.280 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx 2023-11-28T11:45:49.280 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-11-28T11:45:49.280 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-11-28T11:45:49.280 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom 2023-11-28T11:45:49.280 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-11-28T11:45:49.280 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-11-28T11:45:49.280 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-11-28T11:45:49.281 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-11-28T11:45:49.281 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-11-28T11:45:49.281 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/genet 2023-11-28T11:45:49.281 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-11-28T11:45:49.281 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-11-28T11:45:49.281 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade 2023-11-28T11:45:49.281 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/bna 2023-11-28T11:45:49.281 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-11-28T11:45:49.281 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio 2023-11-28T11:45:49.281 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb 2023-11-28T11:45:49.281 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-11-28T11:45:49.281 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-11-28T11:45:49.281 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-11-28T11:45:49.282 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-11-28T11:45:49.282 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-11-28T11:45:49.282 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-11-28T11:45:49.282 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-11-28T11:45:49.282 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-11-28T11:45:49.282 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-11-28T11:45:49.282 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco 2023-11-28T11:45:49.282 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/enic 2023-11-28T11:45:49.282 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-11-28T11:45:49.282 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec 2023-11-28T11:45:49.282 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip 2023-11-28T11:45:49.283 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-11-28T11:45:49.283 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-11-28T11:45:49.283 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-11-28T11:45:49.283 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-11-28T11:45:49.283 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-11-28T11:45:49.283 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-11-28T11:45:49.283 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink 2023-11-28T11:45:49.284 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-11-28T11:45:49.284 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-11-28T11:45:49.284 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dnet.ko 2023-11-28T11:45:49.284 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex 2023-11-28T11:45:49.284 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/benet 2023-11-28T11:45:49.284 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-11-28T11:45:49.284 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ethoc.ko 2023-11-28T11:45:49.285 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fealnx.ko 2023-11-28T11:45:49.285 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel 2023-11-28T11:45:49.285 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e100.ko 2023-11-28T11:45:49.285 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000 2023-11-28T11:45:49.285 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-11-28T11:45:49.286 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000e 2023-11-28T11:45:49.286 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-11-28T11:45:49.286 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/fm10k 2023-11-28T11:45:49.286 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-11-28T11:45:49.286 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/i40e 2023-11-28T11:45:49.286 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-11-28T11:45:49.287 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/iavf 2023-11-28T11:45:49.287 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-11-28T11:45:49.287 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igb 2023-11-28T11:45:49.287 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-11-28T11:45:49.287 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igbvf 2023-11-28T11:45:49.287 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-11-28T11:45:49.287 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbe 2023-11-28T11:45:49.288 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-11-28T11:45:49.288 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbevf 2023-11-28T11:45:49.288 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-11-28T11:45:49.288 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/jme.ko 2023-11-28T11:45:49.288 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell 2023-11-28T11:45:49.288 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-11-28T11:45:49.288 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/skge.ko 2023-11-28T11:45:49.289 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-11-28T11:45:49.289 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox 2023-11-28T11:45:49.289 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4 2023-11-28T11:45:49.289 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-11-28T11:45:49.289 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-11-28T11:45:49.289 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5 2023-11-28T11:45:49.289 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-11-28T11:45:49.290 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-11-28T11:45:49.290 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel 2023-11-28T11:45:49.290 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-11-28T11:45:49.290 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom 2023-11-28T11:45:49.290 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/myri10ge 2023-11-28T11:45:49.290 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-11-28T11:45:49.291 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi 2023-11-28T11:45:49.291 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-11-28T11:45:49.291 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-11-28T11:45:49.291 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/neterion 2023-11-28T11:45:49.291 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-11-28T11:45:49.291 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/nvidia 2023-11-28T11:45:49.292 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-11-28T11:45:49.292 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines 2023-11-28T11:45:49.292 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-11-28T11:45:49.292 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-11-28T11:45:49.292 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic 2023-11-28T11:45:49.292 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/netxen 2023-11-28T11:45:49.292 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-11-28T11:45:49.292 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-11-28T11:45:49.293 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-11-28T11:45:49.293 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-11-28T11:45:49.293 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rdc 2023-11-28T11:45:49.293 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-11-28T11:45:49.293 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek 2023-11-28T11:45:49.293 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-11-28T11:45:49.293 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-11-28T11:45:49.293 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/atp.ko 2023-11-28T11:45:49.293 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-11-28T11:45:49.293 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rocker 2023-11-28T11:45:49.293 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-11-28T11:45:49.294 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sfc 2023-11-28T11:45:49.294 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-11-28T11:45:49.294 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/silan 2023-11-28T11:45:49.294 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-11-28T11:45:49.294 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis 2023-11-28T11:45:49.294 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/sis190.ko 2023-11-28T11:45:49.294 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/sis900.ko 2023-11-28T11:45:49.294 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc 2023-11-28T11:45:49.294 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-11-28T11:45:49.294 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-11-28T11:45:49.294 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-11-28T11:45:49.294 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-11-28T11:45:49.295 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro 2023-11-28T11:45:49.295 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac 2023-11-28T11:45:49.295 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-11-28T11:45:49.295 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-11-28T11:45:49.295 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun 2023-11-28T11:45:49.295 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/cassini.ko 2023-11-28T11:45:49.295 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/niu.ko 2023-11-28T11:45:49.295 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/sungem.ko 2023-11-28T11:45:49.295 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-11-28T11:45:49.295 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/tehuti 2023-11-28T11:45:49.295 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-11-28T11:45:49.295 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ti 2023-11-28T11:45:49.296 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ti/tlan.ko 2023-11-28T11:45:49.296 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via 2023-11-28T11:45:49.296 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-11-28T11:45:49.296 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-11-28T11:45:49.296 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet 2023-11-28T11:45:49.296 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-11-28T11:45:49.296 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-11-28T11:45:49.296 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/xircom 2023-11-28T11:45:49.296 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-11-28T11:45:49.296 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/geneve.ko 2023-11-28T11:45:49.296 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/hyperv 2023-11-28T11:45:49.296 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-11-28T11:45:49.297 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ieee802154 2023-11-28T11:45:49.297 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ieee802154/fakelb.ko 2023-11-28T11:45:49.297 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ifb.ko 2023-11-28T11:45:49.297 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ipvlan 2023-11-28T11:45:49.297 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ipvlan/ipvlan.ko 2023-11-28T11:45:49.297 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/macvlan.ko 2023-11-28T11:45:49.297 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/macvtap.ko 2023-11-28T11:45:49.297 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio 2023-11-28T11:45:49.297 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio.ko 2023-11-28T11:45:49.297 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-11-28T11:45:49.297 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-11-28T11:45:49.297 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-regmap.ko 2023-11-28T11:45:49.297 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mii.ko 2023-11-28T11:45:49.298 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/net_failover.ko 2023-11-28T11:45:49.298 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/netconsole.ko 2023-11-28T11:45:49.298 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/nlmon.ko 2023-11-28T11:45:49.298 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs 2023-11-28T11:45:49.298 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/pcs-lynx.ko 2023-11-28T11:45:49.298 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-11-28T11:45:49.298 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy 2023-11-28T11:45:49.298 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/amd.ko 2023-11-28T11:45:49.298 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-11-28T11:45:49.298 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-11-28T11:45:49.298 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm7xxx.ko 2023-11-28T11:45:49.299 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm87xx.ko 2023-11-28T11:45:49.299 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/broadcom.ko 2023-11-28T11:45:49.299 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/cicada.ko 2023-11-28T11:45:49.299 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/davicom.ko 2023-11-28T11:45:49.299 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/dp83640.ko 2023-11-28T11:45:49.299 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/et1011c.ko 2023-11-28T11:45:49.299 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/icplus.ko 2023-11-28T11:45:49.299 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/lxt.ko 2023-11-28T11:45:49.299 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/marvell.ko 2023-11-28T11:45:49.299 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/micrel.ko 2023-11-28T11:45:49.299 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/national.ko 2023-11-28T11:45:49.299 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/phylink.ko 2023-11-28T11:45:49.299 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/qsemi.ko 2023-11-28T11:45:49.300 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/realtek.ko 2023-11-28T11:45:49.300 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/smsc.ko 2023-11-28T11:45:49.300 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/ste10Xp.ko 2023-11-28T11:45:49.300 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/vitesse.ko 2023-11-28T11:45:49.300 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp 2023-11-28T11:45:49.300 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/bsd_comp.ko 2023-11-28T11:45:49.300 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_async.ko 2023-11-28T11:45:49.300 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_deflate.ko 2023-11-28T11:45:49.300 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_generic.ko 2023-11-28T11:45:49.301 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_mppe.ko 2023-11-28T11:45:49.301 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_synctty.ko 2023-11-28T11:45:49.301 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pppoe.ko 2023-11-28T11:45:49.301 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pppox.ko 2023-11-28T11:45:49.301 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pptp.ko 2023-11-28T11:45:49.302 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip 2023-11-28T11:45:49.302 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip/slhc.ko 2023-11-28T11:45:49.302 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip/slip.ko 2023-11-28T11:45:49.302 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/sungem_phy.ko 2023-11-28T11:45:49.302 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/tap.ko 2023-11-28T11:45:49.302 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team 2023-11-28T11:45:49.303 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team.ko 2023-11-28T11:45:49.303 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_activebackup.ko 2023-11-28T11:45:49.303 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_broadcast.ko 2023-11-28T11:45:49.303 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-11-28T11:45:49.303 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_random.ko 2023-11-28T11:45:49.303 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-11-28T11:45:49.304 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/tun.ko 2023-11-28T11:45:49.304 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/veth.ko 2023-11-28T11:45:49.304 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/virtio_net.ko 2023-11-28T11:45:49.304 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vmxnet3 2023-11-28T11:45:49.304 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-11-28T11:45:49.304 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vxlan 2023-11-28T11:45:49.304 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vxlan/vxlan.ko 2023-11-28T11:45:49.305 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netback 2023-11-28T11:45:49.305 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netback/xen-netback.ko 2023-11-28T11:45:49.305 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netfront.ko 2023-11-28T11:45:49.305 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ntb 2023-11-28T11:45:49.305 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ntb/ntb.ko 2023-11-28T11:45:49.305 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme 2023-11-28T11:45:49.306 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host 2023-11-28T11:45:49.306 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/nvme-core.ko 2023-11-28T11:45:49.306 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/nvme.ko 2023-11-28T11:45:49.306 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport 2023-11-28T11:45:49.306 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport.ko 2023-11-28T11:45:49.306 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_cs.ko 2023-11-28T11:45:49.307 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_pc.ko 2023-11-28T11:45:49.307 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_serial.ko 2023-11-28T11:45:49.307 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci 2023-11-28T11:45:49.307 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug 2023-11-28T11:45:49.307 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-11-28T11:45:49.308 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/pcie 2023-11-28T11:45:49.308 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/pcie/aer_inject.ko 2023-11-28T11:45:49.308 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/xen-pcifront.ko 2023-11-28T11:45:49.308 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia 2023-11-28T11:45:49.308 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/i82092.ko 2023-11-28T11:45:49.308 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pd6729.ko 2023-11-28T11:45:49.309 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/yenta_socket.ko 2023-11-28T11:45:49.309 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl 2023-11-28T11:45:49.309 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/intel 2023-11-28T11:45:49.309 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-11-28T11:45:49.309 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform 2023-11-28T11:45:49.309 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86 2023-11-28T11:45:49.310 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/acer-wmi.ko 2023-11-28T11:45:49.310 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/acerhdf.ko 2023-11-28T11:45:49.310 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/apple-gmux.ko 2023-11-28T11:45:49.310 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-laptop.ko 2023-11-28T11:45:49.310 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-11-28T11:45:49.310 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-wmi.ko 2023-11-28T11:45:49.311 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/classmate-laptop.ko 2023-11-28T11:45:49.311 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-11-28T11:45:49.311 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-11-28T11:45:49.311 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-11-28T11:45:49.311 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-11-28T11:45:49.311 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/hdaps.ko 2023-11-28T11:45:49.312 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel 2023-11-28T11:45:49.312 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-11-28T11:45:49.312 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel_ips.ko 2023-11-28T11:45:49.312 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/msi-wmi.ko 2023-11-28T11:45:49.312 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/mxm-wmi.ko 2023-11-28T11:45:49.312 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-11-28T11:45:49.313 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/samsung-laptop.ko 2023-11-28T11:45:49.313 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/samsung-q10.ko 2023-11-28T11:45:49.313 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/topstar-laptop.ko 2023-11-28T11:45:49.313 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-11-28T11:45:49.313 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/toshiba_haps.ko 2023-11-28T11:45:49.313 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/wmi-bmof.ko 2023-11-28T11:45:49.314 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/wmi.ko 2023-11-28T11:45:49.314 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap 2023-11-28T11:45:49.314 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/intel_rapl_common.ko 2023-11-28T11:45:49.314 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/intel_rapl_msr.ko 2023-11-28T11:45:49.314 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps 2023-11-28T11:45:49.315 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients 2023-11-28T11:45:49.315 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps-gpio.ko 2023-11-28T11:45:49.315 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps-ldisc.ko 2023-11-28T11:45:49.315 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps_parport.ko 2023-11-28T11:45:49.315 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/pps_core.ko 2023-11-28T11:45:49.315 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp 2023-11-28T11:45:49.316 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ptp.ko 2023-11-28T11:45:49.316 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ptp_kvm.ko 2023-11-28T11:45:49.316 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc 2023-11-28T11:45:49.316 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-bq32k.ko 2023-11-28T11:45:49.316 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1286.ko 2023-11-28T11:45:49.316 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1307.ko 2023-11-28T11:45:49.317 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1374.ko 2023-11-28T11:45:49.317 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1511.ko 2023-11-28T11:45:49.317 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1553.ko 2023-11-28T11:45:49.317 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1672.ko 2023-11-28T11:45:49.317 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1742.ko 2023-11-28T11:45:49.318 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds2404.ko 2023-11-28T11:45:49.318 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds3232.ko 2023-11-28T11:45:49.318 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-em3027.ko 2023-11-28T11:45:49.318 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-fm3130.ko 2023-11-28T11:45:49.318 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-isl12022.ko 2023-11-28T11:45:49.318 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-isl1208.ko 2023-11-28T11:45:49.319 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m41t80.ko 2023-11-28T11:45:49.319 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t35.ko 2023-11-28T11:45:49.319 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t59.ko 2023-11-28T11:45:49.319 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max6900.ko 2023-11-28T11:45:49.319 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-msm6242.ko 2023-11-28T11:45:49.319 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf2127.ko 2023-11-28T11:45:49.319 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf85063.ko 2023-11-28T11:45:49.319 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8523.ko 2023-11-28T11:45:49.319 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8563.ko 2023-11-28T11:45:49.319 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8583.ko 2023-11-28T11:45:49.319 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rp5c01.ko 2023-11-28T11:45:49.319 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rs5c372.ko 2023-11-28T11:45:49.320 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-11-28T11:45:49.320 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rx8025.ko 2023-11-28T11:45:49.320 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rx8581.ko 2023-11-28T11:45:49.320 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-11-28T11:45:49.320 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-x1205.ko 2023-11-28T11:45:49.320 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi 2023-11-28T11:45:49.320 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-9xxx.ko 2023-11-28T11:45:49.320 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-sas.ko 2023-11-28T11:45:49.320 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-xxxx.ko 2023-11-28T11:45:49.320 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/BusLogic.ko 2023-11-28T11:45:49.320 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/a100u2w.ko 2023-11-28T11:45:49.320 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aacraid 2023-11-28T11:45:49.320 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aacraid/aacraid.ko 2023-11-28T11:45:49.321 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/advansys.ko 2023-11-28T11:45:49.321 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx 2023-11-28T11:45:49.321 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-11-28T11:45:49.321 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-11-28T11:45:49.321 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/am53c974.ko 2023-11-28T11:45:49.321 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/arcmsr 2023-11-28T11:45:49.321 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-11-28T11:45:49.321 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/atp870u.ko 2023-11-28T11:45:49.321 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/be2iscsi 2023-11-28T11:45:49.321 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-11-28T11:45:49.321 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bfa 2023-11-28T11:45:49.321 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bfa/bfa.ko 2023-11-28T11:45:49.322 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2fc 2023-11-28T11:45:49.322 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-11-28T11:45:49.322 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2i 2023-11-28T11:45:49.322 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-11-28T11:45:49.322 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ch.ko 2023-11-28T11:45:49.322 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/csiostor 2023-11-28T11:45:49.322 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/csiostor/csiostor.ko 2023-11-28T11:45:49.322 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi 2023-11-28T11:45:49.322 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb3i 2023-11-28T11:45:49.322 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-11-28T11:45:49.322 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb4i 2023-11-28T11:45:49.322 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-11-28T11:45:49.323 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-11-28T11:45:49.323 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/dc395x.ko 2023-11-28T11:45:49.323 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/device_handler 2023-11-28T11:45:49.323 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-11-28T11:45:49.323 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-11-28T11:45:49.323 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-11-28T11:45:49.323 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-11-28T11:45:49.323 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/dmx3191d.ko 2023-11-28T11:45:49.323 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esas2r 2023-11-28T11:45:49.323 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esas2r/esas2r.ko 2023-11-28T11:45:49.323 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esp_scsi.ko 2023-11-28T11:45:49.324 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe 2023-11-28T11:45:49.324 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/fcoe.ko 2023-11-28T11:45:49.324 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-11-28T11:45:49.324 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fnic 2023-11-28T11:45:49.324 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fnic/fnic.ko 2023-11-28T11:45:49.324 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hpsa.ko 2023-11-28T11:45:49.324 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hptiop.ko 2023-11-28T11:45:49.324 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hv_storvsc.ko 2023-11-28T11:45:49.324 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/initio.ko 2023-11-28T11:45:49.324 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ipr.ko 2023-11-28T11:45:49.324 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ips.ko 2023-11-28T11:45:49.324 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/isci 2023-11-28T11:45:49.324 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/isci/isci.ko 2023-11-28T11:45:49.325 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-11-28T11:45:49.325 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/iscsi_tcp.ko 2023-11-28T11:45:49.325 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libfc 2023-11-28T11:45:49.325 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libfc/libfc.ko 2023-11-28T11:45:49.325 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libiscsi.ko 2023-11-28T11:45:49.325 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libiscsi_tcp.ko 2023-11-28T11:45:49.325 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libsas 2023-11-28T11:45:49.325 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libsas/libsas.ko 2023-11-28T11:45:49.325 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/lpfc 2023-11-28T11:45:49.325 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/lpfc/lpfc.ko 2023-11-28T11:45:49.325 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid 2023-11-28T11:45:49.326 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid.ko 2023-11-28T11:45:49.326 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-11-28T11:45:49.326 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-11-28T11:45:49.326 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-11-28T11:45:49.326 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mpt3sas 2023-11-28T11:45:49.326 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-11-28T11:45:49.326 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvsas 2023-11-28T11:45:49.326 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvsas/mvsas.ko 2023-11-28T11:45:49.326 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvumi.ko 2023-11-28T11:45:49.326 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pm8001 2023-11-28T11:45:49.326 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-11-28T11:45:49.326 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pmcraid.ko 2023-11-28T11:45:49.327 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla1280.ko 2023-11-28T11:45:49.327 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx 2023-11-28T11:45:49.327 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-11-28T11:45:49.327 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-11-28T11:45:49.327 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla4xxx 2023-11-28T11:45:49.327 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-11-28T11:45:49.327 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/raid_class.ko 2023-11-28T11:45:49.327 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_debug.ko 2023-11-28T11:45:49.327 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_fc.ko 2023-11-28T11:45:49.327 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-11-28T11:45:49.327 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_sas.ko 2023-11-28T11:45:49.327 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_spi.ko 2023-11-28T11:45:49.328 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_srp.ko 2023-11-28T11:45:49.328 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ses.ko 2023-11-28T11:45:49.328 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/st.ko 2023-11-28T11:45:49.328 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/stex.ko 2023-11-28T11:45:49.328 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/sym53c8xx_2 2023-11-28T11:45:49.328 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-11-28T11:45:49.328 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/virtio_scsi.ko 2023-11-28T11:45:49.328 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/vmw_pvscsi.ko 2023-11-28T11:45:49.328 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/wd719x.ko 2023-11-28T11:45:49.328 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ssb 2023-11-28T11:45:49.328 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ssb/ssb.ko 2023-11-28T11:45:49.328 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target 2023-11-28T11:45:49.328 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/iscsi 2023-11-28T11:45:49.329 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-11-28T11:45:49.329 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/loopback 2023-11-28T11:45:49.329 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/loopback/tcm_loop.ko 2023-11-28T11:45:49.329 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_file.ko 2023-11-28T11:45:49.329 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_iblock.ko 2023-11-28T11:45:49.329 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_mod.ko 2023-11-28T11:45:49.329 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_pscsi.ko 2023-11-28T11:45:49.329 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_user.ko 2023-11-28T11:45:49.329 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/tcm_fc 2023-11-28T11:45:49.329 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-11-28T11:45:49.329 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal 2023-11-28T11:45:49.329 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel 2023-11-28T11:45:49.330 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal 2023-11-28T11:45:49.330 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-11-28T11:45:49.330 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-11-28T11:45:49.330 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-11-28T11:45:49.330 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-11-28T11:45:49.330 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-11-28T11:45:49.330 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-11-28T11:45:49.330 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-11-28T11:45:49.330 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-11-28T11:45:49.330 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-11-28T11:45:49.330 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-11-28T11:45:49.330 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-11-28T11:45:49.331 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-11-28T11:45:49.331 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-11-28T11:45:49.331 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-11-28T11:45:49.331 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-11-28T11:45:49.331 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty 2023-11-28T11:45:49.331 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ipwireless 2023-11-28T11:45:49.331 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-11-28T11:45:49.331 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/n_gsm.ko 2023-11-28T11:45:49.331 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/n_hdlc.ko 2023-11-28T11:45:49.331 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/nozomi.ko 2023-11-28T11:45:49.331 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial 2023-11-28T11:45:49.331 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250 2023-11-28T11:45:49.332 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-11-28T11:45:49.332 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/arc_uart.ko 2023-11-28T11:45:49.332 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/jsm 2023-11-28T11:45:49.332 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/jsm/jsm.ko 2023-11-28T11:45:49.332 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs 2023-11-28T11:45:49.332 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/core 2023-11-28T11:45:49.332 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/core/ufshcd-core.ko 2023-11-28T11:45:49.332 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host 2023-11-28T11:45:49.332 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-11-28T11:45:49.332 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio 2023-11-28T11:45:49.332 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio.ko 2023-11-28T11:45:49.332 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_aec.ko 2023-11-28T11:45:49.333 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_cif.ko 2023-11-28T11:45:49.333 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_pci_generic.ko 2023-11-28T11:45:49.333 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_sercos3.ko 2023-11-28T11:45:49.333 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb 2023-11-28T11:45:49.333 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class 2023-11-28T11:45:49.333 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/cdc-acm.ko 2023-11-28T11:45:49.333 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/cdc-wdm.ko 2023-11-28T11:45:49.333 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/usblp.ko 2023-11-28T11:45:49.333 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/usbtmc.ko 2023-11-28T11:45:49.333 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host 2023-11-28T11:45:49.333 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/sl811-hcd.ko 2023-11-28T11:45:49.334 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image 2023-11-28T11:45:49.334 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/mdc800.ko 2023-11-28T11:45:49.334 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/microtek.ko 2023-11-28T11:45:49.334 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc 2023-11-28T11:45:49.334 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/adutux.ko 2023-11-28T11:45:49.334 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/appledisplay.ko 2023-11-28T11:45:49.334 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/emi26.ko 2023-11-28T11:45:49.334 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/emi62.ko 2023-11-28T11:45:49.334 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ezusb.ko 2023-11-28T11:45:49.334 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/idmouse.ko 2023-11-28T11:45:49.334 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/iowarrior.ko 2023-11-28T11:45:49.334 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/isight_firmware.ko 2023-11-28T11:45:49.335 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ldusb.ko 2023-11-28T11:45:49.335 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/legousbtower.ko 2023-11-28T11:45:49.335 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/sisusbvga 2023-11-28T11:45:49.335 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-11-28T11:45:49.335 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/trancevibrator.ko 2023-11-28T11:45:49.335 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usb3503.ko 2023-11-28T11:45:49.335 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usblcd.ko 2023-11-28T11:45:49.335 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usbsevseg.ko 2023-11-28T11:45:49.335 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/uss720.ko 2023-11-28T11:45:49.335 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/yurex.ko 2023-11-28T11:45:49.335 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy 2023-11-28T11:45:49.335 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-generic.ko 2023-11-28T11:45:49.335 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial 2023-11-28T11:45:49.336 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/aircable.ko 2023-11-28T11:45:49.336 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ark3116.ko 2023-11-28T11:45:49.336 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/belkin_sa.ko 2023-11-28T11:45:49.336 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ch341.ko 2023-11-28T11:45:49.336 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cp210x.ko 2023-11-28T11:45:49.336 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cyberjack.ko 2023-11-28T11:45:49.336 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cypress_m8.ko 2023-11-28T11:45:49.336 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/digi_acceleport.ko 2023-11-28T11:45:49.336 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/empeg.ko 2023-11-28T11:45:49.336 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ftdi_sio.ko 2023-11-28T11:45:49.336 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/garmin_gps.ko 2023-11-28T11:45:49.336 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/io_edgeport.ko 2023-11-28T11:45:49.336 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/io_ti.ko 2023-11-28T11:45:49.337 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ipaq.ko 2023-11-28T11:45:49.337 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ipw.ko 2023-11-28T11:45:49.337 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ir-usb.ko 2023-11-28T11:45:49.337 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-11-28T11:45:49.337 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/keyspan.ko 2023-11-28T11:45:49.337 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/keyspan_pda.ko 2023-11-28T11:45:49.337 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/kl5kusb105.ko 2023-11-28T11:45:49.337 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/kobil_sct.ko 2023-11-28T11:45:49.337 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mct_u232.ko 2023-11-28T11:45:49.337 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mos7720.ko 2023-11-28T11:45:49.338 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mos7840.ko 2023-11-28T11:45:49.338 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/navman.ko 2023-11-28T11:45:49.338 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/omninet.ko 2023-11-28T11:45:49.338 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/opticon.ko 2023-11-28T11:45:49.338 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/option.ko 2023-11-28T11:45:49.338 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/oti6858.ko 2023-11-28T11:45:49.338 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/pl2303.ko 2023-11-28T11:45:49.338 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/qcaux.ko 2023-11-28T11:45:49.338 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/qcserial.ko 2023-11-28T11:45:49.338 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/quatech2.ko 2023-11-28T11:45:49.338 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/safe_serial.ko 2023-11-28T11:45:49.338 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/sierra.ko 2023-11-28T11:45:49.339 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/spcp8x5.ko 2023-11-28T11:45:49.339 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ssu100.ko 2023-11-28T11:45:49.339 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/symbolserial.ko 2023-11-28T11:45:49.339 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-11-28T11:45:49.339 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-11-28T11:45:49.339 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb_debug.ko 2023-11-28T11:45:49.339 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb_wwan.ko 2023-11-28T11:45:49.339 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/visor.ko 2023-11-28T11:45:49.339 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/whiteheat.ko 2023-11-28T11:45:49.339 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/xsens_mt.ko 2023-11-28T11:45:49.339 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage 2023-11-28T11:45:49.339 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/uas.ko 2023-11-28T11:45:49.340 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-alauda.ko 2023-11-28T11:45:49.340 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-cypress.ko 2023-11-28T11:45:49.340 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-datafab.ko 2023-11-28T11:45:49.340 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-11-28T11:45:49.340 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-freecom.ko 2023-11-28T11:45:49.340 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-isd200.ko 2023-11-28T11:45:49.340 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-11-28T11:45:49.340 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-karma.ko 2023-11-28T11:45:49.340 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-onetouch.ko 2023-11-28T11:45:49.340 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-realtek.ko 2023-11-28T11:45:49.340 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-sddr09.ko 2023-11-28T11:45:49.340 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-sddr55.ko 2023-11-28T11:45:49.340 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-usbat.ko 2023-11-28T11:45:49.341 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/usb-storage.ko 2023-11-28T11:45:49.341 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip 2023-11-28T11:45:49.341 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/usbip-core.ko 2023-11-28T11:45:49.341 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/usbip-host.ko 2023-11-28T11:45:49.341 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-11-28T11:45:49.341 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio 2023-11-28T11:45:49.341 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci 2023-11-28T11:45:49.341 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-11-28T11:45:49.341 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/vfio-pci.ko 2023-11-28T11:45:49.341 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/vfio.ko 2023-11-28T11:45:49.341 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-11-28T11:45:49.341 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost 2023-11-28T11:45:49.342 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost.ko 2023-11-28T11:45:49.342 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_iotlb.ko 2023-11-28T11:45:49.342 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_net.ko 2023-11-28T11:45:49.342 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_scsi.ko 2023-11-28T11:45:49.342 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video 2023-11-28T11:45:49.342 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight 2023-11-28T11:45:49.342 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/apple_bl.ko 2023-11-28T11:45:49.342 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lcd.ko 2023-11-28T11:45:49.342 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/platform_lcd.ko 2023-11-28T11:45:49.342 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio 2023-11-28T11:45:49.342 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio.ko 2023-11-28T11:45:49.342 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio_balloon.ko 2023-11-28T11:45:49.342 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio_mmio.ko 2023-11-28T11:45:49.343 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio_pci.ko 2023-11-28T11:45:49.343 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-11-28T11:45:49.343 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-11-28T11:45:49.343 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio_ring.ko 2023-11-28T11:45:49.343 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1 2023-11-28T11:45:49.343 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters 2023-11-28T11:45:49.343 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ds2482.ko 2023-11-28T11:45:49.343 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ds2490.ko 2023-11-28T11:45:49.343 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves 2023-11-28T11:45:49.343 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-11-28T11:45:49.343 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-11-28T11:45:49.343 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-11-28T11:45:49.344 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-11-28T11:45:49.344 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-11-28T11:45:49.344 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-11-28T11:45:49.344 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-11-28T11:45:49.344 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-11-28T11:45:49.344 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-11-28T11:45:49.344 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_smem.ko 2023-11-28T11:45:49.344 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_therm.ko 2023-11-28T11:45:49.344 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/wire.ko 2023-11-28T11:45:49.344 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog 2023-11-28T11:45:49.344 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/alim1535_wdt.ko 2023-11-28T11:45:49.344 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/alim7101_wdt.ko 2023-11-28T11:45:49.344 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/f71808e_wdt.ko 2023-11-28T11:45:49.345 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/hpwdt.ko 2023-11-28T11:45:49.345 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/i6300esb.ko 2023-11-28T11:45:49.345 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-11-28T11:45:49.345 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/iTCO_wdt.ko 2023-11-28T11:45:49.345 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ib700wdt.ko 2023-11-28T11:45:49.345 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ibmasr.ko 2023-11-28T11:45:49.345 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-11-28T11:45:49.345 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/it8712f_wdt.ko 2023-11-28T11:45:49.345 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/it87_wdt.ko 2023-11-28T11:45:49.345 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/machzwd.ko 2023-11-28T11:45:49.345 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/nv_tco.ko 2023-11-28T11:45:49.346 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pcwd_pci.ko 2023-11-28T11:45:49.346 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pcwd_usb.ko 2023-11-28T11:45:49.346 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-11-28T11:45:49.346 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sch311x_wdt.ko 2023-11-28T11:45:49.346 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/softdog.ko 2023-11-28T11:45:49.346 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sp5100_tco.ko 2023-11-28T11:45:49.346 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/via_wdt.ko 2023-11-28T11:45:49.346 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-11-28T11:45:49.346 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83877f_wdt.ko 2023-11-28T11:45:49.346 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83977f_wdt.ko 2023-11-28T11:45:49.346 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wdt_pci.ko 2023-11-28T11:45:49.346 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/xen_wdt.ko 2023-11-28T11:45:49.347 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen 2023-11-28T11:45:49.347 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-acpi-processor.ko 2023-11-28T11:45:49.347 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-evtchn.ko 2023-11-28T11:45:49.347 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-gntalloc.ko 2023-11-28T11:45:49.347 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-gntdev.ko 2023-11-28T11:45:49.347 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-pciback 2023-11-28T11:45:49.347 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-11-28T11:45:49.347 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-privcmd.ko 2023-11-28T11:45:49.347 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xenfs 2023-11-28T11:45:49.347 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xenfs/xenfs.ko 2023-11-28T11:45:49.347 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs 2023-11-28T11:45:49.347 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/9p 2023-11-28T11:45:49.347 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/9p/9p.ko 2023-11-28T11:45:49.348 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/affs 2023-11-28T11:45:49.348 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/affs/affs.ko 2023-11-28T11:45:49.348 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/befs 2023-11-28T11:45:49.348 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/befs/befs.ko 2023-11-28T11:45:49.348 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/binfmt_misc.ko 2023-11-28T11:45:49.348 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/btrfs 2023-11-28T11:45:49.348 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/btrfs/btrfs.ko 2023-11-28T11:45:49.348 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cachefiles 2023-11-28T11:45:49.348 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cachefiles/cachefiles.ko 2023-11-28T11:45:49.348 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ceph 2023-11-28T11:45:49.348 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ceph/ceph.ko 2023-11-28T11:45:49.348 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/coda 2023-11-28T11:45:49.348 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/coda/coda.ko 2023-11-28T11:45:49.349 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cramfs 2023-11-28T11:45:49.349 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cramfs/cramfs.ko 2023-11-28T11:45:49.349 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/dlm 2023-11-28T11:45:49.349 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/dlm/dlm.ko 2023-11-28T11:45:49.349 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ecryptfs 2023-11-28T11:45:49.349 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ecryptfs/ecryptfs.ko 2023-11-28T11:45:49.349 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/f2fs 2023-11-28T11:45:49.349 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/f2fs/f2fs.ko 2023-11-28T11:45:49.349 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat 2023-11-28T11:45:49.349 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/fat.ko 2023-11-28T11:45:49.349 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/msdos.ko 2023-11-28T11:45:49.349 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/vfat.ko 2023-11-28T11:45:49.349 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fscache 2023-11-28T11:45:49.350 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fscache/fscache.ko 2023-11-28T11:45:49.350 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse 2023-11-28T11:45:49.350 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse/cuse.ko 2023-11-28T11:45:49.350 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse/fuse.ko 2023-11-28T11:45:49.350 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/gfs2 2023-11-28T11:45:49.350 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/gfs2/gfs2.ko 2023-11-28T11:45:49.350 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfs 2023-11-28T11:45:49.350 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfs/hfs.ko 2023-11-28T11:45:49.350 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfsplus 2023-11-28T11:45:49.350 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfsplus/hfsplus.ko 2023-11-28T11:45:49.350 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/isofs 2023-11-28T11:45:49.350 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/isofs/isofs.ko 2023-11-28T11:45:49.350 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/jfs 2023-11-28T11:45:49.351 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/jfs/jfs.ko 2023-11-28T11:45:49.351 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/lockd 2023-11-28T11:45:49.351 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/lockd/lockd.ko 2023-11-28T11:45:49.351 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/minix 2023-11-28T11:45:49.351 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/minix/minix.ko 2023-11-28T11:45:49.351 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/netfs 2023-11-28T11:45:49.351 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/netfs/netfs.ko 2023-11-28T11:45:49.351 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs 2023-11-28T11:45:49.351 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/blocklayout 2023-11-28T11:45:49.351 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-11-28T11:45:49.351 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/filelayout 2023-11-28T11:45:49.352 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-11-28T11:45:49.352 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/flexfilelayout 2023-11-28T11:45:49.352 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-11-28T11:45:49.352 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfs.ko 2023-11-28T11:45:49.352 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv3.ko 2023-11-28T11:45:49.352 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv4.ko 2023-11-28T11:45:49.352 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common 2023-11-28T11:45:49.352 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/grace.ko 2023-11-28T11:45:49.352 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/nfs_acl.ko 2023-11-28T11:45:49.353 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfsd 2023-11-28T11:45:49.353 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfsd/nfsd.ko 2023-11-28T11:45:49.353 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nilfs2 2023-11-28T11:45:49.353 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nilfs2/nilfs2.ko 2023-11-28T11:45:49.353 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls 2023-11-28T11:45:49.353 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-celtic.ko 2023-11-28T11:45:49.353 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-centeuro.ko 2023-11-28T11:45:49.353 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-croatian.ko 2023-11-28T11:45:49.353 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-cyrillic.ko 2023-11-28T11:45:49.353 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-gaelic.ko 2023-11-28T11:45:49.353 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-greek.ko 2023-11-28T11:45:49.353 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-iceland.ko 2023-11-28T11:45:49.354 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-inuit.ko 2023-11-28T11:45:49.354 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-roman.ko 2023-11-28T11:45:49.354 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-romanian.ko 2023-11-28T11:45:49.354 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-turkish.ko 2023-11-28T11:45:49.354 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1250.ko 2023-11-28T11:45:49.354 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1251.ko 2023-11-28T11:45:49.354 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1255.ko 2023-11-28T11:45:49.354 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp737.ko 2023-11-28T11:45:49.354 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp775.ko 2023-11-28T11:45:49.354 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp850.ko 2023-11-28T11:45:49.354 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp852.ko 2023-11-28T11:45:49.354 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp855.ko 2023-11-28T11:45:49.354 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp857.ko 2023-11-28T11:45:49.355 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp860.ko 2023-11-28T11:45:49.355 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp861.ko 2023-11-28T11:45:49.355 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp862.ko 2023-11-28T11:45:49.355 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp863.ko 2023-11-28T11:45:49.355 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp864.ko 2023-11-28T11:45:49.355 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp865.ko 2023-11-28T11:45:49.355 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp866.ko 2023-11-28T11:45:49.355 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp869.ko 2023-11-28T11:45:49.355 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp874.ko 2023-11-28T11:45:49.355 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp932.ko 2023-11-28T11:45:49.355 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp936.ko 2023-11-28T11:45:49.355 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp949.ko 2023-11-28T11:45:49.355 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp950.ko 2023-11-28T11:45:49.356 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_euc-jp.ko 2023-11-28T11:45:49.356 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-1.ko 2023-11-28T11:45:49.356 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-13.ko 2023-11-28T11:45:49.356 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-14.ko 2023-11-28T11:45:49.356 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-15.ko 2023-11-28T11:45:49.356 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-2.ko 2023-11-28T11:45:49.356 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-3.ko 2023-11-28T11:45:49.356 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-4.ko 2023-11-28T11:45:49.356 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-5.ko 2023-11-28T11:45:49.356 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-6.ko 2023-11-28T11:45:49.356 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-7.ko 2023-11-28T11:45:49.356 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-9.ko 2023-11-28T11:45:49.356 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-r.ko 2023-11-28T11:45:49.357 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-ru.ko 2023-11-28T11:45:49.357 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-u.ko 2023-11-28T11:45:49.357 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_ucs2_utils.ko 2023-11-28T11:45:49.357 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_utf8.ko 2023-11-28T11:45:49.357 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2 2023-11-28T11:45:49.357 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/cluster 2023-11-28T11:45:49.357 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-11-28T11:45:49.357 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlm 2023-11-28T11:45:49.357 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-11-28T11:45:49.357 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlmfs 2023-11-28T11:45:49.357 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-11-28T11:45:49.357 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2.ko 2023-11-28T11:45:49.358 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-11-28T11:45:49.358 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-11-28T11:45:49.358 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-11-28T11:45:49.358 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/overlayfs 2023-11-28T11:45:49.358 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/overlayfs/overlay.ko 2023-11-28T11:45:49.358 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/pstore 2023-11-28T11:45:49.358 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/pstore/ramoops.ko 2023-11-28T11:45:49.358 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/reiserfs 2023-11-28T11:45:49.358 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/reiserfs/reiserfs.ko 2023-11-28T11:45:49.358 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/romfs 2023-11-28T11:45:49.358 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/romfs/romfs.ko 2023-11-28T11:45:49.358 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb 2023-11-28T11:45:49.359 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/client 2023-11-28T11:45:49.359 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/client/cifs.ko 2023-11-28T11:45:49.359 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common 2023-11-28T11:45:49.359 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/cifs_arc4.ko 2023-11-28T11:45:49.359 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/cifs_md4.ko 2023-11-28T11:45:49.359 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/squashfs 2023-11-28T11:45:49.359 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/squashfs/squashfs.ko 2023-11-28T11:45:49.359 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/sysv 2023-11-28T11:45:49.359 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/sysv/sysv.ko 2023-11-28T11:45:49.359 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/udf 2023-11-28T11:45:49.359 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/udf/udf.ko 2023-11-28T11:45:49.359 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ufs 2023-11-28T11:45:49.359 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ufs/ufs.ko 2023-11-28T11:45:49.360 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/xfs 2023-11-28T11:45:49.360 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/xfs/xfs.ko 2023-11-28T11:45:49.360 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/kernel 2023-11-28T11:45:49.360 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/rcu 2023-11-28T11:45:49.360 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/rcu/rcutorture.ko 2023-11-28T11:45:49.360 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/torture.ko 2023-11-28T11:45:49.360 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/trace 2023-11-28T11:45:49.360 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-11-28T11:45:49.360 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib 2023-11-28T11:45:49.360 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/asn1_encoder.ko 2023-11-28T11:45:49.360 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc-itu-t.ko 2023-11-28T11:45:49.360 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc8.ko 2023-11-28T11:45:49.360 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto 2023-11-28T11:45:49.360 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/libarc4.ko 2023-11-28T11:45:49.361 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/libdes.ko 2023-11-28T11:45:49.361 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/libcrc32c.ko 2023-11-28T11:45:49.361 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lru_cache.ko 2023-11-28T11:45:49.361 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4 2023-11-28T11:45:49.361 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/lz4_compress.ko 2023-11-28T11:45:49.361 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/lz4hc_compress.ko 2023-11-28T11:45:49.361 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/math 2023-11-28T11:45:49.361 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/math/cordic.ko 2023-11-28T11:45:49.361 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/raid6 2023-11-28T11:45:49.361 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/raid6/raid6_pq.ko 2023-11-28T11:45:49.361 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/reed_solomon 2023-11-28T11:45:49.361 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/reed_solomon/reed_solomon.ko 2023-11-28T11:45:49.361 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_bm.ko 2023-11-28T11:45:49.362 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_fsm.ko 2023-11-28T11:45:49.362 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_kmp.ko 2023-11-28T11:45:49.362 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/zstd 2023-11-28T11:45:49.362 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/zstd/zstd_compress.ko 2023-11-28T11:45:49.362 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/mm 2023-11-28T11:45:49.362 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/mm/hwpoison-inject.ko 2023-11-28T11:45:49.362 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net 2023-11-28T11:45:49.362 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan 2023-11-28T11:45:49.362 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/6lowpan.ko 2023-11-28T11:45:49.362 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_dest.ko 2023-11-28T11:45:49.362 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_fragment.ko 2023-11-28T11:45:49.362 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_hop.ko 2023-11-28T11:45:49.363 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_ipv6.ko 2023-11-28T11:45:49.363 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_mobility.ko 2023-11-28T11:45:49.363 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_routing.ko 2023-11-28T11:45:49.363 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_udp.ko 2023-11-28T11:45:49.363 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/802 2023-11-28T11:45:49.363 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/garp.ko 2023-11-28T11:45:49.363 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/mrp.ko 2023-11-28T11:45:49.363 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/p8022.ko 2023-11-28T11:45:49.363 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/psnap.ko 2023-11-28T11:45:49.363 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/stp.ko 2023-11-28T11:45:49.363 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/8021q 2023-11-28T11:45:49.363 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/8021q/8021q.ko 2023-11-28T11:45:49.363 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p 2023-11-28T11:45:49.364 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet.ko 2023-11-28T11:45:49.364 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_fd.ko 2023-11-28T11:45:49.364 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_rdma.ko 2023-11-28T11:45:49.364 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_virtio.ko 2023-11-28T11:45:49.364 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/batman-adv 2023-11-28T11:45:49.364 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/batman-adv/batman-adv.ko 2023-11-28T11:45:49.364 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge 2023-11-28T11:45:49.364 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/br_netfilter.ko 2023-11-28T11:45:49.364 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/bridge.ko 2023-11-28T11:45:49.364 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter 2023-11-28T11:45:49.364 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-11-28T11:45:49.364 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_among.ko 2023-11-28T11:45:49.364 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_arp.ko 2023-11-28T11:45:49.365 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-11-28T11:45:49.365 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-11-28T11:45:49.365 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_ip.ko 2023-11-28T11:45:49.365 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-11-28T11:45:49.365 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_limit.ko 2023-11-28T11:45:49.365 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_log.ko 2023-11-28T11:45:49.365 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_mark.ko 2023-11-28T11:45:49.365 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-11-28T11:45:49.365 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-11-28T11:45:49.365 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-11-28T11:45:49.365 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-11-28T11:45:49.365 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_snat.ko 2023-11-28T11:45:49.365 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_stp.ko 2023-11-28T11:45:49.366 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-11-28T11:45:49.366 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-11-28T11:45:49.366 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-11-28T11:45:49.366 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-11-28T11:45:49.366 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtables.ko 2023-11-28T11:45:49.366 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-11-28T11:45:49.366 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-11-28T11:45:49.366 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-11-28T11:45:49.367 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ceph 2023-11-28T11:45:49.367 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ceph/libceph.ko 2023-11-28T11:45:49.367 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/core 2023-11-28T11:45:49.367 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/core/failover.ko 2023-11-28T11:45:49.367 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/core/pktgen.ko 2023-11-28T11:45:49.367 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp 2023-11-28T11:45:49.367 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp.ko 2023-11-28T11:45:49.367 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_diag.ko 2023-11-28T11:45:49.368 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_ipv4.ko 2023-11-28T11:45:49.368 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_ipv6.ko 2023-11-28T11:45:49.368 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dns_resolver 2023-11-28T11:45:49.368 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dns_resolver/dns_resolver.ko 2023-11-28T11:45:49.368 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa 2023-11-28T11:45:49.368 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/dsa_core.ko 2023-11-28T11:45:49.368 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_brcm.ko 2023-11-28T11:45:49.369 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_dsa.ko 2023-11-28T11:45:49.369 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_none.ko 2023-11-28T11:45:49.369 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_trailer.ko 2023-11-28T11:45:49.369 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154 2023-11-28T11:45:49.369 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/6lowpan 2023-11-28T11:45:49.369 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-11-28T11:45:49.370 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ieee802154.ko 2023-11-28T11:45:49.370 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ieee802154_socket.ko 2023-11-28T11:45:49.370 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4 2023-11-28T11:45:49.370 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ah4.ko 2023-11-28T11:45:49.370 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/esp4.ko 2023-11-28T11:45:49.370 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/fou.ko 2023-11-28T11:45:49.371 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/gre.ko 2023-11-28T11:45:49.371 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/inet_diag.ko 2023-11-28T11:45:49.371 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_gre.ko 2023-11-28T11:45:49.371 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_tunnel.ko 2023-11-28T11:45:49.371 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_vti.ko 2023-11-28T11:45:49.371 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ipcomp.ko 2023-11-28T11:45:49.371 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ipip.ko 2023-11-28T11:45:49.371 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter 2023-11-28T11:45:49.372 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arp_tables.ko 2023-11-28T11:45:49.372 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-11-28T11:45:49.372 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-11-28T11:45:49.372 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-11-28T11:45:49.372 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-11-28T11:45:49.372 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-11-28T11:45:49.372 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-11-28T11:45:49.372 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-11-28T11:45:49.372 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-11-28T11:45:49.373 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-11-28T11:45:49.373 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_security.ko 2023-11-28T11:45:49.373 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-11-28T11:45:49.373 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-11-28T11:45:49.373 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-11-28T11:45:49.373 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-11-28T11:45:49.373 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-11-28T11:45:49.373 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-11-28T11:45:49.373 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-11-28T11:45:49.373 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-11-28T11:45:49.373 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-11-28T11:45:49.373 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-11-28T11:45:49.374 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_bic.ko 2023-11-28T11:45:49.374 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_dctcp.ko 2023-11-28T11:45:49.374 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_diag.ko 2023-11-28T11:45:49.374 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_highspeed.ko 2023-11-28T11:45:49.374 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_htcp.ko 2023-11-28T11:45:49.374 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_hybla.ko 2023-11-28T11:45:49.374 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_illinois.ko 2023-11-28T11:45:49.374 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_lp.ko 2023-11-28T11:45:49.374 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_scalable.ko 2023-11-28T11:45:49.374 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_vegas.ko 2023-11-28T11:45:49.374 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_veno.ko 2023-11-28T11:45:49.374 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_westwood.ko 2023-11-28T11:45:49.375 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_yeah.ko 2023-11-28T11:45:49.375 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tunnel4.ko 2023-11-28T11:45:49.375 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/udp_diag.ko 2023-11-28T11:45:49.375 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/udp_tunnel.ko 2023-11-28T11:45:49.375 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/xfrm4_tunnel.ko 2023-11-28T11:45:49.375 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6 2023-11-28T11:45:49.375 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ah6.ko 2023-11-28T11:45:49.375 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/esp6.ko 2023-11-28T11:45:49.375 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/fou6.ko 2023-11-28T11:45:49.375 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_tunnel.ko 2023-11-28T11:45:49.375 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-11-28T11:45:49.375 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_vti.ko 2023-11-28T11:45:49.375 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ipcomp6.ko 2023-11-28T11:45:49.376 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter 2023-11-28T11:45:49.376 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-11-28T11:45:49.376 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-11-28T11:45:49.376 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-11-28T11:45:49.376 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-11-28T11:45:49.376 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-11-28T11:45:49.376 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-11-28T11:45:49.376 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-11-28T11:45:49.376 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-11-28T11:45:49.376 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-11-28T11:45:49.376 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-11-28T11:45:49.376 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-11-28T11:45:49.376 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-11-28T11:45:49.377 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-11-28T11:45:49.377 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-11-28T11:45:49.377 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-11-28T11:45:49.377 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-11-28T11:45:49.377 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-11-28T11:45:49.377 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-11-28T11:45:49.377 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-11-28T11:45:49.377 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-11-28T11:45:49.377 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-11-28T11:45:49.377 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-11-28T11:45:49.377 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-11-28T11:45:49.377 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-11-28T11:45:49.377 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/sit.ko 2023-11-28T11:45:49.378 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/tunnel6.ko 2023-11-28T11:45:49.378 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/xfrm6_tunnel.ko 2023-11-28T11:45:49.378 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/key 2023-11-28T11:45:49.378 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/key/af_key.ko 2023-11-28T11:45:49.378 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp 2023-11-28T11:45:49.378 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_core.ko 2023-11-28T11:45:49.378 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_debugfs.ko 2023-11-28T11:45:49.378 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_eth.ko 2023-11-28T11:45:49.378 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ip.ko 2023-11-28T11:45:49.378 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ip6.ko 2023-11-28T11:45:49.378 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_netlink.ko 2023-11-28T11:45:49.379 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ppp.ko 2023-11-28T11:45:49.379 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc 2023-11-28T11:45:49.379 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/llc.ko 2023-11-28T11:45:49.379 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/mac802154 2023-11-28T11:45:49.379 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/mac802154/mac802154.ko 2023-11-28T11:45:49.381 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/mpls 2023-11-28T11:45:49.381 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/mpls/mpls_gso.ko 2023-11-28T11:45:49.381 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter 2023-11-28T11:45:49.381 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset 2023-11-28T11:45:49.381 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set.ko 2023-11-28T11:45:49.381 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-11-28T11:45:49.381 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-11-28T11:45:49.381 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-11-28T11:45:49.381 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-11-28T11:45:49.382 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-11-28T11:45:49.382 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-11-28T11:45:49.382 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-11-28T11:45:49.382 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-11-28T11:45:49.382 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-11-28T11:45:49.382 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-11-28T11:45:49.382 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-11-28T11:45:49.382 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-11-28T11:45:49.382 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-11-28T11:45:49.382 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-11-28T11:45:49.382 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-11-28T11:45:49.382 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs 2023-11-28T11:45:49.383 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs.ko 2023-11-28T11:45:49.383 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-11-28T11:45:49.383 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-11-28T11:45:49.383 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-11-28T11:45:49.383 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-11-28T11:45:49.383 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-11-28T11:45:49.383 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-11-28T11:45:49.383 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-11-28T11:45:49.383 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-11-28T11:45:49.383 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-11-28T11:45:49.383 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-11-28T11:45:49.383 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-11-28T11:45:49.384 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-11-28T11:45:49.384 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-11-28T11:45:49.384 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conncount.ko 2023-11-28T11:45:49.384 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack.ko 2023-11-28T11:45:49.384 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-11-28T11:45:49.384 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-11-28T11:45:49.384 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-11-28T11:45:49.384 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_h323.ko 2023-11-28T11:45:49.384 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_irc.ko 2023-11-28T11:45:49.384 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-11-28T11:45:49.384 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-11-28T11:45:49.384 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-11-28T11:45:49.384 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_sane.ko 2023-11-28T11:45:49.385 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_sip.ko 2023-11-28T11:45:49.385 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-11-28T11:45:49.385 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-11-28T11:45:49.385 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_dup_netdev.ko 2023-11-28T11:45:49.385 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_flow_table.ko 2023-11-28T11:45:49.385 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_flow_table_inet.ko 2023-11-28T11:45:49.385 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_log_syslog.ko 2023-11-28T11:45:49.385 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat.ko 2023-11-28T11:45:49.385 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_amanda.ko 2023-11-28T11:45:49.385 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_ftp.ko 2023-11-28T11:45:49.385 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_irc.ko 2023-11-28T11:45:49.385 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_sip.ko 2023-11-28T11:45:49.386 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_tftp.ko 2023-11-28T11:45:49.386 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_synproxy_core.ko 2023-11-28T11:45:49.386 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_tables.ko 2023-11-28T11:45:49.386 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink.ko 2023-11-28T11:45:49.386 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_acct.ko 2023-11-28T11:45:49.386 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_log.ko 2023-11-28T11:45:49.386 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_osf.ko 2023-11-28T11:45:49.386 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_queue.ko 2023-11-28T11:45:49.386 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_chain_nat.ko 2023-11-28T11:45:49.387 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_compat.ko 2023-11-28T11:45:49.387 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_ct.ko 2023-11-28T11:45:49.387 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_dup_netdev.ko 2023-11-28T11:45:49.387 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_fib.ko 2023-11-28T11:45:49.387 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_fwd_netdev.ko 2023-11-28T11:45:49.387 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_hash.ko 2023-11-28T11:45:49.387 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_limit.ko 2023-11-28T11:45:49.387 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_log.ko 2023-11-28T11:45:49.388 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_masq.ko 2023-11-28T11:45:49.388 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_nat.ko 2023-11-28T11:45:49.388 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_numgen.ko 2023-11-28T11:45:49.388 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_queue.ko 2023-11-28T11:45:49.388 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_quota.ko 2023-11-28T11:45:49.388 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_redir.ko 2023-11-28T11:45:49.388 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_reject.ko 2023-11-28T11:45:49.388 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_reject_inet.ko 2023-11-28T11:45:49.388 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_socket.ko 2023-11-28T11:45:49.389 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_tunnel.ko 2023-11-28T11:45:49.389 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_AUDIT.ko 2023-11-28T11:45:49.389 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CHECKSUM.ko 2023-11-28T11:45:49.389 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CLASSIFY.ko 2023-11-28T11:45:49.389 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-11-28T11:45:49.389 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CT.ko 2023-11-28T11:45:49.389 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_DSCP.ko 2023-11-28T11:45:49.390 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_HL.ko 2023-11-28T11:45:49.390 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_HMARK.ko 2023-11-28T11:45:49.390 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_IDLETIMER.ko 2023-11-28T11:45:49.390 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_LED.ko 2023-11-28T11:45:49.390 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_LOG.ko 2023-11-28T11:45:49.390 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_MASQUERADE.ko 2023-11-28T11:45:49.390 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NETMAP.ko 2023-11-28T11:45:49.390 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NFLOG.ko 2023-11-28T11:45:49.390 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NFQUEUE.ko 2023-11-28T11:45:49.391 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_RATEEST.ko 2023-11-28T11:45:49.391 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_REDIRECT.ko 2023-11-28T11:45:49.391 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_SECMARK.ko 2023-11-28T11:45:49.391 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TCPMSS.ko 2023-11-28T11:45:49.391 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-11-28T11:45:49.391 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TEE.ko 2023-11-28T11:45:49.391 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TPROXY.ko 2023-11-28T11:45:49.391 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TRACE.ko 2023-11-28T11:45:49.391 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_addrtype.ko 2023-11-28T11:45:49.391 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_bpf.ko 2023-11-28T11:45:49.391 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cgroup.ko 2023-11-28T11:45:49.391 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cluster.ko 2023-11-28T11:45:49.391 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_comment.ko 2023-11-28T11:45:49.392 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connbytes.ko 2023-11-28T11:45:49.392 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connlabel.ko 2023-11-28T11:45:49.392 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connlimit.ko 2023-11-28T11:45:49.392 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connmark.ko 2023-11-28T11:45:49.392 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_conntrack.ko 2023-11-28T11:45:49.392 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cpu.ko 2023-11-28T11:45:49.392 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_dccp.ko 2023-11-28T11:45:49.392 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_devgroup.ko 2023-11-28T11:45:49.393 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_dscp.ko 2023-11-28T11:45:49.393 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ecn.ko 2023-11-28T11:45:49.393 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_esp.ko 2023-11-28T11:45:49.393 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_hashlimit.ko 2023-11-28T11:45:49.393 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_helper.ko 2023-11-28T11:45:49.393 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_hl.ko 2023-11-28T11:45:49.393 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ipcomp.ko 2023-11-28T11:45:49.393 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_iprange.ko 2023-11-28T11:45:49.393 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ipvs.ko 2023-11-28T11:45:49.393 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_l2tp.ko 2023-11-28T11:45:49.393 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_length.ko 2023-11-28T11:45:49.393 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_limit.ko 2023-11-28T11:45:49.393 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_mac.ko 2023-11-28T11:45:49.394 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_mark.ko 2023-11-28T11:45:49.394 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_multiport.ko 2023-11-28T11:45:49.394 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_nat.ko 2023-11-28T11:45:49.394 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_nfacct.ko 2023-11-28T11:45:49.394 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_osf.ko 2023-11-28T11:45:49.394 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_owner.ko 2023-11-28T11:45:49.394 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_physdev.ko 2023-11-28T11:45:49.394 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_pkttype.ko 2023-11-28T11:45:49.394 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_policy.ko 2023-11-28T11:45:49.394 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_quota.ko 2023-11-28T11:45:49.394 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_rateest.ko 2023-11-28T11:45:49.395 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_realm.ko 2023-11-28T11:45:49.395 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_recent.ko 2023-11-28T11:45:49.395 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_sctp.ko 2023-11-28T11:45:49.395 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_set.ko 2023-11-28T11:45:49.395 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_socket.ko 2023-11-28T11:45:49.395 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_state.ko 2023-11-28T11:45:49.395 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_statistic.ko 2023-11-28T11:45:49.395 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_string.ko 2023-11-28T11:45:49.395 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_tcpmss.ko 2023-11-28T11:45:49.395 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_time.ko 2023-11-28T11:45:49.395 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_u32.ko 2023-11-28T11:45:49.395 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netlink 2023-11-28T11:45:49.395 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netlink/netlink_diag.ko 2023-11-28T11:45:49.396 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/nsh 2023-11-28T11:45:49.396 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/nsh/nsh.ko 2023-11-28T11:45:49.396 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch 2023-11-28T11:45:49.396 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/openvswitch.ko 2023-11-28T11:45:49.396 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-geneve.ko 2023-11-28T11:45:49.396 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-gre.ko 2023-11-28T11:45:49.396 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-vxlan.ko 2023-11-28T11:45:49.396 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/packet 2023-11-28T11:45:49.396 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/packet/af_packet_diag.ko 2023-11-28T11:45:49.396 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds 2023-11-28T11:45:49.396 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds.ko 2023-11-28T11:45:49.396 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds_rdma.ko 2023-11-28T11:45:49.396 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds_tcp.ko 2023-11-28T11:45:49.397 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched 2023-11-28T11:45:49.397 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_csum.ko 2023-11-28T11:45:49.397 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_gact.ko 2023-11-28T11:45:49.397 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_ipt.ko 2023-11-28T11:45:49.397 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_mirred.ko 2023-11-28T11:45:49.397 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_nat.ko 2023-11-28T11:45:49.397 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_pedit.ko 2023-11-28T11:45:49.397 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_police.ko 2023-11-28T11:45:49.397 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_simple.ko 2023-11-28T11:45:49.397 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_skbedit.ko 2023-11-28T11:45:49.397 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_vlan.ko 2023-11-28T11:45:49.397 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_basic.ko 2023-11-28T11:45:49.397 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_bpf.ko 2023-11-28T11:45:49.398 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_flow.ko 2023-11-28T11:45:49.398 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_fw.ko 2023-11-28T11:45:49.398 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_route.ko 2023-11-28T11:45:49.398 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_u32.ko 2023-11-28T11:45:49.398 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_cmp.ko 2023-11-28T11:45:49.398 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_ipset.ko 2023-11-28T11:45:49.398 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_meta.ko 2023-11-28T11:45:49.398 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_nbyte.ko 2023-11-28T11:45:49.398 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_text.ko 2023-11-28T11:45:49.398 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_u32.ko 2023-11-28T11:45:49.398 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_choke.ko 2023-11-28T11:45:49.398 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_codel.ko 2023-11-28T11:45:49.399 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_drr.ko 2023-11-28T11:45:49.399 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_fq.ko 2023-11-28T11:45:49.399 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_gred.ko 2023-11-28T11:45:49.399 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_hfsc.ko 2023-11-28T11:45:49.399 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_hhf.ko 2023-11-28T11:45:49.399 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_htb.ko 2023-11-28T11:45:49.399 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_ingress.ko 2023-11-28T11:45:49.399 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_mqprio.ko 2023-11-28T11:45:49.399 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_mqprio_lib.ko 2023-11-28T11:45:49.399 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_multiq.ko 2023-11-28T11:45:49.399 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_netem.ko 2023-11-28T11:45:49.399 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_pie.ko 2023-11-28T11:45:49.399 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_plug.ko 2023-11-28T11:45:49.400 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_prio.ko 2023-11-28T11:45:49.400 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_qfq.ko 2023-11-28T11:45:49.400 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_red.ko 2023-11-28T11:45:49.400 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_sfb.ko 2023-11-28T11:45:49.400 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_sfq.ko 2023-11-28T11:45:49.400 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_tbf.ko 2023-11-28T11:45:49.400 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_teql.ko 2023-11-28T11:45:49.400 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp 2023-11-28T11:45:49.400 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/sctp.ko 2023-11-28T11:45:49.400 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/sctp_diag.ko 2023-11-28T11:45:49.400 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc 2023-11-28T11:45:49.400 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss 2023-11-28T11:45:49.400 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-11-28T11:45:49.400 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-11-28T11:45:49.401 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/sunrpc.ko 2023-11-28T11:45:49.401 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/xprtrdma 2023-11-28T11:45:49.401 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-11-28T11:45:49.401 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc 2023-11-28T11:45:49.401 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/diag.ko 2023-11-28T11:45:49.401 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/tipc.ko 2023-11-28T11:45:49.401 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/unix 2023-11-28T11:45:49.401 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/unix/unix_diag.ko 2023-11-28T11:45:49.401 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock 2023-11-28T11:45:49.401 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-11-28T11:45:49.401 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-11-28T11:45:49.401 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock.ko 2023-11-28T11:45:49.401 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock_diag.ko 2023-11-28T11:45:49.402 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock_loopback.ko 2023-11-28T11:45:49.402 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm 2023-11-28T11:45:49.402 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_ipcomp.ko 2023-11-28T11:45:49.402 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/security 2023-11-28T11:45:49.405 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/security/keys 2023-11-28T11:45:49.405 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/security/keys/encrypted-keys 2023-11-28T11:45:49.405 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-11-28T11:45:49.405 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/security/keys/trusted-keys 2023-11-28T11:45:49.405 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/security/keys/trusted-keys/trusted.ko 2023-11-28T11:45:49.405 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/virt 2023-11-28T11:45:49.406 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/virt/lib 2023-11-28T11:45:49.406 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/virt/lib/irqbypass.ko 2023-11-28T11:45:49.406 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.alias 2023-11-28T11:45:49.406 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.alias.bin 2023-11-28T11:45:49.406 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.builtin 2023-11-28T11:45:49.406 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.builtin.bin 2023-11-28T11:45:49.406 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.builtin.modinfo 2023-11-28T11:45:49.407 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.dep 2023-11-28T11:45:49.407 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.dep.bin 2023-11-28T11:45:49.407 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.devname 2023-11-28T11:45:49.407 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.order 2023-11-28T11:45:49.407 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.softdep 2023-11-28T11:45:49.407 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.symbols 2023-11-28T11:45:49.407 INFO:teuthology.orchestra.run.smithi152.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.symbols.bin 2023-11-28T11:45:49.408 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-g8247bbb5b470 2023-11-28T11:45:49.409 DEBUG:teuthology.orchestra.run.smithi152:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-11-28T11:45:49.447 INFO:teuthology.orchestra.run.smithi152.stdout:postinstall scriptlet (using /bin/sh): 2023-11-28T11:45:49.447 INFO:teuthology.orchestra.run.smithi152.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.6.0-g8247bbb5b470 -a -r /boot/System.map-6.6.0-g8247bbb5b470 ]; then 2023-11-28T11:45:49.447 INFO:teuthology.orchestra.run.smithi152.stdout:cp /boot/vmlinuz-6.6.0-g8247bbb5b470 /boot/.vmlinuz-6.6.0-g8247bbb5b470-rpm 2023-11-28T11:45:49.447 INFO:teuthology.orchestra.run.smithi152.stdout:cp /boot/System.map-6.6.0-g8247bbb5b470 /boot/.System.map-6.6.0-g8247bbb5b470-rpm 2023-11-28T11:45:49.447 INFO:teuthology.orchestra.run.smithi152.stdout:rm -f /boot/vmlinuz-6.6.0-g8247bbb5b470 /boot/System.map-6.6.0-g8247bbb5b470 2023-11-28T11:45:49.447 INFO:teuthology.orchestra.run.smithi152.stdout:/sbin/installkernel 6.6.0-g8247bbb5b470 /boot/.vmlinuz-6.6.0-g8247bbb5b470-rpm /boot/.System.map-6.6.0-g8247bbb5b470-rpm 2023-11-28T11:45:49.447 INFO:teuthology.orchestra.run.smithi152.stdout:rm -f /boot/.vmlinuz-6.6.0-g8247bbb5b470-rpm /boot/.System.map-6.6.0-g8247bbb5b470-rpm 2023-11-28T11:45:49.447 INFO:teuthology.orchestra.run.smithi152.stdout:fi 2023-11-28T11:45:49.448 INFO:teuthology.orchestra.run.smithi152.stdout:preuninstall scriptlet (using /bin/sh): 2023-11-28T11:45:49.448 INFO:teuthology.orchestra.run.smithi152.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-11-28T11:45:49.448 INFO:teuthology.orchestra.run.smithi152.stdout:new-kernel-pkg --remove 6.6.0-g8247bbb5b470 --rminitrd --initrdfile=/boot/initramfs-6.6.0-g8247bbb5b470.img 2023-11-28T11:45:49.448 INFO:teuthology.orchestra.run.smithi152.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-11-28T11:45:49.448 INFO:teuthology.orchestra.run.smithi152.stdout:kernel-install remove 6.6.0-g8247bbb5b470 2023-11-28T11:45:49.448 INFO:teuthology.orchestra.run.smithi152.stdout:fi 2023-11-28T11:45:49.448 INFO:teuthology.orchestra.run.smithi152.stdout:postuninstall scriptlet (using /bin/sh): 2023-11-28T11:45:49.449 INFO:teuthology.orchestra.run.smithi152.stdout:if [ -x /sbin/update-bootloader ]; then 2023-11-28T11:45:49.449 INFO:teuthology.orchestra.run.smithi152.stdout:/sbin/update-bootloader --remove 6.6.0-g8247bbb5b470 2023-11-28T11:45:49.449 INFO:teuthology.orchestra.run.smithi152.stdout:fi 2023-11-28T11:45:49.450 DEBUG:teuthology.orchestra.run.smithi152:> sudo rpm -qi grub2-tools 2023-11-28T11:45:49.525 INFO:teuthology.orchestra.run.smithi152.stdout:Name : grub2-tools 2023-11-28T11:45:49.526 INFO:teuthology.orchestra.run.smithi152.stdout:Epoch : 1 2023-11-28T11:45:49.526 INFO:teuthology.orchestra.run.smithi152.stdout:Version : 2.02 2023-11-28T11:45:49.526 INFO:teuthology.orchestra.run.smithi152.stdout:Release : 129.el8 2023-11-28T11:45:49.526 INFO:teuthology.orchestra.run.smithi152.stdout:Architecture: x86_64 2023-11-28T11:45:49.526 INFO:teuthology.orchestra.run.smithi152.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-11-28T11:45:49.526 INFO:teuthology.orchestra.run.smithi152.stdout:Group : System Environment/Base 2023-11-28T11:45:49.526 INFO:teuthology.orchestra.run.smithi152.stdout:Size : 9265586 2023-11-28T11:45:49.526 INFO:teuthology.orchestra.run.smithi152.stdout:License : GPLv3+ 2023-11-28T11:45:49.526 INFO:teuthology.orchestra.run.smithi152.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-11-28T11:45:49.527 INFO:teuthology.orchestra.run.smithi152.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-11-28T11:45:49.527 INFO:teuthology.orchestra.run.smithi152.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-11-28T11:45:49.527 INFO:teuthology.orchestra.run.smithi152.stdout:Build Host : kbuilder.bsys.centos.org 2023-11-28T11:45:49.527 INFO:teuthology.orchestra.run.smithi152.stdout:Relocations : (not relocatable) 2023-11-28T11:45:49.527 INFO:teuthology.orchestra.run.smithi152.stdout:Packager : CentOS BuildSystem 2023-11-28T11:45:49.527 INFO:teuthology.orchestra.run.smithi152.stdout:Vendor : CentOS 2023-11-28T11:45:49.527 INFO:teuthology.orchestra.run.smithi152.stdout:URL : http://www.gnu.org/software/grub/ 2023-11-28T11:45:49.527 INFO:teuthology.orchestra.run.smithi152.stdout:Summary : Support tools for GRUB. 2023-11-28T11:45:49.527 INFO:teuthology.orchestra.run.smithi152.stdout:Description : 2023-11-28T11:45:49.527 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-11-28T11:45:49.527 INFO:teuthology.orchestra.run.smithi152.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-11-28T11:45:49.527 INFO:teuthology.orchestra.run.smithi152.stdout:customizable bootloader with modular architecture. It supports a rich 2023-11-28T11:45:49.527 INFO:teuthology.orchestra.run.smithi152.stdout:variety of kernel formats, file systems, computer architectures and 2023-11-28T11:45:49.528 INFO:teuthology.orchestra.run.smithi152.stdout:hardware devices. 2023-11-28T11:45:49.528 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-11-28T11:45:49.528 INFO:teuthology.orchestra.run.smithi152.stdout:This subpackage provides tools for support of all platforms. 2023-11-28T11:45:49.529 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-11-28T11:45:49.529 INFO:teuthology.task.kernel:Updating grub on smithi152 to boot 6.6.0-g8247bbb5b470 2023-11-28T11:45:49.529 DEBUG:teuthology.orchestra.run.smithi152:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-11-28T11:45:54.555 INFO:teuthology.orchestra.run.smithi152.stderr:Generating grub configuration file ... 2023-11-28T11:45:56.428 INFO:teuthology.orchestra.run.smithi152.stderr:done 2023-11-28T11:45:56.430 DEBUG:teuthology.orchestra.run.smithi152:> mktemp 2023-11-28T11:45:56.455 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/tmp.bqvUF457ti 2023-11-28T11:45:56.455 DEBUG:teuthology.orchestra.run.smithi152:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.bqvUF457ti 2023-11-28T11:45:56.529 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 0666 /tmp/tmp.bqvUF457ti 2023-11-28T11:45:56.688 DEBUG:teuthology.orchestra.remote:smithi152:/tmp/tmp.bqvUF457ti is 6KB 2023-11-28T11:45:56.736 DEBUG:teuthology.orchestra.run.smithi152:> rm -fr /tmp/tmp.bqvUF457ti 2023-11-28T11:45:56.754 DEBUG:teuthology.orchestra.run.smithi152:> sudo /bin/ls /boot/loader/entries || true 2023-11-28T11:45:56.834 INFO:teuthology.orchestra.run.smithi152.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-11-28T11:45:56.835 INFO:teuthology.orchestra.run.smithi152.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-11-28T11:45:56.835 INFO:teuthology.orchestra.run.smithi152.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-11-28T11:45:56.835 INFO:teuthology.orchestra.run.smithi152.stdout:a1b29d6c289747bdb22930598d39874a-6.6.0-g8247bbb5b470.conf 2023-11-28T11:45:56.836 DEBUG:teuthology.orchestra.run.smithi152:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-6.6.0-g8247bbb5b470 2023-11-28T11:45:57.003 DEBUG:teuthology.orchestra.run.smithi152:> sudo shutdown -r now 2023-11-28T11:46:27.034 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-11-28T11:46:27.035 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2023-11-28T11:46:27.035 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T11:46:47.171 DEBUG:teuthology.orchestra.remote:timed out 2023-11-28T11:46:59.182 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi045.front.sepia.ceph.com' 2023-11-28T11:46:59.183 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T11:46:59.582 DEBUG:teuthology.orchestra.run.smithi045:> true 2023-11-28T11:46:59.961 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi045.front.sepia.ceph.com' 2023-11-28T11:46:59.962 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.6.0-g8247bbb5b470"... 2023-11-28T11:46:59.962 DEBUG:teuthology.orchestra.run.smithi045:> uname -r 2023-11-28T11:47:00.007 INFO:teuthology.orchestra.run.smithi045.stdout:6.6.0-g8247bbb5b470 2023-11-28T11:47:00.008 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-g8247bbb5b470 vs 6.6.0-g8247bbb5b470 2023-11-28T11:47:00.008 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-28T11:47:00.008 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-11-28T11:47:01.009 DEBUG:teuthology.parallel:result is None 2023-11-28T11:47:01.606 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-11-28T11:47:10.607 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2023-11-28T11:47:10.608 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T11:47:28.994 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-11-28T11:47:40.995 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2023-11-28T11:47:40.996 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T11:47:43.802 DEBUG:teuthology.orchestra.run.smithi152:> true 2023-11-28T11:47:44.261 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi152.front.sepia.ceph.com' 2023-11-28T11:47:44.261 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.6.0-g8247bbb5b470"... 2023-11-28T11:47:44.262 DEBUG:teuthology.orchestra.run.smithi152:> uname -r 2023-11-28T11:47:44.308 INFO:teuthology.orchestra.run.smithi152.stdout:6.6.0-g8247bbb5b470 2023-11-28T11:47:44.308 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-g8247bbb5b470 vs 6.6.0-g8247bbb5b470 2023-11-28T11:47:44.308 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-28T11:47:44.308 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-11-28T11:47:45.310 DEBUG:teuthology.parallel:result is None 2023-11-28T11:47:45.310 INFO:teuthology.run_tasks:Running task internal.base... 2023-11-28T11:47:45.318 INFO:teuthology.task.internal:Creating test directory... 2023-11-28T11:47:45.319 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-28T11:47:45.324 DEBUG:teuthology.orchestra.run.smithi152:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-28T11:47:45.372 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-11-28T11:47:45.380 INFO:teuthology.run_tasks:Running task internal.archive... 2023-11-28T11:47:45.391 INFO:teuthology.task.internal:Creating archive directory... 2023-11-28T11:47:45.391 DEBUG:teuthology.orchestra.run.smithi045:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-28T11:47:45.395 DEBUG:teuthology.orchestra.run.smithi152:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-28T11:47:45.453 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-11-28T11:47:45.461 INFO:teuthology.task.internal:Enabling coredump saving... 2023-11-28T11:47:45.462 DEBUG:teuthology.orchestra.run.smithi045:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-28T11:47:45.466 DEBUG:teuthology.orchestra.run.smithi152:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-28T11:47:45.594 INFO:teuthology.orchestra.run.smithi045.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-28T11:47:45.609 INFO:teuthology.orchestra.run.smithi152.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-28T11:47:45.640 INFO:teuthology.orchestra.run.smithi152.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-28T11:47:45.648 INFO:teuthology.orchestra.run.smithi045.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-28T11:47:45.652 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-11-28T11:47:45.660 INFO:teuthology.task.internal:Configuring sudo... 2023-11-28T11:47:45.660 DEBUG:teuthology.orchestra.run.smithi045:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-28T11:47:45.665 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-28T11:47:45.735 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-11-28T11:47:45.745 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-11-28T11:47:45.745 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-28T11:47:45.749 DEBUG:teuthology.orchestra.run.smithi152:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-28T11:47:45.795 DEBUG:teuthology.orchestra.run.smithi045:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-28T11:47:45.904 DEBUG:teuthology.orchestra.run.smithi045:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-28T11:47:45.988 DEBUG:teuthology.orchestra.run.smithi045:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-28T11:47:46.062 DEBUG:teuthology.orchestra.run.smithi045:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-28T11:47:46.135 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T11:47:46.136 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-28T11:47:46.207 DEBUG:teuthology.orchestra.run.smithi152:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-28T11:47:46.281 DEBUG:teuthology.orchestra.run.smithi152:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-28T11:47:46.354 DEBUG:teuthology.orchestra.run.smithi152:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-28T11:47:46.429 DEBUG:teuthology.orchestra.run.smithi152:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-28T11:47:46.499 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-11-28T11:47:46.499 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-28T11:47:46.584 DEBUG:teuthology.orchestra.run.smithi045:> sudo service rsyslog restart 2023-11-28T11:47:46.589 DEBUG:teuthology.orchestra.run.smithi152:> sudo service rsyslog restart 2023-11-28T11:47:46.709 INFO:teuthology.orchestra.run.smithi045.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-28T11:47:46.746 INFO:teuthology.orchestra.run.smithi152.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-28T11:47:47.120 INFO:teuthology.run_tasks:Running task internal.timer... 2023-11-28T11:47:47.128 INFO:teuthology.task.internal:Starting timer... 2023-11-28T11:47:47.128 INFO:teuthology.run_tasks:Running task pcp... 2023-11-28T11:47:47.148 INFO:teuthology.run_tasks:Running task selinux... 2023-11-28T11:47:47.157 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-11-28T11:47:47.158 DEBUG:teuthology.orchestra.run.smithi045:> sudo service auditd rotate 2023-11-28T11:47:47.310 INFO:teuthology.orchestra.run.smithi045.stdout:Rotating logs: 2023-11-28T11:47:47.314 DEBUG:teuthology.orchestra.run.smithi152:> sudo service auditd rotate 2023-11-28T11:47:47.432 INFO:teuthology.orchestra.run.smithi152.stdout:Rotating logs: 2023-11-28T11:47:47.435 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-11-28T11:47:47.435 DEBUG:teuthology.orchestra.run.smithi045:> /usr/sbin/getenforce 2023-11-28T11:47:47.494 INFO:teuthology.orchestra.run.smithi045.stdout:Permissive 2023-11-28T11:47:47.494 DEBUG:teuthology.orchestra.run.smithi152:> /usr/sbin/getenforce 2023-11-28T11:47:47.545 INFO:teuthology.orchestra.run.smithi152.stdout:Permissive 2023-11-28T11:47:47.545 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi045.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi152.front.sepia.ceph.com': 'permissive'} 2023-11-28T11:47:47.546 DEBUG:teuthology.orchestra.run.smithi045:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-28T11:47:47.620 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T11:47:47.621 DEBUG:teuthology.orchestra.run.smithi152:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-28T11:47:47.692 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T11:47:47.692 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-11-28T11:47:47.693 DEBUG:teuthology.orchestra.run.smithi045:> sudo /usr/sbin/setenforce permissive 2023-11-28T11:47:47.774 DEBUG:teuthology.orchestra.run.smithi152:> sudo /usr/sbin/setenforce permissive 2023-11-28T11:47:47.843 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-11-28T11:47:47.861 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-11-28T11:47:47.861 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-11-28T11:47:47.881 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-11-28T11:47:47.883 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi045.front.sepia.ceph.com,smithi152.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-11-28T11:59:51.469 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi045.front.sepia.ceph.com'), Remote(name='ubuntu@smithi152.front.sepia.ceph.com')] 2023-11-28T11:59:51.470 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi045.front.sepia.ceph.com' 2023-11-28T11:59:51.471 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T11:59:51.564 DEBUG:teuthology.orchestra.run.smithi045:> true 2023-11-28T11:59:51.692 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi045.front.sepia.ceph.com' 2023-11-28T11:59:51.692 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2023-11-28T11:59:51.693 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T11:59:51.775 DEBUG:teuthology.orchestra.run.smithi152:> true 2023-11-28T11:59:51.896 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi152.front.sepia.ceph.com' 2023-11-28T11:59:51.896 INFO:teuthology.run_tasks:Running task clock... 2023-11-28T11:59:51.906 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-11-28T11:59:51.906 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-28T11:59:51.907 DEBUG:teuthology.orchestra.run.smithi045:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-28T11:59:51.912 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-28T11:59:51.912 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-28T11:59:51.986 INFO:teuthology.orchestra.run.smithi045.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-11-28T11:59:52.012 INFO:teuthology.orchestra.run.smithi152.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-11-28T11:59:52.021 INFO:teuthology.orchestra.run.smithi045.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-11-28T11:59:52.046 INFO:teuthology.orchestra.run.smithi152.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-11-28T11:59:52.117 INFO:teuthology.orchestra.run.smithi045.stderr:sudo: ntpd: command not found 2023-11-28T11:59:52.141 INFO:teuthology.orchestra.run.smithi152.stderr:sudo: ntpd: command not found 2023-11-28T11:59:52.145 INFO:teuthology.orchestra.run.smithi045.stdout:506 Cannot talk to daemon 2023-11-28T11:59:52.172 INFO:teuthology.orchestra.run.smithi152.stdout:506 Cannot talk to daemon 2023-11-28T11:59:52.180 INFO:teuthology.orchestra.run.smithi045.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-11-28T11:59:52.202 INFO:teuthology.orchestra.run.smithi152.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-11-28T11:59:52.214 INFO:teuthology.orchestra.run.smithi045.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-11-28T11:59:52.234 INFO:teuthology.orchestra.run.smithi152.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-11-28T11:59:52.303 INFO:teuthology.orchestra.run.smithi045.stderr:bash: ntpq: command not found 2023-11-28T11:59:52.310 INFO:teuthology.orchestra.run.smithi045.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-28T11:59:52.310 INFO:teuthology.orchestra.run.smithi045.stdout:=============================================================================== 2023-11-28T11:59:52.310 INFO:teuthology.orchestra.run.smithi045.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-28T11:59:52.310 INFO:teuthology.orchestra.run.smithi045.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-28T11:59:52.310 INFO:teuthology.orchestra.run.smithi045.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-28T11:59:52.310 INFO:teuthology.orchestra.run.smithi045.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-28T11:59:52.322 INFO:teuthology.orchestra.run.smithi152.stderr:bash: ntpq: command not found 2023-11-28T11:59:52.330 INFO:teuthology.orchestra.run.smithi152.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-28T11:59:52.330 INFO:teuthology.orchestra.run.smithi152.stdout:=============================================================================== 2023-11-28T11:59:52.330 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-28T11:59:52.330 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-28T11:59:52.330 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-28T11:59:52.330 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-28T11:59:52.331 INFO:teuthology.run_tasks:Running task install... 2023-11-28T11:59:52.346 DEBUG:teuthology.task.install:project ceph 2023-11-28T11:59:52.346 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '2f5f6028b893ad41357cd06e827373f0fe2a1232'}} 2023-11-28T11:59:52.346 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '2f5f6028b893ad41357cd06e827373f0fe2a1232'} 2023-11-28T11:59:52.347 INFO:teuthology.task.install:Using flavor: default 2023-11-28T11:59:52.352 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-11-28T11:59:52.353 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-11-28T11:59:52.353 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f5f6028b893ad41357cd06e827373f0fe2a1232', 'tag': None, 'wait_for_package': False} 2023-11-28T11:59:52.354 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=2f5f6028b893ad41357cd06e827373f0fe2a1232 2023-11-28T11:59:52.355 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f5f6028b893ad41357cd06e827373f0fe2a1232', 'tag': None, 'wait_for_package': False} 2023-11-28T11:59:52.356 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=2f5f6028b893ad41357cd06e827373f0fe2a1232 2023-11-28T11:59:52.501 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/centos/8/flavors/default/ 2023-11-28T11:59:52.502 INFO:teuthology.task.install.rpm:Package version is 18.0.0-2697.g2f5f6028 2023-11-28T11:59:52.582 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/centos/8/flavors/default/ 2023-11-28T11:59:52.582 INFO:teuthology.task.install.rpm:Package version is 18.0.0-2697.g2f5f6028 2023-11-28T11:59:52.670 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-11-28T11:59:52.671 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T11:59:52.671 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-11-28T11:59:52.690 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-231123/2f5f6028b893ad41357cd06e827373f0fe2a1232/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-11-28T11:59:52.691 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-11-28T11:59:52.691 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-11-28T11:59:52.746 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-11-28T11:59:52.747 DEBUG:teuthology.orchestra.run.smithi045:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f5f6028b893ad41357cd06e827373f0fe2a1232/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-11-28T11:59:52.760 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-11-28T11:59:52.761 DEBUG:teuthology.orchestra.run.smithi152:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f5f6028b893ad41357cd06e827373f0fe2a1232/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-11-28T11:59:52.860 DEBUG:teuthology.orchestra.run.smithi045:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-11-28T11:59:52.872 DEBUG:teuthology.orchestra.run.smithi152:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-11-28T11:59:52.957 DEBUG:teuthology.orchestra.run.smithi045:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-11-28T11:59:52.968 DEBUG:teuthology.orchestra.run.smithi152:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-11-28T11:59:53.028 INFO:teuthology.orchestra.run.smithi045.stdout:check_obsoletes = 1 2023-11-28T11:59:53.031 DEBUG:teuthology.orchestra.run.smithi045:> sudo yum clean all 2023-11-28T11:59:53.037 INFO:teuthology.orchestra.run.smithi152.stdout:check_obsoletes = 1 2023-11-28T11:59:53.041 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum clean all 2023-11-28T11:59:53.397 INFO:teuthology.orchestra.run.smithi152.stdout:76 files removed 2023-11-28T11:59:53.410 INFO:teuthology.orchestra.run.smithi045.stdout:76 files removed 2023-11-28T11:59:53.435 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-11-28T11:59:53.447 DEBUG:teuthology.orchestra.run.smithi045:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-11-28T11:59:54.304 INFO:teuthology.orchestra.run.smithi152.stdout:ceph packages for x86_64 250 kB/s | 80 kB 00:00 2023-11-28T11:59:54.413 INFO:teuthology.orchestra.run.smithi045.stdout:ceph packages for x86_64 206 kB/s | 80 kB 00:00 2023-11-28T11:59:54.613 INFO:teuthology.orchestra.run.smithi152.stdout:ceph noarch packages 35 kB/s | 9.4 kB 00:00 2023-11-28T11:59:54.731 INFO:teuthology.orchestra.run.smithi045.stdout:ceph noarch packages 34 kB/s | 9.4 kB 00:00 2023-11-28T11:59:54.990 INFO:teuthology.orchestra.run.smithi045.stdout:ceph source packages 6.5 kB/s | 1.5 kB 00:00 2023-11-28T11:59:54.996 INFO:teuthology.orchestra.run.smithi152.stdout:ceph source packages 4.2 kB/s | 1.5 kB 00:00 2023-11-28T12:00:55.048 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 8 - AppStream 584 kB/s | 34 MB 01:00 2023-11-28T12:01:04.873 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 8 - BaseOS 23 MB/s | 55 MB 00:02 2023-11-28T12:01:14.048 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 8 - Extras 60 kB/s | 18 kB 00:00 2023-11-28T12:01:14.398 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 8 - Extras common packages 41 kB/s | 6.9 kB 00:00 2023-11-28T12:01:22.140 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 8 - PowerTools 895 kB/s | 6.6 MB 00:07 2023-11-28T12:01:23.782 INFO:teuthology.orchestra.run.smithi152.stdout:Copr repo for python3-asyncssh owned by ceph 28 kB/s | 3.5 kB 00:00 2023-11-28T12:01:28.608 INFO:teuthology.orchestra.run.smithi152.stdout:Extra Packages for Enterprise Linux 3.4 MB/s | 16 MB 00:04 2023-11-28T12:01:33.358 INFO:teuthology.orchestra.run.smithi152.stdout:lab-extras 353 kB/s | 24 kB 00:00 2023-11-28T12:01:37.827 INFO:teuthology.orchestra.run.smithi152.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-11-28T12:01:37.828 INFO:teuthology.orchestra.run.smithi152.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-11-28T12:01:37.843 INFO:teuthology.orchestra.run.smithi152.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2023-11-28T12:01:37.843 INFO:teuthology.orchestra.run.smithi152.stdout:Package NetworkManager-initscripts-updown-1:1.40.16-4.el8.noarch is already installed. 2023-11-28T12:01:37.843 INFO:teuthology.orchestra.run.smithi152.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2023-11-28T12:01:37.844 INFO:teuthology.orchestra.run.smithi152.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2023-11-28T12:01:37.845 INFO:teuthology.orchestra.run.smithi152.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-11-28T12:01:37.847 INFO:teuthology.orchestra.run.smithi152.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-11-28T12:01:37.851 INFO:teuthology.orchestra.run.smithi152.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-11-28T12:01:37.852 INFO:teuthology.orchestra.run.smithi152.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-11-28T12:01:38.116 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2023-11-28T12:01:38.131 INFO:teuthology.orchestra.run.smithi152.stdout:==================================================================================================== 2023-11-28T12:01:38.131 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repository Size 2023-11-28T12:01:38.131 INFO:teuthology.orchestra.run.smithi152.stdout:==================================================================================================== 2023-11-28T12:01:38.131 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2023-11-28T12:01:38.131 INFO:teuthology.orchestra.run.smithi152.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2023-11-28T12:01:38.131 INFO:teuthology.orchestra.run.smithi152.stdout: ceph x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 6.4 k 2023-11-28T12:01:38.131 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-base x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 5.4 M 2023-11-28T12:01:38.131 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-fuse x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 845 k 2023-11-28T12:01:38.131 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 165 k 2023-11-28T12:01:38.132 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 1.5 M 2023-11-28T12:01:38.132 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-cephadm noarch 2:18.0.0-2697.g2f5f6028.el8 ceph-noarch 123 k 2023-11-28T12:01:38.132 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-dashboard noarch 2:18.0.0-2697.g2f5f6028.el8 ceph-noarch 1.7 M 2023-11-28T12:01:38.132 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-2697.g2f5f6028.el8 ceph-noarch 7.4 M 2023-11-28T12:01:38.132 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-rook noarch 2:18.0.0-2697.g2f5f6028.el8 ceph-noarch 47 k 2023-11-28T12:01:38.132 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-radosgw x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 13 M 2023-11-28T12:01:38.132 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-test x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 47 M 2023-11-28T12:01:38.132 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-volume noarch 2:18.0.0-2697.g2f5f6028.el8 ceph-noarch 263 k 2023-11-28T12:01:38.132 INFO:teuthology.orchestra.run.smithi152.stdout: cephadm noarch 2:18.0.0-2697.g2f5f6028.el8 ceph-noarch 83 k 2023-11-28T12:01:38.132 INFO:teuthology.orchestra.run.smithi152.stdout: cephfs-mirror x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 257 k 2023-11-28T12:01:38.132 INFO:teuthology.orchestra.run.smithi152.stdout: cephfs-top noarch 2:18.0.0-2697.g2f5f6028.el8 ceph-noarch 18 k 2023-11-28T12:01:38.133 INFO:teuthology.orchestra.run.smithi152.stdout: elfutils-libelf-devel x86_64 0.190-1.el8 baseos 62 k 2023-11-28T12:01:38.133 INFO:teuthology.orchestra.run.smithi152.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2023-11-28T12:01:38.133 INFO:teuthology.orchestra.run.smithi152.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2023-11-28T12:01:38.133 INFO:teuthology.orchestra.run.smithi152.stdout: libcephfs-devel x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 30 k 2023-11-28T12:01:38.133 INFO:teuthology.orchestra.run.smithi152.stdout: libcephfs2 x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 767 k 2023-11-28T12:01:38.133 INFO:teuthology.orchestra.run.smithi152.stdout: librados-devel x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 139 k 2023-11-28T12:01:38.133 INFO:teuthology.orchestra.run.smithi152.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2023-11-28T12:01:38.133 INFO:teuthology.orchestra.run.smithi152.stdout: libuuid-devel x86_64 2.32.1-43.el8 baseos 100 k 2023-11-28T12:01:38.133 INFO:teuthology.orchestra.run.smithi152.stdout: openssl-devel x86_64 1:1.1.1k-11.el8 baseos 3.2 M 2023-11-28T12:01:38.133 INFO:teuthology.orchestra.run.smithi152.stdout: postgresql x86_64 10.23-2.module_el8+572+929c87ac appstream 1.6 M 2023-11-28T12:01:38.133 INFO:teuthology.orchestra.run.smithi152.stdout: postgresql-contrib x86_64 10.23-2.module_el8+572+929c87ac appstream 901 k 2023-11-28T12:01:38.133 INFO:teuthology.orchestra.run.smithi152.stdout: postgresql-server x86_64 10.23-2.module_el8+572+929c87ac appstream 5.1 M 2023-11-28T12:01:38.134 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cephfs x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 190 k 2023-11-28T12:01:38.134 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rados x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 371 k 2023-11-28T12:01:38.134 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rbd x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 364 k 2023-11-28T12:01:38.134 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rgw x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 107 k 2023-11-28T12:01:38.134 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-fuse x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 94 k 2023-11-28T12:01:38.134 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-mirror x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 3.4 M 2023-11-28T12:01:38.134 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-nbd x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 180 k 2023-11-28T12:01:38.134 INFO:teuthology.orchestra.run.smithi152.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 baseos 74 k 2023-11-28T12:01:38.134 INFO:teuthology.orchestra.run.smithi152.stdout:Upgrading: 2023-11-28T12:01:38.134 INFO:teuthology.orchestra.run.smithi152.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-11.el8 baseos 144 k 2023-11-28T12:01:38.134 INFO:teuthology.orchestra.run.smithi152.stdout: acl x86_64 2.2.53-3.el8 baseos 83 k 2023-11-28T12:01:38.135 INFO:teuthology.orchestra.run.smithi152.stdout: elfutils-debuginfod-client x86_64 0.190-1.el8 baseos 77 k 2023-11-28T12:01:38.135 INFO:teuthology.orchestra.run.smithi152.stdout: elfutils-libelf x86_64 0.190-1.el8 baseos 232 k 2023-11-28T12:01:38.135 INFO:teuthology.orchestra.run.smithi152.stdout: elfutils-libs x86_64 0.190-1.el8 baseos 305 k 2023-11-28T12:01:38.135 INFO:teuthology.orchestra.run.smithi152.stdout: iproute x86_64 6.2.0-5.el8 baseos 854 k 2023-11-28T12:01:38.135 INFO:teuthology.orchestra.run.smithi152.stdout: libacl x86_64 2.2.53-3.el8 baseos 35 k 2023-11-28T12:01:38.135 INFO:teuthology.orchestra.run.smithi152.stdout: libacl-devel x86_64 2.2.53-3.el8 baseos 85 k 2023-11-28T12:01:38.135 INFO:teuthology.orchestra.run.smithi152.stdout: libblkid x86_64 2.32.1-43.el8 baseos 220 k 2023-11-28T12:01:38.135 INFO:teuthology.orchestra.run.smithi152.stdout: libfdisk x86_64 2.32.1-43.el8 baseos 254 k 2023-11-28T12:01:38.135 INFO:teuthology.orchestra.run.smithi152.stdout: libmount x86_64 2.32.1-43.el8 baseos 236 k 2023-11-28T12:01:38.135 INFO:teuthology.orchestra.run.smithi152.stdout: librados2 x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 3.7 M 2023-11-28T12:01:38.135 INFO:teuthology.orchestra.run.smithi152.stdout: librbd1 x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 3.6 M 2023-11-28T12:01:38.136 INFO:teuthology.orchestra.run.smithi152.stdout: libsmartcols x86_64 2.32.1-43.el8 baseos 179 k 2023-11-28T12:01:38.136 INFO:teuthology.orchestra.run.smithi152.stdout: libuuid x86_64 2.32.1-43.el8 baseos 99 k 2023-11-28T12:01:38.136 INFO:teuthology.orchestra.run.smithi152.stdout: openssl x86_64 1:1.1.1k-11.el8 baseos 737 k 2023-11-28T12:01:38.136 INFO:teuthology.orchestra.run.smithi152.stdout: openssl-libs x86_64 1:1.1.1k-11.el8 baseos 1.5 M 2023-11-28T12:01:38.136 INFO:teuthology.orchestra.run.smithi152.stdout: util-linux x86_64 2.32.1-43.el8 baseos 2.5 M 2023-11-28T12:01:38.136 INFO:teuthology.orchestra.run.smithi152.stdout: util-linux-user x86_64 2.32.1-43.el8 baseos 103 k 2023-11-28T12:01:38.136 INFO:teuthology.orchestra.run.smithi152.stdout: xfsdump x86_64 3.1.8-7.el8 baseos 334 k 2023-11-28T12:01:38.136 INFO:teuthology.orchestra.run.smithi152.stdout: xfsprogs x86_64 5.0.0-12.el8 baseos 1.1 M 2023-11-28T12:01:38.136 INFO:teuthology.orchestra.run.smithi152.stdout:Installing dependencies: 2023-11-28T12:01:38.136 INFO:teuthology.orchestra.run.smithi152.stdout: automake noarch 1.16.1-8.el8 appstream 740 k 2023-11-28T12:01:38.136 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-common x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 22 M 2023-11-28T12:01:38.137 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-grafana-dashboards noarch 2:18.0.0-2697.g2f5f6028.el8 ceph-noarch 23 k 2023-11-28T12:01:38.137 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mds x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 2.3 M 2023-11-28T12:01:38.137 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-modules-core noarch 2:18.0.0-2697.g2f5f6028.el8 ceph-noarch 236 k 2023-11-28T12:01:38.137 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mon x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 4.6 M 2023-11-28T12:01:38.137 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-osd x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 18 M 2023-11-28T12:01:38.137 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-prometheus-alerts noarch 2:18.0.0-2697.g2f5f6028.el8 ceph-noarch 15 k 2023-11-28T12:01:38.137 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-selinux x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 24 k 2023-11-28T12:01:38.137 INFO:teuthology.orchestra.run.smithi152.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-11-28T12:01:38.137 INFO:teuthology.orchestra.run.smithi152.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-11-28T12:01:38.137 INFO:teuthology.orchestra.run.smithi152.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2023-11-28T12:01:38.137 INFO:teuthology.orchestra.run.smithi152.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2023-11-28T12:01:38.138 INFO:teuthology.orchestra.run.smithi152.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2023-11-28T12:01:38.138 INFO:teuthology.orchestra.run.smithi152.stdout: libcephsqlite x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 137 k 2023-11-28T12:01:38.138 INFO:teuthology.orchestra.run.smithi152.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2023-11-28T12:01:38.138 INFO:teuthology.orchestra.run.smithi152.stdout: libgfortran x86_64 8.5.0-21.el8 baseos 645 k 2023-11-28T12:01:38.138 INFO:teuthology.orchestra.run.smithi152.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-11-28T12:01:38.138 INFO:teuthology.orchestra.run.smithi152.stdout: libpq x86_64 13.5-1.el8 appstream 198 k 2023-11-28T12:01:38.138 INFO:teuthology.orchestra.run.smithi152.stdout: libquadmath x86_64 8.5.0-21.el8 baseos 172 k 2023-11-28T12:01:38.138 INFO:teuthology.orchestra.run.smithi152.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-11-28T12:01:38.138 INFO:teuthology.orchestra.run.smithi152.stdout: libradosstriper1 x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 474 k 2023-11-28T12:01:38.138 INFO:teuthology.orchestra.run.smithi152.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-11-28T12:01:38.139 INFO:teuthology.orchestra.run.smithi152.stdout: librgw2 x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 6.5 M 2023-11-28T12:01:38.139 INFO:teuthology.orchestra.run.smithi152.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2023-11-28T12:01:38.139 INFO:teuthology.orchestra.run.smithi152.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2023-11-28T12:01:38.139 INFO:teuthology.orchestra.run.smithi152.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-11-28T12:01:38.139 INFO:teuthology.orchestra.run.smithi152.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2023-11-28T12:01:38.139 INFO:teuthology.orchestra.run.smithi152.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2023-11-28T12:01:38.139 INFO:teuthology.orchestra.run.smithi152.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-11-28T12:01:38.139 INFO:teuthology.orchestra.run.smithi152.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-11-28T12:01:38.139 INFO:teuthology.orchestra.run.smithi152.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-11-28T12:01:38.139 INFO:teuthology.orchestra.run.smithi152.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-11-28T12:01:38.139 INFO:teuthology.orchestra.run.smithi152.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2023-11-28T12:01:38.140 INFO:teuthology.orchestra.run.smithi152.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2023-11-28T12:01:38.140 INFO:teuthology.orchestra.run.smithi152.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2023-11-28T12:01:38.140 INFO:teuthology.orchestra.run.smithi152.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-11-28T12:01:38.140 INFO:teuthology.orchestra.run.smithi152.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-11-28T12:01:38.140 INFO:teuthology.orchestra.run.smithi152.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-11-28T12:01:38.140 INFO:teuthology.orchestra.run.smithi152.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-11-28T12:01:38.140 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-11-28T12:01:38.140 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ceph-argparse x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 45 k 2023-11-28T12:01:38.140 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ceph-common x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 117 k 2023-11-28T12:01:38.140 INFO:teuthology.orchestra.run.smithi152.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-11-28T12:01:38.140 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-11-28T12:01:38.140 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-11-28T12:01:38.141 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-11-28T12:01:38.141 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-11-28T12:01:38.141 INFO:teuthology.orchestra.run.smithi152.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-11-28T12:01:38.141 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-11-28T12:01:38.141 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-11-28T12:01:38.141 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-11-28T12:01:38.141 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-11-28T12:01:38.141 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-11-28T12:01:38.141 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-11-28T12:01:38.141 INFO:teuthology.orchestra.run.smithi152.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-11-28T12:01:38.141 INFO:teuthology.orchestra.run.smithi152.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-11-28T12:01:38.141 INFO:teuthology.orchestra.run.smithi152.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-11-28T12:01:38.142 INFO:teuthology.orchestra.run.smithi152.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-11-28T12:01:38.142 INFO:teuthology.orchestra.run.smithi152.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-11-28T12:01:38.142 INFO:teuthology.orchestra.run.smithi152.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-11-28T12:01:38.142 INFO:teuthology.orchestra.run.smithi152.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-11-28T12:01:38.142 INFO:teuthology.orchestra.run.smithi152.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-11-28T12:01:38.142 INFO:teuthology.orchestra.run.smithi152.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-11-28T12:01:38.142 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-11-28T12:01:38.142 INFO:teuthology.orchestra.run.smithi152.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-11-28T12:01:38.142 INFO:teuthology.orchestra.run.smithi152.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-11-28T12:01:38.142 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-11-28T12:01:38.142 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-11-28T12:01:38.143 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-11-28T12:01:38.143 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-11-28T12:01:38.143 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2023-11-28T12:01:38.143 INFO:teuthology.orchestra.run.smithi152.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-11-28T12:01:38.143 INFO:teuthology.orchestra.run.smithi152.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-11-28T12:01:38.143 INFO:teuthology.orchestra.run.smithi152.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-11-28T12:01:38.143 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-11-28T12:01:38.143 INFO:teuthology.orchestra.run.smithi152.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-11-28T12:01:38.143 INFO:teuthology.orchestra.run.smithi152.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-11-28T12:01:38.143 INFO:teuthology.orchestra.run.smithi152.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-11-28T12:01:38.143 INFO:teuthology.orchestra.run.smithi152.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-11-28T12:01:38.144 INFO:teuthology.orchestra.run.smithi152.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-11-28T12:01:38.144 INFO:teuthology.orchestra.run.smithi152.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-11-28T12:01:38.144 INFO:teuthology.orchestra.run.smithi152.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-11-28T12:01:38.144 INFO:teuthology.orchestra.run.smithi152.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-11-28T12:01:38.144 INFO:teuthology.orchestra.run.smithi152.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-11-28T12:01:38.144 INFO:teuthology.orchestra.run.smithi152.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-11-28T12:01:38.144 INFO:teuthology.orchestra.run.smithi152.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-11-28T12:01:38.144 INFO:teuthology.orchestra.run.smithi152.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-11-28T12:01:38.145 INFO:teuthology.orchestra.run.smithi152.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-11-28T12:01:38.145 INFO:teuthology.orchestra.run.smithi152.stdout: uuid x86_64 1.6.2-43.el8 appstream 64 k 2023-11-28T12:01:38.145 INFO:teuthology.orchestra.run.smithi152.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-11-28T12:01:38.145 INFO:teuthology.orchestra.run.smithi152.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2023-11-28T12:01:38.145 INFO:teuthology.orchestra.run.smithi152.stdout:Enabling module streams: 2023-11-28T12:01:38.145 INFO:teuthology.orchestra.run.smithi152.stdout: postgresql 10 2023-11-28T12:01:38.145 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-11-28T12:01:38.145 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2023-11-28T12:01:38.145 INFO:teuthology.orchestra.run.smithi152.stdout:==================================================================================================== 2023-11-28T12:01:38.145 INFO:teuthology.orchestra.run.smithi152.stdout:Install 128 Packages 2023-11-28T12:01:38.146 INFO:teuthology.orchestra.run.smithi152.stdout:Upgrade 21 Packages 2023-11-28T12:01:38.146 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-11-28T12:01:38.147 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 212 M 2023-11-28T12:01:38.147 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2023-11-28T12:01:38.851 INFO:teuthology.orchestra.run.smithi152.stdout:(1/149): ceph-18.0.0-2697.g2f5f6028.el8.x86_64. 51 kB/s | 6.4 kB 00:00 2023-11-28T12:01:38.938 INFO:teuthology.orchestra.run.smithi045.stdout:CentOS Stream 8 - AppStream 337 kB/s | 34 MB 01:43 2023-11-28T12:01:39.084 INFO:teuthology.orchestra.run.smithi152.stdout:(2/149): ceph-fuse-18.0.0-2697.g2f5f6028.el8.x8 3.5 MB/s | 845 kB 00:00 2023-11-28T12:01:39.187 INFO:teuthology.orchestra.run.smithi152.stdout:(3/149): ceph-immutable-object-cache-18.0.0-269 1.6 MB/s | 165 kB 00:00 2023-11-28T12:01:39.518 INFO:teuthology.orchestra.run.smithi152.stdout:(4/149): ceph-mds-18.0.0-2697.g2f5f6028.el8.x86 6.9 MB/s | 2.3 MB 00:00 2023-11-28T12:01:39.777 INFO:teuthology.orchestra.run.smithi152.stdout:(5/149): ceph-mgr-18.0.0-2697.g2f5f6028.el8.x86 6.0 MB/s | 1.5 MB 00:00 2023-11-28T12:01:40.161 INFO:teuthology.orchestra.run.smithi152.stdout:(6/149): ceph-common-18.0.0-2697.g2f5f6028.el8. 15 MB/s | 22 MB 00:01 2023-11-28T12:01:40.303 INFO:teuthology.orchestra.run.smithi152.stdout:(7/149): ceph-mon-18.0.0-2697.g2f5f6028.el8.x86 8.8 MB/s | 4.6 MB 00:00 2023-11-28T12:01:41.253 INFO:teuthology.orchestra.run.smithi152.stdout:(8/149): ceph-base-18.0.0-2697.g2f5f6028.el8.x8 2.1 MB/s | 5.4 MB 00:02 2023-11-28T12:01:41.453 INFO:teuthology.orchestra.run.smithi152.stdout:(9/149): ceph-osd-18.0.0-2697.g2f5f6028.el8.x86 14 MB/s | 18 MB 00:01 2023-11-28T12:01:41.503 INFO:teuthology.orchestra.run.smithi152.stdout:(10/149): ceph-selinux-18.0.0-2697.g2f5f6028.el 97 kB/s | 24 kB 00:00 2023-11-28T12:01:41.603 INFO:teuthology.orchestra.run.smithi152.stdout:(11/149): cephfs-mirror-18.0.0-2697.g2f5f6028.e 2.5 MB/s | 257 kB 00:00 2023-11-28T12:01:41.745 INFO:teuthology.orchestra.run.smithi152.stdout:(12/149): ceph-radosgw-18.0.0-2697.g2f5f6028.el 9.0 MB/s | 13 MB 00:01 2023-11-28T12:01:41.770 INFO:teuthology.orchestra.run.smithi152.stdout:(13/149): libcephfs-devel-18.0.0-2697.g2f5f6028 183 kB/s | 30 kB 00:00 2023-11-28T12:01:41.862 INFO:teuthology.orchestra.run.smithi152.stdout:(14/149): libcephfs2-18.0.0-2697.g2f5f6028.el8. 6.4 MB/s | 767 kB 00:00 2023-11-28T12:01:41.888 INFO:teuthology.orchestra.run.smithi152.stdout:(15/149): libcephsqlite-18.0.0-2697.g2f5f6028.e 1.1 MB/s | 137 kB 00:00 2023-11-28T12:01:41.922 INFO:teuthology.orchestra.run.smithi152.stdout:(16/149): librados-devel-18.0.0-2697.g2f5f6028. 2.3 MB/s | 139 kB 00:00 2023-11-28T12:01:42.022 INFO:teuthology.orchestra.run.smithi152.stdout:(17/149): libradosstriper1-18.0.0-2697.g2f5f602 3.5 MB/s | 474 kB 00:00 2023-11-28T12:01:42.114 INFO:teuthology.orchestra.run.smithi152.stdout:(18/149): python3-ceph-argparse-18.0.0-2697.g2f 487 kB/s | 45 kB 00:00 2023-11-28T12:01:42.205 INFO:teuthology.orchestra.run.smithi152.stdout:(19/149): python3-ceph-common-18.0.0-2697.g2f5f 1.3 MB/s | 117 kB 00:00 2023-11-28T12:01:42.289 INFO:teuthology.orchestra.run.smithi152.stdout:(20/149): python3-cephfs-18.0.0-2697.g2f5f6028. 2.2 MB/s | 190 kB 00:00 2023-11-28T12:01:42.398 INFO:teuthology.orchestra.run.smithi152.stdout:(21/149): python3-rados-18.0.0-2697.g2f5f6028.e 3.4 MB/s | 371 kB 00:00 2023-11-28T12:01:42.490 INFO:teuthology.orchestra.run.smithi152.stdout:(22/149): librgw2-18.0.0-2697.g2f5f6028.el8.x86 11 MB/s | 6.5 MB 00:00 2023-11-28T12:01:42.515 INFO:teuthology.orchestra.run.smithi152.stdout:(23/149): python3-rbd-18.0.0-2697.g2f5f6028.el8 3.0 MB/s | 364 kB 00:00 2023-11-28T12:01:42.549 INFO:teuthology.orchestra.run.smithi152.stdout:(24/149): python3-rgw-18.0.0-2697.g2f5f6028.el8 1.8 MB/s | 107 kB 00:00 2023-11-28T12:01:42.574 INFO:teuthology.orchestra.run.smithi152.stdout:(25/149): rbd-fuse-18.0.0-2697.g2f5f6028.el8.x8 1.6 MB/s | 94 kB 00:00 2023-11-28T12:01:42.674 INFO:teuthology.orchestra.run.smithi152.stdout:(26/149): rbd-nbd-18.0.0-2697.g2f5f6028.el8.x86 1.8 MB/s | 180 kB 00:00 2023-11-28T12:01:42.758 INFO:teuthology.orchestra.run.smithi152.stdout:(27/149): ceph-grafana-dashboards-18.0.0-2697.g 276 kB/s | 23 kB 00:00 2023-11-28T12:01:43.092 INFO:teuthology.orchestra.run.smithi152.stdout:(28/149): rbd-mirror-18.0.0-2697.g2f5f6028.el8. 6.4 MB/s | 3.4 MB 00:00 2023-11-28T12:01:43.117 INFO:teuthology.orchestra.run.smithi152.stdout:(29/149): ceph-mgr-cephadm-18.0.0-2697.g2f5f602 342 kB/s | 123 kB 00:00 2023-11-28T12:01:43.284 INFO:teuthology.orchestra.run.smithi152.stdout:(30/149): ceph-mgr-dashboard-18.0.0-2697.g2f5f6 9.0 MB/s | 1.7 MB 00:00 2023-11-28T12:01:43.351 INFO:teuthology.orchestra.run.smithi152.stdout:(31/149): ceph-mgr-modules-core-18.0.0-2697.g2f 3.5 MB/s | 236 kB 00:00 2023-11-28T12:01:43.426 INFO:teuthology.orchestra.run.smithi152.stdout:(32/149): ceph-mgr-rook-18.0.0-2697.g2f5f6028.e 629 kB/s | 47 kB 00:00 2023-11-28T12:01:43.503 INFO:teuthology.orchestra.run.smithi152.stdout:(33/149): ceph-prometheus-alerts-18.0.0-2697.g2 194 kB/s | 15 kB 00:00 2023-11-28T12:01:43.585 INFO:teuthology.orchestra.run.smithi152.stdout:(34/149): ceph-volume-18.0.0-2697.g2f5f6028.el8 3.1 MB/s | 263 kB 00:00 2023-11-28T12:01:43.652 INFO:teuthology.orchestra.run.smithi152.stdout:(35/149): cephadm-18.0.0-2697.g2f5f6028.el8.noa 1.2 MB/s | 83 kB 00:00 2023-11-28T12:01:43.711 INFO:teuthology.orchestra.run.smithi152.stdout:(36/149): cephfs-top-18.0.0-2697.g2f5f6028.el8. 311 kB/s | 18 kB 00:00 2023-11-28T12:01:44.245 INFO:teuthology.orchestra.run.smithi152.stdout:(37/149): ceph-mgr-diskprediction-local-18.0.0- 6.6 MB/s | 7.4 MB 00:01 2023-11-28T12:01:44.770 INFO:teuthology.orchestra.run.smithi152.stdout:(38/149): ceph-test-18.0.0-2697.g2f5f6028.el8.x 14 MB/s | 47 MB 00:03 2023-11-28T12:01:46.861 INFO:teuthology.orchestra.run.smithi152.stdout:(39/149): flex-2.6.1-9.el8.x86_64.rpm 153 kB/s | 320 kB 00:02 2023-11-28T12:01:48.420 INFO:teuthology.orchestra.run.smithi152.stdout:(40/149): jq-1.6-8.el8.x86_64.rpm 130 kB/s | 203 kB 00:01 2023-11-28T12:01:48.823 INFO:teuthology.orchestra.run.smithi045.stdout:CentOS Stream 8 - BaseOS 20 MB/s | 55 MB 00:02 2023-11-28T12:01:48.828 INFO:teuthology.orchestra.run.smithi152.stdout:(41/149): bison-3.0.4-10.el8.x86_64.rpm 150 kB/s | 688 kB 00:04 2023-11-28T12:01:50.495 INFO:teuthology.orchestra.run.smithi152.stdout:(42/149): librdkafka-0.11.4-3.el8.x86_64.rpm 212 kB/s | 354 kB 00:01 2023-11-28T12:01:51.428 INFO:teuthology.orchestra.run.smithi152.stdout:(43/149): libpq-13.5-1.el8.x86_64.rpm 66 kB/s | 198 kB 00:03 2023-11-28T12:01:53.754 INFO:teuthology.orchestra.run.smithi152.stdout:(44/149): libtool-2.4.6-25.el8.x86_64.rpm 217 kB/s | 709 kB 00:03 2023-11-28T12:01:54.087 INFO:teuthology.orchestra.run.smithi152.stdout:(45/149): automake-1.16.1-8.el8.noarch.rpm 71 kB/s | 740 kB 00:10 2023-11-28T12:01:54.169 INFO:teuthology.orchestra.run.smithi152.stdout:(46/149): lttng-ust-2.8.1-11.el8.x86_64.rpm 95 kB/s | 259 kB 00:02 2023-11-28T12:01:54.654 INFO:teuthology.orchestra.run.smithi152.stdout:(47/149): oniguruma-6.8.2-2.el8.x86_64.rpm 208 kB/s | 187 kB 00:00 2023-11-28T12:01:57.905 INFO:teuthology.orchestra.run.smithi045.stdout:CentOS Stream 8 - Extras 62 kB/s | 18 kB 00:00 2023-11-28T12:01:58.264 INFO:teuthology.orchestra.run.smithi045.stdout:CentOS Stream 8 - Extras common packages 42 kB/s | 6.9 kB 00:00 2023-11-28T12:02:00.648 INFO:teuthology.orchestra.run.smithi045.stdout:CentOS Stream 8 - PowerTools 3.0 MB/s | 6.6 MB 00:02 2023-11-28T12:02:01.978 INFO:teuthology.orchestra.run.smithi152.stdout:(48/149): postgresql-10.23-2.module_el8+572+929 218 kB/s | 1.6 MB 00:07 2023-11-28T12:02:02.249 INFO:teuthology.orchestra.run.smithi045.stdout:Copr repo for python3-asyncssh owned by ceph 29 kB/s | 3.5 kB 00:00 2023-11-28T12:02:04.353 INFO:teuthology.orchestra.run.smithi045.stdout:Extra Packages for Enterprise Linux 8.3 MB/s | 16 MB 00:01 2023-11-28T12:02:08.678 INFO:teuthology.orchestra.run.smithi152.stdout:(49/149): postgresql-contrib-10.23-2.module_el8 135 kB/s | 901 kB 00:06 2023-11-28T12:02:09.234 INFO:teuthology.orchestra.run.smithi045.stdout:lab-extras 132 kB/s | 24 kB 00:00 2023-11-28T12:02:13.996 INFO:teuthology.orchestra.run.smithi045.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-11-28T12:02:13.997 INFO:teuthology.orchestra.run.smithi045.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-11-28T12:02:14.012 INFO:teuthology.orchestra.run.smithi045.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2023-11-28T12:02:14.012 INFO:teuthology.orchestra.run.smithi045.stdout:Package NetworkManager-initscripts-updown-1:1.40.16-4.el8.noarch is already installed. 2023-11-28T12:02:14.013 INFO:teuthology.orchestra.run.smithi045.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2023-11-28T12:02:14.014 INFO:teuthology.orchestra.run.smithi045.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2023-11-28T12:02:14.016 INFO:teuthology.orchestra.run.smithi045.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-11-28T12:02:14.018 INFO:teuthology.orchestra.run.smithi045.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-11-28T12:02:14.021 INFO:teuthology.orchestra.run.smithi045.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-11-28T12:02:14.022 INFO:teuthology.orchestra.run.smithi045.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-11-28T12:02:14.308 INFO:teuthology.orchestra.run.smithi045.stdout:Dependencies resolved. 2023-11-28T12:02:14.324 INFO:teuthology.orchestra.run.smithi045.stdout:==================================================================================================== 2023-11-28T12:02:14.324 INFO:teuthology.orchestra.run.smithi045.stdout: Package Arch Version Repository Size 2023-11-28T12:02:14.324 INFO:teuthology.orchestra.run.smithi045.stdout:==================================================================================================== 2023-11-28T12:02:14.324 INFO:teuthology.orchestra.run.smithi045.stdout:Installing: 2023-11-28T12:02:14.324 INFO:teuthology.orchestra.run.smithi045.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2023-11-28T12:02:14.325 INFO:teuthology.orchestra.run.smithi045.stdout: ceph x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 6.4 k 2023-11-28T12:02:14.325 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-base x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 5.4 M 2023-11-28T12:02:14.325 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-fuse x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 845 k 2023-11-28T12:02:14.325 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 165 k 2023-11-28T12:02:14.325 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 1.5 M 2023-11-28T12:02:14.325 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-cephadm noarch 2:18.0.0-2697.g2f5f6028.el8 ceph-noarch 123 k 2023-11-28T12:02:14.325 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-dashboard noarch 2:18.0.0-2697.g2f5f6028.el8 ceph-noarch 1.7 M 2023-11-28T12:02:14.325 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-2697.g2f5f6028.el8 ceph-noarch 7.4 M 2023-11-28T12:02:14.325 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-rook noarch 2:18.0.0-2697.g2f5f6028.el8 ceph-noarch 47 k 2023-11-28T12:02:14.325 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-radosgw x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 13 M 2023-11-28T12:02:14.325 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-test x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 47 M 2023-11-28T12:02:14.325 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-volume noarch 2:18.0.0-2697.g2f5f6028.el8 ceph-noarch 263 k 2023-11-28T12:02:14.326 INFO:teuthology.orchestra.run.smithi045.stdout: cephadm noarch 2:18.0.0-2697.g2f5f6028.el8 ceph-noarch 83 k 2023-11-28T12:02:14.326 INFO:teuthology.orchestra.run.smithi045.stdout: cephfs-mirror x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 257 k 2023-11-28T12:02:14.326 INFO:teuthology.orchestra.run.smithi045.stdout: cephfs-top noarch 2:18.0.0-2697.g2f5f6028.el8 ceph-noarch 18 k 2023-11-28T12:02:14.326 INFO:teuthology.orchestra.run.smithi045.stdout: elfutils-libelf-devel x86_64 0.190-1.el8 baseos 62 k 2023-11-28T12:02:14.326 INFO:teuthology.orchestra.run.smithi045.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2023-11-28T12:02:14.326 INFO:teuthology.orchestra.run.smithi045.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2023-11-28T12:02:14.326 INFO:teuthology.orchestra.run.smithi045.stdout: libcephfs-devel x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 30 k 2023-11-28T12:02:14.326 INFO:teuthology.orchestra.run.smithi045.stdout: libcephfs2 x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 767 k 2023-11-28T12:02:14.326 INFO:teuthology.orchestra.run.smithi045.stdout: librados-devel x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 139 k 2023-11-28T12:02:14.326 INFO:teuthology.orchestra.run.smithi045.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2023-11-28T12:02:14.326 INFO:teuthology.orchestra.run.smithi045.stdout: libuuid-devel x86_64 2.32.1-43.el8 baseos 100 k 2023-11-28T12:02:14.326 INFO:teuthology.orchestra.run.smithi045.stdout: openssl-devel x86_64 1:1.1.1k-11.el8 baseos 3.2 M 2023-11-28T12:02:14.327 INFO:teuthology.orchestra.run.smithi045.stdout: postgresql x86_64 10.23-2.module_el8+572+929c87ac appstream 1.6 M 2023-11-28T12:02:14.327 INFO:teuthology.orchestra.run.smithi045.stdout: postgresql-contrib x86_64 10.23-2.module_el8+572+929c87ac appstream 901 k 2023-11-28T12:02:14.327 INFO:teuthology.orchestra.run.smithi045.stdout: postgresql-server x86_64 10.23-2.module_el8+572+929c87ac appstream 5.1 M 2023-11-28T12:02:14.327 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cephfs x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 190 k 2023-11-28T12:02:14.327 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rados x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 371 k 2023-11-28T12:02:14.327 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rbd x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 364 k 2023-11-28T12:02:14.327 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rgw x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 107 k 2023-11-28T12:02:14.327 INFO:teuthology.orchestra.run.smithi045.stdout: rbd-fuse x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 94 k 2023-11-28T12:02:14.327 INFO:teuthology.orchestra.run.smithi045.stdout: rbd-mirror x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 3.4 M 2023-11-28T12:02:14.327 INFO:teuthology.orchestra.run.smithi045.stdout: rbd-nbd x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 180 k 2023-11-28T12:02:14.327 INFO:teuthology.orchestra.run.smithi045.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 baseos 74 k 2023-11-28T12:02:14.327 INFO:teuthology.orchestra.run.smithi045.stdout:Upgrading: 2023-11-28T12:02:14.328 INFO:teuthology.orchestra.run.smithi045.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-11.el8 baseos 144 k 2023-11-28T12:02:14.328 INFO:teuthology.orchestra.run.smithi045.stdout: acl x86_64 2.2.53-3.el8 baseos 83 k 2023-11-28T12:02:14.328 INFO:teuthology.orchestra.run.smithi045.stdout: elfutils-debuginfod-client x86_64 0.190-1.el8 baseos 77 k 2023-11-28T12:02:14.328 INFO:teuthology.orchestra.run.smithi045.stdout: elfutils-libelf x86_64 0.190-1.el8 baseos 232 k 2023-11-28T12:02:14.328 INFO:teuthology.orchestra.run.smithi045.stdout: elfutils-libs x86_64 0.190-1.el8 baseos 305 k 2023-11-28T12:02:14.328 INFO:teuthology.orchestra.run.smithi045.stdout: iproute x86_64 6.2.0-5.el8 baseos 854 k 2023-11-28T12:02:14.328 INFO:teuthology.orchestra.run.smithi045.stdout: libacl x86_64 2.2.53-3.el8 baseos 35 k 2023-11-28T12:02:14.328 INFO:teuthology.orchestra.run.smithi045.stdout: libacl-devel x86_64 2.2.53-3.el8 baseos 85 k 2023-11-28T12:02:14.328 INFO:teuthology.orchestra.run.smithi045.stdout: libblkid x86_64 2.32.1-43.el8 baseos 220 k 2023-11-28T12:02:14.328 INFO:teuthology.orchestra.run.smithi045.stdout: libfdisk x86_64 2.32.1-43.el8 baseos 254 k 2023-11-28T12:02:14.328 INFO:teuthology.orchestra.run.smithi045.stdout: libmount x86_64 2.32.1-43.el8 baseos 236 k 2023-11-28T12:02:14.328 INFO:teuthology.orchestra.run.smithi045.stdout: librados2 x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 3.7 M 2023-11-28T12:02:14.329 INFO:teuthology.orchestra.run.smithi045.stdout: librbd1 x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 3.6 M 2023-11-28T12:02:14.329 INFO:teuthology.orchestra.run.smithi045.stdout: libsmartcols x86_64 2.32.1-43.el8 baseos 179 k 2023-11-28T12:02:14.329 INFO:teuthology.orchestra.run.smithi045.stdout: libuuid x86_64 2.32.1-43.el8 baseos 99 k 2023-11-28T12:02:14.329 INFO:teuthology.orchestra.run.smithi045.stdout: openssl x86_64 1:1.1.1k-11.el8 baseos 737 k 2023-11-28T12:02:14.329 INFO:teuthology.orchestra.run.smithi045.stdout: openssl-libs x86_64 1:1.1.1k-11.el8 baseos 1.5 M 2023-11-28T12:02:14.329 INFO:teuthology.orchestra.run.smithi045.stdout: util-linux x86_64 2.32.1-43.el8 baseos 2.5 M 2023-11-28T12:02:14.329 INFO:teuthology.orchestra.run.smithi045.stdout: util-linux-user x86_64 2.32.1-43.el8 baseos 103 k 2023-11-28T12:02:14.329 INFO:teuthology.orchestra.run.smithi045.stdout: xfsdump x86_64 3.1.8-7.el8 baseos 334 k 2023-11-28T12:02:14.329 INFO:teuthology.orchestra.run.smithi045.stdout: xfsprogs x86_64 5.0.0-12.el8 baseos 1.1 M 2023-11-28T12:02:14.329 INFO:teuthology.orchestra.run.smithi045.stdout:Installing dependencies: 2023-11-28T12:02:14.329 INFO:teuthology.orchestra.run.smithi045.stdout: automake noarch 1.16.1-8.el8 appstream 740 k 2023-11-28T12:02:14.329 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-common x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 22 M 2023-11-28T12:02:14.330 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-grafana-dashboards noarch 2:18.0.0-2697.g2f5f6028.el8 ceph-noarch 23 k 2023-11-28T12:02:14.330 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mds x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 2.3 M 2023-11-28T12:02:14.330 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-modules-core noarch 2:18.0.0-2697.g2f5f6028.el8 ceph-noarch 236 k 2023-11-28T12:02:14.330 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mon x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 4.6 M 2023-11-28T12:02:14.330 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-osd x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 18 M 2023-11-28T12:02:14.330 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-prometheus-alerts noarch 2:18.0.0-2697.g2f5f6028.el8 ceph-noarch 15 k 2023-11-28T12:02:14.330 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-selinux x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 24 k 2023-11-28T12:02:14.330 INFO:teuthology.orchestra.run.smithi045.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-11-28T12:02:14.330 INFO:teuthology.orchestra.run.smithi045.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-11-28T12:02:14.330 INFO:teuthology.orchestra.run.smithi045.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2023-11-28T12:02:14.330 INFO:teuthology.orchestra.run.smithi045.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2023-11-28T12:02:14.330 INFO:teuthology.orchestra.run.smithi045.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2023-11-28T12:02:14.330 INFO:teuthology.orchestra.run.smithi045.stdout: libcephsqlite x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 137 k 2023-11-28T12:02:14.331 INFO:teuthology.orchestra.run.smithi045.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2023-11-28T12:02:14.331 INFO:teuthology.orchestra.run.smithi045.stdout: libgfortran x86_64 8.5.0-21.el8 baseos 645 k 2023-11-28T12:02:14.331 INFO:teuthology.orchestra.run.smithi045.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-11-28T12:02:14.331 INFO:teuthology.orchestra.run.smithi045.stdout: libpq x86_64 13.5-1.el8 appstream 198 k 2023-11-28T12:02:14.331 INFO:teuthology.orchestra.run.smithi045.stdout: libquadmath x86_64 8.5.0-21.el8 baseos 172 k 2023-11-28T12:02:14.331 INFO:teuthology.orchestra.run.smithi045.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-11-28T12:02:14.331 INFO:teuthology.orchestra.run.smithi045.stdout: libradosstriper1 x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 474 k 2023-11-28T12:02:14.331 INFO:teuthology.orchestra.run.smithi045.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-11-28T12:02:14.331 INFO:teuthology.orchestra.run.smithi045.stdout: librgw2 x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 6.5 M 2023-11-28T12:02:14.331 INFO:teuthology.orchestra.run.smithi045.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2023-11-28T12:02:14.331 INFO:teuthology.orchestra.run.smithi045.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2023-11-28T12:02:14.331 INFO:teuthology.orchestra.run.smithi045.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-11-28T12:02:14.332 INFO:teuthology.orchestra.run.smithi045.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2023-11-28T12:02:14.332 INFO:teuthology.orchestra.run.smithi045.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2023-11-28T12:02:14.332 INFO:teuthology.orchestra.run.smithi045.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-11-28T12:02:14.332 INFO:teuthology.orchestra.run.smithi045.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-11-28T12:02:14.332 INFO:teuthology.orchestra.run.smithi045.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-11-28T12:02:14.332 INFO:teuthology.orchestra.run.smithi045.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-11-28T12:02:14.332 INFO:teuthology.orchestra.run.smithi045.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2023-11-28T12:02:14.332 INFO:teuthology.orchestra.run.smithi045.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2023-11-28T12:02:14.332 INFO:teuthology.orchestra.run.smithi045.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2023-11-28T12:02:14.332 INFO:teuthology.orchestra.run.smithi045.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-11-28T12:02:14.332 INFO:teuthology.orchestra.run.smithi045.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-11-28T12:02:14.332 INFO:teuthology.orchestra.run.smithi045.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-11-28T12:02:14.333 INFO:teuthology.orchestra.run.smithi045.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-11-28T12:02:14.333 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-11-28T12:02:14.333 INFO:teuthology.orchestra.run.smithi045.stdout: python3-ceph-argparse x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 45 k 2023-11-28T12:02:14.333 INFO:teuthology.orchestra.run.smithi045.stdout: python3-ceph-common x86_64 2:18.0.0-2697.g2f5f6028.el8 ceph 117 k 2023-11-28T12:02:14.333 INFO:teuthology.orchestra.run.smithi045.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-11-28T12:02:14.333 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-11-28T12:02:14.333 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-11-28T12:02:14.333 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-11-28T12:02:14.333 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-11-28T12:02:14.333 INFO:teuthology.orchestra.run.smithi045.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-11-28T12:02:14.333 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-11-28T12:02:14.333 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-11-28T12:02:14.334 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-11-28T12:02:14.334 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-11-28T12:02:14.334 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-11-28T12:02:14.334 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-11-28T12:02:14.334 INFO:teuthology.orchestra.run.smithi045.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-11-28T12:02:14.334 INFO:teuthology.orchestra.run.smithi045.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-11-28T12:02:14.334 INFO:teuthology.orchestra.run.smithi045.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-11-28T12:02:14.334 INFO:teuthology.orchestra.run.smithi045.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-11-28T12:02:14.334 INFO:teuthology.orchestra.run.smithi045.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-11-28T12:02:14.334 INFO:teuthology.orchestra.run.smithi045.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-11-28T12:02:14.335 INFO:teuthology.orchestra.run.smithi045.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-11-28T12:02:14.335 INFO:teuthology.orchestra.run.smithi045.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-11-28T12:02:14.335 INFO:teuthology.orchestra.run.smithi045.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-11-28T12:02:14.335 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-11-28T12:02:14.335 INFO:teuthology.orchestra.run.smithi045.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-11-28T12:02:14.335 INFO:teuthology.orchestra.run.smithi045.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-11-28T12:02:14.335 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-11-28T12:02:14.335 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-11-28T12:02:14.335 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-11-28T12:02:14.335 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-11-28T12:02:14.335 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2023-11-28T12:02:14.335 INFO:teuthology.orchestra.run.smithi045.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-11-28T12:02:14.335 INFO:teuthology.orchestra.run.smithi045.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-11-28T12:02:14.336 INFO:teuthology.orchestra.run.smithi045.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-11-28T12:02:14.336 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-11-28T12:02:14.336 INFO:teuthology.orchestra.run.smithi045.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-11-28T12:02:14.336 INFO:teuthology.orchestra.run.smithi045.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-11-28T12:02:14.336 INFO:teuthology.orchestra.run.smithi045.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-11-28T12:02:14.336 INFO:teuthology.orchestra.run.smithi045.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-11-28T12:02:14.336 INFO:teuthology.orchestra.run.smithi045.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-11-28T12:02:14.336 INFO:teuthology.orchestra.run.smithi045.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-11-28T12:02:14.336 INFO:teuthology.orchestra.run.smithi045.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-11-28T12:02:14.336 INFO:teuthology.orchestra.run.smithi045.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-11-28T12:02:14.336 INFO:teuthology.orchestra.run.smithi045.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-11-28T12:02:14.336 INFO:teuthology.orchestra.run.smithi045.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-11-28T12:02:14.337 INFO:teuthology.orchestra.run.smithi045.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-11-28T12:02:14.337 INFO:teuthology.orchestra.run.smithi045.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-11-28T12:02:14.337 INFO:teuthology.orchestra.run.smithi045.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-11-28T12:02:14.337 INFO:teuthology.orchestra.run.smithi045.stdout: uuid x86_64 1.6.2-43.el8 appstream 64 k 2023-11-28T12:02:14.337 INFO:teuthology.orchestra.run.smithi045.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-11-28T12:02:14.337 INFO:teuthology.orchestra.run.smithi045.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2023-11-28T12:02:14.337 INFO:teuthology.orchestra.run.smithi045.stdout:Enabling module streams: 2023-11-28T12:02:14.337 INFO:teuthology.orchestra.run.smithi045.stdout: postgresql 10 2023-11-28T12:02:14.337 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:02:14.337 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction Summary 2023-11-28T12:02:14.337 INFO:teuthology.orchestra.run.smithi045.stdout:==================================================================================================== 2023-11-28T12:02:14.337 INFO:teuthology.orchestra.run.smithi045.stdout:Install 128 Packages 2023-11-28T12:02:14.337 INFO:teuthology.orchestra.run.smithi045.stdout:Upgrade 21 Packages 2023-11-28T12:02:14.338 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:02:14.338 INFO:teuthology.orchestra.run.smithi045.stdout:Total download size: 212 M 2023-11-28T12:02:14.338 INFO:teuthology.orchestra.run.smithi045.stdout:Downloading Packages: 2023-11-28T12:02:14.743 INFO:teuthology.orchestra.run.smithi045.stdout:(1/149): ceph-18.0.0-2697.g2f5f6028.el8.x86_64. 48 kB/s | 6.4 kB 00:00 2023-11-28T12:02:14.977 INFO:teuthology.orchestra.run.smithi045.stdout:(2/149): ceph-fuse-18.0.0-2697.g2f5f6028.el8.x8 3.5 MB/s | 845 kB 00:00 2023-11-28T12:02:15.052 INFO:teuthology.orchestra.run.smithi045.stdout:(3/149): ceph-immutable-object-cache-18.0.0-269 2.2 MB/s | 165 kB 00:00 2023-11-28T12:02:15.319 INFO:teuthology.orchestra.run.smithi045.stdout:(4/149): ceph-mds-18.0.0-2697.g2f5f6028.el8.x86 8.5 MB/s | 2.3 MB 00:00 2023-11-28T12:02:15.578 INFO:teuthology.orchestra.run.smithi045.stdout:(5/149): ceph-mgr-18.0.0-2697.g2f5f6028.el8.x86 6.0 MB/s | 1.5 MB 00:00 2023-11-28T12:02:16.186 INFO:teuthology.orchestra.run.smithi045.stdout:(6/149): ceph-common-18.0.0-2697.g2f5f6028.el8. 14 MB/s | 22 MB 00:01 2023-11-28T12:02:16.270 INFO:teuthology.orchestra.run.smithi045.stdout:(7/149): ceph-mon-18.0.0-2697.g2f5f6028.el8.x86 6.6 MB/s | 4.6 MB 00:00 2023-11-28T12:02:17.429 INFO:teuthology.orchestra.run.smithi045.stdout:(8/149): ceph-osd-18.0.0-2697.g2f5f6028.el8.x86 14 MB/s | 18 MB 00:01 2023-11-28T12:02:17.470 INFO:teuthology.orchestra.run.smithi045.stdout:(9/149): ceph-selinux-18.0.0-2697.g2f5f6028.el8 587 kB/s | 24 kB 00:00 2023-11-28T12:02:17.613 INFO:teuthology.orchestra.run.smithi045.stdout:(10/149): ceph-radosgw-18.0.0-2697.g2f5f6028.el 9.7 MB/s | 13 MB 00:01 2023-11-28T12:02:17.705 INFO:teuthology.orchestra.run.smithi045.stdout:(11/149): ceph-base-18.0.0-2697.g2f5f6028.el8.x 1.7 MB/s | 5.4 MB 00:03 2023-11-28T12:02:17.730 INFO:teuthology.orchestra.run.smithi045.stdout:(12/149): cephfs-mirror-18.0.0-2697.g2f5f6028.e 2.1 MB/s | 257 kB 00:00 2023-11-28T12:02:17.763 INFO:teuthology.orchestra.run.smithi045.stdout:(13/149): libcephfs-devel-18.0.0-2697.g2f5f6028 523 kB/s | 30 kB 00:00 2023-11-28T12:02:17.806 INFO:teuthology.orchestra.run.smithi045.stdout:(14/149): libcephfs2-18.0.0-2697.g2f5f6028.el8. 10 MB/s | 767 kB 00:00 2023-11-28T12:02:17.864 INFO:teuthology.orchestra.run.smithi045.stdout:(15/149): libcephsqlite-18.0.0-2697.g2f5f6028.e 1.3 MB/s | 137 kB 00:00 2023-11-28T12:02:17.881 INFO:teuthology.orchestra.run.smithi045.stdout:(16/149): librados-devel-18.0.0-2697.g2f5f6028. 1.8 MB/s | 139 kB 00:00 2023-11-28T12:02:18.040 INFO:teuthology.orchestra.run.smithi045.stdout:(17/149): libradosstriper1-18.0.0-2697.g2f5f602 2.6 MB/s | 474 kB 00:00 2023-11-28T12:02:18.173 INFO:teuthology.orchestra.run.smithi045.stdout:(18/149): python3-ceph-argparse-18.0.0-2697.g2f 334 kB/s | 45 kB 00:00 2023-11-28T12:02:18.266 INFO:teuthology.orchestra.run.smithi045.stdout:(19/149): python3-ceph-common-18.0.0-2697.g2f5f 1.3 MB/s | 117 kB 00:00 2023-11-28T12:02:18.366 INFO:teuthology.orchestra.run.smithi045.stdout:(20/149): python3-cephfs-18.0.0-2697.g2f5f6028. 1.9 MB/s | 190 kB 00:00 2023-11-28T12:02:18.533 INFO:teuthology.orchestra.run.smithi045.stdout:(21/149): python3-rados-18.0.0-2697.g2f5f6028.e 2.2 MB/s | 371 kB 00:00 2023-11-28T12:02:18.617 INFO:teuthology.orchestra.run.smithi045.stdout:(22/149): librgw2-18.0.0-2697.g2f5f6028.el8.x86 8.8 MB/s | 6.5 MB 00:00 2023-11-28T12:02:18.668 INFO:teuthology.orchestra.run.smithi045.stdout:(23/149): python3-rgw-18.0.0-2697.g2f5f6028.el8 2.1 MB/s | 107 kB 00:00 2023-11-28T12:02:18.692 INFO:teuthology.orchestra.run.smithi045.stdout:(24/149): python3-rbd-18.0.0-2697.g2f5f6028.el8 2.2 MB/s | 364 kB 00:00 2023-11-28T12:02:18.717 INFO:teuthology.orchestra.run.smithi045.stdout:(25/149): rbd-fuse-18.0.0-2697.g2f5f6028.el8.x8 1.8 MB/s | 94 kB 00:00 2023-11-28T12:02:18.793 INFO:teuthology.orchestra.run.smithi045.stdout:(26/149): rbd-nbd-18.0.0-2697.g2f5f6028.el8.x86 2.3 MB/s | 180 kB 00:00 2023-11-28T12:02:18.860 INFO:teuthology.orchestra.run.smithi045.stdout:(27/149): ceph-grafana-dashboards-18.0.0-2697.g 347 kB/s | 23 kB 00:00 2023-11-28T12:02:18.935 INFO:teuthology.orchestra.run.smithi045.stdout:(28/149): ceph-mgr-cephadm-18.0.0-2697.g2f5f602 1.6 MB/s | 123 kB 00:00 2023-11-28T12:02:19.177 INFO:teuthology.orchestra.run.smithi045.stdout:(29/149): ceph-mgr-dashboard-18.0.0-2697.g2f5f6 7.2 MB/s | 1.7 MB 00:00 2023-11-28T12:02:19.327 INFO:teuthology.orchestra.run.smithi045.stdout:(30/149): rbd-mirror-18.0.0-2697.g2f5f6028.el8. 5.4 MB/s | 3.4 MB 00:00 2023-11-28T12:02:19.444 INFO:teuthology.orchestra.run.smithi045.stdout:(31/149): ceph-mgr-modules-core-18.0.0-2697.g2f 2.0 MB/s | 236 kB 00:00 2023-11-28T12:02:19.545 INFO:teuthology.orchestra.run.smithi045.stdout:(32/149): ceph-mgr-rook-18.0.0-2697.g2f5f6028.e 474 kB/s | 47 kB 00:00 2023-11-28T12:02:19.636 INFO:teuthology.orchestra.run.smithi045.stdout:(33/149): ceph-prometheus-alerts-18.0.0-2697.g2 159 kB/s | 15 kB 00:00 2023-11-28T12:02:19.745 INFO:teuthology.orchestra.run.smithi045.stdout:(34/149): ceph-volume-18.0.0-2697.g2f5f6028.el8 2.4 MB/s | 263 kB 00:00 2023-11-28T12:02:19.846 INFO:teuthology.orchestra.run.smithi045.stdout:(35/149): cephadm-18.0.0-2697.g2f5f6028.el8.noa 826 kB/s | 83 kB 00:00 2023-11-28T12:02:19.938 INFO:teuthology.orchestra.run.smithi045.stdout:(36/149): cephfs-top-18.0.0-2697.g2f5f6028.el8. 197 kB/s | 18 kB 00:00 2023-11-28T12:02:20.047 INFO:teuthology.orchestra.run.smithi045.stdout:(37/149): ceph-mgr-diskprediction-local-18.0.0- 8.5 MB/s | 7.4 MB 00:00 2023-11-28T12:02:20.472 INFO:teuthology.orchestra.run.smithi045.stdout:(38/149): ceph-test-18.0.0-2697.g2f5f6028.el8.x 16 MB/s | 47 MB 00:03 2023-11-28T12:02:22.598 INFO:teuthology.orchestra.run.smithi045.stdout:(39/149): flex-2.6.1-9.el8.x86_64.rpm 150 kB/s | 320 kB 00:02 2023-11-28T12:02:24.397 INFO:teuthology.orchestra.run.smithi045.stdout:(40/149): bison-3.0.4-10.el8.x86_64.rpm 158 kB/s | 688 kB 00:04 2023-11-28T12:02:24.756 INFO:teuthology.orchestra.run.smithi045.stdout:(41/149): automake-1.16.1-8.el8.noarch.rpm 154 kB/s | 740 kB 00:04 2023-11-28T12:02:24.831 INFO:teuthology.orchestra.run.smithi045.stdout:(42/149): jq-1.6-8.el8.x86_64.rpm 91 kB/s | 203 kB 00:02 2023-11-28T12:02:25.673 INFO:teuthology.orchestra.run.smithi045.stdout:(43/149): libpq-13.5-1.el8.x86_64.rpm 155 kB/s | 198 kB 00:01 2023-11-28T12:02:27.056 INFO:teuthology.orchestra.run.smithi045.stdout:(44/149): librdkafka-0.11.4-3.el8.x86_64.rpm 154 kB/s | 354 kB 00:02 2023-11-28T12:02:27.531 INFO:teuthology.orchestra.run.smithi045.stdout:(45/149): lttng-ust-2.8.1-11.el8.x86_64.rpm 140 kB/s | 259 kB 00:01 2023-11-28T12:02:28.483 INFO:teuthology.orchestra.run.smithi045.stdout:(46/149): oniguruma-6.8.2-2.el8.x86_64.rpm 131 kB/s | 187 kB 00:01 2023-11-28T12:02:31.157 INFO:teuthology.orchestra.run.smithi045.stdout:(47/149): libtool-2.4.6-25.el8.x86_64.rpm 112 kB/s | 709 kB 00:06 2023-11-28T12:02:32.043 INFO:teuthology.orchestra.run.smithi152.stdout:(50/149): openblas-threads-0.3.15-4.el8.x86_64. 131 kB/s | 4.9 MB 00:37 2023-11-28T12:02:38.550 INFO:teuthology.orchestra.run.smithi152.stdout:(51/149): postgresql-server-10.23-2.module_el8+ 175 kB/s | 5.1 MB 00:29 2023-11-28T12:02:43.125 INFO:teuthology.orchestra.run.smithi152.stdout:(52/149): python3-jinja2-2.10.1-3.el8.noarch.rp 118 kB/s | 538 kB 00:04 2023-11-28T12:02:43.208 INFO:teuthology.orchestra.run.smithi152.stdout:[MIRROR] python3-jsonpatch-1.21-2.el8.noarch.rpm: Status code: 500 for http://mirrors.xmission.com/centos/8-stream/AppStream/x86_64/os/Packages/python3-jsonpatch-1.21-2.el8.noarch.rpm (IP: 198.60.22.13) 2023-11-28T12:02:43.342 INFO:teuthology.orchestra.run.smithi152.stdout:(53/149): python3-jsonpatch-1.21-2.el8.noarch.r 123 kB/s | 27 kB 00:00 2023-11-28T12:02:43.364 INFO:teuthology.orchestra.run.smithi045.stdout:(48/149): postgresql-10.23-2.module_el8+572+929 131 kB/s | 1.6 MB 00:12 2023-11-28T12:02:43.400 INFO:teuthology.orchestra.run.smithi152.stdout:(54/149): python3-jsonpointer-1.10-11.el8.noarc 341 kB/s | 20 kB 00:00 2023-11-28T12:02:43.534 INFO:teuthology.orchestra.run.smithi152.stdout:(55/149): python3-mako-1.0.6-14.el8.noarch.rpm 1.2 MB/s | 157 kB 00:00 2023-11-28T12:02:43.592 INFO:teuthology.orchestra.run.smithi152.stdout:(56/149): python3-markupsafe-0.23-19.el8.x86_64 666 kB/s | 39 kB 00:00 2023-11-28T12:02:43.826 INFO:teuthology.orchestra.run.smithi152.stdout:(57/149): python3-numpy-1.14.3-10.el8.x86_64.rp 16 MB/s | 3.7 MB 00:00 2023-11-28T12:02:43.885 INFO:teuthology.orchestra.run.smithi152.stdout:(58/149): python3-numpy-f2py-1.14.3-10.el8.x86_ 3.8 MB/s | 225 kB 00:00 2023-11-28T12:02:43.935 INFO:teuthology.orchestra.run.smithi152.stdout:(59/149): python3-prettytable-0.7.2-14.el8.noar 882 kB/s | 44 kB 00:00 2023-11-28T12:02:43.994 INFO:teuthology.orchestra.run.smithi152.stdout:(60/149): python3-pyOpenSSL-19.0.0-1.el8.noarch 1.7 MB/s | 103 kB 00:00 2023-11-28T12:02:44.052 INFO:teuthology.orchestra.run.smithi152.stdout:(61/149): python3-pyasn1-0.3.7-6.el8.noarch.rpm 2.1 MB/s | 126 kB 00:00 2023-11-28T12:02:44.111 INFO:teuthology.orchestra.run.smithi152.stdout:(62/149): python3-pyasn1-modules-0.3.7-6.el8.no 1.8 MB/s | 110 kB 00:00 2023-11-28T12:02:44.161 INFO:teuthology.orchestra.run.smithi152.stdout:(63/149): python3-pytz-2017.2-11.el8.noarch.rpm 1.1 MB/s | 57 kB 00:00 2023-11-28T12:02:44.470 INFO:teuthology.orchestra.run.smithi152.stdout:(64/149): python3-scipy-1.0.0-21.module_el8.5.0 44 MB/s | 14 MB 00:00 2023-11-28T12:02:44.537 INFO:teuthology.orchestra.run.smithi152.stdout:(65/149): python3-werkzeug-0.12.2-4.el8.noarch. 6.7 MB/s | 457 kB 00:00 2023-11-28T12:02:44.595 INFO:teuthology.orchestra.run.smithi152.stdout:(66/149): socat-1.7.4.1-1.el8.x86_64.rpm 5.4 MB/s | 323 kB 00:00 2023-11-28T12:02:44.654 INFO:teuthology.orchestra.run.smithi152.stdout:(67/149): uuid-1.6.2-43.el8.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2023-11-28T12:02:44.713 INFO:teuthology.orchestra.run.smithi152.stdout:(68/149): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.2 MB/s | 71 kB 00:00 2023-11-28T12:02:45.082 INFO:teuthology.orchestra.run.smithi152.stdout:(69/149): elfutils-libelf-devel-0.190-1.el8.x86 169 kB/s | 62 kB 00:00 2023-11-28T12:02:45.263 INFO:teuthology.orchestra.run.smithi152.stdout:(70/149): fuse-2.9.7-17.el8.x86_64.rpm 454 kB/s | 83 kB 00:00 2023-11-28T12:02:45.380 INFO:teuthology.orchestra.run.smithi152.stdout:(71/149): keyutils-libs-devel-1.5.10-9.el8.x86_ 412 kB/s | 48 kB 00:00 2023-11-28T12:02:45.664 INFO:teuthology.orchestra.run.smithi152.stdout:(72/149): krb5-devel-1.18.2-22.el8.x86_64.rpm 1.9 MB/s | 561 kB 00:00 2023-11-28T12:02:45.764 INFO:teuthology.orchestra.run.smithi152.stdout:(73/149): libaio-devel-0.3.112-1.el8.x86_64.rpm 187 kB/s | 19 kB 00:00 2023-11-28T12:02:45.873 INFO:teuthology.orchestra.run.smithi152.stdout:(74/149): libcom_err-devel-1.45.6-5.el8.x86_64. 358 kB/s | 39 kB 00:00 2023-11-28T12:02:46.032 INFO:teuthology.orchestra.run.smithi152.stdout:(75/149): libgfortran-8.5.0-21.el8.x86_64.rpm 4.0 MB/s | 645 kB 00:00 2023-11-28T12:02:46.141 INFO:teuthology.orchestra.run.smithi152.stdout:(76/149): libquadmath-8.5.0-21.el8.x86_64.rpm 1.6 MB/s | 172 kB 00:00 2023-11-28T12:02:46.248 INFO:teuthology.orchestra.run.smithi152.stdout:(77/149): librabbitmq-0.9.0-4.el8.x86_64.rpm 434 kB/s | 47 kB 00:00 2023-11-28T12:02:46.365 INFO:teuthology.orchestra.run.smithi152.stdout:(78/149): libselinux-devel-2.9-8.el8.x86_64.rpm 1.7 MB/s | 200 kB 00:00 2023-11-28T12:02:46.482 INFO:teuthology.orchestra.run.smithi152.stdout:(79/149): libsepol-devel-2.9-3.el8.x86_64.rpm 747 kB/s | 87 kB 00:00 2023-11-28T12:02:46.591 INFO:teuthology.orchestra.run.smithi152.stdout:(80/149): libuuid-devel-2.32.1-43.el8.x86_64.rp 923 kB/s | 100 kB 00:00 2023-11-28T12:02:46.701 INFO:teuthology.orchestra.run.smithi152.stdout:(81/149): libverto-devel-0.3.2-2.el8.x86_64.rpm 166 kB/s | 18 kB 00:00 2023-11-28T12:02:46.808 INFO:teuthology.orchestra.run.smithi152.stdout:(82/149): libzstd-devel-1.4.4-1.el8.x86_64.rpm 405 kB/s | 44 kB 00:00 2023-11-28T12:02:47.167 INFO:teuthology.orchestra.run.smithi152.stdout:(83/149): openssl-devel-1.1.1k-11.el8.x86_64.rp 8.9 MB/s | 3.2 MB 00:00 2023-11-28T12:02:47.292 INFO:teuthology.orchestra.run.smithi152.stdout:(84/149): pcre2-devel-10.32-3.el8.x86_64.rpm 4.7 MB/s | 605 kB 00:00 2023-11-28T12:02:47.409 INFO:teuthology.orchestra.run.smithi152.stdout:(85/149): pcre2-utf16-10.32-3.el8.x86_64.rpm 1.9 MB/s | 229 kB 00:00 2023-11-28T12:02:47.518 INFO:teuthology.orchestra.run.smithi152.stdout:(86/149): pcre2-utf32-10.32-3.el8.x86_64.rpm 2.0 MB/s | 220 kB 00:00 2023-11-28T12:02:47.628 INFO:teuthology.orchestra.run.smithi152.stdout:(87/149): python3-cffi-1.11.5-6.el8.x86_64.rpm 2.2 MB/s | 249 kB 00:00 2023-11-28T12:02:47.753 INFO:teuthology.orchestra.run.smithi152.stdout:(88/149): python3-cryptography-3.2.1-6.el8.x86_ 5.0 MB/s | 641 kB 00:00 2023-11-28T12:02:47.852 INFO:teuthology.orchestra.run.smithi152.stdout:(89/149): python3-jwt-1.6.1-2.el8.noarch.rpm 428 kB/s | 43 kB 00:00 2023-11-28T12:02:47.952 INFO:teuthology.orchestra.run.smithi152.stdout:(90/149): python3-oauthlib-2.1.0-1.el8.noarch.r 1.5 MB/s | 155 kB 00:00 2023-11-28T12:02:48.061 INFO:teuthology.orchestra.run.smithi152.stdout:(91/149): python3-pycparser-2.14-14.el8.noarch. 1.0 MB/s | 109 kB 00:00 2023-11-28T12:02:48.161 INFO:teuthology.orchestra.run.smithi152.stdout:(92/149): python3-requests-oauthlib-1.0.0-1.el8 427 kB/s | 43 kB 00:00 2023-11-28T12:02:48.262 INFO:teuthology.orchestra.run.smithi152.stdout:(93/149): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 746 kB/s | 74 kB 00:00 2023-11-28T12:02:48.362 INFO:teuthology.orchestra.run.smithi152.stdout:(94/149): zlib-devel-1.2.11-21.el8.x86_64.rpm 582 kB/s | 58 kB 00:00 2023-11-28T12:02:48.962 INFO:teuthology.orchestra.run.smithi152.stdout:(95/149): gperftools-libs-2.7-9.el8.x86_64.rpm 510 kB/s | 306 kB 00:00 2023-11-28T12:02:49.104 INFO:teuthology.orchestra.run.smithi152.stdout:(96/149): liboath-2.6.2-3.el8.x86_64.rpm 417 kB/s | 59 kB 00:00 2023-11-28T12:02:49.221 INFO:teuthology.orchestra.run.smithi152.stdout:(97/149): libunwind-1.3.1-3.el8.x86_64.rpm 645 kB/s | 75 kB 00:00 2023-11-28T12:02:49.413 INFO:teuthology.orchestra.run.smithi152.stdout:(98/149): python3-asyncssh-2.7.0-2.el8.noarch.r 2.4 MB/s | 476 kB 00:00 2023-11-28T12:02:49.521 INFO:teuthology.orchestra.run.smithi152.stdout:(99/149): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 403 kB/s | 44 kB 00:00 2023-11-28T12:02:49.639 INFO:teuthology.orchestra.run.smithi152.stdout:(100/149): python3-beautifulsoup4-4.6.3-2.el8.1 1.6 MB/s | 185 kB 00:00 2023-11-28T12:02:49.739 INFO:teuthology.orchestra.run.smithi152.stdout:(101/149): python3-cachetools-3.1.1-4.el8.noarc 331 kB/s | 33 kB 00:00 2023-11-28T12:02:49.839 INFO:teuthology.orchestra.run.smithi152.stdout:(102/149): python3-certifi-2018.10.15-7.el8.noa 163 kB/s | 16 kB 00:00 2023-11-28T12:02:49.956 INFO:teuthology.orchestra.run.smithi152.stdout:(103/149): python3-cheroot-8.5.2-1.el8.noarch.r 1.4 MB/s | 173 kB 00:00 2023-11-28T12:02:50.090 INFO:teuthology.orchestra.run.smithi152.stdout:(104/149): python3-cherrypy-18.4.0-1.el8.noarch 2.8 MB/s | 384 kB 00:00 2023-11-28T12:02:50.198 INFO:teuthology.orchestra.run.smithi152.stdout:(105/149): python3-google-auth-1.1.1-10.el8.noa 764 kB/s | 81 kB 00:00 2023-11-28T12:02:50.299 INFO:teuthology.orchestra.run.smithi152.stdout:(106/149): python3-jaraco-6.2-6.el8.noarch.rpm 111 kB/s | 11 kB 00:00 2023-11-28T12:02:50.399 INFO:teuthology.orchestra.run.smithi152.stdout:(107/149): python3-jaraco-functools-2.0-4.el8.n 176 kB/s | 18 kB 00:00 2023-11-28T12:02:50.514 INFO:teuthology.orchestra.run.smithi045.stdout:(49/149): postgresql-contrib-10.23-2.module_el8 126 kB/s | 901 kB 00:07 2023-11-28T12:02:50.591 INFO:teuthology.orchestra.run.smithi152.stdout:(108/149): python3-kubernetes-11.0.0-6.el8.noar 6.1 MB/s | 1.2 MB 00:00 2023-11-28T12:02:50.783 INFO:teuthology.orchestra.run.smithi152.stdout:(109/149): python3-logutils-0.3.5-11.el8.noarch 254 kB/s | 49 kB 00:00 2023-11-28T12:02:50.892 INFO:teuthology.orchestra.run.smithi152.stdout:(110/149): python3-more-itertools-7.2.0-3.el8.n 543 kB/s | 59 kB 00:00 2023-11-28T12:02:51.000 INFO:teuthology.orchestra.run.smithi152.stdout:(111/149): python3-natsort-7.1.1-2.el8.noarch.r 557 kB/s | 60 kB 00:00 2023-11-28T12:02:51.117 INFO:teuthology.orchestra.run.smithi152.stdout:(112/149): python3-pecan-1.3.2-9.el8.noarch.rpm 2.4 MB/s | 283 kB 00:00 2023-11-28T12:02:51.226 INFO:teuthology.orchestra.run.smithi152.stdout:(113/149): python3-portend-2.6-1.el8.noarch.rpm 144 kB/s | 16 kB 00:00 2023-11-28T12:02:51.360 INFO:teuthology.orchestra.run.smithi152.stdout:(114/149): python3-repoze-lru-0.7-6.el8.noarch. 252 kB/s | 34 kB 00:00 2023-11-28T12:02:51.493 INFO:teuthology.orchestra.run.smithi152.stdout:(115/149): python3-routes-2.4.1-12.el8.noarch.r 1.4 MB/s | 196 kB 00:00 2023-11-28T12:02:51.593 INFO:teuthology.orchestra.run.smithi152.stdout:(116/149): python3-rsa-4.9-2.el8.noarch.rpm 643 kB/s | 64 kB 00:00 2023-11-28T12:02:51.694 INFO:teuthology.orchestra.run.smithi152.stdout:(117/149): python3-simplegeneric-0.8.1-17.el8.n 188 kB/s | 19 kB 00:00 2023-11-28T12:02:51.794 INFO:teuthology.orchestra.run.smithi152.stdout:(118/149): python3-singledispatch-3.4.0.3-18.el 239 kB/s | 24 kB 00:00 2023-11-28T12:02:51.894 INFO:teuthology.orchestra.run.smithi152.stdout:(119/149): python3-tempora-1.14.1-5.el8.noarch. 292 kB/s | 29 kB 00:00 2023-11-28T12:02:51.994 INFO:teuthology.orchestra.run.smithi152.stdout:(120/149): python3-trustme-0.6.0-4.el8.noarch.r 276 kB/s | 27 kB 00:00 2023-11-28T12:02:52.112 INFO:teuthology.orchestra.run.smithi152.stdout:(121/149): python3-waitress-1.4.3-1.el8.noarch. 2.1 MB/s | 255 kB 00:00 2023-11-28T12:02:52.228 INFO:teuthology.orchestra.run.smithi152.stdout:(122/149): python3-webob-1.8.5-1.el8.1.noarch.r 2.1 MB/s | 251 kB 00:00 2023-11-28T12:02:52.345 INFO:teuthology.orchestra.run.smithi152.stdout:(123/149): python3-websocket-client-0.56.0-5.el 526 kB/s | 61 kB 00:00 2023-11-28T12:02:52.446 INFO:teuthology.orchestra.run.smithi152.stdout:(124/149): python3-webtest-2.0.33-1.el8.noarch. 855 kB/s | 85 kB 00:00 2023-11-28T12:02:52.538 INFO:teuthology.orchestra.run.smithi152.stdout:(125/149): python3-zc-lockfile-2.0-2.el8.noarch 250 kB/s | 23 kB 00:00 2023-11-28T12:02:52.739 INFO:teuthology.orchestra.run.smithi152.stdout:(126/149): thrift-0.13.0-2.el8.x86_64.rpm 8.7 MB/s | 1.7 MB 00:00 2023-11-28T12:02:53.347 INFO:teuthology.orchestra.run.smithi152.stdout:(127/149): librados2-18.0.0-2697.g2f5f6028.el8. 6.0 MB/s | 3.7 MB 00:00 2023-11-28T12:02:53.589 INFO:teuthology.orchestra.run.smithi152.stdout:(128/149): librbd1-18.0.0-2697.g2f5f6028.el8.x8 15 MB/s | 3.6 MB 00:00 2023-11-28T12:02:53.689 INFO:teuthology.orchestra.run.smithi152.stdout:(129/149): NetworkManager-initscripts-updown-1. 1.4 MB/s | 144 kB 00:00 2023-11-28T12:02:53.789 INFO:teuthology.orchestra.run.smithi152.stdout:(130/149): acl-2.2.53-3.el8.x86_64.rpm 826 kB/s | 83 kB 00:00 2023-11-28T12:02:53.881 INFO:teuthology.orchestra.run.smithi152.stdout:(131/149): elfutils-debuginfod-client-0.190-1.e 838 kB/s | 77 kB 00:00 2023-11-28T12:02:53.990 INFO:teuthology.orchestra.run.smithi152.stdout:(132/149): elfutils-libelf-0.190-1.el8.x86_64.r 2.1 MB/s | 232 kB 00:00 2023-11-28T12:02:54.109 INFO:teuthology.orchestra.run.smithi152.stdout:(133/149): elfutils-libs-0.190-1.el8.x86_64.rpm 2.6 MB/s | 305 kB 00:00 2023-11-28T12:02:54.232 INFO:teuthology.orchestra.run.smithi152.stdout:(134/149): iproute-6.2.0-5.el8.x86_64.rpm 6.7 MB/s | 854 kB 00:00 2023-11-28T12:02:54.332 INFO:teuthology.orchestra.run.smithi152.stdout:(135/149): libacl-2.2.53-3.el8.x86_64.rpm 348 kB/s | 35 kB 00:00 2023-11-28T12:02:54.441 INFO:teuthology.orchestra.run.smithi152.stdout:(136/149): libacl-devel-2.2.53-3.el8.x86_64.rpm 784 kB/s | 85 kB 00:00 2023-11-28T12:02:54.549 INFO:teuthology.orchestra.run.smithi152.stdout:(137/149): libblkid-2.32.1-43.el8.x86_64.rpm 2.0 MB/s | 220 kB 00:00 2023-11-28T12:02:54.658 INFO:teuthology.orchestra.run.smithi152.stdout:(138/149): libfdisk-2.32.1-43.el8.x86_64.rpm 2.3 MB/s | 254 kB 00:00 2023-11-28T12:02:54.767 INFO:teuthology.orchestra.run.smithi152.stdout:(139/149): libmount-2.32.1-43.el8.x86_64.rpm 2.1 MB/s | 236 kB 00:00 2023-11-28T12:02:54.876 INFO:teuthology.orchestra.run.smithi152.stdout:(140/149): libsmartcols-2.32.1-43.el8.x86_64.rp 1.6 MB/s | 179 kB 00:00 2023-11-28T12:02:54.976 INFO:teuthology.orchestra.run.smithi152.stdout:(141/149): libuuid-2.32.1-43.el8.x86_64.rpm 993 kB/s | 99 kB 00:00 2023-11-28T12:02:55.093 INFO:teuthology.orchestra.run.smithi152.stdout:(142/149): openssl-1.1.1k-11.el8.x86_64.rpm 6.2 MB/s | 737 kB 00:00 2023-11-28T12:02:55.234 INFO:teuthology.orchestra.run.smithi152.stdout:(143/149): openssl-libs-1.1.1k-11.el8.x86_64.rp 10 MB/s | 1.5 MB 00:00 2023-11-28T12:02:55.410 INFO:teuthology.orchestra.run.smithi152.stdout:(144/149): util-linux-2.32.1-43.el8.x86_64.rpm 14 MB/s | 2.5 MB 00:00 2023-11-28T12:02:55.510 INFO:teuthology.orchestra.run.smithi152.stdout:(145/149): util-linux-user-2.32.1-43.el8.x86_64 1.0 MB/s | 103 kB 00:00 2023-11-28T12:02:55.619 INFO:teuthology.orchestra.run.smithi152.stdout:(146/149): xfsdump-3.1.8-7.el8.x86_64.rpm 3.0 MB/s | 334 kB 00:00 2023-11-28T12:02:55.753 INFO:teuthology.orchestra.run.smithi152.stdout:(147/149): xfsprogs-5.0.0-12.el8.x86_64.rpm 8.1 MB/s | 1.1 MB 00:00 2023-11-28T12:03:02.313 INFO:teuthology.orchestra.run.smithi045.stdout:(50/149): openblas-0.3.15-4.el8.x86_64.rpm 139 kB/s | 4.7 MB 00:34 2023-11-28T12:03:06.528 INFO:teuthology.orchestra.run.smithi152.stdout:(148/149): python3-babel-2.5.1-7.el8.noarch.rpm 143 kB/s | 4.8 MB 00:34 2023-11-28T12:03:08.168 INFO:teuthology.orchestra.run.smithi152.stdout:(149/149): openblas-0.3.15-4.el8.x86_64.rpm 65 kB/s | 4.7 MB 01:14 2023-11-28T12:03:08.171 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2023-11-28T12:03:08.171 INFO:teuthology.orchestra.run.smithi152.stdout:Total 2.4 MB/s | 212 MB 01:30 2023-11-28T12:03:10.185 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2023-11-28T12:03:10.638 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2023-11-28T12:03:10.638 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2023-11-28T12:03:12.183 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2023-11-28T12:03:12.187 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2023-11-28T12:03:17.791 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2023-11-28T12:03:17.984 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: openssl-libs-1:1.1.1k-11.el8.x86_64 1/1 2023-11-28T12:03:18.199 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : openssl-libs-1:1.1.1k-11.el8.x86_64 1/170 2023-11-28T12:03:18.451 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: openssl-libs-1:1.1.1k-11.el8.x86_64 1/170 2023-11-28T12:03:18.644 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/170 2023-11-28T12:03:18.802 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : libuuid-2.32.1-43.el8.x86_64 3/170 2023-11-28T12:03:18.915 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libuuid-2.32.1-43.el8.x86_64 3/170 2023-11-28T12:03:19.019 INFO:teuthology.orchestra.run.smithi045.stdout:(51/149): openblas-threads-0.3.15-4.el8.x86_64. 98 kB/s | 4.9 MB 00:50 2023-11-28T12:03:19.108 INFO:teuthology.orchestra.run.smithi045.stdout:[MIRROR] python3-jinja2-2.10.1-3.el8.noarch.rpm: Status code: 500 for http://mirrors.xmission.com/centos/8-stream/AppStream/x86_64/os/Packages/python3-jinja2-2.10.1-3.el8.noarch.rpm (IP: 198.60.22.13) 2023-11-28T12:03:19.127 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : libblkid-2.32.1-43.el8.x86_64 4/170 2023-11-28T12:03:19.219 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libblkid-2.32.1-43.el8.x86_64 4/170 2023-11-28T12:03:19.378 INFO:teuthology.orchestra.run.smithi045.stdout:(52/149): python3-jinja2-2.10.1-3.el8.noarch.rp 1.5 MB/s | 538 kB 00:00 2023-11-28T12:03:19.436 INFO:teuthology.orchestra.run.smithi045.stdout:(53/149): python3-jsonpatch-1.21-2.el8.noarch.r 456 kB/s | 27 kB 00:00 2023-11-28T12:03:19.437 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/170 2023-11-28T12:03:19.487 INFO:teuthology.orchestra.run.smithi045.stdout:(54/149): python3-jsonpointer-1.10-11.el8.noarc 401 kB/s | 20 kB 00:00 2023-11-28T12:03:19.537 INFO:teuthology.orchestra.run.smithi045.stdout:(55/149): python3-mako-1.0.6-14.el8.noarch.rpm 3.1 MB/s | 157 kB 00:00 2023-11-28T12:03:19.588 INFO:teuthology.orchestra.run.smithi045.stdout:(56/149): python3-markupsafe-0.23-19.el8.x86_64 771 kB/s | 39 kB 00:00 2023-11-28T12:03:19.619 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 6/170 2023-11-28T12:03:19.699 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 6/170 2023-11-28T12:03:19.771 INFO:teuthology.orchestra.run.smithi045.stdout:(57/149): python3-numpy-1.14.3-10.el8.x86_64.rp 20 MB/s | 3.7 MB 00:00 2023-11-28T12:03:19.847 INFO:teuthology.orchestra.run.smithi045.stdout:(58/149): python3-numpy-f2py-1.14.3-10.el8.x86_ 2.9 MB/s | 225 kB 00:00 2023-11-28T12:03:19.905 INFO:teuthology.orchestra.run.smithi045.stdout:(59/149): python3-prettytable-0.7.2-14.el8.noar 754 kB/s | 44 kB 00:00 2023-11-28T12:03:19.910 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 7/170 2023-11-28T12:03:19.995 INFO:teuthology.orchestra.run.smithi045.stdout:(60/149): python3-pyOpenSSL-19.0.0-1.el8.noarch 1.1 MB/s | 103 kB 00:00 2023-11-28T12:03:20.056 INFO:teuthology.orchestra.run.smithi045.stdout:(61/149): python3-pyasn1-0.3.7-6.el8.noarch.rpm 2.1 MB/s | 126 kB 00:00 2023-11-28T12:03:20.115 INFO:teuthology.orchestra.run.smithi045.stdout:(62/149): python3-pyasn1-modules-0.3.7-6.el8.no 1.8 MB/s | 110 kB 00:00 2023-11-28T12:03:20.173 INFO:teuthology.orchestra.run.smithi045.stdout:(63/149): python3-pytz-2017.2-11.el8.noarch.rpm 980 kB/s | 57 kB 00:00 2023-11-28T12:03:20.189 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : elfutils-libelf-0.190-1.el8.x86_64 8/170 2023-11-28T12:03:20.377 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 9/170 2023-11-28T12:03:20.482 INFO:teuthology.orchestra.run.smithi045.stdout:(64/149): python3-scipy-1.0.0-21.module_el8.5.0 44 MB/s | 14 MB 00:00 2023-11-28T12:03:20.540 INFO:teuthology.orchestra.run.smithi045.stdout:(65/149): python3-werkzeug-0.12.2-4.el8.noarch. 7.7 MB/s | 457 kB 00:00 2023-11-28T12:03:20.599 INFO:teuthology.orchestra.run.smithi045.stdout:(66/149): socat-1.7.4.1-1.el8.x86_64.rpm 5.4 MB/s | 323 kB 00:00 2023-11-28T12:03:20.658 INFO:teuthology.orchestra.run.smithi045.stdout:(67/149): uuid-1.6.2-43.el8.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2023-11-28T12:03:20.717 INFO:teuthology.orchestra.run.smithi045.stdout:(68/149): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.2 MB/s | 71 kB 00:00 2023-11-28T12:03:20.837 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 9/170 2023-11-28T12:03:21.019 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : librados2-2:18.0.0-2697.g2f5f6028.el8.x86_64 10/170 2023-11-28T12:03:21.083 INFO:teuthology.orchestra.run.smithi045.stdout:(69/149): elfutils-libelf-devel-0.190-1.el8.x86 169 kB/s | 62 kB 00:00 2023-11-28T12:03:21.267 INFO:teuthology.orchestra.run.smithi045.stdout:(70/149): fuse-2.9.7-17.el8.x86_64.rpm 453 kB/s | 83 kB 00:00 2023-11-28T12:03:21.393 INFO:teuthology.orchestra.run.smithi045.stdout:(71/149): keyutils-libs-devel-1.5.10-9.el8.x86_ 384 kB/s | 48 kB 00:00 2023-11-28T12:03:21.468 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librados2-2:18.0.0-2697.g2f5f6028.el8.x86_64 10/170 2023-11-28T12:03:21.676 INFO:teuthology.orchestra.run.smithi045.stdout:(72/149): krb5-devel-1.18.2-22.el8.x86_64.rpm 1.9 MB/s | 561 kB 00:00 2023-11-28T12:03:21.677 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : librbd1-2:18.0.0-2697.g2f5f6028.el8.x86_64 11/170 2023-11-28T12:03:21.776 INFO:teuthology.orchestra.run.smithi045.stdout:(73/149): libaio-devel-0.3.112-1.el8.x86_64.rpm 187 kB/s | 19 kB 00:00 2023-11-28T12:03:21.828 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librbd1-2:18.0.0-2697.g2f5f6028.el8.x86_64 11/170 2023-11-28T12:03:21.885 INFO:teuthology.orchestra.run.smithi045.stdout:(74/149): libcom_err-devel-1.45.6-5.el8.x86_64. 357 kB/s | 39 kB 00:00 2023-11-28T12:03:22.035 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libcephfs2-2:18.0.0-2697.g2f5f6028.el8.x86_64 12/170 2023-11-28T12:03:22.044 INFO:teuthology.orchestra.run.smithi045.stdout:(75/149): libgfortran-8.5.0-21.el8.x86_64.rpm 4.0 MB/s | 645 kB 00:00 2023-11-28T12:03:22.155 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libcephfs2-2:18.0.0-2697.g2f5f6028.el8.x86_64 12/170 2023-11-28T12:03:22.160 INFO:teuthology.orchestra.run.smithi045.stdout:(76/149): libquadmath-8.5.0-21.el8.x86_64.rpm 1.4 MB/s | 172 kB 00:00 2023-11-28T12:03:22.269 INFO:teuthology.orchestra.run.smithi045.stdout:(77/149): librabbitmq-0.9.0-4.el8.x86_64.rpm 434 kB/s | 47 kB 00:00 2023-11-28T12:03:22.380 INFO:teuthology.orchestra.run.smithi045.stdout:(78/149): libselinux-devel-2.9-8.el8.x86_64.rpm 1.8 MB/s | 200 kB 00:00 2023-11-28T12:03:22.486 INFO:teuthology.orchestra.run.smithi045.stdout:(79/149): libsepol-devel-2.9-3.el8.x86_64.rpm 802 kB/s | 87 kB 00:00 2023-11-28T12:03:22.525 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-rados-2:18.0.0-2697.g2f5f6028.el8.x86_64 13/170 2023-11-28T12:03:22.603 INFO:teuthology.orchestra.run.smithi045.stdout:(80/149): libuuid-devel-2.32.1-43.el8.x86_64.rp 857 kB/s | 100 kB 00:00 2023-11-28T12:03:22.720 INFO:teuthology.orchestra.run.smithi045.stdout:(81/149): libverto-devel-0.3.2-2.el8.x86_64.rpm 154 kB/s | 18 kB 00:00 2023-11-28T12:03:22.749 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 14/170 2023-11-28T12:03:22.821 INFO:teuthology.orchestra.run.smithi045.stdout:(82/149): libzstd-devel-1.4.4-1.el8.x86_64.rpm 438 kB/s | 44 kB 00:00 2023-11-28T12:03:22.838 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 14/170 2023-11-28T12:03:23.023 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libpq-13.5-1.el8.x86_64 15/170 2023-11-28T12:03:23.130 INFO:teuthology.orchestra.run.smithi045.stdout:(83/149): openssl-devel-1.1.1k-11.el8.x86_64.rp 10 MB/s | 3.2 MB 00:00 2023-11-28T12:03:23.246 INFO:teuthology.orchestra.run.smithi045.stdout:(84/149): pcre2-devel-10.32-3.el8.x86_64.rpm 5.1 MB/s | 605 kB 00:00 2023-11-28T12:03:23.307 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 16/170 2023-11-28T12:03:23.363 INFO:teuthology.orchestra.run.smithi045.stdout:(85/149): pcre2-utf16-10.32-3.el8.x86_64.rpm 1.9 MB/s | 229 kB 00:00 2023-11-28T12:03:23.480 INFO:teuthology.orchestra.run.smithi045.stdout:(86/149): pcre2-utf32-10.32-3.el8.x86_64.rpm 1.8 MB/s | 220 kB 00:00 2023-11-28T12:03:23.606 INFO:teuthology.orchestra.run.smithi045.stdout:(87/149): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.9 MB/s | 249 kB 00:00 2023-11-28T12:03:23.731 INFO:teuthology.orchestra.run.smithi045.stdout:(88/149): python3-cryptography-3.2.1-6.el8.x86_ 5.0 MB/s | 641 kB 00:00 2023-11-28T12:03:23.774 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 17/170 2023-11-28T12:03:23.848 INFO:teuthology.orchestra.run.smithi045.stdout:(89/149): python3-jwt-1.6.1-2.el8.noarch.rpm 366 kB/s | 43 kB 00:00 2023-11-28T12:03:23.956 INFO:teuthology.orchestra.run.smithi045.stdout:(90/149): python3-oauthlib-2.1.0-1.el8.noarch.r 1.4 MB/s | 155 kB 00:00 2023-11-28T12:03:23.990 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : postgresql-10.23-2.module_el8+572+929c87ac.x86_6 18/170 2023-11-28T12:03:24.065 INFO:teuthology.orchestra.run.smithi045.stdout:(91/149): python3-pycparser-2.14-14.el8.noarch. 1.0 MB/s | 109 kB 00:00 2023-11-28T12:03:24.165 INFO:teuthology.orchestra.run.smithi045.stdout:(92/149): python3-requests-oauthlib-1.0.0-1.el8 427 kB/s | 43 kB 00:00 2023-11-28T12:03:24.176 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libcephsqlite-2:18.0.0-2697.g2f5f6028.el8.x86_64 19/170 2023-11-28T12:03:24.274 INFO:teuthology.orchestra.run.smithi045.stdout:(93/149): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 688 kB/s | 74 kB 00:00 2023-11-28T12:03:24.314 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libcephsqlite-2:18.0.0-2697.g2f5f6028.el8.x86_64 19/170 2023-11-28T12:03:24.374 INFO:teuthology.orchestra.run.smithi045.stdout:(94/149): zlib-devel-1.2.11-21.el8.x86_64.rpm 582 kB/s | 58 kB 00:00 2023-11-28T12:03:24.510 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libradosstriper1-2:18.0.0-2697.g2f5f6028.el8.x86 20/170 2023-11-28T12:03:24.605 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libradosstriper1-2:18.0.0-2697.g2f5f6028.el8.x86 20/170 2023-11-28T12:03:24.843 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : libacl-2.2.53-3.el8.x86_64 21/170 2023-11-28T12:03:25.049 INFO:teuthology.orchestra.run.smithi045.stdout:(95/149): gperftools-libs-2.7-9.el8.x86_64.rpm 454 kB/s | 306 kB 00:00 2023-11-28T12:03:25.061 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 22/170 2023-11-28T12:03:25.166 INFO:teuthology.orchestra.run.smithi045.stdout:(96/149): liboath-2.6.2-3.el8.x86_64.rpm 505 kB/s | 59 kB 00:00 2023-11-28T12:03:25.252 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 23/170 2023-11-28T12:03:25.284 INFO:teuthology.orchestra.run.smithi045.stdout:(97/149): libunwind-1.3.1-3.el8.x86_64.rpm 643 kB/s | 75 kB 00:00 2023-11-28T12:03:25.443 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libquadmath-8.5.0-21.el8.x86_64 24/170 2023-11-28T12:03:25.484 INFO:teuthology.orchestra.run.smithi045.stdout:(98/149): python3-asyncssh-2.7.0-2.el8.noarch.r 2.4 MB/s | 476 kB 00:00 2023-11-28T12:03:25.586 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libquadmath-8.5.0-21.el8.x86_64 24/170 2023-11-28T12:03:25.592 INFO:teuthology.orchestra.run.smithi045.stdout:(99/149): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 403 kB/s | 44 kB 00:00 2023-11-28T12:03:25.709 INFO:teuthology.orchestra.run.smithi045.stdout:(100/149): python3-beautifulsoup4-4.6.3-2.el8.1 1.5 MB/s | 185 kB 00:00 2023-11-28T12:03:25.776 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libgfortran-8.5.0-21.el8.x86_64 25/170 2023-11-28T12:03:25.810 INFO:teuthology.orchestra.run.smithi045.stdout:(101/149): python3-cachetools-3.1.1-4.el8.noarc 330 kB/s | 33 kB 00:00 2023-11-28T12:03:25.910 INFO:teuthology.orchestra.run.smithi045.stdout:(102/149): python3-certifi-2018.10.15-7.el8.noa 163 kB/s | 16 kB 00:00 2023-11-28T12:03:26.027 INFO:teuthology.orchestra.run.smithi045.stdout:(103/149): python3-cheroot-8.5.2-1.el8.noarch.r 1.4 MB/s | 173 kB 00:00 2023-11-28T12:03:26.161 INFO:teuthology.orchestra.run.smithi045.stdout:(104/149): python3-cherrypy-18.4.0-1.el8.noarch 2.8 MB/s | 384 kB 00:00 2023-11-28T12:03:26.261 INFO:teuthology.orchestra.run.smithi045.stdout:(105/149): python3-google-auth-1.1.1-10.el8.noa 814 kB/s | 81 kB 00:00 2023-11-28T12:03:26.370 INFO:teuthology.orchestra.run.smithi045.stdout:(106/149): python3-jaraco-6.2-6.el8.noarch.rpm 103 kB/s | 11 kB 00:00 2023-11-28T12:03:26.424 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libgfortran-8.5.0-21.el8.x86_64 25/170 2023-11-28T12:03:26.470 INFO:teuthology.orchestra.run.smithi045.stdout:(107/149): python3-jaraco-functools-2.0-4.el8.n 175 kB/s | 18 kB 00:00 2023-11-28T12:03:26.651 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : openblas-0.3.15-4.el8.x86_64 26/170 2023-11-28T12:03:26.662 INFO:teuthology.orchestra.run.smithi045.stdout:(108/149): python3-kubernetes-11.0.0-6.el8.noar 6.1 MB/s | 1.2 MB 00:00 2023-11-28T12:03:26.780 INFO:teuthology.orchestra.run.smithi045.stdout:(109/149): python3-logutils-0.3.5-11.el8.noarch 418 kB/s | 49 kB 00:00 2023-11-28T12:03:26.879 INFO:teuthology.orchestra.run.smithi045.stdout:(110/149): python3-more-itertools-7.2.0-3.el8.n 588 kB/s | 59 kB 00:00 2023-11-28T12:03:26.980 INFO:teuthology.orchestra.run.smithi045.stdout:(111/149): python3-natsort-7.1.1-2.el8.noarch.r 603 kB/s | 60 kB 00:00 2023-11-28T12:03:27.088 INFO:teuthology.orchestra.run.smithi045.stdout:(112/149): python3-pecan-1.3.2-9.el8.noarch.rpm 2.6 MB/s | 283 kB 00:00 2023-11-28T12:03:27.189 INFO:teuthology.orchestra.run.smithi045.stdout:(113/149): python3-portend-2.6-1.el8.noarch.rpm 156 kB/s | 16 kB 00:00 2023-11-28T12:03:27.289 INFO:teuthology.orchestra.run.smithi045.stdout:(114/149): python3-repoze-lru-0.7-6.el8.noarch. 337 kB/s | 34 kB 00:00 2023-11-28T12:03:27.331 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 26/170 2023-11-28T12:03:27.389 INFO:teuthology.orchestra.run.smithi045.stdout:(115/149): python3-routes-2.4.1-12.el8.noarch.r 1.9 MB/s | 196 kB 00:00 2023-11-28T12:03:27.490 INFO:teuthology.orchestra.run.smithi045.stdout:(116/149): python3-rsa-4.9-2.el8.noarch.rpm 643 kB/s | 64 kB 00:00 2023-11-28T12:03:27.517 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 27/170 2023-11-28T12:03:27.590 INFO:teuthology.orchestra.run.smithi045.stdout:(117/149): python3-simplegeneric-0.8.1-17.el8.n 187 kB/s | 19 kB 00:00 2023-11-28T12:03:27.690 INFO:teuthology.orchestra.run.smithi045.stdout:(118/149): python3-singledispatch-3.4.0.3-18.el 239 kB/s | 24 kB 00:00 2023-11-28T12:03:27.791 INFO:teuthology.orchestra.run.smithi045.stdout:(119/149): python3-tempora-1.14.1-5.el8.noarch. 292 kB/s | 29 kB 00:00 2023-11-28T12:03:27.883 INFO:teuthology.orchestra.run.smithi045.stdout:(120/149): python3-trustme-0.6.0-4.el8.noarch.r 301 kB/s | 27 kB 00:00 2023-11-28T12:03:27.992 INFO:teuthology.orchestra.run.smithi045.stdout:(121/149): python3-waitress-1.4.3-1.el8.noarch. 2.3 MB/s | 255 kB 00:00 2023-11-28T12:03:28.108 INFO:teuthology.orchestra.run.smithi045.stdout:(122/149): python3-webob-1.8.5-1.el8.1.noarch.r 2.1 MB/s | 251 kB 00:00 2023-11-28T12:03:28.200 INFO:teuthology.orchestra.run.smithi045.stdout:(123/149): python3-websocket-client-0.56.0-5.el 669 kB/s | 61 kB 00:00 2023-11-28T12:03:28.301 INFO:teuthology.orchestra.run.smithi045.stdout:(124/149): python3-webtest-2.0.33-1.el8.noarch. 853 kB/s | 85 kB 00:00 2023-11-28T12:03:28.321 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 27/170 2023-11-28T12:03:28.401 INFO:teuthology.orchestra.run.smithi045.stdout:(125/149): python3-zc-lockfile-2.0-2.el8.noarch 230 kB/s | 23 kB 00:00 2023-11-28T12:03:28.568 INFO:teuthology.orchestra.run.smithi045.stdout:(126/149): thrift-0.13.0-2.el8.x86_64.rpm 10 MB/s | 1.7 MB 00:00 2023-11-28T12:03:28.657 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 28/170 2023-11-28T12:03:28.851 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 29/170 2023-11-28T12:03:28.969 INFO:teuthology.orchestra.run.smithi045.stdout:(127/149): librados2-18.0.0-2697.g2f5f6028.el8. 9.1 MB/s | 3.7 MB 00:00 2023-11-28T12:03:29.010 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 30/170 2023-11-28T12:03:29.160 INFO:teuthology.orchestra.run.smithi045.stdout:(128/149): librbd1-18.0.0-2697.g2f5f6028.el8.x8 19 MB/s | 3.6 MB 00:00 2023-11-28T12:03:29.218 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 31/170 2023-11-28T12:03:29.269 INFO:teuthology.orchestra.run.smithi045.stdout:(129/149): NetworkManager-initscripts-updown-1. 1.3 MB/s | 144 kB 00:00 2023-11-28T12:03:29.361 INFO:teuthology.orchestra.run.smithi045.stdout:(130/149): acl-2.2.53-3.el8.x86_64.rpm 902 kB/s | 83 kB 00:00 2023-11-28T12:03:29.449 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-ceph-common-2:18.0.0-2697.g2f5f6028.el8. 32/170 2023-11-28T12:03:29.469 INFO:teuthology.orchestra.run.smithi045.stdout:(131/149): elfutils-debuginfod-client-0.190-1.e 708 kB/s | 77 kB 00:00 2023-11-28T12:03:29.578 INFO:teuthology.orchestra.run.smithi045.stdout:(132/149): elfutils-libelf-0.190-1.el8.x86_64.r 2.1 MB/s | 232 kB 00:00 2023-11-28T12:03:29.587 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-ceph-argparse-2:18.0.0-2697.g2f5f6028.el 33/170 2023-11-28T12:03:29.687 INFO:teuthology.orchestra.run.smithi045.stdout:(133/149): elfutils-libs-0.190-1.el8.x86_64.rpm 2.7 MB/s | 305 kB 00:00 2023-11-28T12:03:29.804 INFO:teuthology.orchestra.run.smithi045.stdout:(134/149): iproute-6.2.0-5.el8.x86_64.rpm 7.2 MB/s | 854 kB 00:00 2023-11-28T12:03:29.831 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cephfs-2:18.0.0-2697.g2f5f6028.el8.x86_6 34/170 2023-11-28T12:03:29.904 INFO:teuthology.orchestra.run.smithi045.stdout:(135/149): libacl-2.2.53-3.el8.x86_64.rpm 348 kB/s | 35 kB 00:00 2023-11-28T12:03:30.005 INFO:teuthology.orchestra.run.smithi045.stdout:(136/149): libacl-devel-2.2.53-3.el8.x86_64.rpm 850 kB/s | 85 kB 00:00 2023-11-28T12:03:30.113 INFO:teuthology.orchestra.run.smithi045.stdout:(137/149): libblkid-2.32.1-43.el8.x86_64.rpm 2.0 MB/s | 220 kB 00:00 2023-11-28T12:03:30.222 INFO:teuthology.orchestra.run.smithi045.stdout:(138/149): libfdisk-2.32.1-43.el8.x86_64.rpm 2.3 MB/s | 254 kB 00:00 2023-11-28T12:03:30.330 INFO:teuthology.orchestra.run.smithi045.stdout:(139/149): libmount-2.32.1-43.el8.x86_64.rpm 2.1 MB/s | 236 kB 00:00 2023-11-28T12:03:30.430 INFO:teuthology.orchestra.run.smithi045.stdout:(140/149): libsmartcols-2.32.1-43.el8.x86_64.rp 1.8 MB/s | 179 kB 00:00 2023-11-28T12:03:30.531 INFO:teuthology.orchestra.run.smithi045.stdout:(141/149): libuuid-2.32.1-43.el8.x86_64.rpm 991 kB/s | 99 kB 00:00 2023-11-28T12:03:30.649 INFO:teuthology.orchestra.run.smithi045.stdout:(142/149): openssl-1.1.1k-11.el8.x86_64.rpm 6.2 MB/s | 737 kB 00:00 2023-11-28T12:03:30.781 INFO:teuthology.orchestra.run.smithi045.stdout:(143/149): openssl-libs-1.1.1k-11.el8.x86_64.rp 11 MB/s | 1.5 MB 00:00 2023-11-28T12:03:30.888 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 35/170 2023-11-28T12:03:30.940 INFO:teuthology.orchestra.run.smithi045.stdout:(144/149): util-linux-2.32.1-43.el8.x86_64.rpm 16 MB/s | 2.5 MB 00:00 2023-11-28T12:03:31.049 INFO:teuthology.orchestra.run.smithi045.stdout:(145/149): util-linux-user-2.32.1-43.el8.x86_64 949 kB/s | 103 kB 00:00 2023-11-28T12:03:31.157 INFO:teuthology.orchestra.run.smithi045.stdout:(146/149): xfsdump-3.1.8-7.el8.x86_64.rpm 3.0 MB/s | 334 kB 00:00 2023-11-28T12:03:31.259 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 36/170 2023-11-28T12:03:31.291 INFO:teuthology.orchestra.run.smithi045.stdout:(147/149): xfsprogs-5.0.0-12.el8.x86_64.rpm 8.1 MB/s | 1.1 MB 00:00 2023-11-28T12:03:31.600 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 37/170 2023-11-28T12:03:31.792 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 38/170 2023-11-28T12:03:32.033 INFO:teuthology.orchestra.run.smithi045.stdout:(148/149): postgresql-server-10.23-2.module_el8 126 kB/s | 5.1 MB 00:41 2023-11-28T12:03:33.842 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 38/170 2023-11-28T12:03:34.144 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 39/170 2023-11-28T12:03:34.331 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 40/170 2023-11-28T12:03:34.522 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-rsa-4.9-2.el8.noarch 41/170 2023-11-28T12:03:34.707 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-rbd-2:18.0.0-2697.g2f5f6028.el8.x86_64 42/170 2023-11-28T12:03:34.900 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : librados-devel-2:18.0.0-2697.g2f5f6028.el8.x86_6 43/170 2023-11-28T12:03:35.120 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : elfutils-libs-0.190-1.el8.x86_64 44/170 2023-11-28T12:03:35.310 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : elfutils-debuginfod-client-0.190-1.el8.x86_64 45/170 2023-11-28T12:03:35.516 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : libfdisk-2.32.1-43.el8.x86_64 46/170 2023-11-28T12:03:35.613 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libfdisk-2.32.1-43.el8.x86_64 46/170 2023-11-28T12:03:35.783 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : libmount-2.32.1-43.el8.x86_64 47/170 2023-11-28T12:03:35.855 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libmount-2.32.1-43.el8.x86_64 47/170 2023-11-28T12:03:36.017 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libuuid-devel-2.32.1-43.el8.x86_64 48/170 2023-11-28T12:03:36.237 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 49/170 2023-11-28T12:03:36.408 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : libsmartcols-2.32.1-43.el8.x86_64 50/170 2023-11-28T12:03:36.972 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libsmartcols-2.32.1-43.el8.x86_64 50/170 2023-11-28T12:03:37.258 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : util-linux-2.32.1-43.el8.x86_64 51/170 2023-11-28T12:03:37.287 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: util-linux-2.32.1-43.el8.x86_64 51/170 2023-11-28T12:03:37.514 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 52/170 2023-11-28T12:03:37.764 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 53/170 2023-11-28T12:03:37.982 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 54/170 2023-11-28T12:03:38.143 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 55/170 2023-11-28T12:03:38.311 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 56/170 2023-11-28T12:03:38.528 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 57/170 2023-11-28T12:03:38.739 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 58/170 2023-11-28T12:03:38.953 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 59/170 2023-11-28T12:03:39.144 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 60/170 2023-11-28T12:03:39.297 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 61/170 2023-11-28T12:03:39.479 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 62/170 2023-11-28T12:03:39.705 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 63/170 2023-11-28T12:03:39.875 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-portend-2.6-1.el8.noarch 64/170 2023-11-28T12:03:40.042 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 65/170 2023-11-28T12:03:40.230 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 66/170 2023-11-28T12:03:40.469 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 67/170 2023-11-28T12:03:41.079 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 68/170 2023-11-28T12:03:41.420 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 69/170 2023-11-28T12:03:41.676 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 70/170 2023-11-28T12:03:41.874 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 71/170 2023-11-28T12:03:42.741 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 72/170 2023-11-28T12:03:42.965 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : librgw2-2:18.0.0-2697.g2f5f6028.el8.x86_64 73/170 2023-11-28T12:03:43.058 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librgw2-2:18.0.0-2697.g2f5f6028.el8.x86_64 73/170 2023-11-28T12:03:43.309 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-rgw-2:18.0.0-2697.g2f5f6028.el8.x86_64 74/170 2023-11-28T12:03:43.570 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 75/170 2023-11-28T12:03:44.003 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 76/170 2023-11-28T12:03:44.272 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 77/170 2023-11-28T12:03:44.471 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 78/170 2023-11-28T12:03:44.725 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 79/170 2023-11-28T12:03:44.965 INFO:teuthology.orchestra.run.smithi045.stdout:(149/149): python3-babel-2.5.1-7.el8.noarch.rpm 115 kB/s | 4.8 MB 00:42 2023-11-28T12:03:44.966 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 80/170 2023-11-28T12:03:44.968 INFO:teuthology.orchestra.run.smithi045.stdout:-------------------------------------------------------------------------------- 2023-11-28T12:03:44.968 INFO:teuthology.orchestra.run.smithi045.stdout:Total 2.3 MB/s | 212 MB 01:30 2023-11-28T12:03:46.206 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 81/170 2023-11-28T12:03:46.565 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 82/170 2023-11-28T12:03:46.782 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 83/170 2023-11-28T12:03:46.990 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 84/170 2023-11-28T12:03:47.016 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction check 2023-11-28T12:03:47.303 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 85/170 2023-11-28T12:03:47.504 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction check succeeded. 2023-11-28T12:03:47.505 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction test 2023-11-28T12:03:47.559 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 86/170 2023-11-28T12:03:47.801 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 87/170 2023-11-28T12:03:48.065 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 88/170 2023-11-28T12:03:48.391 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 89/170 2023-11-28T12:03:48.614 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 90/170 2023-11-28T12:03:48.791 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 91/170 2023-11-28T12:03:48.990 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 92/170 2023-11-28T12:03:49.062 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction test succeeded. 2023-11-28T12:03:49.066 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction 2023-11-28T12:03:49.357 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 93/170 2023-11-28T12:03:49.610 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 94/170 2023-11-28T12:03:49.787 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 95/170 2023-11-28T12:03:49.989 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 96/170 2023-11-28T12:03:50.233 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 97/170 2023-11-28T12:03:50.475 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : fuse-2.9.7-17.el8.x86_64 98/170 2023-11-28T12:03:50.691 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 99/170 2023-11-28T12:03:50.889 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : uuid-1.6.2-43.el8.x86_64 100/170 2023-11-28T12:03:50.982 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 100/170 2023-11-28T12:03:51.131 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 101/170 2023-11-28T12:03:54.227 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-common-2:18.0.0-2697.g2f5f6028.el8.x86_64 102/170 2023-11-28T12:03:54.481 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-common-2:18.0.0-2697.g2f5f6028.el8.x86_64 102/170 2023-11-28T12:03:54.836 INFO:teuthology.orchestra.run.smithi045.stdout: Preparing : 1/1 2023-11-28T12:03:55.042 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: openssl-libs-1:1.1.1k-11.el8.x86_64 1/1 2023-11-28T12:03:55.150 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-common-2:18.0.0-2697.g2f5f6028.el8.x86_64 102/170 2023-11-28T12:03:55.265 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : openssl-libs-1:1.1.1k-11.el8.x86_64 1/170 2023-11-28T12:03:55.435 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-base-2:18.0.0-2697.g2f5f6028.el8.x86_64 103/170 2023-11-28T12:03:55.525 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: openssl-libs-1:1.1.1k-11.el8.x86_64 1/170 2023-11-28T12:03:55.639 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-base-2:18.0.0-2697.g2f5f6028.el8.x86_64 103/170 2023-11-28T12:03:55.702 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/170 2023-11-28T12:03:55.838 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-selinux-2:18.0.0-2697.g2f5f6028.el8.x86_64 104/170 2023-11-28T12:03:55.838 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : libuuid-2.32.1-43.el8.x86_64 3/170 2023-11-28T12:03:55.938 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libuuid-2.32.1-43.el8.x86_64 3/170 2023-11-28T12:03:56.130 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : libblkid-2.32.1-43.el8.x86_64 4/170 2023-11-28T12:03:56.209 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libblkid-2.32.1-43.el8.x86_64 4/170 2023-11-28T12:03:56.434 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/170 2023-11-28T12:03:56.613 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 6/170 2023-11-28T12:03:56.681 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 6/170 2023-11-28T12:03:56.903 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 7/170 2023-11-28T12:03:57.161 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : elfutils-libelf-0.190-1.el8.x86_64 8/170 2023-11-28T12:03:57.330 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 9/170 2023-11-28T12:03:57.820 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 9/170 2023-11-28T12:03:58.013 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : librados2-2:18.0.0-2697.g2f5f6028.el8.x86_64 10/170 2023-11-28T12:03:58.480 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: librados2-2:18.0.0-2697.g2f5f6028.el8.x86_64 10/170 2023-11-28T12:03:58.654 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : librbd1-2:18.0.0-2697.g2f5f6028.el8.x86_64 11/170 2023-11-28T12:03:58.805 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: librbd1-2:18.0.0-2697.g2f5f6028.el8.x86_64 11/170 2023-11-28T12:03:58.996 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libcephfs2-2:18.0.0-2697.g2f5f6028.el8.x86_64 12/170 2023-11-28T12:03:59.107 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libcephfs2-2:18.0.0-2697.g2f5f6028.el8.x86_64 12/170 2023-11-28T12:03:59.441 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-rados-2:18.0.0-2697.g2f5f6028.el8.x86_64 13/170 2023-11-28T12:03:59.666 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 14/170 2023-11-28T12:03:59.772 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 14/170 2023-11-28T12:03:59.936 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libpq-13.5-1.el8.x86_64 15/170 2023-11-28T12:04:00.173 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 16/170 2023-11-28T12:04:00.632 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 17/170 2023-11-28T12:04:00.835 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : postgresql-10.23-2.module_el8+572+929c87ac.x86_6 18/170 2023-11-28T12:04:01.004 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libcephsqlite-2:18.0.0-2697.g2f5f6028.el8.x86_64 19/170 2023-11-28T12:04:01.251 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libcephsqlite-2:18.0.0-2697.g2f5f6028.el8.x86_64 19/170 2023-11-28T12:04:01.412 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libradosstriper1-2:18.0.0-2697.g2f5f6028.el8.x86 20/170 2023-11-28T12:04:01.489 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libradosstriper1-2:18.0.0-2697.g2f5f6028.el8.x86 20/170 2023-11-28T12:04:01.727 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : libacl-2.2.53-3.el8.x86_64 21/170 2023-11-28T12:04:01.933 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 22/170 2023-11-28T12:04:02.112 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 23/170 2023-11-28T12:04:02.271 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libquadmath-8.5.0-21.el8.x86_64 24/170 2023-11-28T12:04:02.438 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libquadmath-8.5.0-21.el8.x86_64 24/170 2023-11-28T12:04:02.604 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libgfortran-8.5.0-21.el8.x86_64 25/170 2023-11-28T12:04:03.309 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libgfortran-8.5.0-21.el8.x86_64 25/170 2023-11-28T12:04:03.504 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : openblas-0.3.15-4.el8.x86_64 26/170 2023-11-28T12:04:04.231 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 26/170 2023-11-28T12:04:04.420 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 27/170 2023-11-28T12:04:05.280 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 27/170 2023-11-28T12:04:05.735 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 28/170 2023-11-28T12:04:05.913 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 29/170 2023-11-28T12:04:06.072 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 30/170 2023-11-28T12:04:06.283 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 31/170 2023-11-28T12:04:06.486 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-ceph-common-2:18.0.0-2697.g2f5f6028.el8. 32/170 2023-11-28T12:04:06.617 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-ceph-argparse-2:18.0.0-2697.g2f5f6028.el 33/170 2023-11-28T12:04:06.857 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-cephfs-2:18.0.0-2697.g2f5f6028.el8.x86_6 34/170 2023-11-28T12:04:08.004 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 35/170 2023-11-28T12:04:08.364 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 36/170 2023-11-28T12:04:08.675 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 37/170 2023-11-28T12:04:08.870 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 38/170 2023-11-28T12:04:11.137 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 38/170 2023-11-28T12:04:11.417 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 39/170 2023-11-28T12:04:11.587 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 40/170 2023-11-28T12:04:11.768 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-rsa-4.9-2.el8.noarch 41/170 2023-11-28T12:04:11.946 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-rbd-2:18.0.0-2697.g2f5f6028.el8.x86_64 42/170 2023-11-28T12:04:12.113 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : librados-devel-2:18.0.0-2697.g2f5f6028.el8.x86_6 43/170 2023-11-28T12:04:12.279 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : elfutils-libs-0.190-1.el8.x86_64 44/170 2023-11-28T12:04:12.481 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : elfutils-debuginfod-client-0.190-1.el8.x86_64 45/170 2023-11-28T12:04:12.694 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : libfdisk-2.32.1-43.el8.x86_64 46/170 2023-11-28T12:04:12.793 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libfdisk-2.32.1-43.el8.x86_64 46/170 2023-11-28T12:04:12.986 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : libmount-2.32.1-43.el8.x86_64 47/170 2023-11-28T12:04:13.077 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libmount-2.32.1-43.el8.x86_64 47/170 2023-11-28T12:04:13.251 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libuuid-devel-2.32.1-43.el8.x86_64 48/170 2023-11-28T12:04:13.433 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 49/170 2023-11-28T12:04:13.602 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : libsmartcols-2.32.1-43.el8.x86_64 50/170 2023-11-28T12:04:14.214 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libsmartcols-2.32.1-43.el8.x86_64 50/170 2023-11-28T12:04:14.462 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : util-linux-2.32.1-43.el8.x86_64 51/170 2023-11-28T12:04:14.491 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: util-linux-2.32.1-43.el8.x86_64 51/170 2023-11-28T12:04:14.677 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 52/170 2023-11-28T12:04:14.929 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 53/170 2023-11-28T12:04:15.169 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 54/170 2023-11-28T12:04:15.342 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 55/170 2023-11-28T12:04:15.498 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 56/170 2023-11-28T12:04:15.675 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 57/170 2023-11-28T12:04:15.860 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 58/170 2023-11-28T12:04:16.067 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 59/170 2023-11-28T12:04:16.239 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 60/170 2023-11-28T12:04:16.264 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-selinux-2:18.0.0-2697.g2f5f6028.el8.x86_64 104/170 2023-11-28T12:04:16.264 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /sys 2023-11-28T12:04:16.264 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /proc 2023-11-28T12:04:16.264 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /dev 2023-11-28T12:04:16.265 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /run 2023-11-28T12:04:16.265 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /mnt 2023-11-28T12:04:16.265 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /var/tmp 2023-11-28T12:04:16.265 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /home 2023-11-28T12:04:16.265 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /tmp 2023-11-28T12:04:16.265 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /dev 2023-11-28T12:04:16.265 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-11-28T12:04:16.384 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 61/170 2023-11-28T12:04:16.583 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 62/170 2023-11-28T12:04:16.660 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-volume-2:18.0.0-2697.g2f5f6028.el8.noarch 105/170 2023-11-28T12:04:16.759 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 63/170 2023-11-28T12:04:16.921 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-portend-2.6-1.el8.noarch 64/170 2023-11-28T12:04:17.099 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 65/170 2023-11-28T12:04:17.298 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 66/170 2023-11-28T12:04:17.544 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 67/170 2023-11-28T12:04:17.736 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 68/170 2023-11-28T12:04:18.100 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 69/170 2023-11-28T12:04:18.338 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 70/170 2023-11-28T12:04:18.372 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-volume-2:18.0.0-2697.g2f5f6028.el8.noarch 105/170 2023-11-28T12:04:18.537 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 71/170 2023-11-28T12:04:18.656 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-osd-2:18.0.0-2697.g2f5f6028.el8.x86_64 106/170 2023-11-28T12:04:18.922 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-osd-2:18.0.0-2697.g2f5f6028.el8.x86_64 106/170 2023-11-28T12:04:19.151 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mds-2:18.0.0-2697.g2f5f6028.el8.x86_64 107/170 2023-11-28T12:04:19.382 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 72/170 2023-11-28T12:04:19.593 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : librgw2-2:18.0.0-2697.g2f5f6028.el8.x86_64 73/170 2023-11-28T12:04:19.670 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mds-2:18.0.0-2697.g2f5f6028.el8.x86_64 107/170 2023-11-28T12:04:19.688 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: librgw2-2:18.0.0-2697.g2f5f6028.el8.x86_64 73/170 2023-11-28T12:04:19.914 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-rgw-2:18.0.0-2697.g2f5f6028.el8.x86_64 74/170 2023-11-28T12:04:19.918 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mon-2:18.0.0-2697.g2f5f6028.el8.x86_64 108/170 2023-11-28T12:04:19.968 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mon-2:18.0.0-2697.g2f5f6028.el8.x86_64 108/170 2023-11-28T12:04:20.166 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 75/170 2023-11-28T12:04:20.176 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 109/170 2023-11-28T12:04:20.389 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 110/170 2023-11-28T12:04:20.559 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 111/170 2023-11-28T12:04:20.586 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 76/170 2023-11-28T12:04:20.662 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 111/170 2023-11-28T12:04:20.851 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 77/170 2023-11-28T12:04:21.016 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : jq-1.6-8.el8.x86_64 112/170 2023-11-28T12:04:21.017 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 78/170 2023-11-28T12:04:21.226 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : automake-1.16.1-8.el8.noarch 113/170 2023-11-28T12:04:21.258 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 79/170 2023-11-28T12:04:21.471 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 80/170 2023-11-28T12:04:21.846 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: cephadm-2:18.0.0-2697.g2f5f6028.el8.noarch 114/170 2023-11-28T12:04:21.984 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : cephadm-2:18.0.0-2697.g2f5f6028.el8.noarch 114/170 2023-11-28T12:04:22.142 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-2697.g2f5f6028.e 115/170 2023-11-28T12:04:22.347 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-2697.g2f5f6028. 116/170 2023-11-28T12:04:22.567 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-2697.g2f5f6028.el8.noa 117/170 2023-11-28T12:04:22.786 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 81/170 2023-11-28T12:04:22.826 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-2697.g2f5f6028.el8.noa 117/170 2023-11-28T12:04:23.047 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-2697.g2f5f6028.el8.n 118/170 2023-11-28T12:04:23.125 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 82/170 2023-11-28T12:04:23.344 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 83/170 2023-11-28T12:04:23.556 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 84/170 2023-11-28T12:04:23.863 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 85/170 2023-11-28T12:04:24.105 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 86/170 2023-11-28T12:04:24.134 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-2697.g2f5f6028.el8.n 118/170 2023-11-28T12:04:24.300 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-2697.g2f5 119/170 2023-11-28T12:04:24.357 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 87/170 2023-11-28T12:04:24.427 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-2697.g2f5 119/170 2023-11-28T12:04:24.607 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 88/170 2023-11-28T12:04:24.802 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-2697.g2f5f6028.el 120/170 2023-11-28T12:04:24.932 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 89/170 2023-11-28T12:04:25.014 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-2:18.0.0-2697.g2f5f6028.el8.x86_64 121/170 2023-11-28T12:04:25.080 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-2:18.0.0-2697.g2f5f6028.el8.x86_64 121/170 2023-11-28T12:04:25.157 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 90/170 2023-11-28T12:04:25.241 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-rook-2:18.0.0-2697.g2f5f6028.el8.noarch 122/170 2023-11-28T12:04:25.269 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-2697.g2f5f6028.el8.noarch 122/170 2023-11-28T12:04:25.311 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 91/170 2023-11-28T12:04:25.459 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-2:18.0.0-2697.g2f5f6028.el8.x86_64 123/170 2023-11-28T12:04:25.495 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 92/170 2023-11-28T12:04:25.658 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libtool-2.4.6-25.el8.x86_64 124/170 2023-11-28T12:04:25.809 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 93/170 2023-11-28T12:04:26.046 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 94/170 2023-11-28T12:04:26.208 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 95/170 2023-11-28T12:04:26.410 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 96/170 2023-11-28T12:04:26.628 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 97/170 2023-11-28T12:04:26.845 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : fuse-2.9.7-17.el8.x86_64 98/170 2023-11-28T12:04:27.047 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 99/170 2023-11-28T12:04:27.275 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : uuid-1.6.2-43.el8.x86_64 100/170 2023-11-28T12:04:27.363 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 100/170 2023-11-28T12:04:27.493 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 101/170 2023-11-28T12:04:30.427 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 124/170 2023-11-28T12:04:30.454 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-common-2:18.0.0-2697.g2f5f6028.el8.x86_64 102/170 2023-11-28T12:04:30.676 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-common-2:18.0.0-2697.g2f5f6028.el8.x86_64 102/170 2023-11-28T12:04:31.396 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-common-2:18.0.0-2697.g2f5f6028.el8.x86_64 102/170 2023-11-28T12:04:31.685 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-base-2:18.0.0-2697.g2f5f6028.el8.x86_64 103/170 2023-11-28T12:04:31.898 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-base-2:18.0.0-2697.g2f5f6028.el8.x86_64 103/170 2023-11-28T12:04:31.907 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-test-2:18.0.0-2697.g2f5f6028.el8.x86_64 125/170 2023-11-28T12:04:32.091 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-selinux-2:18.0.0-2697.g2f5f6028.el8.x86_64 104/170 2023-11-28T12:04:32.163 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-radosgw-2:18.0.0-2697.g2f5f6028.el8.x86_64 126/170 2023-11-28T12:04:32.225 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-2697.g2f5f6028.el8.x86_64 126/170 2023-11-28T12:04:32.458 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-2697.g2f5f6 127/170 2023-11-28T12:04:32.529 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-2697.g2f5f6 127/170 2023-11-28T12:04:32.757 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : cephfs-mirror-2:18.0.0-2697.g2f5f6028.el8.x86_64 128/170 2023-11-28T12:04:33.160 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-2697.g2f5f6028.el8.x86_64 128/170 2023-11-28T12:04:33.391 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : rbd-mirror-2:18.0.0-2697.g2f5f6028.el8.x86_64 129/170 2023-11-28T12:04:33.668 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: rbd-mirror-2:18.0.0-2697.g2f5f6028.el8.x86_64 129/170 2023-11-28T12:04:33.978 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : postgresql-contrib-10.23-2.module_el8+572+929c87 130/170 2023-11-28T12:04:35.234 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-fuse-2:18.0.0-2697.g2f5f6028.el8.x86_64 131/170 2023-11-28T12:04:35.562 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : openssl-devel-1:1.1.1k-11.el8.x86_64 132/170 2023-11-28T12:04:35.764 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : elfutils-libelf-devel-0.190-1.el8.x86_64 133/170 2023-11-28T12:04:36.054 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : util-linux-user-2.32.1-43.el8.x86_64 134/170 2023-11-28T12:04:36.237 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 135/170 2023-11-28T12:04:36.450 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libcephfs-devel-2:18.0.0-2697.g2f5f6028.el8.x86_ 136/170 2023-11-28T12:04:36.794 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : acl-2.2.53-3.el8.x86_64 137/170 2023-11-28T12:04:36.974 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : libacl-devel-2.2.53-3.el8.x86_64 138/170 2023-11-28T12:04:38.200 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: postgresql-server-10.23-2.module_el8+572+929c87a 139/170 2023-11-28T12:04:38.515 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : postgresql-server-10.23-2.module_el8+572+929c87a 139/170 2023-11-28T12:04:38.597 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: postgresql-server-10.23-2.module_el8+572+929c87a 139/170 2023-11-28T12:04:38.853 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : xfsdump-3.1.8-7.el8.x86_64 140/170 2023-11-28T12:04:39.065 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : cephfs-top-2:18.0.0-2697.g2f5f6028.el8.noarch 141/170 2023-11-28T12:04:39.316 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : rbd-fuse-2:18.0.0-2697.g2f5f6028.el8.x86_64 142/170 2023-11-28T12:04:39.716 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : rbd-nbd-2:18.0.0-2697.g2f5f6028.el8.x86_64 143/170 2023-11-28T12:04:40.123 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : iproute-6.2.0-5.el8.x86_64 144/170 2023-11-28T12:04:40.425 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : openssl-1:1.1.1k-11.el8.x86_64 145/170 2023-11-28T12:04:40.581 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : NetworkManager-initscripts-updown-1:1.40.16-11.e 146/170 2023-11-28T12:04:40.627 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-11.e 146/170 2023-11-28T12:04:40.824 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 147/170 2023-11-28T12:04:41.072 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : flex-2.6.1-9.el8.x86_64 148/170 2023-11-28T12:04:41.182 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 148/170 2023-11-28T12:04:41.464 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : bison-3.0.4-10.el8.x86_64 149/170 2023-11-28T12:04:41.492 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 149/170 2023-11-28T12:04:41.708 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 150/170 2023-11-28T12:04:41.949 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 151/170 2023-11-28T12:04:42.174 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : openssl-1:1.1.1k-9.el8.x86_64 152/170 2023-11-28T12:04:42.377 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 153/170 2023-11-28T12:04:42.378 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 154/170 2023-11-28T12:04:42.669 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 154/170 2023-11-28T12:04:42.669 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 155/170 2023-11-28T12:04:42.993 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 155/170 2023-11-28T12:04:43.124 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : libacl-devel-2.2.53-1.el8.x86_64 156/170 2023-11-28T12:04:43.141 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-4.el 157/170 2023-11-28T12:04:43.262 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : NetworkManager-initscripts-updown-1:1.40.16-4.el 157/170 2023-11-28T12:04:43.262 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 158/170 2023-11-28T12:04:43.568 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 158/170 2023-11-28T12:04:43.762 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : acl-2.2.53-1.el8.x86_64 159/170 2023-11-28T12:04:43.949 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : iproute-6.2.0-1.el8.x86_64 160/170 2023-11-28T12:04:44.201 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 161/170 2023-11-28T12:04:44.449 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 162/170 2023-11-28T12:04:44.449 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 163/170 2023-11-28T12:04:44.683 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 163/170 2023-11-28T12:04:44.684 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 164/170 2023-11-28T12:04:44.925 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 164/170 2023-11-28T12:04:44.925 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 165/170 2023-11-28T12:04:45.175 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 165/170 2023-11-28T12:04:45.176 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 166/170 2023-11-28T12:04:45.442 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 166/170 2023-11-28T12:04:45.442 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 167/170 2023-11-28T12:04:45.692 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 167/170 2023-11-28T12:04:45.890 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 168/170 2023-11-28T12:04:46.033 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : libacl-2.2.53-1.el8.x86_64 169/170 2023-11-28T12:04:46.033 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : openssl-libs-1:1.1.1k-9.el8.x86_64 170/170 2023-11-28T12:04:46.566 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: openssl-libs-1:1.1.1k-9.el8.x86_64 170/170 2023-11-28T12:04:46.566 INFO:teuthology.orchestra.run.smithi152.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-11-28T12:04:46.566 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-11-28T12:04:47.304 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-2:18.0.0-2697.g2f5f6028.el8.x86_64 1/170 2023-11-28T12:04:47.305 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-base-2:18.0.0-2697.g2f5f6028.el8.x86_64 2/170 2023-11-28T12:04:47.305 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-common-2:18.0.0-2697.g2f5f6028.el8.x86_64 3/170 2023-11-28T12:04:47.305 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-fuse-2:18.0.0-2697.g2f5f6028.el8.x86_64 4/170 2023-11-28T12:04:47.305 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-2697.g2f5f6 5/170 2023-11-28T12:04:47.305 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mds-2:18.0.0-2697.g2f5f6028.el8.x86_64 6/170 2023-11-28T12:04:47.305 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-2:18.0.0-2697.g2f5f6028.el8.x86_64 7/170 2023-11-28T12:04:47.305 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mon-2:18.0.0-2697.g2f5f6028.el8.x86_64 8/170 2023-11-28T12:04:47.305 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-osd-2:18.0.0-2697.g2f5f6028.el8.x86_64 9/170 2023-11-28T12:04:47.305 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-radosgw-2:18.0.0-2697.g2f5f6028.el8.x86_64 10/170 2023-11-28T12:04:47.305 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-selinux-2:18.0.0-2697.g2f5f6028.el8.x86_64 11/170 2023-11-28T12:04:47.306 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-test-2:18.0.0-2697.g2f5f6028.el8.x86_64 12/170 2023-11-28T12:04:47.306 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : cephfs-mirror-2:18.0.0-2697.g2f5f6028.el8.x86_64 13/170 2023-11-28T12:04:47.306 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libcephfs-devel-2:18.0.0-2697.g2f5f6028.el8.x86_ 14/170 2023-11-28T12:04:47.306 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libcephfs2-2:18.0.0-2697.g2f5f6028.el8.x86_64 15/170 2023-11-28T12:04:47.306 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libcephsqlite-2:18.0.0-2697.g2f5f6028.el8.x86_64 16/170 2023-11-28T12:04:47.306 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librados-devel-2:18.0.0-2697.g2f5f6028.el8.x86_6 17/170 2023-11-28T12:04:47.306 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libradosstriper1-2:18.0.0-2697.g2f5f6028.el8.x86 18/170 2023-11-28T12:04:47.306 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librgw2-2:18.0.0-2697.g2f5f6028.el8.x86_64 19/170 2023-11-28T12:04:47.306 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-ceph-argparse-2:18.0.0-2697.g2f5f6028.el 20/170 2023-11-28T12:04:47.306 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-ceph-common-2:18.0.0-2697.g2f5f6028.el8. 21/170 2023-11-28T12:04:47.306 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cephfs-2:18.0.0-2697.g2f5f6028.el8.x86_6 22/170 2023-11-28T12:04:47.307 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-rados-2:18.0.0-2697.g2f5f6028.el8.x86_64 23/170 2023-11-28T12:04:47.307 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-rbd-2:18.0.0-2697.g2f5f6028.el8.x86_64 24/170 2023-11-28T12:04:47.307 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-rgw-2:18.0.0-2697.g2f5f6028.el8.x86_64 25/170 2023-11-28T12:04:47.307 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : rbd-fuse-2:18.0.0-2697.g2f5f6028.el8.x86_64 26/170 2023-11-28T12:04:47.307 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : rbd-mirror-2:18.0.0-2697.g2f5f6028.el8.x86_64 27/170 2023-11-28T12:04:47.307 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : rbd-nbd-2:18.0.0-2697.g2f5f6028.el8.x86_64 28/170 2023-11-28T12:04:47.307 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-2697.g2f5f6028. 29/170 2023-11-28T12:04:47.320 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-2697.g2f5f6028.el8.noa 30/170 2023-11-28T12:04:47.320 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-2697.g2f5f6028.el8.n 31/170 2023-11-28T12:04:47.320 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-2697.g2f5 32/170 2023-11-28T12:04:47.320 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-2697.g2f5f6028.el 33/170 2023-11-28T12:04:47.320 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-rook-2:18.0.0-2697.g2f5f6028.el8.noarch 34/170 2023-11-28T12:04:47.321 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-2697.g2f5f6028.e 35/170 2023-11-28T12:04:47.321 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-volume-2:18.0.0-2697.g2f5f6028.el8.noarch 36/170 2023-11-28T12:04:47.321 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : cephadm-2:18.0.0-2697.g2f5f6028.el8.noarch 37/170 2023-11-28T12:04:47.321 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : cephfs-top-2:18.0.0-2697.g2f5f6028.el8.noarch 38/170 2023-11-28T12:04:47.321 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : automake-1.16.1-8.el8.noarch 39/170 2023-11-28T12:04:47.321 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : bison-3.0.4-10.el8.x86_64 40/170 2023-11-28T12:04:47.321 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : flex-2.6.1-9.el8.x86_64 41/170 2023-11-28T12:04:47.321 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : jq-1.6-8.el8.x86_64 42/170 2023-11-28T12:04:47.321 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libpq-13.5-1.el8.x86_64 43/170 2023-11-28T12:04:47.322 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 44/170 2023-11-28T12:04:47.322 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 45/170 2023-11-28T12:04:47.322 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 46/170 2023-11-28T12:04:47.322 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 47/170 2023-11-28T12:04:47.322 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 48/170 2023-11-28T12:04:47.322 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 49/170 2023-11-28T12:04:47.322 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : postgresql-10.23-2.module_el8+572+929c87ac.x86_6 50/170 2023-11-28T12:04:47.322 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : postgresql-contrib-10.23-2.module_el8+572+929c87 51/170 2023-11-28T12:04:47.322 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : postgresql-server-10.23-2.module_el8+572+929c87a 52/170 2023-11-28T12:04:47.322 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 53/170 2023-11-28T12:04:47.322 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 54/170 2023-11-28T12:04:47.323 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 55/170 2023-11-28T12:04:47.323 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 56/170 2023-11-28T12:04:47.323 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 57/170 2023-11-28T12:04:47.323 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 58/170 2023-11-28T12:04:47.323 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 59/170 2023-11-28T12:04:47.323 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 60/170 2023-11-28T12:04:47.323 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 61/170 2023-11-28T12:04:47.323 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 62/170 2023-11-28T12:04:47.323 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 63/170 2023-11-28T12:04:47.323 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 64/170 2023-11-28T12:04:47.323 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 65/170 2023-11-28T12:04:47.323 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 66/170 2023-11-28T12:04:47.324 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 67/170 2023-11-28T12:04:47.324 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 68/170 2023-11-28T12:04:47.324 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 69/170 2023-11-28T12:04:47.324 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 70/170 2023-11-28T12:04:47.324 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : elfutils-libelf-devel-0.190-1.el8.x86_64 71/170 2023-11-28T12:04:47.324 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 72/170 2023-11-28T12:04:47.324 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 73/170 2023-11-28T12:04:47.324 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 74/170 2023-11-28T12:04:47.324 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 75/170 2023-11-28T12:04:47.324 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 76/170 2023-11-28T12:04:47.324 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libgfortran-8.5.0-21.el8.x86_64 77/170 2023-11-28T12:04:47.324 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libquadmath-8.5.0-21.el8.x86_64 78/170 2023-11-28T12:04:47.325 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 79/170 2023-11-28T12:04:47.325 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 80/170 2023-11-28T12:04:47.325 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 81/170 2023-11-28T12:04:47.325 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libuuid-devel-2.32.1-43.el8.x86_64 82/170 2023-11-28T12:04:47.325 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 83/170 2023-11-28T12:04:47.325 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 84/170 2023-11-28T12:04:47.325 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : openssl-devel-1:1.1.1k-11.el8.x86_64 85/170 2023-11-28T12:04:47.325 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 86/170 2023-11-28T12:04:47.325 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 87/170 2023-11-28T12:04:47.325 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 88/170 2023-11-28T12:04:47.325 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 89/170 2023-11-28T12:04:47.325 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 90/170 2023-11-28T12:04:47.326 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 91/170 2023-11-28T12:04:47.326 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 92/170 2023-11-28T12:04:47.326 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 93/170 2023-11-28T12:04:47.326 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 94/170 2023-11-28T12:04:47.326 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 95/170 2023-11-28T12:04:47.326 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 96/170 2023-11-28T12:04:47.326 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 97/170 2023-11-28T12:04:47.326 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 98/170 2023-11-28T12:04:47.326 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 99/170 2023-11-28T12:04:47.326 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 100/170 2023-11-28T12:04:47.326 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 101/170 2023-11-28T12:04:47.326 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 102/170 2023-11-28T12:04:47.327 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 103/170 2023-11-28T12:04:47.327 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 104/170 2023-11-28T12:04:47.327 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 105/170 2023-11-28T12:04:47.327 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 106/170 2023-11-28T12:04:47.327 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 107/170 2023-11-28T12:04:47.327 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 108/170 2023-11-28T12:04:47.327 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 109/170 2023-11-28T12:04:47.327 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 110/170 2023-11-28T12:04:47.327 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 111/170 2023-11-28T12:04:47.327 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 112/170 2023-11-28T12:04:47.327 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 113/170 2023-11-28T12:04:47.327 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 114/170 2023-11-28T12:04:47.328 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-portend-2.6-1.el8.noarch 115/170 2023-11-28T12:04:47.328 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 116/170 2023-11-28T12:04:47.328 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 117/170 2023-11-28T12:04:47.328 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 118/170 2023-11-28T12:04:47.328 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 119/170 2023-11-28T12:04:47.328 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 120/170 2023-11-28T12:04:47.328 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 121/170 2023-11-28T12:04:47.328 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 122/170 2023-11-28T12:04:47.328 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 123/170 2023-11-28T12:04:47.328 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 124/170 2023-11-28T12:04:47.328 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 125/170 2023-11-28T12:04:47.328 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 126/170 2023-11-28T12:04:47.328 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 127/170 2023-11-28T12:04:47.329 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 128/170 2023-11-28T12:04:47.329 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librados2-2:18.0.0-2697.g2f5f6028.el8.x86_64 129/170 2023-11-28T12:04:47.329 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/170 2023-11-28T12:04:47.329 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librbd1-2:18.0.0-2697.g2f5f6028.el8.x86_64 131/170 2023-11-28T12:04:47.329 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/170 2023-11-28T12:04:47.329 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-11.e 133/170 2023-11-28T12:04:47.329 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-4.el 134/170 2023-11-28T12:04:47.329 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : acl-2.2.53-3.el8.x86_64 135/170 2023-11-28T12:04:47.329 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : acl-2.2.53-1.el8.x86_64 136/170 2023-11-28T12:04:47.329 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : elfutils-debuginfod-client-0.190-1.el8.x86_64 137/170 2023-11-28T12:04:47.329 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 138/170 2023-11-28T12:04:47.329 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : elfutils-libelf-0.190-1.el8.x86_64 139/170 2023-11-28T12:04:47.330 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 140/170 2023-11-28T12:04:47.330 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : elfutils-libs-0.190-1.el8.x86_64 141/170 2023-11-28T12:04:47.330 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 142/170 2023-11-28T12:04:47.330 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : iproute-6.2.0-5.el8.x86_64 143/170 2023-11-28T12:04:47.330 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : iproute-6.2.0-1.el8.x86_64 144/170 2023-11-28T12:04:47.330 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libacl-2.2.53-3.el8.x86_64 145/170 2023-11-28T12:04:47.330 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libacl-2.2.53-1.el8.x86_64 146/170 2023-11-28T12:04:47.330 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libacl-devel-2.2.53-3.el8.x86_64 147/170 2023-11-28T12:04:47.330 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libacl-devel-2.2.53-1.el8.x86_64 148/170 2023-11-28T12:04:47.330 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libblkid-2.32.1-43.el8.x86_64 149/170 2023-11-28T12:04:47.330 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 150/170 2023-11-28T12:04:47.330 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libfdisk-2.32.1-43.el8.x86_64 151/170 2023-11-28T12:04:47.331 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 152/170 2023-11-28T12:04:47.331 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libmount-2.32.1-43.el8.x86_64 153/170 2023-11-28T12:04:47.331 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 154/170 2023-11-28T12:04:47.331 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libsmartcols-2.32.1-43.el8.x86_64 155/170 2023-11-28T12:04:47.331 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 156/170 2023-11-28T12:04:47.331 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libuuid-2.32.1-43.el8.x86_64 157/170 2023-11-28T12:04:47.331 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 158/170 2023-11-28T12:04:47.331 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : openssl-1:1.1.1k-11.el8.x86_64 159/170 2023-11-28T12:04:47.331 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : openssl-1:1.1.1k-9.el8.x86_64 160/170 2023-11-28T12:04:47.331 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : openssl-libs-1:1.1.1k-11.el8.x86_64 161/170 2023-11-28T12:04:47.331 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : openssl-libs-1:1.1.1k-9.el8.x86_64 162/170 2023-11-28T12:04:47.331 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : util-linux-2.32.1-43.el8.x86_64 163/170 2023-11-28T12:04:47.332 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 164/170 2023-11-28T12:04:47.332 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : util-linux-user-2.32.1-43.el8.x86_64 165/170 2023-11-28T12:04:47.332 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 166/170 2023-11-28T12:04:47.332 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : xfsdump-3.1.8-7.el8.x86_64 167/170 2023-11-28T12:04:47.332 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 168/170 2023-11-28T12:04:47.332 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 169/170 2023-11-28T12:04:49.665 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 170/170 2023-11-28T12:04:49.665 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-11-28T12:04:49.665 INFO:teuthology.orchestra.run.smithi152.stdout:Upgraded: 2023-11-28T12:04:49.666 INFO:teuthology.orchestra.run.smithi152.stdout: NetworkManager-initscripts-updown-1:1.40.16-11.el8.noarch 2023-11-28T12:04:49.666 INFO:teuthology.orchestra.run.smithi152.stdout: acl-2.2.53-3.el8.x86_64 2023-11-28T12:04:49.666 INFO:teuthology.orchestra.run.smithi152.stdout: elfutils-debuginfod-client-0.190-1.el8.x86_64 2023-11-28T12:04:49.666 INFO:teuthology.orchestra.run.smithi152.stdout: elfutils-libelf-0.190-1.el8.x86_64 2023-11-28T12:04:49.666 INFO:teuthology.orchestra.run.smithi152.stdout: elfutils-libs-0.190-1.el8.x86_64 2023-11-28T12:04:49.666 INFO:teuthology.orchestra.run.smithi152.stdout: iproute-6.2.0-5.el8.x86_64 2023-11-28T12:04:49.666 INFO:teuthology.orchestra.run.smithi152.stdout: libacl-2.2.53-3.el8.x86_64 2023-11-28T12:04:49.666 INFO:teuthology.orchestra.run.smithi152.stdout: libacl-devel-2.2.53-3.el8.x86_64 2023-11-28T12:04:49.666 INFO:teuthology.orchestra.run.smithi152.stdout: libblkid-2.32.1-43.el8.x86_64 2023-11-28T12:04:49.666 INFO:teuthology.orchestra.run.smithi152.stdout: libfdisk-2.32.1-43.el8.x86_64 2023-11-28T12:04:49.667 INFO:teuthology.orchestra.run.smithi152.stdout: libmount-2.32.1-43.el8.x86_64 2023-11-28T12:04:49.667 INFO:teuthology.orchestra.run.smithi152.stdout: librados2-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T12:04:49.667 INFO:teuthology.orchestra.run.smithi152.stdout: librbd1-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T12:04:49.667 INFO:teuthology.orchestra.run.smithi152.stdout: libsmartcols-2.32.1-43.el8.x86_64 2023-11-28T12:04:49.667 INFO:teuthology.orchestra.run.smithi152.stdout: libuuid-2.32.1-43.el8.x86_64 2023-11-28T12:04:49.667 INFO:teuthology.orchestra.run.smithi152.stdout: openssl-1:1.1.1k-11.el8.x86_64 2023-11-28T12:04:49.667 INFO:teuthology.orchestra.run.smithi152.stdout: openssl-libs-1:1.1.1k-11.el8.x86_64 2023-11-28T12:04:49.667 INFO:teuthology.orchestra.run.smithi152.stdout: util-linux-2.32.1-43.el8.x86_64 2023-11-28T12:04:49.667 INFO:teuthology.orchestra.run.smithi152.stdout: util-linux-user-2.32.1-43.el8.x86_64 2023-11-28T12:04:49.667 INFO:teuthology.orchestra.run.smithi152.stdout: xfsdump-3.1.8-7.el8.x86_64 2023-11-28T12:04:49.667 INFO:teuthology.orchestra.run.smithi152.stdout: xfsprogs-5.0.0-12.el8.x86_64 2023-11-28T12:04:49.668 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2023-11-28T12:04:49.668 INFO:teuthology.orchestra.run.smithi152.stdout: automake-1.16.1-8.el8.noarch 2023-11-28T12:04:49.668 INFO:teuthology.orchestra.run.smithi152.stdout: bison-3.0.4-10.el8.x86_64 2023-11-28T12:04:49.668 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T12:04:49.668 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-base-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T12:04:49.668 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-common-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T12:04:49.668 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-fuse-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T12:04:49.668 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-grafana-dashboards-2:18.0.0-2697.g2f5f6028.el8.noarch 2023-11-28T12:04:49.668 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-immutable-object-cache-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T12:04:49.668 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mds-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T12:04:49.668 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T12:04:49.669 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-cephadm-2:18.0.0-2697.g2f5f6028.el8.noarch 2023-11-28T12:04:49.669 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-dashboard-2:18.0.0-2697.g2f5f6028.el8.noarch 2023-11-28T12:04:49.669 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-diskprediction-local-2:18.0.0-2697.g2f5f6028.el8.noarch 2023-11-28T12:04:49.669 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-modules-core-2:18.0.0-2697.g2f5f6028.el8.noarch 2023-11-28T12:04:49.669 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-rook-2:18.0.0-2697.g2f5f6028.el8.noarch 2023-11-28T12:04:49.669 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mon-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T12:04:49.669 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-osd-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T12:04:49.669 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-prometheus-alerts-2:18.0.0-2697.g2f5f6028.el8.noarch 2023-11-28T12:04:49.669 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-radosgw-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T12:04:49.669 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-selinux-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T12:04:49.669 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-test-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T12:04:49.669 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-volume-2:18.0.0-2697.g2f5f6028.el8.noarch 2023-11-28T12:04:49.670 INFO:teuthology.orchestra.run.smithi152.stdout: cephadm-2:18.0.0-2697.g2f5f6028.el8.noarch 2023-11-28T12:04:49.670 INFO:teuthology.orchestra.run.smithi152.stdout: cephfs-mirror-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T12:04:49.670 INFO:teuthology.orchestra.run.smithi152.stdout: cephfs-top-2:18.0.0-2697.g2f5f6028.el8.noarch 2023-11-28T12:04:49.670 INFO:teuthology.orchestra.run.smithi152.stdout: elfutils-libelf-devel-0.190-1.el8.x86_64 2023-11-28T12:04:49.670 INFO:teuthology.orchestra.run.smithi152.stdout: flex-2.6.1-9.el8.x86_64 2023-11-28T12:04:49.670 INFO:teuthology.orchestra.run.smithi152.stdout: fuse-2.9.7-17.el8.x86_64 2023-11-28T12:04:49.670 INFO:teuthology.orchestra.run.smithi152.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-11-28T12:04:49.670 INFO:teuthology.orchestra.run.smithi152.stdout: jq-1.6-8.el8.x86_64 2023-11-28T12:04:49.670 INFO:teuthology.orchestra.run.smithi152.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-11-28T12:04:49.670 INFO:teuthology.orchestra.run.smithi152.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-11-28T12:04:49.670 INFO:teuthology.orchestra.run.smithi152.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-11-28T12:04:49.670 INFO:teuthology.orchestra.run.smithi152.stdout: libcephfs-devel-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T12:04:49.671 INFO:teuthology.orchestra.run.smithi152.stdout: libcephfs2-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T12:04:49.671 INFO:teuthology.orchestra.run.smithi152.stdout: libcephsqlite-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T12:04:49.671 INFO:teuthology.orchestra.run.smithi152.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-11-28T12:04:49.671 INFO:teuthology.orchestra.run.smithi152.stdout: libgfortran-8.5.0-21.el8.x86_64 2023-11-28T12:04:49.671 INFO:teuthology.orchestra.run.smithi152.stdout: liboath-2.6.2-3.el8.x86_64 2023-11-28T12:04:49.671 INFO:teuthology.orchestra.run.smithi152.stdout: libpq-13.5-1.el8.x86_64 2023-11-28T12:04:49.671 INFO:teuthology.orchestra.run.smithi152.stdout: libquadmath-8.5.0-21.el8.x86_64 2023-11-28T12:04:49.671 INFO:teuthology.orchestra.run.smithi152.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-11-28T12:04:49.671 INFO:teuthology.orchestra.run.smithi152.stdout: librados-devel-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T12:04:49.671 INFO:teuthology.orchestra.run.smithi152.stdout: libradosstriper1-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T12:04:49.671 INFO:teuthology.orchestra.run.smithi152.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-11-28T12:04:49.671 INFO:teuthology.orchestra.run.smithi152.stdout: librgw2-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T12:04:49.671 INFO:teuthology.orchestra.run.smithi152.stdout: libselinux-devel-2.9-8.el8.x86_64 2023-11-28T12:04:49.672 INFO:teuthology.orchestra.run.smithi152.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-11-28T12:04:49.672 INFO:teuthology.orchestra.run.smithi152.stdout: libtool-2.4.6-25.el8.x86_64 2023-11-28T12:04:49.672 INFO:teuthology.orchestra.run.smithi152.stdout: libunwind-1.3.1-3.el8.x86_64 2023-11-28T12:04:49.672 INFO:teuthology.orchestra.run.smithi152.stdout: libuuid-devel-2.32.1-43.el8.x86_64 2023-11-28T12:04:49.672 INFO:teuthology.orchestra.run.smithi152.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-11-28T12:04:49.672 INFO:teuthology.orchestra.run.smithi152.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-11-28T12:04:49.672 INFO:teuthology.orchestra.run.smithi152.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-11-28T12:04:49.672 INFO:teuthology.orchestra.run.smithi152.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-11-28T12:04:49.672 INFO:teuthology.orchestra.run.smithi152.stdout: openblas-0.3.15-4.el8.x86_64 2023-11-28T12:04:49.672 INFO:teuthology.orchestra.run.smithi152.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-11-28T12:04:49.672 INFO:teuthology.orchestra.run.smithi152.stdout: openssl-devel-1:1.1.1k-11.el8.x86_64 2023-11-28T12:04:49.672 INFO:teuthology.orchestra.run.smithi152.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-11-28T12:04:49.673 INFO:teuthology.orchestra.run.smithi152.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-11-28T12:04:49.673 INFO:teuthology.orchestra.run.smithi152.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-11-28T12:04:49.673 INFO:teuthology.orchestra.run.smithi152.stdout: postgresql-10.23-2.module_el8+572+929c87ac.x86_64 2023-11-28T12:04:49.673 INFO:teuthology.orchestra.run.smithi152.stdout: postgresql-contrib-10.23-2.module_el8+572+929c87ac.x86_64 2023-11-28T12:04:49.673 INFO:teuthology.orchestra.run.smithi152.stdout: postgresql-server-10.23-2.module_el8+572+929c87ac.x86_64 2023-11-28T12:04:49.673 INFO:teuthology.orchestra.run.smithi152.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-11-28T12:04:49.673 INFO:teuthology.orchestra.run.smithi152.stdout: python3-babel-2.5.1-7.el8.noarch 2023-11-28T12:04:49.673 INFO:teuthology.orchestra.run.smithi152.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-11-28T12:04:49.673 INFO:teuthology.orchestra.run.smithi152.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-11-28T12:04:49.673 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-11-28T12:04:49.673 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ceph-argparse-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T12:04:49.673 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ceph-common-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T12:04:49.674 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cephfs-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T12:04:49.674 INFO:teuthology.orchestra.run.smithi152.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-11-28T12:04:49.674 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-11-28T12:04:49.674 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-11-28T12:04:49.674 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-11-28T12:04:49.674 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-11-28T12:04:49.674 INFO:teuthology.orchestra.run.smithi152.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-11-28T12:04:49.674 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-6.2-6.el8.noarch 2023-11-28T12:04:49.674 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-11-28T12:04:49.674 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-11-28T12:04:49.674 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-11-28T12:04:49.674 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-11-28T12:04:49.675 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-11-28T12:04:49.675 INFO:teuthology.orchestra.run.smithi152.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-11-28T12:04:49.675 INFO:teuthology.orchestra.run.smithi152.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-11-28T12:04:49.675 INFO:teuthology.orchestra.run.smithi152.stdout: python3-mako-1.0.6-14.el8.noarch 2023-11-28T12:04:49.675 INFO:teuthology.orchestra.run.smithi152.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-11-28T12:04:49.675 INFO:teuthology.orchestra.run.smithi152.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-11-28T12:04:49.675 INFO:teuthology.orchestra.run.smithi152.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-11-28T12:04:49.675 INFO:teuthology.orchestra.run.smithi152.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-11-28T12:04:49.675 INFO:teuthology.orchestra.run.smithi152.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-11-28T12:04:49.675 INFO:teuthology.orchestra.run.smithi152.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-11-28T12:04:49.675 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-11-28T12:04:49.675 INFO:teuthology.orchestra.run.smithi152.stdout: python3-portend-2.6-1.el8.noarch 2023-11-28T12:04:49.676 INFO:teuthology.orchestra.run.smithi152.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-11-28T12:04:49.676 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-11-28T12:04:49.676 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-11-28T12:04:49.676 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-11-28T12:04:49.676 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pycparser-2.14-14.el8.noarch 2023-11-28T12:04:49.676 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pytz-2017.2-11.el8.noarch 2023-11-28T12:04:49.676 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rados-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T12:04:49.676 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rbd-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T12:04:49.676 INFO:teuthology.orchestra.run.smithi152.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-11-28T12:04:49.676 INFO:teuthology.orchestra.run.smithi152.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-11-28T12:04:49.676 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rgw-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T12:04:49.676 INFO:teuthology.orchestra.run.smithi152.stdout: python3-routes-2.4.1-12.el8.noarch 2023-11-28T12:04:49.677 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rsa-4.9-2.el8.noarch 2023-11-28T12:04:49.677 INFO:teuthology.orchestra.run.smithi152.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-11-28T12:04:49.677 INFO:teuthology.orchestra.run.smithi152.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-11-28T12:04:49.677 INFO:teuthology.orchestra.run.smithi152.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-11-28T12:04:49.677 INFO:teuthology.orchestra.run.smithi152.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-11-28T12:04:49.677 INFO:teuthology.orchestra.run.smithi152.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-11-28T12:04:49.677 INFO:teuthology.orchestra.run.smithi152.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-11-28T12:04:49.677 INFO:teuthology.orchestra.run.smithi152.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-11-28T12:04:49.677 INFO:teuthology.orchestra.run.smithi152.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-11-28T12:04:49.677 INFO:teuthology.orchestra.run.smithi152.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-11-28T12:04:49.677 INFO:teuthology.orchestra.run.smithi152.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-11-28T12:04:49.677 INFO:teuthology.orchestra.run.smithi152.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-11-28T12:04:49.678 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-fuse-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T12:04:49.678 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-mirror-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T12:04:49.678 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-nbd-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T12:04:49.678 INFO:teuthology.orchestra.run.smithi152.stdout: socat-1.7.4.1-1.el8.x86_64 2023-11-28T12:04:49.678 INFO:teuthology.orchestra.run.smithi152.stdout: thrift-0.13.0-2.el8.x86_64 2023-11-28T12:04:49.678 INFO:teuthology.orchestra.run.smithi152.stdout: uuid-1.6.2-43.el8.x86_64 2023-11-28T12:04:49.678 INFO:teuthology.orchestra.run.smithi152.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2023-11-28T12:04:49.678 INFO:teuthology.orchestra.run.smithi152.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-11-28T12:04:49.679 INFO:teuthology.orchestra.run.smithi152.stdout: zlib-devel-1.2.11-21.el8.x86_64 2023-11-28T12:04:49.679 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-11-28T12:04:49.679 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2023-11-28T12:04:51.137 DEBUG:teuthology.parallel:result is None 2023-11-28T12:04:53.110 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-selinux-2:18.0.0-2697.g2f5f6028.el8.x86_64 104/170 2023-11-28T12:04:53.111 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /sys 2023-11-28T12:04:53.111 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /proc 2023-11-28T12:04:53.111 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /dev 2023-11-28T12:04:53.111 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /run 2023-11-28T12:04:53.111 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /mnt 2023-11-28T12:04:53.111 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /var/tmp 2023-11-28T12:04:53.111 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /home 2023-11-28T12:04:53.111 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /tmp 2023-11-28T12:04:53.111 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /dev 2023-11-28T12:04:53.112 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:04:53.497 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-volume-2:18.0.0-2697.g2f5f6028.el8.noarch 105/170 2023-11-28T12:04:55.308 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-volume-2:18.0.0-2697.g2f5f6028.el8.noarch 105/170 2023-11-28T12:04:55.549 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-osd-2:18.0.0-2697.g2f5f6028.el8.x86_64 106/170 2023-11-28T12:04:55.828 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-osd-2:18.0.0-2697.g2f5f6028.el8.x86_64 106/170 2023-11-28T12:04:56.005 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mds-2:18.0.0-2697.g2f5f6028.el8.x86_64 107/170 2023-11-28T12:04:56.551 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-mds-2:18.0.0-2697.g2f5f6028.el8.x86_64 107/170 2023-11-28T12:04:56.738 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mon-2:18.0.0-2697.g2f5f6028.el8.x86_64 108/170 2023-11-28T12:04:56.790 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-mon-2:18.0.0-2697.g2f5f6028.el8.x86_64 108/170 2023-11-28T12:04:56.963 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 109/170 2023-11-28T12:04:57.185 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 110/170 2023-11-28T12:04:57.321 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 111/170 2023-11-28T12:04:57.421 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 111/170 2023-11-28T12:04:57.748 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : jq-1.6-8.el8.x86_64 112/170 2023-11-28T12:04:57.963 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : automake-1.16.1-8.el8.noarch 113/170 2023-11-28T12:04:58.600 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: cephadm-2:18.0.0-2697.g2f5f6028.el8.noarch 114/170 2023-11-28T12:04:58.759 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : cephadm-2:18.0.0-2697.g2f5f6028.el8.noarch 114/170 2023-11-28T12:04:58.896 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-2697.g2f5f6028.e 115/170 2023-11-28T12:04:59.093 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-2697.g2f5f6028. 116/170 2023-11-28T12:04:59.287 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-2697.g2f5f6028.el8.noa 117/170 2023-11-28T12:04:59.558 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-2697.g2f5f6028.el8.noa 117/170 2023-11-28T12:04:59.814 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-2697.g2f5f6028.el8.n 118/170 2023-11-28T12:05:00.968 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-2697.g2f5f6028.el8.n 118/170 2023-11-28T12:05:01.195 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-2697.g2f5 119/170 2023-11-28T12:05:01.328 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-2697.g2f5 119/170 2023-11-28T12:05:01.711 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-2697.g2f5f6028.el 120/170 2023-11-28T12:05:01.923 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mgr-2:18.0.0-2697.g2f5f6028.el8.x86_64 121/170 2023-11-28T12:05:01.990 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-mgr-2:18.0.0-2697.g2f5f6028.el8.x86_64 121/170 2023-11-28T12:05:02.145 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mgr-rook-2:18.0.0-2697.g2f5f6028.el8.noarch 122/170 2023-11-28T12:05:02.174 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-2697.g2f5f6028.el8.noarch 122/170 2023-11-28T12:05:02.370 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-2:18.0.0-2697.g2f5f6028.el8.x86_64 123/170 2023-11-28T12:05:02.536 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libtool-2.4.6-25.el8.x86_64 124/170 2023-11-28T12:05:07.602 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 124/170 2023-11-28T12:05:09.190 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-test-2:18.0.0-2697.g2f5f6028.el8.x86_64 125/170 2023-11-28T12:05:09.438 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-radosgw-2:18.0.0-2697.g2f5f6028.el8.x86_64 126/170 2023-11-28T12:05:09.503 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-2697.g2f5f6028.el8.x86_64 126/170 2023-11-28T12:05:09.711 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-2697.g2f5f6 127/170 2023-11-28T12:05:09.785 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-2697.g2f5f6 127/170 2023-11-28T12:05:10.011 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : cephfs-mirror-2:18.0.0-2697.g2f5f6028.el8.x86_64 128/170 2023-11-28T12:05:10.439 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-2697.g2f5f6028.el8.x86_64 128/170 2023-11-28T12:05:10.661 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : rbd-mirror-2:18.0.0-2697.g2f5f6028.el8.x86_64 129/170 2023-11-28T12:05:10.960 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: rbd-mirror-2:18.0.0-2697.g2f5f6028.el8.x86_64 129/170 2023-11-28T12:05:11.278 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : postgresql-contrib-10.23-2.module_el8+572+929c87 130/170 2023-11-28T12:05:12.585 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-fuse-2:18.0.0-2697.g2f5f6028.el8.x86_64 131/170 2023-11-28T12:05:12.900 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : openssl-devel-1:1.1.1k-11.el8.x86_64 132/170 2023-11-28T12:05:13.101 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : elfutils-libelf-devel-0.190-1.el8.x86_64 133/170 2023-11-28T12:05:13.393 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : util-linux-user-2.32.1-43.el8.x86_64 134/170 2023-11-28T12:05:13.583 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 135/170 2023-11-28T12:05:13.779 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libcephfs-devel-2:18.0.0-2697.g2f5f6028.el8.x86_ 136/170 2023-11-28T12:05:14.100 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : acl-2.2.53-3.el8.x86_64 137/170 2023-11-28T12:05:14.261 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : libacl-devel-2.2.53-3.el8.x86_64 138/170 2023-11-28T12:05:15.515 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: postgresql-server-10.23-2.module_el8+572+929c87a 139/170 2023-11-28T12:05:15.794 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : postgresql-server-10.23-2.module_el8+572+929c87a 139/170 2023-11-28T12:05:15.881 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: postgresql-server-10.23-2.module_el8+572+929c87a 139/170 2023-11-28T12:05:16.124 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : xfsdump-3.1.8-7.el8.x86_64 140/170 2023-11-28T12:05:16.328 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : cephfs-top-2:18.0.0-2697.g2f5f6028.el8.noarch 141/170 2023-11-28T12:05:16.570 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : rbd-fuse-2:18.0.0-2697.g2f5f6028.el8.x86_64 142/170 2023-11-28T12:05:16.950 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : rbd-nbd-2:18.0.0-2697.g2f5f6028.el8.x86_64 143/170 2023-11-28T12:05:17.352 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : iproute-6.2.0-5.el8.x86_64 144/170 2023-11-28T12:05:17.671 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : openssl-1:1.1.1k-11.el8.x86_64 145/170 2023-11-28T12:05:17.810 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : NetworkManager-initscripts-updown-1:1.40.16-11.e 146/170 2023-11-28T12:05:17.838 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-11.e 146/170 2023-11-28T12:05:18.030 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 147/170 2023-11-28T12:05:18.234 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : flex-2.6.1-9.el8.x86_64 148/170 2023-11-28T12:05:18.347 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 148/170 2023-11-28T12:05:18.618 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : bison-3.0.4-10.el8.x86_64 149/170 2023-11-28T12:05:18.646 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 149/170 2023-11-28T12:05:18.828 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 150/170 2023-11-28T12:05:19.033 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 151/170 2023-11-28T12:05:19.270 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : openssl-1:1.1.1k-9.el8.x86_64 152/170 2023-11-28T12:05:19.443 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 153/170 2023-11-28T12:05:19.443 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 154/170 2023-11-28T12:05:19.723 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 154/170 2023-11-28T12:05:19.723 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 155/170 2023-11-28T12:05:20.014 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 155/170 2023-11-28T12:05:20.128 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : libacl-devel-2.2.53-1.el8.x86_64 156/170 2023-11-28T12:05:20.146 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-4.el 157/170 2023-11-28T12:05:20.258 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : NetworkManager-initscripts-updown-1:1.40.16-4.el 157/170 2023-11-28T12:05:20.258 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 158/170 2023-11-28T12:05:20.505 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 158/170 2023-11-28T12:05:20.701 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : acl-2.2.53-1.el8.x86_64 159/170 2023-11-28T12:05:20.911 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : iproute-6.2.0-1.el8.x86_64 160/170 2023-11-28T12:05:21.100 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 161/170 2023-11-28T12:05:21.344 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 162/170 2023-11-28T12:05:21.345 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 163/170 2023-11-28T12:05:21.562 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 163/170 2023-11-28T12:05:21.563 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 164/170 2023-11-28T12:05:21.804 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 164/170 2023-11-28T12:05:21.804 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 165/170 2023-11-28T12:05:22.021 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 165/170 2023-11-28T12:05:22.021 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 166/170 2023-11-28T12:05:22.229 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 166/170 2023-11-28T12:05:22.229 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 167/170 2023-11-28T12:05:22.446 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 167/170 2023-11-28T12:05:22.669 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 168/170 2023-11-28T12:05:22.796 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : libacl-2.2.53-1.el8.x86_64 169/170 2023-11-28T12:05:22.796 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : openssl-libs-1:1.1.1k-9.el8.x86_64 170/170 2023-11-28T12:05:23.391 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: openssl-libs-1:1.1.1k-9.el8.x86_64 170/170 2023-11-28T12:05:23.392 INFO:teuthology.orchestra.run.smithi045.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-11-28T12:05:23.392 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:05:24.169 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-2:18.0.0-2697.g2f5f6028.el8.x86_64 1/170 2023-11-28T12:05:24.169 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-base-2:18.0.0-2697.g2f5f6028.el8.x86_64 2/170 2023-11-28T12:05:24.169 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-common-2:18.0.0-2697.g2f5f6028.el8.x86_64 3/170 2023-11-28T12:05:24.169 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-fuse-2:18.0.0-2697.g2f5f6028.el8.x86_64 4/170 2023-11-28T12:05:24.170 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-2697.g2f5f6 5/170 2023-11-28T12:05:24.170 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mds-2:18.0.0-2697.g2f5f6028.el8.x86_64 6/170 2023-11-28T12:05:24.170 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mgr-2:18.0.0-2697.g2f5f6028.el8.x86_64 7/170 2023-11-28T12:05:24.170 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mon-2:18.0.0-2697.g2f5f6028.el8.x86_64 8/170 2023-11-28T12:05:24.170 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-osd-2:18.0.0-2697.g2f5f6028.el8.x86_64 9/170 2023-11-28T12:05:24.170 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-radosgw-2:18.0.0-2697.g2f5f6028.el8.x86_64 10/170 2023-11-28T12:05:24.170 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-selinux-2:18.0.0-2697.g2f5f6028.el8.x86_64 11/170 2023-11-28T12:05:24.170 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-test-2:18.0.0-2697.g2f5f6028.el8.x86_64 12/170 2023-11-28T12:05:24.170 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : cephfs-mirror-2:18.0.0-2697.g2f5f6028.el8.x86_64 13/170 2023-11-28T12:05:24.171 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libcephfs-devel-2:18.0.0-2697.g2f5f6028.el8.x86_ 14/170 2023-11-28T12:05:24.171 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libcephfs2-2:18.0.0-2697.g2f5f6028.el8.x86_64 15/170 2023-11-28T12:05:24.171 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libcephsqlite-2:18.0.0-2697.g2f5f6028.el8.x86_64 16/170 2023-11-28T12:05:24.171 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librados-devel-2:18.0.0-2697.g2f5f6028.el8.x86_6 17/170 2023-11-28T12:05:24.171 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libradosstriper1-2:18.0.0-2697.g2f5f6028.el8.x86 18/170 2023-11-28T12:05:24.171 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librgw2-2:18.0.0-2697.g2f5f6028.el8.x86_64 19/170 2023-11-28T12:05:24.171 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-ceph-argparse-2:18.0.0-2697.g2f5f6028.el 20/170 2023-11-28T12:05:24.171 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-ceph-common-2:18.0.0-2697.g2f5f6028.el8. 21/170 2023-11-28T12:05:24.171 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-cephfs-2:18.0.0-2697.g2f5f6028.el8.x86_6 22/170 2023-11-28T12:05:24.171 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-rados-2:18.0.0-2697.g2f5f6028.el8.x86_64 23/170 2023-11-28T12:05:24.171 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-rbd-2:18.0.0-2697.g2f5f6028.el8.x86_64 24/170 2023-11-28T12:05:24.171 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-rgw-2:18.0.0-2697.g2f5f6028.el8.x86_64 25/170 2023-11-28T12:05:24.172 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : rbd-fuse-2:18.0.0-2697.g2f5f6028.el8.x86_64 26/170 2023-11-28T12:05:24.172 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : rbd-mirror-2:18.0.0-2697.g2f5f6028.el8.x86_64 27/170 2023-11-28T12:05:24.172 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : rbd-nbd-2:18.0.0-2697.g2f5f6028.el8.x86_64 28/170 2023-11-28T12:05:24.172 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-2697.g2f5f6028. 29/170 2023-11-28T12:05:24.172 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-2697.g2f5f6028.el8.noa 30/170 2023-11-28T12:05:24.172 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-2697.g2f5f6028.el8.n 31/170 2023-11-28T12:05:24.172 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-2697.g2f5 32/170 2023-11-28T12:05:24.172 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-2697.g2f5f6028.el 33/170 2023-11-28T12:05:24.172 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mgr-rook-2:18.0.0-2697.g2f5f6028.el8.noarch 34/170 2023-11-28T12:05:24.172 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-2697.g2f5f6028.e 35/170 2023-11-28T12:05:24.172 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-volume-2:18.0.0-2697.g2f5f6028.el8.noarch 36/170 2023-11-28T12:05:24.172 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : cephadm-2:18.0.0-2697.g2f5f6028.el8.noarch 37/170 2023-11-28T12:05:24.173 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : cephfs-top-2:18.0.0-2697.g2f5f6028.el8.noarch 38/170 2023-11-28T12:05:24.173 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : automake-1.16.1-8.el8.noarch 39/170 2023-11-28T12:05:24.173 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : bison-3.0.4-10.el8.x86_64 40/170 2023-11-28T12:05:24.173 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : flex-2.6.1-9.el8.x86_64 41/170 2023-11-28T12:05:24.173 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : jq-1.6-8.el8.x86_64 42/170 2023-11-28T12:05:24.173 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libpq-13.5-1.el8.x86_64 43/170 2023-11-28T12:05:24.173 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 44/170 2023-11-28T12:05:24.173 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 45/170 2023-11-28T12:05:24.173 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 46/170 2023-11-28T12:05:24.173 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 47/170 2023-11-28T12:05:24.173 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 48/170 2023-11-28T12:05:24.174 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 49/170 2023-11-28T12:05:24.174 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : postgresql-10.23-2.module_el8+572+929c87ac.x86_6 50/170 2023-11-28T12:05:24.174 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : postgresql-contrib-10.23-2.module_el8+572+929c87 51/170 2023-11-28T12:05:24.174 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : postgresql-server-10.23-2.module_el8+572+929c87a 52/170 2023-11-28T12:05:24.174 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 53/170 2023-11-28T12:05:24.174 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 54/170 2023-11-28T12:05:24.174 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 55/170 2023-11-28T12:05:24.174 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 56/170 2023-11-28T12:05:24.174 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 57/170 2023-11-28T12:05:24.174 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 58/170 2023-11-28T12:05:24.174 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 59/170 2023-11-28T12:05:24.174 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 60/170 2023-11-28T12:05:24.175 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 61/170 2023-11-28T12:05:24.175 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 62/170 2023-11-28T12:05:24.175 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 63/170 2023-11-28T12:05:24.175 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 64/170 2023-11-28T12:05:24.175 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 65/170 2023-11-28T12:05:24.175 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 66/170 2023-11-28T12:05:24.175 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 67/170 2023-11-28T12:05:24.175 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 68/170 2023-11-28T12:05:24.175 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 69/170 2023-11-28T12:05:24.175 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 70/170 2023-11-28T12:05:24.175 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : elfutils-libelf-devel-0.190-1.el8.x86_64 71/170 2023-11-28T12:05:24.175 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 72/170 2023-11-28T12:05:24.176 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 73/170 2023-11-28T12:05:24.176 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 74/170 2023-11-28T12:05:24.176 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 75/170 2023-11-28T12:05:24.176 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 76/170 2023-11-28T12:05:24.176 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libgfortran-8.5.0-21.el8.x86_64 77/170 2023-11-28T12:05:24.176 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libquadmath-8.5.0-21.el8.x86_64 78/170 2023-11-28T12:05:24.176 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 79/170 2023-11-28T12:05:24.176 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 80/170 2023-11-28T12:05:24.176 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 81/170 2023-11-28T12:05:24.176 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libuuid-devel-2.32.1-43.el8.x86_64 82/170 2023-11-28T12:05:24.176 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 83/170 2023-11-28T12:05:24.176 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 84/170 2023-11-28T12:05:24.177 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : openssl-devel-1:1.1.1k-11.el8.x86_64 85/170 2023-11-28T12:05:24.177 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 86/170 2023-11-28T12:05:24.177 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 87/170 2023-11-28T12:05:24.177 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 88/170 2023-11-28T12:05:24.177 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 89/170 2023-11-28T12:05:24.177 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 90/170 2023-11-28T12:05:24.177 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 91/170 2023-11-28T12:05:24.177 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 92/170 2023-11-28T12:05:24.177 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 93/170 2023-11-28T12:05:24.177 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 94/170 2023-11-28T12:05:24.177 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 95/170 2023-11-28T12:05:24.177 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 96/170 2023-11-28T12:05:24.178 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 97/170 2023-11-28T12:05:24.178 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 98/170 2023-11-28T12:05:24.178 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 99/170 2023-11-28T12:05:24.178 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 100/170 2023-11-28T12:05:24.178 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 101/170 2023-11-28T12:05:24.178 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 102/170 2023-11-28T12:05:24.178 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 103/170 2023-11-28T12:05:24.178 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 104/170 2023-11-28T12:05:24.178 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 105/170 2023-11-28T12:05:24.178 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 106/170 2023-11-28T12:05:24.178 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 107/170 2023-11-28T12:05:24.178 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 108/170 2023-11-28T12:05:24.178 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 109/170 2023-11-28T12:05:24.179 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 110/170 2023-11-28T12:05:24.179 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 111/170 2023-11-28T12:05:24.179 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 112/170 2023-11-28T12:05:24.179 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 113/170 2023-11-28T12:05:24.179 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 114/170 2023-11-28T12:05:24.179 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-portend-2.6-1.el8.noarch 115/170 2023-11-28T12:05:24.179 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 116/170 2023-11-28T12:05:24.179 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 117/170 2023-11-28T12:05:24.179 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 118/170 2023-11-28T12:05:24.179 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 119/170 2023-11-28T12:05:24.179 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 120/170 2023-11-28T12:05:24.179 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 121/170 2023-11-28T12:05:24.180 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 122/170 2023-11-28T12:05:24.180 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 123/170 2023-11-28T12:05:24.180 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 124/170 2023-11-28T12:05:24.180 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 125/170 2023-11-28T12:05:24.180 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 126/170 2023-11-28T12:05:24.180 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 127/170 2023-11-28T12:05:24.180 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 128/170 2023-11-28T12:05:24.180 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librados2-2:18.0.0-2697.g2f5f6028.el8.x86_64 129/170 2023-11-28T12:05:24.180 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/170 2023-11-28T12:05:24.180 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librbd1-2:18.0.0-2697.g2f5f6028.el8.x86_64 131/170 2023-11-28T12:05:24.180 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/170 2023-11-28T12:05:24.180 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-11.e 133/170 2023-11-28T12:05:24.180 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-4.el 134/170 2023-11-28T12:05:24.181 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : acl-2.2.53-3.el8.x86_64 135/170 2023-11-28T12:05:24.181 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : acl-2.2.53-1.el8.x86_64 136/170 2023-11-28T12:05:24.181 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : elfutils-debuginfod-client-0.190-1.el8.x86_64 137/170 2023-11-28T12:05:24.181 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 138/170 2023-11-28T12:05:24.181 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : elfutils-libelf-0.190-1.el8.x86_64 139/170 2023-11-28T12:05:24.181 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 140/170 2023-11-28T12:05:24.181 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : elfutils-libs-0.190-1.el8.x86_64 141/170 2023-11-28T12:05:24.181 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 142/170 2023-11-28T12:05:24.181 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : iproute-6.2.0-5.el8.x86_64 143/170 2023-11-28T12:05:24.181 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : iproute-6.2.0-1.el8.x86_64 144/170 2023-11-28T12:05:24.181 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libacl-2.2.53-3.el8.x86_64 145/170 2023-11-28T12:05:24.181 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libacl-2.2.53-1.el8.x86_64 146/170 2023-11-28T12:05:24.182 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libacl-devel-2.2.53-3.el8.x86_64 147/170 2023-11-28T12:05:24.182 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libacl-devel-2.2.53-1.el8.x86_64 148/170 2023-11-28T12:05:24.182 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libblkid-2.32.1-43.el8.x86_64 149/170 2023-11-28T12:05:24.182 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 150/170 2023-11-28T12:05:24.182 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libfdisk-2.32.1-43.el8.x86_64 151/170 2023-11-28T12:05:24.182 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 152/170 2023-11-28T12:05:24.182 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libmount-2.32.1-43.el8.x86_64 153/170 2023-11-28T12:05:24.182 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 154/170 2023-11-28T12:05:24.182 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libsmartcols-2.32.1-43.el8.x86_64 155/170 2023-11-28T12:05:24.182 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 156/170 2023-11-28T12:05:24.182 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libuuid-2.32.1-43.el8.x86_64 157/170 2023-11-28T12:05:24.182 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 158/170 2023-11-28T12:05:24.183 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : openssl-1:1.1.1k-11.el8.x86_64 159/170 2023-11-28T12:05:24.183 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : openssl-1:1.1.1k-9.el8.x86_64 160/170 2023-11-28T12:05:24.183 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : openssl-libs-1:1.1.1k-11.el8.x86_64 161/170 2023-11-28T12:05:24.183 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : openssl-libs-1:1.1.1k-9.el8.x86_64 162/170 2023-11-28T12:05:24.183 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : util-linux-2.32.1-43.el8.x86_64 163/170 2023-11-28T12:05:24.183 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 164/170 2023-11-28T12:05:24.183 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : util-linux-user-2.32.1-43.el8.x86_64 165/170 2023-11-28T12:05:24.183 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 166/170 2023-11-28T12:05:24.183 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : xfsdump-3.1.8-7.el8.x86_64 167/170 2023-11-28T12:05:24.183 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 168/170 2023-11-28T12:05:24.183 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 169/170 2023-11-28T12:05:26.533 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 170/170 2023-11-28T12:05:26.533 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:05:26.533 INFO:teuthology.orchestra.run.smithi045.stdout:Upgraded: 2023-11-28T12:05:26.533 INFO:teuthology.orchestra.run.smithi045.stdout: NetworkManager-initscripts-updown-1:1.40.16-11.el8.noarch 2023-11-28T12:05:26.533 INFO:teuthology.orchestra.run.smithi045.stdout: acl-2.2.53-3.el8.x86_64 2023-11-28T12:05:26.533 INFO:teuthology.orchestra.run.smithi045.stdout: elfutils-debuginfod-client-0.190-1.el8.x86_64 2023-11-28T12:05:26.533 INFO:teuthology.orchestra.run.smithi045.stdout: elfutils-libelf-0.190-1.el8.x86_64 2023-11-28T12:05:26.533 INFO:teuthology.orchestra.run.smithi045.stdout: elfutils-libs-0.190-1.el8.x86_64 2023-11-28T12:05:26.534 INFO:teuthology.orchestra.run.smithi045.stdout: iproute-6.2.0-5.el8.x86_64 2023-11-28T12:05:26.534 INFO:teuthology.orchestra.run.smithi045.stdout: libacl-2.2.53-3.el8.x86_64 2023-11-28T12:05:26.534 INFO:teuthology.orchestra.run.smithi045.stdout: libacl-devel-2.2.53-3.el8.x86_64 2023-11-28T12:05:26.534 INFO:teuthology.orchestra.run.smithi045.stdout: libblkid-2.32.1-43.el8.x86_64 2023-11-28T12:05:26.534 INFO:teuthology.orchestra.run.smithi045.stdout: libfdisk-2.32.1-43.el8.x86_64 2023-11-28T12:05:26.534 INFO:teuthology.orchestra.run.smithi045.stdout: libmount-2.32.1-43.el8.x86_64 2023-11-28T12:05:26.534 INFO:teuthology.orchestra.run.smithi045.stdout: librados2-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T12:05:26.534 INFO:teuthology.orchestra.run.smithi045.stdout: librbd1-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T12:05:26.534 INFO:teuthology.orchestra.run.smithi045.stdout: libsmartcols-2.32.1-43.el8.x86_64 2023-11-28T12:05:26.534 INFO:teuthology.orchestra.run.smithi045.stdout: libuuid-2.32.1-43.el8.x86_64 2023-11-28T12:05:26.534 INFO:teuthology.orchestra.run.smithi045.stdout: openssl-1:1.1.1k-11.el8.x86_64 2023-11-28T12:05:26.534 INFO:teuthology.orchestra.run.smithi045.stdout: openssl-libs-1:1.1.1k-11.el8.x86_64 2023-11-28T12:05:26.535 INFO:teuthology.orchestra.run.smithi045.stdout: util-linux-2.32.1-43.el8.x86_64 2023-11-28T12:05:26.535 INFO:teuthology.orchestra.run.smithi045.stdout: util-linux-user-2.32.1-43.el8.x86_64 2023-11-28T12:05:26.535 INFO:teuthology.orchestra.run.smithi045.stdout: xfsdump-3.1.8-7.el8.x86_64 2023-11-28T12:05:26.535 INFO:teuthology.orchestra.run.smithi045.stdout: xfsprogs-5.0.0-12.el8.x86_64 2023-11-28T12:05:26.535 INFO:teuthology.orchestra.run.smithi045.stdout:Installed: 2023-11-28T12:05:26.535 INFO:teuthology.orchestra.run.smithi045.stdout: automake-1.16.1-8.el8.noarch 2023-11-28T12:05:26.535 INFO:teuthology.orchestra.run.smithi045.stdout: bison-3.0.4-10.el8.x86_64 2023-11-28T12:05:26.535 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T12:05:26.535 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-base-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T12:05:26.535 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-common-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T12:05:26.535 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-fuse-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T12:05:26.535 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-grafana-dashboards-2:18.0.0-2697.g2f5f6028.el8.noarch 2023-11-28T12:05:26.536 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-immutable-object-cache-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T12:05:26.536 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mds-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T12:05:26.536 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T12:05:26.536 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-cephadm-2:18.0.0-2697.g2f5f6028.el8.noarch 2023-11-28T12:05:26.536 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-dashboard-2:18.0.0-2697.g2f5f6028.el8.noarch 2023-11-28T12:05:26.536 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-diskprediction-local-2:18.0.0-2697.g2f5f6028.el8.noarch 2023-11-28T12:05:26.536 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-modules-core-2:18.0.0-2697.g2f5f6028.el8.noarch 2023-11-28T12:05:26.536 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-rook-2:18.0.0-2697.g2f5f6028.el8.noarch 2023-11-28T12:05:26.536 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mon-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T12:05:26.536 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-osd-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T12:05:26.536 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-prometheus-alerts-2:18.0.0-2697.g2f5f6028.el8.noarch 2023-11-28T12:05:26.536 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-radosgw-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T12:05:26.537 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-selinux-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T12:05:26.537 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-test-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T12:05:26.537 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-volume-2:18.0.0-2697.g2f5f6028.el8.noarch 2023-11-28T12:05:26.537 INFO:teuthology.orchestra.run.smithi045.stdout: cephadm-2:18.0.0-2697.g2f5f6028.el8.noarch 2023-11-28T12:05:26.537 INFO:teuthology.orchestra.run.smithi045.stdout: cephfs-mirror-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T12:05:26.537 INFO:teuthology.orchestra.run.smithi045.stdout: cephfs-top-2:18.0.0-2697.g2f5f6028.el8.noarch 2023-11-28T12:05:26.537 INFO:teuthology.orchestra.run.smithi045.stdout: elfutils-libelf-devel-0.190-1.el8.x86_64 2023-11-28T12:05:26.537 INFO:teuthology.orchestra.run.smithi045.stdout: flex-2.6.1-9.el8.x86_64 2023-11-28T12:05:26.537 INFO:teuthology.orchestra.run.smithi045.stdout: fuse-2.9.7-17.el8.x86_64 2023-11-28T12:05:26.537 INFO:teuthology.orchestra.run.smithi045.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-11-28T12:05:26.537 INFO:teuthology.orchestra.run.smithi045.stdout: jq-1.6-8.el8.x86_64 2023-11-28T12:05:26.537 INFO:teuthology.orchestra.run.smithi045.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-11-28T12:05:26.538 INFO:teuthology.orchestra.run.smithi045.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-11-28T12:05:26.538 INFO:teuthology.orchestra.run.smithi045.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-11-28T12:05:26.538 INFO:teuthology.orchestra.run.smithi045.stdout: libcephfs-devel-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T12:05:26.538 INFO:teuthology.orchestra.run.smithi045.stdout: libcephfs2-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T12:05:26.538 INFO:teuthology.orchestra.run.smithi045.stdout: libcephsqlite-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T12:05:26.538 INFO:teuthology.orchestra.run.smithi045.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-11-28T12:05:26.538 INFO:teuthology.orchestra.run.smithi045.stdout: libgfortran-8.5.0-21.el8.x86_64 2023-11-28T12:05:26.538 INFO:teuthology.orchestra.run.smithi045.stdout: liboath-2.6.2-3.el8.x86_64 2023-11-28T12:05:26.538 INFO:teuthology.orchestra.run.smithi045.stdout: libpq-13.5-1.el8.x86_64 2023-11-28T12:05:26.538 INFO:teuthology.orchestra.run.smithi045.stdout: libquadmath-8.5.0-21.el8.x86_64 2023-11-28T12:05:26.538 INFO:teuthology.orchestra.run.smithi045.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-11-28T12:05:26.539 INFO:teuthology.orchestra.run.smithi045.stdout: librados-devel-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T12:05:26.539 INFO:teuthology.orchestra.run.smithi045.stdout: libradosstriper1-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T12:05:26.539 INFO:teuthology.orchestra.run.smithi045.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-11-28T12:05:26.539 INFO:teuthology.orchestra.run.smithi045.stdout: librgw2-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T12:05:26.539 INFO:teuthology.orchestra.run.smithi045.stdout: libselinux-devel-2.9-8.el8.x86_64 2023-11-28T12:05:26.539 INFO:teuthology.orchestra.run.smithi045.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-11-28T12:05:26.539 INFO:teuthology.orchestra.run.smithi045.stdout: libtool-2.4.6-25.el8.x86_64 2023-11-28T12:05:26.539 INFO:teuthology.orchestra.run.smithi045.stdout: libunwind-1.3.1-3.el8.x86_64 2023-11-28T12:05:26.539 INFO:teuthology.orchestra.run.smithi045.stdout: libuuid-devel-2.32.1-43.el8.x86_64 2023-11-28T12:05:26.539 INFO:teuthology.orchestra.run.smithi045.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-11-28T12:05:26.539 INFO:teuthology.orchestra.run.smithi045.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-11-28T12:05:26.539 INFO:teuthology.orchestra.run.smithi045.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-11-28T12:05:26.540 INFO:teuthology.orchestra.run.smithi045.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-11-28T12:05:26.540 INFO:teuthology.orchestra.run.smithi045.stdout: openblas-0.3.15-4.el8.x86_64 2023-11-28T12:05:26.540 INFO:teuthology.orchestra.run.smithi045.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-11-28T12:05:26.540 INFO:teuthology.orchestra.run.smithi045.stdout: openssl-devel-1:1.1.1k-11.el8.x86_64 2023-11-28T12:05:26.540 INFO:teuthology.orchestra.run.smithi045.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-11-28T12:05:26.540 INFO:teuthology.orchestra.run.smithi045.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-11-28T12:05:26.540 INFO:teuthology.orchestra.run.smithi045.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-11-28T12:05:26.540 INFO:teuthology.orchestra.run.smithi045.stdout: postgresql-10.23-2.module_el8+572+929c87ac.x86_64 2023-11-28T12:05:26.540 INFO:teuthology.orchestra.run.smithi045.stdout: postgresql-contrib-10.23-2.module_el8+572+929c87ac.x86_64 2023-11-28T12:05:26.540 INFO:teuthology.orchestra.run.smithi045.stdout: postgresql-server-10.23-2.module_el8+572+929c87ac.x86_64 2023-11-28T12:05:26.540 INFO:teuthology.orchestra.run.smithi045.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-11-28T12:05:26.541 INFO:teuthology.orchestra.run.smithi045.stdout: python3-babel-2.5.1-7.el8.noarch 2023-11-28T12:05:26.541 INFO:teuthology.orchestra.run.smithi045.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-11-28T12:05:26.541 INFO:teuthology.orchestra.run.smithi045.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-11-28T12:05:26.541 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-11-28T12:05:26.541 INFO:teuthology.orchestra.run.smithi045.stdout: python3-ceph-argparse-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T12:05:26.541 INFO:teuthology.orchestra.run.smithi045.stdout: python3-ceph-common-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T12:05:26.541 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cephfs-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T12:05:26.541 INFO:teuthology.orchestra.run.smithi045.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-11-28T12:05:26.541 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-11-28T12:05:26.541 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-11-28T12:05:26.541 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-11-28T12:05:26.541 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-11-28T12:05:26.542 INFO:teuthology.orchestra.run.smithi045.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-11-28T12:05:26.542 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco-6.2-6.el8.noarch 2023-11-28T12:05:26.542 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-11-28T12:05:26.542 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-11-28T12:05:26.542 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-11-28T12:05:26.542 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-11-28T12:05:26.542 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-11-28T12:05:26.542 INFO:teuthology.orchestra.run.smithi045.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-11-28T12:05:26.543 INFO:teuthology.orchestra.run.smithi045.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-11-28T12:05:26.543 INFO:teuthology.orchestra.run.smithi045.stdout: python3-mako-1.0.6-14.el8.noarch 2023-11-28T12:05:26.543 INFO:teuthology.orchestra.run.smithi045.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-11-28T12:05:26.543 INFO:teuthology.orchestra.run.smithi045.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-11-28T12:05:26.543 INFO:teuthology.orchestra.run.smithi045.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-11-28T12:05:26.543 INFO:teuthology.orchestra.run.smithi045.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-11-28T12:05:26.543 INFO:teuthology.orchestra.run.smithi045.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-11-28T12:05:26.543 INFO:teuthology.orchestra.run.smithi045.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-11-28T12:05:26.543 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-11-28T12:05:26.543 INFO:teuthology.orchestra.run.smithi045.stdout: python3-portend-2.6-1.el8.noarch 2023-11-28T12:05:26.543 INFO:teuthology.orchestra.run.smithi045.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-11-28T12:05:26.544 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-11-28T12:05:26.544 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-11-28T12:05:26.544 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-11-28T12:05:26.544 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pycparser-2.14-14.el8.noarch 2023-11-28T12:05:26.544 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pytz-2017.2-11.el8.noarch 2023-11-28T12:05:26.544 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rados-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T12:05:26.544 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rbd-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T12:05:26.544 INFO:teuthology.orchestra.run.smithi045.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-11-28T12:05:26.544 INFO:teuthology.orchestra.run.smithi045.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-11-28T12:05:26.544 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rgw-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T12:05:26.544 INFO:teuthology.orchestra.run.smithi045.stdout: python3-routes-2.4.1-12.el8.noarch 2023-11-28T12:05:26.544 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rsa-4.9-2.el8.noarch 2023-11-28T12:05:26.545 INFO:teuthology.orchestra.run.smithi045.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-11-28T12:05:26.545 INFO:teuthology.orchestra.run.smithi045.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-11-28T12:05:26.545 INFO:teuthology.orchestra.run.smithi045.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-11-28T12:05:26.545 INFO:teuthology.orchestra.run.smithi045.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-11-28T12:05:26.545 INFO:teuthology.orchestra.run.smithi045.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-11-28T12:05:26.545 INFO:teuthology.orchestra.run.smithi045.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-11-28T12:05:26.545 INFO:teuthology.orchestra.run.smithi045.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-11-28T12:05:26.545 INFO:teuthology.orchestra.run.smithi045.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-11-28T12:05:26.545 INFO:teuthology.orchestra.run.smithi045.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-11-28T12:05:26.545 INFO:teuthology.orchestra.run.smithi045.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-11-28T12:05:26.545 INFO:teuthology.orchestra.run.smithi045.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-11-28T12:05:26.545 INFO:teuthology.orchestra.run.smithi045.stdout: rbd-fuse-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T12:05:26.546 INFO:teuthology.orchestra.run.smithi045.stdout: rbd-mirror-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T12:05:26.546 INFO:teuthology.orchestra.run.smithi045.stdout: rbd-nbd-2:18.0.0-2697.g2f5f6028.el8.x86_64 2023-11-28T12:05:26.546 INFO:teuthology.orchestra.run.smithi045.stdout: socat-1.7.4.1-1.el8.x86_64 2023-11-28T12:05:26.546 INFO:teuthology.orchestra.run.smithi045.stdout: thrift-0.13.0-2.el8.x86_64 2023-11-28T12:05:26.550 INFO:teuthology.orchestra.run.smithi045.stdout: uuid-1.6.2-43.el8.x86_64 2023-11-28T12:05:26.550 INFO:teuthology.orchestra.run.smithi045.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2023-11-28T12:05:26.551 INFO:teuthology.orchestra.run.smithi045.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-11-28T12:05:26.551 INFO:teuthology.orchestra.run.smithi045.stdout: zlib-devel-1.2.11-21.el8.x86_64 2023-11-28T12:05:26.551 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:05:26.551 INFO:teuthology.orchestra.run.smithi045.stdout:Complete! 2023-11-28T12:05:26.868 DEBUG:teuthology.parallel:result is None 2023-11-28T12:05:26.869 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=2f5f6028b893ad41357cd06e827373f0fe2a1232 2023-11-28T12:05:27.092 DEBUG:teuthology.orchestra.run.smithi045:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-11-28T12:05:27.149 INFO:teuthology.orchestra.run.smithi045.stdout:18.0.0-2697.g2f5f6028.el8 2023-11-28T12:05:27.150 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-2697.g2f5f6028.el8 2023-11-28T12:05:27.150 INFO:teuthology.task.install:The correct ceph version 18.0.0-2697.g2f5f6028 is installed. 2023-11-28T12:05:27.150 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=2f5f6028b893ad41357cd06e827373f0fe2a1232 2023-11-28T12:05:27.364 DEBUG:teuthology.orchestra.run.smithi152:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-11-28T12:05:27.426 INFO:teuthology.orchestra.run.smithi152.stdout:18.0.0-2697.g2f5f6028.el8 2023-11-28T12:05:27.426 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-2697.g2f5f6028.el8 2023-11-28T12:05:27.426 INFO:teuthology.task.install:The correct ceph version 18.0.0-2697.g2f5f6028 is installed. 2023-11-28T12:05:27.427 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-11-28T12:05:27.427 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T12:05:27.427 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-28T12:05:27.505 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-11-28T12:05:27.506 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-28T12:05:27.583 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-11-28T12:05:27.584 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T12:05:27.584 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/usr/bin/daemon-helper 2023-11-28T12:05:27.657 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-28T12:05:27.768 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-11-28T12:05:27.768 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/usr/bin/daemon-helper 2023-11-28T12:05:27.840 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-28T12:05:27.950 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-11-28T12:05:27.950 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T12:05:27.950 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-28T12:05:28.027 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-28T12:05:28.140 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-11-28T12:05:28.140 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-28T12:05:28.209 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-28T12:05:28.319 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-11-28T12:05:28.320 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T12:05:28.320 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/usr/bin/stdin-killer 2023-11-28T12:05:28.392 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-28T12:05:28.505 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-11-28T12:05:28.505 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/usr/bin/stdin-killer 2023-11-28T12:05:28.575 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-28T12:05:28.685 INFO:teuthology.run_tasks:Running task ceph... 2023-11-28T12:05:28.749 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-11-28T12:05:28.750 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 777 /var/log/ceph 2023-11-28T12:05:28.754 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 777 /var/log/ceph 2023-11-28T12:05:28.823 INFO:tasks.ceph:Disabling ceph logrotate... 2023-11-28T12:05:28.823 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-28T12:05:28.828 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-28T12:05:28.898 INFO:tasks.ceph:Creating extra log directories... 2023-11-28T12:05:28.899 DEBUG:teuthology.orchestra.run.smithi045:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-28T12:05:28.903 DEBUG:teuthology.orchestra.run.smithi152:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-28T12:05:28.980 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-11-28T12:05:28.980 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-11-28T12:05:28.980 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-11-28T12:05:28.980 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T12:05:28.980 DEBUG:teuthology.orchestra.run.smithi045:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-28T12:05:29.026 DEBUG:teuthology.orchestra.run.smithi045:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-28T12:05:29.233 DEBUG:teuthology.orchestra.run.smithi045:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-11-28T12:05:29.306 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-11-28T12:05:29.306 DEBUG:teuthology.orchestra.run.smithi152:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-28T12:05:29.353 DEBUG:teuthology.orchestra.run.smithi152:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-28T12:05:29.563 DEBUG:teuthology.orchestra.run.smithi152:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-11-28T12:05:29.639 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-11-28T12:05:29.641 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'inode wrongly marked free', 'bad backtrace on inode', 'inode table repaired for inode', 'Scrub error on inode', 'Scrub error on dir', 'Metadata damage detected'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-11-28T12:05:29.641 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/neesingh-2023-11-28_11:27:19-fs-wip-neesingh-testing-231123-distro-default-smithi/7469966', 'branch': 'wip-neesingh-testing-231123', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/forward-scrub}', 'email': 'neesingh@redhat.com', 'first_in_suite': False, 'job_id': '7469966', 'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'neesingh-2023-11-28_11:27:19-fs-wip-neesingh-testing-231123-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '8.stream', 'overrides': {'admin_socket': {'branch': 'wip-neesingh-testing-231123'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'inode wrongly marked free', 'bad backtrace on inode', 'inode table repaired for inode', 'Scrub error on inode', 'Scrub error on dir', 'Metadata damage detected'], 'sha1': '2f5f6028b893ad41357cd06e827373f0fe2a1232'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '2f5f6028b893ad41357cd06e827373f0fe2a1232'}}, 'kclient': {'syntax': 'v1'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'issue_54557', 'sha1': '17c45c858c4cb3105f973d12c6c74f8d5037aa89'}}, 'owner': 'scheduled_neesingh@teuthology', 'priority': 10, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 4140, 'sha1': '2f5f6028b893ad41357cd06e827373f0fe2a1232', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'issue_54557', 'suite_path': '/home/teuthworker/src/github.com_neesingh-rh_ceph_17c45c858c4cb3105f973d12c6c74f8d5037aa89/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/neesingh-rh/ceph', 'suite_sha1': '17c45c858c4cb3105f973d12c6c74f8d5037aa89', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi045.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHtRyX/J4dXuPgQZgnkRgI+j6ljTtxie2rq92X9POlWrfA6Kzs8mueTUo+MwatEEj3SVyJCJZQNKF0ZFSK7Xsmk=', 'smithi152.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFsEDIPxrgkagg2Jhwa4+SjOQ7xHIEWtHfSMxrtjNX2cprFC975JqW+8AYf+cIfR+qWWqSDVm1y1ZDG3RVOIMPI='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '2f5f6028b893ad41357cd06e827373f0fe2a1232'}}, {'ceph': None}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_forward_scrub']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '5ae09a5cc7064ca2bf994df19f3006b79794789a', 'timestamp': '2023-11-28_11:27:19', 'tube': 'smithi', 'user': 'neesingh', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.232157'} 2023-11-28T12:05:29.642 DEBUG:teuthology.orchestra.run.smithi045:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-28T12:05:29.646 DEBUG:teuthology.orchestra.run.smithi152:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-28T12:05:29.692 DEBUG:teuthology.orchestra.run.smithi045:> sudo install -d -m0777 -- /var/run/ceph 2023-11-28T12:05:29.696 DEBUG:teuthology.orchestra.run.smithi152:> sudo install -d -m0777 -- /var/run/ceph 2023-11-28T12:05:29.803 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T12:05:29.803 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/scratch_devs of=/dev/stdout 2023-11-28T12:05:29.851 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-28T12:05:29.851 DEBUG:teuthology.orchestra.run.smithi045:> stat /dev/vg_nvme/lv_1 2023-11-28T12:05:29.939 INFO:teuthology.orchestra.run.smithi045.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-28T12:05:29.939 INFO:teuthology.orchestra.run.smithi045.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T12:05:29.939 INFO:teuthology.orchestra.run.smithi045.stdout:Device: 5h/5d Inode: 444 Links: 1 2023-11-28T12:05:29.939 INFO:teuthology.orchestra.run.smithi045.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T12:05:29.939 INFO:teuthology.orchestra.run.smithi045.stdout:Context: system_u:object_r:device_t:s0 2023-11-28T12:05:29.939 INFO:teuthology.orchestra.run.smithi045.stdout:Access: 2023-11-28 12:05:23.630309287 +0000 2023-11-28T12:05:29.940 INFO:teuthology.orchestra.run.smithi045.stdout:Modify: 2023-11-28 11:57:53.375210140 +0000 2023-11-28T12:05:29.940 INFO:teuthology.orchestra.run.smithi045.stdout:Change: 2023-11-28 11:57:53.375210140 +0000 2023-11-28T12:05:29.940 INFO:teuthology.orchestra.run.smithi045.stdout: Birth: 2023-11-28 11:57:53.346210579 +0000 2023-11-28T12:05:29.940 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-28T12:05:30.048 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records in 2023-11-28T12:05:30.048 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records out 2023-11-28T12:05:30.048 INFO:teuthology.orchestra.run.smithi045.stderr:512 bytes copied, 0.000166935 s, 3.1 MB/s 2023-11-28T12:05:30.054 DEBUG:teuthology.orchestra.run.smithi045:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-28T12:05:30.104 DEBUG:teuthology.orchestra.run.smithi045:> stat /dev/vg_nvme/lv_2 2023-11-28T12:05:30.151 INFO:teuthology.orchestra.run.smithi045.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-28T12:05:30.152 INFO:teuthology.orchestra.run.smithi045.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T12:05:30.152 INFO:teuthology.orchestra.run.smithi045.stdout:Device: 5h/5d Inode: 450 Links: 1 2023-11-28T12:05:30.152 INFO:teuthology.orchestra.run.smithi045.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T12:05:30.152 INFO:teuthology.orchestra.run.smithi045.stdout:Context: system_u:object_r:device_t:s0 2023-11-28T12:05:30.152 INFO:teuthology.orchestra.run.smithi045.stdout:Access: 2023-11-28 12:05:23.631309271 +0000 2023-11-28T12:05:30.152 INFO:teuthology.orchestra.run.smithi045.stdout:Modify: 2023-11-28 11:57:54.218197397 +0000 2023-11-28T12:05:30.152 INFO:teuthology.orchestra.run.smithi045.stdout:Change: 2023-11-28 11:57:54.218197397 +0000 2023-11-28T12:05:30.152 INFO:teuthology.orchestra.run.smithi045.stdout: Birth: 2023-11-28 11:57:54.193197775 +0000 2023-11-28T12:05:30.153 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-28T12:05:30.262 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records in 2023-11-28T12:05:30.262 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records out 2023-11-28T12:05:30.263 INFO:teuthology.orchestra.run.smithi045.stderr:512 bytes copied, 0.000184161 s, 2.8 MB/s 2023-11-28T12:05:30.265 DEBUG:teuthology.orchestra.run.smithi045:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-28T12:05:30.314 DEBUG:teuthology.orchestra.run.smithi045:> stat /dev/vg_nvme/lv_3 2023-11-28T12:05:30.364 INFO:teuthology.orchestra.run.smithi045.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-28T12:05:30.364 INFO:teuthology.orchestra.run.smithi045.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T12:05:30.364 INFO:teuthology.orchestra.run.smithi045.stdout:Device: 5h/5d Inode: 456 Links: 1 2023-11-28T12:05:30.364 INFO:teuthology.orchestra.run.smithi045.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T12:05:30.364 INFO:teuthology.orchestra.run.smithi045.stdout:Context: system_u:object_r:device_t:s0 2023-11-28T12:05:30.364 INFO:teuthology.orchestra.run.smithi045.stdout:Access: 2023-11-28 12:05:23.631309271 +0000 2023-11-28T12:05:30.364 INFO:teuthology.orchestra.run.smithi045.stdout:Modify: 2023-11-28 11:57:55.074184457 +0000 2023-11-28T12:05:30.365 INFO:teuthology.orchestra.run.smithi045.stdout:Change: 2023-11-28 11:57:55.074184457 +0000 2023-11-28T12:05:30.365 INFO:teuthology.orchestra.run.smithi045.stdout: Birth: 2023-11-28 11:57:55.050184820 +0000 2023-11-28T12:05:30.365 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-28T12:05:30.433 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records in 2023-11-28T12:05:30.434 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records out 2023-11-28T12:05:30.434 INFO:teuthology.orchestra.run.smithi045.stderr:512 bytes copied, 0.00017374 s, 2.9 MB/s 2023-11-28T12:05:30.436 DEBUG:teuthology.orchestra.run.smithi045:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-28T12:05:30.485 DEBUG:teuthology.orchestra.run.smithi045:> stat /dev/vg_nvme/lv_4 2023-11-28T12:05:30.533 INFO:teuthology.orchestra.run.smithi045.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-28T12:05:30.533 INFO:teuthology.orchestra.run.smithi045.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T12:05:30.534 INFO:teuthology.orchestra.run.smithi045.stdout:Device: 5h/5d Inode: 462 Links: 1 2023-11-28T12:05:30.534 INFO:teuthology.orchestra.run.smithi045.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T12:05:30.534 INFO:teuthology.orchestra.run.smithi045.stdout:Context: system_u:object_r:device_t:s0 2023-11-28T12:05:30.534 INFO:teuthology.orchestra.run.smithi045.stdout:Access: 2023-11-28 12:05:23.631309271 +0000 2023-11-28T12:05:30.534 INFO:teuthology.orchestra.run.smithi045.stdout:Modify: 2023-11-28 11:57:55.951171200 +0000 2023-11-28T12:05:30.534 INFO:teuthology.orchestra.run.smithi045.stdout:Change: 2023-11-28 11:57:55.951171200 +0000 2023-11-28T12:05:30.534 INFO:teuthology.orchestra.run.smithi045.stdout: Birth: 2023-11-28 11:57:55.927171563 +0000 2023-11-28T12:05:30.534 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-28T12:05:30.601 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records in 2023-11-28T12:05:30.602 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records out 2023-11-28T12:05:30.602 INFO:teuthology.orchestra.run.smithi045.stderr:512 bytes copied, 0.000174967 s, 2.9 MB/s 2023-11-28T12:05:30.604 DEBUG:teuthology.orchestra.run.smithi045:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-28T12:05:30.654 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-28T12:05:30.655 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-11-28T12:05:30.655 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/scratch_devs of=/dev/stdout 2023-11-28T12:05:30.702 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-28T12:05:30.703 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_1 2023-11-28T12:05:30.790 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-28T12:05:30.791 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T12:05:30.791 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 5h/5d Inode: 444 Links: 1 2023-11-28T12:05:30.791 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T12:05:30.791 INFO:teuthology.orchestra.run.smithi152.stdout:Context: system_u:object_r:device_t:s0 2023-11-28T12:05:30.791 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2023-11-28 12:04:46.789100764 +0000 2023-11-28T12:05:30.791 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2023-11-28 11:57:48.479005742 +0000 2023-11-28T12:05:30.791 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2023-11-28 11:57:48.479005742 +0000 2023-11-28T12:05:30.791 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: 2023-11-28 11:57:48.449006079 +0000 2023-11-28T12:05:30.793 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-28T12:05:30.860 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2023-11-28T12:05:30.860 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2023-11-28T12:05:30.860 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.000303315 s, 1.7 MB/s 2023-11-28T12:05:30.862 DEBUG:teuthology.orchestra.run.smithi152:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-28T12:05:30.910 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_2 2023-11-28T12:05:30.957 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-28T12:05:30.957 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T12:05:30.957 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 5h/5d Inode: 450 Links: 1 2023-11-28T12:05:30.957 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T12:05:30.957 INFO:teuthology.orchestra.run.smithi152.stdout:Context: system_u:object_r:device_t:s0 2023-11-28T12:05:30.957 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2023-11-28 12:04:46.789100764 +0000 2023-11-28T12:05:30.957 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2023-11-28 11:57:49.332996154 +0000 2023-11-28T12:05:30.957 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2023-11-28 11:57:49.332996154 +0000 2023-11-28T12:05:30.958 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: 2023-11-28 11:57:49.303996480 +0000 2023-11-28T12:05:30.958 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-28T12:05:31.064 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2023-11-28T12:05:31.064 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2023-11-28T12:05:31.064 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.000307368 s, 1.7 MB/s 2023-11-28T12:05:31.067 DEBUG:teuthology.orchestra.run.smithi152:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-28T12:05:31.115 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_3 2023-11-28T12:05:31.161 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-28T12:05:31.161 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T12:05:31.161 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 5h/5d Inode: 456 Links: 1 2023-11-28T12:05:31.161 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T12:05:31.161 INFO:teuthology.orchestra.run.smithi152.stdout:Context: system_u:object_r:device_t:s0 2023-11-28T12:05:31.161 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2023-11-28 12:04:46.789100764 +0000 2023-11-28T12:05:31.161 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2023-11-28 11:57:50.190986522 +0000 2023-11-28T12:05:31.161 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2023-11-28 11:57:50.190986522 +0000 2023-11-28T12:05:31.162 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: 2023-11-28 11:57:50.166986791 +0000 2023-11-28T12:05:31.162 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-28T12:05:31.269 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2023-11-28T12:05:31.269 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2023-11-28T12:05:31.270 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.000290219 s, 1.8 MB/s 2023-11-28T12:05:31.271 DEBUG:teuthology.orchestra.run.smithi152:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-28T12:05:31.320 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_4 2023-11-28T12:05:31.366 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-28T12:05:31.366 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T12:05:31.366 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 5h/5d Inode: 462 Links: 1 2023-11-28T12:05:31.367 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T12:05:31.367 INFO:teuthology.orchestra.run.smithi152.stdout:Context: system_u:object_r:device_t:s0 2023-11-28T12:05:31.367 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2023-11-28 12:04:46.789100764 +0000 2023-11-28T12:05:31.367 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2023-11-28 11:57:51.052976844 +0000 2023-11-28T12:05:31.367 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2023-11-28 11:57:51.052976844 +0000 2023-11-28T12:05:31.367 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: 2023-11-28 11:57:51.027977125 +0000 2023-11-28T12:05:31.367 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-28T12:05:31.434 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2023-11-28T12:05:31.434 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2023-11-28T12:05:31.434 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.000483954 s, 1.1 MB/s 2023-11-28T12:05:31.437 DEBUG:teuthology.orchestra.run.smithi152:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-28T12:05:31.485 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-28T12:05:31.485 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi045.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi152.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-28T12:05:31.485 INFO:tasks.ceph:Generating config... 2023-11-28T12:05:31.486 INFO:tasks.ceph:[client] client mount timeout = 600 2023-11-28T12:05:31.486 INFO:tasks.ceph:[client] debug client = 20 2023-11-28T12:05:31.487 INFO:tasks.ceph:[client] debug ms = 1 2023-11-28T12:05:31.487 INFO:tasks.ceph:[client] pid file = 2023-11-28T12:05:31.487 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-11-28T12:05:31.490 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-11-28T12:05:31.490 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-11-28T12:05:31.490 INFO:tasks.ceph:[mds] debug mds = 20 2023-11-28T12:05:31.490 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-11-28T12:05:31.490 INFO:tasks.ceph:[mds] debug ms = 1 2023-11-28T12:05:31.490 INFO:tasks.ceph:[mds] mds debug frag = True 2023-11-28T12:05:31.490 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-11-28T12:05:31.490 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-11-28T12:05:31.492 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-11-28T12:05:31.492 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-11-28T12:05:31.492 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-11-28T12:05:31.492 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-11-28T12:05:31.492 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-11-28T12:05:31.493 INFO:tasks.ceph:[mgr] debug ms = 1 2023-11-28T12:05:31.493 INFO:tasks.ceph:[mon] debug mon = 20 2023-11-28T12:05:31.493 INFO:tasks.ceph:[mon] debug ms = 1 2023-11-28T12:05:31.493 INFO:tasks.ceph:[mon] debug paxos = 20 2023-11-28T12:05:31.493 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-11-28T12:05:31.493 INFO:tasks.ceph:[osd] bdev async discard = True 2023-11-28T12:05:31.494 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-11-28T12:05:31.494 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-11-28T12:05:31.494 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-11-28T12:05:31.494 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-11-28T12:05:31.495 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-11-28T12:05:31.495 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-11-28T12:05:31.495 INFO:tasks.ceph:[osd] debug ms = 1 2023-11-28T12:05:31.495 INFO:tasks.ceph:[osd] debug osd = 20 2023-11-28T12:05:31.495 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-11-28T12:05:31.495 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-11-28T12:05:31.496 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-11-28T12:05:31.496 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-11-28T12:05:31.496 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-11-28T12:05:31.496 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-11-28T12:05:31.496 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-11-28T12:05:31.496 INFO:tasks.ceph:Setting up mon.a... 2023-11-28T12:05:31.496 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-11-28T12:05:31.610 INFO:teuthology.orchestra.run.smithi045.stdout:creating /etc/ceph/ceph.keyring 2023-11-28T12:05:31.616 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-11-28T12:05:31.724 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-28T12:05:31.796 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.45'), ('mon.b', '172.21.15.152'), ('mon.c', '[v2:172.21.15.152:3301,v1:172.21.15.152:6790]')] 2023-11-28T12:05:31.797 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.45,172.21.15.152,[v2:172.21.15.152:3301,v1:172.21.15.152:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-11-28T12:05:31.798 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T12:05:31.798 DEBUG:teuthology.orchestra.run.smithi045:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-11-28T12:05:31.846 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.45 --add b 172.21.15.152 --addv c '[v2:172.21.15.152:3301,v1:172.21.15.152:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-11-28T12:05:31.981 INFO:teuthology.orchestra.run.smithi045.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-11-28T12:05:31.981 INFO:teuthology.orchestra.run.smithi045.stdout:monmaptool: generated fsid bd7c37f1-f7c6-4778-b845-52cf2aa6e366 2023-11-28T12:05:31.981 INFO:teuthology.orchestra.run.smithi045.stdout:setting min_mon_release = pacific 2023-11-28T12:05:31.982 INFO:teuthology.orchestra.run.smithi045.stdout:epoch 0 2023-11-28T12:05:31.982 INFO:teuthology.orchestra.run.smithi045.stdout:fsid bd7c37f1-f7c6-4778-b845-52cf2aa6e366 2023-11-28T12:05:31.982 INFO:teuthology.orchestra.run.smithi045.stdout:last_changed 2023-11-28T12:05:31.981297+0000 2023-11-28T12:05:31.982 INFO:teuthology.orchestra.run.smithi045.stdout:created 2023-11-28T12:05:31.981297+0000 2023-11-28T12:05:31.982 INFO:teuthology.orchestra.run.smithi045.stdout:min_mon_release 16 (pacific) 2023-11-28T12:05:31.982 INFO:teuthology.orchestra.run.smithi045.stdout:election_strategy: 1 2023-11-28T12:05:31.982 INFO:teuthology.orchestra.run.smithi045.stdout:0: [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] mon.a 2023-11-28T12:05:31.982 INFO:teuthology.orchestra.run.smithi045.stdout:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2023-11-28T12:05:31.982 INFO:teuthology.orchestra.run.smithi045.stdout:2: [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] mon.c 2023-11-28T12:05:31.982 INFO:teuthology.orchestra.run.smithi045.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-11-28T12:05:31.984 DEBUG:teuthology.orchestra.run.smithi045:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-11-28T12:05:32.030 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID bd7c37f1-f7c6-4778-b845-52cf2aa6e366... 2023-11-28T12:05:32.031 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-28T12:05:32.076 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-28T12:05:32.199 INFO:teuthology.orchestra.run.smithi152.stdout:[global] 2023-11-28T12:05:32.200 INFO:teuthology.orchestra.run.smithi152.stdout: chdir = "" 2023-11-28T12:05:32.200 INFO:teuthology.orchestra.run.smithi152.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-28T12:05:32.200 INFO:teuthology.orchestra.run.smithi152.stdout: auth supported = cephx 2023-11-28T12:05:32.200 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-11-28T12:05:32.200 INFO:teuthology.orchestra.run.smithi152.stdout: filestore xattr use omap = true 2023-11-28T12:05:32.200 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-11-28T12:05:32.200 INFO:teuthology.orchestra.run.smithi152.stdout: mon clock drift allowed = 1.000 2023-11-28T12:05:32.200 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-11-28T12:05:32.200 INFO:teuthology.orchestra.run.smithi152.stdout: osd crush chooseleaf type = 0 2023-11-28T12:05:32.200 INFO:teuthology.orchestra.run.smithi152.stdout: auth debug = true 2023-11-28T12:05:32.200 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-11-28T12:05:32.201 INFO:teuthology.orchestra.run.smithi152.stdout: ms die on old message = true 2023-11-28T12:05:32.201 INFO:teuthology.orchestra.run.smithi152.stdout: ms die on bug = true 2023-11-28T12:05:32.201 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-11-28T12:05:32.201 INFO:teuthology.orchestra.run.smithi152.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-28T12:05:32.201 INFO:teuthology.orchestra.run.smithi152.stdout: mon pg warn max object skew = 0 2023-11-28T12:05:32.201 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-11-28T12:05:32.201 INFO:teuthology.orchestra.run.smithi152.stdout: # disable pg_autoscaler by default for new pools 2023-11-28T12:05:32.201 INFO:teuthology.orchestra.run.smithi152.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-28T12:05:32.201 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-11-28T12:05:32.201 INFO:teuthology.orchestra.run.smithi152.stdout: osd pool default size = 2 2023-11-28T12:05:32.201 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-11-28T12:05:32.202 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd allow primary affinity = true 2023-11-28T12:05:32.202 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd allow pg remap = true 2023-11-28T12:05:32.202 INFO:teuthology.orchestra.run.smithi152.stdout: mon warn on legacy crush tunables = false 2023-11-28T12:05:32.202 INFO:teuthology.orchestra.run.smithi152.stdout: mon warn on crush straw calc version zero = false 2023-11-28T12:05:32.202 INFO:teuthology.orchestra.run.smithi152.stdout: mon warn on no sortbitwise = false 2023-11-28T12:05:32.202 INFO:teuthology.orchestra.run.smithi152.stdout: mon warn on osd down out interval zero = false 2023-11-28T12:05:32.202 INFO:teuthology.orchestra.run.smithi152.stdout: mon warn on too few osds = false 2023-11-28T12:05:32.202 INFO:teuthology.orchestra.run.smithi152.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-28T12:05:32.202 INFO:teuthology.orchestra.run.smithi152.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-28T12:05:32.202 INFO:teuthology.orchestra.run.smithi152.stdout: mon_allow_pool_size_one = true 2023-11-28T12:05:32.202 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-11-28T12:05:32.203 INFO:teuthology.orchestra.run.smithi152.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-28T12:05:32.203 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-11-28T12:05:32.203 INFO:teuthology.orchestra.run.smithi152.stdout: osd default data pool replay window = 5 2023-11-28T12:05:32.203 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-11-28T12:05:32.203 INFO:teuthology.orchestra.run.smithi152.stdout: mon allow pool delete = true 2023-11-28T12:05:32.203 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-11-28T12:05:32.203 INFO:teuthology.orchestra.run.smithi152.stdout: mon cluster log file level = debug 2023-11-28T12:05:32.203 INFO:teuthology.orchestra.run.smithi152.stdout: debug asserts on shutdown = true 2023-11-28T12:05:32.203 INFO:teuthology.orchestra.run.smithi152.stdout: mon health detail to clog = false 2023-11-28T12:05:32.203 INFO:teuthology.orchestra.run.smithi152.stdout: mon host = "172.21.15.45,172.21.15.152,[v2:172.21.15.152:3301,v1:172.21.15.152:6790]" 2023-11-28T12:05:32.204 INFO:teuthology.orchestra.run.smithi152.stdout: ms die on skipped message = False 2023-11-28T12:05:32.204 INFO:teuthology.orchestra.run.smithi152.stdout: fsid = bd7c37f1-f7c6-4778-b845-52cf2aa6e366 2023-11-28T12:05:32.204 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-11-28T12:05:32.204 INFO:teuthology.orchestra.run.smithi152.stdout:[osd] 2023-11-28T12:05:32.204 INFO:teuthology.orchestra.run.smithi152.stdout: osd journal size = 100 2023-11-28T12:05:32.204 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-11-28T12:05:32.204 INFO:teuthology.orchestra.run.smithi152.stdout: osd scrub load threshold = 5.0 2023-11-28T12:05:32.204 INFO:teuthology.orchestra.run.smithi152.stdout: osd scrub max interval = 600 2023-11-28T12:05:32.204 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-11-28T12:05:32.204 INFO:teuthology.orchestra.run.smithi152.stdout: osd recover clone overlap = true 2023-11-28T12:05:32.204 INFO:teuthology.orchestra.run.smithi152.stdout: osd recovery max chunk = 1048576 2023-11-28T12:05:32.204 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-11-28T12:05:32.205 INFO:teuthology.orchestra.run.smithi152.stdout: osd debug shutdown = true 2023-11-28T12:05:32.205 INFO:teuthology.orchestra.run.smithi152.stdout: osd debug op order = true 2023-11-28T12:05:32.205 INFO:teuthology.orchestra.run.smithi152.stdout: osd debug verify stray on activate = true 2023-11-28T12:05:32.205 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-11-28T12:05:32.205 INFO:teuthology.orchestra.run.smithi152.stdout: osd open classes on start = true 2023-11-28T12:05:32.205 INFO:teuthology.orchestra.run.smithi152.stdout: osd debug pg log writeout = true 2023-11-28T12:05:32.205 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-11-28T12:05:32.205 INFO:teuthology.orchestra.run.smithi152.stdout: osd deep scrub update digest min age = 30 2023-11-28T12:05:32.205 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-11-28T12:05:32.205 INFO:teuthology.orchestra.run.smithi152.stdout: osd map max advance = 10 2023-11-28T12:05:32.205 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-11-28T12:05:32.205 INFO:teuthology.orchestra.run.smithi152.stdout: journal zero on create = true 2023-11-28T12:05:32.206 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-11-28T12:05:32.206 INFO:teuthology.orchestra.run.smithi152.stdout: filestore ondisk finisher threads = 3 2023-11-28T12:05:32.206 INFO:teuthology.orchestra.run.smithi152.stdout: filestore apply finisher threads = 3 2023-11-28T12:05:32.206 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-11-28T12:05:32.206 INFO:teuthology.orchestra.run.smithi152.stdout: bdev debug aio = true 2023-11-28T12:05:32.206 INFO:teuthology.orchestra.run.smithi152.stdout: osd debug misdirected ops = true 2023-11-28T12:05:32.206 INFO:teuthology.orchestra.run.smithi152.stdout: bdev async discard = True 2023-11-28T12:05:32.206 INFO:teuthology.orchestra.run.smithi152.stdout: bdev enable discard = True 2023-11-28T12:05:32.207 INFO:teuthology.orchestra.run.smithi152.stdout: bluestore allocator = bitmap 2023-11-28T12:05:32.207 INFO:teuthology.orchestra.run.smithi152.stdout: bluestore block size = 96636764160 2023-11-28T12:05:32.207 INFO:teuthology.orchestra.run.smithi152.stdout: bluestore fsck on mount = True 2023-11-28T12:05:32.207 INFO:teuthology.orchestra.run.smithi152.stdout: debug bluefs = 1/20 2023-11-28T12:05:32.207 INFO:teuthology.orchestra.run.smithi152.stdout: debug bluestore = 1/20 2023-11-28T12:05:32.207 INFO:teuthology.orchestra.run.smithi152.stdout: debug ms = 1 2023-11-28T12:05:32.207 INFO:teuthology.orchestra.run.smithi152.stdout: debug osd = 20 2023-11-28T12:05:32.207 INFO:teuthology.orchestra.run.smithi152.stdout: debug rocksdb = 4/10 2023-11-28T12:05:32.207 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd backfillfull_ratio = 0.85 2023-11-28T12:05:32.207 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd full ratio = 0.9 2023-11-28T12:05:32.207 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd nearfull ratio = 0.8 2023-11-28T12:05:32.208 INFO:teuthology.orchestra.run.smithi152.stdout: osd failsafe full ratio = 0.95 2023-11-28T12:05:32.208 INFO:teuthology.orchestra.run.smithi152.stdout: osd objectstore = bluestore 2023-11-28T12:05:32.208 INFO:teuthology.orchestra.run.smithi152.stdout: osd op complaint time = 180 2023-11-28T12:05:32.208 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-11-28T12:05:32.208 INFO:teuthology.orchestra.run.smithi152.stdout:[mgr] 2023-11-28T12:05:32.208 INFO:teuthology.orchestra.run.smithi152.stdout: debug ms = 1 2023-11-28T12:05:32.208 INFO:teuthology.orchestra.run.smithi152.stdout: debug mgr = 20 2023-11-28T12:05:32.208 INFO:teuthology.orchestra.run.smithi152.stdout: debug mon = 20 2023-11-28T12:05:32.208 INFO:teuthology.orchestra.run.smithi152.stdout: debug auth = 20 2023-11-28T12:05:32.208 INFO:teuthology.orchestra.run.smithi152.stdout: mon reweight min pgs per osd = 4 2023-11-28T12:05:32.208 INFO:teuthology.orchestra.run.smithi152.stdout: mon reweight min bytes per osd = 10 2023-11-28T12:05:32.208 INFO:teuthology.orchestra.run.smithi152.stdout: mgr/telemetry/nag = false 2023-11-28T12:05:32.209 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-11-28T12:05:32.209 INFO:teuthology.orchestra.run.smithi152.stdout:[mon] 2023-11-28T12:05:32.209 INFO:teuthology.orchestra.run.smithi152.stdout: debug ms = 1 2023-11-28T12:05:32.209 INFO:teuthology.orchestra.run.smithi152.stdout: debug mon = 20 2023-11-28T12:05:32.209 INFO:teuthology.orchestra.run.smithi152.stdout: debug paxos = 20 2023-11-28T12:05:32.209 INFO:teuthology.orchestra.run.smithi152.stdout: debug auth = 20 2023-11-28T12:05:32.209 INFO:teuthology.orchestra.run.smithi152.stdout: mon data avail warn = 5 2023-11-28T12:05:32.209 INFO:teuthology.orchestra.run.smithi152.stdout: mon mgr mkfs grace = 240 2023-11-28T12:05:32.209 INFO:teuthology.orchestra.run.smithi152.stdout: mon reweight min pgs per osd = 4 2023-11-28T12:05:32.209 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd reporter subtree level = osd 2023-11-28T12:05:32.210 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd prime pg temp = true 2023-11-28T12:05:32.210 INFO:teuthology.orchestra.run.smithi152.stdout: mon reweight min bytes per osd = 10 2023-11-28T12:05:32.210 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-11-28T12:05:32.210 INFO:teuthology.orchestra.run.smithi152.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-28T12:05:32.210 INFO:teuthology.orchestra.run.smithi152.stdout: auth mon ticket ttl = 660 # 11m 2023-11-28T12:05:32.210 INFO:teuthology.orchestra.run.smithi152.stdout: auth service ticket ttl = 240 # 4m 2023-11-28T12:05:32.210 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-11-28T12:05:32.210 INFO:teuthology.orchestra.run.smithi152.stdout: # don't complain about insecure global_id in the test suite 2023-11-28T12:05:32.210 INFO:teuthology.orchestra.run.smithi152.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-28T12:05:32.211 INFO:teuthology.orchestra.run.smithi152.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-28T12:05:32.211 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-11-28T12:05:32.211 INFO:teuthology.orchestra.run.smithi152.stdout: # 1m isn't quite enough 2023-11-28T12:05:32.211 INFO:teuthology.orchestra.run.smithi152.stdout: mon_down_mkfs_grace = 2m 2023-11-28T12:05:32.211 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-11-28T12:05:32.211 INFO:teuthology.orchestra.run.smithi152.stdout: mon_warn_on_filestore_osds = false 2023-11-28T12:05:32.211 INFO:teuthology.orchestra.run.smithi152.stdout: mon op complaint time = 120 2023-11-28T12:05:32.211 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-11-28T12:05:32.212 INFO:teuthology.orchestra.run.smithi152.stdout:[client] 2023-11-28T12:05:32.212 INFO:teuthology.orchestra.run.smithi152.stdout: rgw cache enabled = true 2023-11-28T12:05:32.212 INFO:teuthology.orchestra.run.smithi152.stdout: rgw enable ops log = true 2023-11-28T12:05:32.212 INFO:teuthology.orchestra.run.smithi152.stdout: rgw enable usage log = true 2023-11-28T12:05:32.212 INFO:teuthology.orchestra.run.smithi152.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-28T12:05:32.212 INFO:teuthology.orchestra.run.smithi152.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-28T12:05:32.212 INFO:teuthology.orchestra.run.smithi152.stdout: client mount timeout = 600 2023-11-28T12:05:32.212 INFO:teuthology.orchestra.run.smithi152.stdout: debug client = 20 2023-11-28T12:05:32.213 INFO:teuthology.orchestra.run.smithi152.stdout: debug ms = 1 2023-11-28T12:05:32.213 INFO:teuthology.orchestra.run.smithi152.stdout: pid file = "" 2023-11-28T12:05:32.213 INFO:teuthology.orchestra.run.smithi152.stdout: rados mon op timeout = 900 2023-11-28T12:05:32.213 INFO:teuthology.orchestra.run.smithi152.stdout: rados osd op timeout = 900 2023-11-28T12:05:32.213 INFO:teuthology.orchestra.run.smithi152.stdout:[mon.a] 2023-11-28T12:05:32.213 INFO:teuthology.orchestra.run.smithi152.stdout:[mon.b] 2023-11-28T12:05:32.213 INFO:teuthology.orchestra.run.smithi152.stdout:[mon.c] 2023-11-28T12:05:32.213 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.a] 2023-11-28T12:05:32.213 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.c] 2023-11-28T12:05:32.214 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.b] 2023-11-28T12:05:32.214 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.d] 2023-11-28T12:05:32.214 INFO:teuthology.orchestra.run.smithi152.stdout:[mds] 2023-11-28T12:05:32.214 INFO:teuthology.orchestra.run.smithi152.stdout: debug mds = 20 2023-11-28T12:05:32.214 INFO:teuthology.orchestra.run.smithi152.stdout: debug mds balancer = 20 2023-11-28T12:05:32.214 INFO:teuthology.orchestra.run.smithi152.stdout: debug ms = 1 2023-11-28T12:05:32.214 INFO:teuthology.orchestra.run.smithi152.stdout: mds debug frag = True 2023-11-28T12:05:32.214 INFO:teuthology.orchestra.run.smithi152.stdout: mds debug scatterstat = True 2023-11-28T12:05:32.215 INFO:teuthology.orchestra.run.smithi152.stdout: mds op complaint time = 180 2023-11-28T12:05:32.215 INFO:teuthology.orchestra.run.smithi152.stdout: mds verify scatter = True 2023-11-28T12:05:32.215 INFO:teuthology.orchestra.run.smithi152.stdout: osd op complaint time = 180 2023-11-28T12:05:32.215 INFO:teuthology.orchestra.run.smithi152.stdout: rados mon op timeout = 900 2023-11-28T12:05:32.215 INFO:teuthology.orchestra.run.smithi152.stdout: rados osd op timeout = 900 2023-11-28T12:05:32.215 INFO:teuthology.orchestra.run.smithi045.stdout:[global] 2023-11-28T12:05:32.215 INFO:teuthology.orchestra.run.smithi045.stdout: chdir = "" 2023-11-28T12:05:32.216 INFO:teuthology.orchestra.run.smithi045.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-28T12:05:32.216 INFO:teuthology.orchestra.run.smithi045.stdout: auth supported = cephx 2023-11-28T12:05:32.216 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:05:32.216 INFO:teuthology.orchestra.run.smithi045.stdout: filestore xattr use omap = true 2023-11-28T12:05:32.216 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:05:32.216 INFO:teuthology.orchestra.run.smithi045.stdout: mon clock drift allowed = 1.000 2023-11-28T12:05:32.216 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:05:32.216 INFO:teuthology.orchestra.run.smithi045.stdout: osd crush chooseleaf type = 0 2023-11-28T12:05:32.216 INFO:teuthology.orchestra.run.smithi045.stdout: auth debug = true 2023-11-28T12:05:32.217 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:05:32.217 INFO:teuthology.orchestra.run.smithi045.stdout: ms die on old message = true 2023-11-28T12:05:32.217 INFO:teuthology.orchestra.run.smithi045.stdout: ms die on bug = true 2023-11-28T12:05:32.217 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:05:32.217 INFO:teuthology.orchestra.run.smithi045.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-28T12:05:32.217 INFO:teuthology.orchestra.run.smithi045.stdout: mon pg warn max object skew = 0 2023-11-28T12:05:32.217 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:05:32.217 INFO:teuthology.orchestra.run.smithi045.stdout: # disable pg_autoscaler by default for new pools 2023-11-28T12:05:32.217 INFO:teuthology.orchestra.run.smithi045.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-28T12:05:32.217 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:05:32.217 INFO:teuthology.orchestra.run.smithi045.stdout: osd pool default size = 2 2023-11-28T12:05:32.218 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:05:32.218 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd allow primary affinity = true 2023-11-28T12:05:32.218 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd allow pg remap = true 2023-11-28T12:05:32.218 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on legacy crush tunables = false 2023-11-28T12:05:32.218 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on crush straw calc version zero = false 2023-11-28T12:05:32.218 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on no sortbitwise = false 2023-11-28T12:05:32.218 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on osd down out interval zero = false 2023-11-28T12:05:32.219 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on too few osds = false 2023-11-28T12:05:32.219 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-28T12:05:32.219 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-28T12:05:32.219 INFO:teuthology.orchestra.run.smithi045.stdout: mon_allow_pool_size_one = true 2023-11-28T12:05:32.219 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:05:32.219 INFO:teuthology.orchestra.run.smithi045.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-28T12:05:32.219 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:05:32.219 INFO:teuthology.orchestra.run.smithi045.stdout: osd default data pool replay window = 5 2023-11-28T12:05:32.219 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:05:32.219 INFO:teuthology.orchestra.run.smithi045.stdout: mon allow pool delete = true 2023-11-28T12:05:32.220 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:05:32.220 INFO:teuthology.orchestra.run.smithi045.stdout: mon cluster log file level = debug 2023-11-28T12:05:32.220 INFO:teuthology.orchestra.run.smithi045.stdout: debug asserts on shutdown = true 2023-11-28T12:05:32.220 INFO:teuthology.orchestra.run.smithi045.stdout: mon health detail to clog = false 2023-11-28T12:05:32.220 INFO:teuthology.orchestra.run.smithi045.stdout: mon host = "172.21.15.45,172.21.15.152,[v2:172.21.15.152:3301,v1:172.21.15.152:6790]" 2023-11-28T12:05:32.220 INFO:teuthology.orchestra.run.smithi045.stdout: ms die on skipped message = False 2023-11-28T12:05:32.220 INFO:teuthology.orchestra.run.smithi045.stdout: fsid = bd7c37f1-f7c6-4778-b845-52cf2aa6e366 2023-11-28T12:05:32.220 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:05:32.220 INFO:teuthology.orchestra.run.smithi045.stdout:[osd] 2023-11-28T12:05:32.220 INFO:teuthology.orchestra.run.smithi045.stdout: osd journal size = 100 2023-11-28T12:05:32.221 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:05:32.221 INFO:teuthology.orchestra.run.smithi045.stdout: osd scrub load threshold = 5.0 2023-11-28T12:05:32.221 INFO:teuthology.orchestra.run.smithi045.stdout: osd scrub max interval = 600 2023-11-28T12:05:32.221 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:05:32.221 INFO:teuthology.orchestra.run.smithi045.stdout: osd recover clone overlap = true 2023-11-28T12:05:32.221 INFO:teuthology.orchestra.run.smithi045.stdout: osd recovery max chunk = 1048576 2023-11-28T12:05:32.221 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:05:32.221 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug shutdown = true 2023-11-28T12:05:32.221 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug op order = true 2023-11-28T12:05:32.222 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug verify stray on activate = true 2023-11-28T12:05:32.222 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:05:32.222 INFO:teuthology.orchestra.run.smithi045.stdout: osd open classes on start = true 2023-11-28T12:05:32.222 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug pg log writeout = true 2023-11-28T12:05:32.222 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:05:32.222 INFO:teuthology.orchestra.run.smithi045.stdout: osd deep scrub update digest min age = 30 2023-11-28T12:05:32.222 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:05:32.222 INFO:teuthology.orchestra.run.smithi045.stdout: osd map max advance = 10 2023-11-28T12:05:32.222 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:05:32.222 INFO:teuthology.orchestra.run.smithi045.stdout: journal zero on create = true 2023-11-28T12:05:32.222 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:05:32.222 INFO:teuthology.orchestra.run.smithi045.stdout: filestore ondisk finisher threads = 3 2023-11-28T12:05:32.222 INFO:teuthology.orchestra.run.smithi045.stdout: filestore apply finisher threads = 3 2023-11-28T12:05:32.223 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:05:32.223 INFO:teuthology.orchestra.run.smithi045.stdout: bdev debug aio = true 2023-11-28T12:05:32.223 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug misdirected ops = true 2023-11-28T12:05:32.223 INFO:teuthology.orchestra.run.smithi045.stdout: bdev async discard = True 2023-11-28T12:05:32.223 INFO:teuthology.orchestra.run.smithi045.stdout: bdev enable discard = True 2023-11-28T12:05:32.223 INFO:teuthology.orchestra.run.smithi045.stdout: bluestore allocator = bitmap 2023-11-28T12:05:32.223 INFO:teuthology.orchestra.run.smithi045.stdout: bluestore block size = 96636764160 2023-11-28T12:05:32.223 INFO:teuthology.orchestra.run.smithi045.stdout: bluestore fsck on mount = True 2023-11-28T12:05:32.223 INFO:teuthology.orchestra.run.smithi045.stdout: debug bluefs = 1/20 2023-11-28T12:05:32.223 INFO:teuthology.orchestra.run.smithi045.stdout: debug bluestore = 1/20 2023-11-28T12:05:32.223 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-11-28T12:05:32.223 INFO:teuthology.orchestra.run.smithi045.stdout: debug osd = 20 2023-11-28T12:05:32.224 INFO:teuthology.orchestra.run.smithi045.stdout: debug rocksdb = 4/10 2023-11-28T12:05:32.224 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd backfillfull_ratio = 0.85 2023-11-28T12:05:32.224 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd full ratio = 0.9 2023-11-28T12:05:32.224 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd nearfull ratio = 0.8 2023-11-28T12:05:32.224 INFO:teuthology.orchestra.run.smithi045.stdout: osd failsafe full ratio = 0.95 2023-11-28T12:05:32.224 INFO:teuthology.orchestra.run.smithi045.stdout: osd objectstore = bluestore 2023-11-28T12:05:32.224 INFO:teuthology.orchestra.run.smithi045.stdout: osd op complaint time = 180 2023-11-28T12:05:32.224 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:05:32.224 INFO:teuthology.orchestra.run.smithi045.stdout:[mgr] 2023-11-28T12:05:32.224 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-11-28T12:05:32.224 INFO:teuthology.orchestra.run.smithi045.stdout: debug mgr = 20 2023-11-28T12:05:32.224 INFO:teuthology.orchestra.run.smithi045.stdout: debug mon = 20 2023-11-28T12:05:32.225 INFO:teuthology.orchestra.run.smithi045.stdout: debug auth = 20 2023-11-28T12:05:32.225 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min pgs per osd = 4 2023-11-28T12:05:32.225 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min bytes per osd = 10 2023-11-28T12:05:32.225 INFO:teuthology.orchestra.run.smithi045.stdout: mgr/telemetry/nag = false 2023-11-28T12:05:32.225 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:05:32.225 INFO:teuthology.orchestra.run.smithi045.stdout:[mon] 2023-11-28T12:05:32.225 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-11-28T12:05:32.225 INFO:teuthology.orchestra.run.smithi045.stdout: debug mon = 20 2023-11-28T12:05:32.225 INFO:teuthology.orchestra.run.smithi045.stdout: debug paxos = 20 2023-11-28T12:05:32.226 INFO:teuthology.orchestra.run.smithi045.stdout: debug auth = 20 2023-11-28T12:05:32.226 INFO:teuthology.orchestra.run.smithi045.stdout: mon data avail warn = 5 2023-11-28T12:05:32.226 INFO:teuthology.orchestra.run.smithi045.stdout: mon mgr mkfs grace = 240 2023-11-28T12:05:32.226 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min pgs per osd = 4 2023-11-28T12:05:32.226 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd reporter subtree level = osd 2023-11-28T12:05:32.226 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd prime pg temp = true 2023-11-28T12:05:32.226 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min bytes per osd = 10 2023-11-28T12:05:32.227 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:05:32.227 INFO:teuthology.orchestra.run.smithi045.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-28T12:05:32.227 INFO:teuthology.orchestra.run.smithi045.stdout: auth mon ticket ttl = 660 # 11m 2023-11-28T12:05:32.227 INFO:teuthology.orchestra.run.smithi045.stdout: auth service ticket ttl = 240 # 4m 2023-11-28T12:05:32.227 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:05:32.227 INFO:teuthology.orchestra.run.smithi045.stdout: # don't complain about insecure global_id in the test suite 2023-11-28T12:05:32.227 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-28T12:05:32.227 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-28T12:05:32.227 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:05:32.227 INFO:teuthology.orchestra.run.smithi045.stdout: # 1m isn't quite enough 2023-11-28T12:05:32.227 INFO:teuthology.orchestra.run.smithi045.stdout: mon_down_mkfs_grace = 2m 2023-11-28T12:05:32.227 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:05:32.228 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_filestore_osds = false 2023-11-28T12:05:32.228 INFO:teuthology.orchestra.run.smithi045.stdout: mon op complaint time = 120 2023-11-28T12:05:32.228 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:05:32.228 INFO:teuthology.orchestra.run.smithi045.stdout:[client] 2023-11-28T12:05:32.228 INFO:teuthology.orchestra.run.smithi045.stdout: rgw cache enabled = true 2023-11-28T12:05:32.228 INFO:teuthology.orchestra.run.smithi045.stdout: rgw enable ops log = true 2023-11-28T12:05:32.228 INFO:teuthology.orchestra.run.smithi045.stdout: rgw enable usage log = true 2023-11-28T12:05:32.228 INFO:teuthology.orchestra.run.smithi045.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-28T12:05:32.228 INFO:teuthology.orchestra.run.smithi045.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-28T12:05:32.228 INFO:teuthology.orchestra.run.smithi045.stdout: client mount timeout = 600 2023-11-28T12:05:32.229 INFO:teuthology.orchestra.run.smithi045.stdout: debug client = 20 2023-11-28T12:05:32.229 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-11-28T12:05:32.229 INFO:teuthology.orchestra.run.smithi045.stdout: pid file = "" 2023-11-28T12:05:32.229 INFO:teuthology.orchestra.run.smithi045.stdout: rados mon op timeout = 900 2023-11-28T12:05:32.229 INFO:teuthology.orchestra.run.smithi045.stdout: rados osd op timeout = 900 2023-11-28T12:05:32.229 INFO:teuthology.orchestra.run.smithi045.stdout:[mon.a] 2023-11-28T12:05:32.229 INFO:teuthology.orchestra.run.smithi045.stdout:[mon.b] 2023-11-28T12:05:32.229 INFO:teuthology.orchestra.run.smithi045.stdout:[mon.c] 2023-11-28T12:05:32.229 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.a] 2023-11-28T12:05:32.229 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.c] 2023-11-28T12:05:32.229 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.b] 2023-11-28T12:05:32.230 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.d] 2023-11-28T12:05:32.230 INFO:teuthology.orchestra.run.smithi045.stdout:[mds] 2023-11-28T12:05:32.230 INFO:teuthology.orchestra.run.smithi045.stdout: debug mds = 20 2023-11-28T12:05:32.230 INFO:teuthology.orchestra.run.smithi045.stdout: debug mds balancer = 20 2023-11-28T12:05:32.230 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-11-28T12:05:32.230 INFO:teuthology.orchestra.run.smithi045.stdout: mds debug frag = True 2023-11-28T12:05:32.230 INFO:teuthology.orchestra.run.smithi045.stdout: mds debug scatterstat = True 2023-11-28T12:05:32.230 INFO:teuthology.orchestra.run.smithi045.stdout: mds op complaint time = 180 2023-11-28T12:05:32.230 INFO:teuthology.orchestra.run.smithi045.stdout: mds verify scatter = True 2023-11-28T12:05:32.230 INFO:teuthology.orchestra.run.smithi045.stdout: osd op complaint time = 180 2023-11-28T12:05:32.230 INFO:teuthology.orchestra.run.smithi045.stdout: rados mon op timeout = 900 2023-11-28T12:05:32.230 INFO:teuthology.orchestra.run.smithi045.stdout: rados osd op timeout = 900 2023-11-28T12:05:32.232 INFO:tasks.ceph:Creating admin key on mon.a... 2023-11-28T12:05:32.232 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-11-28T12:05:32.353 INFO:tasks.ceph:Copying monmap to all nodes... 2023-11-28T12:05:32.353 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T12:05:32.353 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-11-28T12:05:32.401 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T12:05:32.401 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-11-28T12:05:32.491 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi045.front.sepia.ceph.com 2023-11-28T12:05:32.491 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T12:05:32.492 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-28T12:05:32.492 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-28T12:05:32.595 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T12:05:32.595 DEBUG:teuthology.orchestra.run.smithi045:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-28T12:05:32.683 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi152.front.sepia.ceph.com 2023-11-28T12:05:32.683 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-11-28T12:05:32.683 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-28T12:05:32.683 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-28T12:05:32.780 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-11-28T12:05:32.780 DEBUG:teuthology.orchestra.run.smithi152:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-28T12:05:32.868 INFO:tasks.ceph:Setting up mon nodes... 2023-11-28T12:05:32.868 INFO:tasks.ceph:Setting up mgr nodes... 2023-11-28T12:05:32.868 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-11-28T12:05:32.998 INFO:teuthology.orchestra.run.smithi045.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-11-28T12:05:33.005 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-11-28T12:05:33.134 INFO:teuthology.orchestra.run.smithi152.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-11-28T12:05:33.141 INFO:tasks.ceph:Setting up mds nodes... 2023-11-28T12:05:33.141 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-11-28T12:05:33.274 INFO:teuthology.orchestra.run.smithi045.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-11-28T12:05:33.280 DEBUG:teuthology.orchestra.run.smithi045:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-11-28T12:05:33.359 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-11-28T12:05:33.489 INFO:teuthology.orchestra.run.smithi045.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-11-28T12:05:33.496 DEBUG:teuthology.orchestra.run.smithi045:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-11-28T12:05:33.567 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-11-28T12:05:33.694 INFO:teuthology.orchestra.run.smithi152.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-11-28T12:05:33.699 DEBUG:teuthology.orchestra.run.smithi152:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-11-28T12:05:33.771 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-11-28T12:05:33.895 INFO:teuthology.orchestra.run.smithi152.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-11-28T12:05:33.900 DEBUG:teuthology.orchestra.run.smithi152:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-11-28T12:05:33.970 INFO:tasks.ceph_client:Setting up client nodes... 2023-11-28T12:05:33.971 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-11-28T12:05:34.069 INFO:teuthology.orchestra.run.smithi045.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-11-28T12:05:34.101 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-11-28T12:05:34.199 INFO:teuthology.orchestra.run.smithi045.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-11-28T12:05:34.231 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-11-28T12:05:34.328 INFO:teuthology.orchestra.run.smithi152.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-11-28T12:05:34.359 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-11-28T12:05:34.458 INFO:teuthology.orchestra.run.smithi152.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-11-28T12:05:34.488 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-11-28T12:05:34.488 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi045.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi152.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-28T12:05:34.488 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-11-28T12:05:34.561 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-28T12:05:34.561 INFO:tasks.ceph:role: osd.0 2023-11-28T12:05:34.561 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi045.front.sepia.ceph.com 2023-11-28T12:05:34.562 DEBUG:teuthology.orchestra.run.smithi045:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-28T12:05:34.633 INFO:teuthology.orchestra.run.smithi045.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T12:05:34.634 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T12:05:34.634 INFO:teuthology.orchestra.run.smithi045.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T12:05:34.634 INFO:teuthology.orchestra.run.smithi045.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-28T12:05:34.634 INFO:teuthology.orchestra.run.smithi045.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T12:05:34.634 INFO:teuthology.orchestra.run.smithi045.stdout: = sunit=0 swidth=0 blks 2023-11-28T12:05:34.634 INFO:teuthology.orchestra.run.smithi045.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T12:05:34.634 INFO:teuthology.orchestra.run.smithi045.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T12:05:34.634 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T12:05:34.634 INFO:teuthology.orchestra.run.smithi045.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T12:05:34.657 INFO:teuthology.orchestra.run.smithi045.stdout:Discarding blocks...Done. 2023-11-28T12:05:34.661 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi045.front.sepia.ceph.com -o noatime 2023-11-28T12:05:34.661 DEBUG:teuthology.orchestra.run.smithi045:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-11-28T12:05:34.769 DEBUG:teuthology.orchestra.run.smithi045:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-11-28T12:05:34.848 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-11-28T12:05:34.939 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-28T12:05:34.939 INFO:tasks.ceph:role: osd.1 2023-11-28T12:05:34.939 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi045.front.sepia.ceph.com 2023-11-28T12:05:34.940 DEBUG:teuthology.orchestra.run.smithi045:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-28T12:05:35.013 INFO:teuthology.orchestra.run.smithi045.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T12:05:35.013 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T12:05:35.013 INFO:teuthology.orchestra.run.smithi045.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T12:05:35.013 INFO:teuthology.orchestra.run.smithi045.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-28T12:05:35.013 INFO:teuthology.orchestra.run.smithi045.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T12:05:35.013 INFO:teuthology.orchestra.run.smithi045.stdout: = sunit=0 swidth=0 blks 2023-11-28T12:05:35.013 INFO:teuthology.orchestra.run.smithi045.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T12:05:35.013 INFO:teuthology.orchestra.run.smithi045.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T12:05:35.013 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T12:05:35.013 INFO:teuthology.orchestra.run.smithi045.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T12:05:35.036 INFO:teuthology.orchestra.run.smithi045.stdout:Discarding blocks...Done. 2023-11-28T12:05:35.040 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi045.front.sepia.ceph.com -o noatime 2023-11-28T12:05:35.040 DEBUG:teuthology.orchestra.run.smithi045:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-11-28T12:05:35.146 DEBUG:teuthology.orchestra.run.smithi045:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-11-28T12:05:35.223 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-11-28T12:05:35.293 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-28T12:05:35.293 INFO:tasks.ceph:role: osd.2 2023-11-28T12:05:35.293 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi045.front.sepia.ceph.com 2023-11-28T12:05:35.293 DEBUG:teuthology.orchestra.run.smithi045:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-28T12:05:35.363 INFO:teuthology.orchestra.run.smithi045.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T12:05:35.363 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T12:05:35.363 INFO:teuthology.orchestra.run.smithi045.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T12:05:35.363 INFO:teuthology.orchestra.run.smithi045.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-28T12:05:35.363 INFO:teuthology.orchestra.run.smithi045.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T12:05:35.363 INFO:teuthology.orchestra.run.smithi045.stdout: = sunit=0 swidth=0 blks 2023-11-28T12:05:35.363 INFO:teuthology.orchestra.run.smithi045.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T12:05:35.363 INFO:teuthology.orchestra.run.smithi045.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T12:05:35.364 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T12:05:35.364 INFO:teuthology.orchestra.run.smithi045.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T12:05:35.386 INFO:teuthology.orchestra.run.smithi045.stdout:Discarding blocks...Done. 2023-11-28T12:05:35.390 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi045.front.sepia.ceph.com -o noatime 2023-11-28T12:05:35.390 DEBUG:teuthology.orchestra.run.smithi045:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-11-28T12:05:35.496 DEBUG:teuthology.orchestra.run.smithi045:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-11-28T12:05:35.573 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-11-28T12:05:35.643 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-28T12:05:35.644 INFO:tasks.ceph:role: osd.3 2023-11-28T12:05:35.644 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi045.front.sepia.ceph.com 2023-11-28T12:05:35.644 DEBUG:teuthology.orchestra.run.smithi045:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-28T12:05:35.713 INFO:teuthology.orchestra.run.smithi045.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T12:05:35.714 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T12:05:35.714 INFO:teuthology.orchestra.run.smithi045.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T12:05:35.714 INFO:teuthology.orchestra.run.smithi045.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-28T12:05:35.714 INFO:teuthology.orchestra.run.smithi045.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T12:05:35.714 INFO:teuthology.orchestra.run.smithi045.stdout: = sunit=0 swidth=0 blks 2023-11-28T12:05:35.714 INFO:teuthology.orchestra.run.smithi045.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T12:05:35.714 INFO:teuthology.orchestra.run.smithi045.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T12:05:35.714 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T12:05:35.714 INFO:teuthology.orchestra.run.smithi045.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T12:05:35.737 INFO:teuthology.orchestra.run.smithi045.stdout:Discarding blocks...Done. 2023-11-28T12:05:35.740 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi045.front.sepia.ceph.com -o noatime 2023-11-28T12:05:35.741 DEBUG:teuthology.orchestra.run.smithi045:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-11-28T12:05:35.845 DEBUG:teuthology.orchestra.run.smithi045:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-11-28T12:05:35.923 DEBUG:teuthology.orchestra.run.smithi045:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T12:05:36.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:05:36.044+0000 7ff21b9ad680 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-11-28T12:05:36.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:05:36.045+0000 7ff21b9ad680 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-11-28T12:05:36.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:05:36.045+0000 7ff21b9ad680 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-28T12:05:36.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:05:36.045+0000 7ff21b9ad680 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-28T12:05:36.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:05:36.045+0000 7ff21b9ad680 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-28T12:05:36.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:05:36.047+0000 7ff21b9ad680 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-11-28T12:05:38.951 DEBUG:teuthology.orchestra.run.smithi045:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-11-28T12:05:39.028 DEBUG:teuthology.orchestra.run.smithi045:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T12:05:39.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:05:39.139+0000 7f43e5684680 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-11-28T12:05:39.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:05:39.139+0000 7f43e5684680 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-11-28T12:05:39.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:05:39.139+0000 7f43e5684680 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-28T12:05:39.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:05:39.139+0000 7f43e5684680 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-28T12:05:39.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:05:39.139+0000 7f43e5684680 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-28T12:05:39.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:05:39.141+0000 7f43e5684680 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-11-28T12:05:42.024 DEBUG:teuthology.orchestra.run.smithi045:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-11-28T12:05:42.101 DEBUG:teuthology.orchestra.run.smithi045:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T12:05:42.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:05:42.212+0000 7f6e33bca680 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-11-28T12:05:42.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:05:42.212+0000 7f6e33bca680 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-11-28T12:05:42.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:05:42.212+0000 7f6e33bca680 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-28T12:05:42.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:05:42.212+0000 7f6e33bca680 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-28T12:05:42.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:05:42.212+0000 7f6e33bca680 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-28T12:05:42.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:05:42.214+0000 7f6e33bca680 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-11-28T12:05:45.088 DEBUG:teuthology.orchestra.run.smithi045:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-11-28T12:05:45.161 DEBUG:teuthology.orchestra.run.smithi045:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T12:05:45.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:05:45.270+0000 7f386579f680 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-11-28T12:05:45.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:05:45.270+0000 7f386579f680 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-11-28T12:05:45.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:05:45.270+0000 7f386579f680 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-28T12:05:45.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:05:45.270+0000 7f386579f680 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-28T12:05:45.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:05:45.270+0000 7f386579f680 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-28T12:05:45.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:05:45.272+0000 7f386579f680 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-11-28T12:05:48.155 DEBUG:teuthology.orchestra.run.smithi045:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-11-28T12:05:48.231 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-11-28T12:05:48.311 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-28T12:05:48.311 INFO:tasks.ceph:role: osd.4 2023-11-28T12:05:48.311 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi152.front.sepia.ceph.com 2023-11-28T12:05:48.311 DEBUG:teuthology.orchestra.run.smithi152:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-28T12:05:48.390 INFO:teuthology.orchestra.run.smithi152.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T12:05:48.390 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T12:05:48.391 INFO:teuthology.orchestra.run.smithi152.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T12:05:48.391 INFO:teuthology.orchestra.run.smithi152.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-28T12:05:48.391 INFO:teuthology.orchestra.run.smithi152.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T12:05:48.391 INFO:teuthology.orchestra.run.smithi152.stdout: = sunit=0 swidth=0 blks 2023-11-28T12:05:48.391 INFO:teuthology.orchestra.run.smithi152.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T12:05:48.391 INFO:teuthology.orchestra.run.smithi152.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T12:05:48.391 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T12:05:48.391 INFO:teuthology.orchestra.run.smithi152.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T12:05:48.820 INFO:teuthology.orchestra.run.smithi152.stdout:Discarding blocks...Done. 2023-11-28T12:05:48.824 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi152.front.sepia.ceph.com -o noatime 2023-11-28T12:05:48.824 DEBUG:teuthology.orchestra.run.smithi152:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-11-28T12:05:49.030 DEBUG:teuthology.orchestra.run.smithi152:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-11-28T12:05:49.112 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-11-28T12:05:49.182 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-28T12:05:49.182 INFO:tasks.ceph:role: osd.5 2023-11-28T12:05:49.182 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi152.front.sepia.ceph.com 2023-11-28T12:05:49.182 DEBUG:teuthology.orchestra.run.smithi152:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-28T12:05:49.259 INFO:teuthology.orchestra.run.smithi152.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T12:05:49.260 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T12:05:49.260 INFO:teuthology.orchestra.run.smithi152.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T12:05:49.260 INFO:teuthology.orchestra.run.smithi152.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-28T12:05:49.260 INFO:teuthology.orchestra.run.smithi152.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T12:05:49.260 INFO:teuthology.orchestra.run.smithi152.stdout: = sunit=0 swidth=0 blks 2023-11-28T12:05:49.260 INFO:teuthology.orchestra.run.smithi152.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T12:05:49.260 INFO:teuthology.orchestra.run.smithi152.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T12:05:49.260 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T12:05:49.260 INFO:teuthology.orchestra.run.smithi152.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T12:05:49.669 INFO:teuthology.orchestra.run.smithi152.stdout:Discarding blocks...Done. 2023-11-28T12:05:49.673 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi152.front.sepia.ceph.com -o noatime 2023-11-28T12:05:49.674 DEBUG:teuthology.orchestra.run.smithi152:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-11-28T12:05:49.822 DEBUG:teuthology.orchestra.run.smithi152:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-11-28T12:05:49.898 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-11-28T12:05:49.969 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-28T12:05:49.969 INFO:tasks.ceph:role: osd.6 2023-11-28T12:05:49.969 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi152.front.sepia.ceph.com 2023-11-28T12:05:49.969 DEBUG:teuthology.orchestra.run.smithi152:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-28T12:05:50.047 INFO:teuthology.orchestra.run.smithi152.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T12:05:50.047 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T12:05:50.048 INFO:teuthology.orchestra.run.smithi152.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T12:05:50.048 INFO:teuthology.orchestra.run.smithi152.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-28T12:05:50.048 INFO:teuthology.orchestra.run.smithi152.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T12:05:50.048 INFO:teuthology.orchestra.run.smithi152.stdout: = sunit=0 swidth=0 blks 2023-11-28T12:05:50.048 INFO:teuthology.orchestra.run.smithi152.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T12:05:50.048 INFO:teuthology.orchestra.run.smithi152.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T12:05:50.049 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T12:05:50.049 INFO:teuthology.orchestra.run.smithi152.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T12:05:50.500 INFO:teuthology.orchestra.run.smithi152.stdout:Discarding blocks...Done. 2023-11-28T12:05:50.504 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi152.front.sepia.ceph.com -o noatime 2023-11-28T12:05:50.505 DEBUG:teuthology.orchestra.run.smithi152:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-11-28T12:05:50.704 DEBUG:teuthology.orchestra.run.smithi152:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-11-28T12:05:50.785 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-11-28T12:05:50.856 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-28T12:05:50.856 INFO:tasks.ceph:role: osd.7 2023-11-28T12:05:50.857 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi152.front.sepia.ceph.com 2023-11-28T12:05:50.857 DEBUG:teuthology.orchestra.run.smithi152:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-28T12:05:50.935 INFO:teuthology.orchestra.run.smithi152.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T12:05:50.935 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T12:05:50.935 INFO:teuthology.orchestra.run.smithi152.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T12:05:50.935 INFO:teuthology.orchestra.run.smithi152.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-28T12:05:50.935 INFO:teuthology.orchestra.run.smithi152.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T12:05:50.935 INFO:teuthology.orchestra.run.smithi152.stdout: = sunit=0 swidth=0 blks 2023-11-28T12:05:50.935 INFO:teuthology.orchestra.run.smithi152.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T12:05:50.935 INFO:teuthology.orchestra.run.smithi152.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T12:05:50.936 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T12:05:50.936 INFO:teuthology.orchestra.run.smithi152.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T12:05:51.370 INFO:teuthology.orchestra.run.smithi152.stdout:Discarding blocks...Done. 2023-11-28T12:05:51.374 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi152.front.sepia.ceph.com -o noatime 2023-11-28T12:05:51.374 DEBUG:teuthology.orchestra.run.smithi152:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-11-28T12:05:51.497 DEBUG:teuthology.orchestra.run.smithi152:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-11-28T12:05:51.573 DEBUG:teuthology.orchestra.run.smithi152:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T12:05:51.722 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:05:51.722+0000 7f8c87f6d680 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-11-28T12:05:51.723 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:05:51.722+0000 7f8c87f6d680 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-11-28T12:05:51.723 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:05:51.722+0000 7f8c87f6d680 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-28T12:05:51.723 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:05:51.722+0000 7f8c87f6d680 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-28T12:05:51.723 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:05:51.722+0000 7f8c87f6d680 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-28T12:05:51.725 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:05:51.724+0000 7f8c87f6d680 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-11-28T12:05:54.618 DEBUG:teuthology.orchestra.run.smithi152:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-11-28T12:05:54.692 DEBUG:teuthology.orchestra.run.smithi152:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T12:05:54.800 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:05:54.799+0000 7f9970918680 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-11-28T12:05:54.800 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:05:54.799+0000 7f9970918680 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-11-28T12:05:54.800 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:05:54.799+0000 7f9970918680 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-28T12:05:54.800 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:05:54.799+0000 7f9970918680 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-28T12:05:54.800 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:05:54.799+0000 7f9970918680 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-28T12:05:54.801 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:05:54.801+0000 7f9970918680 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-11-28T12:05:57.687 DEBUG:teuthology.orchestra.run.smithi152:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-11-28T12:05:57.761 DEBUG:teuthology.orchestra.run.smithi152:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T12:05:57.868 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:05:57.867+0000 7fb6f45f6680 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-11-28T12:05:57.868 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:05:57.867+0000 7fb6f45f6680 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-11-28T12:05:57.868 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:05:57.867+0000 7fb6f45f6680 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-28T12:05:57.869 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:05:57.867+0000 7fb6f45f6680 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-28T12:05:57.869 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:05:57.867+0000 7fb6f45f6680 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-28T12:05:57.869 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:05:57.869+0000 7fb6f45f6680 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-11-28T12:05:59.644 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T12:05:59.649 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T12:06:00.756 DEBUG:teuthology.orchestra.run.smithi152:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-11-28T12:06:00.827 DEBUG:teuthology.orchestra.run.smithi152:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T12:06:00.934 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:00.932+0000 7f8e22942680 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-11-28T12:06:00.934 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:00.933+0000 7f8e22942680 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-11-28T12:06:00.934 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:00.933+0000 7f8e22942680 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-28T12:06:00.935 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:00.933+0000 7f8e22942680 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-28T12:06:00.935 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:00.933+0000 7f8e22942680 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-28T12:06:00.936 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:00.935+0000 7f8e22942680 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-11-28T12:06:03.818 DEBUG:teuthology.orchestra.run.smithi152:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-11-28T12:06:03.890 INFO:tasks.ceph:Reading keys from all nodes... 2023-11-28T12:06:03.890 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T12:06:03.891 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-11-28T12:06:03.968 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T12:06:03.968 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-11-28T12:06:04.041 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T12:06:04.041 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-11-28T12:06:04.150 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T12:06:04.150 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-11-28T12:06:04.260 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T12:06:04.260 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-11-28T12:06:04.370 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T12:06:04.370 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-11-28T12:06:04.481 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T12:06:04.481 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-11-28T12:06:04.591 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-11-28T12:06:04.591 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-11-28T12:06:04.663 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-11-28T12:06:04.663 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-11-28T12:06:04.772 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-11-28T12:06:04.772 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-11-28T12:06:04.882 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-11-28T12:06:04.882 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-11-28T12:06:04.991 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-11-28T12:06:04.991 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-11-28T12:06:05.100 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-11-28T12:06:05.100 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-11-28T12:06:05.209 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-11-28T12:06:05.209 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-11-28T12:06:05.320 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T12:06:05.320 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-11-28T12:06:05.371 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T12:06:05.372 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-11-28T12:06:05.420 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-11-28T12:06:05.421 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-11-28T12:06:05.467 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-11-28T12:06:05.467 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-11-28T12:06:05.553 INFO:tasks.ceph:Adding keys to all mons... 2023-11-28T12:06:05.553 DEBUG:teuthology.orchestra.run.smithi045:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-28T12:06:05.558 DEBUG:teuthology.orchestra.run.smithi152:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-28T12:06:05.622 INFO:teuthology.orchestra.run.smithi045.stdout:[mgr.y] 2023-11-28T12:06:05.622 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQCM12VlY8eOOxAAR6xl4mDL9yOV6aeCuYBojQ== 2023-11-28T12:06:05.622 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.a] 2023-11-28T12:06:05.622 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQCN12VlhJ1iEBAAPwejLipJZQnV/6P7L6lA8g== 2023-11-28T12:06:05.623 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.c] 2023-11-28T12:06:05.623 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQCN12Vlaxs2HRAA/rYFx19h5UmFvkpiAxDjKg== 2023-11-28T12:06:05.623 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.0] 2023-11-28T12:06:05.623 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQCQ12Vl8522AhAAJv4sFjazwIQ5obUUGqgJ+g== 2023-11-28T12:06:05.623 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.1] 2023-11-28T12:06:05.623 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQCT12VlPhVZCBAAS04ENEYS51RMXl904XaeNQ== 2023-11-28T12:06:05.623 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.2] 2023-11-28T12:06:05.623 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQCW12Vl5RaxDBAA3n4GyG47l/H5wINInjSqWQ== 2023-11-28T12:06:05.623 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.3] 2023-11-28T12:06:05.623 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQCZ12VloTQ4EBAAU8iRvrISZn7x8FfYJj6vOA== 2023-11-28T12:06:05.623 INFO:teuthology.orchestra.run.smithi045.stdout:[mgr.x] 2023-11-28T12:06:05.624 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQCN12VlWJ4LCBAAY0cfxIlr/nfBfr8TP7L96w== 2023-11-28T12:06:05.624 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.b] 2023-11-28T12:06:05.624 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQCN12Vlr6poKRAAtFhus9UGFZrdPX+6WU116A== 2023-11-28T12:06:05.624 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.d] 2023-11-28T12:06:05.624 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQCN12Vl46tjNRAA367PN+mS4wxerzI5vuXgCA== 2023-11-28T12:06:05.624 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.4] 2023-11-28T12:06:05.624 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQCf12VlJs4aKxAA75OrLomZU+ZLWe6qj+CoJw== 2023-11-28T12:06:05.624 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.5] 2023-11-28T12:06:05.624 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQCi12VlQkuxLxAAlT0F37mAouzhrSRKRD78MQ== 2023-11-28T12:06:05.624 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.6] 2023-11-28T12:06:05.624 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQCl12Vl2OfDMxAAV9LEr55YsDldXYXahMy9Rg== 2023-11-28T12:06:05.625 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.7] 2023-11-28T12:06:05.625 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQCo12VldQCsNxAALZb33rZWI6sXmHBWJlPX0g== 2023-11-28T12:06:05.625 INFO:teuthology.orchestra.run.smithi045.stdout:[client.0] 2023-11-28T12:06:05.625 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQCO12VljkopBBAAR62fve9Sjku9pqyTv1pQXg== 2023-11-28T12:06:05.625 INFO:teuthology.orchestra.run.smithi045.stdout:[client.2] 2023-11-28T12:06:05.625 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQCO12Vl3HDpCxAA4joXCEwKG9hndZHR0vziiw== 2023-11-28T12:06:05.625 INFO:teuthology.orchestra.run.smithi045.stdout:[client.1] 2023-11-28T12:06:05.625 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQCO12Vl1B+WExAAEsX9UkIk23pAuPUuKpyIIg== 2023-11-28T12:06:05.625 INFO:teuthology.orchestra.run.smithi045.stdout:[client.3] 2023-11-28T12:06:05.625 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQCO12VlqGtSGxAAWLALZhfUpjq0VBH/ACtOSA== 2023-11-28T12:06:05.659 INFO:teuthology.orchestra.run.smithi152.stdout:[mgr.y] 2023-11-28T12:06:05.660 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQCM12VlY8eOOxAAR6xl4mDL9yOV6aeCuYBojQ== 2023-11-28T12:06:05.660 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.a] 2023-11-28T12:06:05.660 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQCN12VlhJ1iEBAAPwejLipJZQnV/6P7L6lA8g== 2023-11-28T12:06:05.660 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.c] 2023-11-28T12:06:05.660 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQCN12Vlaxs2HRAA/rYFx19h5UmFvkpiAxDjKg== 2023-11-28T12:06:05.660 INFO:teuthology.orchestra.run.smithi152.stdout:[osd.0] 2023-11-28T12:06:05.661 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQCQ12Vl8522AhAAJv4sFjazwIQ5obUUGqgJ+g== 2023-11-28T12:06:05.661 INFO:teuthology.orchestra.run.smithi152.stdout:[osd.1] 2023-11-28T12:06:05.661 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQCT12VlPhVZCBAAS04ENEYS51RMXl904XaeNQ== 2023-11-28T12:06:05.661 INFO:teuthology.orchestra.run.smithi152.stdout:[osd.2] 2023-11-28T12:06:05.661 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQCW12Vl5RaxDBAA3n4GyG47l/H5wINInjSqWQ== 2023-11-28T12:06:05.661 INFO:teuthology.orchestra.run.smithi152.stdout:[osd.3] 2023-11-28T12:06:05.661 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQCZ12VloTQ4EBAAU8iRvrISZn7x8FfYJj6vOA== 2023-11-28T12:06:05.661 INFO:teuthology.orchestra.run.smithi152.stdout:[mgr.x] 2023-11-28T12:06:05.661 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQCN12VlWJ4LCBAAY0cfxIlr/nfBfr8TP7L96w== 2023-11-28T12:06:05.661 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.b] 2023-11-28T12:06:05.661 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQCN12Vlr6poKRAAtFhus9UGFZrdPX+6WU116A== 2023-11-28T12:06:05.661 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.d] 2023-11-28T12:06:05.662 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQCN12Vl46tjNRAA367PN+mS4wxerzI5vuXgCA== 2023-11-28T12:06:05.662 INFO:teuthology.orchestra.run.smithi152.stdout:[osd.4] 2023-11-28T12:06:05.662 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQCf12VlJs4aKxAA75OrLomZU+ZLWe6qj+CoJw== 2023-11-28T12:06:05.662 INFO:teuthology.orchestra.run.smithi152.stdout:[osd.5] 2023-11-28T12:06:05.662 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQCi12VlQkuxLxAAlT0F37mAouzhrSRKRD78MQ== 2023-11-28T12:06:05.662 INFO:teuthology.orchestra.run.smithi152.stdout:[osd.6] 2023-11-28T12:06:05.662 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQCl12Vl2OfDMxAAV9LEr55YsDldXYXahMy9Rg== 2023-11-28T12:06:05.662 INFO:teuthology.orchestra.run.smithi152.stdout:[osd.7] 2023-11-28T12:06:05.662 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQCo12VldQCsNxAALZb33rZWI6sXmHBWJlPX0g== 2023-11-28T12:06:05.662 INFO:teuthology.orchestra.run.smithi152.stdout:[client.0] 2023-11-28T12:06:05.662 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQCO12VljkopBBAAR62fve9Sjku9pqyTv1pQXg== 2023-11-28T12:06:05.663 INFO:teuthology.orchestra.run.smithi152.stdout:[client.2] 2023-11-28T12:06:05.663 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQCO12Vl3HDpCxAA4joXCEwKG9hndZHR0vziiw== 2023-11-28T12:06:05.663 INFO:teuthology.orchestra.run.smithi152.stdout:[client.1] 2023-11-28T12:06:05.663 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQCO12Vl1B+WExAAEsX9UkIk23pAuPUuKpyIIg== 2023-11-28T12:06:05.663 INFO:teuthology.orchestra.run.smithi152.stdout:[client.3] 2023-11-28T12:06:05.663 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQCO12VlqGtSGxAAWLALZhfUpjq0VBH/ACtOSA== 2023-11-28T12:06:05.664 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-28T12:06:05.674 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-28T12:06:05.813 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T12:06:05.817 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T12:06:05.931 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T12:06:05.938 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T12:06:06.050 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T12:06:06.055 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T12:06:06.164 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T12:06:06.170 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T12:06:06.280 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T12:06:06.285 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T12:06:06.395 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T12:06:06.399 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T12:06:06.509 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-28T12:06:06.514 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-28T12:06:06.623 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T12:06:06.627 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T12:06:06.739 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T12:06:06.744 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T12:06:06.857 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T12:06:06.861 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T12:06:06.972 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T12:06:06.977 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T12:06:07.086 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T12:06:07.093 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T12:06:07.203 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T12:06:07.208 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T12:06:07.317 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-28T12:06:07.321 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-28T12:06:07.439 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-28T12:06:07.449 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-28T12:06:07.561 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-28T12:06:07.565 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-28T12:06:07.678 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-28T12:06:07.683 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-28T12:06:07.796 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-11-28T12:06:07.797 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-11-28T12:06:07.868 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-28T12:06:07.995 DEBUG:teuthology.orchestra.run.smithi045:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-11-28T12:06:08.066 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-11-28T12:06:08.137 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-28T12:06:08.262 DEBUG:teuthology.orchestra.run.smithi152:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-11-28T12:06:08.332 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-11-28T12:06:08.402 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-28T12:06:08.526 DEBUG:teuthology.orchestra.run.smithi152:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-11-28T12:06:08.599 DEBUG:teuthology.orchestra.run.smithi045:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-28T12:06:08.603 DEBUG:teuthology.orchestra.run.smithi152:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-28T12:06:08.649 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-11-28T12:06:08.649 INFO:tasks.ceph.mon.a:Restarting daemon 2023-11-28T12:06:08.649 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-11-28T12:06:08.654 INFO:tasks.ceph.mon.a:Started 2023-11-28T12:06:08.654 INFO:tasks.ceph.mon.b:Restarting daemon 2023-11-28T12:06:08.654 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-11-28T12:06:08.693 INFO:tasks.ceph.mon.b:Started 2023-11-28T12:06:08.693 INFO:tasks.ceph.mon.c:Restarting daemon 2023-11-28T12:06:08.694 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-11-28T12:06:08.698 INFO:tasks.ceph.mon.c:Started 2023-11-28T12:06:08.698 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-11-28T12:06:08.698 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-11-28T12:06:08.699 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-11-28T12:06:08.703 INFO:tasks.ceph.mgr.y:Started 2023-11-28T12:06:08.703 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-11-28T12:06:08.704 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-11-28T12:06:08.708 INFO:tasks.ceph.mgr.x:Started 2023-11-28T12:06:08.709 INFO:tasks.ceph:Setting crush tunables to default 2023-11-28T12:06:08.709 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --cluster ceph osd crush tunables default 2023-11-28T12:06:08.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:08.913+0000 7f8ddcfff700 1 Processor -- start 2023-11-28T12:06:08.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:08.913+0000 7f8ddcfff700 1 -- start start 2023-11-28T12:06:08.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:08.914+0000 7f8ddcfff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8dd80d1330 0x7f8dd80b06c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:08.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:08.914+0000 7f8ddcfff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dd80b0230 con 0x7f8dd80d01b0 2023-11-28T12:06:08.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:08.914+0000 7f8ddcfff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dd80b4570 con 0x7f8dd80b20b0 2023-11-28T12:06:08.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:08.914+0000 7f8ddcfff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd815cec0 con 0x7f8dd80d1330 2023-11-28T12:06:08.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:08.915+0000 7f8dcffff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8dd80d1330 0x7f8dd80b06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:08.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:08.915+0000 7f8dcffff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8dd80d1330 0x7f8dd80b06c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.45:50886/0 (socket says 172.21.15.45:50886) 2023-11-28T12:06:08.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:08.915+0000 7f8dcffff700 1 -- 172.21.15.45:0/4197724431 learned_addr learned my addr 172.21.15.45:0/4197724431 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:08.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:08.915+0000 7f8dcffff700 1 -- 172.21.15.45:0/4197724431 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8dd80d1330 msgr2=0x7f8dd80b06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T12:06:08.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:08.915+0000 7f8dcffff700 1 -- 172.21.15.45:0/4197724431 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8dd80d1330 msgr2=0x7f8dd80b06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T12:06:08.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:08.915+0000 7f8dcffff700 1 --2- 172.21.15.45:0/4197724431 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8dd80d1330 0x7f8dd80b06c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T12:06:08.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:08.915+0000 7f8dcffff700 1 --2- 172.21.15.45:0/4197724431 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8dd80d1330 0x7f8dd80b06c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T12:06:09.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:09.062+0000 7f8dd5d9b700 1 -- 172.21.15.45:0/4197724431 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2640474577 0 0) 0x7f8dd80b0230 con 0x7f8dd80d01b0 2023-11-28T12:06:09.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:09.062+0000 7f8dd5d9b700 1 -- 172.21.15.45:0/4197724431 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8dc40035b0 con 0x7f8dd80d01b0 2023-11-28T12:06:09.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:09.062+0000 7f8dd5d9b700 1 -- 172.21.15.45:0/4197724431 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4115774777 0 0) 0x7f8dc40035b0 con 0x7f8dd80d01b0 2023-11-28T12:06:09.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:09.062+0000 7f8dd5d9b700 1 -- 172.21.15.45:0/4197724431 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8dd80d1330 msgr2=0x7f8dd80b06c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T12:06:09.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:09.062+0000 7f8dd5d9b700 1 --2- 172.21.15.45:0/4197724431 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8dd80d1330 0x7f8dd80b06c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:09.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:09.062+0000 7f8dd5d9b700 1 -- 172.21.15.45:0/4197724431 >> v1:172.21.15.152:6789/0 conn(0x7f8dd80b20b0 legacy=0x7f8dd80b0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:09.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:09.062+0000 7f8dd5d9b700 1 -- 172.21.15.45:0/4197724431 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dd80b4850 con 0x7f8dd80d01b0 2023-11-28T12:06:09.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:09.062+0000 7f8dd5d9b700 1 -- 172.21.15.45:0/4197724431 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3460218165 0 0) 0x7f8dc8001670 con 0x7f8dd80d01b0 2023-11-28T12:06:09.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:09.063+0000 7f8dd5d9b700 1 -- 172.21.15.45:0/4197724431 >> v1:172.21.15.45:6789/0 conn(0x7f8dd80d01b0 legacy=0x7f8dd80d0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:09.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:09.063+0000 7f8dd5d9b700 1 --2- 172.21.15.45:0/4197724431 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8dc4003a30 0x7f8dc4003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:09.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:09.063+0000 7f8dd5d9b700 1 --2- 172.21.15.45:0/4197724431 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8dc4004850 0x7f8dc4004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:09.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:09.063+0000 7f8dd5d9b700 1 --2- 172.21.15.45:0/4197724431 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8dd80d1330 0x7f8dc40052b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:09.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:09.063+0000 7f8dd5d9b700 1 -- 172.21.15.45:0/4197724431 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd815cec0 con 0x7f8dc4003a30 2023-11-28T12:06:09.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:09.063+0000 7f8dd5d9b700 1 -- 172.21.15.45:0/4197724431 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc400bba0 con 0x7f8dc4004850 2023-11-28T12:06:09.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:09.063+0000 7f8dd5d9b700 1 -- 172.21.15.45:0/4197724431 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc400bd60 con 0x7f8dd80d1330 2023-11-28T12:06:09.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:09.063+0000 7f8dd659c700 1 --2- 172.21.15.45:0/4197724431 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8dc4003a30 0x7f8dc4003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:09.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:09.063+0000 7f8dcffff700 1 --2- 172.21.15.45:0/4197724431 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8dc4004850 0x7f8dc4004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:09.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:09.063+0000 7f8dd6d9d700 1 --2- 172.21.15.45:0/4197724431 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8dd80d1330 0x7f8dc40052b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:09.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:09.063+0000 7f8dd659c700 1 -- 172.21.15.45:0/4197724431 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8dd80d1330 msgr2=0x7f8dc40052b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:06:09.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:09.063+0000 7f8dd659c700 1 --2- 172.21.15.45:0/4197724431 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8dd80d1330 0x7f8dc40052b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:09.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:09.063+0000 7f8dd659c700 1 -- 172.21.15.45:0/4197724431 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8dc4004850 msgr2=0x7f8dc4004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:06:09.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:09.064+0000 7f8dd659c700 1 --2- 172.21.15.45:0/4197724431 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8dc4004850 0x7f8dc4004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:09.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:09.064+0000 7f8dd659c700 1 -- 172.21.15.45:0/4197724431 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dc40035b0 con 0x7f8dc4003a30 2023-11-28T12:06:09.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:09.064+0000 7f8dd659c700 1 --2- 172.21.15.45:0/4197724431 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8dc4003a30 0x7f8dc4003e40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8dc8007fa0 tx=0x7f8dc4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=418440ed1d75554f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:09.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:09.064+0000 7f8dd5d9b700 1 -- 172.21.15.45:0/4197724431 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc8007a60 con 0x7f8dc4003a30 2023-11-28T12:06:09.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:09.064+0000 7f8dd5d9b700 1 -- 172.21.15.45:0/4197724431 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dc800cc20 con 0x7f8dc4003a30 2023-11-28T12:06:09.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:09.064+0000 7f8dd5d9b700 1 -- 172.21.15.45:0/4197724431 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc8012420 con 0x7f8dc4003a30 2023-11-28T12:06:09.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:09.065+0000 7f8ddcfff700 1 -- 172.21.15.45:0/4197724431 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8dc4003a30 msgr2=0x7f8dc4003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:09.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:09.065+0000 7f8ddcfff700 1 --2- 172.21.15.45:0/4197724431 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8dc4003a30 0x7f8dc4003e40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8dc8007fa0 tx=0x7f8dc4005880 comp rx=0 tx=0).stop 2023-11-28T12:06:09.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:09.065+0000 7f8dd6d9d700 1 -- 172.21.15.45:0/4197724431 reap_dead start 2023-11-28T12:06:09.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:09.065+0000 7f8ddcfff700 1 -- 172.21.15.45:0/4197724431 shutdown_connections 2023-11-28T12:06:09.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:09.065+0000 7f8ddcfff700 1 -- 172.21.15.45:0/4197724431 >> 172.21.15.45:0/4197724431 conn(0x7f8dd809c3f0 msgr2=0x7f8dd80d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:09.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:09.065+0000 7f8ddcfff700 1 -- 172.21.15.45:0/4197724431 shutdown_connections 2023-11-28T12:06:09.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:09.065+0000 7f8ddcfff700 1 -- 172.21.15.45:0/4197724431 wait complete. 2023-11-28T12:06:09.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:09.067+0000 7f8ddcfff700 1 Processor -- start 2023-11-28T12:06:09.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:09.067+0000 7f8ddcfff700 1 -- start start 2023-11-28T12:06:09.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:09.068+0000 7f8ddcfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8dc4003a30 0x7f8dd815a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:09.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:09.068+0000 7f8ddcfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8dd815ed90 0x7f8dd80cc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:09.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:09.068+0000 7f8ddcfff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8dd80cc830 0x7f8dd815d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:09.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:09.068+0000 7f8ddcfff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd815e970 con 0x7f8dc4003a30 2023-11-28T12:06:09.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:09.068+0000 7f8ddcfff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd80cccd0 con 0x7f8dd815ed90 2023-11-28T12:06:09.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:09.068+0000 7f8ddcfff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd815dcf0 con 0x7f8dd80cc830 2023-11-28T12:06:09.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:09.068+0000 7f8dd659c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8dc4003a30 0x7f8dd815a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:09.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:09.068+0000 7f8dd659c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8dc4003a30 0x7f8dd815a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57878/0 (socket says 172.21.15.45:57878) 2023-11-28T12:06:09.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:09.068+0000 7f8dd659c700 1 -- 172.21.15.45:0/1480546744 learned_addr learned my addr 172.21.15.45:0/1480546744 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:09.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:09.069+0000 7f8dcffff700 1 --2- 172.21.15.45:0/1480546744 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8dd815ed90 0x7f8dd80cc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:09.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:09.069+0000 7f8dd6d9d700 1 --2- 172.21.15.45:0/1480546744 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8dd80cc830 0x7f8dd815d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:09.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:09.069+0000 7f8dd659c700 1 -- 172.21.15.45:0/1480546744 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8dd80cc830 msgr2=0x7f8dd815d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:09.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:09.069+0000 7f8dd659c700 1 --2- 172.21.15.45:0/1480546744 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8dd80cc830 0x7f8dd815d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:09.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:09.069+0000 7f8dd659c700 1 -- 172.21.15.45:0/1480546744 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8dd815ed90 msgr2=0x7f8dd80cc2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:09.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:09.069+0000 7f8dd659c700 1 --2- 172.21.15.45:0/1480546744 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8dd815ed90 0x7f8dd80cc2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:09.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:09.069+0000 7f8dd659c700 1 -- 172.21.15.45:0/1480546744 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dd80afec0 con 0x7f8dc4003a30 2023-11-28T12:06:09.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:09.069+0000 7f8dd6d9d700 1 --2- 172.21.15.45:0/1480546744 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8dd80cc830 0x7f8dd815d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:06:09.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:09.069+0000 7f8dd659c700 1 --2- 172.21.15.45:0/1480546744 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8dc4003a30 0x7f8dd815a9b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8dc800d010 tx=0x7f8dc8001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:09.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:09.070+0000 7f8dceffd700 1 -- 172.21.15.45:0/1480546744 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc80052d0 con 0x7f8dc4003a30 2023-11-28T12:06:09.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:09.070+0000 7f8dceffd700 1 -- 172.21.15.45:0/1480546744 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dc8005450 con 0x7f8dc4003a30 2023-11-28T12:06:09.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:09.070+0000 7f8dceffd700 1 -- 172.21.15.45:0/1480546744 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc80038c0 con 0x7f8dc4003a30 2023-11-28T12:06:09.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:09.070+0000 7f8ddcfff700 1 -- 172.21.15.45:0/1480546744 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dd80afbe0 con 0x7f8dc4003a30 2023-11-28T12:06:09.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:09.070+0000 7f8ddcfff700 1 -- 172.21.15.45:0/1480546744 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dd80b2600 con 0x7f8dc4003a30 2023-11-28T12:06:09.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:09.070+0000 7f8dceffd700 1 -- 172.21.15.45:0/1480546744 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f8dc8010050 con 0x7f8dc4003a30 2023-11-28T12:06:09.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:09.070+0000 7f8dceffd700 1 -- 172.21.15.45:0/1480546744 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f8dc8026a00 con 0x7f8dc4003a30 2023-11-28T12:06:09.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:09.071+0000 7f8ddcfff700 1 -- 172.21.15.45:0/1480546744 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dd8068690 con 0x7f8dc4003a30 2023-11-28T12:06:09.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:09.076+0000 7f8dceffd700 1 -- 172.21.15.45:0/1480546744 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f8dc802b020 con 0x7f8dc4003a30 2023-11-28T12:06:09.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:09.156+0000 7f8ddcfff700 1 -- 172.21.15.45:0/1480546744 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f8dd815c910 con 0x7f8dc4003a30 2023-11-28T12:06:09.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:09.159+0000 7f8dceffd700 1 -- 172.21.15.45:0/1480546744 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f8dc8007bc0 con 0x7f8dc4003a30 2023-11-28T12:06:09.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:09.160+0000 7f8ddcfff700 1 -- 172.21.15.45:0/1480546744 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8dc4003a30 msgr2=0x7f8dd815a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:09.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:09.160+0000 7f8ddcfff700 1 --2- 172.21.15.45:0/1480546744 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8dc4003a30 0x7f8dd815a9b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8dc800d010 tx=0x7f8dc8001930 comp rx=0 tx=0).stop 2023-11-28T12:06:09.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:09.160+0000 7f8ddcfff700 1 -- 172.21.15.45:0/1480546744 shutdown_connections 2023-11-28T12:06:09.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:09.161+0000 7f8ddcfff700 1 --2- 172.21.15.45:0/1480546744 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8dd80cc830 0x7f8dd815d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:09.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:09.161+0000 7f8ddcfff700 1 --2- 172.21.15.45:0/1480546744 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8dc4003a30 0x7f8dd815a9b0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:09.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:09.161+0000 7f8ddcfff700 1 --2- 172.21.15.45:0/1480546744 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8dd815ed90 0x7f8dd80cc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:09.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:09.161+0000 7f8ddcfff700 1 -- 172.21.15.45:0/1480546744 >> 172.21.15.45:0/1480546744 conn(0x7f8dd809c3f0 msgr2=0x7f8dd806b310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:09.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:09.161+0000 7f8ddcfff700 1 -- 172.21.15.45:0/1480546744 shutdown_connections 2023-11-28T12:06:09.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:09.161+0000 7f8ddcfff700 1 -- 172.21.15.45:0/1480546744 wait complete. 2023-11-28T12:06:09.165 INFO:teuthology.orchestra.run.smithi045.stderr:adjusted tunables profile to default 2023-11-28T12:06:09.180 INFO:tasks.ceph:check_enable_crimson: False 2023-11-28T12:06:09.180 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-11-28T12:06:09.180 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T12:06:09.180 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-11-28T12:06:09.231 INFO:tasks.ceph.mgr.x.smithi152.stderr:2023-11-28T12:06:09.230+0000 7f3d7c63d240 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-28T12:06:09.238 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-11-28T12:06:09.237+0000 7f1d96e99240 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-28T12:06:09.252 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T12:06:09.252 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-11-28T12:06:09.364 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T12:06:09.364 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-11-28T12:06:09.446 INFO:tasks.ceph.mgr.x.smithi152.stderr:2023-11-28T12:06:09.445+0000 7f3d7c63d240 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-28T12:06:09.478 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-11-28T12:06:09.477+0000 7f1d96e99240 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-28T12:06:09.493 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T12:06:09.494 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-11-28T12:06:09.565 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-11-28T12:06:09.565 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-11-28T12:06:09.635 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-11-28T12:06:09.635 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-11-28T12:06:09.745 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-11-28T12:06:09.745 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-11-28T12:06:09.855 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-11-28T12:06:09.856 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-11-28T12:06:09.857 INFO:tasks.ceph.mgr.x.smithi152.stderr:2023-11-28T12:06:09.856+0000 7f3d7c63d240 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-28T12:06:09.903 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-11-28T12:06:09.902+0000 7f1d96e99240 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-28T12:06:09.929 DEBUG:teuthology.orchestra.run.smithi152:> sudo ceph --cluster ceph osd new 2d0cdd8a-87fd-4f2c-91bd-47bdfa661905 0 2023-11-28T12:06:10.163 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.161+0000 7f433c9ff700 1 Processor -- start 2023-11-28T12:06:10.163 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.162+0000 7f433c9ff700 1 -- start start 2023-11-28T12:06:10.165 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.163+0000 7f433c9ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f433815c9b0 0x7f43380b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:10.165 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.163+0000 7f433c9ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4338161340 0x7f43380d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:10.165 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.163+0000 7f433c9ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43380d1950 con 0x7f43380d2320 2023-11-28T12:06:10.165 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.163+0000 7f433c9ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43380b5800 con 0x7f433815c9b0 2023-11-28T12:06:10.165 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.163+0000 7f433c9ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43380b5520 con 0x7f4338161340 2023-11-28T12:06:10.165 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.163+0000 7f433659c700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f433815c9b0 0x7f43380b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:10.165 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.163+0000 7f433659c700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f433815c9b0 0x7f43380b4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:55198/0 (socket says 172.21.15.152:55198) 2023-11-28T12:06:10.166 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.163+0000 7f433659c700 1 -- 172.21.15.152:0/2949755776 learned_addr learned my addr 172.21.15.152:0/2949755776 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-11-28T12:06:10.166 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.163+0000 7f432ffff700 1 --2- 172.21.15.152:0/2949755776 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4338161340 0x7f43380d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:10.166 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.164+0000 7f433659c700 1 -- 172.21.15.152:0/2949755776 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4338161340 msgr2=0x7f43380d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:06:10.166 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.164+0000 7f433659c700 1 --2- 172.21.15.152:0/2949755776 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4338161340 0x7f43380d1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:10.166 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.164+0000 7f433659c700 1 -- 172.21.15.152:0/2949755776 >> v1:172.21.15.152:6789/0 conn(0x7f43380d2320 legacy=0x7f43380cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:10.166 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.164+0000 7f433659c700 1 -- 172.21.15.152:0/2949755776 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43380d1300 con 0x7f433815c9b0 2023-11-28T12:06:10.166 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.164+0000 7f4335d9b700 1 -- 172.21.15.152:0/2949755776 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1338236164 0 0) 0x7f43380d1950 con 0x7f43380d2320 2023-11-28T12:06:10.166 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.164+0000 7f433659c700 1 --2- 172.21.15.152:0/2949755776 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f433815c9b0 0x7f43380b4bf0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f43280098f0 tx=0x7f4328009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bddde8bdf04150de server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:10.166 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.164+0000 7f4335d9b700 1 -- 172.21.15.152:0/2949755776 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4328011830 con 0x7f433815c9b0 2023-11-28T12:06:10.166 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.164+0000 7f4335d9b700 1 -- 172.21.15.152:0/2949755776 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4328011990 con 0x7f433815c9b0 2023-11-28T12:06:10.166 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.164+0000 7f4335d9b700 1 -- 172.21.15.152:0/2949755776 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4328011d20 con 0x7f433815c9b0 2023-11-28T12:06:10.167 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.165+0000 7f433c9ff700 1 -- 172.21.15.152:0/2949755776 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f433815c9b0 msgr2=0x7f43380b4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:10.168 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.165+0000 7f433c9ff700 1 --2- 172.21.15.152:0/2949755776 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f433815c9b0 0x7f43380b4bf0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f43280098f0 tx=0x7f4328009c00 comp rx=0 tx=0).stop 2023-11-28T12:06:10.168 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.165+0000 7f433c9ff700 1 -- 172.21.15.152:0/2949755776 shutdown_connections 2023-11-28T12:06:10.168 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.165+0000 7f433c9ff700 1 --2- 172.21.15.152:0/2949755776 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f433815c9b0 0x7f43380b4bf0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:10.168 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.165+0000 7f433c9ff700 1 --2- 172.21.15.152:0/2949755776 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4338161340 0x7f43380d1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:10.168 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.165+0000 7f433c9ff700 1 -- 172.21.15.152:0/2949755776 >> 172.21.15.152:0/2949755776 conn(0x7f4338072600 msgr2=0x7f43380cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:10.168 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.165+0000 7f433c9ff700 1 -- 172.21.15.152:0/2949755776 shutdown_connections 2023-11-28T12:06:10.168 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.165+0000 7f433c9ff700 1 -- 172.21.15.152:0/2949755776 wait complete. 2023-11-28T12:06:10.168 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.167+0000 7f433c9ff700 1 Processor -- start 2023-11-28T12:06:10.168 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.167+0000 7f433c9ff700 1 -- start start 2023-11-28T12:06:10.170 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.168+0000 7f433c9ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f43380d2320 0x7f43380c5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:10.170 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.168+0000 7f433c9ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f433815c9b0 0x7f4338157860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:10.170 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.168+0000 7f433c9ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4338161340 0x7f4338154200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:10.170 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.168+0000 7f433c9ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43380c6410 con 0x7f4338161340 2023-11-28T12:06:10.171 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.168+0000 7f433c9ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4338153160 con 0x7f43380d2320 2023-11-28T12:06:10.171 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.168+0000 7f433c9ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4338153440 con 0x7f433815c9b0 2023-11-28T12:06:10.171 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.168+0000 7f432ffff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f433815c9b0 0x7f4338157860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:10.171 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.168+0000 7f433659c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f43380d2320 0x7f43380c5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:10.171 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.168+0000 7f433659c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f43380d2320 0x7f43380c5ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:55204/0 (socket says 172.21.15.152:55204) 2023-11-28T12:06:10.171 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.168+0000 7f433659c700 1 -- 172.21.15.152:0/2072508647 learned_addr learned my addr 172.21.15.152:0/2072508647 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-11-28T12:06:10.171 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.168+0000 7f4336d9d700 1 --2- 172.21.15.152:0/2072508647 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4338161340 0x7f4338154200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:10.171 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.168+0000 7f433659c700 1 -- 172.21.15.152:0/2072508647 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f433815c9b0 msgr2=0x7f4338157860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:10.172 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.168+0000 7f433659c700 1 --2- 172.21.15.152:0/2072508647 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f433815c9b0 0x7f4338157860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:10.172 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.168+0000 7f433659c700 1 -- 172.21.15.152:0/2072508647 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4338161340 msgr2=0x7f4338154200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:10.172 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.168+0000 7f433659c700 1 --2- 172.21.15.152:0/2072508647 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4338161340 0x7f4338154200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:10.172 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.168+0000 7f433659c700 1 -- 172.21.15.152:0/2072508647 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4328009550 con 0x7f43380d2320 2023-11-28T12:06:10.172 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.168+0000 7f4336d9d700 1 --2- 172.21.15.152:0/2072508647 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4338161340 0x7f4338154200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:06:10.172 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.169+0000 7f433659c700 1 --2- 172.21.15.152:0/2072508647 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f43380d2320 0x7f43380c5ed0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4328009c40 tx=0x7f4328004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:10.172 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.169+0000 7f432effd700 1 -- 172.21.15.152:0/2072508647 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4328004400 con 0x7f43380d2320 2023-11-28T12:06:10.172 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.169+0000 7f432effd700 1 -- 172.21.15.152:0/2072508647 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f432801f070 con 0x7f43380d2320 2023-11-28T12:06:10.173 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.169+0000 7f432effd700 1 -- 172.21.15.152:0/2072508647 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43280038c0 con 0x7f43380d2320 2023-11-28T12:06:10.173 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.169+0000 7f433c9ff700 1 -- 172.21.15.152:0/2072508647 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43380b5130 con 0x7f43380d2320 2023-11-28T12:06:10.173 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.169+0000 7f433c9ff700 1 -- 172.21.15.152:0/2072508647 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43380d15e0 con 0x7f43380d2320 2023-11-28T12:06:10.173 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.169+0000 7f432effd700 1 -- 172.21.15.152:0/2072508647 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f432802a020 con 0x7f43380d2320 2023-11-28T12:06:10.173 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.169+0000 7f432effd700 1 -- 172.21.15.152:0/2072508647 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f432801a770 con 0x7f43380d2320 2023-11-28T12:06:10.174 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.170+0000 7f433c9ff700 1 -- 172.21.15.152:0/2072508647 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43380b52c0 con 0x7f43380d2320 2023-11-28T12:06:10.174 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.173+0000 7f432effd700 1 -- 172.21.15.152:0/2072508647 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f4328015020 con 0x7f43380d2320 2023-11-28T12:06:10.258 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.257+0000 7f433c9ff700 1 -- 172.21.15.152:0/2072508647 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2d0cdd8a-87fd-4f2c-91bd-47bdfa661905", "id": 0} v 0) v1 -- 0x7f43380b9150 con 0x7f43380d2320 2023-11-28T12:06:10.262 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.261+0000 7f432effd700 1 -- 172.21.15.152:0/2072508647 <== mon.1 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2d0cdd8a-87fd-4f2c-91bd-47bdfa661905", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4328003af0 con 0x7f43380d2320 2023-11-28T12:06:10.262 INFO:teuthology.orchestra.run.smithi152.stdout:0 2023-11-28T12:06:10.263 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.262+0000 7f433c9ff700 1 -- 172.21.15.152:0/2072508647 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f43380d2320 msgr2=0x7f43380c5ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:10.264 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.262+0000 7f433c9ff700 1 --2- 172.21.15.152:0/2072508647 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f43380d2320 0x7f43380c5ed0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4328009c40 tx=0x7f4328004750 comp rx=0 tx=0).stop 2023-11-28T12:06:10.264 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.263+0000 7f433c9ff700 1 -- 172.21.15.152:0/2072508647 shutdown_connections 2023-11-28T12:06:10.264 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.263+0000 7f433c9ff700 1 --2- 172.21.15.152:0/2072508647 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f43380d2320 0x7f43380c5ed0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:10.264 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.263+0000 7f433c9ff700 1 --2- 172.21.15.152:0/2072508647 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4338161340 0x7f4338154200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:10.264 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.263+0000 7f433c9ff700 1 --2- 172.21.15.152:0/2072508647 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f433815c9b0 0x7f4338157860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:10.264 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.263+0000 7f433c9ff700 1 -- 172.21.15.152:0/2072508647 >> 172.21.15.152:0/2072508647 conn(0x7f4338072600 msgr2=0x7f43380b8380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:10.264 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.263+0000 7f433c9ff700 1 -- 172.21.15.152:0/2072508647 shutdown_connections 2023-11-28T12:06:10.264 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.263+0000 7f433c9ff700 1 -- 172.21.15.152:0/2072508647 wait complete. 2023-11-28T12:06:10.282 DEBUG:teuthology.orchestra.run.smithi152:> sudo ceph --cluster ceph osd new c5de4ebd-9ec5-40b3-9caa-9b706fab4c76 1 2023-11-28T12:06:10.478 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.477+0000 7efdb0fff700 1 Processor -- start 2023-11-28T12:06:10.478 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.477+0000 7efdb0fff700 1 -- start start 2023-11-28T12:06:10.479 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.478+0000 7efdb0fff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7efdac0d01b0 0x7efdac0d0c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:10.481 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.479+0000 7efdb0fff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdac0b0230 con 0x7efdac0b16d0 2023-11-28T12:06:10.481 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.479+0000 7efdb0fff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdac0b37d0 con 0x7efdac0b20b0 2023-11-28T12:06:10.481 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.479+0000 7efdb0fff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdac15cec0 con 0x7efdac0d01b0 2023-11-28T12:06:10.481 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.479+0000 7efdaa59c700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7efdac0d01b0 0x7efdac0d0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:10.481 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.479+0000 7efda3fff700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7efdac0b20b0 0x7efdac0b29b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:47108/0 (socket says 172.21.15.152:47108) 2023-11-28T12:06:10.481 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.479+0000 7efda3fff700 1 -- 172.21.15.152:0/4203945612 learned_addr learned my addr 172.21.15.152:0/4203945612 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-11-28T12:06:10.482 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.479+0000 7efdaa59c700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7efdac0d01b0 0x7efdac0d0c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.152:33024/0 (socket says 172.21.15.152:33024) 2023-11-28T12:06:10.482 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.479+0000 7efdaa59c700 1 -- 172.21.15.152:0/4203945612 >> v1:172.21.15.152:6789/0 conn(0x7efdac0b20b0 legacy=0x7efdac0b29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:10.482 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.479+0000 7efdaa59c700 1 -- 172.21.15.152:0/4203945612 >> v1:172.21.15.45:6789/0 conn(0x7efdac0b16d0 legacy=0x7efdac0b30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:10.482 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.479+0000 7efdaa59c700 1 -- 172.21.15.152:0/4203945612 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdac0b4570 con 0x7efdac0d01b0 2023-11-28T12:06:10.482 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.479+0000 7efda9d9b700 1 -- 172.21.15.152:0/4203945612 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 871020514 0 0) 0x7efdac0b37d0 con 0x7efdac0b20b0 2023-11-28T12:06:10.482 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.480+0000 7efdaa59c700 1 --2- 172.21.15.152:0/4203945612 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7efdac0d01b0 0x7efdac0d0c20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7efd9c0098a0 tx=0x7efd9c009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2e208097f7687a3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:10.482 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.480+0000 7efda9d9b700 1 -- 172.21.15.152:0/4203945612 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd9c011830 con 0x7efdac0d01b0 2023-11-28T12:06:10.482 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.480+0000 7efda9d9b700 1 -- 172.21.15.152:0/4203945612 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd9c011990 con 0x7efdac0d01b0 2023-11-28T12:06:10.482 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.480+0000 7efda9d9b700 1 -- 172.21.15.152:0/4203945612 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd9c011d40 con 0x7efdac0d01b0 2023-11-28T12:06:10.483 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.480+0000 7efdb0fff700 1 -- 172.21.15.152:0/4203945612 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7efdac0d01b0 msgr2=0x7efdac0d0c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:10.483 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.480+0000 7efdb0fff700 1 --2- 172.21.15.152:0/4203945612 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7efdac0d01b0 0x7efdac0d0c20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7efd9c0098a0 tx=0x7efd9c009bb0 comp rx=0 tx=0).stop 2023-11-28T12:06:10.484 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.481+0000 7efdb0fff700 1 -- 172.21.15.152:0/4203945612 shutdown_connections 2023-11-28T12:06:10.484 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.481+0000 7efdb0fff700 1 --2- 172.21.15.152:0/4203945612 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7efdac0d01b0 0x7efdac0d0c20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:10.484 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.481+0000 7efdb0fff700 1 -- 172.21.15.152:0/4203945612 >> 172.21.15.152:0/4203945612 conn(0x7efdac09c3f0 msgr2=0x7efdac0d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:10.484 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.481+0000 7efdb0fff700 1 -- 172.21.15.152:0/4203945612 shutdown_connections 2023-11-28T12:06:10.484 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.481+0000 7efdb0fff700 1 -- 172.21.15.152:0/4203945612 wait complete. 2023-11-28T12:06:10.484 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.482+0000 7efdb0fff700 1 Processor -- start 2023-11-28T12:06:10.484 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.483+0000 7efdb0fff700 1 -- start start 2023-11-28T12:06:10.487 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.484+0000 7efdb0fff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7efdac0b16d0 0x7efdac0ca120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:10.487 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.484+0000 7efdb0fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efdac0b20b0 0x7efdac0ca660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:10.487 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.484+0000 7efdb0fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efdac0d01b0 0x7efdac143f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:10.487 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.484+0000 7efdb0fff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdac155940 con 0x7efdac0d01b0 2023-11-28T12:06:10.487 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.484+0000 7efdb0fff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdac1e5750 con 0x7efdac0b20b0 2023-11-28T12:06:10.487 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.484+0000 7efdb0fff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdac1e5a30 con 0x7efdac0b16d0 2023-11-28T12:06:10.488 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.484+0000 7efdaa59c700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7efdac0b16d0 0x7efdac0ca120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:10.488 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.484+0000 7efda3fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efdac0b20b0 0x7efdac0ca660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:10.488 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.484+0000 7efdaa59c700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7efdac0b16d0 0x7efdac0ca120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.152:33026/0 (socket says 172.21.15.152:33026) 2023-11-28T12:06:10.488 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.484+0000 7efdaa59c700 1 -- 172.21.15.152:0/2864738034 learned_addr learned my addr 172.21.15.152:0/2864738034 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-11-28T12:06:10.488 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.484+0000 7efdaad9d700 1 --2- 172.21.15.152:0/2864738034 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efdac0d01b0 0x7efdac143f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:10.488 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.484+0000 7efdaa59c700 1 -- 172.21.15.152:0/2864738034 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efdac0b20b0 msgr2=0x7efdac0ca660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:10.488 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.484+0000 7efdaa59c700 1 --2- 172.21.15.152:0/2864738034 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efdac0b20b0 0x7efdac0ca660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:10.488 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.484+0000 7efdaa59c700 1 -- 172.21.15.152:0/2864738034 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efdac0d01b0 msgr2=0x7efdac143f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:10.488 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.484+0000 7efdaa59c700 1 --2- 172.21.15.152:0/2864738034 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efdac0d01b0 0x7efdac143f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:10.488 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.484+0000 7efdaa59c700 1 -- 172.21.15.152:0/2864738034 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd9c0094a0 con 0x7efdac0b16d0 2023-11-28T12:06:10.488 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.485+0000 7efdaa59c700 1 --2- 172.21.15.152:0/2864738034 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7efdac0b16d0 0x7efdac0ca120 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7efd9c0090b0 tx=0x7efd9c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:10.488 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.485+0000 7efda2ffd700 1 -- 172.21.15.152:0/2864738034 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd9c01aa70 con 0x7efdac0b16d0 2023-11-28T12:06:10.489 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.485+0000 7efda2ffd700 1 -- 172.21.15.152:0/2864738034 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd9c01abd0 con 0x7efdac0b16d0 2023-11-28T12:06:10.489 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.485+0000 7efdb0fff700 1 -- 172.21.15.152:0/2864738034 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdac0afbe0 con 0x7efdac0b16d0 2023-11-28T12:06:10.489 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.485+0000 7efda2ffd700 1 -- 172.21.15.152:0/2864738034 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd9c024400 con 0x7efdac0b16d0 2023-11-28T12:06:10.489 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.485+0000 7efdb0fff700 1 -- 172.21.15.152:0/2864738034 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdac0b4850 con 0x7efdac0b16d0 2023-11-28T12:06:10.489 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.485+0000 7efda2ffd700 1 -- 172.21.15.152:0/2864738034 <== mon.2 v2:172.21.15.152:3301/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7efd9c02a020 con 0x7efdac0b16d0 2023-11-28T12:06:10.489 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.485+0000 7efda2ffd700 1 -- 172.21.15.152:0/2864738034 <== mon.2 v2:172.21.15.152:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7efd9c02d7f0 con 0x7efdac0b16d0 2023-11-28T12:06:10.489 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.486+0000 7efdb0fff700 1 -- 172.21.15.152:0/2864738034 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdac0afec0 con 0x7efdac0b16d0 2023-11-28T12:06:10.489 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.489+0000 7efda2ffd700 1 -- 172.21.15.152:0/2864738034 <== mon.2 v2:172.21.15.152:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7efd9c015020 con 0x7efdac0b16d0 2023-11-28T12:06:10.520 INFO:tasks.ceph.mgr.x.smithi152.stderr:2023-11-28T12:06:10.519+0000 7f3d7c63d240 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-28T12:06:10.567 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-11-28T12:06:10.566+0000 7f1d96e99240 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-28T12:06:10.574 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.573+0000 7efdb0fff700 1 -- 172.21.15.152:0/2864738034 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c5de4ebd-9ec5-40b3-9caa-9b706fab4c76", "id": 1} v 0) v1 -- 0x7efdac068690 con 0x7efdac0b16d0 2023-11-28T12:06:10.578 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.577+0000 7efda2ffd700 1 -- 172.21.15.152:0/2864738034 <== mon.2 v2:172.21.15.152:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c5de4ebd-9ec5-40b3-9caa-9b706fab4c76", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7efd9c02dad0 con 0x7efdac0b16d0 2023-11-28T12:06:10.579 INFO:teuthology.orchestra.run.smithi152.stdout:1 2023-11-28T12:06:10.580 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.578+0000 7efdb0fff700 1 -- 172.21.15.152:0/2864738034 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7efdac0b16d0 msgr2=0x7efdac0ca120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:10.580 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.578+0000 7efdb0fff700 1 --2- 172.21.15.152:0/2864738034 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7efdac0b16d0 0x7efdac0ca120 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7efd9c0090b0 tx=0x7efd9c004750 comp rx=0 tx=0).stop 2023-11-28T12:06:10.580 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.579+0000 7efdb0fff700 1 -- 172.21.15.152:0/2864738034 shutdown_connections 2023-11-28T12:06:10.580 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.579+0000 7efdb0fff700 1 --2- 172.21.15.152:0/2864738034 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efdac0d01b0 0x7efdac143f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:10.580 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.579+0000 7efdb0fff700 1 --2- 172.21.15.152:0/2864738034 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7efdac0b16d0 0x7efdac0ca120 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:10.580 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.579+0000 7efdb0fff700 1 --2- 172.21.15.152:0/2864738034 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efdac0b20b0 0x7efdac0ca660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:10.580 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.579+0000 7efdb0fff700 1 -- 172.21.15.152:0/2864738034 >> 172.21.15.152:0/2864738034 conn(0x7efdac09c3f0 msgr2=0x7efdac0b06c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:10.580 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.579+0000 7efdb0fff700 1 -- 172.21.15.152:0/2864738034 shutdown_connections 2023-11-28T12:06:10.581 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.579+0000 7efdb0fff700 1 -- 172.21.15.152:0/2864738034 wait complete. 2023-11-28T12:06:10.597 DEBUG:teuthology.orchestra.run.smithi152:> sudo ceph --cluster ceph osd new 9f4b36b2-65d2-40e7-9fe6-a2991afa71c5 2 2023-11-28T12:06:10.794 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.792+0000 7f78a8bff700 1 Processor -- start 2023-11-28T12:06:10.794 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.793+0000 7f78a8bff700 1 -- start start 2023-11-28T12:06:10.795 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.794+0000 7f78a8bff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f78a415c9b0 0x7f78a40b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:10.795 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.794+0000 7f78a8bff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78a40d1950 con 0x7f78a4161340 2023-11-28T12:06:10.795 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.794+0000 7f78a8bff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78a40d24f0 con 0x7f78a40cd7c0 2023-11-28T12:06:10.795 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.794+0000 7f78a8bff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78a40b5800 con 0x7f78a415c9b0 2023-11-28T12:06:10.796 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.794+0000 7f78a2d9d700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f78a40cd7c0 0x7f78a40b5fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:47112/0 (socket says 172.21.15.152:47112) 2023-11-28T12:06:10.796 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.794+0000 7f78a2d9d700 1 -- 172.21.15.152:0/4121576914 learned_addr learned my addr 172.21.15.152:0/4121576914 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-11-28T12:06:10.796 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.794+0000 7f78a259c700 1 --2- 172.21.15.152:0/4121576914 >> v2:172.21.15.45:3300/0 conn(0x7f78a415c9b0 0x7f78a40b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:10.796 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.795+0000 7f78a259c700 1 -- 172.21.15.152:0/4121576914 >> v1:172.21.15.152:6789/0 conn(0x7f78a40cd7c0 legacy=0x7f78a40b5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:10.796 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.795+0000 7f78a259c700 1 -- 172.21.15.152:0/4121576914 >> v1:172.21.15.45:6789/0 conn(0x7f78a4161340 legacy=0x7f78a40d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:10.796 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.795+0000 7f78a259c700 1 -- 172.21.15.152:0/4121576914 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78a40b5520 con 0x7f78a415c9b0 2023-11-28T12:06:10.796 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.795+0000 7f78a1d9b700 1 -- 172.21.15.152:0/4121576914 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1547605937 0 0) 0x7f78a40d24f0 con 0x7f78a40cd7c0 2023-11-28T12:06:10.796 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.795+0000 7f78a259c700 1 --2- 172.21.15.152:0/4121576914 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78a415c9b0 0x7f78a40b4bf0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7894009840 tx=0x7f7894009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d902a3831472bbf4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:10.797 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.795+0000 7f78a1d9b700 1 -- 172.21.15.152:0/4121576914 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7894004230 con 0x7f78a415c9b0 2023-11-28T12:06:10.798 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.795+0000 7f78a1d9b700 1 -- 172.21.15.152:0/4121576914 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7894004390 con 0x7f78a415c9b0 2023-11-28T12:06:10.798 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.795+0000 7f78a1d9b700 1 -- 172.21.15.152:0/4121576914 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78940036a0 con 0x7f78a415c9b0 2023-11-28T12:06:10.798 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.796+0000 7f78a8bff700 1 -- 172.21.15.152:0/4121576914 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78a415c9b0 msgr2=0x7f78a40b4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:10.800 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.796+0000 7f78a8bff700 1 --2- 172.21.15.152:0/4121576914 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78a415c9b0 0x7f78a40b4bf0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7894009840 tx=0x7f7894009b50 comp rx=0 tx=0).stop 2023-11-28T12:06:10.800 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.796+0000 7f78a8bff700 1 -- 172.21.15.152:0/4121576914 shutdown_connections 2023-11-28T12:06:10.800 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.796+0000 7f78a8bff700 1 --2- 172.21.15.152:0/4121576914 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78a415c9b0 0x7f78a40b4bf0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:10.801 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.796+0000 7f78a8bff700 1 -- 172.21.15.152:0/4121576914 >> 172.21.15.152:0/4121576914 conn(0x7f78a4072600 msgr2=0x7f78a40cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:10.801 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.796+0000 7f78a8bff700 1 -- 172.21.15.152:0/4121576914 shutdown_connections 2023-11-28T12:06:10.801 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.796+0000 7f78a8bff700 1 -- 172.21.15.152:0/4121576914 wait complete. 2023-11-28T12:06:10.803 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.798+0000 7f78a8bff700 1 Processor -- start 2023-11-28T12:06:10.803 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.798+0000 7f78a8bff700 1 -- start start 2023-11-28T12:06:10.803 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.799+0000 7f78a8bff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f78a40cd7c0 0x7f78a40c7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:10.803 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.799+0000 7f78a8bff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78a415c9b0 0x7f78a414d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:10.803 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.799+0000 7f78a8bff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f78a4161340 0x7f78a40cc9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:10.803 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.799+0000 7f78a8bff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a40c80b0 con 0x7f78a415c9b0 2023-11-28T12:06:10.803 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.799+0000 7f78a8bff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a40c8390 con 0x7f78a4161340 2023-11-28T12:06:10.804 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.799+0000 7f78a8bff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78a40c8670 con 0x7f78a40cd7c0 2023-11-28T12:06:10.804 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.799+0000 7f78a259c700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f78a40cd7c0 0x7f78a40c7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:10.804 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.799+0000 7f78a2d9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f78a4161340 0x7f78a40cc9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:10.804 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.799+0000 7f78a259c700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f78a40cd7c0 0x7f78a40c7ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.152:33034/0 (socket says 172.21.15.152:33034) 2023-11-28T12:06:10.804 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.799+0000 7f789bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78a415c9b0 0x7f78a414d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:10.804 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.799+0000 7f78a259c700 1 -- 172.21.15.152:0/69061929 learned_addr learned my addr 172.21.15.152:0/69061929 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-11-28T12:06:10.804 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.800+0000 7f789bfff700 1 -- 172.21.15.152:0/69061929 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f78a40cd7c0 msgr2=0x7f78a40c7ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:10.804 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.800+0000 7f789bfff700 1 --2- 172.21.15.152:0/69061929 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f78a40cd7c0 0x7f78a40c7ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:10.804 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.800+0000 7f789bfff700 1 -- 172.21.15.152:0/69061929 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f78a4161340 msgr2=0x7f78a40cc9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:10.804 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.800+0000 7f789bfff700 1 --2- 172.21.15.152:0/69061929 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f78a4161340 0x7f78a40cc9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:10.804 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.800+0000 7f789bfff700 1 -- 172.21.15.152:0/69061929 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78940094a0 con 0x7f78a415c9b0 2023-11-28T12:06:10.804 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.800+0000 7f78a259c700 1 --2- 172.21.15.152:0/69061929 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f78a40cd7c0 0x7f78a40c7ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:06:10.805 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.800+0000 7f789bfff700 1 --2- 172.21.15.152:0/69061929 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78a415c9b0 0x7f78a414d570 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f788c00c750 tx=0x7f788c00ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:10.805 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.800+0000 7f789affd700 1 -- 172.21.15.152:0/69061929 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f788c0054e0 con 0x7f78a415c9b0 2023-11-28T12:06:10.805 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.800+0000 7f789affd700 1 -- 172.21.15.152:0/69061929 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f788c003680 con 0x7f78a415c9b0 2023-11-28T12:06:10.805 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.800+0000 7f78a8bff700 1 -- 172.21.15.152:0/69061929 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78a40d15e0 con 0x7f78a415c9b0 2023-11-28T12:06:10.805 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.800+0000 7f789affd700 1 -- 172.21.15.152:0/69061929 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f788c003a30 con 0x7f78a415c9b0 2023-11-28T12:06:10.805 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.800+0000 7f78a8bff700 1 -- 172.21.15.152:0/69061929 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78a40d1300 con 0x7f78a415c9b0 2023-11-28T12:06:10.805 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.800+0000 7f789affd700 1 -- 172.21.15.152:0/69061929 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f788c019030 con 0x7f78a415c9b0 2023-11-28T12:06:10.805 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.801+0000 7f789affd700 1 -- 172.21.15.152:0/69061929 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f788c01c440 con 0x7f78a415c9b0 2023-11-28T12:06:10.805 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.802+0000 7f78a8bff700 1 -- 172.21.15.152:0/69061929 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78a40b5130 con 0x7f78a415c9b0 2023-11-28T12:06:10.805 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.804+0000 7f789affd700 1 -- 172.21.15.152:0/69061929 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f788c017070 con 0x7f78a415c9b0 2023-11-28T12:06:10.893 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.892+0000 7f78a8bff700 1 -- 172.21.15.152:0/69061929 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9f4b36b2-65d2-40e7-9fe6-a2991afa71c5", "id": 2} v 0) v1 -- 0x7f78a40745c0 con 0x7f78a415c9b0 2023-11-28T12:06:10.896 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.895+0000 7f789affd700 1 -- 172.21.15.152:0/69061929 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9f4b36b2-65d2-40e7-9fe6-a2991afa71c5", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f788c003b90 con 0x7f78a415c9b0 2023-11-28T12:06:10.896 INFO:teuthology.orchestra.run.smithi152.stdout:2 2023-11-28T12:06:10.897 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.896+0000 7f78a8bff700 1 -- 172.21.15.152:0/69061929 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78a415c9b0 msgr2=0x7f78a414d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:10.898 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.896+0000 7f78a8bff700 1 --2- 172.21.15.152:0/69061929 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78a415c9b0 0x7f78a414d570 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f788c00c750 tx=0x7f788c00ca60 comp rx=0 tx=0).stop 2023-11-28T12:06:10.898 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.896+0000 7f78a8bff700 1 -- 172.21.15.152:0/69061929 shutdown_connections 2023-11-28T12:06:10.898 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.896+0000 7f78a8bff700 1 --2- 172.21.15.152:0/69061929 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f78a4161340 0x7f78a40cc9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:10.898 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.896+0000 7f78a8bff700 1 --2- 172.21.15.152:0/69061929 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f78a40cd7c0 0x7f78a40c7ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:10.898 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.896+0000 7f78a8bff700 1 --2- 172.21.15.152:0/69061929 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78a415c9b0 0x7f78a414d570 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:10.898 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.896+0000 7f78a8bff700 1 -- 172.21.15.152:0/69061929 >> 172.21.15.152:0/69061929 conn(0x7f78a4072600 msgr2=0x7f78a415aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:10.898 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.896+0000 7f78a8bff700 1 -- 172.21.15.152:0/69061929 shutdown_connections 2023-11-28T12:06:10.899 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:10.896+0000 7f78a8bff700 1 -- 172.21.15.152:0/69061929 wait complete. 2023-11-28T12:06:10.915 DEBUG:teuthology.orchestra.run.smithi152:> sudo ceph --cluster ceph osd new 6fe7ef05-4e0d-426c-bf94-44b51d4d550b 3 2023-11-28T12:06:10.980 INFO:tasks.ceph.mgr.x.smithi152.stderr:2023-11-28T12:06:10.979+0000 7f3d7c63d240 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-28T12:06:11.018 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-11-28T12:06:11.017+0000 7f1d96e99240 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-28T12:06:11.117 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.110+0000 7fc6b5bff700 1 Processor -- start 2023-11-28T12:06:11.117 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.111+0000 7fc6b5bff700 1 -- start start 2023-11-28T12:06:11.117 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.112+0000 7fc6b5bff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc6b00d01b0 0x7fc6b00d0c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:11.117 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.112+0000 7fc6b5bff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fc6b00b20b0 0x7fc6b00d1160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:11.117 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.112+0000 7fc6b5bff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc6b00b29b0 0x7fc6b00b2e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:11.117 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.112+0000 7fc6b5bff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6b015cec0 con 0x7fc6b00b29b0 2023-11-28T12:06:11.118 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.112+0000 7fc6b5bff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6b00b0230 con 0x7fc6b00b20b0 2023-11-28T12:06:11.118 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.112+0000 7fc6b5bff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b00b4570 con 0x7fc6b00d01b0 2023-11-28T12:06:11.118 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.112+0000 7fc6af7fe700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc6b00d01b0 0x7fc6b00d0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:11.118 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.112+0000 7fc6aeffd700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fc6b00b20b0 0x7fc6b00d1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:11.118 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.112+0000 7fc6aeffd700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fc6b00b20b0 0x7fc6b00d1160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:55232/0 (socket says 172.21.15.152:55232) 2023-11-28T12:06:11.118 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.112+0000 7fc6af7fe700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc6b00d01b0 0x7fc6b00d0c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.152:33048/0 (socket says 172.21.15.152:33048) 2023-11-28T12:06:11.118 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.112+0000 7fc6aeffd700 1 -- 172.21.15.152:0/2835519279 learned_addr learned my addr 172.21.15.152:0/2835519279 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-11-28T12:06:11.118 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.112+0000 7fc6affff700 1 --2- 172.21.15.152:0/2835519279 >> v2:172.21.15.45:3300/0 conn(0x7fc6b00b29b0 0x7fc6b00b2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:11.118 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.112+0000 7fc6aeffd700 1 -- 172.21.15.152:0/2835519279 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc6b00d01b0 msgr2=0x7fc6b00d0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:06:11.118 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.112+0000 7fc6aeffd700 1 --2- 172.21.15.152:0/2835519279 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc6b00d01b0 0x7fc6b00d0c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:11.119 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.112+0000 7fc6aeffd700 1 -- 172.21.15.152:0/2835519279 >> v2:172.21.15.45:3300/0 conn(0x7fc6b00b29b0 msgr2=0x7fc6b00b2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:06:11.119 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.112+0000 7fc6aeffd700 1 --2- 172.21.15.152:0/2835519279 >> v2:172.21.15.45:3300/0 conn(0x7fc6b00b29b0 0x7fc6b00b2e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:11.119 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.113+0000 7fc6aeffd700 1 -- 172.21.15.152:0/2835519279 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6b00b4850 con 0x7fc6b00b20b0 2023-11-28T12:06:11.119 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.113+0000 7fc6af7fe700 1 --2- 172.21.15.152:0/2835519279 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc6b00d01b0 0x7fc6b00d0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:06:11.119 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.113+0000 7fc6affff700 1 --2- 172.21.15.152:0/2835519279 >> v2:172.21.15.45:3300/0 conn(0x7fc6b00b29b0 0x7fc6b00b2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:06:11.119 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.113+0000 7fc6aeffd700 1 --2- 172.21.15.152:0/2835519279 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc6b00b20b0 0x7fc6b00d1160 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc6b00b5c10 tx=0x7fc6a4009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5679ddaf5cea9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:11.119 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.113+0000 7fc6ae7fc700 1 -- 172.21.15.152:0/2835519279 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a4011830 con 0x7fc6b00b20b0 2023-11-28T12:06:11.119 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.113+0000 7fc6ae7fc700 1 -- 172.21.15.152:0/2835519279 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6a4011990 con 0x7fc6b00b20b0 2023-11-28T12:06:11.119 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.113+0000 7fc6ae7fc700 1 -- 172.21.15.152:0/2835519279 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a4011d20 con 0x7fc6b00b20b0 2023-11-28T12:06:11.119 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.114+0000 7fc6b5bff700 1 -- 172.21.15.152:0/2835519279 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc6b00b20b0 msgr2=0x7fc6b00d1160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:11.120 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.114+0000 7fc6b5bff700 1 --2- 172.21.15.152:0/2835519279 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc6b00b20b0 0x7fc6b00d1160 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc6b00b5c10 tx=0x7fc6a4009bd0 comp rx=0 tx=0).stop 2023-11-28T12:06:11.120 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.114+0000 7fc6b5bff700 1 -- 172.21.15.152:0/2835519279 shutdown_connections 2023-11-28T12:06:11.120 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.114+0000 7fc6b5bff700 1 --2- 172.21.15.152:0/2835519279 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc6b00d01b0 0x7fc6b00d0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:11.120 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.114+0000 7fc6b5bff700 1 --2- 172.21.15.152:0/2835519279 >> v2:172.21.15.45:3300/0 conn(0x7fc6b00b29b0 0x7fc6b00b2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:11.121 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.114+0000 7fc6b5bff700 1 --2- 172.21.15.152:0/2835519279 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc6b00b20b0 0x7fc6b00d1160 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:11.121 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.114+0000 7fc6b5bff700 1 -- 172.21.15.152:0/2835519279 >> 172.21.15.152:0/2835519279 conn(0x7fc6b009c3f0 msgr2=0x7fc6b00d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:11.121 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.114+0000 7fc6b5bff700 1 -- 172.21.15.152:0/2835519279 shutdown_connections 2023-11-28T12:06:11.121 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.114+0000 7fc6b5bff700 1 -- 172.21.15.152:0/2835519279 wait complete. 2023-11-28T12:06:11.121 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.116+0000 7fc6b5bff700 1 Processor -- start 2023-11-28T12:06:11.121 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.116+0000 7fc6b5bff700 1 -- start start 2023-11-28T12:06:11.124 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.117+0000 7fc6b5bff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc6b00b20b0 0x7fc6b01f1c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:11.124 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.117+0000 7fc6b5bff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6b00b29b0 0x7fc6b00cd680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:11.124 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.117+0000 7fc6b5bff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc6b00d01b0 0x7fc6b00cdbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:11.124 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.117+0000 7fc6b5bff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b00cd440 con 0x7fc6b00b29b0 2023-11-28T12:06:11.124 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.117+0000 7fc6b5bff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b015d040 con 0x7fc6b00b20b0 2023-11-28T12:06:11.125 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.117+0000 7fc6b5bff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b015d320 con 0x7fc6b00d01b0 2023-11-28T12:06:11.125 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.117+0000 7fc6af7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc6b00b20b0 0x7fc6b01f1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:11.125 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.117+0000 7fc6af7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc6b00b20b0 0x7fc6b01f1c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:55246/0 (socket says 172.21.15.152:55246) 2023-11-28T12:06:11.125 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.117+0000 7fc6af7fe700 1 -- 172.21.15.152:0/283913126 learned_addr learned my addr 172.21.15.152:0/283913126 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-11-28T12:06:11.125 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.117+0000 7fc6aeffd700 1 --2- 172.21.15.152:0/283913126 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6b00b29b0 0x7fc6b00cd680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:11.125 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.117+0000 7fc6affff700 1 --2- 172.21.15.152:0/283913126 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc6b00d01b0 0x7fc6b00cdbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:11.126 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.118+0000 7fc6af7fe700 1 -- 172.21.15.152:0/283913126 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc6b00d01b0 msgr2=0x7fc6b00cdbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:11.126 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.118+0000 7fc6af7fe700 1 --2- 172.21.15.152:0/283913126 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc6b00d01b0 0x7fc6b00cdbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:11.126 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.118+0000 7fc6af7fe700 1 -- 172.21.15.152:0/283913126 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6b00b29b0 msgr2=0x7fc6b00cd680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:11.126 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.118+0000 7fc6af7fe700 1 --2- 172.21.15.152:0/283913126 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6b00b29b0 0x7fc6b00cd680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:11.126 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.118+0000 7fc6af7fe700 1 -- 172.21.15.152:0/283913126 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6a00094a0 con 0x7fc6b00b20b0 2023-11-28T12:06:11.127 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.118+0000 7fc6af7fe700 1 --2- 172.21.15.152:0/283913126 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc6b00b20b0 0x7fc6b01f1c00 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc6a000ebe0 tx=0x7fc6a000eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:11.129 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.118+0000 7fc697fff700 1 -- 172.21.15.152:0/283913126 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a0009760 con 0x7fc6b00b20b0 2023-11-28T12:06:11.129 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.118+0000 7fc697fff700 1 -- 172.21.15.152:0/283913126 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6a000c850 con 0x7fc6b00b20b0 2023-11-28T12:06:11.129 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.118+0000 7fc697fff700 1 -- 172.21.15.152:0/283913126 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a000cbe0 con 0x7fc6b00b20b0 2023-11-28T12:06:11.130 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.118+0000 7fc6b5bff700 1 -- 172.21.15.152:0/283913126 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6a4009550 con 0x7fc6b00b20b0 2023-11-28T12:06:11.130 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.118+0000 7fc6b5bff700 1 -- 172.21.15.152:0/283913126 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6b00afec0 con 0x7fc6b00b20b0 2023-11-28T12:06:11.130 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.119+0000 7fc697fff700 1 -- 172.21.15.152:0/283913126 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7fc6a0019030 con 0x7fc6b00b20b0 2023-11-28T12:06:11.130 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.119+0000 7fc697fff700 1 -- 172.21.15.152:0/283913126 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fc6a000cd40 con 0x7fc6b00b20b0 2023-11-28T12:06:11.130 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.119+0000 7fc6b5bff700 1 -- 172.21.15.152:0/283913126 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6b00afbe0 con 0x7fc6b00b20b0 2023-11-28T12:06:11.130 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.122+0000 7fc697fff700 1 -- 172.21.15.152:0/283913126 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7fc6a0021060 con 0x7fc6b00b20b0 2023-11-28T12:06:11.211 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.210+0000 7fc6b5bff700 1 -- 172.21.15.152:0/283913126 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd new", "uuid": "6fe7ef05-4e0d-426c-bf94-44b51d4d550b", "id": 3} v 0) v1 -- 0x7fc6b00b2600 con 0x7fc6b00b20b0 2023-11-28T12:06:11.215 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.214+0000 7fc697fff700 1 -- 172.21.15.152:0/283913126 <== mon.1 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6fe7ef05-4e0d-426c-bf94-44b51d4d550b", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc6a0029020 con 0x7fc6b00b20b0 2023-11-28T12:06:11.216 INFO:teuthology.orchestra.run.smithi152.stdout:3 2023-11-28T12:06:11.217 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.215+0000 7fc6b5bff700 1 -- 172.21.15.152:0/283913126 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc6b00b20b0 msgr2=0x7fc6b01f1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:11.217 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.215+0000 7fc6b5bff700 1 --2- 172.21.15.152:0/283913126 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc6b00b20b0 0x7fc6b01f1c00 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc6a000ebe0 tx=0x7fc6a000eef0 comp rx=0 tx=0).stop 2023-11-28T12:06:11.217 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.215+0000 7fc6b5bff700 1 -- 172.21.15.152:0/283913126 shutdown_connections 2023-11-28T12:06:11.217 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.215+0000 7fc6b5bff700 1 --2- 172.21.15.152:0/283913126 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc6b00b20b0 0x7fc6b01f1c00 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:11.217 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.215+0000 7fc6b5bff700 1 --2- 172.21.15.152:0/283913126 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc6b00d01b0 0x7fc6b00cdbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:11.217 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.215+0000 7fc6b5bff700 1 --2- 172.21.15.152:0/283913126 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6b00b29b0 0x7fc6b00cd680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:11.218 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.215+0000 7fc6b5bff700 1 -- 172.21.15.152:0/283913126 >> 172.21.15.152:0/283913126 conn(0x7fc6b009c3f0 msgr2=0x7fc6b00b12f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:11.218 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.215+0000 7fc6b5bff700 1 -- 172.21.15.152:0/283913126 shutdown_connections 2023-11-28T12:06:11.218 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.216+0000 7fc6b5bff700 1 -- 172.21.15.152:0/283913126 wait complete. 2023-11-28T12:06:11.234 DEBUG:teuthology.orchestra.run.smithi152:> sudo ceph --cluster ceph osd new fa403c08-d8a1-4a3a-8384-cb465c1a654c 4 2023-11-28T12:06:11.440 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.438+0000 7ff4513ff700 1 Processor -- start 2023-11-28T12:06:11.440 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.438+0000 7ff4513ff700 1 -- start start 2023-11-28T12:06:11.444 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.439+0000 7ff4513ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ff44c15c9b0 0x7ff44c0b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:11.445 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.439+0000 7ff4513ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff44c0cd7c0 0x7ff44c0cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:11.445 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.440+0000 7ff4513ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff44c0d1950 con 0x7ff44c161340 2023-11-28T12:06:11.445 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.440+0000 7ff4513ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff44c0b5800 con 0x7ff44c0cd7c0 2023-11-28T12:06:11.445 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.440+0000 7ff4513ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff44c0ce140 con 0x7ff44c15c9b0 2023-11-28T12:06:11.445 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.440+0000 7ff44affd700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ff44c15c9b0 0x7ff44c0b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:11.445 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.440+0000 7ff44affd700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ff44c15c9b0 0x7ff44c0b4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:55248/0 (socket says 172.21.15.152:55248) 2023-11-28T12:06:11.446 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.440+0000 7ff44affd700 1 -- 172.21.15.152:0/1835014283 learned_addr learned my addr 172.21.15.152:0/1835014283 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-11-28T12:06:11.446 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.440+0000 7ff443fff700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7ff44c161340 0x7ff44c0d1de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:47128/0 (socket says 172.21.15.152:47128) 2023-11-28T12:06:11.446 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.440+0000 7ff44b7fe700 1 --2- 172.21.15.152:0/1835014283 >> v2:172.21.15.45:3300/0 conn(0x7ff44c0cd7c0 0x7ff44c0cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:11.446 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.440+0000 7ff44affd700 1 -- 172.21.15.152:0/1835014283 >> v2:172.21.15.45:3300/0 conn(0x7ff44c0cd7c0 msgr2=0x7ff44c0cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:06:11.446 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.440+0000 7ff44affd700 1 --2- 172.21.15.152:0/1835014283 >> v2:172.21.15.45:3300/0 conn(0x7ff44c0cd7c0 0x7ff44c0cdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:11.446 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.440+0000 7ff44affd700 1 -- 172.21.15.152:0/1835014283 >> v1:172.21.15.152:6789/0 conn(0x7ff44c161340 legacy=0x7ff44c0d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:11.447 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.440+0000 7ff44affd700 1 -- 172.21.15.152:0/1835014283 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff44c0d24f0 con 0x7ff44c15c9b0 2023-11-28T12:06:11.447 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.440+0000 7ff44a7fc700 1 -- 172.21.15.152:0/1835014283 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4122139405 0 0) 0x7ff44c0d1950 con 0x7ff44c161340 2023-11-28T12:06:11.447 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.441+0000 7ff44affd700 1 --2- 172.21.15.152:0/1835014283 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff44c15c9b0 0x7ff44c0b4bf0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff44c067460 tx=0x7ff43c009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57ed0ba8377df8ff server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:11.447 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.441+0000 7ff44a7fc700 1 -- 172.21.15.152:0/1835014283 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43c011830 con 0x7ff44c15c9b0 2023-11-28T12:06:11.447 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.441+0000 7ff44a7fc700 1 -- 172.21.15.152:0/1835014283 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff43c011990 con 0x7ff44c15c9b0 2023-11-28T12:06:11.447 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.441+0000 7ff44a7fc700 1 -- 172.21.15.152:0/1835014283 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43c011d20 con 0x7ff44c15c9b0 2023-11-28T12:06:11.447 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.441+0000 7ff4513ff700 1 -- 172.21.15.152:0/1835014283 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff44c15c9b0 msgr2=0x7ff44c0b4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:11.448 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.441+0000 7ff4513ff700 1 --2- 172.21.15.152:0/1835014283 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff44c15c9b0 0x7ff44c0b4bf0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff44c067460 tx=0x7ff43c009bd0 comp rx=0 tx=0).stop 2023-11-28T12:06:11.448 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.442+0000 7ff4513ff700 1 -- 172.21.15.152:0/1835014283 shutdown_connections 2023-11-28T12:06:11.448 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.442+0000 7ff4513ff700 1 --2- 172.21.15.152:0/1835014283 >> v2:172.21.15.45:3300/0 conn(0x7ff44c0cd7c0 0x7ff44c0cdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:11.448 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.442+0000 7ff4513ff700 1 --2- 172.21.15.152:0/1835014283 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff44c15c9b0 0x7ff44c0b4bf0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:11.448 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.442+0000 7ff4513ff700 1 -- 172.21.15.152:0/1835014283 >> 172.21.15.152:0/1835014283 conn(0x7ff44c072600 msgr2=0x7ff44c0cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:11.448 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.442+0000 7ff4513ff700 1 -- 172.21.15.152:0/1835014283 shutdown_connections 2023-11-28T12:06:11.449 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.442+0000 7ff4513ff700 1 -- 172.21.15.152:0/1835014283 wait complete. 2023-11-28T12:06:11.453 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.444+0000 7ff4513ff700 1 Processor -- start 2023-11-28T12:06:11.453 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.445+0000 7ff4513ff700 1 -- start start 2023-11-28T12:06:11.453 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.446+0000 7ff4513ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff44c0cd7c0 0x7ff44c157870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:11.454 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.446+0000 7ff4513ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff44c15c9b0 0x7ff44c0c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:11.454 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.446+0000 7ff4513ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff44c161340 0x7ff44c15e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:11.454 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.446+0000 7ff4513ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff44c1f2740 con 0x7ff44c15c9b0 2023-11-28T12:06:11.454 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.446+0000 7ff4513ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff44c157db0 con 0x7ff44c0cd7c0 2023-11-28T12:06:11.454 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.446+0000 7ff4513ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff44c0c9170 con 0x7ff44c161340 2023-11-28T12:06:11.454 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.446+0000 7ff44affd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff44c0cd7c0 0x7ff44c157870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:11.454 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.446+0000 7ff44affd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff44c0cd7c0 0x7ff44c157870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:55264/0 (socket says 172.21.15.152:55264) 2023-11-28T12:06:11.455 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.446+0000 7ff44affd700 1 -- 172.21.15.152:0/2110224082 learned_addr learned my addr 172.21.15.152:0/2110224082 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-11-28T12:06:11.455 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.447+0000 7ff44b7fe700 1 --2- 172.21.15.152:0/2110224082 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff44c161340 0x7ff44c15e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:11.455 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.447+0000 7ff443fff700 1 --2- 172.21.15.152:0/2110224082 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff44c15c9b0 0x7ff44c0c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:11.455 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.447+0000 7ff44affd700 1 -- 172.21.15.152:0/2110224082 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff44c161340 msgr2=0x7ff44c15e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:11.455 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.447+0000 7ff44affd700 1 --2- 172.21.15.152:0/2110224082 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff44c161340 0x7ff44c15e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:11.455 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.447+0000 7ff44affd700 1 -- 172.21.15.152:0/2110224082 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff44c15c9b0 msgr2=0x7ff44c0c86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:11.455 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.447+0000 7ff44affd700 1 --2- 172.21.15.152:0/2110224082 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff44c15c9b0 0x7ff44c0c86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:11.456 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.447+0000 7ff44affd700 1 -- 172.21.15.152:0/2110224082 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff43c009550 con 0x7ff44c0cd7c0 2023-11-28T12:06:11.456 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.447+0000 7ff44affd700 1 --2- 172.21.15.152:0/2110224082 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff44c0cd7c0 0x7ff44c157870 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff43c009c10 tx=0x7ff43c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:11.456 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.447+0000 7ff4437fe700 1 -- 172.21.15.152:0/2110224082 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43c004590 con 0x7ff44c0cd7c0 2023-11-28T12:06:11.456 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.447+0000 7ff4437fe700 1 -- 172.21.15.152:0/2110224082 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff43c01e070 con 0x7ff44c0cd7c0 2023-11-28T12:06:11.456 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.447+0000 7ff4437fe700 1 -- 172.21.15.152:0/2110224082 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43c0038c0 con 0x7ff44c0cd7c0 2023-11-28T12:06:11.456 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.447+0000 7ff4513ff700 1 -- 172.21.15.152:0/2110224082 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff44c0d1300 con 0x7ff44c0cd7c0 2023-11-28T12:06:11.456 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.448+0000 7ff4513ff700 1 -- 172.21.15.152:0/2110224082 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff44c0b5520 con 0x7ff44c0cd7c0 2023-11-28T12:06:11.457 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.448+0000 7ff4437fe700 1 -- 172.21.15.152:0/2110224082 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7ff43c00f050 con 0x7ff44c0cd7c0 2023-11-28T12:06:11.457 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.448+0000 7ff4437fe700 1 -- 172.21.15.152:0/2110224082 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7ff43c02d6d0 con 0x7ff44c0cd7c0 2023-11-28T12:06:11.457 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.449+0000 7ff4513ff700 1 -- 172.21.15.152:0/2110224082 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff44c0d15e0 con 0x7ff44c0cd7c0 2023-11-28T12:06:11.457 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.451+0000 7ff4437fe700 1 -- 172.21.15.152:0/2110224082 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7ff43c020070 con 0x7ff44c0cd7c0 2023-11-28T12:06:11.559 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.558+0000 7ff4513ff700 1 -- 172.21.15.152:0/2110224082 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd new", "uuid": "fa403c08-d8a1-4a3a-8384-cb465c1a654c", "id": 4} v 0) v1 -- 0x7ff44c0d2310 con 0x7ff44c0cd7c0 2023-11-28T12:06:11.563 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.562+0000 7ff4437fe700 1 -- 172.21.15.152:0/2110224082 <== mon.1 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fa403c08-d8a1-4a3a-8384-cb465c1a654c", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff43c015020 con 0x7ff44c0cd7c0 2023-11-28T12:06:11.564 INFO:teuthology.orchestra.run.smithi152.stdout:4 2023-11-28T12:06:11.565 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.563+0000 7ff4513ff700 1 -- 172.21.15.152:0/2110224082 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff44c0cd7c0 msgr2=0x7ff44c157870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:11.566 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.563+0000 7ff4513ff700 1 --2- 172.21.15.152:0/2110224082 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff44c0cd7c0 0x7ff44c157870 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff43c009c10 tx=0x7ff43c004750 comp rx=0 tx=0).stop 2023-11-28T12:06:11.566 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.563+0000 7ff4513ff700 1 -- 172.21.15.152:0/2110224082 shutdown_connections 2023-11-28T12:06:11.566 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.563+0000 7ff4513ff700 1 --2- 172.21.15.152:0/2110224082 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff44c0cd7c0 0x7ff44c157870 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:11.566 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.563+0000 7ff4513ff700 1 --2- 172.21.15.152:0/2110224082 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff44c161340 0x7ff44c15e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:11.566 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.563+0000 7ff4513ff700 1 --2- 172.21.15.152:0/2110224082 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff44c15c9b0 0x7ff44c0c86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:11.567 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.563+0000 7ff4513ff700 1 -- 172.21.15.152:0/2110224082 >> 172.21.15.152:0/2110224082 conn(0x7ff44c072600 msgr2=0x7ff44c06a900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:11.567 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.564+0000 7ff4513ff700 1 -- 172.21.15.152:0/2110224082 shutdown_connections 2023-11-28T12:06:11.567 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.564+0000 7ff4513ff700 1 -- 172.21.15.152:0/2110224082 wait complete. 2023-11-28T12:06:11.583 DEBUG:teuthology.orchestra.run.smithi152:> sudo ceph --cluster ceph osd new 399fc450-39fa-43a6-bf80-0b8bcb41bd95 5 2023-11-28T12:06:11.776 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.775+0000 7f69913ff700 1 Processor -- start 2023-11-28T12:06:11.776 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.775+0000 7f69913ff700 1 -- start start 2023-11-28T12:06:11.778 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.776+0000 7f69913ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f698c15c9b0 0x7f698c0b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:11.779 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.776+0000 7f69913ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f698c161340 0x7f698c0d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:11.779 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.776+0000 7f69913ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f698c0d2320 0x7f698c0cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:11.781 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.776+0000 7f69913ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f698c0b5800 con 0x7f698c0d2320 2023-11-28T12:06:11.781 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.776+0000 7f69913ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f698c0d1950 con 0x7f698c161340 2023-11-28T12:06:11.781 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.776+0000 7f69913ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f698c0b5520 con 0x7f698c15c9b0 2023-11-28T12:06:11.781 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.777+0000 7f698affd700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f698c15c9b0 0x7f698c0b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:11.781 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.777+0000 7f6983fff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f698c161340 0x7f698c0d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:11.782 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.777+0000 7f698affd700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f698c15c9b0 0x7f698c0b4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.152:33078/0 (socket says 172.21.15.152:33078) 2023-11-28T12:06:11.782 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.777+0000 7f698affd700 1 -- 172.21.15.152:0/4184086231 learned_addr learned my addr 172.21.15.152:0/4184086231 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-11-28T12:06:11.782 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.777+0000 7f698b7fe700 1 --2- 172.21.15.152:0/4184086231 >> v2:172.21.15.45:3300/0 conn(0x7f698c0d2320 0x7f698c0cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:11.782 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.777+0000 7f698affd700 1 -- 172.21.15.152:0/4184086231 >> v2:172.21.15.152:3300/0 conn(0x7f698c161340 msgr2=0x7f698c0d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:06:11.782 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.777+0000 7f698affd700 1 --2- 172.21.15.152:0/4184086231 >> v2:172.21.15.152:3300/0 conn(0x7f698c161340 0x7f698c0d1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:11.782 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.777+0000 7f698affd700 1 -- 172.21.15.152:0/4184086231 >> v2:172.21.15.45:3300/0 conn(0x7f698c0d2320 msgr2=0x7f698c0cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:06:11.782 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.777+0000 7f698affd700 1 --2- 172.21.15.152:0/4184086231 >> v2:172.21.15.45:3300/0 conn(0x7f698c0d2320 0x7f698c0cd7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:11.782 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.777+0000 7f698affd700 1 -- 172.21.15.152:0/4184086231 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f698c0d1300 con 0x7f698c15c9b0 2023-11-28T12:06:11.782 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.777+0000 7f698affd700 1 --2- 172.21.15.152:0/4184086231 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f698c15c9b0 0x7f698c0b4bf0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f698c06bc00 tx=0x7f697c009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69e16380f1137b24 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:11.786 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.778+0000 7f698a7fc700 1 -- 172.21.15.152:0/4184086231 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f697c011830 con 0x7f698c15c9b0 2023-11-28T12:06:11.786 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.778+0000 7f698a7fc700 1 -- 172.21.15.152:0/4184086231 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f697c011990 con 0x7f698c15c9b0 2023-11-28T12:06:11.786 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.778+0000 7f698a7fc700 1 -- 172.21.15.152:0/4184086231 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f697c011d20 con 0x7f698c15c9b0 2023-11-28T12:06:11.786 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.778+0000 7f69913ff700 1 -- 172.21.15.152:0/4184086231 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f698c15c9b0 msgr2=0x7f698c0b4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:11.787 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.778+0000 7f69913ff700 1 --2- 172.21.15.152:0/4184086231 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f698c15c9b0 0x7f698c0b4bf0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f698c06bc00 tx=0x7f697c009bd0 comp rx=0 tx=0).stop 2023-11-28T12:06:11.787 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.778+0000 7f69913ff700 1 -- 172.21.15.152:0/4184086231 shutdown_connections 2023-11-28T12:06:11.787 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.778+0000 7f69913ff700 1 --2- 172.21.15.152:0/4184086231 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f698c15c9b0 0x7f698c0b4bf0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:11.787 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.778+0000 7f69913ff700 1 --2- 172.21.15.152:0/4184086231 >> v2:172.21.15.45:3300/0 conn(0x7f698c0d2320 0x7f698c0cd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:11.787 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.778+0000 7f69913ff700 1 --2- 172.21.15.152:0/4184086231 >> v2:172.21.15.152:3300/0 conn(0x7f698c161340 0x7f698c0d1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:11.787 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.778+0000 7f69913ff700 1 -- 172.21.15.152:0/4184086231 >> 172.21.15.152:0/4184086231 conn(0x7f698c072600 msgr2=0x7f698c0cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:11.787 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.778+0000 7f69913ff700 1 -- 172.21.15.152:0/4184086231 shutdown_connections 2023-11-28T12:06:11.787 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.778+0000 7f69913ff700 1 -- 172.21.15.152:0/4184086231 wait complete. 2023-11-28T12:06:11.788 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.780+0000 7f69913ff700 1 Processor -- start 2023-11-28T12:06:11.788 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.780+0000 7f69913ff700 1 -- start start 2023-11-28T12:06:11.788 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.781+0000 7f69913ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f698c0d2320 0x7f698c1576a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:11.788 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.781+0000 7f69913ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f698c15c9b0 0x7f698c154010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:11.788 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.781+0000 7f69913ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f698c161340 0x7f698c154550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:11.788 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.781+0000 7f69913ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f698c1f26a0 con 0x7f698c15c9b0 2023-11-28T12:06:11.788 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.781+0000 7f69913ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f698c1f2940 con 0x7f698c161340 2023-11-28T12:06:11.788 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.781+0000 7f69913ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f698c1f2c20 con 0x7f698c0d2320 2023-11-28T12:06:11.788 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.781+0000 7f698affd700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f698c0d2320 0x7f698c1576a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:11.788 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.781+0000 7f698b7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f698c161340 0x7f698c154550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:11.789 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.782+0000 7f698b7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f698c161340 0x7f698c154550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:55290/0 (socket says 172.21.15.152:55290) 2023-11-28T12:06:11.789 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.782+0000 7f698b7fe700 1 -- 172.21.15.152:0/713989766 learned_addr learned my addr 172.21.15.152:0/713989766 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-11-28T12:06:11.789 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.782+0000 7f6983fff700 1 --2- 172.21.15.152:0/713989766 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f698c15c9b0 0x7f698c154010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:11.789 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.782+0000 7f698affd700 1 -- 172.21.15.152:0/713989766 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f698c161340 msgr2=0x7f698c154550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:11.789 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.782+0000 7f698affd700 1 --2- 172.21.15.152:0/713989766 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f698c161340 0x7f698c154550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:11.789 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.782+0000 7f698affd700 1 -- 172.21.15.152:0/713989766 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f698c15c9b0 msgr2=0x7f698c154010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:11.789 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.782+0000 7f698affd700 1 --2- 172.21.15.152:0/713989766 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f698c15c9b0 0x7f698c154010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:11.789 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.782+0000 7f698affd700 1 -- 172.21.15.152:0/713989766 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f697c009550 con 0x7f698c0d2320 2023-11-28T12:06:11.789 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.782+0000 7f698b7fe700 1 --2- 172.21.15.152:0/713989766 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f698c161340 0x7f698c154550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:06:11.789 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.782+0000 7f698affd700 1 --2- 172.21.15.152:0/713989766 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f698c0d2320 0x7f698c1576a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f697c016000 tx=0x7f697c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:11.789 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.782+0000 7f69837fe700 1 -- 172.21.15.152:0/713989766 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f697c004450 con 0x7f698c0d2320 2023-11-28T12:06:11.790 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.783+0000 7f69837fe700 1 -- 172.21.15.152:0/713989766 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f697c01e070 con 0x7f698c0d2320 2023-11-28T12:06:11.790 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.783+0000 7f69837fe700 1 -- 172.21.15.152:0/713989766 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f697c0038e0 con 0x7f698c0d2320 2023-11-28T12:06:11.790 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.783+0000 7f69913ff700 1 -- 172.21.15.152:0/713989766 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f698c0b5130 con 0x7f698c0d2320 2023-11-28T12:06:11.790 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.783+0000 7f69913ff700 1 -- 172.21.15.152:0/713989766 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f698c0d15e0 con 0x7f698c0d2320 2023-11-28T12:06:11.790 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.783+0000 7f69837fe700 1 -- 172.21.15.152:0/713989766 <== mon.2 v2:172.21.15.152:3301/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f697c00f050 con 0x7f698c0d2320 2023-11-28T12:06:11.790 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.783+0000 7f69837fe700 1 -- 172.21.15.152:0/713989766 <== mon.2 v2:172.21.15.152:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f697c003a40 con 0x7f698c0d2320 2023-11-28T12:06:11.790 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.784+0000 7f69913ff700 1 -- 172.21.15.152:0/713989766 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f698c0b52c0 con 0x7f698c0d2320 2023-11-28T12:06:11.791 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.786+0000 7f69837fe700 1 -- 172.21.15.152:0/713989766 <== mon.2 v2:172.21.15.152:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f697c020070 con 0x7f698c0d2320 2023-11-28T12:06:11.874 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.873+0000 7f69913ff700 1 -- 172.21.15.152:0/713989766 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_command({"prefix": "osd new", "uuid": "399fc450-39fa-43a6-bf80-0b8bcb41bd95", "id": 5} v 0) v1 -- 0x7f698c0745c0 con 0x7f698c0d2320 2023-11-28T12:06:11.878 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.877+0000 7f69837fe700 1 -- 172.21.15.152:0/713989766 <== mon.2 v2:172.21.15.152:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "399fc450-39fa-43a6-bf80-0b8bcb41bd95", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f697c015020 con 0x7f698c0d2320 2023-11-28T12:06:11.878 INFO:teuthology.orchestra.run.smithi152.stdout:5 2023-11-28T12:06:11.879 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.878+0000 7f69913ff700 1 -- 172.21.15.152:0/713989766 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f698c0d2320 msgr2=0x7f698c1576a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:11.879 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.878+0000 7f69913ff700 1 --2- 172.21.15.152:0/713989766 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f698c0d2320 0x7f698c1576a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f697c016000 tx=0x7f697c004750 comp rx=0 tx=0).stop 2023-11-28T12:06:11.879 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.878+0000 7f69913ff700 1 -- 172.21.15.152:0/713989766 shutdown_connections 2023-11-28T12:06:11.879 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.878+0000 7f69913ff700 1 --2- 172.21.15.152:0/713989766 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f698c161340 0x7f698c154550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:11.879 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.878+0000 7f69913ff700 1 --2- 172.21.15.152:0/713989766 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f698c0d2320 0x7f698c1576a0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:11.880 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.878+0000 7f69913ff700 1 --2- 172.21.15.152:0/713989766 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f698c15c9b0 0x7f698c154010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:11.880 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.878+0000 7f69913ff700 1 -- 172.21.15.152:0/713989766 >> 172.21.15.152:0/713989766 conn(0x7f698c072600 msgr2=0x7f698c15cd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:11.880 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.878+0000 7f69913ff700 1 -- 172.21.15.152:0/713989766 shutdown_connections 2023-11-28T12:06:11.880 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:11.878+0000 7f69913ff700 1 -- 172.21.15.152:0/713989766 wait complete. 2023-11-28T12:06:11.900 DEBUG:teuthology.orchestra.run.smithi152:> sudo ceph --cluster ceph osd new e59a4017-2d23-4627-836b-e25b2d3ddaaf 6 2023-11-28T12:06:11.942 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-11-28T12:06:11.939+0000 7f1d96e99240 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-28T12:06:11.944 INFO:tasks.ceph.mgr.x.smithi152.stderr:2023-11-28T12:06:11.942+0000 7f3d7c63d240 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-28T12:06:12.036 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-11-28T12:06:12.035+0000 7f1d96e99240 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-28T12:06:12.039 INFO:tasks.ceph.mgr.x.smithi152.stderr:2023-11-28T12:06:12.039+0000 7f3d7c63d240 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-28T12:06:12.095 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.094+0000 7fa6c01ff700 1 Processor -- start 2023-11-28T12:06:12.095 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.094+0000 7fa6c01ff700 1 -- start start 2023-11-28T12:06:12.107 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.095+0000 7fa6c01ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fa6b80d01b0 0x7fa6b80d0c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:12.107 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.095+0000 7fa6c01ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa6b80b20b0 0x7fa6b80d1160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:12.107 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.095+0000 7fa6c01ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6b80b0230 con 0x7fa6b80b29b0 2023-11-28T12:06:12.107 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.095+0000 7fa6c01ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6b815cec0 con 0x7fa6b80d01b0 2023-11-28T12:06:12.107 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.095+0000 7fa6c01ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b80b4570 con 0x7fa6b80b20b0 2023-11-28T12:06:12.107 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.095+0000 7fa6bdf9b700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fa6b80d01b0 0x7fa6b80d0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:12.107 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.095+0000 7fa6bd79a700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa6b80b20b0 0x7fa6b80d1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:12.107 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.095+0000 7fa6bd79a700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa6b80b20b0 0x7fa6b80d1160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.152:33106/0 (socket says 172.21.15.152:33106) 2023-11-28T12:06:12.107 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.095+0000 7fa6bd79a700 1 -- 172.21.15.152:0/551879152 learned_addr learned my addr 172.21.15.152:0/551879152 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-11-28T12:06:12.108 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.095+0000 7fa6be79c700 1 --1- 172.21.15.152:0/551879152 >> v1:172.21.15.45:6789/0 conn(0x7fa6b80b29b0 0x7fa6b80b2e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.152:58630/0 (socket says 172.21.15.152:58630) 2023-11-28T12:06:12.108 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.096+0000 7fa6bdf9b700 1 -- 172.21.15.152:0/551879152 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa6b80b20b0 msgr2=0x7fa6b80d1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:06:12.108 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.096+0000 7fa6bdf9b700 1 --2- 172.21.15.152:0/551879152 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa6b80b20b0 0x7fa6b80d1160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:12.108 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.096+0000 7fa6bdf9b700 1 -- 172.21.15.152:0/551879152 >> v1:172.21.15.45:6789/0 conn(0x7fa6b80b29b0 legacy=0x7fa6b80b2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:12.108 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.096+0000 7fa6bdf9b700 1 -- 172.21.15.152:0/551879152 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6b80b4850 con 0x7fa6b80d01b0 2023-11-28T12:06:12.108 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.096+0000 7fa6bd79a700 1 --2- 172.21.15.152:0/551879152 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa6b80b20b0 0x7fa6b80d1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:06:12.108 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.096+0000 7fa6bcf99700 1 -- 172.21.15.152:0/551879152 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3131024116 0 0) 0x7fa6b80b0230 con 0x7fa6b80b29b0 2023-11-28T12:06:12.108 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.096+0000 7fa6bdf9b700 1 --2- 172.21.15.152:0/551879152 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6b80d01b0 0x7fa6b80d0c20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa6b4009840 tx=0x7fa6b4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8adf1e20d0ebb0e2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:12.108 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.096+0000 7fa6bcf99700 1 -- 172.21.15.152:0/551879152 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6b4011830 con 0x7fa6b80d01b0 2023-11-28T12:06:12.109 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.096+0000 7fa6bcf99700 1 -- 172.21.15.152:0/551879152 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6b4011990 con 0x7fa6b80d01b0 2023-11-28T12:06:12.109 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.096+0000 7fa6bcf99700 1 -- 172.21.15.152:0/551879152 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6b4011d20 con 0x7fa6b80d01b0 2023-11-28T12:06:12.109 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.097+0000 7fa6c01ff700 1 -- 172.21.15.152:0/551879152 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6b80d01b0 msgr2=0x7fa6b80d0c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:12.109 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.097+0000 7fa6c01ff700 1 --2- 172.21.15.152:0/551879152 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6b80d01b0 0x7fa6b80d0c20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa6b4009840 tx=0x7fa6b4009b50 comp rx=0 tx=0).stop 2023-11-28T12:06:12.109 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.097+0000 7fa6c01ff700 1 -- 172.21.15.152:0/551879152 shutdown_connections 2023-11-28T12:06:12.109 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.097+0000 7fa6c01ff700 1 --2- 172.21.15.152:0/551879152 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6b80d01b0 0x7fa6b80d0c20 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:12.109 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.097+0000 7fa6c01ff700 1 --2- 172.21.15.152:0/551879152 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa6b80b20b0 0x7fa6b80d1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:12.109 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.097+0000 7fa6c01ff700 1 -- 172.21.15.152:0/551879152 >> 172.21.15.152:0/551879152 conn(0x7fa6b809c3f0 msgr2=0x7fa6b80d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:12.109 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.097+0000 7fa6c01ff700 1 -- 172.21.15.152:0/551879152 shutdown_connections 2023-11-28T12:06:12.109 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.097+0000 7fa6c01ff700 1 -- 172.21.15.152:0/551879152 wait complete. 2023-11-28T12:06:12.109 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.099+0000 7fa6c01ff700 1 Processor -- start 2023-11-28T12:06:12.109 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.099+0000 7fa6c01ff700 1 -- start start 2023-11-28T12:06:12.110 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.100+0000 7fa6c01ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa6b80b20b0 0x7fa6b80ce6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:12.110 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.100+0000 7fa6c01ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa6b80b29b0 0x7fa6b80cec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:12.110 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.100+0000 7fa6c01ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6b80d01b0 0x7fa6b8158420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:12.110 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.100+0000 7fa6c01ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b80b64b0 con 0x7fa6b80b20b0 2023-11-28T12:06:12.110 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.100+0000 7fa6c01ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b80b6720 con 0x7fa6b80d01b0 2023-11-28T12:06:12.110 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.100+0000 7fa6c01ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b80b6a00 con 0x7fa6b80b29b0 2023-11-28T12:06:12.110 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.100+0000 7fa6bd79a700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa6b80b29b0 0x7fa6b80cec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:12.110 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.100+0000 7fa6bd79a700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa6b80b29b0 0x7fa6b80cec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.152:33122/0 (socket says 172.21.15.152:33122) 2023-11-28T12:06:12.110 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.100+0000 7fa6bd79a700 1 -- 172.21.15.152:0/3611326844 learned_addr learned my addr 172.21.15.152:0/3611326844 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-11-28T12:06:12.111 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.100+0000 7fa6bdf9b700 1 --2- 172.21.15.152:0/3611326844 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa6b80b20b0 0x7fa6b80ce6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:12.111 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.100+0000 7fa6be79c700 1 --2- 172.21.15.152:0/3611326844 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6b80d01b0 0x7fa6b8158420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:12.111 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.101+0000 7fa6bd79a700 1 -- 172.21.15.152:0/3611326844 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6b80d01b0 msgr2=0x7fa6b8158420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:12.111 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.101+0000 7fa6bd79a700 1 --2- 172.21.15.152:0/3611326844 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6b80d01b0 0x7fa6b8158420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:12.111 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.101+0000 7fa6bd79a700 1 -- 172.21.15.152:0/3611326844 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa6b80b20b0 msgr2=0x7fa6b80ce6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:12.111 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.101+0000 7fa6bd79a700 1 --2- 172.21.15.152:0/3611326844 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa6b80b20b0 0x7fa6b80ce6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:12.111 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.101+0000 7fa6bd79a700 1 -- 172.21.15.152:0/3611326844 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6a8009550 con 0x7fa6b80b29b0 2023-11-28T12:06:12.111 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.101+0000 7fa6bd79a700 1 --2- 172.21.15.152:0/3611326844 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa6b80b29b0 0x7fa6b80cec10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa6a800ebe0 tx=0x7fa6a800eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:12.111 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.101+0000 7fa6ae7fc700 1 -- 172.21.15.152:0/3611326844 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a800c850 con 0x7fa6b80b29b0 2023-11-28T12:06:12.111 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.101+0000 7fa6ae7fc700 1 -- 172.21.15.152:0/3611326844 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6a800c9b0 con 0x7fa6b80b29b0 2023-11-28T12:06:12.111 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.101+0000 7fa6c01ff700 1 -- 172.21.15.152:0/3611326844 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6b40094a0 con 0x7fa6b80b29b0 2023-11-28T12:06:12.111 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.101+0000 7fa6ae7fc700 1 -- 172.21.15.152:0/3611326844 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a800cd40 con 0x7fa6b80b29b0 2023-11-28T12:06:12.112 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.102+0000 7fa6c01ff700 1 -- 172.21.15.152:0/3611326844 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6b80afec0 con 0x7fa6b80b29b0 2023-11-28T12:06:12.112 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.102+0000 7fa6ae7fc700 1 -- 172.21.15.152:0/3611326844 <== mon.2 v2:172.21.15.152:3301/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7fa6a8019030 con 0x7fa6b80b29b0 2023-11-28T12:06:12.112 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.102+0000 7fa6ae7fc700 1 -- 172.21.15.152:0/3611326844 <== mon.2 v2:172.21.15.152:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fa6a80062a0 con 0x7fa6b80b29b0 2023-11-28T12:06:12.112 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.103+0000 7fa6c01ff700 1 -- 172.21.15.152:0/3611326844 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6b80afbe0 con 0x7fa6b80b29b0 2023-11-28T12:06:12.112 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.105+0000 7fa6ae7fc700 1 -- 172.21.15.152:0/3611326844 <== mon.2 v2:172.21.15.152:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7fa6a8021060 con 0x7fa6b80b29b0 2023-11-28T12:06:12.195 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.193+0000 7fa6c01ff700 1 -- 172.21.15.152:0/3611326844 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e59a4017-2d23-4627-836b-e25b2d3ddaaf", "id": 6} v 0) v1 -- 0x7fa6b80b7330 con 0x7fa6b80b29b0 2023-11-28T12:06:12.217 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-11-28T12:06:12.214+0000 7f1d96e99240 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-28T12:06:12.217 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.197+0000 7fa6ae7fc700 1 -- 172.21.15.152:0/3611326844 <== mon.2 v2:172.21.15.152:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e59a4017-2d23-4627-836b-e25b2d3ddaaf", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa6a80290b0 con 0x7fa6b80b29b0 2023-11-28T12:06:12.217 INFO:teuthology.orchestra.run.smithi152.stdout:6 2023-11-28T12:06:12.219 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.198+0000 7fa6c01ff700 1 -- 172.21.15.152:0/3611326844 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa6b80b29b0 msgr2=0x7fa6b80cec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:12.219 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.198+0000 7fa6c01ff700 1 --2- 172.21.15.152:0/3611326844 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa6b80b29b0 0x7fa6b80cec10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa6a800ebe0 tx=0x7fa6a800eef0 comp rx=0 tx=0).stop 2023-11-28T12:06:12.219 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.198+0000 7fa6c01ff700 1 -- 172.21.15.152:0/3611326844 shutdown_connections 2023-11-28T12:06:12.219 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.198+0000 7fa6c01ff700 1 --2- 172.21.15.152:0/3611326844 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6b80d01b0 0x7fa6b8158420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:12.219 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.198+0000 7fa6c01ff700 1 --2- 172.21.15.152:0/3611326844 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa6b80b20b0 0x7fa6b80ce6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:12.219 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.198+0000 7fa6c01ff700 1 --2- 172.21.15.152:0/3611326844 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa6b80b29b0 0x7fa6b80cec10 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:12.219 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.198+0000 7fa6c01ff700 1 -- 172.21.15.152:0/3611326844 >> 172.21.15.152:0/3611326844 conn(0x7fa6b809c3f0 msgr2=0x7fa6b80b13f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:12.219 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.198+0000 7fa6c01ff700 1 -- 172.21.15.152:0/3611326844 shutdown_connections 2023-11-28T12:06:12.219 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.198+0000 7fa6c01ff700 1 -- 172.21.15.152:0/3611326844 wait complete. 2023-11-28T12:06:12.220 DEBUG:teuthology.orchestra.run.smithi152:> sudo ceph --cluster ceph osd new 8d7f9d4b-bf08-4670-8591-388c0f012a45 7 2023-11-28T12:06:12.220 INFO:tasks.ceph.mgr.x.smithi152.stderr:2023-11-28T12:06:12.218+0000 7f3d7c63d240 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-28T12:06:12.308 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-11-28T12:06:12.307+0000 7f1d96e99240 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-28T12:06:12.311 INFO:tasks.ceph.mgr.x.smithi152.stderr:2023-11-28T12:06:12.310+0000 7f3d7c63d240 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-28T12:06:12.406 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-11-28T12:06:12.405+0000 7f1d96e99240 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-28T12:06:12.409 INFO:tasks.ceph.mgr.x.smithi152.stderr:2023-11-28T12:06:12.409+0000 7f3d7c63d240 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-28T12:06:12.464 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.463+0000 7f78abdff700 1 Processor -- start 2023-11-28T12:06:12.464 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.463+0000 7f78abdff700 1 -- start start 2023-11-28T12:06:12.466 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.464+0000 7f78abdff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f78a415c9b0 0x7f78a40b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:12.467 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.464+0000 7f78abdff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f78a4161340 0x7f78a40d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:12.467 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.464+0000 7f78abdff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78a40d1950 con 0x7f78a40d2320 2023-11-28T12:06:12.467 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.464+0000 7f78abdff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78a40b5800 con 0x7f78a4161340 2023-11-28T12:06:12.467 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.464+0000 7f78abdff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78a40b5520 con 0x7f78a415c9b0 2023-11-28T12:06:12.467 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.464+0000 7f78a9b9b700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f78a415c9b0 0x7f78a40b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:12.467 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.464+0000 7f78aa39c700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f78a40d2320 0x7f78a40cd7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:47130/0 (socket says 172.21.15.152:47130) 2023-11-28T12:06:12.467 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.464+0000 7f78a9b9b700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f78a415c9b0 0x7f78a40b4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.152:33136/0 (socket says 172.21.15.152:33136) 2023-11-28T12:06:12.467 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.464+0000 7f78aa39c700 1 -- 172.21.15.152:0/2833189008 learned_addr learned my addr 172.21.15.152:0/2833189008 (peer_addr_for_me v1:172.21.15.152:0/0) 2023-11-28T12:06:12.467 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.464+0000 7f78a939a700 1 --2- 172.21.15.152:0/2833189008 >> v2:172.21.15.45:3300/0 conn(0x7f78a4161340 0x7f78a40d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:12.467 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.465+0000 7f78a9b9b700 1 -- 172.21.15.152:0/2833189008 >> v2:172.21.15.45:3300/0 conn(0x7f78a4161340 msgr2=0x7f78a40d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:06:12.467 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.465+0000 7f78a9b9b700 1 --2- 172.21.15.152:0/2833189008 >> v2:172.21.15.45:3300/0 conn(0x7f78a4161340 0x7f78a40d1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:12.467 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.465+0000 7f78a9b9b700 1 -- 172.21.15.152:0/2833189008 >> v1:172.21.15.152:6789/0 conn(0x7f78a40d2320 legacy=0x7f78a40cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:12.468 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.465+0000 7f78a9b9b700 1 -- 172.21.15.152:0/2833189008 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78a40d1300 con 0x7f78a415c9b0 2023-11-28T12:06:12.468 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.465+0000 7f78a9b9b700 1 --2- 172.21.15.152:0/2833189008 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f78a415c9b0 0x7f78a40b4bf0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f78a0009840 tx=0x7f78a0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2d2bcffa7a4b8af server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:12.468 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.465+0000 7f78a8b99700 1 -- 172.21.15.152:0/2833189008 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a0011830 con 0x7f78a415c9b0 2023-11-28T12:06:12.468 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.465+0000 7f78a8b99700 1 -- 172.21.15.152:0/2833189008 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78a0011990 con 0x7f78a415c9b0 2023-11-28T12:06:12.468 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.465+0000 7f78a8b99700 1 -- 172.21.15.152:0/2833189008 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a0011d20 con 0x7f78a415c9b0 2023-11-28T12:06:12.468 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.466+0000 7f78abdff700 1 -- 172.21.15.152:0/2833189008 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f78a415c9b0 msgr2=0x7f78a40b4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:12.468 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.466+0000 7f78abdff700 1 --2- 172.21.15.152:0/2833189008 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f78a415c9b0 0x7f78a40b4bf0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f78a0009840 tx=0x7f78a0009b50 comp rx=0 tx=0).stop 2023-11-28T12:06:12.469 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.466+0000 7f78abdff700 1 -- 172.21.15.152:0/2833189008 shutdown_connections 2023-11-28T12:06:12.469 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.466+0000 7f78abdff700 1 --2- 172.21.15.152:0/2833189008 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f78a415c9b0 0x7f78a40b4bf0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:12.469 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.466+0000 7f78abdff700 1 --2- 172.21.15.152:0/2833189008 >> v2:172.21.15.45:3300/0 conn(0x7f78a4161340 0x7f78a40d1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:12.469 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.466+0000 7f78abdff700 1 -- 172.21.15.152:0/2833189008 >> 172.21.15.152:0/2833189008 conn(0x7f78a4072600 msgr2=0x7f78a40cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:12.469 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.466+0000 7f78abdff700 1 -- 172.21.15.152:0/2833189008 shutdown_connections 2023-11-28T12:06:12.469 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.466+0000 7f78abdff700 1 -- 172.21.15.152:0/2833189008 wait complete. 2023-11-28T12:06:12.469 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.468+0000 7f78abdff700 1 Processor -- start 2023-11-28T12:06:12.470 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.468+0000 7f78abdff700 1 -- start start 2023-11-28T12:06:12.471 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.469+0000 7f78abdff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f78a40d2320 0x7f78a40b7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:12.471 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.469+0000 7f78abdff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78a415c9b0 0x7f78a41570d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:12.471 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.469+0000 7f78abdff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f78a4161340 0x7f78a41520f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:12.471 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.469+0000 7f78abdff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a4156310 con 0x7f78a415c9b0 2023-11-28T12:06:12.471 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.469+0000 7f78abdff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a41565f0 con 0x7f78a40d2320 2023-11-28T12:06:12.471 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.469+0000 7f78abdff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78a41568d0 con 0x7f78a4161340 2023-11-28T12:06:12.472 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.469+0000 7f78a9b9b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f78a40d2320 0x7f78a40b7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:12.472 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.469+0000 7f78a9b9b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f78a40d2320 0x7f78a40b7cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:55302/0 (socket says 172.21.15.152:55302) 2023-11-28T12:06:12.472 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.469+0000 7f78a9b9b700 1 -- 172.21.15.152:0/2066846950 learned_addr learned my addr 172.21.15.152:0/2066846950 (peer_addr_for_me v2:172.21.15.152:0/0) 2023-11-28T12:06:12.472 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.469+0000 7f78aa39c700 1 --2- 172.21.15.152:0/2066846950 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f78a4161340 0x7f78a41520f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:12.472 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.469+0000 7f78a939a700 1 --2- 172.21.15.152:0/2066846950 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78a415c9b0 0x7f78a41570d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:12.472 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.469+0000 7f78a9b9b700 1 -- 172.21.15.152:0/2066846950 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f78a4161340 msgr2=0x7f78a41520f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:12.472 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.469+0000 7f78a9b9b700 1 --2- 172.21.15.152:0/2066846950 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f78a4161340 0x7f78a41520f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:12.472 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.469+0000 7f78a9b9b700 1 -- 172.21.15.152:0/2066846950 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78a415c9b0 msgr2=0x7f78a41570d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:12.472 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.469+0000 7f78a9b9b700 1 --2- 172.21.15.152:0/2066846950 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78a415c9b0 0x7f78a41570d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:12.472 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.470+0000 7f78a9b9b700 1 -- 172.21.15.152:0/2066846950 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78a00094a0 con 0x7f78a40d2320 2023-11-28T12:06:12.472 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.470+0000 7f78a9b9b700 1 --2- 172.21.15.152:0/2066846950 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f78a40d2320 0x7f78a40b7cc0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f78a0009fd0 tx=0x7f78a0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:12.472 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.470+0000 7f789a7fc700 1 -- 172.21.15.152:0/2066846950 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a00036a0 con 0x7f78a40d2320 2023-11-28T12:06:12.473 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.470+0000 7f789a7fc700 1 -- 172.21.15.152:0/2066846950 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78a001f070 con 0x7f78a40d2320 2023-11-28T12:06:12.473 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.470+0000 7f78abdff700 1 -- 172.21.15.152:0/2066846950 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78a40b5130 con 0x7f78a40d2320 2023-11-28T12:06:12.473 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.470+0000 7f789a7fc700 1 -- 172.21.15.152:0/2066846950 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a0003a60 con 0x7f78a40d2320 2023-11-28T12:06:12.474 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.470+0000 7f78abdff700 1 -- 172.21.15.152:0/2066846950 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78a40d15e0 con 0x7f78a40d2320 2023-11-28T12:06:12.474 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.471+0000 7f789a7fc700 1 -- 172.21.15.152:0/2066846950 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f78a000f050 con 0x7f78a40d2320 2023-11-28T12:06:12.474 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.471+0000 7f789a7fc700 1 -- 172.21.15.152:0/2066846950 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f78a0021070 con 0x7f78a40d2320 2023-11-28T12:06:12.474 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.471+0000 7f78abdff700 1 -- 172.21.15.152:0/2066846950 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78a40b52c0 con 0x7f78a40d2320 2023-11-28T12:06:12.475 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.474+0000 7f789a7fc700 1 -- 172.21.15.152:0/2066846950 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f78a0015020 con 0x7f78a40d2320 2023-11-28T12:06:12.560 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.558+0000 7f78abdff700 1 -- 172.21.15.152:0/2066846950 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8d7f9d4b-bf08-4670-8591-388c0f012a45", "id": 7} v 0) v1 -- 0x7f78a4156df0 con 0x7f78a40d2320 2023-11-28T12:06:12.563 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.562+0000 7f789a7fc700 1 -- 172.21.15.152:0/2066846950 <== mon.1 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8d7f9d4b-bf08-4670-8591-388c0f012a45", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f78a0003bc0 con 0x7f78a40d2320 2023-11-28T12:06:12.563 INFO:teuthology.orchestra.run.smithi152.stdout:7 2023-11-28T12:06:12.564 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.563+0000 7f78abdff700 1 -- 172.21.15.152:0/2066846950 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f78a40d2320 msgr2=0x7f78a40b7cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:12.564 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.563+0000 7f78abdff700 1 --2- 172.21.15.152:0/2066846950 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f78a40d2320 0x7f78a40b7cc0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f78a0009fd0 tx=0x7f78a0004750 comp rx=0 tx=0).stop 2023-11-28T12:06:12.564 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.563+0000 7f78abdff700 1 -- 172.21.15.152:0/2066846950 shutdown_connections 2023-11-28T12:06:12.564 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.563+0000 7f78abdff700 1 --2- 172.21.15.152:0/2066846950 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f78a40d2320 0x7f78a40b7cc0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:12.565 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.563+0000 7f78abdff700 1 --2- 172.21.15.152:0/2066846950 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f78a4161340 0x7f78a41520f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:12.565 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.563+0000 7f78abdff700 1 --2- 172.21.15.152:0/2066846950 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78a415c9b0 0x7f78a41570d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:12.565 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.563+0000 7f78abdff700 1 -- 172.21.15.152:0/2066846950 >> 172.21.15.152:0/2066846950 conn(0x7f78a4072600 msgr2=0x7f78a415cf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:12.565 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.563+0000 7f78abdff700 1 -- 172.21.15.152:0/2066846950 shutdown_connections 2023-11-28T12:06:12.565 INFO:teuthology.orchestra.run.smithi152.stderr:2023-11-28T12:06:12.564+0000 7f78abdff700 1 -- 172.21.15.152:0/2066846950 wait complete. 2023-11-28T12:06:12.582 INFO:tasks.ceph.osd.0:Restarting daemon 2023-11-28T12:06:12.582 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-11-28T12:06:12.588 INFO:tasks.ceph.osd.0:Started 2023-11-28T12:06:12.588 INFO:tasks.ceph.osd.1:Restarting daemon 2023-11-28T12:06:12.588 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-11-28T12:06:12.593 INFO:tasks.ceph.osd.1:Started 2023-11-28T12:06:12.594 INFO:tasks.ceph.osd.2:Restarting daemon 2023-11-28T12:06:12.594 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-11-28T12:06:12.600 INFO:tasks.ceph.osd.2:Started 2023-11-28T12:06:12.601 INFO:tasks.ceph.osd.3:Restarting daemon 2023-11-28T12:06:12.601 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-11-28T12:06:12.608 INFO:tasks.ceph.osd.3:Started 2023-11-28T12:06:12.609 INFO:tasks.ceph.osd.4:Restarting daemon 2023-11-28T12:06:12.609 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-11-28T12:06:12.629 INFO:tasks.ceph.osd.4:Started 2023-11-28T12:06:12.629 INFO:tasks.ceph.osd.5:Restarting daemon 2023-11-28T12:06:12.629 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-11-28T12:06:12.636 INFO:tasks.ceph.osd.5:Started 2023-11-28T12:06:12.636 INFO:tasks.ceph.osd.6:Restarting daemon 2023-11-28T12:06:12.636 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-11-28T12:06:12.643 INFO:tasks.ceph.osd.6:Started 2023-11-28T12:06:12.643 INFO:tasks.ceph.osd.7:Restarting daemon 2023-11-28T12:06:12.644 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-11-28T12:06:12.645 INFO:tasks.ceph.mgr.x.smithi152.stderr:2023-11-28T12:06:12.644+0000 7f3d7c63d240 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-28T12:06:12.651 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-11-28T12:06:12.651+0000 7f1d96e99240 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-28T12:06:12.653 INFO:tasks.ceph.osd.7:Started 2023-11-28T12:06:12.653 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T12:06:12.787 INFO:tasks.ceph.mgr.x.smithi152.stderr:2023-11-28T12:06:12.787+0000 7f3d7c63d240 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-28T12:06:12.807 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-11-28T12:06:12.806+0000 7f1d96e99240 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-28T12:06:12.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:12.913+0000 7f727e5ff700 1 Processor -- start 2023-11-28T12:06:12.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:12.913+0000 7f727e5ff700 1 -- start start 2023-11-28T12:06:12.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:12.915+0000 7f727e5ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f72780b20b0 0x7f72780b0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:12.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:12.915+0000 7f727e5ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72780b0230 con 0x7f72780d01b0 2023-11-28T12:06:12.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:12.915+0000 7f727e5ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72780b4570 con 0x7f72780d1330 2023-11-28T12:06:12.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:12.915+0000 7f727e5ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f727815cec0 con 0x7f72780b20b0 2023-11-28T12:06:12.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:12.915+0000 7f7277fff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f72780d01b0 0x7f72780d0c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:38326/0 (socket says 172.21.15.45:38326) 2023-11-28T12:06:12.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:12.915+0000 7f7277fff700 1 -- 172.21.15.45:0/2882428093 learned_addr learned my addr 172.21.15.45:0/2882428093 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:06:12.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:12.915+0000 7f727cb9c700 1 --2- 172.21.15.45:0/2882428093 >> v2:172.21.15.152:3300/0 conn(0x7f72780b20b0 0x7f72780b0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:12.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:12.915+0000 7f7276ffd700 1 -- 172.21.15.45:0/2882428093 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4099476971 0 0) 0x7f72780b0230 con 0x7f72780d01b0 2023-11-28T12:06:12.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:12.915+0000 7f7276ffd700 1 -- 172.21.15.45:0/2882428093 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72600035b0 con 0x7f72780d01b0 2023-11-28T12:06:12.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:12.916+0000 7f727cb9c700 1 -- 172.21.15.45:0/2882428093 >> v1:172.21.15.152:6789/0 conn(0x7f72780d1330 legacy=0x7f72780b06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:12.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:12.916+0000 7f7276ffd700 1 -- 172.21.15.45:0/2882428093 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3281991532 0 0) 0x7f72780b4570 con 0x7f72780d1330 2023-11-28T12:06:12.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:12.916+0000 7f727cb9c700 1 -- 172.21.15.45:0/2882428093 >> v1:172.21.15.45:6789/0 conn(0x7f72780d01b0 legacy=0x7f72780d0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:12.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:12.916+0000 7f727cb9c700 1 -- 172.21.15.45:0/2882428093 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72780b4850 con 0x7f72780b20b0 2023-11-28T12:06:12.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:12.916+0000 7f727cb9c700 1 --2- 172.21.15.45:0/2882428093 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f72780b20b0 0x7f72780b0dd0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7270009d90 tx=0x7f727000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fdd00d7b550deeaf server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:12.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:12.916+0000 7f7276ffd700 1 -- 172.21.15.45:0/2882428093 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f727000e070 con 0x7f72780b20b0 2023-11-28T12:06:12.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:12.916+0000 7f7276ffd700 1 -- 172.21.15.45:0/2882428093 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f727000bb20 con 0x7f72780b20b0 2023-11-28T12:06:12.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:12.916+0000 7f7276ffd700 1 -- 172.21.15.45:0/2882428093 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f727000bed0 con 0x7f72780b20b0 2023-11-28T12:06:12.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:12.917+0000 7f727e5ff700 1 -- 172.21.15.45:0/2882428093 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f72780b20b0 msgr2=0x7f72780b0dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:12.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:12.917+0000 7f727e5ff700 1 --2- 172.21.15.45:0/2882428093 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f72780b20b0 0x7f72780b0dd0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7270009d90 tx=0x7f727000b330 comp rx=0 tx=0).stop 2023-11-28T12:06:12.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:12.917+0000 7f727e5ff700 1 -- 172.21.15.45:0/2882428093 shutdown_connections 2023-11-28T12:06:12.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:12.917+0000 7f727e5ff700 1 --2- 172.21.15.45:0/2882428093 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f72780b20b0 0x7f72780b0dd0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:12.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:12.917+0000 7f727e5ff700 1 -- 172.21.15.45:0/2882428093 >> 172.21.15.45:0/2882428093 conn(0x7f727809c3f0 msgr2=0x7f72780d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:12.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:12.917+0000 7f727e5ff700 1 -- 172.21.15.45:0/2882428093 shutdown_connections 2023-11-28T12:06:12.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:12.917+0000 7f727e5ff700 1 -- 172.21.15.45:0/2882428093 wait complete. 2023-11-28T12:06:12.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:12.919+0000 7f727e5ff700 1 Processor -- start 2023-11-28T12:06:12.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:12.920+0000 7f727e5ff700 1 -- start start 2023-11-28T12:06:12.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:12.921+0000 7f727e5ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72780b20b0 0x7f727815a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:12.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:12.921+0000 7f727e5ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f72780d01b0 0x7f72780b7340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:12.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:12.921+0000 7f727e5ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f72780d1330 0x7f72780b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:12.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:12.921+0000 7f727e5ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f727815e490 con 0x7f72780b20b0 2023-11-28T12:06:12.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:12.921+0000 7f727e5ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f727815e770 con 0x7f72780d1330 2023-11-28T12:06:12.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:12.921+0000 7f727e5ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f727815ea50 con 0x7f72780d01b0 2023-11-28T12:06:12.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:12.921+0000 7f7277fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72780b20b0 0x7f727815a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:12.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:12.921+0000 7f7277fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72780b20b0 0x7f727815a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58978/0 (socket says 172.21.15.45:58978) 2023-11-28T12:06:12.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:12.921+0000 7f7277fff700 1 -- 172.21.15.45:0/1392566342 learned_addr learned my addr 172.21.15.45:0/1392566342 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:12.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:12.921+0000 7f727cb9c700 1 --2- 172.21.15.45:0/1392566342 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f72780d1330 0x7f72780b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:12.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:12.921+0000 7f72777fe700 1 --2- 172.21.15.45:0/1392566342 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f72780d01b0 0x7f72780b7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:12.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:12.922+0000 7f7277fff700 1 -- 172.21.15.45:0/1392566342 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f72780d01b0 msgr2=0x7f72780b7340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:12.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:12.922+0000 7f7277fff700 1 --2- 172.21.15.45:0/1392566342 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f72780d01b0 0x7f72780b7340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:12.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:12.922+0000 7f7277fff700 1 -- 172.21.15.45:0/1392566342 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f72780d1330 msgr2=0x7f72780b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:12.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:12.922+0000 7f7277fff700 1 --2- 172.21.15.45:0/1392566342 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f72780d1330 0x7f72780b7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:12.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:12.922+0000 7f7277fff700 1 -- 172.21.15.45:0/1392566342 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7270009a70 con 0x7f72780b20b0 2023-11-28T12:06:12.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:12.922+0000 7f7277fff700 1 --2- 172.21.15.45:0/1392566342 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72780b20b0 0x7f727815a880 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f726800c4d0 tx=0x7f726800c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:12.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:12.922+0000 7f7274ff9700 1 -- 172.21.15.45:0/1392566342 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7268005d70 con 0x7f72780b20b0 2023-11-28T12:06:12.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:12.922+0000 7f7274ff9700 1 -- 172.21.15.45:0/1392566342 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72680070d0 con 0x7f72780b20b0 2023-11-28T12:06:12.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:12.922+0000 7f727e5ff700 1 -- 172.21.15.45:0/1392566342 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72780afec0 con 0x7f72780b20b0 2023-11-28T12:06:12.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:12.922+0000 7f7274ff9700 1 -- 172.21.15.45:0/1392566342 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7268007440 con 0x7f72780b20b0 2023-11-28T12:06:12.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:12.922+0000 7f727e5ff700 1 -- 172.21.15.45:0/1392566342 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72780afbe0 con 0x7f72780b20b0 2023-11-28T12:06:12.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:12.923+0000 7f7274ff9700 1 -- 172.21.15.45:0/1392566342 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f7268019030 con 0x7f72780b20b0 2023-11-28T12:06:12.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:12.923+0000 7f7274ff9700 1 -- 172.21.15.45:0/1392566342 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f726801c440 con 0x7f72780b20b0 2023-11-28T12:06:12.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:12.923+0000 7f727e5ff700 1 -- 172.21.15.45:0/1392566342 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72780b2600 con 0x7f72780b20b0 2023-11-28T12:06:12.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:12.926+0000 7f7274ff9700 1 -- 172.21.15.45:0/1392566342 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f7268021060 con 0x7f72780b20b0 2023-11-28T12:06:12.928 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-11-28T12:06:12.927+0000 7f1d96e99240 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-28T12:06:12.928 INFO:tasks.ceph.mgr.x.smithi152.stderr:2023-11-28T12:06:12.928+0000 7f3d7c63d240 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-28T12:06:13.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:13.000+0000 7f727e5ff700 1 -- 172.21.15.45:0/1392566342 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f72780d0810 con 0x7f72780b20b0 2023-11-28T12:06:13.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:13.001+0000 7f7274ff9700 1 -- 172.21.15.45:0/1392566342 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f7268017070 con 0x7f72780b20b0 2023-11-28T12:06:13.002 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:06:13.003 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":10,"fsid":"bd7c37f1-f7c6-4778-b845-52cf2aa6e366","created":"2023-11-28T12:06:09.045075+0000","modified":"2023-11-28T12:06:12.560924+0000","last_up_change":"0.000000","last_in_change":"2023-11-28T12:06:12.560924+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"2d0cdd8a-87fd-4f2c-91bd-47bdfa661905","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c5de4ebd-9ec5-40b3-9caa-9b706fab4c76","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9f4b36b2-65d2-40e7-9fe6-a2991afa71c5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"6fe7ef05-4e0d-426c-bf94-44b51d4d550b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"fa403c08-d8a1-4a3a-8384-cb465c1a654c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"399fc450-39fa-43a6-bf80-0b8bcb41bd95","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e59a4017-2d23-4627-836b-e25b2d3ddaaf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"8d7f9d4b-bf08-4670-8591-388c0f012a45","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T12:06:13.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:13.002+0000 7f727e5ff700 1 -- 172.21.15.45:0/1392566342 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72780b20b0 msgr2=0x7f727815a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:13.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:13.002+0000 7f727e5ff700 1 --2- 172.21.15.45:0/1392566342 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72780b20b0 0x7f727815a880 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f726800c4d0 tx=0x7f726800c7e0 comp rx=0 tx=0).stop 2023-11-28T12:06:13.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:13.002+0000 7f727e5ff700 1 -- 172.21.15.45:0/1392566342 shutdown_connections 2023-11-28T12:06:13.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:13.002+0000 7f727e5ff700 1 --2- 172.21.15.45:0/1392566342 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f72780d1330 0x7f72780b7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:13.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:13.002+0000 7f727e5ff700 1 --2- 172.21.15.45:0/1392566342 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72780b20b0 0x7f727815a880 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:13.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:13.002+0000 7f727e5ff700 1 --2- 172.21.15.45:0/1392566342 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f72780d01b0 0x7f72780b7340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:13.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:13.002+0000 7f727e5ff700 1 -- 172.21.15.45:0/1392566342 >> 172.21.15.45:0/1392566342 conn(0x7f727809c3f0 msgr2=0x7f727806b690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:13.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:13.002+0000 7f727e5ff700 1 -- 172.21.15.45:0/1392566342 shutdown_connections 2023-11-28T12:06:13.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:13.002+0000 7f727e5ff700 1 -- 172.21.15.45:0/1392566342 wait complete. 2023-11-28T12:06:13.021 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-11-28T12:06:13.021 INFO:tasks.ceph:Waiting for OSDs to come up 2023-11-28T12:06:13.159 INFO:tasks.ceph.mgr.x.smithi152.stderr:2023-11-28T12:06:13.159+0000 7f3d7c63d240 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-28T12:06:13.166 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-11-28T12:06:13.165+0000 7f1d96e99240 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-28T12:06:13.261 INFO:tasks.ceph.mgr.x.smithi152.stderr:2023-11-28T12:06:13.261+0000 7f3d7c63d240 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-28T12:06:13.273 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-11-28T12:06:13.272+0000 7f1d96e99240 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-28T12:06:13.322 INFO:tasks.ceph.osd.1.smithi045.stderr:2023-11-28T12:06:13.322+0000 7fa5f0fa7680 -1 Falling back to public interface 2023-11-28T12:06:13.323 INFO:tasks.ceph.osd.4.smithi152.stderr:2023-11-28T12:06:13.323+0000 7f086ad78680 -1 Falling back to public interface 2023-11-28T12:06:13.323 INFO:tasks.ceph.osd.0.smithi045.stderr:2023-11-28T12:06:13.323+0000 7f1bb9154680 -1 Falling back to public interface 2023-11-28T12:06:13.348 INFO:tasks.ceph.osd.6.smithi152.stderr:2023-11-28T12:06:13.348+0000 7f44550cf680 -1 Falling back to public interface 2023-11-28T12:06:13.348 INFO:tasks.ceph.osd.2.smithi045.stderr:2023-11-28T12:06:13.348+0000 7fb08cf69680 -1 Falling back to public interface 2023-11-28T12:06:13.349 INFO:tasks.ceph.osd.3.smithi045.stderr:2023-11-28T12:06:13.348+0000 7ff1736ba680 -1 Falling back to public interface 2023-11-28T12:06:13.351 INFO:tasks.ceph.osd.5.smithi152.stderr:2023-11-28T12:06:13.351+0000 7f21a4f63680 -1 Falling back to public interface 2023-11-28T12:06:13.377 INFO:tasks.ceph.osd.7.smithi152.stderr:2023-11-28T12:06:13.377+0000 7f57c057c680 -1 Falling back to public interface 2023-11-28T12:06:13.622 INFO:tasks.ceph.mgr.x.smithi152.stderr:2023-11-28T12:06:13.622+0000 7f3d7c63d240 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-28T12:06:13.640 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-11-28T12:06:13.639+0000 7f1d96e99240 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-28T12:06:13.714 INFO:tasks.ceph.mgr.x.smithi152.stderr:2023-11-28T12:06:13.714+0000 7f3d7c63d240 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-28T12:06:13.733 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-11-28T12:06:13.733+0000 7f1d96e99240 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-28T12:06:13.825 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-28T12:06:14.010 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:14.010+0000 7f9c301ff700 1 Processor -- start 2023-11-28T12:06:14.011 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:14.010+0000 7f9c301ff700 1 -- start start 2023-11-28T12:06:14.014 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:14.011+0000 7f9c301ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f9c280d01b0 0x7f9c280d0c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:14.014 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:14.011+0000 7f9c301ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9c280b16d0 0x7f9c280d1160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:14.014 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:14.011+0000 7f9c301ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c280b0230 con 0x7f9c280b20b0 2023-11-28T12:06:14.015 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:14.011+0000 7f9c301ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c2815cec0 con 0x7f9c280d01b0 2023-11-28T12:06:14.015 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:14.011+0000 7f9c301ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c280b4570 con 0x7f9c280b16d0 2023-11-28T12:06:14.015 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:14.012+0000 7f9c2d79a700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f9c280b20b0 0x7f9c280b29b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:38336/0 (socket says 172.21.15.45:38336) 2023-11-28T12:06:14.015 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:14.012+0000 7f9c2df9b700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f9c280d01b0 0x7f9c280d0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:14.015 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:14.012+0000 7f9c2e79c700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9c280b16d0 0x7f9c280d1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:14.015 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:14.012+0000 7f9c2d79a700 1 -- 172.21.15.45:0/4217155871 learned_addr learned my addr 172.21.15.45:0/4217155871 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:06:14.016 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:14.012+0000 7f9c2cf99700 1 -- 172.21.15.45:0/4217155871 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2515725486 0 0) 0x7f9c280b0230 con 0x7f9c280b20b0 2023-11-28T12:06:14.016 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:14.012+0000 7f9c2cf99700 1 -- 172.21.15.45:0/4217155871 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c140035b0 con 0x7f9c280b20b0 2023-11-28T12:06:14.016 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:14.012+0000 7f9c2e79c700 1 -- 172.21.15.45:0/4217155871 >> v2:172.21.15.152:3300/0 conn(0x7f9c280d01b0 msgr2=0x7f9c280d0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:06:14.016 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:14.012+0000 7f9c2e79c700 1 --2- 172.21.15.45:0/4217155871 >> v2:172.21.15.152:3300/0 conn(0x7f9c280d01b0 0x7f9c280d0c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:14.016 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:14.012+0000 7f9c2e79c700 1 -- 172.21.15.45:0/4217155871 >> v1:172.21.15.45:6789/0 conn(0x7f9c280b20b0 legacy=0x7f9c280b29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:14.016 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:14.012+0000 7f9c2e79c700 1 -- 172.21.15.45:0/4217155871 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c280b4850 con 0x7f9c280b16d0 2023-11-28T12:06:14.017 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:14.012+0000 7f9c2df9b700 1 --2- 172.21.15.45:0/4217155871 >> v2:172.21.15.152:3300/0 conn(0x7f9c280d01b0 0x7f9c280d0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:06:14.017 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:14.012+0000 7f9c2e79c700 1 --2- 172.21.15.45:0/4217155871 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9c280b16d0 0x7f9c280d1160 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f9c20009d90 tx=0x7f9c2000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56f350a9a49daeee server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:14.018 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:14.013+0000 7f9c2cf99700 1 -- 172.21.15.45:0/4217155871 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c2000e070 con 0x7f9c280b16d0 2023-11-28T12:06:14.018 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:14.013+0000 7f9c2cf99700 1 -- 172.21.15.45:0/4217155871 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c2000bb20 con 0x7f9c280b16d0 2023-11-28T12:06:14.018 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:14.013+0000 7f9c2cf99700 1 -- 172.21.15.45:0/4217155871 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c20012430 con 0x7f9c280b16d0 2023-11-28T12:06:14.018 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:14.013+0000 7f9c301ff700 1 -- 172.21.15.45:0/4217155871 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9c280b16d0 msgr2=0x7f9c280d1160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:14.018 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:14.013+0000 7f9c301ff700 1 --2- 172.21.15.45:0/4217155871 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9c280b16d0 0x7f9c280d1160 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f9c20009d90 tx=0x7f9c2000b330 comp rx=0 tx=0).stop 2023-11-28T12:06:14.018 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:14.014+0000 7f9c301ff700 1 -- 172.21.15.45:0/4217155871 shutdown_connections 2023-11-28T12:06:14.018 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:14.014+0000 7f9c301ff700 1 --2- 172.21.15.45:0/4217155871 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9c280b16d0 0x7f9c280d1160 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:14.019 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:14.014+0000 7f9c301ff700 1 --2- 172.21.15.45:0/4217155871 >> v2:172.21.15.152:3300/0 conn(0x7f9c280d01b0 0x7f9c280d0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:14.019 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:14.014+0000 7f9c301ff700 1 -- 172.21.15.45:0/4217155871 >> 172.21.15.45:0/4217155871 conn(0x7f9c2809c3f0 msgr2=0x7f9c280d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:14.019 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:14.014+0000 7f9c301ff700 1 -- 172.21.15.45:0/4217155871 shutdown_connections 2023-11-28T12:06:14.019 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:14.014+0000 7f9c301ff700 1 -- 172.21.15.45:0/4217155871 wait complete. 2023-11-28T12:06:14.022 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:14.017+0000 7f9c301ff700 1 Processor -- start 2023-11-28T12:06:14.022 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:14.017+0000 7f9c301ff700 1 -- start start 2023-11-28T12:06:14.022 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:14.018+0000 7f9c301ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c280b16d0 0x7f9c28159ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:14.022 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:14.018+0000 7f9c301ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c280b20b0 0x7f9c281e6830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:14.022 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:14.018+0000 7f9c301ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9c280d01b0 0x7f9c280cc130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:14.022 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:14.018+0000 7f9c301ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c2815a420 con 0x7f9c280b20b0 2023-11-28T12:06:14.022 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:14.019+0000 7f9c301ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c280a01c0 con 0x7f9c280b16d0 2023-11-28T12:06:14.023 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:14.019+0000 7f9c301ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c281e7080 con 0x7f9c280d01b0 2023-11-28T12:06:14.023 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:14.019+0000 7f9c2d79a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c280b20b0 0x7f9c281e6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:14.023 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:14.019+0000 7f9c2df9b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c280b16d0 0x7f9c28159ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:14.023 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:14.019+0000 7f9c2d79a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c280b20b0 0x7f9c281e6830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58990/0 (socket says 172.21.15.45:58990) 2023-11-28T12:06:14.023 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:14.019+0000 7f9c2d79a700 1 -- 172.21.15.45:0/2143427761 learned_addr learned my addr 172.21.15.45:0/2143427761 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:14.023 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:14.019+0000 7f9c2e79c700 1 --2- 172.21.15.45:0/2143427761 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9c280d01b0 0x7f9c280cc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:14.023 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:14.019+0000 7f9c2d79a700 1 -- 172.21.15.45:0/2143427761 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9c280d01b0 msgr2=0x7f9c280cc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:14.024 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:14.019+0000 7f9c2d79a700 1 --2- 172.21.15.45:0/2143427761 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9c280d01b0 0x7f9c280cc130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:14.024 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:14.019+0000 7f9c2d79a700 1 -- 172.21.15.45:0/2143427761 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c280b16d0 msgr2=0x7f9c28159ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:14.024 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:14.019+0000 7f9c2d79a700 1 --2- 172.21.15.45:0/2143427761 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c280b16d0 0x7f9c28159ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:14.024 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:14.019+0000 7f9c2d79a700 1 -- 172.21.15.45:0/2143427761 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c240094a0 con 0x7f9c280b20b0 2023-11-28T12:06:14.024 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:14.019+0000 7f9c2df9b700 1 --2- 172.21.15.45:0/2143427761 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c280b16d0 0x7f9c28159ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:06:14.024 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:14.019+0000 7f9c2d79a700 1 --2- 172.21.15.45:0/2143427761 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c280b20b0 0x7f9c281e6830 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9c1800c730 tx=0x7f9c1800ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:14.024 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:14.020+0000 7f9c1e7fc700 1 -- 172.21.15.45:0/2143427761 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c18005d70 con 0x7f9c280b20b0 2023-11-28T12:06:14.025 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:14.020+0000 7f9c1e7fc700 1 -- 172.21.15.45:0/2143427761 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c180070d0 con 0x7f9c280b20b0 2023-11-28T12:06:14.025 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:14.020+0000 7f9c1e7fc700 1 -- 172.21.15.45:0/2143427761 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c18007440 con 0x7f9c280b20b0 2023-11-28T12:06:14.025 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:14.020+0000 7f9c301ff700 1 -- 172.21.15.45:0/2143427761 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c20009a70 con 0x7f9c280b20b0 2023-11-28T12:06:14.025 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:14.020+0000 7f9c301ff700 1 -- 172.21.15.45:0/2143427761 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c280afec0 con 0x7f9c280b20b0 2023-11-28T12:06:14.025 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:14.021+0000 7f9c1e7fc700 1 -- 172.21.15.45:0/2143427761 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f9c18019030 con 0x7f9c280b20b0 2023-11-28T12:06:14.025 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:14.021+0000 7f9c1e7fc700 1 -- 172.21.15.45:0/2143427761 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f9c1801ba80 con 0x7f9c280b20b0 2023-11-28T12:06:14.025 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:14.021+0000 7f9c301ff700 1 -- 172.21.15.45:0/2143427761 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c280afbe0 con 0x7f9c280b20b0 2023-11-28T12:06:14.026 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:14.025+0000 7f9c1e7fc700 1 -- 172.21.15.45:0/2143427761 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f9c18021060 con 0x7f9c280b20b0 2023-11-28T12:06:14.100 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:14.100+0000 7f9c301ff700 1 -- 172.21.15.45:0/2143427761 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9c280b2600 con 0x7f9c280b20b0 2023-11-28T12:06:14.101 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:14.101+0000 7f9c1e7fc700 1 -- 172.21.15.45:0/2143427761 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f9c18017070 con 0x7f9c280b20b0 2023-11-28T12:06:14.101 INFO:teuthology.misc.health.smithi045.stdout: 2023-11-28T12:06:14.101 INFO:teuthology.misc.health.smithi045.stdout:{"epoch":10,"fsid":"bd7c37f1-f7c6-4778-b845-52cf2aa6e366","created":"2023-11-28T12:06:09.045075+0000","modified":"2023-11-28T12:06:12.560924+0000","last_up_change":"0.000000","last_in_change":"2023-11-28T12:06:12.560924+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"2d0cdd8a-87fd-4f2c-91bd-47bdfa661905","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c5de4ebd-9ec5-40b3-9caa-9b706fab4c76","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9f4b36b2-65d2-40e7-9fe6-a2991afa71c5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"6fe7ef05-4e0d-426c-bf94-44b51d4d550b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"fa403c08-d8a1-4a3a-8384-cb465c1a654c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"399fc450-39fa-43a6-bf80-0b8bcb41bd95","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e59a4017-2d23-4627-836b-e25b2d3ddaaf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"8d7f9d4b-bf08-4670-8591-388c0f012a45","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T12:06:14.102 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:14.102+0000 7f9c301ff700 1 -- 172.21.15.45:0/2143427761 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c280b20b0 msgr2=0x7f9c281e6830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:14.103 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:14.102+0000 7f9c301ff700 1 --2- 172.21.15.45:0/2143427761 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c280b20b0 0x7f9c281e6830 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9c1800c730 tx=0x7f9c1800ca40 comp rx=0 tx=0).stop 2023-11-28T12:06:14.103 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:14.102+0000 7f9c301ff700 1 -- 172.21.15.45:0/2143427761 shutdown_connections 2023-11-28T12:06:14.103 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:14.102+0000 7f9c301ff700 1 --2- 172.21.15.45:0/2143427761 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c280b16d0 0x7f9c28159ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:14.103 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:14.102+0000 7f9c301ff700 1 --2- 172.21.15.45:0/2143427761 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9c280d01b0 0x7f9c280cc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:14.104 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:14.102+0000 7f9c301ff700 1 --2- 172.21.15.45:0/2143427761 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c280b20b0 0x7f9c281e6830 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:14.104 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:14.102+0000 7f9c301ff700 1 -- 172.21.15.45:0/2143427761 >> 172.21.15.45:0/2143427761 conn(0x7f9c2809c3f0 msgr2=0x7f9c280cf7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:14.104 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:14.102+0000 7f9c301ff700 1 -- 172.21.15.45:0/2143427761 shutdown_connections 2023-11-28T12:06:14.104 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:14.102+0000 7f9c301ff700 1 -- 172.21.15.45:0/2143427761 wait complete. 2023-11-28T12:06:14.117 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-11-28T12:06:14.335 INFO:tasks.ceph.mgr.x.smithi152.stderr:2023-11-28T12:06:14.335+0000 7f3d7c63d240 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-28T12:06:14.392 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-11-28T12:06:14.391+0000 7f1d96e99240 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-28T12:06:14.524 INFO:tasks.ceph.mgr.x.smithi152.stderr:2023-11-28T12:06:14.524+0000 7f3d7c63d240 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-28T12:06:14.586 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-11-28T12:06:14.586+0000 7f1d96e99240 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-28T12:06:14.906 INFO:tasks.ceph.mgr.x.smithi152.stderr:2023-11-28T12:06:14.906+0000 7f3d7c63d240 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-28T12:06:14.973 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-11-28T12:06:14.972+0000 7f1d96e99240 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-28T12:06:15.572 INFO:tasks.ceph.mgr.x.smithi152.stderr:2023-11-28T12:06:15.572+0000 7f3d7c63d240 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-28T12:06:15.666 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-11-28T12:06:15.666+0000 7f1d96e99240 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-28T12:06:15.756 INFO:tasks.ceph.mgr.x.smithi152.stderr:2023-11-28T12:06:15.756+0000 7f3d7c63d240 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-28T12:06:15.872 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-11-28T12:06:15.871+0000 7f1d96e99240 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-28T12:06:16.245 INFO:tasks.ceph.mgr.x.smithi152.stderr:2023-11-28T12:06:16.245+0000 7f3d7c63d240 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-28T12:06:16.407 INFO:tasks.ceph.mgr.x.smithi152.stderr:2023-11-28T12:06:16.407+0000 7f3d7c63d240 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-28T12:06:16.452 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-11-28T12:06:16.452+0000 7f1d96e99240 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-28T12:06:16.605 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-11-28T12:06:16.605+0000 7f1d96e99240 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-28T12:06:16.877 INFO:tasks.ceph.osd.1.smithi045.stderr:2023-11-28T12:06:16.876+0000 7fa5f0fa7680 -1 osd.1 0 log_to_monitors true 2023-11-28T12:06:16.888 INFO:tasks.ceph.osd.0.smithi045.stderr:2023-11-28T12:06:16.888+0000 7f1bb9154680 -1 osd.0 0 log_to_monitors true 2023-11-28T12:06:16.909 INFO:tasks.ceph.osd.3.smithi045.stderr:2023-11-28T12:06:16.908+0000 7ff1736ba680 -1 osd.3 0 log_to_monitors true 2023-11-28T12:06:16.919 INFO:tasks.ceph.osd.5.smithi152.stderr:2023-11-28T12:06:16.919+0000 7f21a4f63680 -1 osd.5 0 log_to_monitors true 2023-11-28T12:06:16.944 INFO:tasks.ceph.osd.6.smithi152.stderr:2023-11-28T12:06:16.943+0000 7f44550cf680 -1 osd.6 0 log_to_monitors true 2023-11-28T12:06:17.122 INFO:tasks.ceph.osd.2.smithi045.stderr:2023-11-28T12:06:17.121+0000 7fb08cf69680 -1 osd.2 0 log_to_monitors true 2023-11-28T12:06:17.126 INFO:tasks.ceph.osd.4.smithi152.stderr:2023-11-28T12:06:17.127+0000 7f086ad78680 -1 osd.4 0 log_to_monitors true 2023-11-28T12:06:17.207 INFO:tasks.ceph.osd.7.smithi152.stderr:2023-11-28T12:06:17.207+0000 7f57c057c680 -1 osd.7 0 log_to_monitors true 2023-11-28T12:06:17.426 INFO:tasks.ceph.mgr.x.smithi152.stderr:2023-11-28T12:06:17.426+0000 7f3d35ffa700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-11-28T12:06:17.431 INFO:tasks.ceph.mgr.x.smithi152.stderr:2023-11-28T12:06:17.430+0000 7f3d35ffa700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-11-28T12:06:20.260 INFO:tasks.ceph.osd.1.smithi045.stderr:2023-11-28T12:06:20.260+0000 7fa5df5f6700 -1 osd.1 0 waiting for initial osdmap 2023-11-28T12:06:20.267 INFO:tasks.ceph.osd.3.smithi045.stderr:2023-11-28T12:06:20.266+0000 7ff161df6700 -1 osd.3 0 waiting for initial osdmap 2023-11-28T12:06:20.277 INFO:tasks.ceph.osd.0.smithi045.stderr:2023-11-28T12:06:20.276+0000 7f1ba77f6700 -1 osd.0 0 waiting for initial osdmap 2023-11-28T12:06:20.281 INFO:tasks.ceph.osd.1.smithi045.stderr:2023-11-28T12:06:20.281+0000 7fa5d75fb700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T12:06:20.287 INFO:tasks.ceph.osd.3.smithi045.stderr:2023-11-28T12:06:20.286+0000 7ff159dfb700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T12:06:20.288 INFO:tasks.ceph.osd.0.smithi045.stderr:2023-11-28T12:06:20.288+0000 7f1b9f7fb700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T12:06:20.292 INFO:tasks.ceph.osd.2.smithi045.stderr:2023-11-28T12:06:20.292+0000 7fb07b5f6700 -1 osd.2 0 waiting for initial osdmap 2023-11-28T12:06:20.309 INFO:tasks.ceph.osd.2.smithi045.stderr:2023-11-28T12:06:20.308+0000 7fb0735fb700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T12:06:20.771 INFO:tasks.ceph.osd.7.smithi152.stderr:2023-11-28T12:06:20.770+0000 7f57aebf6700 -1 osd.7 0 waiting for initial osdmap 2023-11-28T12:06:20.782 INFO:tasks.ceph.osd.6.smithi152.stderr:2023-11-28T12:06:20.781+0000 7f44437f6700 -1 osd.6 0 waiting for initial osdmap 2023-11-28T12:06:20.789 INFO:tasks.ceph.osd.7.smithi152.stderr:2023-11-28T12:06:20.788+0000 7f57a6bfb700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T12:06:20.797 INFO:tasks.ceph.osd.4.smithi152.stderr:2023-11-28T12:06:20.796+0000 7f08593f6700 -1 osd.4 0 waiting for initial osdmap 2023-11-28T12:06:20.799 INFO:tasks.ceph.osd.6.smithi152.stderr:2023-11-28T12:06:20.798+0000 7f443b7fb700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T12:06:20.815 INFO:tasks.ceph.osd.4.smithi152.stderr:2023-11-28T12:06:20.814+0000 7f08513fb700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T12:06:20.822 INFO:tasks.ceph.osd.5.smithi152.stderr:2023-11-28T12:06:20.820+0000 7f2194df9700 -1 osd.5 0 waiting for initial osdmap 2023-11-28T12:06:20.839 INFO:tasks.ceph.osd.5.smithi152.stderr:2023-11-28T12:06:20.837+0000 7f218b5fb700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T12:06:20.923 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-28T12:06:21.108 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:21.108+0000 7f48503ff700 1 Processor -- start 2023-11-28T12:06:21.109 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:21.108+0000 7f48503ff700 1 -- start start 2023-11-28T12:06:21.111 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:21.109+0000 7f48503ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4848161340 0x7f48480d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:21.111 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:21.109+0000 7f48503ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f48480d2320 0x7f48480cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:21.111 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:21.109+0000 7f48503ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48480d1950 con 0x7f484815c9b0 2023-11-28T12:06:21.111 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:21.109+0000 7f48503ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48480b5800 con 0x7f48480d2320 2023-11-28T12:06:21.111 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:21.109+0000 7f48503ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48480b5300 con 0x7f4848161340 2023-11-28T12:06:21.111 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:21.109+0000 7f484e19b700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f484815c9b0 0x7f48480b4bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:38338/0 (socket says 172.21.15.45:38338) 2023-11-28T12:06:21.111 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:21.109+0000 7f484e19b700 1 -- 172.21.15.45:0/3015561620 learned_addr learned my addr 172.21.15.45:0/3015561620 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:06:21.111 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:21.110+0000 7f484e99c700 1 --2- 172.21.15.45:0/3015561620 >> v2:172.21.15.45:3300/0 conn(0x7f48480d2320 0x7f48480cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:21.111 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:21.110+0000 7f484d99a700 1 --2- 172.21.15.45:0/3015561620 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4848161340 0x7f48480d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:21.111 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:21.110+0000 7f484d199700 1 -- 172.21.15.45:0/3015561620 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1751124567 0 0) 0x7f48480d1950 con 0x7f484815c9b0 2023-11-28T12:06:21.112 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:21.110+0000 7f484d199700 1 -- 172.21.15.45:0/3015561620 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48340035b0 con 0x7f484815c9b0 2023-11-28T12:06:21.112 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:21.110+0000 7f484e99c700 1 -- 172.21.15.45:0/3015561620 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4848161340 msgr2=0x7f48480d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:06:21.112 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:21.110+0000 7f484e99c700 1 --2- 172.21.15.45:0/3015561620 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4848161340 0x7f48480d1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:21.112 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:21.110+0000 7f484e99c700 1 -- 172.21.15.45:0/3015561620 >> v1:172.21.15.45:6789/0 conn(0x7f484815c9b0 legacy=0x7f48480b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:21.112 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:21.110+0000 7f484e99c700 1 -- 172.21.15.45:0/3015561620 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48480b5520 con 0x7f48480d2320 2023-11-28T12:06:21.112 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:21.110+0000 7f484e99c700 1 --2- 172.21.15.45:0/3015561620 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48480d2320 0x7f48480cd7c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4840009dc0 tx=0x7f484000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd2858cff31f7f0e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:21.112 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:21.110+0000 7f484d199700 1 -- 172.21.15.45:0/3015561620 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f484000e070 con 0x7f48480d2320 2023-11-28T12:06:21.112 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:21.111+0000 7f484d199700 1 -- 172.21.15.45:0/3015561620 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f484000bae0 con 0x7f48480d2320 2023-11-28T12:06:21.112 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:21.111+0000 7f484d199700 1 -- 172.21.15.45:0/3015561620 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f484000be90 con 0x7f48480d2320 2023-11-28T12:06:21.113 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:21.111+0000 7f48503ff700 1 -- 172.21.15.45:0/3015561620 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48480d2320 msgr2=0x7f48480cd7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:21.113 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:21.111+0000 7f48503ff700 1 --2- 172.21.15.45:0/3015561620 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48480d2320 0x7f48480cd7c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4840009dc0 tx=0x7f484000b330 comp rx=0 tx=0).stop 2023-11-28T12:06:21.113 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:21.111+0000 7f48503ff700 1 -- 172.21.15.45:0/3015561620 shutdown_connections 2023-11-28T12:06:21.113 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:21.111+0000 7f48503ff700 1 --2- 172.21.15.45:0/3015561620 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48480d2320 0x7f48480cd7c0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:21.114 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:21.111+0000 7f48503ff700 1 --2- 172.21.15.45:0/3015561620 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4848161340 0x7f48480d1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:21.114 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:21.111+0000 7f48503ff700 1 -- 172.21.15.45:0/3015561620 >> 172.21.15.45:0/3015561620 conn(0x7f4848072600 msgr2=0x7f48480cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:21.114 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:21.111+0000 7f48503ff700 1 -- 172.21.15.45:0/3015561620 shutdown_connections 2023-11-28T12:06:21.114 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:21.111+0000 7f48503ff700 1 -- 172.21.15.45:0/3015561620 wait complete. 2023-11-28T12:06:21.114 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:21.113+0000 7f48503ff700 1 Processor -- start 2023-11-28T12:06:21.114 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:21.113+0000 7f48503ff700 1 -- start start 2023-11-28T12:06:21.116 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:21.114+0000 7f48503ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f48480d2320 0x7f48481468d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:21.116 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:21.114+0000 7f48503ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f484815c9b0 0x7f484815e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:21.116 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:21.114+0000 7f48503ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4848161340 0x7f484815e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:21.117 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:21.114+0000 7f48503ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4848146e10 con 0x7f484815c9b0 2023-11-28T12:06:21.117 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:21.114+0000 7f48503ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48480c8bd0 con 0x7f48480d2320 2023-11-28T12:06:21.118 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:21.114+0000 7f48503ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4848156170 con 0x7f4848161340 2023-11-28T12:06:21.118 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:21.114+0000 7f484d99a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f484815c9b0 0x7f484815e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:21.118 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:21.114+0000 7f484d99a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f484815c9b0 0x7f484815e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59036/0 (socket says 172.21.15.45:59036) 2023-11-28T12:06:21.118 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:21.114+0000 7f484d99a700 1 -- 172.21.15.45:0/2603309361 learned_addr learned my addr 172.21.15.45:0/2603309361 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:21.118 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:21.114+0000 7f484e19b700 1 --2- 172.21.15.45:0/2603309361 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f48480d2320 0x7f48481468d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:21.118 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:21.115+0000 7f484e99c700 1 --2- 172.21.15.45:0/2603309361 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4848161340 0x7f484815e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:21.118 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:21.115+0000 7f484d99a700 1 -- 172.21.15.45:0/2603309361 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4848161340 msgr2=0x7f484815e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:21.118 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:21.115+0000 7f484d99a700 1 --2- 172.21.15.45:0/2603309361 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4848161340 0x7f484815e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:21.118 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:21.115+0000 7f484d99a700 1 -- 172.21.15.45:0/2603309361 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f48480d2320 msgr2=0x7f48481468d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:21.118 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:21.115+0000 7f484d99a700 1 --2- 172.21.15.45:0/2603309361 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f48480d2320 0x7f48481468d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:21.118 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:21.115+0000 7f484d99a700 1 -- 172.21.15.45:0/2603309361 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4840009a70 con 0x7f484815c9b0 2023-11-28T12:06:21.119 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:21.115+0000 7f484d99a700 1 --2- 172.21.15.45:0/2603309361 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f484815c9b0 0x7f484815e150 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f483800e870 tx=0x7f483800eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:21.119 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:21.115+0000 7f483effd700 1 -- 172.21.15.45:0/2603309361 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4838009590 con 0x7f484815c9b0 2023-11-28T12:06:21.119 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:21.115+0000 7f483effd700 1 -- 172.21.15.45:0/2603309361 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4838013680 con 0x7f484815c9b0 2023-11-28T12:06:21.119 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:21.115+0000 7f483effd700 1 -- 172.21.15.45:0/2603309361 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48380139f0 con 0x7f484815c9b0 2023-11-28T12:06:21.119 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:21.115+0000 7f48503ff700 1 -- 172.21.15.45:0/2603309361 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48480d15e0 con 0x7f484815c9b0 2023-11-28T12:06:21.119 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:21.115+0000 7f48503ff700 1 -- 172.21.15.45:0/2603309361 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48480d1300 con 0x7f484815c9b0 2023-11-28T12:06:21.120 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:21.116+0000 7f48503ff700 1 -- 172.21.15.45:0/2603309361 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f484815cd80 con 0x7f484815c9b0 2023-11-28T12:06:21.120 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:21.117+0000 7f483effd700 1 -- 172.21.15.45:0/2603309361 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 86375+0+0 (secure 0 0 0) 0x7f4838019030 con 0x7f484815c9b0 2023-11-28T12:06:21.120 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:21.118+0000 7f483effd700 1 --2- 172.21.15.45:0/2603309361 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f482c068370 0x7f482c06a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:21.120 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:21.118+0000 7f483effd700 1 -- 172.21.15.45:0/2603309361 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f4838084a60 con 0x7f484815c9b0 2023-11-28T12:06:21.120 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:21.118+0000 7f484e19b700 1 --2- 172.21.15.45:0/2603309361 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f482c068370 0x7f482c06a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:21.120 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:21.119+0000 7f484e19b700 1 --2- 172.21.15.45:0/2603309361 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f482c068370 0x7f482c06a820 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4844007fd0 tx=0x7f4844007dc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:21.123 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:21.123+0000 7f483effd700 1 -- 172.21.15.45:0/2603309361 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f4838052190 con 0x7f484815c9b0 2023-11-28T12:06:21.331 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:21.330+0000 7f48503ff700 1 -- 172.21.15.45:0/2603309361 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f48480745c0 con 0x7f484815c9b0 2023-11-28T12:06:21.331 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:21.331+0000 7f483effd700 1 -- 172.21.15.45:0/2603309361 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+10536 (secure 0 0 0) 0x7f4838017090 con 0x7f484815c9b0 2023-11-28T12:06:21.332 INFO:teuthology.misc.health.smithi045.stdout: 2023-11-28T12:06:21.332 INFO:teuthology.misc.health.smithi045.stdout:{"epoch":13,"fsid":"bd7c37f1-f7c6-4778-b845-52cf2aa6e366","created":"2023-11-28T12:06:09.045075+0000","modified":"2023-11-28T12:06:21.282227+0000","last_up_change":"2023-11-28T12:06:21.282227+0000","last_in_change":"2023-11-28T12:06:12.560924+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"2d0cdd8a-87fd-4f2c-91bd-47bdfa661905","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":115843},{"type":"v1","addr":"172.21.15.45:6808","nonce":115843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":115843},{"type":"v1","addr":"172.21.15.45:6811","nonce":115843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":115843},{"type":"v1","addr":"172.21.15.45:6815","nonce":115843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":115843},{"type":"v1","addr":"172.21.15.45:6813","nonce":115843}]},"public_addr":"172.21.15.45:6808/115843","cluster_addr":"172.21.15.45:6811/115843","heartbeat_back_addr":"172.21.15.45:6815/115843","heartbeat_front_addr":"172.21.15.45:6813/115843","state":["exists","up"]},{"osd":1,"uuid":"c5de4ebd-9ec5-40b3-9caa-9b706fab4c76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":115842},{"type":"v1","addr":"172.21.15.45:6801","nonce":115842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":115842},{"type":"v1","addr":"172.21.15.45:6803","nonce":115842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6807","nonce":115842},{"type":"v1","addr":"172.21.15.45:6809","nonce":115842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":115842},{"type":"v1","addr":"172.21.15.45:6805","nonce":115842}]},"public_addr":"172.21.15.45:6801/115842","cluster_addr":"172.21.15.45:6803/115842","heartbeat_back_addr":"172.21.15.45:6809/115842","heartbeat_front_addr":"172.21.15.45:6805/115842","state":["exists","up"]},{"osd":2,"uuid":"9f4b36b2-65d2-40e7-9fe6-a2991afa71c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":115850},{"type":"v1","addr":"172.21.15.45:6819","nonce":115850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":115850},{"type":"v1","addr":"172.21.15.45:6823","nonce":115850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":115850},{"type":"v1","addr":"172.21.15.45:6831","nonce":115850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":115850},{"type":"v1","addr":"172.21.15.45:6828","nonce":115850}]},"public_addr":"172.21.15.45:6819/115850","cluster_addr":"172.21.15.45:6823/115850","heartbeat_back_addr":"172.21.15.45:6831/115850","heartbeat_front_addr":"172.21.15.45:6828/115850","state":["exists","up"]},{"osd":3,"uuid":"6fe7ef05-4e0d-426c-bf94-44b51d4d550b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":115848},{"type":"v1","addr":"172.21.15.45:6818","nonce":115848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":115848},{"type":"v1","addr":"172.21.15.45:6822","nonce":115848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6827","nonce":115848},{"type":"v1","addr":"172.21.15.45:6829","nonce":115848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":115848},{"type":"v1","addr":"172.21.15.45:6825","nonce":115848}]},"public_addr":"172.21.15.45:6818/115848","cluster_addr":"172.21.15.45:6822/115848","heartbeat_back_addr":"172.21.15.45:6829/115848","heartbeat_front_addr":"172.21.15.45:6825/115848","state":["exists","up"]},{"osd":4,"uuid":"fa403c08-d8a1-4a3a-8384-cb465c1a654c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":116092},{"type":"v1","addr":"172.21.15.152:6801","nonce":116092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":116092},{"type":"v1","addr":"172.21.15.152:6803","nonce":116092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":116092},{"type":"v1","addr":"172.21.15.152:6807","nonce":116092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":116092},{"type":"v1","addr":"172.21.15.152:6805","nonce":116092}]},"public_addr":"172.21.15.152:6801/116092","cluster_addr":"172.21.15.152:6803/116092","heartbeat_back_addr":"172.21.15.152:6807/116092","heartbeat_front_addr":"172.21.15.152:6805/116092","state":["exists","up"]},{"osd":5,"uuid":"399fc450-39fa-43a6-bf80-0b8bcb41bd95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6815","nonce":116093},{"type":"v1","addr":"172.21.15.152:6817","nonce":116093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":116093},{"type":"v1","addr":"172.21.15.152:6819","nonce":116093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":116093},{"type":"v1","addr":"172.21.15.152:6823","nonce":116093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":116093},{"type":"v1","addr":"172.21.15.152:6821","nonce":116093}]},"public_addr":"172.21.15.152:6817/116093","cluster_addr":"172.21.15.152:6819/116093","heartbeat_back_addr":"172.21.15.152:6823/116093","heartbeat_front_addr":"172.21.15.152:6821/116093","state":["exists","up"]},{"osd":6,"uuid":"e59a4017-2d23-4627-836b-e25b2d3ddaaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":116094},{"type":"v1","addr":"172.21.15.152:6809","nonce":116094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":116094},{"type":"v1","addr":"172.21.15.152:6811","nonce":116094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":116094},{"type":"v1","addr":"172.21.15.152:6816","nonce":116094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":116094},{"type":"v1","addr":"172.21.15.152:6813","nonce":116094}]},"public_addr":"172.21.15.152:6809/116094","cluster_addr":"172.21.15.152:6811/116094","heartbeat_back_addr":"172.21.15.152:6816/116094","heartbeat_front_addr":"172.21.15.152:6813/116094","state":["exists","up"]},{"osd":7,"uuid":"8d7f9d4b-bf08-4670-8591-388c0f012a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":116097},{"type":"v1","addr":"172.21.15.152:6825","nonce":116097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":116097},{"type":"v1","addr":"172.21.15.152:6827","nonce":116097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":116097},{"type":"v1","addr":"172.21.15.152:6831","nonce":116097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":116097},{"type":"v1","addr":"172.21.15.152:6829","nonce":116097}]},"public_addr":"172.21.15.152:6825/116097","cluster_addr":"172.21.15.152:6827/116097","heartbeat_back_addr":"172.21.15.152:6831/116097","heartbeat_front_addr":"172.21.15.152:6829/116097","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T12:06:21.334 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:21.334+0000 7f48503ff700 1 -- 172.21.15.45:0/2603309361 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f482c068370 msgr2=0x7f482c06a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:21.334 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:21.334+0000 7f48503ff700 1 --2- 172.21.15.45:0/2603309361 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f482c068370 0x7f482c06a820 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4844007fd0 tx=0x7f4844007dc0 comp rx=0 tx=0).stop 2023-11-28T12:06:21.334 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:21.334+0000 7f48503ff700 1 -- 172.21.15.45:0/2603309361 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f484815c9b0 msgr2=0x7f484815e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:21.335 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:21.334+0000 7f48503ff700 1 --2- 172.21.15.45:0/2603309361 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f484815c9b0 0x7f484815e150 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f483800e870 tx=0x7f483800eb80 comp rx=0 tx=0).stop 2023-11-28T12:06:21.335 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:21.334+0000 7f48503ff700 1 -- 172.21.15.45:0/2603309361 shutdown_connections 2023-11-28T12:06:21.335 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:21.334+0000 7f48503ff700 1 --2- 172.21.15.45:0/2603309361 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f482c068370 0x7f482c06a820 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:21.335 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:21.334+0000 7f48503ff700 1 --2- 172.21.15.45:0/2603309361 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f48480d2320 0x7f48481468d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:21.335 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:21.334+0000 7f48503ff700 1 --2- 172.21.15.45:0/2603309361 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4848161340 0x7f484815e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:21.335 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:21.334+0000 7f48503ff700 1 --2- 172.21.15.45:0/2603309361 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f484815c9b0 0x7f484815e150 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:21.335 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:21.334+0000 7f48503ff700 1 -- 172.21.15.45:0/2603309361 >> 172.21.15.45:0/2603309361 conn(0x7f4848072600 msgr2=0x7f484815f940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:21.335 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:21.334+0000 7f48503ff700 1 -- 172.21.15.45:0/2603309361 shutdown_connections 2023-11-28T12:06:21.335 INFO:teuthology.misc.health.smithi045.stderr:2023-11-28T12:06:21.334+0000 7f48503ff700 1 -- 172.21.15.45:0/2603309361 wait complete. 2023-11-28T12:06:21.350 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-11-28T12:06:21.350 INFO:tasks.ceph:Creating RBD pool 2023-11-28T12:06:21.350 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --cluster ceph osd pool create rbd 8 2023-11-28T12:06:21.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:21.549+0000 7fe3093ff700 1 Processor -- start 2023-11-28T12:06:21.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:21.549+0000 7fe3093ff700 1 -- start start 2023-11-28T12:06:21.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:21.550+0000 7fe3093ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe3040d01b0 0x7fe3040d0c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:21.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:21.550+0000 7fe3093ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3040b0230 con 0x7fe3040b16d0 2023-11-28T12:06:21.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:21.550+0000 7fe3093ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3040b37d0 con 0x7fe3040b20b0 2023-11-28T12:06:21.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:21.550+0000 7fe3093ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe30415cec0 con 0x7fe3040d01b0 2023-11-28T12:06:21.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:21.550+0000 7fe3037fe700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fe3040b16d0 0x7fe3040b30c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:38342/0 (socket says 172.21.15.45:38342) 2023-11-28T12:06:21.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:21.550+0000 7fe3037fe700 1 -- 172.21.15.45:0/1051454463 learned_addr learned my addr 172.21.15.45:0/1051454463 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:06:21.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:21.550+0000 7fe302ffd700 1 --2- 172.21.15.45:0/1051454463 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe3040d01b0 0x7fe3040d0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:21.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:21.551+0000 7fe301ffb700 1 -- 172.21.15.45:0/1051454463 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1249525994 0 0) 0x7fe3040b0230 con 0x7fe3040b16d0 2023-11-28T12:06:21.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:21.551+0000 7fe301ffb700 1 -- 172.21.15.45:0/1051454463 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2ec0035b0 con 0x7fe3040b16d0 2023-11-28T12:06:21.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:21.551+0000 7fe301ffb700 1 -- 172.21.15.45:0/1051454463 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 503657547 0 0) 0x7fe3040b37d0 con 0x7fe3040b20b0 2023-11-28T12:06:21.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:21.551+0000 7fe301ffb700 1 -- 172.21.15.45:0/1051454463 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3040b0230 con 0x7fe3040b20b0 2023-11-28T12:06:21.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:21.551+0000 7fe302ffd700 1 -- 172.21.15.45:0/1051454463 >> v1:172.21.15.152:6789/0 conn(0x7fe3040b20b0 legacy=0x7fe3040b29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:21.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:21.551+0000 7fe302ffd700 1 -- 172.21.15.45:0/1051454463 >> v1:172.21.15.45:6789/0 conn(0x7fe3040b16d0 legacy=0x7fe3040b30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:21.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:21.551+0000 7fe302ffd700 1 -- 172.21.15.45:0/1051454463 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3040b4570 con 0x7fe3040d01b0 2023-11-28T12:06:21.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:21.551+0000 7fe302ffd700 1 --2- 172.21.15.45:0/1051454463 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe3040d01b0 0x7fe3040d0c20 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe2f40098a0 tx=0x7fe2f4009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54581952f66e281b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:21.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:21.551+0000 7fe301ffb700 1 -- 172.21.15.45:0/1051454463 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f4011830 con 0x7fe3040d01b0 2023-11-28T12:06:21.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:21.552+0000 7fe301ffb700 1 -- 172.21.15.45:0/1051454463 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2f4011990 con 0x7fe3040d01b0 2023-11-28T12:06:21.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:21.552+0000 7fe301ffb700 1 -- 172.21.15.45:0/1051454463 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f4011d20 con 0x7fe3040d01b0 2023-11-28T12:06:21.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:21.552+0000 7fe3093ff700 1 -- 172.21.15.45:0/1051454463 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe3040d01b0 msgr2=0x7fe3040d0c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:21.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:21.552+0000 7fe3093ff700 1 --2- 172.21.15.45:0/1051454463 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe3040d01b0 0x7fe3040d0c20 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe2f40098a0 tx=0x7fe2f4009bb0 comp rx=0 tx=0).stop 2023-11-28T12:06:21.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:21.552+0000 7fe3093ff700 1 -- 172.21.15.45:0/1051454463 shutdown_connections 2023-11-28T12:06:21.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:21.552+0000 7fe3093ff700 1 --2- 172.21.15.45:0/1051454463 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe3040d01b0 0x7fe3040d0c20 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:21.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:21.552+0000 7fe3093ff700 1 -- 172.21.15.45:0/1051454463 >> 172.21.15.45:0/1051454463 conn(0x7fe30409c3f0 msgr2=0x7fe3040d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:21.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:21.552+0000 7fe3093ff700 1 -- 172.21.15.45:0/1051454463 shutdown_connections 2023-11-28T12:06:21.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:21.552+0000 7fe3093ff700 1 -- 172.21.15.45:0/1051454463 wait complete. 2023-11-28T12:06:21.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:21.554+0000 7fe3093ff700 1 Processor -- start 2023-11-28T12:06:21.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:21.554+0000 7fe3093ff700 1 -- start start 2023-11-28T12:06:21.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:21.555+0000 7fe3093ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3040b16d0 0x7fe3040b6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:21.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:21.555+0000 7fe3093ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe3040b20b0 0x7fe3040b7a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:21.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:21.555+0000 7fe3093ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe3040d01b0 0x7fe3041f1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:21.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:21.555+0000 7fe3093ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe30415d0a0 con 0x7fe3040b16d0 2023-11-28T12:06:21.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:21.555+0000 7fe3093ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3040b7f40 con 0x7fe3040b20b0 2023-11-28T12:06:21.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:21.555+0000 7fe3093ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3040b81e0 con 0x7fe3040d01b0 2023-11-28T12:06:21.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:21.555+0000 7fe302ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3040b16d0 0x7fe3040b6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:21.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:21.555+0000 7fe302ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3040b16d0 0x7fe3040b6ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59042/0 (socket says 172.21.15.45:59042) 2023-11-28T12:06:21.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:21.555+0000 7fe302ffd700 1 -- 172.21.15.45:0/1048128242 learned_addr learned my addr 172.21.15.45:0/1048128242 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:21.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:21.556+0000 7fe3037fe700 1 --2- 172.21.15.45:0/1048128242 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe3040d01b0 0x7fe3041f1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:21.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:21.556+0000 7fe3027fc700 1 --2- 172.21.15.45:0/1048128242 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe3040b20b0 0x7fe3040b7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:21.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:21.556+0000 7fe302ffd700 1 -- 172.21.15.45:0/1048128242 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe3040d01b0 msgr2=0x7fe3041f1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:21.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:21.556+0000 7fe302ffd700 1 --2- 172.21.15.45:0/1048128242 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe3040d01b0 0x7fe3041f1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:21.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:21.556+0000 7fe302ffd700 1 -- 172.21.15.45:0/1048128242 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe3040b20b0 msgr2=0x7fe3040b7a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:21.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:21.556+0000 7fe302ffd700 1 --2- 172.21.15.45:0/1048128242 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe3040b20b0 0x7fe3040b7a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:21.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:21.556+0000 7fe302ffd700 1 -- 172.21.15.45:0/1048128242 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2f40094a0 con 0x7fe3040b16d0 2023-11-28T12:06:21.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:21.556+0000 7fe302ffd700 1 --2- 172.21.15.45:0/1048128242 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3040b16d0 0x7fe3040b6ae0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe2f4000c00 tx=0x7fe2f4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:21.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:21.556+0000 7fe2eb7fe700 1 -- 172.21.15.45:0/1048128242 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f401a850 con 0x7fe3040b16d0 2023-11-28T12:06:21.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:21.556+0000 7fe2eb7fe700 1 -- 172.21.15.45:0/1048128242 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2f401a9d0 con 0x7fe3040b16d0 2023-11-28T12:06:21.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:21.556+0000 7fe3093ff700 1 -- 172.21.15.45:0/1048128242 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3040afbe0 con 0x7fe3040b16d0 2023-11-28T12:06:21.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:21.556+0000 7fe2eb7fe700 1 -- 172.21.15.45:0/1048128242 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f401ad80 con 0x7fe3040b16d0 2023-11-28T12:06:21.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:21.557+0000 7fe3093ff700 1 -- 172.21.15.45:0/1048128242 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3040b4850 con 0x7fe3040b16d0 2023-11-28T12:06:21.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:21.558+0000 7fe3093ff700 1 -- 172.21.15.45:0/1048128242 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3040afec0 con 0x7fe3040b16d0 2023-11-28T12:06:21.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:21.558+0000 7fe2eb7fe700 1 -- 172.21.15.45:0/1048128242 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 86375+0+0 (secure 0 0 0) 0x7fe2f402b030 con 0x7fe3040b16d0 2023-11-28T12:06:21.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:21.559+0000 7fe2eb7fe700 1 --2- 172.21.15.45:0/1048128242 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fe2f00682a0 0x7fe2f006a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:21.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:21.559+0000 7fe2eb7fe700 1 -- 172.21.15.45:0/1048128242 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4471+0+0 (secure 0 0 0) 0x7fe2f4086880 con 0x7fe3040b16d0 2023-11-28T12:06:21.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:21.560+0000 7fe3027fc700 1 --2- 172.21.15.45:0/1048128242 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fe2f00682a0 0x7fe2f006a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:21.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:21.560+0000 7fe3027fc700 1 --2- 172.21.15.45:0/1048128242 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fe2f00682a0 0x7fe2f006a750 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe3040b7970 tx=0x7fe2f8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:21.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:21.564+0000 7fe2eb7fe700 1 -- 172.21.15.45:0/1048128242 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fe2f4053760 con 0x7fe3040b16d0 2023-11-28T12:06:21.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:21.766+0000 7fe3093ff700 1 -- 172.21.15.45:0/1048128242 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7fe304068690 con 0x7fe3040b16d0 2023-11-28T12:06:22.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:22.505+0000 7fe2eb7fe700 1 -- 172.21.15.45:0/1048128242 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v14) v1 ==== 109+0+0 (secure 0 0 0) 0x7fe2f40290a0 con 0x7fe3040b16d0 2023-11-28T12:06:22.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:22.509+0000 7fe3093ff700 1 -- 172.21.15.45:0/1048128242 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fe2f00682a0 msgr2=0x7fe2f006a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:22.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:22.509+0000 7fe3093ff700 1 --2- 172.21.15.45:0/1048128242 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fe2f00682a0 0x7fe2f006a750 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe3040b7970 tx=0x7fe2f8009040 comp rx=0 tx=0).stop 2023-11-28T12:06:22.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:22.509+0000 7fe3093ff700 1 -- 172.21.15.45:0/1048128242 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3040b16d0 msgr2=0x7fe3040b6ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:22.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:22.509+0000 7fe3093ff700 1 --2- 172.21.15.45:0/1048128242 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3040b16d0 0x7fe3040b6ae0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe2f4000c00 tx=0x7fe2f4004750 comp rx=0 tx=0).stop 2023-11-28T12:06:22.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:22.509+0000 7fe3093ff700 1 -- 172.21.15.45:0/1048128242 shutdown_connections 2023-11-28T12:06:22.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:22.509+0000 7fe3093ff700 1 --2- 172.21.15.45:0/1048128242 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fe2f00682a0 0x7fe2f006a750 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:22.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:22.509+0000 7fe3093ff700 1 --2- 172.21.15.45:0/1048128242 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe3040d01b0 0x7fe3041f1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:22.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:22.509+0000 7fe3093ff700 1 --2- 172.21.15.45:0/1048128242 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3040b16d0 0x7fe3040b6ae0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:22.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:22.509+0000 7fe3093ff700 1 --2- 172.21.15.45:0/1048128242 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe3040b20b0 0x7fe3040b7a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:22.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:22.509+0000 7fe3093ff700 1 -- 172.21.15.45:0/1048128242 >> 172.21.15.45:0/1048128242 conn(0x7fe30409c3f0 msgr2=0x7fe3040d0c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:22.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:22.509+0000 7fe3093ff700 1 -- 172.21.15.45:0/1048128242 shutdown_connections 2023-11-28T12:06:22.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:22.510+0000 7fe3093ff700 1 -- 172.21.15.45:0/1048128242 wait complete. 2023-11-28T12:06:22.511 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'rbd' created 2023-11-28T12:06:22.531 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-11-28T12:06:22.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:22.733+0000 7f2327dff700 1 Processor -- start 2023-11-28T12:06:22.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:22.733+0000 7f2327dff700 1 -- start start 2023-11-28T12:06:22.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:22.734+0000 7f2327dff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f23200b29d0 0x7f23200b38b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:22.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:22.734+0000 7f2327dff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23200afbe0 con 0x7f23200d1350 2023-11-28T12:06:22.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:22.734+0000 7f2327dff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23200b2750 con 0x7f232015ca60 2023-11-28T12:06:22.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:22.734+0000 7f2327dff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f232015ce30 con 0x7f23200b29d0 2023-11-28T12:06:22.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:22.734+0000 7f232539a700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f23200d1350 0x7f23200b0070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:37722/0 (socket says 172.21.15.45:37722) 2023-11-28T12:06:22.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:22.734+0000 7f232539a700 1 -- 172.21.15.45:0/98075745 learned_addr learned my addr 172.21.15.45:0/98075745 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:06:22.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:22.734+0000 7f232639c700 1 --2- 172.21.15.45:0/98075745 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f23200b29d0 0x7f23200b38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:22.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:22.735+0000 7f2324b99700 1 -- 172.21.15.45:0/98075745 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 300778187 0 0) 0x7f23200afbe0 con 0x7f23200d1350 2023-11-28T12:06:22.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:22.735+0000 7f2324b99700 1 -- 172.21.15.45:0/98075745 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f230c0035b0 con 0x7f23200d1350 2023-11-28T12:06:22.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:22.735+0000 7f2324b99700 1 -- 172.21.15.45:0/98075745 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3668098020 0 0) 0x7f23200b2750 con 0x7f232015ca60 2023-11-28T12:06:22.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:22.735+0000 7f2324b99700 1 -- 172.21.15.45:0/98075745 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23200afbe0 con 0x7f232015ca60 2023-11-28T12:06:22.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:22.735+0000 7f232639c700 1 -- 172.21.15.45:0/98075745 >> v1:172.21.15.152:6789/0 conn(0x7f232015ca60 legacy=0x7f23200d0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:22.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:22.735+0000 7f232639c700 1 -- 172.21.15.45:0/98075745 >> v1:172.21.15.45:6789/0 conn(0x7f23200d1350 legacy=0x7f23200b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:22.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:22.735+0000 7f232639c700 1 -- 172.21.15.45:0/98075745 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23200b3f20 con 0x7f23200b29d0 2023-11-28T12:06:22.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:22.735+0000 7f232639c700 1 --2- 172.21.15.45:0/98075745 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f23200b29d0 0x7f23200b38b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2318009dc0 tx=0x7f231800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de2d1599cb1980e7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:22.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:22.736+0000 7f2324b99700 1 -- 172.21.15.45:0/98075745 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f231800e070 con 0x7f23200b29d0 2023-11-28T12:06:22.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:22.736+0000 7f2324b99700 1 -- 172.21.15.45:0/98075745 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f231800bb20 con 0x7f23200b29d0 2023-11-28T12:06:22.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:22.736+0000 7f2324b99700 1 -- 172.21.15.45:0/98075745 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2318012430 con 0x7f23200b29d0 2023-11-28T12:06:22.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:22.736+0000 7f2327dff700 1 -- 172.21.15.45:0/98075745 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f23200b29d0 msgr2=0x7f23200b38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:22.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:22.736+0000 7f2327dff700 1 --2- 172.21.15.45:0/98075745 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f23200b29d0 0x7f23200b38b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2318009dc0 tx=0x7f231800b330 comp rx=0 tx=0).stop 2023-11-28T12:06:22.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:22.736+0000 7f2327dff700 1 -- 172.21.15.45:0/98075745 shutdown_connections 2023-11-28T12:06:22.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:22.736+0000 7f2327dff700 1 --2- 172.21.15.45:0/98075745 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f23200b29d0 0x7f23200b38b0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:22.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:22.736+0000 7f2327dff700 1 -- 172.21.15.45:0/98075745 >> 172.21.15.45:0/98075745 conn(0x7f232009c3f0 msgr2=0x7f23200d3070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:22.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:22.736+0000 7f2327dff700 1 -- 172.21.15.45:0/98075745 shutdown_connections 2023-11-28T12:06:22.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:22.736+0000 7f2327dff700 1 -- 172.21.15.45:0/98075745 wait complete. 2023-11-28T12:06:22.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:22.738+0000 7f2327dff700 1 Processor -- start 2023-11-28T12:06:22.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:22.738+0000 7f2327dff700 1 -- start start 2023-11-28T12:06:22.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:22.739+0000 7f2327dff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23200b29d0 0x7f2320159360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:22.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:22.739+0000 7f2327dff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f23200d1350 0x7f232015d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:22.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:22.739+0000 7f2327dff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f232015ca60 0x7f2320156180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:22.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:22.739+0000 7f2327dff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23200b64f0 con 0x7f23200b29d0 2023-11-28T12:06:22.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:22.739+0000 7f2327dff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f232015e160 con 0x7f23200d1350 2023-11-28T12:06:22.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:22.739+0000 7f2327dff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f232015e440 con 0x7f232015ca60 2023-11-28T12:06:22.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:22.739+0000 7f2325b9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23200b29d0 0x7f2320159360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:22.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:22.740+0000 7f2325b9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23200b29d0 0x7f2320159360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46300/0 (socket says 172.21.15.45:46300) 2023-11-28T12:06:22.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:22.740+0000 7f2325b9b700 1 -- 172.21.15.45:0/4135807047 learned_addr learned my addr 172.21.15.45:0/4135807047 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:22.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:22.740+0000 7f232639c700 1 --2- 172.21.15.45:0/4135807047 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f232015ca60 0x7f2320156180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:22.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:22.740+0000 7f232539a700 1 --2- 172.21.15.45:0/4135807047 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f23200d1350 0x7f232015d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:22.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:22.740+0000 7f2325b9b700 1 -- 172.21.15.45:0/4135807047 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f232015ca60 msgr2=0x7f2320156180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:22.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:22.740+0000 7f2325b9b700 1 --2- 172.21.15.45:0/4135807047 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f232015ca60 0x7f2320156180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:22.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:22.740+0000 7f2325b9b700 1 -- 172.21.15.45:0/4135807047 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f23200d1350 msgr2=0x7f232015d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:22.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:22.740+0000 7f2325b9b700 1 --2- 172.21.15.45:0/4135807047 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f23200d1350 0x7f232015d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:22.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:22.740+0000 7f2325b9b700 1 -- 172.21.15.45:0/4135807047 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2318009a70 con 0x7f23200b29d0 2023-11-28T12:06:22.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:22.740+0000 7f2325b9b700 1 --2- 172.21.15.45:0/4135807047 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23200b29d0 0x7f2320159360 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f231c00c700 tx=0x7f231c00ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:22.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:22.740+0000 7f23167fc700 1 -- 172.21.15.45:0/4135807047 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f231c0052d0 con 0x7f23200b29d0 2023-11-28T12:06:22.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:22.741+0000 7f23167fc700 1 -- 172.21.15.45:0/4135807047 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f231c005430 con 0x7f23200b29d0 2023-11-28T12:06:22.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:22.741+0000 7f23167fc700 1 -- 172.21.15.45:0/4135807047 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f231c0038f0 con 0x7f23200b29d0 2023-11-28T12:06:22.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:22.741+0000 7f2327dff700 1 -- 172.21.15.45:0/4135807047 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23200b44e0 con 0x7f23200b29d0 2023-11-28T12:06:22.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:22.741+0000 7f2327dff700 1 -- 172.21.15.45:0/4135807047 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23200b4200 con 0x7f23200b29d0 2023-11-28T12:06:22.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:22.742+0000 7f2327dff700 1 -- 172.21.15.45:0/4135807047 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23200b47c0 con 0x7f23200b29d0 2023-11-28T12:06:22.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:22.743+0000 7f23167fc700 1 -- 172.21.15.45:0/4135807047 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 86375+0+0 (secure 0 0 0) 0x7f231c019030 con 0x7f23200b29d0 2023-11-28T12:06:22.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:22.744+0000 7f23167fc700 1 --2- 172.21.15.45:0/4135807047 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f23040682a0 0x7f230406a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:22.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:22.744+0000 7f23167fc700 1 -- 172.21.15.45:0/4135807047 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 5188+0+0 (secure 0 0 0) 0x7f231c084d00 con 0x7f23200b29d0 2023-11-28T12:06:22.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:22.744+0000 7f232539a700 1 --2- 172.21.15.45:0/4135807047 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f23040682a0 0x7f230406a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:22.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:22.745+0000 7f232539a700 1 --2- 172.21.15.45:0/4135807047 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f23040682a0 0x7f230406a750 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2310007fd0 tx=0x7f2310007dc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:22.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:22.748+0000 7f23167fc700 1 -- 172.21.15.45:0/4135807047 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f231c0517c0 con 0x7f23200b29d0 2023-11-28T12:06:22.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:22.954+0000 7f2327dff700 1 -- 172.21.15.45:0/4135807047 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f23200672a0 con 0x7f23200b29d0 2023-11-28T12:06:23.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:23.506+0000 7f23167fc700 1 -- 172.21.15.45:0/4135807047 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v15) v1 ==== 173+0+0 (secure 0 0 0) 0x7f231c054de0 con 0x7f23200b29d0 2023-11-28T12:06:23.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:23.509+0000 7f2327dff700 1 -- 172.21.15.45:0/4135807047 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f23040682a0 msgr2=0x7f230406a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:23.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:23.509+0000 7f2327dff700 1 --2- 172.21.15.45:0/4135807047 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f23040682a0 0x7f230406a750 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2310007fd0 tx=0x7f2310007dc0 comp rx=0 tx=0).stop 2023-11-28T12:06:23.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:23.509+0000 7f2327dff700 1 -- 172.21.15.45:0/4135807047 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23200b29d0 msgr2=0x7f2320159360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:23.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:23.509+0000 7f2327dff700 1 --2- 172.21.15.45:0/4135807047 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23200b29d0 0x7f2320159360 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f231c00c700 tx=0x7f231c00ca10 comp rx=0 tx=0).stop 2023-11-28T12:06:23.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:23.509+0000 7f2327dff700 1 -- 172.21.15.45:0/4135807047 shutdown_connections 2023-11-28T12:06:23.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:23.509+0000 7f2327dff700 1 --2- 172.21.15.45:0/4135807047 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f23040682a0 0x7f230406a750 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:23.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:23.509+0000 7f2327dff700 1 --2- 172.21.15.45:0/4135807047 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f232015ca60 0x7f2320156180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:23.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:23.509+0000 7f2327dff700 1 --2- 172.21.15.45:0/4135807047 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23200b29d0 0x7f2320159360 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:23.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:23.509+0000 7f2327dff700 1 --2- 172.21.15.45:0/4135807047 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f23200d1350 0x7f232015d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:23.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:23.509+0000 7f2327dff700 1 -- 172.21.15.45:0/4135807047 >> 172.21.15.45:0/4135807047 conn(0x7f232009c3f0 msgr2=0x7f23200aff70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:23.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:23.509+0000 7f2327dff700 1 -- 172.21.15.45:0/4135807047 shutdown_connections 2023-11-28T12:06:23.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:23.509+0000 7f2327dff700 1 -- 172.21.15.45:0/4135807047 wait complete. 2023-11-28T12:06:23.512 INFO:teuthology.orchestra.run.smithi045.stderr:enabled application 'rbd' on pool 'rbd' 2023-11-28T12:06:23.532 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-11-28T12:06:23.532 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-28T12:06:23.533 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-28T12:06:23.537 INFO:tasks.ceph.mds.a:Started 2023-11-28T12:06:23.538 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-28T12:06:23.538 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-28T12:06:23.543 INFO:tasks.ceph.mds.c:Started 2023-11-28T12:06:23.543 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-28T12:06:23.543 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-28T12:06:23.549 INFO:tasks.ceph.mds.b:Started 2023-11-28T12:06:23.550 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-28T12:06:23.550 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-28T12:06:23.555 INFO:tasks.ceph.mds.d:Started 2023-11-28T12:06:23.555 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-11-28T12:06:23.556 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T12:06:23.709 INFO:tasks.ceph.mds.a.smithi045.stdout:starting mds.a at 2023-11-28T12:06:23.710 INFO:tasks.ceph.mds.c.smithi045.stdout:starting mds.c at 2023-11-28T12:06:23.716 INFO:tasks.ceph.mds.b.smithi152.stdout:starting mds.b at 2023-11-28T12:06:23.718 INFO:tasks.ceph.mds.d.smithi152.stdout:starting mds.d at 2023-11-28T12:06:23.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:23.787+0000 7f82f67ff700 1 Processor -- start 2023-11-28T12:06:23.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:23.787+0000 7f82f67ff700 1 -- start start 2023-11-28T12:06:23.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:23.788+0000 7f82f67ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f82f015c9b0 0x7f82f00b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:23.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:23.788+0000 7f82f67ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f82f0161340 0x7f82f00d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:23.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:23.788+0000 7f82f67ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f82f00d2320 0x7f82f00cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:23.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:23.788+0000 7f82f67ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82f00b5800 con 0x7f82f015c9b0 2023-11-28T12:06:23.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:23.788+0000 7f82f67ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82f00d1950 con 0x7f82f0161340 2023-11-28T12:06:23.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:23.788+0000 7f82f67ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82f00b5520 con 0x7f82f00d2320 2023-11-28T12:06:23.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:23.789+0000 7f82effff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f82f015c9b0 0x7f82f00b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:23.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:23.789+0000 7f82effff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f82f015c9b0 0x7f82f00b4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46326/0 (socket says 172.21.15.45:46326) 2023-11-28T12:06:23.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:23.789+0000 7f82effff700 1 -- 172.21.15.45:0/2561575635 learned_addr learned my addr 172.21.15.45:0/2561575635 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:23.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:23.789+0000 7f82ef7fe700 1 --2- 172.21.15.45:0/2561575635 >> v2:172.21.15.152:3300/0 conn(0x7f82f0161340 0x7f82f00d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:23.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:23.789+0000 7f82f4d9c700 1 --2- 172.21.15.45:0/2561575635 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f82f00d2320 0x7f82f00cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:23.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:23.789+0000 7f82effff700 1 -- 172.21.15.45:0/2561575635 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f82f00d2320 msgr2=0x7f82f00cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:06:23.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:23.789+0000 7f82effff700 1 --2- 172.21.15.45:0/2561575635 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f82f00d2320 0x7f82f00cd7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:23.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:23.789+0000 7f82effff700 1 -- 172.21.15.45:0/2561575635 >> v2:172.21.15.152:3300/0 conn(0x7f82f0161340 msgr2=0x7f82f00d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:06:23.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:23.789+0000 7f82effff700 1 --2- 172.21.15.45:0/2561575635 >> v2:172.21.15.152:3300/0 conn(0x7f82f0161340 0x7f82f00d1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:23.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:23.789+0000 7f82effff700 1 -- 172.21.15.45:0/2561575635 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82f00d1300 con 0x7f82f015c9b0 2023-11-28T12:06:23.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:23.789+0000 7f82effff700 1 --2- 172.21.15.45:0/2561575635 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82f015c9b0 0x7f82f00b4bf0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f82f00685c0 tx=0x7f82e0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c24a35c822fc3b98 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:23.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:23.790+0000 7f82eeffd700 1 -- 172.21.15.45:0/2561575635 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e0011830 con 0x7f82f015c9b0 2023-11-28T12:06:23.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:23.790+0000 7f82eeffd700 1 -- 172.21.15.45:0/2561575635 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82e0011990 con 0x7f82f015c9b0 2023-11-28T12:06:23.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:23.790+0000 7f82eeffd700 1 -- 172.21.15.45:0/2561575635 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e0011d20 con 0x7f82f015c9b0 2023-11-28T12:06:23.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:23.790+0000 7f82f67ff700 1 -- 172.21.15.45:0/2561575635 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82f015c9b0 msgr2=0x7f82f00b4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:23.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:23.790+0000 7f82f67ff700 1 --2- 172.21.15.45:0/2561575635 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82f015c9b0 0x7f82f00b4bf0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f82f00685c0 tx=0x7f82e0009bd0 comp rx=0 tx=0).stop 2023-11-28T12:06:23.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:23.790+0000 7f82f67ff700 1 -- 172.21.15.45:0/2561575635 shutdown_connections 2023-11-28T12:06:23.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:23.790+0000 7f82f67ff700 1 --2- 172.21.15.45:0/2561575635 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f82f00d2320 0x7f82f00cd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:23.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:23.790+0000 7f82f67ff700 1 --2- 172.21.15.45:0/2561575635 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82f015c9b0 0x7f82f00b4bf0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:23.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:23.790+0000 7f82f67ff700 1 --2- 172.21.15.45:0/2561575635 >> v2:172.21.15.152:3300/0 conn(0x7f82f0161340 0x7f82f00d1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:23.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:23.790+0000 7f82f67ff700 1 -- 172.21.15.45:0/2561575635 >> 172.21.15.45:0/2561575635 conn(0x7f82f0072600 msgr2=0x7f82f00cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:23.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:23.790+0000 7f82f67ff700 1 -- 172.21.15.45:0/2561575635 shutdown_connections 2023-11-28T12:06:23.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:23.790+0000 7f82f67ff700 1 -- 172.21.15.45:0/2561575635 wait complete. 2023-11-28T12:06:23.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:23.792+0000 7f82f67ff700 1 Processor -- start 2023-11-28T12:06:23.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:23.792+0000 7f82f67ff700 1 -- start start 2023-11-28T12:06:23.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:23.793+0000 7f82f67ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f82f00d2320 0x7f82f0154bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:23.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:23.793+0000 7f82f67ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82f015c9b0 0x7f82f0150990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:23.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:23.793+0000 7f82f67ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f82f0161340 0x7f82f00b74c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:23.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:23.793+0000 7f82f67ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82f00c8230 con 0x7f82f015c9b0 2023-11-28T12:06:23.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:23.793+0000 7f82f67ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82f0150ed0 con 0x7f82f00d2320 2023-11-28T12:06:23.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:23.793+0000 7f82f67ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82f00c8480 con 0x7f82f0161340 2023-11-28T12:06:23.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:23.794+0000 7f82effff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f82f00d2320 0x7f82f0154bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:23.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:23.794+0000 7f82ef7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82f015c9b0 0x7f82f0150990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:23.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:23.794+0000 7f82effff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f82f00d2320 0x7f82f0154bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.45:42928/0 (socket says 172.21.15.45:42928) 2023-11-28T12:06:23.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:23.794+0000 7f82effff700 1 -- 172.21.15.45:0/4222552549 learned_addr learned my addr 172.21.15.45:0/4222552549 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:23.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:23.794+0000 7f82f4d9c700 1 --2- 172.21.15.45:0/4222552549 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f82f0161340 0x7f82f00b74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:23.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:23.794+0000 7f82effff700 1 -- 172.21.15.45:0/4222552549 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f82f0161340 msgr2=0x7f82f00b74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:23.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:23.794+0000 7f82effff700 1 --2- 172.21.15.45:0/4222552549 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f82f0161340 0x7f82f00b74c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:23.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:23.794+0000 7f82effff700 1 -- 172.21.15.45:0/4222552549 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82f015c9b0 msgr2=0x7f82f0150990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:23.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:23.794+0000 7f82effff700 1 --2- 172.21.15.45:0/4222552549 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82f015c9b0 0x7f82f0150990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:23.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:23.794+0000 7f82effff700 1 -- 172.21.15.45:0/4222552549 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82e0009550 con 0x7f82f00d2320 2023-11-28T12:06:23.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:23.794+0000 7f82f4d9c700 1 --2- 172.21.15.45:0/4222552549 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f82f0161340 0x7f82f00b74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:06:23.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:23.794+0000 7f82ef7fe700 1 --2- 172.21.15.45:0/4222552549 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82f015c9b0 0x7f82f0150990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:06:23.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:23.794+0000 7f82effff700 1 --2- 172.21.15.45:0/4222552549 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f82f00d2320 0x7f82f0154bb0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f82e0000c00 tx=0x7f82e0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:23.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:23.794+0000 7f82ecff9700 1 -- 172.21.15.45:0/4222552549 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e0004300 con 0x7f82f00d2320 2023-11-28T12:06:23.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:23.795+0000 7f82ecff9700 1 -- 172.21.15.45:0/4222552549 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82e001f070 con 0x7f82f00d2320 2023-11-28T12:06:23.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:23.795+0000 7f82f67ff700 1 -- 172.21.15.45:0/4222552549 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82f00b5130 con 0x7f82f00d2320 2023-11-28T12:06:23.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:23.795+0000 7f82ecff9700 1 -- 172.21.15.45:0/4222552549 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e00036a0 con 0x7f82f00d2320 2023-11-28T12:06:23.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:23.795+0000 7f82f67ff700 1 -- 172.21.15.45:0/4222552549 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82f00d15e0 con 0x7f82f00d2320 2023-11-28T12:06:23.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:23.796+0000 7f82f67ff700 1 -- 172.21.15.45:0/4222552549 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82f00b52c0 con 0x7f82f00d2320 2023-11-28T12:06:23.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:23.797+0000 7f82ecff9700 1 -- 172.21.15.45:0/4222552549 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 4) v1 ==== 86375+0+0 (secure 0 0 0) 0x7f82e002a020 con 0x7f82f00d2320 2023-11-28T12:06:23.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:23.797+0000 7f82ecff9700 1 --2- 172.21.15.45:0/4222552549 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f82dc0682a0 0x7f82dc06a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:23.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:23.798+0000 7f82ecff9700 1 -- 172.21.15.45:0/4222552549 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f82e0086dc0 con 0x7f82f00d2320 2023-11-28T12:06:23.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:23.798+0000 7f82ef7fe700 1 --2- 172.21.15.45:0/4222552549 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f82dc0682a0 0x7f82dc06a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:23.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:23.798+0000 7f82ef7fe700 1 --2- 172.21.15.45:0/4222552549 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f82dc0682a0 0x7f82dc06a750 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f82f01f5650 tx=0x7f82e4009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:23.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:23.803+0000 7f82ecff9700 1 -- 172.21.15.45:0/4222552549 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f82e00538d0 con 0x7f82f00d2320 2023-11-28T12:06:24.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.023+0000 7f82f67ff700 1 -- 172.21.15.45:0/4222552549 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f82f00745c0 con 0x7f82f00d2320 2023-11-28T12:06:24.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.025+0000 7f82ecff9700 1 -- 172.21.15.45:0/4222552549 <== mon.1 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+14233 (secure 0 0 0) 0x7f82e0015090 con 0x7f82f00d2320 2023-11-28T12:06:24.026 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:06:24.026 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":15,"fsid":"bd7c37f1-f7c6-4778-b845-52cf2aa6e366","created":"2023-11-28T12:06:09.045075+0000","modified":"2023-11-28T12:06:23.502655+0000","last_up_change":"2023-11-28T12:06:21.282227+0000","last_in_change":"2023-11-28T12:06:12.560924+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T12:06:21.807108+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T12:06:22.491009+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d0cdd8a-87fd-4f2c-91bd-47bdfa661905","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":115843},{"type":"v1","addr":"172.21.15.45:6808","nonce":115843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":115843},{"type":"v1","addr":"172.21.15.45:6811","nonce":115843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":115843},{"type":"v1","addr":"172.21.15.45:6815","nonce":115843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":115843},{"type":"v1","addr":"172.21.15.45:6813","nonce":115843}]},"public_addr":"172.21.15.45:6808/115843","cluster_addr":"172.21.15.45:6811/115843","heartbeat_back_addr":"172.21.15.45:6815/115843","heartbeat_front_addr":"172.21.15.45:6813/115843","state":["exists","up"]},{"osd":1,"uuid":"c5de4ebd-9ec5-40b3-9caa-9b706fab4c76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":115842},{"type":"v1","addr":"172.21.15.45:6801","nonce":115842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":115842},{"type":"v1","addr":"172.21.15.45:6803","nonce":115842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6807","nonce":115842},{"type":"v1","addr":"172.21.15.45:6809","nonce":115842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":115842},{"type":"v1","addr":"172.21.15.45:6805","nonce":115842}]},"public_addr":"172.21.15.45:6801/115842","cluster_addr":"172.21.15.45:6803/115842","heartbeat_back_addr":"172.21.15.45:6809/115842","heartbeat_front_addr":"172.21.15.45:6805/115842","state":["exists","up"]},{"osd":2,"uuid":"9f4b36b2-65d2-40e7-9fe6-a2991afa71c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":115850},{"type":"v1","addr":"172.21.15.45:6819","nonce":115850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":115850},{"type":"v1","addr":"172.21.15.45:6823","nonce":115850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":115850},{"type":"v1","addr":"172.21.15.45:6831","nonce":115850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":115850},{"type":"v1","addr":"172.21.15.45:6828","nonce":115850}]},"public_addr":"172.21.15.45:6819/115850","cluster_addr":"172.21.15.45:6823/115850","heartbeat_back_addr":"172.21.15.45:6831/115850","heartbeat_front_addr":"172.21.15.45:6828/115850","state":["exists","up"]},{"osd":3,"uuid":"6fe7ef05-4e0d-426c-bf94-44b51d4d550b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":115848},{"type":"v1","addr":"172.21.15.45:6818","nonce":115848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":115848},{"type":"v1","addr":"172.21.15.45:6822","nonce":115848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6827","nonce":115848},{"type":"v1","addr":"172.21.15.45:6829","nonce":115848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":115848},{"type":"v1","addr":"172.21.15.45:6825","nonce":115848}]},"public_addr":"172.21.15.45:6818/115848","cluster_addr":"172.21.15.45:6822/115848","heartbeat_back_addr":"172.21.15.45:6829/115848","heartbeat_front_addr":"172.21.15.45:6825/115848","state":["exists","up"]},{"osd":4,"uuid":"fa403c08-d8a1-4a3a-8384-cb465c1a654c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":116092},{"type":"v1","addr":"172.21.15.152:6801","nonce":116092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":116092},{"type":"v1","addr":"172.21.15.152:6803","nonce":116092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":116092},{"type":"v1","addr":"172.21.15.152:6807","nonce":116092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":116092},{"type":"v1","addr":"172.21.15.152:6805","nonce":116092}]},"public_addr":"172.21.15.152:6801/116092","cluster_addr":"172.21.15.152:6803/116092","heartbeat_back_addr":"172.21.15.152:6807/116092","heartbeat_front_addr":"172.21.15.152:6805/116092","state":["exists","up"]},{"osd":5,"uuid":"399fc450-39fa-43a6-bf80-0b8bcb41bd95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6815","nonce":116093},{"type":"v1","addr":"172.21.15.152:6817","nonce":116093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":116093},{"type":"v1","addr":"172.21.15.152:6819","nonce":116093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":116093},{"type":"v1","addr":"172.21.15.152:6823","nonce":116093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":116093},{"type":"v1","addr":"172.21.15.152:6821","nonce":116093}]},"public_addr":"172.21.15.152:6817/116093","cluster_addr":"172.21.15.152:6819/116093","heartbeat_back_addr":"172.21.15.152:6823/116093","heartbeat_front_addr":"172.21.15.152:6821/116093","state":["exists","up"]},{"osd":6,"uuid":"e59a4017-2d23-4627-836b-e25b2d3ddaaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":116094},{"type":"v1","addr":"172.21.15.152:6809","nonce":116094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":116094},{"type":"v1","addr":"172.21.15.152:6811","nonce":116094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":116094},{"type":"v1","addr":"172.21.15.152:6816","nonce":116094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":116094},{"type":"v1","addr":"172.21.15.152:6813","nonce":116094}]},"public_addr":"172.21.15.152:6809/116094","cluster_addr":"172.21.15.152:6811/116094","heartbeat_back_addr":"172.21.15.152:6816/116094","heartbeat_front_addr":"172.21.15.152:6813/116094","state":["exists","up"]},{"osd":7,"uuid":"8d7f9d4b-bf08-4670-8591-388c0f012a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":116097},{"type":"v1","addr":"172.21.15.152:6825","nonce":116097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":116097},{"type":"v1","addr":"172.21.15.152:6827","nonce":116097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":116097},{"type":"v1","addr":"172.21.15.152:6831","nonce":116097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":116097},{"type":"v1","addr":"172.21.15.152:6829","nonce":116097}]},"public_addr":"172.21.15.152:6825/116097","cluster_addr":"172.21.15.152:6827/116097","heartbeat_back_addr":"172.21.15.152:6831/116097","heartbeat_front_addr":"172.21.15.152:6829/116097","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.937710+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.865423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.159434+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.913090+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.131647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.966255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.972583+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.177209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T12:06:24.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.027+0000 7f82f67ff700 1 -- 172.21.15.45:0/4222552549 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f82dc0682a0 msgr2=0x7f82dc06a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:24.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.027+0000 7f82f67ff700 1 --2- 172.21.15.45:0/4222552549 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f82dc0682a0 0x7f82dc06a750 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f82f01f5650 tx=0x7f82e4009210 comp rx=0 tx=0).stop 2023-11-28T12:06:24.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.027+0000 7f82f67ff700 1 -- 172.21.15.45:0/4222552549 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f82f00d2320 msgr2=0x7f82f0154bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:24.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.027+0000 7f82f67ff700 1 --2- 172.21.15.45:0/4222552549 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f82f00d2320 0x7f82f0154bb0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f82e0000c00 tx=0x7f82e0004750 comp rx=0 tx=0).stop 2023-11-28T12:06:24.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.027+0000 7f82f67ff700 1 -- 172.21.15.45:0/4222552549 shutdown_connections 2023-11-28T12:06:24.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.027+0000 7f82f67ff700 1 --2- 172.21.15.45:0/4222552549 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f82dc0682a0 0x7f82dc06a750 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:24.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.027+0000 7f82f67ff700 1 --2- 172.21.15.45:0/4222552549 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f82f00d2320 0x7f82f0154bb0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:24.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.027+0000 7f82f67ff700 1 --2- 172.21.15.45:0/4222552549 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f82f0161340 0x7f82f00b74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:24.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.027+0000 7f82f67ff700 1 --2- 172.21.15.45:0/4222552549 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82f015c9b0 0x7f82f0150990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:24.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.027+0000 7f82f67ff700 1 -- 172.21.15.45:0/4222552549 >> 172.21.15.45:0/4222552549 conn(0x7f82f0072600 msgr2=0x7f82f0158130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:24.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.027+0000 7f82f67ff700 1 -- 172.21.15.45:0/4222552549 shutdown_connections 2023-11-28T12:06:24.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.028+0000 7f82f67ff700 1 -- 172.21.15.45:0/4222552549 wait complete. 2023-11-28T12:06:24.046 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-28T12:06:21.807108+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-28T12:06:22.491009+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T12:06:24.047 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T12:06:24.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.259+0000 7fba9e1ff700 1 Processor -- start 2023-11-28T12:06:24.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.260+0000 7fba9e1ff700 1 -- start start 2023-11-28T12:06:24.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.261+0000 7fba9e1ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fba980d01b0 0x7fba980d0c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:24.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.261+0000 7fba9e1ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fba980b16d0 0x7fba980d1160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:24.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.261+0000 7fba9e1ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba980b0230 con 0x7fba980b20b0 2023-11-28T12:06:24.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.261+0000 7fba9e1ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba9815cec0 con 0x7fba980d01b0 2023-11-28T12:06:24.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.261+0000 7fba9e1ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba980b4570 con 0x7fba980b16d0 2023-11-28T12:06:24.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.261+0000 7fba96ffd700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fba980b20b0 0x7fba980b29b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:37728/0 (socket says 172.21.15.45:37728) 2023-11-28T12:06:24.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.261+0000 7fba977fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fba980d01b0 0x7fba980d0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:24.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.261+0000 7fba96ffd700 1 -- 172.21.15.45:0/2361367493 learned_addr learned my addr 172.21.15.45:0/2361367493 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:06:24.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.262+0000 7fba97fff700 1 --2- 172.21.15.45:0/2361367493 >> v2:172.21.15.152:3300/0 conn(0x7fba980b16d0 0x7fba980d1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:24.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.262+0000 7fba977fe700 1 -- 172.21.15.45:0/2361367493 >> v2:172.21.15.152:3300/0 conn(0x7fba980b16d0 msgr2=0x7fba980d1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:06:24.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.262+0000 7fba977fe700 1 --2- 172.21.15.45:0/2361367493 >> v2:172.21.15.152:3300/0 conn(0x7fba980b16d0 0x7fba980d1160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:24.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.262+0000 7fba977fe700 1 -- 172.21.15.45:0/2361367493 >> v1:172.21.15.45:6789/0 conn(0x7fba980b20b0 legacy=0x7fba980b29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:24.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.262+0000 7fba977fe700 1 -- 172.21.15.45:0/2361367493 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba980b4850 con 0x7fba980d01b0 2023-11-28T12:06:24.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.262+0000 7fba97fff700 1 --2- 172.21.15.45:0/2361367493 >> v2:172.21.15.152:3300/0 conn(0x7fba980b16d0 0x7fba980d1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:06:24.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.262+0000 7fba967fc700 1 -- 172.21.15.45:0/2361367493 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3390186284 0 0) 0x7fba980b0230 con 0x7fba980b20b0 2023-11-28T12:06:24.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.262+0000 7fba977fe700 1 --2- 172.21.15.45:0/2361367493 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba980d01b0 0x7fba980d0c20 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fba980cd630 tx=0x7fba88009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ead9ed9367ba5ae server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:24.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.262+0000 7fba967fc700 1 -- 172.21.15.45:0/2361367493 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba88011830 con 0x7fba980d01b0 2023-11-28T12:06:24.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.262+0000 7fba967fc700 1 -- 172.21.15.45:0/2361367493 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba88011990 con 0x7fba980d01b0 2023-11-28T12:06:24.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.262+0000 7fba967fc700 1 -- 172.21.15.45:0/2361367493 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba88011d20 con 0x7fba980d01b0 2023-11-28T12:06:24.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.263+0000 7fba9e1ff700 1 -- 172.21.15.45:0/2361367493 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba980d01b0 msgr2=0x7fba980d0c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:24.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.263+0000 7fba9e1ff700 1 --2- 172.21.15.45:0/2361367493 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba980d01b0 0x7fba980d0c20 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fba980cd630 tx=0x7fba88009b20 comp rx=0 tx=0).stop 2023-11-28T12:06:24.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.263+0000 7fba9e1ff700 1 -- 172.21.15.45:0/2361367493 shutdown_connections 2023-11-28T12:06:24.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.263+0000 7fba9e1ff700 1 --2- 172.21.15.45:0/2361367493 >> v2:172.21.15.152:3300/0 conn(0x7fba980b16d0 0x7fba980d1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:24.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.263+0000 7fba9e1ff700 1 --2- 172.21.15.45:0/2361367493 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba980d01b0 0x7fba980d0c20 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:24.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.263+0000 7fba9e1ff700 1 -- 172.21.15.45:0/2361367493 >> 172.21.15.45:0/2361367493 conn(0x7fba9809c3f0 msgr2=0x7fba980d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:24.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.263+0000 7fba9e1ff700 1 -- 172.21.15.45:0/2361367493 shutdown_connections 2023-11-28T12:06:24.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.263+0000 7fba9e1ff700 1 -- 172.21.15.45:0/2361367493 wait complete. 2023-11-28T12:06:24.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.265+0000 7fba9e1ff700 1 Processor -- start 2023-11-28T12:06:24.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.265+0000 7fba9e1ff700 1 -- start start 2023-11-28T12:06:24.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.266+0000 7fba9e1ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fba980b16d0 0x7fba9814a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:24.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.266+0000 7fba9e1ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba980b20b0 0x7fba980b7430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:24.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.266+0000 7fba9e1ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fba980d01b0 0x7fba981e3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:24.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.266+0000 7fba9e1ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba980c9720 con 0x7fba980b20b0 2023-11-28T12:06:24.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.266+0000 7fba9e1ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba9815a170 con 0x7fba980b16d0 2023-11-28T12:06:24.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.266+0000 7fba9e1ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba980b7e10 con 0x7fba980d01b0 2023-11-28T12:06:24.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.266+0000 7fba96ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba980b20b0 0x7fba980b7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:24.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.266+0000 7fba96ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba980b20b0 0x7fba980b7430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46348/0 (socket says 172.21.15.45:46348) 2023-11-28T12:06:24.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.266+0000 7fba96ffd700 1 -- 172.21.15.45:0/3989879084 learned_addr learned my addr 172.21.15.45:0/3989879084 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:24.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.266+0000 7fba977fe700 1 --2- 172.21.15.45:0/3989879084 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fba980b16d0 0x7fba9814a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:24.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.266+0000 7fba97fff700 1 --2- 172.21.15.45:0/3989879084 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fba980d01b0 0x7fba981e3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:24.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.267+0000 7fba96ffd700 1 -- 172.21.15.45:0/3989879084 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fba980d01b0 msgr2=0x7fba981e3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:24.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.267+0000 7fba96ffd700 1 --2- 172.21.15.45:0/3989879084 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fba980d01b0 0x7fba981e3ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:24.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.267+0000 7fba96ffd700 1 -- 172.21.15.45:0/3989879084 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fba980b16d0 msgr2=0x7fba9814a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:24.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.267+0000 7fba96ffd700 1 --2- 172.21.15.45:0/3989879084 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fba980b16d0 0x7fba9814a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:24.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.267+0000 7fba96ffd700 1 -- 172.21.15.45:0/3989879084 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba880094a0 con 0x7fba980b20b0 2023-11-28T12:06:24.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.267+0000 7fba977fe700 1 --2- 172.21.15.45:0/3989879084 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fba980b16d0 0x7fba9814a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:06:24.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.267+0000 7fba96ffd700 1 --2- 172.21.15.45:0/3989879084 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba980b20b0 0x7fba980b7430 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fba8c0011e0 tx=0x7fba8c00ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:24.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.267+0000 7fba7ffff700 1 -- 172.21.15.45:0/3989879084 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba8c004c80 con 0x7fba980b20b0 2023-11-28T12:06:24.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.267+0000 7fba7ffff700 1 -- 172.21.15.45:0/3989879084 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba8c004e00 con 0x7fba980b20b0 2023-11-28T12:06:24.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.267+0000 7fba7ffff700 1 -- 172.21.15.45:0/3989879084 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba8c007310 con 0x7fba980b20b0 2023-11-28T12:06:24.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.267+0000 7fba9e1ff700 1 -- 172.21.15.45:0/3989879084 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba980afec0 con 0x7fba980b20b0 2023-11-28T12:06:24.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.267+0000 7fba9e1ff700 1 -- 172.21.15.45:0/3989879084 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba980afbe0 con 0x7fba980b20b0 2023-11-28T12:06:24.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.269+0000 7fba9e1ff700 1 -- 172.21.15.45:0/3989879084 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba980b2600 con 0x7fba980b20b0 2023-11-28T12:06:24.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.269+0000 7fba7ffff700 1 -- 172.21.15.45:0/3989879084 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 86375+0+0 (secure 0 0 0) 0x7fba8c01a020 con 0x7fba980b20b0 2023-11-28T12:06:24.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.271+0000 7fba7ffff700 1 --2- 172.21.15.45:0/3989879084 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fba840682d0 0x7fba8406a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:24.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.271+0000 7fba7ffff700 1 -- 172.21.15.45:0/3989879084 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fba8c085440 con 0x7fba980b20b0 2023-11-28T12:06:24.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.271+0000 7fba977fe700 1 --2- 172.21.15.45:0/3989879084 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fba840682d0 0x7fba8406a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:24.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.272+0000 7fba977fe700 1 --2- 172.21.15.45:0/3989879084 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fba840682d0 0x7fba8406a780 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fba88000c00 tx=0x7fba8801c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:24.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.276+0000 7fba7ffff700 1 -- 172.21.15.45:0/3989879084 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fba8c051f50 con 0x7fba980b20b0 2023-11-28T12:06:24.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.478+0000 7fba9e1ff700 1 -- 172.21.15.45:0/3989879084 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fba98068690 con 0x7fba980b20b0 2023-11-28T12:06:24.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.478+0000 7fba7ffff700 1 -- 172.21.15.45:0/3989879084 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v15) v1 ==== 92+0+10 (secure 0 0 0) 0x7fba8c055570 con 0x7fba980b20b0 2023-11-28T12:06:24.479 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-11-28T12:06:24.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.480+0000 7fba9e1ff700 1 -- 172.21.15.45:0/3989879084 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fba840682d0 msgr2=0x7fba8406a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:24.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.480+0000 7fba9e1ff700 1 --2- 172.21.15.45:0/3989879084 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fba840682d0 0x7fba8406a780 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fba88000c00 tx=0x7fba8801c040 comp rx=0 tx=0).stop 2023-11-28T12:06:24.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.480+0000 7fba9e1ff700 1 -- 172.21.15.45:0/3989879084 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba980b20b0 msgr2=0x7fba980b7430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:24.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.480+0000 7fba9e1ff700 1 --2- 172.21.15.45:0/3989879084 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba980b20b0 0x7fba980b7430 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fba8c0011e0 tx=0x7fba8c00ca30 comp rx=0 tx=0).stop 2023-11-28T12:06:24.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.480+0000 7fba9e1ff700 1 -- 172.21.15.45:0/3989879084 shutdown_connections 2023-11-28T12:06:24.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.480+0000 7fba9e1ff700 1 --2- 172.21.15.45:0/3989879084 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fba840682d0 0x7fba8406a780 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:24.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.480+0000 7fba9e1ff700 1 --2- 172.21.15.45:0/3989879084 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fba980b16d0 0x7fba9814a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:24.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.480+0000 7fba9e1ff700 1 --2- 172.21.15.45:0/3989879084 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fba980d01b0 0x7fba981e3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:24.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.480+0000 7fba9e1ff700 1 --2- 172.21.15.45:0/3989879084 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba980b20b0 0x7fba980b7430 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:24.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.480+0000 7fba9e1ff700 1 -- 172.21.15.45:0/3989879084 >> 172.21.15.45:0/3989879084 conn(0x7fba9809c3f0 msgr2=0x7fba980cf7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:24.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.480+0000 7fba9e1ff700 1 -- 172.21.15.45:0/3989879084 shutdown_connections 2023-11-28T12:06:24.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.480+0000 7fba9e1ff700 1 -- 172.21.15.45:0/3989879084 wait complete. 2023-11-28T12:06:24.499 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T12:06:24.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.706+0000 7fd80a1ff700 1 Processor -- start 2023-11-28T12:06:24.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.707+0000 7fd80a1ff700 1 -- start start 2023-11-28T12:06:24.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.708+0000 7fd80a1ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fd8040b37b0 0x7fd8040b6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:24.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.708+0000 7fd80a1ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8040cf220 con 0x7fd8040d0ff0 2023-11-28T12:06:24.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.708+0000 7fd80a1ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8040b3e50 con 0x7fd8040b4750 2023-11-28T12:06:24.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.708+0000 7fd80a1ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8040cf470 con 0x7fd8040b37b0 2023-11-28T12:06:24.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.708+0000 7fd8037fe700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fd8040d0ff0 0x7fd8040cff50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:37732/0 (socket says 172.21.15.45:37732) 2023-11-28T12:06:24.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.708+0000 7fd8037fe700 1 -- 172.21.15.45:0/2544187528 learned_addr learned my addr 172.21.15.45:0/2544187528 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:06:24.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.708+0000 7fd803fff700 1 --2- 172.21.15.45:0/2544187528 >> v2:172.21.15.152:3300/0 conn(0x7fd8040b37b0 0x7fd8040b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:24.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.708+0000 7fd8027fc700 1 -- 172.21.15.45:0/2544187528 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3012154118 0 0) 0x7fd8040cf220 con 0x7fd8040d0ff0 2023-11-28T12:06:24.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.709+0000 7fd8027fc700 1 -- 172.21.15.45:0/2544187528 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7ec0035b0 con 0x7fd8040d0ff0 2023-11-28T12:06:24.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.709+0000 7fd803fff700 1 -- 172.21.15.45:0/2544187528 >> v1:172.21.15.152:6789/0 conn(0x7fd8040b4750 legacy=0x7fd8040b30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:24.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.709+0000 7fd8027fc700 1 -- 172.21.15.45:0/2544187528 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1227425635 0 0) 0x7fd8040b3e50 con 0x7fd8040b4750 2023-11-28T12:06:24.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.709+0000 7fd803fff700 1 -- 172.21.15.45:0/2544187528 >> v1:172.21.15.45:6789/0 conn(0x7fd8040d0ff0 legacy=0x7fd8040cff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:24.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.709+0000 7fd803fff700 1 -- 172.21.15.45:0/2544187528 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8040cf750 con 0x7fd8040b37b0 2023-11-28T12:06:24.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.709+0000 7fd803fff700 1 --2- 172.21.15.45:0/2544187528 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd8040b37b0 0x7fd8040b6000 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc009d90 tx=0x7fd7fc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e2d793bfe312d23 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:24.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.709+0000 7fd8027fc700 1 -- 172.21.15.45:0/2544187528 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc00e070 con 0x7fd8040b37b0 2023-11-28T12:06:24.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.709+0000 7fd8027fc700 1 -- 172.21.15.45:0/2544187528 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7fc00bb20 con 0x7fd8040b37b0 2023-11-28T12:06:24.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.709+0000 7fd8027fc700 1 -- 172.21.15.45:0/2544187528 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc00bed0 con 0x7fd8040b37b0 2023-11-28T12:06:24.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.710+0000 7fd80a1ff700 1 -- 172.21.15.45:0/2544187528 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd8040b37b0 msgr2=0x7fd8040b6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:24.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.710+0000 7fd80a1ff700 1 --2- 172.21.15.45:0/2544187528 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd8040b37b0 0x7fd8040b6000 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc009d90 tx=0x7fd7fc00b330 comp rx=0 tx=0).stop 2023-11-28T12:06:24.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.710+0000 7fd80a1ff700 1 -- 172.21.15.45:0/2544187528 shutdown_connections 2023-11-28T12:06:24.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.710+0000 7fd80a1ff700 1 --2- 172.21.15.45:0/2544187528 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd8040b37b0 0x7fd8040b6000 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:24.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.710+0000 7fd80a1ff700 1 -- 172.21.15.45:0/2544187528 >> 172.21.15.45:0/2544187528 conn(0x7fd80409c3c0 msgr2=0x7fd8040d31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:24.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.710+0000 7fd80a1ff700 1 -- 172.21.15.45:0/2544187528 shutdown_connections 2023-11-28T12:06:24.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.710+0000 7fd80a1ff700 1 -- 172.21.15.45:0/2544187528 wait complete. 2023-11-28T12:06:24.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.712+0000 7fd80a1ff700 1 Processor -- start 2023-11-28T12:06:24.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.712+0000 7fd80a1ff700 1 -- start start 2023-11-28T12:06:24.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.713+0000 7fd80a1ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd8040b37b0 0x7fd8040b8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:24.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.713+0000 7fd80a1ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd8040b4750 0x7fd8040b89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:24.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.713+0000 7fd80a1ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd8040d0ff0 0x7fd8041f1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:24.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.713+0000 7fd80a1ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8040b8ee0 con 0x7fd8040b37b0 2023-11-28T12:06:24.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.713+0000 7fd80a1ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd80414f540 con 0x7fd8040d0ff0 2023-11-28T12:06:24.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.713+0000 7fd80a1ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8041e5a50 con 0x7fd8040b4750 2023-11-28T12:06:24.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.713+0000 7fd8037fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd8040b37b0 0x7fd8040b8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:24.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.713+0000 7fd8037fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd8040b37b0 0x7fd8040b8460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46364/0 (socket says 172.21.15.45:46364) 2023-11-28T12:06:24.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.713+0000 7fd8037fe700 1 -- 172.21.15.45:0/3333343778 learned_addr learned my addr 172.21.15.45:0/3333343778 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:24.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.713+0000 7fd803fff700 1 --2- 172.21.15.45:0/3333343778 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd8040d0ff0 0x7fd8041f1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:24.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.713+0000 7fd802ffd700 1 --2- 172.21.15.45:0/3333343778 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd8040b4750 0x7fd8040b89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:24.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.713+0000 7fd8037fe700 1 -- 172.21.15.45:0/3333343778 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd8040b4750 msgr2=0x7fd8040b89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:24.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.713+0000 7fd8037fe700 1 --2- 172.21.15.45:0/3333343778 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd8040b4750 0x7fd8040b89a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:24.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.713+0000 7fd8037fe700 1 -- 172.21.15.45:0/3333343778 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd8040d0ff0 msgr2=0x7fd8041f1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:24.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.713+0000 7fd8037fe700 1 --2- 172.21.15.45:0/3333343778 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd8040d0ff0 0x7fd8041f1680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:24.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.713+0000 7fd8037fe700 1 -- 172.21.15.45:0/3333343778 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7fc009a70 con 0x7fd8040b37b0 2023-11-28T12:06:24.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.713+0000 7fd803fff700 1 --2- 172.21.15.45:0/3333343778 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd8040d0ff0 0x7fd8041f1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:06:24.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.714+0000 7fd8037fe700 1 --2- 172.21.15.45:0/3333343778 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd8040b37b0 0x7fd8040b8460 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd7f400c4d0 tx=0x7fd7f400c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:24.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.714+0000 7fd7ebfff700 1 -- 172.21.15.45:0/3333343778 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f40074e0 con 0x7fd8040b37b0 2023-11-28T12:06:24.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.714+0000 7fd7ebfff700 1 -- 172.21.15.45:0/3333343778 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7f4007660 con 0x7fd8040b37b0 2023-11-28T12:06:24.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.714+0000 7fd80a1ff700 1 -- 172.21.15.45:0/3333343778 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8040d0a50 con 0x7fd8040b37b0 2023-11-28T12:06:24.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.714+0000 7fd7ebfff700 1 -- 172.21.15.45:0/3333343778 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f4005a70 con 0x7fd8040b37b0 2023-11-28T12:06:24.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.714+0000 7fd80a1ff700 1 -- 172.21.15.45:0/3333343778 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8040cfa30 con 0x7fd8040b37b0 2023-11-28T12:06:24.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.715+0000 7fd80a1ff700 1 -- 172.21.15.45:0/3333343778 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8040d13c0 con 0x7fd8040b37b0 2023-11-28T12:06:24.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.716+0000 7fd7ebfff700 1 -- 172.21.15.45:0/3333343778 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 86375+0+0 (secure 0 0 0) 0x7fd7f4019030 con 0x7fd8040b37b0 2023-11-28T12:06:24.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.717+0000 7fd7ebfff700 1 --2- 172.21.15.45:0/3333343778 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fd7f00682a0 0x7fd7f006a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:24.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.717+0000 7fd7ebfff700 1 -- 172.21.15.45:0/3333343778 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fd7f4084c70 con 0x7fd8040b37b0 2023-11-28T12:06:24.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.717+0000 7fd802ffd700 1 --2- 172.21.15.45:0/3333343778 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fd7f00682a0 0x7fd7f006a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:24.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.718+0000 7fd802ffd700 1 --2- 172.21.15.45:0/3333343778 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fd7f00682a0 0x7fd7f006a750 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd7f8007fd0 tx=0x7fd7f8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:24.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.721+0000 7fd7ebfff700 1 -- 172.21.15.45:0/3333343778 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fd7f4051700 con 0x7fd8040b37b0 2023-11-28T12:06:24.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.864+0000 7fd7ebfff700 1 -- 172.21.15.45:0/3333343778 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fd7f4010070 con 0x7fd8040b37b0 2023-11-28T12:06:24.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.926+0000 7fd80a1ff700 1 -- 172.21.15.45:0/3333343778 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd8040745c0 con 0x7fd8040b37b0 2023-11-28T12:06:24.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.926+0000 7fd7ebfff700 1 -- 172.21.15.45:0/3333343778 <== mon.0 v2:172.21.15.45:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd7f40170a0 con 0x7fd8040b37b0 2023-11-28T12:06:24.927 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-11-28T12:06:24.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.928+0000 7fd80a1ff700 1 -- 172.21.15.45:0/3333343778 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fd7f00682a0 msgr2=0x7fd7f006a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:24.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.928+0000 7fd80a1ff700 1 --2- 172.21.15.45:0/3333343778 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fd7f00682a0 0x7fd7f006a750 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd7f8007fd0 tx=0x7fd7f8009040 comp rx=0 tx=0).stop 2023-11-28T12:06:24.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.928+0000 7fd80a1ff700 1 -- 172.21.15.45:0/3333343778 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd8040b37b0 msgr2=0x7fd8040b8460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:24.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.928+0000 7fd80a1ff700 1 --2- 172.21.15.45:0/3333343778 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd8040b37b0 0x7fd8040b8460 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd7f400c4d0 tx=0x7fd7f400c7e0 comp rx=0 tx=0).stop 2023-11-28T12:06:24.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.928+0000 7fd80a1ff700 1 -- 172.21.15.45:0/3333343778 shutdown_connections 2023-11-28T12:06:24.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.928+0000 7fd80a1ff700 1 --2- 172.21.15.45:0/3333343778 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fd7f00682a0 0x7fd7f006a750 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:24.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.928+0000 7fd80a1ff700 1 --2- 172.21.15.45:0/3333343778 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd8040d0ff0 0x7fd8041f1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:24.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.929+0000 7fd80a1ff700 1 --2- 172.21.15.45:0/3333343778 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd8040b37b0 0x7fd8040b8460 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:24.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.929+0000 7fd80a1ff700 1 --2- 172.21.15.45:0/3333343778 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd8040b4750 0x7fd8040b89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:24.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.929+0000 7fd80a1ff700 1 -- 172.21.15.45:0/3333343778 >> 172.21.15.45:0/3333343778 conn(0x7fd80409c3c0 msgr2=0x7fd80406b810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:24.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.929+0000 7fd80a1ff700 1 -- 172.21.15.45:0/3333343778 shutdown_connections 2023-11-28T12:06:24.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:24.929+0000 7fd80a1ff700 1 -- 172.21.15.45:0/3333343778 wait complete. 2023-11-28T12:06:24.947 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T12:06:25.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.152+0000 7f17017ff700 1 Processor -- start 2023-11-28T12:06:25.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.152+0000 7f17017ff700 1 -- start start 2023-11-28T12:06:25.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.154+0000 7f17017ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f16fc0d01b0 0x7f16fc0d0c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:25.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.154+0000 7f17017ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16fc0b0230 con 0x7f16fc0b16d0 2023-11-28T12:06:25.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.154+0000 7f17017ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16fc0b37d0 con 0x7f16fc0b20b0 2023-11-28T12:06:25.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.154+0000 7f17017ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16fc15cec0 con 0x7f16fc0d01b0 2023-11-28T12:06:25.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.154+0000 7f16fa7fc700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f16fc0b20b0 0x7f16fc0b29b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.45:59702/0 (socket says 172.21.15.45:59702) 2023-11-28T12:06:25.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.154+0000 7f16fa7fc700 1 -- 172.21.15.45:0/3906125549 learned_addr learned my addr 172.21.15.45:0/3906125549 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:06:25.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.155+0000 7f16faffd700 1 --2- 172.21.15.45:0/3906125549 >> v2:172.21.15.45:3300/0 conn(0x7f16fc0d01b0 0x7f16fc0d0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:25.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.155+0000 7f16f9ffb700 1 -- 172.21.15.45:0/3906125549 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2083109939 0 0) 0x7f16fc0b37d0 con 0x7f16fc0b20b0 2023-11-28T12:06:25.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.155+0000 7f16f9ffb700 1 -- 172.21.15.45:0/3906125549 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16e40035b0 con 0x7f16fc0b20b0 2023-11-28T12:06:25.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.155+0000 7f16f9ffb700 1 -- 172.21.15.45:0/3906125549 <== mon.1 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2891210717 0 0) 0x7f16e40035b0 con 0x7f16fc0b20b0 2023-11-28T12:06:25.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.155+0000 7f16f9ffb700 1 -- 172.21.15.45:0/3906125549 >> v2:172.21.15.45:3300/0 conn(0x7f16fc0d01b0 msgr2=0x7f16fc0d0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:06:25.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.155+0000 7f16f9ffb700 1 --2- 172.21.15.45:0/3906125549 >> v2:172.21.15.45:3300/0 conn(0x7f16fc0d01b0 0x7f16fc0d0c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:25.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.155+0000 7f16f9ffb700 1 -- 172.21.15.45:0/3906125549 >> v1:172.21.15.45:6789/0 conn(0x7f16fc0b16d0 legacy=0x7f16fc0b30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:25.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.155+0000 7f16f9ffb700 1 -- 172.21.15.45:0/3906125549 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16fc0b4570 con 0x7f16fc0b20b0 2023-11-28T12:06:25.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.156+0000 7f16f9ffb700 1 -- 172.21.15.45:0/3906125549 <== mon.1 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3460218165 0 0) 0x7f16f0001670 con 0x7f16fc0b20b0 2023-11-28T12:06:25.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.156+0000 7f16f9ffb700 1 -- 172.21.15.45:0/3906125549 >> v1:172.21.15.152:6789/0 conn(0x7f16fc0b20b0 legacy=0x7f16fc0b29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:25.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.156+0000 7f16f9ffb700 1 --2- 172.21.15.45:0/3906125549 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16e4003a50 0x7f16e4003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:25.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.156+0000 7f16f9ffb700 1 --2- 172.21.15.45:0/3906125549 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f16e4004850 0x7f16e4004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:25.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.156+0000 7f16f9ffb700 1 --2- 172.21.15.45:0/3906125549 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f16e4005200 0x7f16e400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:25.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.156+0000 7f16f9ffb700 1 -- 172.21.15.45:0/3906125549 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16fc15cec0 con 0x7f16e4003a50 2023-11-28T12:06:25.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.156+0000 7f16f9ffb700 1 -- 172.21.15.45:0/3906125549 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16e400c0e0 con 0x7f16e4004850 2023-11-28T12:06:25.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.156+0000 7f16f9ffb700 1 -- 172.21.15.45:0/3906125549 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16e400c2a0 con 0x7f16e4005200 2023-11-28T12:06:25.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.156+0000 7f16faffd700 1 --2- 172.21.15.45:0/3906125549 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16e4003a50 0x7f16e4003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:25.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.156+0000 7f16fb7fe700 1 --2- 172.21.15.45:0/3906125549 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f16e4005200 0x7f16e400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:25.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.156+0000 7f16fa7fc700 1 --2- 172.21.15.45:0/3906125549 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f16e4004850 0x7f16e4004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:25.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.156+0000 7f16fb7fe700 1 -- 172.21.15.45:0/3906125549 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f16e4004850 msgr2=0x7f16e4004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:06:25.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.156+0000 7f16fb7fe700 1 --2- 172.21.15.45:0/3906125549 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f16e4004850 0x7f16e4004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:25.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.156+0000 7f16fb7fe700 1 -- 172.21.15.45:0/3906125549 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16e4003a50 msgr2=0x7f16e4003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:06:25.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.156+0000 7f16fb7fe700 1 --2- 172.21.15.45:0/3906125549 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16e4003a50 0x7f16e4003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:25.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.156+0000 7f16fb7fe700 1 -- 172.21.15.45:0/3906125549 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16e40035b0 con 0x7f16e4005200 2023-11-28T12:06:25.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.157+0000 7f16fb7fe700 1 -- 172.21.15.45:0/3906125549 reap_dead start 2023-11-28T12:06:25.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.157+0000 7f16fb7fe700 1 --2- 172.21.15.45:0/3906125549 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f16e4005200 0x7f16e400ba10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f16f400c190 tx=0x7f16e4005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58626e3ceade75e4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:25.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.157+0000 7f16f9ffb700 1 -- 172.21.15.45:0/3906125549 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f4001db0 con 0x7f16e4005200 2023-11-28T12:06:25.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.157+0000 7f16f9ffb700 1 -- 172.21.15.45:0/3906125549 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16f400cc90 con 0x7f16e4005200 2023-11-28T12:06:25.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.157+0000 7f16f9ffb700 1 -- 172.21.15.45:0/3906125549 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f4003a00 con 0x7f16e4005200 2023-11-28T12:06:25.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.158+0000 7f17017ff700 1 -- 172.21.15.45:0/3906125549 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f16e4005200 msgr2=0x7f16e400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:25.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.158+0000 7f17017ff700 1 --2- 172.21.15.45:0/3906125549 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f16e4005200 0x7f16e400ba10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f16f400c190 tx=0x7f16e4005880 comp rx=0 tx=0).stop 2023-11-28T12:06:25.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.158+0000 7f17017ff700 1 -- 172.21.15.45:0/3906125549 shutdown_connections 2023-11-28T12:06:25.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.158+0000 7f17017ff700 1 --2- 172.21.15.45:0/3906125549 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f16e4005200 0x7f16e400ba10 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:25.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.158+0000 7f17017ff700 1 -- 172.21.15.45:0/3906125549 >> 172.21.15.45:0/3906125549 conn(0x7f16fc09c3f0 msgr2=0x7f16fc0d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:25.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.158+0000 7f17017ff700 1 -- 172.21.15.45:0/3906125549 shutdown_connections 2023-11-28T12:06:25.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.158+0000 7f17017ff700 1 -- 172.21.15.45:0/3906125549 wait complete. 2023-11-28T12:06:25.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.160+0000 7f17017ff700 1 Processor -- start 2023-11-28T12:06:25.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.160+0000 7f17017ff700 1 -- start start 2023-11-28T12:06:25.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.161+0000 7f17017ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f16e4005200 0x7f16fc1f6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:25.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.161+0000 7f17017ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f16fc15b680 0x7f16fc15baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:25.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.161+0000 7f17017ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16fc0b7380 0x7f16fc0b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:25.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.161+0000 7f17017ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16fc1f6840 con 0x7f16fc0b7380 2023-11-28T12:06:25.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.161+0000 7f17017ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16fc15c030 con 0x7f16fc15b680 2023-11-28T12:06:25.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.161+0000 7f17017ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16fc0b8170 con 0x7f16e4005200 2023-11-28T12:06:25.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.161+0000 7f16fb7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16fc0b7380 0x7f16fc0b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:25.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.161+0000 7f16fb7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16fc0b7380 0x7f16fc0b77f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46404/0 (socket says 172.21.15.45:46404) 2023-11-28T12:06:25.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.161+0000 7f16fb7fe700 1 -- 172.21.15.45:0/4073155644 learned_addr learned my addr 172.21.15.45:0/4073155644 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:25.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.162+0000 7f16fa7fc700 1 --2- 172.21.15.45:0/4073155644 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f16fc15b680 0x7f16fc15baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:25.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.162+0000 7f16faffd700 1 --2- 172.21.15.45:0/4073155644 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f16e4005200 0x7f16fc1f6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:25.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.162+0000 7f16fa7fc700 1 -- 172.21.15.45:0/4073155644 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f16e4005200 msgr2=0x7f16fc1f6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:25.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.162+0000 7f16fa7fc700 1 --2- 172.21.15.45:0/4073155644 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f16e4005200 0x7f16fc1f6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:25.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.162+0000 7f16fa7fc700 1 -- 172.21.15.45:0/4073155644 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16fc0b7380 msgr2=0x7f16fc0b77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:25.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.162+0000 7f16fa7fc700 1 --2- 172.21.15.45:0/4073155644 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16fc0b7380 0x7f16fc0b77f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:25.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.162+0000 7f16fa7fc700 1 -- 172.21.15.45:0/4073155644 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16fc0afbe0 con 0x7f16fc15b680 2023-11-28T12:06:25.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.162+0000 7f16fb7fe700 1 --2- 172.21.15.45:0/4073155644 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16fc0b7380 0x7f16fc0b77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:06:25.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.162+0000 7f16fa7fc700 1 --2- 172.21.15.45:0/4073155644 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f16fc15b680 0x7f16fc15baf0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f16f0007fd0 tx=0x7f16f0007340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:25.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.163+0000 7f16e37fe700 1 -- 172.21.15.45:0/4073155644 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f0012560 con 0x7f16fc15b680 2023-11-28T12:06:25.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.163+0000 7f16e37fe700 1 -- 172.21.15.45:0/4073155644 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16f00126e0 con 0x7f16fc15b680 2023-11-28T12:06:25.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.163+0000 7f17017ff700 1 -- 172.21.15.45:0/4073155644 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16fc0b4850 con 0x7f16fc15b680 2023-11-28T12:06:25.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.163+0000 7f16e37fe700 1 -- 172.21.15.45:0/4073155644 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f0012a90 con 0x7f16fc15b680 2023-11-28T12:06:25.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.163+0000 7f17017ff700 1 -- 172.21.15.45:0/4073155644 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16fc0afec0 con 0x7f16fc15b680 2023-11-28T12:06:25.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.164+0000 7f17017ff700 1 -- 172.21.15.45:0/4073155644 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16fc0c6a40 con 0x7f16fc15b680 2023-11-28T12:06:25.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.165+0000 7f16e37fe700 1 -- 172.21.15.45:0/4073155644 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f16f0012bf0 con 0x7f16fc15b680 2023-11-28T12:06:25.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.166+0000 7f16e37fe700 1 --2- 172.21.15.45:0/4073155644 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f16e80682f0 0x7f16e806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:25.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.166+0000 7f16e37fe700 1 -- 172.21.15.45:0/4073155644 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f16f00859c0 con 0x7f16fc15b680 2023-11-28T12:06:25.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.166+0000 7f16faffd700 1 --2- 172.21.15.45:0/4073155644 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f16e80682f0 0x7f16e806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:25.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.167+0000 7f16faffd700 1 --2- 172.21.15.45:0/4073155644 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f16e80682f0 0x7f16e806a7a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f16ec009be0 tx=0x7f16ec009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:25.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.171+0000 7f16e37fe700 1 -- 172.21.15.45:0/4073155644 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f16fc0c6a40 con 0x7f16fc15b680 2023-11-28T12:06:25.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.416+0000 7f17017ff700 1 -- 172.21.15.45:0/4073155644 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f16fc068690 con 0x7f16fc15b680 2023-11-28T12:06:25.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.417+0000 7f16e37fe700 1 -- 172.21.15.45:0/4073155644 <== mon.1 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3530 (secure 0 0 0) 0x7f16f0052480 con 0x7f16fc15b680 2023-11-28T12:06:25.417 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:06:25.417 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1163718907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6835","nonce":1163718907},{"type":"v1","addr":"172.21.15.152:6837","nonce":1163718907}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4282,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/2292614522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":2292614522},{"type":"v1","addr":"172.21.15.45:6834","nonce":2292614522}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4285,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/3920917053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":3920917053},{"type":"v1","addr":"172.21.15.45:6835","nonce":3920917053}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6836/3624153928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":3624153928},{"type":"v1","addr":"172.21.15.152:6836","nonce":3624153928}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-11-28T12:06:25.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.419+0000 7f17017ff700 1 -- 172.21.15.45:0/4073155644 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f16e80682f0 msgr2=0x7f16e806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:25.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.419+0000 7f17017ff700 1 --2- 172.21.15.45:0/4073155644 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f16e80682f0 0x7f16e806a7a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f16ec009be0 tx=0x7f16ec009210 comp rx=0 tx=0).stop 2023-11-28T12:06:25.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.419+0000 7f17017ff700 1 -- 172.21.15.45:0/4073155644 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f16fc15b680 msgr2=0x7f16fc15baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:25.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.419+0000 7f17017ff700 1 --2- 172.21.15.45:0/4073155644 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f16fc15b680 0x7f16fc15baf0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f16f0007fd0 tx=0x7f16f0007340 comp rx=0 tx=0).stop 2023-11-28T12:06:25.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.419+0000 7f17017ff700 1 -- 172.21.15.45:0/4073155644 shutdown_connections 2023-11-28T12:06:25.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.419+0000 7f17017ff700 1 --2- 172.21.15.45:0/4073155644 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f16e80682f0 0x7f16e806a7a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:25.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.419+0000 7f17017ff700 1 --2- 172.21.15.45:0/4073155644 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16fc0b7380 0x7f16fc0b77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:25.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.419+0000 7f17017ff700 1 --2- 172.21.15.45:0/4073155644 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f16e4005200 0x7f16fc1f6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:25.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.419+0000 7f17017ff700 1 --2- 172.21.15.45:0/4073155644 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f16fc15b680 0x7f16fc15baf0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:25.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.419+0000 7f17017ff700 1 -- 172.21.15.45:0/4073155644 >> 172.21.15.45:0/4073155644 conn(0x7f16fc09c3f0 msgr2=0x7f16fc0d2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:25.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.419+0000 7f17017ff700 1 -- 172.21.15.45:0/4073155644 shutdown_connections 2023-11-28T12:06:25.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.419+0000 7f17017ff700 1 -- 172.21.15.45:0/4073155644 wait complete. 2023-11-28T12:06:25.421 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 3 2023-11-28T12:06:25.438 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T12:06:25.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.642+0000 7fdf199ff700 1 Processor -- start 2023-11-28T12:06:25.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.642+0000 7fdf199ff700 1 -- start start 2023-11-28T12:06:25.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.643+0000 7fdf199ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fdf140d0ff0 0x7fdf140cff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:25.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.643+0000 7fdf199ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fdf140b4750 0x7fdf140b30a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:25.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.644+0000 7fdf199ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdf140d13c0 0x7fdf140b35e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:25.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.644+0000 7fdf199ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf140b3b20 con 0x7fdf140d0ff0 2023-11-28T12:06:25.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.644+0000 7fdf199ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf140cf220 con 0x7fdf140b4750 2023-11-28T12:06:25.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.644+0000 7fdf199ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf140b3e50 con 0x7fdf140d13c0 2023-11-28T12:06:25.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.644+0000 7fdf12ffd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fdf140d0ff0 0x7fdf140cff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:25.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.644+0000 7fdf12ffd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fdf140d0ff0 0x7fdf140cff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46420/0 (socket says 172.21.15.45:46420) 2023-11-28T12:06:25.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.644+0000 7fdf12ffd700 1 -- 172.21.15.45:0/483556090 learned_addr learned my addr 172.21.15.45:0/483556090 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:25.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.644+0000 7fdf127fc700 1 --2- 172.21.15.45:0/483556090 >> v2:172.21.15.152:3300/0 conn(0x7fdf140b4750 0x7fdf140b30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:25.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.644+0000 7fdf137fe700 1 --2- 172.21.15.45:0/483556090 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdf140d13c0 0x7fdf140b35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:25.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.644+0000 7fdf12ffd700 1 -- 172.21.15.45:0/483556090 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdf140d13c0 msgr2=0x7fdf140b35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:06:25.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.644+0000 7fdf12ffd700 1 --2- 172.21.15.45:0/483556090 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdf140d13c0 0x7fdf140b35e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:25.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.644+0000 7fdf12ffd700 1 -- 172.21.15.45:0/483556090 >> v2:172.21.15.152:3300/0 conn(0x7fdf140b4750 msgr2=0x7fdf140b30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:06:25.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.644+0000 7fdf12ffd700 1 --2- 172.21.15.45:0/483556090 >> v2:172.21.15.152:3300/0 conn(0x7fdf140b4750 0x7fdf140b30a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:25.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.644+0000 7fdf12ffd700 1 -- 172.21.15.45:0/483556090 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf140cf470 con 0x7fdf140d0ff0 2023-11-28T12:06:25.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.645+0000 7fdf12ffd700 1 --2- 172.21.15.45:0/483556090 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf140d0ff0 0x7fdf140cff50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fdf1408d340 tx=0x7fdf04009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f0400f003a47d6f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:25.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.645+0000 7fdf11ffb700 1 -- 172.21.15.45:0/483556090 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf04005e30 con 0x7fdf140d0ff0 2023-11-28T12:06:25.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.645+0000 7fdf11ffb700 1 -- 172.21.15.45:0/483556090 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf04004030 con 0x7fdf140d0ff0 2023-11-28T12:06:25.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.645+0000 7fdf11ffb700 1 -- 172.21.15.45:0/483556090 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf040043e0 con 0x7fdf140d0ff0 2023-11-28T12:06:25.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.645+0000 7fdf199ff700 1 -- 172.21.15.45:0/483556090 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf140d0ff0 msgr2=0x7fdf140cff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:25.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.645+0000 7fdf199ff700 1 --2- 172.21.15.45:0/483556090 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf140d0ff0 0x7fdf140cff50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fdf1408d340 tx=0x7fdf04009bd0 comp rx=0 tx=0).stop 2023-11-28T12:06:25.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.645+0000 7fdf199ff700 1 -- 172.21.15.45:0/483556090 shutdown_connections 2023-11-28T12:06:25.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.645+0000 7fdf199ff700 1 --2- 172.21.15.45:0/483556090 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdf140d13c0 0x7fdf140b35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:25.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.645+0000 7fdf199ff700 1 --2- 172.21.15.45:0/483556090 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf140d0ff0 0x7fdf140cff50 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:25.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.645+0000 7fdf199ff700 1 --2- 172.21.15.45:0/483556090 >> v2:172.21.15.152:3300/0 conn(0x7fdf140b4750 0x7fdf140b30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:25.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.645+0000 7fdf199ff700 1 -- 172.21.15.45:0/483556090 >> 172.21.15.45:0/483556090 conn(0x7fdf1409c3c0 msgr2=0x7fdf140d31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:25.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.646+0000 7fdf199ff700 1 -- 172.21.15.45:0/483556090 shutdown_connections 2023-11-28T12:06:25.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.646+0000 7fdf199ff700 1 -- 172.21.15.45:0/483556090 wait complete. 2023-11-28T12:06:25.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.647+0000 7fdf199ff700 1 Processor -- start 2023-11-28T12:06:25.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.647+0000 7fdf199ff700 1 -- start start 2023-11-28T12:06:25.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.648+0000 7fdf199ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf140b4750 0x7fdf141e4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:25.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.648+0000 7fdf199ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdf140d0ff0 0x7fdf1415c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:25.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.648+0000 7fdf199ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf140d13c0 0x7fdf1415c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:25.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.648+0000 7fdf199ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf141e52d0 con 0x7fdf140b4750 2023-11-28T12:06:25.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.648+0000 7fdf199ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf141e5d80 con 0x7fdf140d13c0 2023-11-28T12:06:25.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.648+0000 7fdf199ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf141e54e0 con 0x7fdf140d0ff0 2023-11-28T12:06:25.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.649+0000 7fdf12ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf140b4750 0x7fdf141e4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:25.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.649+0000 7fdf127fc700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdf140d0ff0 0x7fdf1415c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:25.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.649+0000 7fdf137fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf140d13c0 0x7fdf1415c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:25.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.649+0000 7fdf127fc700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdf140d0ff0 0x7fdf1415c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.45:52440/0 (socket says 172.21.15.45:52440) 2023-11-28T12:06:25.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.649+0000 7fdf127fc700 1 -- 172.21.15.45:0/1444418635 learned_addr learned my addr 172.21.15.45:0/1444418635 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:25.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.649+0000 7fdf127fc700 1 -- 172.21.15.45:0/1444418635 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf140d13c0 msgr2=0x7fdf1415c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:25.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.649+0000 7fdf127fc700 1 --2- 172.21.15.45:0/1444418635 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf140d13c0 0x7fdf1415c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:25.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.649+0000 7fdf127fc700 1 -- 172.21.15.45:0/1444418635 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf140b4750 msgr2=0x7fdf141e4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:25.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.649+0000 7fdf127fc700 1 --2- 172.21.15.45:0/1444418635 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf140b4750 0x7fdf141e4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:25.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.649+0000 7fdf127fc700 1 -- 172.21.15.45:0/1444418635 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf04009500 con 0x7fdf140d0ff0 2023-11-28T12:06:25.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.649+0000 7fdf127fc700 1 --2- 172.21.15.45:0/1444418635 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdf140d0ff0 0x7fdf1415c340 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fdf0800e840 tx=0x7fdf0800eb50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:25.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.650+0000 7fdefbfff700 1 -- 172.21.15.45:0/1444418635 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf08013680 con 0x7fdf140d0ff0 2023-11-28T12:06:25.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.650+0000 7fdefbfff700 1 -- 172.21.15.45:0/1444418635 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf080137e0 con 0x7fdf140d0ff0 2023-11-28T12:06:25.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.650+0000 7fdefbfff700 1 -- 172.21.15.45:0/1444418635 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf08013b70 con 0x7fdf140d0ff0 2023-11-28T12:06:25.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.650+0000 7fdf199ff700 1 -- 172.21.15.45:0/1444418635 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf140cfa30 con 0x7fdf140d0ff0 2023-11-28T12:06:25.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.650+0000 7fdf199ff700 1 -- 172.21.15.45:0/1444418635 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf140cf750 con 0x7fdf140d0ff0 2023-11-28T12:06:25.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.651+0000 7fdf199ff700 1 -- 172.21.15.45:0/1444418635 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf140d0a50 con 0x7fdf140d0ff0 2023-11-28T12:06:25.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.652+0000 7fdefbfff700 1 -- 172.21.15.45:0/1444418635 <== mon.2 v2:172.21.15.152:3301/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fdf08019030 con 0x7fdf140d0ff0 2023-11-28T12:06:25.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.653+0000 7fdefbfff700 1 --2- 172.21.15.45:0/1444418635 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fdf00068320 0x7fdf0006a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:25.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.653+0000 7fdefbfff700 1 -- 172.21.15.45:0/1444418635 <== mon.2 v2:172.21.15.152:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fdf08085e30 con 0x7fdf140d0ff0 2023-11-28T12:06:25.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.653+0000 7fdf12ffd700 1 --2- 172.21.15.45:0/1444418635 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fdf00068320 0x7fdf0006a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:25.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.654+0000 7fdf12ffd700 1 --2- 172.21.15.45:0/1444418635 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fdf00068320 0x7fdf0006a7d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fdf04000c00 tx=0x7fdf04008070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:25.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.657+0000 7fdefbfff700 1 -- 172.21.15.45:0/1444418635 <== mon.2 v2:172.21.15.152:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fdf080528e0 con 0x7fdf140d0ff0 2023-11-28T12:06:25.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.859+0000 7fdf199ff700 1 -- 172.21.15.45:0/1444418635 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdf140745c0 con 0x7fdf140d0ff0 2023-11-28T12:06:25.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.860+0000 7fdefbfff700 1 -- 172.21.15.45:0/1444418635 <== mon.2 v2:172.21.15.152:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+14207 (secure 0 0 0) 0x7fdf08021090 con 0x7fdf140d0ff0 2023-11-28T12:06:25.861 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:06:25.861 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":16,"fsid":"bd7c37f1-f7c6-4778-b845-52cf2aa6e366","created":"2023-11-28T12:06:09.045075+0000","modified":"2023-11-28T12:06:24.504602+0000","last_up_change":"2023-11-28T12:06:21.282227+0000","last_in_change":"2023-11-28T12:06:12.560924+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T12:06:21.807108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T12:06:22.491009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d0cdd8a-87fd-4f2c-91bd-47bdfa661905","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":115843},{"type":"v1","addr":"172.21.15.45:6808","nonce":115843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":115843},{"type":"v1","addr":"172.21.15.45:6811","nonce":115843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":115843},{"type":"v1","addr":"172.21.15.45:6815","nonce":115843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":115843},{"type":"v1","addr":"172.21.15.45:6813","nonce":115843}]},"public_addr":"172.21.15.45:6808/115843","cluster_addr":"172.21.15.45:6811/115843","heartbeat_back_addr":"172.21.15.45:6815/115843","heartbeat_front_addr":"172.21.15.45:6813/115843","state":["exists","up"]},{"osd":1,"uuid":"c5de4ebd-9ec5-40b3-9caa-9b706fab4c76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":115842},{"type":"v1","addr":"172.21.15.45:6801","nonce":115842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":115842},{"type":"v1","addr":"172.21.15.45:6803","nonce":115842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6807","nonce":115842},{"type":"v1","addr":"172.21.15.45:6809","nonce":115842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":115842},{"type":"v1","addr":"172.21.15.45:6805","nonce":115842}]},"public_addr":"172.21.15.45:6801/115842","cluster_addr":"172.21.15.45:6803/115842","heartbeat_back_addr":"172.21.15.45:6809/115842","heartbeat_front_addr":"172.21.15.45:6805/115842","state":["exists","up"]},{"osd":2,"uuid":"9f4b36b2-65d2-40e7-9fe6-a2991afa71c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":115850},{"type":"v1","addr":"172.21.15.45:6819","nonce":115850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":115850},{"type":"v1","addr":"172.21.15.45:6823","nonce":115850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":115850},{"type":"v1","addr":"172.21.15.45:6831","nonce":115850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":115850},{"type":"v1","addr":"172.21.15.45:6828","nonce":115850}]},"public_addr":"172.21.15.45:6819/115850","cluster_addr":"172.21.15.45:6823/115850","heartbeat_back_addr":"172.21.15.45:6831/115850","heartbeat_front_addr":"172.21.15.45:6828/115850","state":["exists","up"]},{"osd":3,"uuid":"6fe7ef05-4e0d-426c-bf94-44b51d4d550b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":115848},{"type":"v1","addr":"172.21.15.45:6818","nonce":115848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":115848},{"type":"v1","addr":"172.21.15.45:6822","nonce":115848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6827","nonce":115848},{"type":"v1","addr":"172.21.15.45:6829","nonce":115848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":115848},{"type":"v1","addr":"172.21.15.45:6825","nonce":115848}]},"public_addr":"172.21.15.45:6818/115848","cluster_addr":"172.21.15.45:6822/115848","heartbeat_back_addr":"172.21.15.45:6829/115848","heartbeat_front_addr":"172.21.15.45:6825/115848","state":["exists","up"]},{"osd":4,"uuid":"fa403c08-d8a1-4a3a-8384-cb465c1a654c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":116092},{"type":"v1","addr":"172.21.15.152:6801","nonce":116092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":116092},{"type":"v1","addr":"172.21.15.152:6803","nonce":116092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":116092},{"type":"v1","addr":"172.21.15.152:6807","nonce":116092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":116092},{"type":"v1","addr":"172.21.15.152:6805","nonce":116092}]},"public_addr":"172.21.15.152:6801/116092","cluster_addr":"172.21.15.152:6803/116092","heartbeat_back_addr":"172.21.15.152:6807/116092","heartbeat_front_addr":"172.21.15.152:6805/116092","state":["exists","up"]},{"osd":5,"uuid":"399fc450-39fa-43a6-bf80-0b8bcb41bd95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6815","nonce":116093},{"type":"v1","addr":"172.21.15.152:6817","nonce":116093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":116093},{"type":"v1","addr":"172.21.15.152:6819","nonce":116093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":116093},{"type":"v1","addr":"172.21.15.152:6823","nonce":116093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":116093},{"type":"v1","addr":"172.21.15.152:6821","nonce":116093}]},"public_addr":"172.21.15.152:6817/116093","cluster_addr":"172.21.15.152:6819/116093","heartbeat_back_addr":"172.21.15.152:6823/116093","heartbeat_front_addr":"172.21.15.152:6821/116093","state":["exists","up"]},{"osd":6,"uuid":"e59a4017-2d23-4627-836b-e25b2d3ddaaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":116094},{"type":"v1","addr":"172.21.15.152:6809","nonce":116094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":116094},{"type":"v1","addr":"172.21.15.152:6811","nonce":116094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":116094},{"type":"v1","addr":"172.21.15.152:6816","nonce":116094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":116094},{"type":"v1","addr":"172.21.15.152:6813","nonce":116094}]},"public_addr":"172.21.15.152:6809/116094","cluster_addr":"172.21.15.152:6811/116094","heartbeat_back_addr":"172.21.15.152:6816/116094","heartbeat_front_addr":"172.21.15.152:6813/116094","state":["exists","up"]},{"osd":7,"uuid":"8d7f9d4b-bf08-4670-8591-388c0f012a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":116097},{"type":"v1","addr":"172.21.15.152:6825","nonce":116097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":116097},{"type":"v1","addr":"172.21.15.152:6827","nonce":116097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":116097},{"type":"v1","addr":"172.21.15.152:6831","nonce":116097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":116097},{"type":"v1","addr":"172.21.15.152:6829","nonce":116097}]},"public_addr":"172.21.15.152:6825/116097","cluster_addr":"172.21.15.152:6827/116097","heartbeat_back_addr":"172.21.15.152:6831/116097","heartbeat_front_addr":"172.21.15.152:6829/116097","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.937710+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.865423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.159434+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.913090+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.131647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.966255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.972583+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.177209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T12:06:25.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.863+0000 7fdf199ff700 1 -- 172.21.15.45:0/1444418635 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fdf00068320 msgr2=0x7fdf0006a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:25.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.863+0000 7fdf199ff700 1 --2- 172.21.15.45:0/1444418635 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fdf00068320 0x7fdf0006a7d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fdf04000c00 tx=0x7fdf04008070 comp rx=0 tx=0).stop 2023-11-28T12:06:25.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.863+0000 7fdf199ff700 1 -- 172.21.15.45:0/1444418635 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdf140d0ff0 msgr2=0x7fdf1415c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:25.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.863+0000 7fdf199ff700 1 --2- 172.21.15.45:0/1444418635 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdf140d0ff0 0x7fdf1415c340 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fdf0800e840 tx=0x7fdf0800eb50 comp rx=0 tx=0).stop 2023-11-28T12:06:25.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.863+0000 7fdf199ff700 1 -- 172.21.15.45:0/1444418635 shutdown_connections 2023-11-28T12:06:25.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.863+0000 7fdf199ff700 1 --2- 172.21.15.45:0/1444418635 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fdf00068320 0x7fdf0006a7d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:25.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.863+0000 7fdf199ff700 1 --2- 172.21.15.45:0/1444418635 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf140d13c0 0x7fdf1415c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:25.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.863+0000 7fdf199ff700 1 --2- 172.21.15.45:0/1444418635 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf140b4750 0x7fdf141e4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:25.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.863+0000 7fdf199ff700 1 --2- 172.21.15.45:0/1444418635 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdf140d0ff0 0x7fdf1415c340 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:25.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.863+0000 7fdf199ff700 1 -- 172.21.15.45:0/1444418635 >> 172.21.15.45:0/1444418635 conn(0x7fdf1409c3c0 msgr2=0x7fdf140d31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:25.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.863+0000 7fdf199ff700 1 -- 172.21.15.45:0/1444418635 shutdown_connections 2023-11-28T12:06:25.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:25.863+0000 7fdf199ff700 1 -- 172.21.15.45:0/1444418635 wait complete. 2023-11-28T12:06:25.882 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-28T12:06:21.807108+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-28T12:06:22.491009+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T12:06:25.882 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T12:06:26.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.087+0000 7f36bffff700 1 Processor -- start 2023-11-28T12:06:26.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.087+0000 7f36bffff700 1 -- start start 2023-11-28T12:06:26.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.088+0000 7f36bffff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f36b8159490 0x7f36b80b0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:26.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.088+0000 7f36bffff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f36b8159860 0x7f36b80b0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:26.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.088+0000 7f36bffff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36b80ccc00 con 0x7f36b80cdc80 2023-11-28T12:06:26.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.088+0000 7f36bffff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36b80ccec0 con 0x7f36b8159490 2023-11-28T12:06:26.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.088+0000 7f36bffff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36b80cd1a0 con 0x7f36b8159860 2023-11-28T12:06:26.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.089+0000 7f36bd59a700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f36b8159860 0x7f36b80b0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:26.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.089+0000 7f36bdd9b700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f36b8159490 0x7f36b80b0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:26.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.089+0000 7f36bd59a700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f36b8159860 0x7f36b80b0bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.45:52450/0 (socket says 172.21.15.45:52450) 2023-11-28T12:06:26.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.089+0000 7f36bdd9b700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f36b8159490 0x7f36b80b0670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.45:43016/0 (socket says 172.21.15.45:43016) 2023-11-28T12:06:26.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.089+0000 7f36bd59a700 1 -- 172.21.15.45:0/2142558196 learned_addr learned my addr 172.21.15.45:0/2142558196 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:26.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.089+0000 7f36be59c700 1 --1- 172.21.15.45:0/2142558196 >> v1:172.21.15.152:6789/0 conn(0x7f36b80cdc80 0x7f36b80c94c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.45:59704/0 (socket says 172.21.15.45:59704) 2023-11-28T12:06:26.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.089+0000 7f36bdd9b700 1 -- 172.21.15.45:0/2142558196 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f36b8159860 msgr2=0x7f36b80b0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:06:26.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.089+0000 7f36bdd9b700 1 --2- 172.21.15.45:0/2142558196 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f36b8159860 0x7f36b80b0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:26.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.089+0000 7f36bdd9b700 1 -- 172.21.15.45:0/2142558196 >> v1:172.21.15.152:6789/0 conn(0x7f36b80cdc80 legacy=0x7f36b80c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:26.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.089+0000 7f36bdd9b700 1 -- 172.21.15.45:0/2142558196 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36b80cd480 con 0x7f36b8159490 2023-11-28T12:06:26.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.089+0000 7f36bdd9b700 1 --2- 172.21.15.45:0/2142558196 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36b8159490 0x7f36b80b0670 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f36b4009870 tx=0x7f36b4009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d9b4de4c7c175b0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:26.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.090+0000 7f36bcd99700 1 -- 172.21.15.45:0/2142558196 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b4011830 con 0x7f36b8159490 2023-11-28T12:06:26.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.090+0000 7f36bcd99700 1 -- 172.21.15.45:0/2142558196 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36b4011990 con 0x7f36b8159490 2023-11-28T12:06:26.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.090+0000 7f36bcd99700 1 -- 172.21.15.45:0/2142558196 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b4011d20 con 0x7f36b8159490 2023-11-28T12:06:26.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.090+0000 7f36bffff700 1 -- 172.21.15.45:0/2142558196 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36b8159490 msgr2=0x7f36b80b0670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:26.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.090+0000 7f36bffff700 1 --2- 172.21.15.45:0/2142558196 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36b8159490 0x7f36b80b0670 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f36b4009870 tx=0x7f36b4009b80 comp rx=0 tx=0).stop 2023-11-28T12:06:26.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.090+0000 7f36bffff700 1 -- 172.21.15.45:0/2142558196 shutdown_connections 2023-11-28T12:06:26.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.090+0000 7f36bffff700 1 --2- 172.21.15.45:0/2142558196 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36b8159490 0x7f36b80b0670 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:26.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.090+0000 7f36bffff700 1 --2- 172.21.15.45:0/2142558196 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f36b8159860 0x7f36b80b0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:26.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.090+0000 7f36bffff700 1 -- 172.21.15.45:0/2142558196 >> 172.21.15.45:0/2142558196 conn(0x7f36b80cb670 msgr2=0x7f36b80cba70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:26.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.091+0000 7f36bffff700 1 -- 172.21.15.45:0/2142558196 shutdown_connections 2023-11-28T12:06:26.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.091+0000 7f36bffff700 1 -- 172.21.15.45:0/2142558196 wait complete. 2023-11-28T12:06:26.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.092+0000 7f36bffff700 1 Processor -- start 2023-11-28T12:06:26.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.092+0000 7f36bffff700 1 -- start start 2023-11-28T12:06:26.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.093+0000 7f36bffff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f36b80cdc80 0x7f36b8151100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:26.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.093+0000 7f36bffff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36b8159490 0x7f36b806b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:26.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.093+0000 7f36bffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36b806bd60 0x7f36b8155050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:26.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.093+0000 7f36bffff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36b806d0b0 con 0x7f36b806bd60 2023-11-28T12:06:26.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.093+0000 7f36bffff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36b806c200 con 0x7f36b8159490 2023-11-28T12:06:26.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.093+0000 7f36bffff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36b8150890 con 0x7f36b80cdc80 2023-11-28T12:06:26.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.094+0000 7f36be59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36b806bd60 0x7f36b8155050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:26.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.094+0000 7f36be59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36b806bd60 0x7f36b8155050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46446/0 (socket says 172.21.15.45:46446) 2023-11-28T12:06:26.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.094+0000 7f36be59c700 1 -- 172.21.15.45:0/340202788 learned_addr learned my addr 172.21.15.45:0/340202788 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:26.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.094+0000 7f36bdd9b700 1 --2- 172.21.15.45:0/340202788 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f36b80cdc80 0x7f36b8151100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:26.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.094+0000 7f36bd59a700 1 --2- 172.21.15.45:0/340202788 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36b8159490 0x7f36b806b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:26.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.094+0000 7f36be59c700 1 -- 172.21.15.45:0/340202788 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f36b80cdc80 msgr2=0x7f36b8151100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:26.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.094+0000 7f36be59c700 1 --2- 172.21.15.45:0/340202788 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f36b80cdc80 0x7f36b8151100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:26.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.094+0000 7f36be59c700 1 -- 172.21.15.45:0/340202788 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36b8159490 msgr2=0x7f36b806b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:26.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.094+0000 7f36be59c700 1 --2- 172.21.15.45:0/340202788 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36b8159490 0x7f36b806b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:26.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.094+0000 7f36be59c700 1 -- 172.21.15.45:0/340202788 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36b40094a0 con 0x7f36b806bd60 2023-11-28T12:06:26.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.094+0000 7f36be59c700 1 --2- 172.21.15.45:0/340202788 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36b806bd60 0x7f36b8155050 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f36b000cc00 tx=0x7f36b000cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:26.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.095+0000 7f36ae7fc700 1 -- 172.21.15.45:0/340202788 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b000aa40 con 0x7f36b806bd60 2023-11-28T12:06:26.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.095+0000 7f36ae7fc700 1 -- 172.21.15.45:0/340202788 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36b000aba0 con 0x7f36b806bd60 2023-11-28T12:06:26.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.095+0000 7f36bffff700 1 -- 172.21.15.45:0/340202788 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36b80c9bd0 con 0x7f36b806bd60 2023-11-28T12:06:26.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.095+0000 7f36ae7fc700 1 -- 172.21.15.45:0/340202788 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36b0007070 con 0x7f36b806bd60 2023-11-28T12:06:26.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.095+0000 7f36bffff700 1 -- 172.21.15.45:0/340202788 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36b80cd760 con 0x7f36b806bd60 2023-11-28T12:06:26.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.096+0000 7f36bffff700 1 -- 172.21.15.45:0/340202788 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36b80c9d60 con 0x7f36b806bd60 2023-11-28T12:06:26.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.097+0000 7f36ae7fc700 1 -- 172.21.15.45:0/340202788 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f36b0019030 con 0x7f36b806bd60 2023-11-28T12:06:26.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.098+0000 7f36ae7fc700 1 --2- 172.21.15.45:0/340202788 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f369c0682f0 0x7f369c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:26.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.098+0000 7f36ae7fc700 1 -- 172.21.15.45:0/340202788 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f36b00854f0 con 0x7f36b806bd60 2023-11-28T12:06:26.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.098+0000 7f36bdd9b700 1 --2- 172.21.15.45:0/340202788 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f369c0682f0 0x7f369c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:26.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.099+0000 7f36bdd9b700 1 --2- 172.21.15.45:0/340202788 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f369c0682f0 0x7f369c06a7a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f36b40090b0 tx=0x7f36b4008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:26.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.103+0000 7f36ae7fc700 1 -- 172.21.15.45:0/340202788 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f36b004b5e0 con 0x7f36b806bd60 2023-11-28T12:06:26.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.302+0000 7f36bffff700 1 -- 172.21.15.45:0/340202788 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f36b806d1f0 con 0x7f36b806bd60 2023-11-28T12:06:26.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.303+0000 7f36ae7fc700 1 -- 172.21.15.45:0/340202788 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v16) v1 ==== 92+0+10 (secure 0 0 0) 0x7f36b806d1f0 con 0x7f36b806bd60 2023-11-28T12:06:26.303 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-11-28T12:06:26.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.305+0000 7f36bffff700 1 -- 172.21.15.45:0/340202788 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f369c0682f0 msgr2=0x7f369c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:26.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.305+0000 7f36bffff700 1 --2- 172.21.15.45:0/340202788 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f369c0682f0 0x7f369c06a7a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f36b40090b0 tx=0x7f36b4008030 comp rx=0 tx=0).stop 2023-11-28T12:06:26.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.305+0000 7f36bffff700 1 -- 172.21.15.45:0/340202788 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36b806bd60 msgr2=0x7f36b8155050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:26.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.305+0000 7f36bffff700 1 --2- 172.21.15.45:0/340202788 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36b806bd60 0x7f36b8155050 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f36b000cc00 tx=0x7f36b000cf10 comp rx=0 tx=0).stop 2023-11-28T12:06:26.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.305+0000 7f36bffff700 1 -- 172.21.15.45:0/340202788 shutdown_connections 2023-11-28T12:06:26.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.305+0000 7f36bffff700 1 --2- 172.21.15.45:0/340202788 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f369c0682f0 0x7f369c06a7a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:26.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.305+0000 7f36bffff700 1 --2- 172.21.15.45:0/340202788 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36b806bd60 0x7f36b8155050 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:26.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.305+0000 7f36bffff700 1 --2- 172.21.15.45:0/340202788 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f36b80cdc80 0x7f36b8151100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:26.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.305+0000 7f36bffff700 1 --2- 172.21.15.45:0/340202788 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36b8159490 0x7f36b806b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:26.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.305+0000 7f36bffff700 1 -- 172.21.15.45:0/340202788 >> 172.21.15.45:0/340202788 conn(0x7f36b80cb670 msgr2=0x7f36b80716e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:26.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.305+0000 7f36bffff700 1 -- 172.21.15.45:0/340202788 shutdown_connections 2023-11-28T12:06:26.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.305+0000 7f36bffff700 1 -- 172.21.15.45:0/340202788 wait complete. 2023-11-28T12:06:26.324 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T12:06:26.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.530+0000 7fd8f97ff700 1 Processor -- start 2023-11-28T12:06:26.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.530+0000 7fd8f97ff700 1 -- start start 2023-11-28T12:06:26.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.531+0000 7fd8f97ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd8f415c9b0 0x7fd8f40b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:26.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.531+0000 7fd8f97ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd8f4161340 0x7fd8f40d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:26.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.531+0000 7fd8f97ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8f40d1950 con 0x7fd8f40d2320 2023-11-28T12:06:26.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.531+0000 7fd8f97ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8f40b5800 con 0x7fd8f4161340 2023-11-28T12:06:26.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.531+0000 7fd8f97ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f40b5520 con 0x7fd8f415c9b0 2023-11-28T12:06:26.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.532+0000 7fd8f27fc700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd8f4161340 0x7fd8f40d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:26.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.532+0000 7fd8f37fe700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fd8f40d2320 0x7fd8f40cd7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:37758/0 (socket says 172.21.15.45:37758) 2023-11-28T12:06:26.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.532+0000 7fd8f37fe700 1 -- 172.21.15.45:0/2786543053 learned_addr learned my addr 172.21.15.45:0/2786543053 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:06:26.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.532+0000 7fd8f2ffd700 1 --2- 172.21.15.45:0/2786543053 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd8f415c9b0 0x7fd8f40b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:26.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.532+0000 7fd8f1ffb700 1 -- 172.21.15.45:0/2786543053 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 908820959 0 0) 0x7fd8f40d1950 con 0x7fd8f40d2320 2023-11-28T12:06:26.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.532+0000 7fd8f1ffb700 1 -- 172.21.15.45:0/2786543053 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8dc0035b0 con 0x7fd8f40d2320 2023-11-28T12:06:26.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.532+0000 7fd8f27fc700 1 -- 172.21.15.45:0/2786543053 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd8f415c9b0 msgr2=0x7fd8f40b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:06:26.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.532+0000 7fd8f27fc700 1 --2- 172.21.15.45:0/2786543053 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd8f415c9b0 0x7fd8f40b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:26.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.532+0000 7fd8f27fc700 1 -- 172.21.15.45:0/2786543053 >> v1:172.21.15.45:6789/0 conn(0x7fd8f40d2320 legacy=0x7fd8f40cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:26.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.532+0000 7fd8f27fc700 1 -- 172.21.15.45:0/2786543053 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8f40d1300 con 0x7fd8f4161340 2023-11-28T12:06:26.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.532+0000 7fd8f27fc700 1 --2- 172.21.15.45:0/2786543053 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd8f4161340 0x7fd8f40d1de0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd8e8009840 tx=0x7fd8e8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41e45154e19f0a1c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:26.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.533+0000 7fd8f1ffb700 1 -- 172.21.15.45:0/2786543053 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e8011830 con 0x7fd8f4161340 2023-11-28T12:06:26.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.533+0000 7fd8f1ffb700 1 -- 172.21.15.45:0/2786543053 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8e8011990 con 0x7fd8f4161340 2023-11-28T12:06:26.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.533+0000 7fd8f1ffb700 1 -- 172.21.15.45:0/2786543053 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e8011d20 con 0x7fd8f4161340 2023-11-28T12:06:26.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.533+0000 7fd8f97ff700 1 -- 172.21.15.45:0/2786543053 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd8f4161340 msgr2=0x7fd8f40d1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:26.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.533+0000 7fd8f97ff700 1 --2- 172.21.15.45:0/2786543053 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd8f4161340 0x7fd8f40d1de0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd8e8009840 tx=0x7fd8e8009b50 comp rx=0 tx=0).stop 2023-11-28T12:06:26.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.533+0000 7fd8f97ff700 1 -- 172.21.15.45:0/2786543053 shutdown_connections 2023-11-28T12:06:26.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.533+0000 7fd8f97ff700 1 --2- 172.21.15.45:0/2786543053 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd8f415c9b0 0x7fd8f40b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:26.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.533+0000 7fd8f97ff700 1 --2- 172.21.15.45:0/2786543053 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd8f4161340 0x7fd8f40d1de0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:26.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.533+0000 7fd8f97ff700 1 -- 172.21.15.45:0/2786543053 >> 172.21.15.45:0/2786543053 conn(0x7fd8f4072600 msgr2=0x7fd8f40cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:26.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.533+0000 7fd8f97ff700 1 -- 172.21.15.45:0/2786543053 shutdown_connections 2023-11-28T12:06:26.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.533+0000 7fd8f97ff700 1 -- 172.21.15.45:0/2786543053 wait complete. 2023-11-28T12:06:26.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.535+0000 7fd8f97ff700 1 Processor -- start 2023-11-28T12:06:26.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.535+0000 7fd8f97ff700 1 -- start start 2023-11-28T12:06:26.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.536+0000 7fd8f97ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd8f40d2320 0x7fd8f40b6620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:26.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.536+0000 7fd8f97ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd8f415c9b0 0x7fd8f40c86c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:26.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.536+0000 7fd8f97ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd8f4161340 0x7fd8f40c8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:26.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.536+0000 7fd8f97ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f4151b90 con 0x7fd8f4161340 2023-11-28T12:06:26.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.536+0000 7fd8f97ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f4151610 con 0x7fd8f40d2320 2023-11-28T12:06:26.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.536+0000 7fd8f97ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f40b6140 con 0x7fd8f415c9b0 2023-11-28T12:06:26.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.536+0000 7fd8f37fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd8f4161340 0x7fd8f40c8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:26.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.536+0000 7fd8f37fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd8f4161340 0x7fd8f40c8c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46466/0 (socket says 172.21.15.45:46466) 2023-11-28T12:06:26.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.536+0000 7fd8f37fe700 1 -- 172.21.15.45:0/894302880 learned_addr learned my addr 172.21.15.45:0/894302880 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:26.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.537+0000 7fd8f2ffd700 1 --2- 172.21.15.45:0/894302880 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd8f40d2320 0x7fd8f40b6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:26.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.537+0000 7fd8f37fe700 1 -- 172.21.15.45:0/894302880 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd8f415c9b0 msgr2=0x7fd8f40c86c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:26.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.537+0000 7fd8f27fc700 1 --2- 172.21.15.45:0/894302880 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd8f415c9b0 0x7fd8f40c86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:26.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.537+0000 7fd8f37fe700 1 --2- 172.21.15.45:0/894302880 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd8f415c9b0 0x7fd8f40c86c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:26.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.537+0000 7fd8f37fe700 1 -- 172.21.15.45:0/894302880 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd8f40d2320 msgr2=0x7fd8f40b6620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:26.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.537+0000 7fd8f37fe700 1 --2- 172.21.15.45:0/894302880 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd8f40d2320 0x7fd8f40b6620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:26.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.537+0000 7fd8f37fe700 1 -- 172.21.15.45:0/894302880 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8e80094a0 con 0x7fd8f4161340 2023-11-28T12:06:26.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.537+0000 7fd8f2ffd700 1 --2- 172.21.15.45:0/894302880 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd8f40d2320 0x7fd8f40b6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:06:26.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.537+0000 7fd8f27fc700 1 --2- 172.21.15.45:0/894302880 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd8f415c9b0 0x7fd8f40c86c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:06:26.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.537+0000 7fd8f37fe700 1 --2- 172.21.15.45:0/894302880 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd8f4161340 0x7fd8f40c8c00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec00caa0 tx=0x7fd8ec00ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:26.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.537+0000 7fd8db7fe700 1 -- 172.21.15.45:0/894302880 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ec00aa80 con 0x7fd8f4161340 2023-11-28T12:06:26.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.537+0000 7fd8db7fe700 1 -- 172.21.15.45:0/894302880 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8ec00abe0 con 0x7fd8f4161340 2023-11-28T12:06:26.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.537+0000 7fd8db7fe700 1 -- 172.21.15.45:0/894302880 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ec012400 con 0x7fd8f4161340 2023-11-28T12:06:26.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.537+0000 7fd8f97ff700 1 -- 172.21.15.45:0/894302880 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8f40b5130 con 0x7fd8f4161340 2023-11-28T12:06:26.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.537+0000 7fd8f97ff700 1 -- 172.21.15.45:0/894302880 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8f40d15e0 con 0x7fd8f4161340 2023-11-28T12:06:26.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.538+0000 7fd8f97ff700 1 -- 172.21.15.45:0/894302880 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8f40b52c0 con 0x7fd8f4161340 2023-11-28T12:06:26.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.539+0000 7fd8db7fe700 1 -- 172.21.15.45:0/894302880 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fd8ec019030 con 0x7fd8f4161340 2023-11-28T12:06:26.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.540+0000 7fd8db7fe700 1 --2- 172.21.15.45:0/894302880 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fd8e00682f0 0x7fd8e006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:26.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.540+0000 7fd8db7fe700 1 -- 172.21.15.45:0/894302880 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fd8ec085660 con 0x7fd8f4161340 2023-11-28T12:06:26.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.541+0000 7fd8f2ffd700 1 --2- 172.21.15.45:0/894302880 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fd8e00682f0 0x7fd8e006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:26.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.541+0000 7fd8f2ffd700 1 --2- 172.21.15.45:0/894302880 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fd8e00682f0 0x7fd8e006a7a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd8e4009b60 tx=0x7fd8e4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:26.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.544+0000 7fd8db7fe700 1 -- 172.21.15.45:0/894302880 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fd8ec052120 con 0x7fd8f4161340 2023-11-28T12:06:26.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.746+0000 7fd8f97ff700 1 -- 172.21.15.45:0/894302880 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd8f40b5fa0 con 0x7fd8f4161340 2023-11-28T12:06:26.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.747+0000 7fd8db7fe700 1 -- 172.21.15.45:0/894302880 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd8ec017020 con 0x7fd8f4161340 2023-11-28T12:06:26.747 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-11-28T12:06:26.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.749+0000 7fd8f97ff700 1 -- 172.21.15.45:0/894302880 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fd8e00682f0 msgr2=0x7fd8e006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:26.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.749+0000 7fd8f97ff700 1 --2- 172.21.15.45:0/894302880 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fd8e00682f0 0x7fd8e006a7a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd8e4009b60 tx=0x7fd8e4008040 comp rx=0 tx=0).stop 2023-11-28T12:06:26.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.749+0000 7fd8f97ff700 1 -- 172.21.15.45:0/894302880 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd8f4161340 msgr2=0x7fd8f40c8c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:26.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.749+0000 7fd8f97ff700 1 --2- 172.21.15.45:0/894302880 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd8f4161340 0x7fd8f40c8c00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec00caa0 tx=0x7fd8ec00ce60 comp rx=0 tx=0).stop 2023-11-28T12:06:26.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.749+0000 7fd8f97ff700 1 -- 172.21.15.45:0/894302880 shutdown_connections 2023-11-28T12:06:26.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.749+0000 7fd8f97ff700 1 --2- 172.21.15.45:0/894302880 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fd8e00682f0 0x7fd8e006a7a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:26.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.749+0000 7fd8f97ff700 1 --2- 172.21.15.45:0/894302880 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd8f40d2320 0x7fd8f40b6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:26.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.749+0000 7fd8f97ff700 1 --2- 172.21.15.45:0/894302880 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd8f4161340 0x7fd8f40c8c00 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:26.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.749+0000 7fd8f97ff700 1 --2- 172.21.15.45:0/894302880 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd8f415c9b0 0x7fd8f40c86c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:26.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.749+0000 7fd8f97ff700 1 -- 172.21.15.45:0/894302880 >> 172.21.15.45:0/894302880 conn(0x7fd8f4072600 msgr2=0x7fd8f4160610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:26.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.749+0000 7fd8f97ff700 1 -- 172.21.15.45:0/894302880 shutdown_connections 2023-11-28T12:06:26.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.749+0000 7fd8f97ff700 1 -- 172.21.15.45:0/894302880 wait complete. 2023-11-28T12:06:26.769 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-28T12:06:26.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.973+0000 7fe4a31ff700 1 Processor -- start 2023-11-28T12:06:26.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.974+0000 7fe4a31ff700 1 -- start start 2023-11-28T12:06:26.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.975+0000 7fe4a31ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe49c15c9b0 0x7fe49c0b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:26.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.975+0000 7fe4a31ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe49c0d1950 con 0x7fe49c161340 2023-11-28T12:06:26.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.975+0000 7fe4a31ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe49c0d24f0 con 0x7fe49c0cd7c0 2023-11-28T12:06:26.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.975+0000 7fe4a31ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe49c0b5800 con 0x7fe49c15c9b0 2023-11-28T12:06:26.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.975+0000 7fe49bfff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fe49c161340 0x7fe49c0d1de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:37760/0 (socket says 172.21.15.45:37760) 2023-11-28T12:06:26.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.975+0000 7fe49bfff700 1 -- 172.21.15.45:0/3697966461 learned_addr learned my addr 172.21.15.45:0/3697966461 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:06:26.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.975+0000 7fe4a0f9b700 1 --2- 172.21.15.45:0/3697966461 >> v2:172.21.15.45:3300/0 conn(0x7fe49c15c9b0 0x7fe49c0b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:26.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.976+0000 7fe4a0f9b700 1 -- 172.21.15.45:0/3697966461 >> v1:172.21.15.152:6789/0 conn(0x7fe49c0cd7c0 legacy=0x7fe49c0b5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:26.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.976+0000 7fe4a0f9b700 1 -- 172.21.15.45:0/3697966461 >> v1:172.21.15.45:6789/0 conn(0x7fe49c161340 legacy=0x7fe49c0d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:26.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.976+0000 7fe4a0f9b700 1 -- 172.21.15.45:0/3697966461 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe49c0b5520 con 0x7fe49c15c9b0 2023-11-28T12:06:26.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.976+0000 7fe49b7fe700 1 -- 172.21.15.45:0/3697966461 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 287877599 0 0) 0x7fe49c0d1950 con 0x7fe49c161340 2023-11-28T12:06:26.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.976+0000 7fe4a0f9b700 1 --2- 172.21.15.45:0/3697966461 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe49c15c9b0 0x7fe49c0b4bf0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe490009840 tx=0x7fe490009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7fa091280eed6ef server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:26.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.976+0000 7fe49b7fe700 1 -- 172.21.15.45:0/3697966461 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe490011830 con 0x7fe49c15c9b0 2023-11-28T12:06:26.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.976+0000 7fe49b7fe700 1 -- 172.21.15.45:0/3697966461 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe490011990 con 0x7fe49c15c9b0 2023-11-28T12:06:26.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.976+0000 7fe49b7fe700 1 -- 172.21.15.45:0/3697966461 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe490011d20 con 0x7fe49c15c9b0 2023-11-28T12:06:26.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.977+0000 7fe4a31ff700 1 -- 172.21.15.45:0/3697966461 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe49c15c9b0 msgr2=0x7fe49c0b4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:26.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.977+0000 7fe4a31ff700 1 --2- 172.21.15.45:0/3697966461 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe49c15c9b0 0x7fe49c0b4bf0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe490009840 tx=0x7fe490009b50 comp rx=0 tx=0).stop 2023-11-28T12:06:26.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.977+0000 7fe4a31ff700 1 -- 172.21.15.45:0/3697966461 shutdown_connections 2023-11-28T12:06:26.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.977+0000 7fe4a31ff700 1 --2- 172.21.15.45:0/3697966461 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe49c15c9b0 0x7fe49c0b4bf0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:26.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.977+0000 7fe4a31ff700 1 -- 172.21.15.45:0/3697966461 >> 172.21.15.45:0/3697966461 conn(0x7fe49c072600 msgr2=0x7fe49c0cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:26.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.977+0000 7fe4a31ff700 1 -- 172.21.15.45:0/3697966461 shutdown_connections 2023-11-28T12:06:26.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.977+0000 7fe4a31ff700 1 -- 172.21.15.45:0/3697966461 wait complete. 2023-11-28T12:06:26.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.978+0000 7fe4a31ff700 1 Processor -- start 2023-11-28T12:06:26.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.979+0000 7fe4a31ff700 1 -- start start 2023-11-28T12:06:26.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.979+0000 7fe4a31ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe49c0cd7c0 0x7fe49c1f3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:26.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.980+0000 7fe4a31ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe49c15c9b0 0x7fe49c1f2f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:26.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.980+0000 7fe4a31ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe49c161340 0x7fe49c1f51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:26.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.980+0000 7fe4a31ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe49c14e0b0 con 0x7fe49c0cd7c0 2023-11-28T12:06:26.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.980+0000 7fe4a31ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe49c1f3450 con 0x7fe49c161340 2023-11-28T12:06:26.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.980+0000 7fe4a31ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe49c15e280 con 0x7fe49c15c9b0 2023-11-28T12:06:26.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.980+0000 7fe4a0f9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe49c0cd7c0 0x7fe49c1f3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:26.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.980+0000 7fe4a0f9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe49c0cd7c0 0x7fe49c1f3650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46474/0 (socket says 172.21.15.45:46474) 2023-11-28T12:06:26.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.980+0000 7fe4a0f9b700 1 -- 172.21.15.45:0/1496151524 learned_addr learned my addr 172.21.15.45:0/1496151524 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:26.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.980+0000 7fe49bfff700 1 --2- 172.21.15.45:0/1496151524 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe49c15c9b0 0x7fe49c1f2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:26.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.980+0000 7fe4a0f9b700 1 -- 172.21.15.45:0/1496151524 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe49c15c9b0 msgr2=0x7fe49c1f2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:26.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.980+0000 7fe4a179c700 1 --2- 172.21.15.45:0/1496151524 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe49c161340 0x7fe49c1f51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:26.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.980+0000 7fe4a0f9b700 1 --2- 172.21.15.45:0/1496151524 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe49c15c9b0 0x7fe49c1f2f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:26.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.980+0000 7fe4a0f9b700 1 -- 172.21.15.45:0/1496151524 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe49c161340 msgr2=0x7fe49c1f51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:26.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.980+0000 7fe4a0f9b700 1 --2- 172.21.15.45:0/1496151524 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe49c161340 0x7fe49c1f51d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:26.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.980+0000 7fe4a0f9b700 1 -- 172.21.15.45:0/1496151524 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4900094a0 con 0x7fe49c0cd7c0 2023-11-28T12:06:26.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.980+0000 7fe4a179c700 1 --2- 172.21.15.45:0/1496151524 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe49c161340 0x7fe49c1f51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:06:26.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.980+0000 7fe49bfff700 1 --2- 172.21.15.45:0/1496151524 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe49c15c9b0 0x7fe49c1f2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:06:26.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.981+0000 7fe4a0f9b700 1 --2- 172.21.15.45:0/1496151524 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe49c0cd7c0 0x7fe49c1f3650 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe490014040 tx=0x7fe490004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:26.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.981+0000 7fe4997fa700 1 -- 172.21.15.45:0/1496151524 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe49001a900 con 0x7fe49c0cd7c0 2023-11-28T12:06:26.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.981+0000 7fe4997fa700 1 -- 172.21.15.45:0/1496151524 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe49001aa60 con 0x7fe49c0cd7c0 2023-11-28T12:06:26.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.981+0000 7fe4997fa700 1 -- 172.21.15.45:0/1496151524 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe49001add0 con 0x7fe49c0cd7c0 2023-11-28T12:06:26.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.981+0000 7fe4a31ff700 1 -- 172.21.15.45:0/1496151524 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe49c0d15e0 con 0x7fe49c0cd7c0 2023-11-28T12:06:26.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.981+0000 7fe4a31ff700 1 -- 172.21.15.45:0/1496151524 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe49c0d1300 con 0x7fe49c0cd7c0 2023-11-28T12:06:26.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.982+0000 7fe4a31ff700 1 -- 172.21.15.45:0/1496151524 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe49c0b5130 con 0x7fe49c0cd7c0 2023-11-28T12:06:26.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.983+0000 7fe4997fa700 1 -- 172.21.15.45:0/1496151524 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fe49000f050 con 0x7fe49c0cd7c0 2023-11-28T12:06:26.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.984+0000 7fe4997fa700 1 --2- 172.21.15.45:0/1496151524 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fe4800682f0 0x7fe48006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:26.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.984+0000 7fe4997fa700 1 -- 172.21.15.45:0/1496151524 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fe490086aa0 con 0x7fe49c0cd7c0 2023-11-28T12:06:26.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.984+0000 7fe49bfff700 1 --2- 172.21.15.45:0/1496151524 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fe4800682f0 0x7fe48006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:26.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.985+0000 7fe49bfff700 1 --2- 172.21.15.45:0/1496151524 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fe4800682f0 0x7fe48006a7a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe49c1e7160 tx=0x7fe488009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:26.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:26.988+0000 7fe4997fa700 1 -- 172.21.15.45:0/1496151524 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fe490053610 con 0x7fe49c0cd7c0 2023-11-28T12:06:27.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:27.197+0000 7fe4a31ff700 1 -- 172.21.15.45:0/1496151524 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fe49c0745c0 con 0x7fe49c0cd7c0 2023-11-28T12:06:27.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:27.198+0000 7fe4997fa700 1 -- 172.21.15.45:0/1496151524 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+126 (secure 0 0 0) 0x7fe490029090 con 0x7fe49c0cd7c0 2023-11-28T12:06:27.198 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:06:27.199 INFO:teuthology.orchestra.run.smithi045.stdout:[ 2023-11-28T12:06:27.199 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T12:06:27.199 INFO:teuthology.orchestra.run.smithi045.stdout: "poolnum": 1, 2023-11-28T12:06:27.199 INFO:teuthology.orchestra.run.smithi045.stdout: "poolname": "rbd" 2023-11-28T12:06:27.199 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T12:06:27.199 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T12:06:27.199 INFO:teuthology.orchestra.run.smithi045.stdout: "poolnum": 2, 2023-11-28T12:06:27.199 INFO:teuthology.orchestra.run.smithi045.stdout: "poolname": ".mgr" 2023-11-28T12:06:27.199 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T12:06:27.199 INFO:teuthology.orchestra.run.smithi045.stdout:] 2023-11-28T12:06:27.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:27.200+0000 7fe4a31ff700 1 -- 172.21.15.45:0/1496151524 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fe4800682f0 msgr2=0x7fe48006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:27.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:27.200+0000 7fe4a31ff700 1 --2- 172.21.15.45:0/1496151524 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fe4800682f0 0x7fe48006a7a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe49c1e7160 tx=0x7fe488009040 comp rx=0 tx=0).stop 2023-11-28T12:06:27.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:27.200+0000 7fe4a31ff700 1 -- 172.21.15.45:0/1496151524 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe49c0cd7c0 msgr2=0x7fe49c1f3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:27.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:27.200+0000 7fe4a31ff700 1 --2- 172.21.15.45:0/1496151524 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe49c0cd7c0 0x7fe49c1f3650 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe490014040 tx=0x7fe490004750 comp rx=0 tx=0).stop 2023-11-28T12:06:27.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:27.200+0000 7fe4a31ff700 1 -- 172.21.15.45:0/1496151524 shutdown_connections 2023-11-28T12:06:27.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:27.200+0000 7fe4a31ff700 1 --2- 172.21.15.45:0/1496151524 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fe4800682f0 0x7fe48006a7a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:27.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:27.200+0000 7fe4a31ff700 1 --2- 172.21.15.45:0/1496151524 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe49c161340 0x7fe49c1f51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:27.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:27.200+0000 7fe4a31ff700 1 --2- 172.21.15.45:0/1496151524 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe49c0cd7c0 0x7fe49c1f3650 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:27.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:27.200+0000 7fe4a31ff700 1 --2- 172.21.15.45:0/1496151524 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe49c15c9b0 0x7fe49c1f2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:27.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:27.200+0000 7fe4a31ff700 1 -- 172.21.15.45:0/1496151524 >> 172.21.15.45:0/1496151524 conn(0x7fe49c072600 msgr2=0x7fe49c15ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:27.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:27.200+0000 7fe4a31ff700 1 -- 172.21.15.45:0/1496151524 shutdown_connections 2023-11-28T12:06:27.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:27.200+0000 7fe4a31ff700 1 -- 172.21.15.45:0/1496151524 wait complete. 2023-11-28T12:06:27.219 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-28T12:06:27.220 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-28T12:06:27.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:27.426+0000 7ff5a21ff700 1 Processor -- start 2023-11-28T12:06:27.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:27.427+0000 7ff5a21ff700 1 -- start start 2023-11-28T12:06:27.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:27.428+0000 7ff5a21ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff59c15ca60 0x7ff59c0b38b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:27.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:27.428+0000 7ff5a21ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ff59c0b29d0 0x7ff59c0d0c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:27.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:27.428+0000 7ff5a21ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff59c0d15e0 con 0x7ff59c0d1180 2023-11-28T12:06:27.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:27.428+0000 7ff5a21ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff59c0afbe0 con 0x7ff59c0b29d0 2023-11-28T12:06:27.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:27.428+0000 7ff5a21ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff59c0b2750 con 0x7ff59c15ca60 2023-11-28T12:06:27.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:27.429+0000 7ff59affd700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ff59c0b29d0 0x7ff59c0d0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:27.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:27.429+0000 7ff59affd700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ff59c0b29d0 0x7ff59c0d0c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.45:43046/0 (socket says 172.21.15.45:43046) 2023-11-28T12:06:27.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:27.429+0000 7ff59affd700 1 -- 172.21.15.45:0/2327827480 learned_addr learned my addr 172.21.15.45:0/2327827480 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:27.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:27.429+0000 7ff59b7fe700 1 --2- 172.21.15.45:0/2327827480 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff59c15ca60 0x7ff59c0b38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:27.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:27.429+0000 7ff59affd700 1 -- 172.21.15.45:0/2327827480 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff59c15ca60 msgr2=0x7ff59c0b38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:06:27.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:27.429+0000 7ff59affd700 1 --2- 172.21.15.45:0/2327827480 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff59c15ca60 0x7ff59c0b38b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:27.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:27.429+0000 7ff59affd700 1 -- 172.21.15.45:0/2327827480 >> v1:172.21.15.152:6789/0 conn(0x7ff59c0d1180 legacy=0x7ff59c160560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:27.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:27.429+0000 7ff59affd700 1 -- 172.21.15.45:0/2327827480 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff59c15ce30 con 0x7ff59c0b29d0 2023-11-28T12:06:27.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:27.430+0000 7ff59affd700 1 --2- 172.21.15.45:0/2327827480 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff59c0b29d0 0x7ff59c0d0c40 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff5900098f0 tx=0x7ff590009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad515794b9570d65 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:27.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:27.430+0000 7ff59a7fc700 1 -- 172.21.15.45:0/2327827480 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff590011830 con 0x7ff59c0b29d0 2023-11-28T12:06:27.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:27.430+0000 7ff59a7fc700 1 -- 172.21.15.45:0/2327827480 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff590011990 con 0x7ff59c0b29d0 2023-11-28T12:06:27.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:27.430+0000 7ff59a7fc700 1 -- 172.21.15.45:0/2327827480 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff590011d20 con 0x7ff59c0b29d0 2023-11-28T12:06:27.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:27.430+0000 7ff5a21ff700 1 -- 172.21.15.45:0/2327827480 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff59c0b29d0 msgr2=0x7ff59c0d0c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:27.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:27.430+0000 7ff5a21ff700 1 --2- 172.21.15.45:0/2327827480 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff59c0b29d0 0x7ff59c0d0c40 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff5900098f0 tx=0x7ff590009c00 comp rx=0 tx=0).stop 2023-11-28T12:06:27.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:27.430+0000 7ff5a21ff700 1 -- 172.21.15.45:0/2327827480 shutdown_connections 2023-11-28T12:06:27.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:27.430+0000 7ff5a21ff700 1 --2- 172.21.15.45:0/2327827480 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff59c15ca60 0x7ff59c0b38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:27.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:27.430+0000 7ff5a21ff700 1 --2- 172.21.15.45:0/2327827480 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff59c0b29d0 0x7ff59c0d0c40 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:27.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:27.430+0000 7ff5a21ff700 1 -- 172.21.15.45:0/2327827480 >> 172.21.15.45:0/2327827480 conn(0x7ff59c09c3f0 msgr2=0x7ff59c0d3070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:27.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:27.431+0000 7ff5a21ff700 1 -- 172.21.15.45:0/2327827480 shutdown_connections 2023-11-28T12:06:27.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:27.431+0000 7ff5a21ff700 1 -- 172.21.15.45:0/2327827480 wait complete. 2023-11-28T12:06:27.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:27.433+0000 7ff5a21ff700 1 Processor -- start 2023-11-28T12:06:27.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:27.433+0000 7ff5a21ff700 1 -- start start 2023-11-28T12:06:27.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:27.434+0000 7ff5a21ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff59c0b29d0 0x7ff59c156410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:27.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:27.434+0000 7ff5a21ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff59c0d1180 0x7ff59c1e7750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:27.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:27.434+0000 7ff5a21ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff59c15ca60 0x7ff59c0c8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:27.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:27.434+0000 7ff5a21ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff59c15ff50 con 0x7ff59c0b29d0 2023-11-28T12:06:27.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:27.434+0000 7ff5a21ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff59c1e7fa0 con 0x7ff59c15ca60 2023-11-28T12:06:27.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:27.434+0000 7ff5a21ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff59c1e8280 con 0x7ff59c0d1180 2023-11-28T12:06:27.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:27.435+0000 7ff59b7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff59c0b29d0 0x7ff59c156410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:27.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:27.435+0000 7ff59b7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff59c0b29d0 0x7ff59c156410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46486/0 (socket says 172.21.15.45:46486) 2023-11-28T12:06:27.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:27.435+0000 7ff59b7fe700 1 -- 172.21.15.45:0/1916937548 learned_addr learned my addr 172.21.15.45:0/1916937548 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:27.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:27.435+0000 7ff59affd700 1 --2- 172.21.15.45:0/1916937548 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff59c0d1180 0x7ff59c1e7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:27.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:27.435+0000 7ff59bfff700 1 --2- 172.21.15.45:0/1916937548 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff59c15ca60 0x7ff59c0c8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:27.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:27.435+0000 7ff59b7fe700 1 -- 172.21.15.45:0/1916937548 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff59c0d1180 msgr2=0x7ff59c1e7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:27.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:27.435+0000 7ff59b7fe700 1 --2- 172.21.15.45:0/1916937548 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff59c0d1180 0x7ff59c1e7750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:27.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:27.435+0000 7ff59b7fe700 1 -- 172.21.15.45:0/1916937548 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff59c15ca60 msgr2=0x7ff59c0c8b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:27.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:27.435+0000 7ff59b7fe700 1 --2- 172.21.15.45:0/1916937548 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff59c15ca60 0x7ff59c0c8b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:27.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:27.435+0000 7ff59b7fe700 1 -- 172.21.15.45:0/1916937548 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff590009550 con 0x7ff59c0b29d0 2023-11-28T12:06:27.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:27.436+0000 7ff59b7fe700 1 --2- 172.21.15.45:0/1916937548 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff59c0b29d0 0x7ff59c156410 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff58c00e990 tx=0x7ff58c00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:27.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:27.436+0000 7ff583fff700 1 -- 172.21.15.45:0/1916937548 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff58c0096f0 con 0x7ff59c0b29d0 2023-11-28T12:06:27.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:27.436+0000 7ff583fff700 1 -- 172.21.15.45:0/1916937548 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff58c00c690 con 0x7ff59c0b29d0 2023-11-28T12:06:27.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:27.436+0000 7ff5a21ff700 1 -- 172.21.15.45:0/1916937548 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff59c0b4200 con 0x7ff59c0b29d0 2023-11-28T12:06:27.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:27.436+0000 7ff583fff700 1 -- 172.21.15.45:0/1916937548 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff58c00ca00 con 0x7ff59c0b29d0 2023-11-28T12:06:27.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:27.436+0000 7ff5a21ff700 1 -- 172.21.15.45:0/1916937548 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff59c0b3f20 con 0x7ff59c0b29d0 2023-11-28T12:06:27.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:27.437+0000 7ff5a21ff700 1 -- 172.21.15.45:0/1916937548 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff59c0b44e0 con 0x7ff59c0b29d0 2023-11-28T12:06:27.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:27.438+0000 7ff583fff700 1 -- 172.21.15.45:0/1916937548 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7ff58c023070 con 0x7ff59c0b29d0 2023-11-28T12:06:27.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:27.439+0000 7ff583fff700 1 --2- 172.21.15.45:0/1916937548 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7ff5880682f0 0x7ff58806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:27.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:27.439+0000 7ff583fff700 1 -- 172.21.15.45:0/1916937548 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5210+0+0 (secure 0 0 0) 0x7ff58c085c60 con 0x7ff59c0b29d0 2023-11-28T12:06:27.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:27.439+0000 7ff59affd700 1 --2- 172.21.15.45:0/1916937548 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7ff5880682f0 0x7ff58806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:27.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:27.440+0000 7ff59affd700 1 --2- 172.21.15.45:0/1916937548 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7ff5880682f0 0x7ff58806a7a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff590014040 tx=0x7ff590008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:27.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:27.443+0000 7ff583fff700 1 -- 172.21.15.45:0/1916937548 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7ff58c0526c0 con 0x7ff59c0b29d0 2023-11-28T12:06:27.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:27.643+0000 7ff5a21ff700 1 -- 172.21.15.45:0/1916937548 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7ff59c0672a0 con 0x7ff59c0b29d0 2023-11-28T12:06:27.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:27.875+0000 7ff583fff700 1 -- 172.21.15.45:0/1916937548 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7ff58c055ce0 con 0x7ff59c0b29d0 2023-11-28T12:06:27.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:27.879+0000 7ff5a21ff700 1 -- 172.21.15.45:0/1916937548 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7ff5880682f0 msgr2=0x7ff58806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:27.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:27.879+0000 7ff5a21ff700 1 --2- 172.21.15.45:0/1916937548 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7ff5880682f0 0x7ff58806a7a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff590014040 tx=0x7ff590008030 comp rx=0 tx=0).stop 2023-11-28T12:06:27.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:27.879+0000 7ff5a21ff700 1 -- 172.21.15.45:0/1916937548 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff59c0b29d0 msgr2=0x7ff59c156410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:27.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:27.879+0000 7ff5a21ff700 1 --2- 172.21.15.45:0/1916937548 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff59c0b29d0 0x7ff59c156410 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff58c00e990 tx=0x7ff58c00eca0 comp rx=0 tx=0).stop 2023-11-28T12:06:27.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:27.880+0000 7ff5a21ff700 1 -- 172.21.15.45:0/1916937548 shutdown_connections 2023-11-28T12:06:27.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:27.880+0000 7ff5a21ff700 1 --2- 172.21.15.45:0/1916937548 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7ff5880682f0 0x7ff58806a7a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:27.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:27.880+0000 7ff5a21ff700 1 --2- 172.21.15.45:0/1916937548 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff59c15ca60 0x7ff59c0c8b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:27.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:27.880+0000 7ff5a21ff700 1 --2- 172.21.15.45:0/1916937548 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff59c0b29d0 0x7ff59c156410 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:27.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:27.880+0000 7ff5a21ff700 1 --2- 172.21.15.45:0/1916937548 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff59c0d1180 0x7ff59c1e7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:27.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:27.880+0000 7ff5a21ff700 1 -- 172.21.15.45:0/1916937548 >> 172.21.15.45:0/1916937548 conn(0x7ff59c09c3f0 msgr2=0x7ff59c1604f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:27.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:27.882+0000 7ff5a21ff700 1 -- 172.21.15.45:0/1916937548 shutdown_connections 2023-11-28T12:06:27.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:27.882+0000 7ff5a21ff700 1 -- 172.21.15.45:0/1916937548 wait complete. 2023-11-28T12:06:27.887 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' created 2023-11-28T12:06:27.904 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-28T12:06:28.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:28.120+0000 7f674ddff700 1 Processor -- start 2023-11-28T12:06:28.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:28.120+0000 7f674ddff700 1 -- start start 2023-11-28T12:06:28.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:28.122+0000 7f674ddff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f67480d1330 0x7f67480b06c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:28.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:28.122+0000 7f674ddff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f67480b20b0 0x7f67480b0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:28.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:28.122+0000 7f674ddff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67480b0230 con 0x7f67480d01b0 2023-11-28T12:06:28.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:28.122+0000 7f674ddff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f674815cec0 con 0x7f67480b20b0 2023-11-28T12:06:28.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:28.122+0000 7f674ddff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67480b4570 con 0x7f67480d1330 2023-11-28T12:06:28.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:28.122+0000 7f6747fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f67480b20b0 0x7f67480b0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:28.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:28.122+0000 7f6747fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f67480b20b0 0x7f67480b0c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46492/0 (socket says 172.21.15.45:46492) 2023-11-28T12:06:28.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:28.122+0000 7f6747fff700 1 -- 172.21.15.45:0/3483537199 learned_addr learned my addr 172.21.15.45:0/3483537199 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:28.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:28.122+0000 7f6746ffd700 1 --2- 172.21.15.45:0/3483537199 >> v2:172.21.15.152:3300/0 conn(0x7f67480d1330 0x7f67480b06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:28.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:28.122+0000 7f6747fff700 1 -- 172.21.15.45:0/3483537199 >> v2:172.21.15.152:3300/0 conn(0x7f67480d1330 msgr2=0x7f67480b06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:06:28.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:28.122+0000 7f6747fff700 1 --2- 172.21.15.45:0/3483537199 >> v2:172.21.15.152:3300/0 conn(0x7f67480d1330 0x7f67480b06c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:28.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:28.122+0000 7f6747fff700 1 -- 172.21.15.45:0/3483537199 >> v1:172.21.15.152:6789/0 conn(0x7f67480d01b0 legacy=0x7f67480d0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:28.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:28.122+0000 7f6747fff700 1 -- 172.21.15.45:0/3483537199 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67480b4850 con 0x7f67480b20b0 2023-11-28T12:06:28.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:28.123+0000 7f6747fff700 1 --2- 172.21.15.45:0/3483537199 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f67480b20b0 0x7f67480b0c00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f67480ca0b0 tx=0x7f674000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eb8a8f3dfd71a4a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:28.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:28.123+0000 7f67467fc700 1 -- 172.21.15.45:0/3483537199 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f674000e070 con 0x7f67480b20b0 2023-11-28T12:06:28.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:28.123+0000 7f67467fc700 1 -- 172.21.15.45:0/3483537199 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f674000b910 con 0x7f67480b20b0 2023-11-28T12:06:28.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:28.123+0000 7f67467fc700 1 -- 172.21.15.45:0/3483537199 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f674000bcc0 con 0x7f67480b20b0 2023-11-28T12:06:28.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:28.123+0000 7f674ddff700 1 -- 172.21.15.45:0/3483537199 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f67480b20b0 msgr2=0x7f67480b0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:28.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:28.123+0000 7f674ddff700 1 --2- 172.21.15.45:0/3483537199 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f67480b20b0 0x7f67480b0c00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f67480ca0b0 tx=0x7f674000b330 comp rx=0 tx=0).stop 2023-11-28T12:06:28.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:28.124+0000 7f674ddff700 1 -- 172.21.15.45:0/3483537199 shutdown_connections 2023-11-28T12:06:28.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:28.124+0000 7f674ddff700 1 --2- 172.21.15.45:0/3483537199 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f67480b20b0 0x7f67480b0c00 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:28.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:28.124+0000 7f674ddff700 1 --2- 172.21.15.45:0/3483537199 >> v2:172.21.15.152:3300/0 conn(0x7f67480d1330 0x7f67480b06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:28.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:28.124+0000 7f674ddff700 1 -- 172.21.15.45:0/3483537199 >> 172.21.15.45:0/3483537199 conn(0x7f674809c3f0 msgr2=0x7f67480d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:28.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:28.124+0000 7f674ddff700 1 -- 172.21.15.45:0/3483537199 shutdown_connections 2023-11-28T12:06:28.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:28.124+0000 7f674ddff700 1 -- 172.21.15.45:0/3483537199 wait complete. 2023-11-28T12:06:28.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:28.125+0000 7f674ddff700 1 Processor -- start 2023-11-28T12:06:28.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:28.126+0000 7f674ddff700 1 -- start start 2023-11-28T12:06:28.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:28.126+0000 7f674ddff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f67480b20b0 0x7f674815b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:28.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:28.126+0000 7f674ddff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f67480d01b0 0x7f674809f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:28.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:28.127+0000 7f674ddff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f67480d1330 0x7f674809fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:28.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:28.127+0000 7f674ddff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67481e67e0 con 0x7f67480d1330 2023-11-28T12:06:28.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:28.127+0000 7f674ddff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f674809d000 con 0x7f67480d01b0 2023-11-28T12:06:28.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:28.127+0000 7f674ddff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67480a0250 con 0x7f67480b20b0 2023-11-28T12:06:28.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:28.127+0000 7f6747fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f67480d1330 0x7f674809fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:28.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:28.127+0000 7f6747fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f67480d1330 0x7f674809fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46508/0 (socket says 172.21.15.45:46508) 2023-11-28T12:06:28.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:28.127+0000 7f6747fff700 1 -- 172.21.15.45:0/3449626021 learned_addr learned my addr 172.21.15.45:0/3449626021 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:28.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:28.127+0000 7f67477fe700 1 --2- 172.21.15.45:0/3449626021 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f67480b20b0 0x7f674815b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:28.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:28.127+0000 7f6746ffd700 1 --2- 172.21.15.45:0/3449626021 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f67480d01b0 0x7f674809f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:28.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:28.127+0000 7f6747fff700 1 -- 172.21.15.45:0/3449626021 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f67480b20b0 msgr2=0x7f674815b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:28.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:28.127+0000 7f6747fff700 1 --2- 172.21.15.45:0/3449626021 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f67480b20b0 0x7f674815b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:28.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:28.127+0000 7f6747fff700 1 -- 172.21.15.45:0/3449626021 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f67480d01b0 msgr2=0x7f674809f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:28.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:28.127+0000 7f6747fff700 1 --2- 172.21.15.45:0/3449626021 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f67480d01b0 0x7f674809f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:28.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:28.127+0000 7f6747fff700 1 -- 172.21.15.45:0/3449626021 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6740009b30 con 0x7f67480d1330 2023-11-28T12:06:28.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:28.128+0000 7f6747fff700 1 --2- 172.21.15.45:0/3449626021 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f67480d1330 0x7f674809fc20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6740012000 tx=0x7f6740004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:28.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:28.128+0000 7f672ffff700 1 -- 172.21.15.45:0/3449626021 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6740004880 con 0x7f67480d1330 2023-11-28T12:06:28.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:28.128+0000 7f672ffff700 1 -- 172.21.15.45:0/3449626021 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67400099b0 con 0x7f67480d1330 2023-11-28T12:06:28.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:28.128+0000 7f672ffff700 1 -- 172.21.15.45:0/3449626021 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f674001c680 con 0x7f67480d1330 2023-11-28T12:06:28.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:28.128+0000 7f674ddff700 1 -- 172.21.15.45:0/3449626021 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67480afec0 con 0x7f67480d1330 2023-11-28T12:06:28.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:28.128+0000 7f674ddff700 1 -- 172.21.15.45:0/3449626021 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67480afbe0 con 0x7f67480d1330 2023-11-28T12:06:28.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:28.129+0000 7f674ddff700 1 -- 172.21.15.45:0/3449626021 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67480b2600 con 0x7f67480d1330 2023-11-28T12:06:28.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:28.130+0000 7f672ffff700 1 -- 172.21.15.45:0/3449626021 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f6740022030 con 0x7f67480d1330 2023-11-28T12:06:28.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:28.131+0000 7f672ffff700 1 --2- 172.21.15.45:0/3449626021 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f67340682f0 0x7f673406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:28.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:28.131+0000 7f672ffff700 1 -- 172.21.15.45:0/3449626021 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f67400872f0 con 0x7f67480d1330 2023-11-28T12:06:28.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:28.131+0000 7f67477fe700 1 --2- 172.21.15.45:0/3449626021 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f67340682f0 0x7f673406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:28.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:28.132+0000 7f67477fe700 1 --2- 172.21.15.45:0/3449626021 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f67340682f0 0x7f673406a7a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6738007fd0 tx=0x7f6738009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:28.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:28.136+0000 7f672ffff700 1 -- 172.21.15.45:0/3449626021 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f6740053c40 con 0x7f67480d1330 2023-11-28T12:06:28.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:28.343+0000 7f674ddff700 1 -- 172.21.15.45:0/3449626021 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f6748068690 con 0x7f67480d1330 2023-11-28T12:06:28.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:28.883+0000 7f672ffff700 1 -- 172.21.15.45:0/3449626021 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) v1 ==== 170+0+0 (secure 0 0 0) 0x7f6740057260 con 0x7f67480d1330 2023-11-28T12:06:28.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:28.889+0000 7f674ddff700 1 -- 172.21.15.45:0/3449626021 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f67340682f0 msgr2=0x7f673406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:28.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:28.889+0000 7f674ddff700 1 --2- 172.21.15.45:0/3449626021 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f67340682f0 0x7f673406a7a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6738007fd0 tx=0x7f6738009040 comp rx=0 tx=0).stop 2023-11-28T12:06:28.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:28.890+0000 7f674ddff700 1 -- 172.21.15.45:0/3449626021 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f67480d1330 msgr2=0x7f674809fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:28.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:28.890+0000 7f674ddff700 1 --2- 172.21.15.45:0/3449626021 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f67480d1330 0x7f674809fc20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6740012000 tx=0x7f6740004ad0 comp rx=0 tx=0).stop 2023-11-28T12:06:28.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:28.891+0000 7f674ddff700 1 -- 172.21.15.45:0/3449626021 shutdown_connections 2023-11-28T12:06:28.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:28.891+0000 7f674ddff700 1 --2- 172.21.15.45:0/3449626021 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f67340682f0 0x7f673406a7a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:28.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:28.891+0000 7f674ddff700 1 --2- 172.21.15.45:0/3449626021 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f67480d1330 0x7f674809fc20 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:28.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:28.891+0000 7f674ddff700 1 --2- 172.21.15.45:0/3449626021 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f67480b20b0 0x7f674815b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:28.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:28.891+0000 7f674ddff700 1 --2- 172.21.15.45:0/3449626021 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f67480d01b0 0x7f674809f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:28.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:28.891+0000 7f674ddff700 1 -- 172.21.15.45:0/3449626021 >> 172.21.15.45:0/3449626021 conn(0x7f674809c3f0 msgr2=0x7f674806b150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:28.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:28.893+0000 7f674ddff700 1 -- 172.21.15.45:0/3449626021 shutdown_connections 2023-11-28T12:06:28.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:28.894+0000 7f674ddff700 1 -- 172.21.15.45:0/3449626021 wait complete. 2023-11-28T12:06:28.898 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' created 2023-11-28T12:06:28.926 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-28T12:06:29.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.133+0000 7f5c3b1ff700 1 Processor -- start 2023-11-28T12:06:29.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.133+0000 7f5c3b1ff700 1 -- start start 2023-11-28T12:06:29.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.134+0000 7f5c3b1ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5c3415c9b0 0x7f5c340b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:29.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.134+0000 7f5c3b1ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5c34161340 0x7f5c340d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:29.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.134+0000 7f5c3b1ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c340d1950 con 0x7f5c340d2320 2023-11-28T12:06:29.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.134+0000 7f5c3b1ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c340b5800 con 0x7f5c3415c9b0 2023-11-28T12:06:29.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.134+0000 7f5c3b1ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c340b5520 con 0x7f5c34161340 2023-11-28T12:06:29.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.134+0000 7f5c38f9b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5c3415c9b0 0x7f5c340b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:29.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.134+0000 7f5c3979c700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f5c340d2320 0x7f5c340cd7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:37776/0 (socket says 172.21.15.45:37776) 2023-11-28T12:06:29.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.134+0000 7f5c3979c700 1 -- 172.21.15.45:0/1125901521 learned_addr learned my addr 172.21.15.45:0/1125901521 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:06:29.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.134+0000 7f5c33fff700 1 --2- 172.21.15.45:0/1125901521 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5c34161340 0x7f5c340d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:29.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.135+0000 7f5c337fe700 1 -- 172.21.15.45:0/1125901521 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 824083961 0 0) 0x7f5c340d1950 con 0x7f5c340d2320 2023-11-28T12:06:29.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.135+0000 7f5c337fe700 1 -- 172.21.15.45:0/1125901521 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c240035b0 con 0x7f5c340d2320 2023-11-28T12:06:29.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.135+0000 7f5c38f9b700 1 -- 172.21.15.45:0/1125901521 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5c34161340 msgr2=0x7f5c340d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:06:29.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.135+0000 7f5c38f9b700 1 --2- 172.21.15.45:0/1125901521 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5c34161340 0x7f5c340d1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:29.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.135+0000 7f5c38f9b700 1 -- 172.21.15.45:0/1125901521 >> v1:172.21.15.45:6789/0 conn(0x7f5c340d2320 legacy=0x7f5c340cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:29.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.135+0000 7f5c38f9b700 1 -- 172.21.15.45:0/1125901521 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c340d1300 con 0x7f5c3415c9b0 2023-11-28T12:06:29.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.135+0000 7f5c38f9b700 1 --2- 172.21.15.45:0/1125901521 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c3415c9b0 0x7f5c340b4bf0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5c28009840 tx=0x7f5c28009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=842169fdcae7aeda server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:29.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.135+0000 7f5c337fe700 1 -- 172.21.15.45:0/1125901521 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c28011830 con 0x7f5c3415c9b0 2023-11-28T12:06:29.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.135+0000 7f5c337fe700 1 -- 172.21.15.45:0/1125901521 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c28011990 con 0x7f5c3415c9b0 2023-11-28T12:06:29.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.135+0000 7f5c337fe700 1 -- 172.21.15.45:0/1125901521 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c28011d20 con 0x7f5c3415c9b0 2023-11-28T12:06:29.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.136+0000 7f5c3b1ff700 1 -- 172.21.15.45:0/1125901521 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c3415c9b0 msgr2=0x7f5c340b4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:29.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.136+0000 7f5c3b1ff700 1 --2- 172.21.15.45:0/1125901521 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c3415c9b0 0x7f5c340b4bf0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5c28009840 tx=0x7f5c28009b50 comp rx=0 tx=0).stop 2023-11-28T12:06:29.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.136+0000 7f5c3b1ff700 1 -- 172.21.15.45:0/1125901521 shutdown_connections 2023-11-28T12:06:29.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.136+0000 7f5c3b1ff700 1 --2- 172.21.15.45:0/1125901521 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c3415c9b0 0x7f5c340b4bf0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:29.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.136+0000 7f5c3b1ff700 1 --2- 172.21.15.45:0/1125901521 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5c34161340 0x7f5c340d1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:29.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.136+0000 7f5c3b1ff700 1 -- 172.21.15.45:0/1125901521 >> 172.21.15.45:0/1125901521 conn(0x7f5c34072600 msgr2=0x7f5c340cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:29.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.136+0000 7f5c3b1ff700 1 -- 172.21.15.45:0/1125901521 shutdown_connections 2023-11-28T12:06:29.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.136+0000 7f5c3b1ff700 1 -- 172.21.15.45:0/1125901521 wait complete. 2023-11-28T12:06:29.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.138+0000 7f5c3b1ff700 1 Processor -- start 2023-11-28T12:06:29.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.138+0000 7f5c3b1ff700 1 -- start start 2023-11-28T12:06:29.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.139+0000 7f5c3b1ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c340d2320 0x7f5c34146300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:29.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.139+0000 7f5c3b1ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c3415c9b0 0x7f5c34151de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:29.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.139+0000 7f5c3b1ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5c34161340 0x7f5c34152320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:29.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.139+0000 7f5c3b1ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c34146840 con 0x7f5c3415c9b0 2023-11-28T12:06:29.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.139+0000 7f5c3b1ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c34154250 con 0x7f5c340d2320 2023-11-28T12:06:29.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.139+0000 7f5c3b1ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c34153640 con 0x7f5c34161340 2023-11-28T12:06:29.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.139+0000 7f5c33fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c3415c9b0 0x7f5c34151de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:29.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.139+0000 7f5c33fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c3415c9b0 0x7f5c34151de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46524/0 (socket says 172.21.15.45:46524) 2023-11-28T12:06:29.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.139+0000 7f5c33fff700 1 -- 172.21.15.45:0/3886123662 learned_addr learned my addr 172.21.15.45:0/3886123662 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:29.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.139+0000 7f5c3979c700 1 --2- 172.21.15.45:0/3886123662 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5c34161340 0x7f5c34152320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:29.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.139+0000 7f5c38f9b700 1 --2- 172.21.15.45:0/3886123662 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c340d2320 0x7f5c34146300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:29.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.139+0000 7f5c33fff700 1 -- 172.21.15.45:0/3886123662 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5c34161340 msgr2=0x7f5c34152320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:29.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.140+0000 7f5c33fff700 1 --2- 172.21.15.45:0/3886123662 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5c34161340 0x7f5c34152320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:29.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.140+0000 7f5c33fff700 1 -- 172.21.15.45:0/3886123662 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c340d2320 msgr2=0x7f5c34146300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:29.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.140+0000 7f5c33fff700 1 --2- 172.21.15.45:0/3886123662 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c340d2320 0x7f5c34146300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:29.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.140+0000 7f5c33fff700 1 -- 172.21.15.45:0/3886123662 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c280094a0 con 0x7f5c3415c9b0 2023-11-28T12:06:29.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.140+0000 7f5c3979c700 1 --2- 172.21.15.45:0/3886123662 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5c34161340 0x7f5c34152320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:06:29.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.140+0000 7f5c38f9b700 1 --2- 172.21.15.45:0/3886123662 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c340d2320 0x7f5c34146300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:06:29.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.140+0000 7f5c33fff700 1 --2- 172.21.15.45:0/3886123662 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c3415c9b0 0x7f5c34151de0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5c2000e9b0 tx=0x7f5c2000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:29.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.140+0000 7f5c317fa700 1 -- 172.21.15.45:0/3886123662 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c20009710 con 0x7f5c3415c9b0 2023-11-28T12:06:29.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.140+0000 7f5c317fa700 1 -- 172.21.15.45:0/3886123662 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c2000c850 con 0x7f5c3415c9b0 2023-11-28T12:06:29.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.140+0000 7f5c317fa700 1 -- 172.21.15.45:0/3886123662 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c2000cbc0 con 0x7f5c3415c9b0 2023-11-28T12:06:29.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.140+0000 7f5c3b1ff700 1 -- 172.21.15.45:0/3886123662 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c340b5130 con 0x7f5c3415c9b0 2023-11-28T12:06:29.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.140+0000 7f5c3b1ff700 1 -- 172.21.15.45:0/3886123662 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c340d15e0 con 0x7f5c3415c9b0 2023-11-28T12:06:29.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.141+0000 7f5c3b1ff700 1 -- 172.21.15.45:0/3886123662 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c340b52c0 con 0x7f5c3415c9b0 2023-11-28T12:06:29.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.142+0000 7f5c317fa700 1 -- 172.21.15.45:0/3886123662 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f5c20019030 con 0x7f5c3415c9b0 2023-11-28T12:06:29.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.143+0000 7f5c317fa700 1 --2- 172.21.15.45:0/3886123662 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5c18068340 0x7f5c1806a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:29.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.144+0000 7f5c317fa700 1 -- 172.21.15.45:0/3886123662 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f5c20085c70 con 0x7f5c3415c9b0 2023-11-28T12:06:29.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.144+0000 7f5c38f9b700 1 --2- 172.21.15.45:0/3886123662 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5c18068340 0x7f5c1806a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:29.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.144+0000 7f5c38f9b700 1 --2- 172.21.15.45:0/3886123662 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5c18068340 0x7f5c1806a7f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5c280090b0 tx=0x7f5c28008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:29.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.148+0000 7f5c317fa700 1 -- 172.21.15.45:0/3886123662 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f5c200524c0 con 0x7f5c3415c9b0 2023-11-28T12:06:29.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.392+0000 7f5c3b1ff700 1 -- 172.21.15.45:0/3886123662 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f5c340745c0 con 0x7f5c3415c9b0 2023-11-28T12:06:29.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.398+0000 7f5c317fa700 1 -- 172.21.15.45:0/3886123662 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f5c200170c0 con 0x7f5c3415c9b0 2023-11-28T12:06:29.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.402+0000 7f5c3b1ff700 1 -- 172.21.15.45:0/3886123662 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5c18068340 msgr2=0x7f5c1806a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:29.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.402+0000 7f5c3b1ff700 1 --2- 172.21.15.45:0/3886123662 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5c18068340 0x7f5c1806a7f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5c280090b0 tx=0x7f5c28008030 comp rx=0 tx=0).stop 2023-11-28T12:06:29.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.402+0000 7f5c3b1ff700 1 -- 172.21.15.45:0/3886123662 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c3415c9b0 msgr2=0x7f5c34151de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:29.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.402+0000 7f5c3b1ff700 1 --2- 172.21.15.45:0/3886123662 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c3415c9b0 0x7f5c34151de0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5c2000e9b0 tx=0x7f5c2000ed70 comp rx=0 tx=0).stop 2023-11-28T12:06:29.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.404+0000 7f5c3b1ff700 1 -- 172.21.15.45:0/3886123662 shutdown_connections 2023-11-28T12:06:29.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.404+0000 7f5c3b1ff700 1 --2- 172.21.15.45:0/3886123662 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5c18068340 0x7f5c1806a7f0 secure :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5c280090b0 tx=0x7f5c28008030 comp rx=0 tx=0).stop 2023-11-28T12:06:29.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.404+0000 7f5c3b1ff700 1 --2- 172.21.15.45:0/3886123662 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c340d2320 0x7f5c34146300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:29.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.404+0000 7f5c3b1ff700 1 --2- 172.21.15.45:0/3886123662 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5c34161340 0x7f5c34152320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:29.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.404+0000 7f5c3b1ff700 1 --2- 172.21.15.45:0/3886123662 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c3415c9b0 0x7f5c34151de0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:29.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.404+0000 7f5c3b1ff700 1 -- 172.21.15.45:0/3886123662 >> 172.21.15.45:0/3886123662 conn(0x7f5c34072600 msgr2=0x7f5c3415cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:29.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.406+0000 7f5c3b1ff700 1 -- 172.21.15.45:0/3886123662 shutdown_connections 2023-11-28T12:06:29.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.407+0000 7f5c3b1ff700 1 -- 172.21.15.45:0/3886123662 wait complete. 2023-11-28T12:06:29.416 INFO:teuthology.orchestra.run.smithi045.stderr:new fs with metadata pool 3 and data pool 4 2023-11-28T12:06:29.443 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T12:06:29.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.645+0000 7ff0aa5ff700 1 Processor -- start 2023-11-28T12:06:29.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.645+0000 7ff0aa5ff700 1 -- start start 2023-11-28T12:06:29.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.646+0000 7ff0aa5ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff0a415c9b0 0x7ff0a40b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:29.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.646+0000 7ff0aa5ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ff0a4161340 0x7ff0a40d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:29.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.646+0000 7ff0aa5ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0a40d1950 con 0x7ff0a40d2320 2023-11-28T12:06:29.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.646+0000 7ff0aa5ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0a40b5800 con 0x7ff0a4161340 2023-11-28T12:06:29.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.646+0000 7ff0aa5ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a40b5520 con 0x7ff0a415c9b0 2023-11-28T12:06:29.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.647+0000 7ff0a8b9c700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ff0a40d2320 0x7ff0a40cd7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:37780/0 (socket says 172.21.15.45:37780) 2023-11-28T12:06:29.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.647+0000 7ff0a8b9c700 1 -- 172.21.15.45:0/614695782 learned_addr learned my addr 172.21.15.45:0/614695782 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:06:29.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.647+0000 7ff0a3fff700 1 --2- 172.21.15.45:0/614695782 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff0a415c9b0 0x7ff0a40b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:29.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.647+0000 7ff0a37fe700 1 --2- 172.21.15.45:0/614695782 >> v2:172.21.15.152:3300/0 conn(0x7ff0a4161340 0x7ff0a40d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:29.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.647+0000 7ff0a2ffd700 1 -- 172.21.15.45:0/614695782 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 360287309 0 0) 0x7ff0a40d1950 con 0x7ff0a40d2320 2023-11-28T12:06:29.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.647+0000 7ff0a2ffd700 1 -- 172.21.15.45:0/614695782 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff08c0035b0 con 0x7ff0a40d2320 2023-11-28T12:06:29.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.647+0000 7ff0a37fe700 1 -- 172.21.15.45:0/614695782 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff0a415c9b0 msgr2=0x7ff0a40b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:06:29.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.647+0000 7ff0a37fe700 1 --2- 172.21.15.45:0/614695782 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff0a415c9b0 0x7ff0a40b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:29.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.647+0000 7ff0a37fe700 1 -- 172.21.15.45:0/614695782 >> v1:172.21.15.45:6789/0 conn(0x7ff0a40d2320 legacy=0x7ff0a40cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:29.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.647+0000 7ff0a37fe700 1 -- 172.21.15.45:0/614695782 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0a40d1300 con 0x7ff0a4161340 2023-11-28T12:06:29.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.647+0000 7ff0a3fff700 1 --2- 172.21.15.45:0/614695782 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff0a415c9b0 0x7ff0a40b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:06:29.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.648+0000 7ff0a37fe700 1 --2- 172.21.15.45:0/614695782 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0a4161340 0x7ff0a40d1de0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff098009840 tx=0x7ff098009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a21fd844a8e244ca server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:29.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.648+0000 7ff0a2ffd700 1 -- 172.21.15.45:0/614695782 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff098011830 con 0x7ff0a4161340 2023-11-28T12:06:29.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.648+0000 7ff0a2ffd700 1 -- 172.21.15.45:0/614695782 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff098011990 con 0x7ff0a4161340 2023-11-28T12:06:29.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.648+0000 7ff0a2ffd700 1 -- 172.21.15.45:0/614695782 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff098011d00 con 0x7ff0a4161340 2023-11-28T12:06:29.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.648+0000 7ff0aa5ff700 1 -- 172.21.15.45:0/614695782 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0a4161340 msgr2=0x7ff0a40d1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:29.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.648+0000 7ff0aa5ff700 1 --2- 172.21.15.45:0/614695782 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0a4161340 0x7ff0a40d1de0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff098009840 tx=0x7ff098009b50 comp rx=0 tx=0).stop 2023-11-28T12:06:29.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.648+0000 7ff0aa5ff700 1 -- 172.21.15.45:0/614695782 shutdown_connections 2023-11-28T12:06:29.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.648+0000 7ff0aa5ff700 1 --2- 172.21.15.45:0/614695782 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff0a415c9b0 0x7ff0a40b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:29.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.648+0000 7ff0aa5ff700 1 --2- 172.21.15.45:0/614695782 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0a4161340 0x7ff0a40d1de0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:29.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.648+0000 7ff0aa5ff700 1 -- 172.21.15.45:0/614695782 >> 172.21.15.45:0/614695782 conn(0x7ff0a4072600 msgr2=0x7ff0a40cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:29.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.649+0000 7ff0aa5ff700 1 -- 172.21.15.45:0/614695782 shutdown_connections 2023-11-28T12:06:29.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.649+0000 7ff0aa5ff700 1 -- 172.21.15.45:0/614695782 wait complete. 2023-11-28T12:06:29.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.650+0000 7ff0aa5ff700 1 Processor -- start 2023-11-28T12:06:29.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.650+0000 7ff0aa5ff700 1 -- start start 2023-11-28T12:06:29.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.651+0000 7ff0aa5ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff0a40d2320 0x7ff0a40c6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:29.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.651+0000 7ff0aa5ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0a415c9b0 0x7ff0a40c99c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:29.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.651+0000 7ff0aa5ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0a4161340 0x7ff0a415f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:29.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.651+0000 7ff0aa5ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a41529c0 con 0x7ff0a4161340 2023-11-28T12:06:29.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.651+0000 7ff0aa5ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a40c7d70 con 0x7ff0a415c9b0 2023-11-28T12:06:29.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.651+0000 7ff0aa5ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a40c74d0 con 0x7ff0a40d2320 2023-11-28T12:06:29.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.652+0000 7ff0a8b9c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0a4161340 0x7ff0a415f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:29.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.652+0000 7ff0a3fff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff0a40d2320 0x7ff0a40c6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:29.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.652+0000 7ff0a37fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0a415c9b0 0x7ff0a40c99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:29.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.652+0000 7ff0a3fff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff0a40d2320 0x7ff0a40c6ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.45:52566/0 (socket says 172.21.15.45:52566) 2023-11-28T12:06:29.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.652+0000 7ff0a3fff700 1 -- 172.21.15.45:0/4118079816 learned_addr learned my addr 172.21.15.45:0/4118079816 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:29.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.652+0000 7ff0a8b9c700 1 -- 172.21.15.45:0/4118079816 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff0a40d2320 msgr2=0x7ff0a40c6ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:29.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.652+0000 7ff0a8b9c700 1 --2- 172.21.15.45:0/4118079816 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff0a40d2320 0x7ff0a40c6ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:29.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.652+0000 7ff0a8b9c700 1 -- 172.21.15.45:0/4118079816 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0a415c9b0 msgr2=0x7ff0a40c99c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:29.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.652+0000 7ff0a8b9c700 1 --2- 172.21.15.45:0/4118079816 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0a415c9b0 0x7ff0a40c99c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:29.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.652+0000 7ff0a8b9c700 1 -- 172.21.15.45:0/4118079816 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0940094a0 con 0x7ff0a4161340 2023-11-28T12:06:29.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.653+0000 7ff0a8b9c700 1 --2- 172.21.15.45:0/4118079816 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0a4161340 0x7ff0a415f170 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff09c00caa0 tx=0x7ff09c00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:29.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.653+0000 7ff0a0ff9700 1 -- 172.21.15.45:0/4118079816 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff09c00a9e0 con 0x7ff0a4161340 2023-11-28T12:06:29.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.653+0000 7ff0a0ff9700 1 -- 172.21.15.45:0/4118079816 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff09c00ab40 con 0x7ff0a4161340 2023-11-28T12:06:29.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.653+0000 7ff0aa5ff700 1 -- 172.21.15.45:0/4118079816 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0980094a0 con 0x7ff0a4161340 2023-11-28T12:06:29.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.653+0000 7ff0a0ff9700 1 -- 172.21.15.45:0/4118079816 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff09c012400 con 0x7ff0a4161340 2023-11-28T12:06:29.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.653+0000 7ff0aa5ff700 1 -- 172.21.15.45:0/4118079816 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0a40b5130 con 0x7ff0a4161340 2023-11-28T12:06:29.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.654+0000 7ff0aa5ff700 1 -- 172.21.15.45:0/4118079816 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0a40d15e0 con 0x7ff0a4161340 2023-11-28T12:06:29.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.655+0000 7ff0a0ff9700 1 -- 172.21.15.45:0/4118079816 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7ff09c019030 con 0x7ff0a4161340 2023-11-28T12:06:29.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.656+0000 7ff0a0ff9700 1 --2- 172.21.15.45:0/4118079816 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7ff0900682f0 0x7ff09006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:29.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.656+0000 7ff0a0ff9700 1 -- 172.21.15.45:0/4118079816 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff09c085640 con 0x7ff0a4161340 2023-11-28T12:06:29.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.656+0000 7ff0a3fff700 1 --2- 172.21.15.45:0/4118079816 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7ff0900682f0 0x7ff09006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:29.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.657+0000 7ff0a3fff700 1 --2- 172.21.15.45:0/4118079816 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7ff0900682f0 0x7ff09006a7a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff094009dd0 tx=0x7ff094009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:29.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.660+0000 7ff0a0ff9700 1 -- 172.21.15.45:0/4118079816 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7ff09c04b5e0 con 0x7ff0a4161340 2023-11-28T12:06:29.768 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T12:06:29.773 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T12:06:29.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.862+0000 7ff0aa5ff700 1 -- 172.21.15.45:0/4118079816 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff0a40b52c0 con 0x7ff0a4161340 2023-11-28T12:06:29.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.863+0000 7ff0a0ff9700 1 -- 172.21.15.45:0/4118079816 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+17862 (secure 0 0 0) 0x7ff09c051e60 con 0x7ff0a4161340 2023-11-28T12:06:29.864 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:06:29.864 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":19,"fsid":"bd7c37f1-f7c6-4778-b845-52cf2aa6e366","created":"2023-11-28T12:06:09.045075+0000","modified":"2023-11-28T12:06:29.393829+0000","last_up_change":"2023-11-28T12:06:21.282227+0000","last_in_change":"2023-11-28T12:06:12.560924+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T12:06:21.807108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T12:06:22.491009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T12:06:27.684157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T12:06:28.384679+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d0cdd8a-87fd-4f2c-91bd-47bdfa661905","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":115843},{"type":"v1","addr":"172.21.15.45:6808","nonce":115843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":115843},{"type":"v1","addr":"172.21.15.45:6811","nonce":115843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":115843},{"type":"v1","addr":"172.21.15.45:6815","nonce":115843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":115843},{"type":"v1","addr":"172.21.15.45:6813","nonce":115843}]},"public_addr":"172.21.15.45:6808/115843","cluster_addr":"172.21.15.45:6811/115843","heartbeat_back_addr":"172.21.15.45:6815/115843","heartbeat_front_addr":"172.21.15.45:6813/115843","state":["exists","up"]},{"osd":1,"uuid":"c5de4ebd-9ec5-40b3-9caa-9b706fab4c76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":115842},{"type":"v1","addr":"172.21.15.45:6801","nonce":115842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":115842},{"type":"v1","addr":"172.21.15.45:6803","nonce":115842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6807","nonce":115842},{"type":"v1","addr":"172.21.15.45:6809","nonce":115842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":115842},{"type":"v1","addr":"172.21.15.45:6805","nonce":115842}]},"public_addr":"172.21.15.45:6801/115842","cluster_addr":"172.21.15.45:6803/115842","heartbeat_back_addr":"172.21.15.45:6809/115842","heartbeat_front_addr":"172.21.15.45:6805/115842","state":["exists","up"]},{"osd":2,"uuid":"9f4b36b2-65d2-40e7-9fe6-a2991afa71c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":115850},{"type":"v1","addr":"172.21.15.45:6819","nonce":115850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":115850},{"type":"v1","addr":"172.21.15.45:6823","nonce":115850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":115850},{"type":"v1","addr":"172.21.15.45:6831","nonce":115850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":115850},{"type":"v1","addr":"172.21.15.45:6828","nonce":115850}]},"public_addr":"172.21.15.45:6819/115850","cluster_addr":"172.21.15.45:6823/115850","heartbeat_back_addr":"172.21.15.45:6831/115850","heartbeat_front_addr":"172.21.15.45:6828/115850","state":["exists","up"]},{"osd":3,"uuid":"6fe7ef05-4e0d-426c-bf94-44b51d4d550b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":115848},{"type":"v1","addr":"172.21.15.45:6818","nonce":115848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":115848},{"type":"v1","addr":"172.21.15.45:6822","nonce":115848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6827","nonce":115848},{"type":"v1","addr":"172.21.15.45:6829","nonce":115848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":115848},{"type":"v1","addr":"172.21.15.45:6825","nonce":115848}]},"public_addr":"172.21.15.45:6818/115848","cluster_addr":"172.21.15.45:6822/115848","heartbeat_back_addr":"172.21.15.45:6829/115848","heartbeat_front_addr":"172.21.15.45:6825/115848","state":["exists","up"]},{"osd":4,"uuid":"fa403c08-d8a1-4a3a-8384-cb465c1a654c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":116092},{"type":"v1","addr":"172.21.15.152:6801","nonce":116092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":116092},{"type":"v1","addr":"172.21.15.152:6803","nonce":116092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":116092},{"type":"v1","addr":"172.21.15.152:6807","nonce":116092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":116092},{"type":"v1","addr":"172.21.15.152:6805","nonce":116092}]},"public_addr":"172.21.15.152:6801/116092","cluster_addr":"172.21.15.152:6803/116092","heartbeat_back_addr":"172.21.15.152:6807/116092","heartbeat_front_addr":"172.21.15.152:6805/116092","state":["exists","up"]},{"osd":5,"uuid":"399fc450-39fa-43a6-bf80-0b8bcb41bd95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6815","nonce":116093},{"type":"v1","addr":"172.21.15.152:6817","nonce":116093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":116093},{"type":"v1","addr":"172.21.15.152:6819","nonce":116093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":116093},{"type":"v1","addr":"172.21.15.152:6823","nonce":116093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":116093},{"type":"v1","addr":"172.21.15.152:6821","nonce":116093}]},"public_addr":"172.21.15.152:6817/116093","cluster_addr":"172.21.15.152:6819/116093","heartbeat_back_addr":"172.21.15.152:6823/116093","heartbeat_front_addr":"172.21.15.152:6821/116093","state":["exists","up"]},{"osd":6,"uuid":"e59a4017-2d23-4627-836b-e25b2d3ddaaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":116094},{"type":"v1","addr":"172.21.15.152:6809","nonce":116094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":116094},{"type":"v1","addr":"172.21.15.152:6811","nonce":116094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":116094},{"type":"v1","addr":"172.21.15.152:6816","nonce":116094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":116094},{"type":"v1","addr":"172.21.15.152:6813","nonce":116094}]},"public_addr":"172.21.15.152:6809/116094","cluster_addr":"172.21.15.152:6811/116094","heartbeat_back_addr":"172.21.15.152:6816/116094","heartbeat_front_addr":"172.21.15.152:6813/116094","state":["exists","up"]},{"osd":7,"uuid":"8d7f9d4b-bf08-4670-8591-388c0f012a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":116097},{"type":"v1","addr":"172.21.15.152:6825","nonce":116097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":116097},{"type":"v1","addr":"172.21.15.152:6827","nonce":116097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":116097},{"type":"v1","addr":"172.21.15.152:6831","nonce":116097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":116097},{"type":"v1","addr":"172.21.15.152:6829","nonce":116097}]},"public_addr":"172.21.15.152:6825/116097","cluster_addr":"172.21.15.152:6827/116097","heartbeat_back_addr":"172.21.15.152:6831/116097","heartbeat_front_addr":"172.21.15.152:6829/116097","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.937710+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.865423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.159434+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.913090+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.131647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.966255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.972583+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.177209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T12:06:29.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.865+0000 7ff0aa5ff700 1 -- 172.21.15.45:0/4118079816 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7ff0900682f0 msgr2=0x7ff09006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:29.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.865+0000 7ff0aa5ff700 1 --2- 172.21.15.45:0/4118079816 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7ff0900682f0 0x7ff09006a7a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff094009dd0 tx=0x7ff094009210 comp rx=0 tx=0).stop 2023-11-28T12:06:29.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.865+0000 7ff0aa5ff700 1 -- 172.21.15.45:0/4118079816 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0a4161340 msgr2=0x7ff0a415f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:29.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.865+0000 7ff0aa5ff700 1 --2- 172.21.15.45:0/4118079816 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0a4161340 0x7ff0a415f170 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff09c00caa0 tx=0x7ff09c00cdb0 comp rx=0 tx=0).stop 2023-11-28T12:06:29.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.866+0000 7ff0aa5ff700 1 -- 172.21.15.45:0/4118079816 shutdown_connections 2023-11-28T12:06:29.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.866+0000 7ff0aa5ff700 1 --2- 172.21.15.45:0/4118079816 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7ff0900682f0 0x7ff09006a7a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:29.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.866+0000 7ff0aa5ff700 1 --2- 172.21.15.45:0/4118079816 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0a4161340 0x7ff0a415f170 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:29.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.866+0000 7ff0aa5ff700 1 --2- 172.21.15.45:0/4118079816 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff0a40d2320 0x7ff0a40c6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:29.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.866+0000 7ff0aa5ff700 1 --2- 172.21.15.45:0/4118079816 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0a415c9b0 0x7ff0a40c99c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:29.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.866+0000 7ff0aa5ff700 1 -- 172.21.15.45:0/4118079816 >> 172.21.15.45:0/4118079816 conn(0x7ff0a4072600 msgr2=0x7ff0a415cd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:29.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.866+0000 7ff0aa5ff700 1 -- 172.21.15.45:0/4118079816 shutdown_connections 2023-11-28T12:06:29.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:29.866+0000 7ff0aa5ff700 1 -- 172.21.15.45:0/4118079816 wait complete. 2023-11-28T12:06:29.885 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T12:06:30.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.126+0000 7f15d2dff700 1 Processor -- start 2023-11-28T12:06:30.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.127+0000 7f15d2dff700 1 -- start start 2023-11-28T12:06:30.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.128+0000 7f15d2dff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f15cc15c9b0 0x7f15cc0b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:30.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.128+0000 7f15d2dff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15cc0d1950 con 0x7f15cc161340 2023-11-28T12:06:30.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.128+0000 7f15d2dff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15cc0d24f0 con 0x7f15cc0cd7c0 2023-11-28T12:06:30.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.128+0000 7f15d2dff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15cc0b5800 con 0x7f15cc15c9b0 2023-11-28T12:06:30.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.128+0000 7f15cbfff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f15cc161340 0x7f15cc0d1de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:37790/0 (socket says 172.21.15.45:37790) 2023-11-28T12:06:30.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.128+0000 7f15cbfff700 1 -- 172.21.15.45:0/4267679560 learned_addr learned my addr 172.21.15.45:0/4267679560 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:06:30.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.128+0000 7f15d0b9b700 1 --2- 172.21.15.45:0/4267679560 >> v2:172.21.15.45:3300/0 conn(0x7f15cc15c9b0 0x7f15cc0b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:30.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.129+0000 7f15d0b9b700 1 -- 172.21.15.45:0/4267679560 >> v1:172.21.15.152:6789/0 conn(0x7f15cc0cd7c0 legacy=0x7f15cc0b5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:30.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.129+0000 7f15d0b9b700 1 -- 172.21.15.45:0/4267679560 >> v1:172.21.15.45:6789/0 conn(0x7f15cc161340 legacy=0x7f15cc0d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:30.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.129+0000 7f15d0b9b700 1 -- 172.21.15.45:0/4267679560 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15cc0b5520 con 0x7f15cc15c9b0 2023-11-28T12:06:30.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.129+0000 7f15cb7fe700 1 -- 172.21.15.45:0/4267679560 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1478778495 0 0) 0x7f15cc0d24f0 con 0x7f15cc0cd7c0 2023-11-28T12:06:30.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.129+0000 7f15d0b9b700 1 --2- 172.21.15.45:0/4267679560 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15cc15c9b0 0x7f15cc0b4bf0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f15c0009840 tx=0x7f15c0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c239abdba7a0161 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:30.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.129+0000 7f15cb7fe700 1 -- 172.21.15.45:0/4267679560 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c0004230 con 0x7f15cc15c9b0 2023-11-28T12:06:30.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.129+0000 7f15cb7fe700 1 -- 172.21.15.45:0/4267679560 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15c0004390 con 0x7f15cc15c9b0 2023-11-28T12:06:30.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.129+0000 7f15cb7fe700 1 -- 172.21.15.45:0/4267679560 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c00036a0 con 0x7f15cc15c9b0 2023-11-28T12:06:30.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.130+0000 7f15d2dff700 1 -- 172.21.15.45:0/4267679560 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15cc15c9b0 msgr2=0x7f15cc0b4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:30.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.130+0000 7f15d2dff700 1 --2- 172.21.15.45:0/4267679560 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15cc15c9b0 0x7f15cc0b4bf0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f15c0009840 tx=0x7f15c0009b50 comp rx=0 tx=0).stop 2023-11-28T12:06:30.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.130+0000 7f15d2dff700 1 -- 172.21.15.45:0/4267679560 shutdown_connections 2023-11-28T12:06:30.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.130+0000 7f15d2dff700 1 --2- 172.21.15.45:0/4267679560 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15cc15c9b0 0x7f15cc0b4bf0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:30.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.130+0000 7f15d2dff700 1 -- 172.21.15.45:0/4267679560 >> 172.21.15.45:0/4267679560 conn(0x7f15cc072600 msgr2=0x7f15cc0cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:30.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.130+0000 7f15d2dff700 1 -- 172.21.15.45:0/4267679560 shutdown_connections 2023-11-28T12:06:30.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.130+0000 7f15d2dff700 1 -- 172.21.15.45:0/4267679560 wait complete. 2023-11-28T12:06:30.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.132+0000 7f15d2dff700 1 Processor -- start 2023-11-28T12:06:30.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.132+0000 7f15d2dff700 1 -- start start 2023-11-28T12:06:30.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.133+0000 7f15d2dff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f15cc0cd7c0 0x7f15cc147000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:30.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.133+0000 7f15d2dff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f15cc15c9b0 0x7f15cc0c82c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:30.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.133+0000 7f15d2dff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15cc161340 0x7f15cc1e6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:30.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.133+0000 7f15d2dff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15cc147540 con 0x7f15cc161340 2023-11-28T12:06:30.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.133+0000 7f15d2dff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15cc146b70 con 0x7f15cc15c9b0 2023-11-28T12:06:30.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.133+0000 7f15d2dff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15cc146530 con 0x7f15cc0cd7c0 2023-11-28T12:06:30.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.133+0000 7f15d139c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15cc161340 0x7f15cc1e6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:30.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.133+0000 7f15d139c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15cc161340 0x7f15cc1e6480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46564/0 (socket says 172.21.15.45:46564) 2023-11-28T12:06:30.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.133+0000 7f15d139c700 1 -- 172.21.15.45:0/1390064220 learned_addr learned my addr 172.21.15.45:0/1390064220 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:30.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.133+0000 7f15cbfff700 1 --2- 172.21.15.45:0/1390064220 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f15cc15c9b0 0x7f15cc0c82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:30.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.133+0000 7f15d0b9b700 1 --2- 172.21.15.45:0/1390064220 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f15cc0cd7c0 0x7f15cc147000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:30.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.133+0000 7f15d139c700 1 -- 172.21.15.45:0/1390064220 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f15cc0cd7c0 msgr2=0x7f15cc147000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:30.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.133+0000 7f15d139c700 1 --2- 172.21.15.45:0/1390064220 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f15cc0cd7c0 0x7f15cc147000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:30.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.133+0000 7f15d139c700 1 -- 172.21.15.45:0/1390064220 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f15cc15c9b0 msgr2=0x7f15cc0c82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:30.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.133+0000 7f15d139c700 1 --2- 172.21.15.45:0/1390064220 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f15cc15c9b0 0x7f15cc0c82c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:30.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.133+0000 7f15d139c700 1 -- 172.21.15.45:0/1390064220 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15c00094a0 con 0x7f15cc161340 2023-11-28T12:06:30.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.134+0000 7f15d139c700 1 --2- 172.21.15.45:0/1390064220 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15cc161340 0x7f15cc1e6480 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f15c400c760 tx=0x7f15c400cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:30.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.134+0000 7f15c97fa700 1 -- 172.21.15.45:0/1390064220 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c4003e30 con 0x7f15cc161340 2023-11-28T12:06:30.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.134+0000 7f15c97fa700 1 -- 172.21.15.45:0/1390064220 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15c4005070 con 0x7f15cc161340 2023-11-28T12:06:30.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.134+0000 7f15d2dff700 1 -- 172.21.15.45:0/1390064220 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15cc0d15e0 con 0x7f15cc161340 2023-11-28T12:06:30.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.134+0000 7f15c97fa700 1 -- 172.21.15.45:0/1390064220 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c4005400 con 0x7f15cc161340 2023-11-28T12:06:30.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.134+0000 7f15d2dff700 1 -- 172.21.15.45:0/1390064220 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15cc0d1300 con 0x7f15cc161340 2023-11-28T12:06:30.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.136+0000 7f15d2dff700 1 -- 172.21.15.45:0/1390064220 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15cc0b5130 con 0x7f15cc161340 2023-11-28T12:06:30.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.136+0000 7f15c97fa700 1 -- 172.21.15.45:0/1390064220 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f15c4010070 con 0x7f15cc161340 2023-11-28T12:06:30.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.137+0000 7f15c97fa700 1 --2- 172.21.15.45:0/1390064220 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f15b00682f0 0x7f15b006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:30.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.137+0000 7f15c97fa700 1 -- 172.21.15.45:0/1390064220 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f15c4085960 con 0x7f15cc161340 2023-11-28T12:06:30.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.138+0000 7f15d0b9b700 1 --2- 172.21.15.45:0/1390064220 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f15b00682f0 0x7f15b006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:30.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.138+0000 7f15d0b9b700 1 --2- 172.21.15.45:0/1390064220 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f15b00682f0 0x7f15b006a7a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f15c00090b0 tx=0x7f15c0013040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:30.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.141+0000 7f15c97fa700 1 -- 172.21.15.45:0/1390064220 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f15c40520d0 con 0x7f15cc161340 2023-11-28T12:06:30.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.340+0000 7f15d2dff700 1 -- 172.21.15.45:0/1390064220 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f15cc0745c0 con 0x7f15cc161340 2023-11-28T12:06:30.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.341+0000 7f15c97fa700 1 -- 172.21.15.45:0/1390064220 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+17862 (secure 0 0 0) 0x7f15c40556f0 con 0x7f15cc161340 2023-11-28T12:06:30.342 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:06:30.343 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":19,"fsid":"bd7c37f1-f7c6-4778-b845-52cf2aa6e366","created":"2023-11-28T12:06:09.045075+0000","modified":"2023-11-28T12:06:29.393829+0000","last_up_change":"2023-11-28T12:06:21.282227+0000","last_in_change":"2023-11-28T12:06:12.560924+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T12:06:21.807108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T12:06:22.491009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T12:06:27.684157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T12:06:28.384679+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d0cdd8a-87fd-4f2c-91bd-47bdfa661905","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":115843},{"type":"v1","addr":"172.21.15.45:6808","nonce":115843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":115843},{"type":"v1","addr":"172.21.15.45:6811","nonce":115843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":115843},{"type":"v1","addr":"172.21.15.45:6815","nonce":115843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":115843},{"type":"v1","addr":"172.21.15.45:6813","nonce":115843}]},"public_addr":"172.21.15.45:6808/115843","cluster_addr":"172.21.15.45:6811/115843","heartbeat_back_addr":"172.21.15.45:6815/115843","heartbeat_front_addr":"172.21.15.45:6813/115843","state":["exists","up"]},{"osd":1,"uuid":"c5de4ebd-9ec5-40b3-9caa-9b706fab4c76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":115842},{"type":"v1","addr":"172.21.15.45:6801","nonce":115842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":115842},{"type":"v1","addr":"172.21.15.45:6803","nonce":115842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6807","nonce":115842},{"type":"v1","addr":"172.21.15.45:6809","nonce":115842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":115842},{"type":"v1","addr":"172.21.15.45:6805","nonce":115842}]},"public_addr":"172.21.15.45:6801/115842","cluster_addr":"172.21.15.45:6803/115842","heartbeat_back_addr":"172.21.15.45:6809/115842","heartbeat_front_addr":"172.21.15.45:6805/115842","state":["exists","up"]},{"osd":2,"uuid":"9f4b36b2-65d2-40e7-9fe6-a2991afa71c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":115850},{"type":"v1","addr":"172.21.15.45:6819","nonce":115850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":115850},{"type":"v1","addr":"172.21.15.45:6823","nonce":115850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":115850},{"type":"v1","addr":"172.21.15.45:6831","nonce":115850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":115850},{"type":"v1","addr":"172.21.15.45:6828","nonce":115850}]},"public_addr":"172.21.15.45:6819/115850","cluster_addr":"172.21.15.45:6823/115850","heartbeat_back_addr":"172.21.15.45:6831/115850","heartbeat_front_addr":"172.21.15.45:6828/115850","state":["exists","up"]},{"osd":3,"uuid":"6fe7ef05-4e0d-426c-bf94-44b51d4d550b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":115848},{"type":"v1","addr":"172.21.15.45:6818","nonce":115848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":115848},{"type":"v1","addr":"172.21.15.45:6822","nonce":115848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6827","nonce":115848},{"type":"v1","addr":"172.21.15.45:6829","nonce":115848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":115848},{"type":"v1","addr":"172.21.15.45:6825","nonce":115848}]},"public_addr":"172.21.15.45:6818/115848","cluster_addr":"172.21.15.45:6822/115848","heartbeat_back_addr":"172.21.15.45:6829/115848","heartbeat_front_addr":"172.21.15.45:6825/115848","state":["exists","up"]},{"osd":4,"uuid":"fa403c08-d8a1-4a3a-8384-cb465c1a654c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":116092},{"type":"v1","addr":"172.21.15.152:6801","nonce":116092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":116092},{"type":"v1","addr":"172.21.15.152:6803","nonce":116092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":116092},{"type":"v1","addr":"172.21.15.152:6807","nonce":116092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":116092},{"type":"v1","addr":"172.21.15.152:6805","nonce":116092}]},"public_addr":"172.21.15.152:6801/116092","cluster_addr":"172.21.15.152:6803/116092","heartbeat_back_addr":"172.21.15.152:6807/116092","heartbeat_front_addr":"172.21.15.152:6805/116092","state":["exists","up"]},{"osd":5,"uuid":"399fc450-39fa-43a6-bf80-0b8bcb41bd95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6815","nonce":116093},{"type":"v1","addr":"172.21.15.152:6817","nonce":116093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":116093},{"type":"v1","addr":"172.21.15.152:6819","nonce":116093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":116093},{"type":"v1","addr":"172.21.15.152:6823","nonce":116093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":116093},{"type":"v1","addr":"172.21.15.152:6821","nonce":116093}]},"public_addr":"172.21.15.152:6817/116093","cluster_addr":"172.21.15.152:6819/116093","heartbeat_back_addr":"172.21.15.152:6823/116093","heartbeat_front_addr":"172.21.15.152:6821/116093","state":["exists","up"]},{"osd":6,"uuid":"e59a4017-2d23-4627-836b-e25b2d3ddaaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":116094},{"type":"v1","addr":"172.21.15.152:6809","nonce":116094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":116094},{"type":"v1","addr":"172.21.15.152:6811","nonce":116094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":116094},{"type":"v1","addr":"172.21.15.152:6816","nonce":116094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":116094},{"type":"v1","addr":"172.21.15.152:6813","nonce":116094}]},"public_addr":"172.21.15.152:6809/116094","cluster_addr":"172.21.15.152:6811/116094","heartbeat_back_addr":"172.21.15.152:6816/116094","heartbeat_front_addr":"172.21.15.152:6813/116094","state":["exists","up"]},{"osd":7,"uuid":"8d7f9d4b-bf08-4670-8591-388c0f012a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":116097},{"type":"v1","addr":"172.21.15.152:6825","nonce":116097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":116097},{"type":"v1","addr":"172.21.15.152:6827","nonce":116097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":116097},{"type":"v1","addr":"172.21.15.152:6831","nonce":116097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":116097},{"type":"v1","addr":"172.21.15.152:6829","nonce":116097}]},"public_addr":"172.21.15.152:6825/116097","cluster_addr":"172.21.15.152:6827/116097","heartbeat_back_addr":"172.21.15.152:6831/116097","heartbeat_front_addr":"172.21.15.152:6829/116097","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.937710+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.865423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.159434+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.913090+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.131647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.966255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.972583+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.177209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T12:06:30.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.344+0000 7f15d2dff700 1 -- 172.21.15.45:0/1390064220 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f15b00682f0 msgr2=0x7f15b006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:30.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.344+0000 7f15d2dff700 1 --2- 172.21.15.45:0/1390064220 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f15b00682f0 0x7f15b006a7a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f15c00090b0 tx=0x7f15c0013040 comp rx=0 tx=0).stop 2023-11-28T12:06:30.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.344+0000 7f15d2dff700 1 -- 172.21.15.45:0/1390064220 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15cc161340 msgr2=0x7f15cc1e6480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:30.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.344+0000 7f15d2dff700 1 --2- 172.21.15.45:0/1390064220 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15cc161340 0x7f15cc1e6480 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f15c400c760 tx=0x7f15c400cb20 comp rx=0 tx=0).stop 2023-11-28T12:06:30.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.344+0000 7f15d2dff700 1 -- 172.21.15.45:0/1390064220 shutdown_connections 2023-11-28T12:06:30.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.344+0000 7f15d2dff700 1 --2- 172.21.15.45:0/1390064220 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f15b00682f0 0x7f15b006a7a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:30.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.344+0000 7f15d2dff700 1 --2- 172.21.15.45:0/1390064220 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15cc161340 0x7f15cc1e6480 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:30.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.344+0000 7f15d2dff700 1 --2- 172.21.15.45:0/1390064220 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f15cc0cd7c0 0x7f15cc147000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:30.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.344+0000 7f15d2dff700 1 --2- 172.21.15.45:0/1390064220 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f15cc15c9b0 0x7f15cc0c82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:30.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.344+0000 7f15d2dff700 1 -- 172.21.15.45:0/1390064220 >> 172.21.15.45:0/1390064220 conn(0x7f15cc072600 msgr2=0x7f15cc15aac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:30.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.344+0000 7f15d2dff700 1 -- 172.21.15.45:0/1390064220 shutdown_connections 2023-11-28T12:06:30.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.344+0000 7f15d2dff700 1 -- 172.21.15.45:0/1390064220 wait complete. 2023-11-28T12:06:30.363 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-28T12:06:30.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.572+0000 7fec23bff700 1 Processor -- start 2023-11-28T12:06:30.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.573+0000 7fec23bff700 1 -- start start 2023-11-28T12:06:30.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.574+0000 7fec23bff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fec1c0d0ff0 0x7fec1c0cff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:30.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.574+0000 7fec23bff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fec1c0b4750 0x7fec1c0b30a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:30.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.574+0000 7fec23bff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec1c0cf220 con 0x7fec1c0d13c0 2023-11-28T12:06:30.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.574+0000 7fec23bff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec1c0b3e50 con 0x7fec1c0b4750 2023-11-28T12:06:30.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.574+0000 7fec23bff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec1c0cf470 con 0x7fec1c0d0ff0 2023-11-28T12:06:30.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.574+0000 7fec2219c700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fec1c0d13c0 0x7fec1c0b6000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:37806/0 (socket says 172.21.15.45:37806) 2023-11-28T12:06:30.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.574+0000 7fec2219c700 1 -- 172.21.15.45:0/3037023782 learned_addr learned my addr 172.21.15.45:0/3037023782 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:06:30.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.574+0000 7fec2119a700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fec1c0b4750 0x7fec1c0b30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:30.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.574+0000 7fec2199b700 1 --2- 172.21.15.45:0/3037023782 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fec1c0d0ff0 0x7fec1c0cff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:30.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.574+0000 7fec2119a700 1 -- 172.21.15.45:0/3037023782 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fec1c0d0ff0 msgr2=0x7fec1c0cff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:06:30.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.574+0000 7fec2119a700 1 --2- 172.21.15.45:0/3037023782 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fec1c0d0ff0 0x7fec1c0cff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:30.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.574+0000 7fec2119a700 1 -- 172.21.15.45:0/3037023782 >> v1:172.21.15.45:6789/0 conn(0x7fec1c0d13c0 legacy=0x7fec1c0b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:30.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.574+0000 7fec2119a700 1 -- 172.21.15.45:0/3037023782 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec1c0cf750 con 0x7fec1c0b4750 2023-11-28T12:06:30.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.574+0000 7fec20999700 1 -- 172.21.15.45:0/3037023782 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1920604571 0 0) 0x7fec1c0cf220 con 0x7fec1c0d13c0 2023-11-28T12:06:30.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.575+0000 7fec2119a700 1 --2- 172.21.15.45:0/3037023782 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec1c0b4750 0x7fec1c0b30a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fec0c009840 tx=0x7fec0c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45ec47db1f1324a0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:30.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.575+0000 7fec20999700 1 -- 172.21.15.45:0/3037023782 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0c011830 con 0x7fec1c0b4750 2023-11-28T12:06:30.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.575+0000 7fec20999700 1 -- 172.21.15.45:0/3037023782 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec0c011990 con 0x7fec1c0b4750 2023-11-28T12:06:30.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.575+0000 7fec20999700 1 -- 172.21.15.45:0/3037023782 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0c011d20 con 0x7fec1c0b4750 2023-11-28T12:06:30.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.575+0000 7fec23bff700 1 -- 172.21.15.45:0/3037023782 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec1c0b4750 msgr2=0x7fec1c0b30a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:30.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.576+0000 7fec23bff700 1 --2- 172.21.15.45:0/3037023782 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec1c0b4750 0x7fec1c0b30a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fec0c009840 tx=0x7fec0c009b50 comp rx=0 tx=0).stop 2023-11-28T12:06:30.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.576+0000 7fec23bff700 1 -- 172.21.15.45:0/3037023782 shutdown_connections 2023-11-28T12:06:30.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.576+0000 7fec23bff700 1 --2- 172.21.15.45:0/3037023782 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fec1c0d0ff0 0x7fec1c0cff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:30.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.576+0000 7fec23bff700 1 --2- 172.21.15.45:0/3037023782 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec1c0b4750 0x7fec1c0b30a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:30.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.576+0000 7fec23bff700 1 -- 172.21.15.45:0/3037023782 >> 172.21.15.45:0/3037023782 conn(0x7fec1c09c3c0 msgr2=0x7fec1c0d31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:30.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.576+0000 7fec23bff700 1 -- 172.21.15.45:0/3037023782 shutdown_connections 2023-11-28T12:06:30.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.576+0000 7fec23bff700 1 -- 172.21.15.45:0/3037023782 wait complete. 2023-11-28T12:06:30.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.577+0000 7fec23bff700 1 Processor -- start 2023-11-28T12:06:30.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.578+0000 7fec23bff700 1 -- start start 2023-11-28T12:06:30.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.579+0000 7fec23bff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec1c0b4750 0x7fec1c0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:30.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.579+0000 7fec23bff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec1c0d0ff0 0x7fec1c1e6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:30.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.579+0000 7fec23bff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fec1c0d13c0 0x7fec1c1f5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:30.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.579+0000 7fec23bff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec1c1e6bb0 con 0x7fec1c0d0ff0 2023-11-28T12:06:30.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.579+0000 7fec23bff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec1c0c6bd0 con 0x7fec1c0b4750 2023-11-28T12:06:30.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.579+0000 7fec23bff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec1c1e7640 con 0x7fec1c0d13c0 2023-11-28T12:06:30.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.579+0000 7fec2119a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec1c0d0ff0 0x7fec1c1e6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:30.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.579+0000 7fec2119a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec1c0d0ff0 0x7fec1c1e6670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46578/0 (socket says 172.21.15.45:46578) 2023-11-28T12:06:30.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.579+0000 7fec2119a700 1 -- 172.21.15.45:0/3353998805 learned_addr learned my addr 172.21.15.45:0/3353998805 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:30.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.579+0000 7fec2219c700 1 --2- 172.21.15.45:0/3353998805 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fec1c0d13c0 0x7fec1c1f5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:30.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.579+0000 7fec2119a700 1 -- 172.21.15.45:0/3353998805 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fec1c0d13c0 msgr2=0x7fec1c1f5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:30.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.579+0000 7fec2119a700 1 --2- 172.21.15.45:0/3353998805 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fec1c0d13c0 0x7fec1c1f5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:30.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.579+0000 7fec2119a700 1 -- 172.21.15.45:0/3353998805 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec1c0b4750 msgr2=0x7fec1c0b8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:30.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.579+0000 7fec2199b700 1 --2- 172.21.15.45:0/3353998805 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec1c0b4750 0x7fec1c0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:30.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.579+0000 7fec2119a700 1 --2- 172.21.15.45:0/3353998805 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec1c0b4750 0x7fec1c0b8ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:30.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.579+0000 7fec2119a700 1 -- 172.21.15.45:0/3353998805 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec0c0094a0 con 0x7fec1c0d0ff0 2023-11-28T12:06:30.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.579+0000 7fec2219c700 1 --2- 172.21.15.45:0/3353998805 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fec1c0d13c0 0x7fec1c1f5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:06:30.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.579+0000 7fec2119a700 1 --2- 172.21.15.45:0/3353998805 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec1c0d0ff0 0x7fec1c1e6670 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fec1c0686f0 tx=0x7fec0c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:30.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.580+0000 7fec127fc700 1 -- 172.21.15.45:0/3353998805 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0c0038a0 con 0x7fec1c0d0ff0 2023-11-28T12:06:30.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.580+0000 7fec127fc700 1 -- 172.21.15.45:0/3353998805 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec0c01f070 con 0x7fec1c0d0ff0 2023-11-28T12:06:30.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.580+0000 7fec23bff700 1 -- 172.21.15.45:0/3353998805 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec1c0d0a50 con 0x7fec1c0d0ff0 2023-11-28T12:06:30.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.580+0000 7fec127fc700 1 -- 172.21.15.45:0/3353998805 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0c003c20 con 0x7fec1c0d0ff0 2023-11-28T12:06:30.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.580+0000 7fec23bff700 1 -- 172.21.15.45:0/3353998805 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec1c0cfa30 con 0x7fec1c0d0ff0 2023-11-28T12:06:30.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.581+0000 7fec23bff700 1 -- 172.21.15.45:0/3353998805 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec1c0d0490 con 0x7fec1c0d0ff0 2023-11-28T12:06:30.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.582+0000 7fec127fc700 1 -- 172.21.15.45:0/3353998805 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fec0c00f050 con 0x7fec1c0d0ff0 2023-11-28T12:06:30.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.583+0000 7fec127fc700 1 --2- 172.21.15.45:0/3353998805 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fec000682f0 0x7fec0006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:30.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.583+0000 7fec127fc700 1 -- 172.21.15.45:0/3353998805 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fec0c021070 con 0x7fec1c0d0ff0 2023-11-28T12:06:30.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.583+0000 7fec2199b700 1 --2- 172.21.15.45:0/3353998805 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fec000682f0 0x7fec0006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:30.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.584+0000 7fec2199b700 1 --2- 172.21.15.45:0/3353998805 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fec000682f0 0x7fec0006a7a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fec18006fd0 tx=0x7fec18008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:30.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.587+0000 7fec127fc700 1 -- 172.21.15.45:0/3353998805 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fec0c053e70 con 0x7fec1c0d0ff0 2023-11-28T12:06:30.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:30.833+0000 7fec23bff700 1 -- 172.21.15.45:0/3353998805 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fec1c0d23f0 con 0x7fec1c0d0ff0 2023-11-28T12:06:31.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.412+0000 7fec127fc700 1 -- 172.21.15.45:0/3353998805 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7fec0c0150b0 con 0x7fec1c0d0ff0 2023-11-28T12:06:31.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.415+0000 7fec23bff700 1 -- 172.21.15.45:0/3353998805 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fec000682f0 msgr2=0x7fec0006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:31.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.415+0000 7fec23bff700 1 --2- 172.21.15.45:0/3353998805 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fec000682f0 0x7fec0006a7a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fec18006fd0 tx=0x7fec18008040 comp rx=0 tx=0).stop 2023-11-28T12:06:31.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.415+0000 7fec23bff700 1 -- 172.21.15.45:0/3353998805 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec1c0d0ff0 msgr2=0x7fec1c1e6670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:31.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.415+0000 7fec23bff700 1 --2- 172.21.15.45:0/3353998805 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec1c0d0ff0 0x7fec1c1e6670 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fec1c0686f0 tx=0x7fec0c004750 comp rx=0 tx=0).stop 2023-11-28T12:06:31.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.415+0000 7fec23bff700 1 -- 172.21.15.45:0/3353998805 shutdown_connections 2023-11-28T12:06:31.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.415+0000 7fec23bff700 1 --2- 172.21.15.45:0/3353998805 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fec000682f0 0x7fec0006a7a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:31.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.415+0000 7fec23bff700 1 --2- 172.21.15.45:0/3353998805 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fec1c0b4750 0x7fec1c0b8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:31.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.415+0000 7fec23bff700 1 --2- 172.21.15.45:0/3353998805 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fec1c0d13c0 0x7fec1c1f5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:31.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.415+0000 7fec23bff700 1 --2- 172.21.15.45:0/3353998805 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec1c0d0ff0 0x7fec1c1e6670 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:31.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.415+0000 7fec23bff700 1 -- 172.21.15.45:0/3353998805 >> 172.21.15.45:0/3353998805 conn(0x7fec1c09c3c0 msgr2=0x7fec1c0b0300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:31.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.415+0000 7fec23bff700 1 -- 172.21.15.45:0/3353998805 shutdown_connections 2023-11-28T12:06:31.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.416+0000 7fec23bff700 1 -- 172.21.15.45:0/3353998805 wait complete. 2023-11-28T12:06:31.436 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-28T12:06:31.436 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-28T12:06:31.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.645+0000 7f44091ff700 1 Processor -- start 2023-11-28T12:06:31.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.645+0000 7f44091ff700 1 -- start start 2023-11-28T12:06:31.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.646+0000 7f44091ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4404161340 0x7f44040d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:31.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.646+0000 7f44091ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44040d1950 con 0x7f44040d2320 2023-11-28T12:06:31.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.646+0000 7f44091ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44040b5520 con 0x7f440415c9b0 2023-11-28T12:06:31.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.646+0000 7f44091ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44040b5800 con 0x7f4404161340 2023-11-28T12:06:31.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.646+0000 7f440359e700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f44040d2320 0x7f44040cd7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:37818/0 (socket says 172.21.15.45:37818) 2023-11-28T12:06:31.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.646+0000 7f440359e700 1 -- 172.21.15.45:0/2832242392 learned_addr learned my addr 172.21.15.45:0/2832242392 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:06:31.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.647+0000 7f440259c700 1 --2- 172.21.15.45:0/2832242392 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4404161340 0x7f44040d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:31.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.647+0000 7f4401d9b700 1 -- 172.21.15.45:0/2832242392 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3559055962 0 0) 0x7f44040d1950 con 0x7f44040d2320 2023-11-28T12:06:31.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.647+0000 7f4401d9b700 1 -- 172.21.15.45:0/2832242392 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43ec0035b0 con 0x7f44040d2320 2023-11-28T12:06:31.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.647+0000 7f4401d9b700 1 -- 172.21.15.45:0/2832242392 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2002883686 0 0) 0x7f44040b5520 con 0x7f440415c9b0 2023-11-28T12:06:31.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.647+0000 7f4401d9b700 1 -- 172.21.15.45:0/2832242392 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44040d1950 con 0x7f440415c9b0 2023-11-28T12:06:31.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.647+0000 7f4401d9b700 1 -- 172.21.15.45:0/2832242392 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2873850025 0 0) 0x7f43ec0035b0 con 0x7f44040d2320 2023-11-28T12:06:31.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.647+0000 7f4401d9b700 1 -- 172.21.15.45:0/2832242392 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4404161340 msgr2=0x7f44040d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:06:31.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.647+0000 7f4401d9b700 1 --2- 172.21.15.45:0/2832242392 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4404161340 0x7f44040d1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:31.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.647+0000 7f4401d9b700 1 -- 172.21.15.45:0/2832242392 >> v1:172.21.15.152:6789/0 conn(0x7f440415c9b0 legacy=0x7f44040b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:31.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.647+0000 7f4401d9b700 1 -- 172.21.15.45:0/2832242392 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44040d1300 con 0x7f44040d2320 2023-11-28T12:06:31.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.647+0000 7f4401d9b700 1 -- 172.21.15.45:0/2832242392 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3460218165 0 0) 0x7f43fc001970 con 0x7f44040d2320 2023-11-28T12:06:31.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.647+0000 7f440259c700 1 --2- 172.21.15.45:0/2832242392 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4404161340 0x7f44040d1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:06:31.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.647+0000 7f4401d9b700 1 -- 172.21.15.45:0/2832242392 >> v1:172.21.15.45:6789/0 conn(0x7f44040d2320 legacy=0x7f44040cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:31.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.647+0000 7f4401d9b700 1 --2- 172.21.15.45:0/2832242392 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f43ec003bc0 0x7f43ec003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:31.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.647+0000 7f4401d9b700 1 --2- 172.21.15.45:0/2832242392 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4404161340 0x7f43ec004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:31.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.647+0000 7f4401d9b700 1 --2- 172.21.15.45:0/2832242392 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43ec004d90 0x7f43ec005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:31.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.647+0000 7f4401d9b700 1 -- 172.21.15.45:0/2832242392 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44040b5800 con 0x7f43ec004d90 2023-11-28T12:06:31.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.647+0000 7f4401d9b700 1 -- 172.21.15.45:0/2832242392 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43ec00bb10 con 0x7f43ec003bc0 2023-11-28T12:06:31.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.647+0000 7f4401d9b700 1 -- 172.21.15.45:0/2832242392 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43ec00bcd0 con 0x7f4404161340 2023-11-28T12:06:31.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.647+0000 7f4402d9d700 1 --2- 172.21.15.45:0/2832242392 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f43ec003bc0 0x7f43ec003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:31.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.648+0000 7f440359e700 1 --2- 172.21.15.45:0/2832242392 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43ec004d90 0x7f43ec005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:31.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.648+0000 7f440259c700 1 --2- 172.21.15.45:0/2832242392 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4404161340 0x7f43ec004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:31.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.648+0000 7f440359e700 1 -- 172.21.15.45:0/2832242392 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4404161340 msgr2=0x7f43ec004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:06:31.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.648+0000 7f440359e700 1 --2- 172.21.15.45:0/2832242392 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4404161340 0x7f43ec004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:31.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.648+0000 7f440359e700 1 -- 172.21.15.45:0/2832242392 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f43ec003bc0 msgr2=0x7f43ec003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:06:31.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.648+0000 7f440359e700 1 --2- 172.21.15.45:0/2832242392 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f43ec003bc0 0x7f43ec003fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:31.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.648+0000 7f440359e700 1 -- 172.21.15.45:0/2832242392 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43f80094a0 con 0x7f43ec004d90 2023-11-28T12:06:31.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.648+0000 7f440359e700 1 --2- 172.21.15.45:0/2832242392 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43ec004d90 0x7f43ec005200 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f43fc00a680 tx=0x7f43ec005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c8b0e2888718232 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:31.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.648+0000 7f4401d9b700 1 -- 172.21.15.45:0/2832242392 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43fc00a140 con 0x7f43ec004d90 2023-11-28T12:06:31.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.648+0000 7f4401d9b700 1 -- 172.21.15.45:0/2832242392 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43fc0072d0 con 0x7f43ec004d90 2023-11-28T12:06:31.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.648+0000 7f4401d9b700 1 -- 172.21.15.45:0/2832242392 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43fc007680 con 0x7f43ec004d90 2023-11-28T12:06:31.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.649+0000 7f44091ff700 1 -- 172.21.15.45:0/2832242392 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43ec004d90 msgr2=0x7f43ec005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:31.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.649+0000 7f44091ff700 1 --2- 172.21.15.45:0/2832242392 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43ec004d90 0x7f43ec005200 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f43fc00a680 tx=0x7f43ec005880 comp rx=0 tx=0).stop 2023-11-28T12:06:31.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.649+0000 7f440359e700 1 -- 172.21.15.45:0/2832242392 reap_dead start 2023-11-28T12:06:31.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.649+0000 7f44091ff700 1 -- 172.21.15.45:0/2832242392 shutdown_connections 2023-11-28T12:06:31.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.649+0000 7f44091ff700 1 -- 172.21.15.45:0/2832242392 >> 172.21.15.45:0/2832242392 conn(0x7f4404072600 msgr2=0x7f44040cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:31.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.649+0000 7f44091ff700 1 -- 172.21.15.45:0/2832242392 shutdown_connections 2023-11-28T12:06:31.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.649+0000 7f44091ff700 1 -- 172.21.15.45:0/2832242392 wait complete. 2023-11-28T12:06:31.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.651+0000 7f44091ff700 1 Processor -- start 2023-11-28T12:06:31.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.651+0000 7f44091ff700 1 -- start start 2023-11-28T12:06:31.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.652+0000 7f44091ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f44040b87c0 0x7f44041541c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:31.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.652+0000 7f44091ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f44040c7120 0x7f44041e6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:31.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.652+0000 7f44091ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44040b8b90 0x7f4404153630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:31.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.652+0000 7f44091ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4404154e60 con 0x7f44040b8b90 2023-11-28T12:06:31.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.652+0000 7f44091ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4404154ac0 con 0x7f44040b87c0 2023-11-28T12:06:31.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.652+0000 7f44091ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44041e6b00 con 0x7f44040c7120 2023-11-28T12:06:31.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.652+0000 7f440359e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44040b8b90 0x7f4404153630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:31.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.652+0000 7f4402d9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f44040b87c0 0x7f44041541c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:31.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.652+0000 7f440259c700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f44040c7120 0x7f44041e6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:31.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.652+0000 7f440359e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44040b8b90 0x7f4404153630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46598/0 (socket says 172.21.15.45:46598) 2023-11-28T12:06:31.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.652+0000 7f440359e700 1 -- 172.21.15.45:0/3404917749 learned_addr learned my addr 172.21.15.45:0/3404917749 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:31.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.652+0000 7f4402d9d700 1 --2- 172.21.15.45:0/3404917749 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f44040b87c0 0x7f44041541c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.45:43140/0 (socket says 172.21.15.45:43140) 2023-11-28T12:06:31.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.653+0000 7f440359e700 1 -- 172.21.15.45:0/3404917749 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f44040c7120 msgr2=0x7f44041e6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:31.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.653+0000 7f440359e700 1 --2- 172.21.15.45:0/3404917749 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f44040c7120 0x7f44041e6420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:31.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.653+0000 7f440359e700 1 -- 172.21.15.45:0/3404917749 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f44040b87c0 msgr2=0x7f44041541c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:31.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.653+0000 7f440359e700 1 --2- 172.21.15.45:0/3404917749 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f44040b87c0 0x7f44041541c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:31.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.653+0000 7f440359e700 1 -- 172.21.15.45:0/3404917749 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f440415cd80 con 0x7f44040b8b90 2023-11-28T12:06:31.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.653+0000 7f440359e700 1 --2- 172.21.15.45:0/3404917749 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44040b8b90 0x7f4404153630 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f43fc011000 tx=0x7f43fc001c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:31.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.653+0000 7f43eb7fe700 1 -- 172.21.15.45:0/3404917749 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43fc007980 con 0x7f44040b8b90 2023-11-28T12:06:31.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.653+0000 7f43eb7fe700 1 -- 172.21.15.45:0/3404917749 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43fc007b20 con 0x7f44040b8b90 2023-11-28T12:06:31.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.653+0000 7f44091ff700 1 -- 172.21.15.45:0/3404917749 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44040d15e0 con 0x7f44040b8b90 2023-11-28T12:06:31.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.653+0000 7f43eb7fe700 1 -- 172.21.15.45:0/3404917749 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43fc01f670 con 0x7f44040b8b90 2023-11-28T12:06:31.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.653+0000 7f44091ff700 1 -- 172.21.15.45:0/3404917749 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f440415cf10 con 0x7f44040b8b90 2023-11-28T12:06:31.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.654+0000 7f44091ff700 1 -- 172.21.15.45:0/3404917749 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44040745c0 con 0x7f44040b8b90 2023-11-28T12:06:31.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.655+0000 7f43eb7fe700 1 -- 172.21.15.45:0/3404917749 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f43fc010070 con 0x7f44040b8b90 2023-11-28T12:06:31.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.656+0000 7f43eb7fe700 1 --2- 172.21.15.45:0/3404917749 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f43f00682f0 0x7f43f006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:31.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.656+0000 7f43eb7fe700 1 -- 172.21.15.45:0/3404917749 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f43fc0874c0 con 0x7f44040b8b90 2023-11-28T12:06:31.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.657+0000 7f4402d9d700 1 --2- 172.21.15.45:0/3404917749 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f43f00682f0 0x7f43f006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:31.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.657+0000 7f4402d9d700 1 --2- 172.21.15.45:0/3404917749 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f43f00682f0 0x7f43f006a7a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f43f4007fd0 tx=0x7f43f4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:31.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.660+0000 7f43eb7fe700 1 -- 172.21.15.45:0/3404917749 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f43fc053c30 con 0x7f44040b8b90 2023-11-28T12:06:31.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:31.911+0000 7f44091ff700 1 -- 172.21.15.45:0/3404917749 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f44040d08a0 con 0x7f44040b8b90 2023-11-28T12:06:32.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:32.893+0000 7f43eb7fe700 1 -- 172.21.15.45:0/3404917749 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f43fc0180c0 con 0x7f44040b8b90 2023-11-28T12:06:32.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:32.896+0000 7f44091ff700 1 -- 172.21.15.45:0/3404917749 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f43f00682f0 msgr2=0x7f43f006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:32.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:32.896+0000 7f44091ff700 1 --2- 172.21.15.45:0/3404917749 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f43f00682f0 0x7f43f006a7a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f43f4007fd0 tx=0x7f43f4009040 comp rx=0 tx=0).stop 2023-11-28T12:06:32.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:32.896+0000 7f44091ff700 1 -- 172.21.15.45:0/3404917749 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44040b8b90 msgr2=0x7f4404153630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:32.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:32.896+0000 7f44091ff700 1 --2- 172.21.15.45:0/3404917749 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44040b8b90 0x7f4404153630 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f43fc011000 tx=0x7f43fc001c30 comp rx=0 tx=0).stop 2023-11-28T12:06:32.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:32.896+0000 7f44091ff700 1 -- 172.21.15.45:0/3404917749 shutdown_connections 2023-11-28T12:06:32.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:32.896+0000 7f44091ff700 1 --2- 172.21.15.45:0/3404917749 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f43f00682f0 0x7f43f006a7a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:32.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:32.896+0000 7f44091ff700 1 --2- 172.21.15.45:0/3404917749 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f44040b87c0 0x7f44041541c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:32.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:32.896+0000 7f44091ff700 1 --2- 172.21.15.45:0/3404917749 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44040b8b90 0x7f4404153630 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:32.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:32.896+0000 7f44091ff700 1 --2- 172.21.15.45:0/3404917749 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f44040c7120 0x7f44041e6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:32.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:32.896+0000 7f44091ff700 1 -- 172.21.15.45:0/3404917749 >> 172.21.15.45:0/3404917749 conn(0x7f4404072600 msgr2=0x7f44040b6080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:32.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:32.897+0000 7f44091ff700 1 -- 172.21.15.45:0/3404917749 shutdown_connections 2023-11-28T12:06:32.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:32.897+0000 7f44091ff700 1 -- 172.21.15.45:0/3404917749 wait complete. 2023-11-28T12:06:32.919 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-28T12:06:32.919 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T12:06:33.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.125+0000 7fc83dfff700 1 Processor -- start 2023-11-28T12:06:33.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.125+0000 7fc83dfff700 1 -- start start 2023-11-28T12:06:33.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.126+0000 7fc83dfff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fc838161340 0x7fc8380d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:33.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.126+0000 7fc83dfff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc8380d2320 0x7fc8380cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:33.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.126+0000 7fc83dfff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8380d1950 con 0x7fc83815c9b0 2023-11-28T12:06:33.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.126+0000 7fc83dfff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8380b5800 con 0x7fc8380d2320 2023-11-28T12:06:33.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.126+0000 7fc83dfff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8380b5300 con 0x7fc838161340 2023-11-28T12:06:33.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.126+0000 7fc837fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc8380d2320 0x7fc8380cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:33.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.126+0000 7fc8377fe700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fc83815c9b0 0x7fc8380b4bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:60936/0 (socket says 172.21.15.45:60936) 2023-11-28T12:06:33.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.126+0000 7fc8377fe700 1 -- 172.21.15.45:0/3767852029 learned_addr learned my addr 172.21.15.45:0/3767852029 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:06:33.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.127+0000 7fc836ffd700 1 --2- 172.21.15.45:0/3767852029 >> v2:172.21.15.152:3300/0 conn(0x7fc838161340 0x7fc8380d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:33.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.127+0000 7fc837fff700 1 -- 172.21.15.45:0/3767852029 >> v2:172.21.15.152:3300/0 conn(0x7fc838161340 msgr2=0x7fc8380d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:06:33.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.127+0000 7fc837fff700 1 --2- 172.21.15.45:0/3767852029 >> v2:172.21.15.152:3300/0 conn(0x7fc838161340 0x7fc8380d1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:33.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.127+0000 7fc837fff700 1 -- 172.21.15.45:0/3767852029 >> v1:172.21.15.45:6789/0 conn(0x7fc83815c9b0 legacy=0x7fc8380b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:33.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.127+0000 7fc837fff700 1 -- 172.21.15.45:0/3767852029 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8380b5520 con 0x7fc8380d2320 2023-11-28T12:06:33.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.127+0000 7fc8367fc700 1 -- 172.21.15.45:0/3767852029 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 721744693 0 0) 0x7fc8380d1950 con 0x7fc83815c9b0 2023-11-28T12:06:33.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.127+0000 7fc837fff700 1 --2- 172.21.15.45:0/3767852029 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8380d2320 0x7fc8380cd7c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc8380685c0 tx=0x7fc83000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16d7e3d313fd2d13 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:33.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.127+0000 7fc8367fc700 1 -- 172.21.15.45:0/3767852029 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83000e070 con 0x7fc8380d2320 2023-11-28T12:06:33.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.127+0000 7fc8367fc700 1 -- 172.21.15.45:0/3767852029 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc83000bb90 con 0x7fc8380d2320 2023-11-28T12:06:33.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.127+0000 7fc8367fc700 1 -- 172.21.15.45:0/3767852029 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc830012430 con 0x7fc8380d2320 2023-11-28T12:06:33.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.128+0000 7fc83dfff700 1 -- 172.21.15.45:0/3767852029 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8380d2320 msgr2=0x7fc8380cd7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:33.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.128+0000 7fc83dfff700 1 --2- 172.21.15.45:0/3767852029 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8380d2320 0x7fc8380cd7c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc8380685c0 tx=0x7fc83000b330 comp rx=0 tx=0).stop 2023-11-28T12:06:33.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.128+0000 7fc83dfff700 1 -- 172.21.15.45:0/3767852029 shutdown_connections 2023-11-28T12:06:33.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.128+0000 7fc83dfff700 1 --2- 172.21.15.45:0/3767852029 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8380d2320 0x7fc8380cd7c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:33.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.128+0000 7fc83dfff700 1 --2- 172.21.15.45:0/3767852029 >> v2:172.21.15.152:3300/0 conn(0x7fc838161340 0x7fc8380d1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:33.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.128+0000 7fc83dfff700 1 -- 172.21.15.45:0/3767852029 >> 172.21.15.45:0/3767852029 conn(0x7fc838072600 msgr2=0x7fc8380cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:33.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.128+0000 7fc83dfff700 1 -- 172.21.15.45:0/3767852029 shutdown_connections 2023-11-28T12:06:33.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.128+0000 7fc83dfff700 1 -- 172.21.15.45:0/3767852029 wait complete. 2023-11-28T12:06:33.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.130+0000 7fc83dfff700 1 Processor -- start 2023-11-28T12:06:33.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.130+0000 7fc83dfff700 1 -- start start 2023-11-28T12:06:33.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.131+0000 7fc83dfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8380d2320 0x7fc83815f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:33.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.131+0000 7fc83dfff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc83815c9b0 0x7fc8381f26b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:33.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.131+0000 7fc83dfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc838161340 0x7fc8381f2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:33.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.131+0000 7fc83dfff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8380c84a0 con 0x7fc8380d2320 2023-11-28T12:06:33.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.131+0000 7fc83dfff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8381f3870 con 0x7fc838161340 2023-11-28T12:06:33.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.131+0000 7fc83dfff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8381f31e0 con 0x7fc83815c9b0 2023-11-28T12:06:33.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.131+0000 7fc8377fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8380d2320 0x7fc83815f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:33.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.131+0000 7fc8377fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8380d2320 0x7fc83815f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35734/0 (socket says 172.21.15.45:35734) 2023-11-28T12:06:33.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.131+0000 7fc8377fe700 1 -- 172.21.15.45:0/1868020433 learned_addr learned my addr 172.21.15.45:0/1868020433 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:33.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.131+0000 7fc836ffd700 1 --2- 172.21.15.45:0/1868020433 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc83815c9b0 0x7fc8381f26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:33.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.131+0000 7fc837fff700 1 --2- 172.21.15.45:0/1868020433 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc838161340 0x7fc8381f2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:33.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.132+0000 7fc8377fe700 1 -- 172.21.15.45:0/1868020433 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc83815c9b0 msgr2=0x7fc8381f26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:33.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.132+0000 7fc8377fe700 1 --2- 172.21.15.45:0/1868020433 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc83815c9b0 0x7fc8381f26b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:33.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.132+0000 7fc8377fe700 1 -- 172.21.15.45:0/1868020433 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc838161340 msgr2=0x7fc8381f2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:33.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.132+0000 7fc8377fe700 1 --2- 172.21.15.45:0/1868020433 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc838161340 0x7fc8381f2bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:33.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.132+0000 7fc8377fe700 1 -- 172.21.15.45:0/1868020433 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc830009a70 con 0x7fc8380d2320 2023-11-28T12:06:33.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.132+0000 7fc837fff700 1 --2- 172.21.15.45:0/1868020433 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc838161340 0x7fc8381f2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:06:33.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.132+0000 7fc8377fe700 1 --2- 172.21.15.45:0/1868020433 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8380d2320 0x7fc83815f500 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc82800c550 tx=0x7fc82800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:33.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.132+0000 7fc81ffff700 1 -- 172.21.15.45:0/1868020433 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc828004c80 con 0x7fc8380d2320 2023-11-28T12:06:33.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.132+0000 7fc81ffff700 1 -- 172.21.15.45:0/1868020433 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc828004e00 con 0x7fc8380d2320 2023-11-28T12:06:33.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.132+0000 7fc83dfff700 1 -- 172.21.15.45:0/1868020433 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8380d15e0 con 0x7fc8380d2320 2023-11-28T12:06:33.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.132+0000 7fc81ffff700 1 -- 172.21.15.45:0/1868020433 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc828007310 con 0x7fc8380d2320 2023-11-28T12:06:33.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.132+0000 7fc83dfff700 1 -- 172.21.15.45:0/1868020433 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8380d1300 con 0x7fc8380d2320 2023-11-28T12:06:33.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.133+0000 7fc83dfff700 1 -- 172.21.15.45:0/1868020433 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc83815cd80 con 0x7fc8380d2320 2023-11-28T12:06:33.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.134+0000 7fc81ffff700 1 -- 172.21.15.45:0/1868020433 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fc82801a020 con 0x7fc8380d2320 2023-11-28T12:06:33.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.135+0000 7fc81ffff700 1 --2- 172.21.15.45:0/1868020433 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fc8240682f0 0x7fc82406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:33.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.135+0000 7fc81ffff700 1 -- 172.21.15.45:0/1868020433 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc828085890 con 0x7fc8380d2320 2023-11-28T12:06:33.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.135+0000 7fc836ffd700 1 --2- 172.21.15.45:0/1868020433 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fc8240682f0 0x7fc82406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:33.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.136+0000 7fc836ffd700 1 --2- 172.21.15.45:0/1868020433 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fc8240682f0 0x7fc82406a7a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc838151950 tx=0x7fc82c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:33.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.139+0000 7fc81ffff700 1 -- 172.21.15.45:0/1868020433 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fc828052000 con 0x7fc8380d2320 2023-11-28T12:06:33.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.386+0000 7fc83dfff700 1 -- 172.21.15.45:0/1868020433 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc8380745c0 con 0x7fc8380d2320 2023-11-28T12:06:33.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.387+0000 7fc81ffff700 1 -- 172.21.15.45:0/1868020433 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4648 (secure 0 0 0) 0x7fc828055620 con 0x7fc8380d2320 2023-11-28T12:06:33.387 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:06:33.387 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1163718907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6835","nonce":1163718907},{"type":"v1","addr":"172.21.15.152:6837","nonce":1163718907}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4282,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/2292614522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":2292614522},{"type":"v1","addr":"172.21.15.45:6834","nonce":2292614522}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4285,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/3920917053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":3920917053},{"type":"v1","addr":"172.21.15.45:6835","nonce":3920917053}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T12:06:29.394171+0000","modified":"2023-11-28T12:06:32.886491+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.152:6836/3624153928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":3624153928},{"type":"v1","addr":"172.21.15.152:6836","nonce":3624153928}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T12:06:33.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.389+0000 7fc83dfff700 1 -- 172.21.15.45:0/1868020433 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fc8240682f0 msgr2=0x7fc82406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:33.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.389+0000 7fc83dfff700 1 --2- 172.21.15.45:0/1868020433 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fc8240682f0 0x7fc82406a7a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc838151950 tx=0x7fc82c008040 comp rx=0 tx=0).stop 2023-11-28T12:06:33.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.389+0000 7fc83dfff700 1 -- 172.21.15.45:0/1868020433 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8380d2320 msgr2=0x7fc83815f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:33.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.389+0000 7fc83dfff700 1 --2- 172.21.15.45:0/1868020433 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8380d2320 0x7fc83815f500 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc82800c550 tx=0x7fc82800c860 comp rx=0 tx=0).stop 2023-11-28T12:06:33.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.389+0000 7fc83dfff700 1 -- 172.21.15.45:0/1868020433 shutdown_connections 2023-11-28T12:06:33.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.389+0000 7fc83dfff700 1 --2- 172.21.15.45:0/1868020433 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fc8240682f0 0x7fc82406a7a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:33.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.389+0000 7fc83dfff700 1 --2- 172.21.15.45:0/1868020433 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc838161340 0x7fc8381f2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:33.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.389+0000 7fc83dfff700 1 --2- 172.21.15.45:0/1868020433 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8380d2320 0x7fc83815f500 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:33.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.389+0000 7fc83dfff700 1 --2- 172.21.15.45:0/1868020433 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc83815c9b0 0x7fc8381f26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:33.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.389+0000 7fc83dfff700 1 -- 172.21.15.45:0/1868020433 >> 172.21.15.45:0/1868020433 conn(0x7fc838072600 msgr2=0x7fc8380b60a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:33.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.389+0000 7fc83dfff700 1 -- 172.21.15.45:0/1868020433 shutdown_connections 2023-11-28T12:06:33.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.389+0000 7fc83dfff700 1 -- 172.21.15.45:0/1868020433 wait complete. 2023-11-28T12:06:33.391 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 8 2023-11-28T12:06:33.408 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T12:06:33.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.610+0000 7fdaa11ff700 1 Processor -- start 2023-11-28T12:06:33.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.610+0000 7fdaa11ff700 1 -- start start 2023-11-28T12:06:33.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.611+0000 7fdaa11ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fda9c15c9b0 0x7fda9c0b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:33.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.611+0000 7fdaa11ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda9c0d1950 con 0x7fda9c0cd7c0 2023-11-28T12:06:33.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.611+0000 7fdaa11ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda9c0d24f0 con 0x7fda9c161340 2023-11-28T12:06:33.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.611+0000 7fdaa11ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda9c0b5800 con 0x7fda9c15c9b0 2023-11-28T12:06:33.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.612+0000 7fda9b59e700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fda9c0cd7c0 0x7fda9c0b5fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:60938/0 (socket says 172.21.15.45:60938) 2023-11-28T12:06:33.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.612+0000 7fda9b59e700 1 -- 172.21.15.45:0/3553704705 learned_addr learned my addr 172.21.15.45:0/3553704705 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:06:33.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.612+0000 7fda9ad9d700 1 --2- 172.21.15.45:0/3553704705 >> v2:172.21.15.152:3300/0 conn(0x7fda9c15c9b0 0x7fda9c0b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:33.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.612+0000 7fda99d9b700 1 -- 172.21.15.45:0/3553704705 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2585587171 0 0) 0x7fda9c0d1950 con 0x7fda9c0cd7c0 2023-11-28T12:06:33.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.612+0000 7fda99d9b700 1 -- 172.21.15.45:0/3553704705 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda840035b0 con 0x7fda9c0cd7c0 2023-11-28T12:06:33.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.612+0000 7fda9ad9d700 1 -- 172.21.15.45:0/3553704705 >> v1:172.21.15.152:6789/0 conn(0x7fda9c161340 legacy=0x7fda9c0d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:33.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.612+0000 7fda9ad9d700 1 -- 172.21.15.45:0/3553704705 >> v1:172.21.15.45:6789/0 conn(0x7fda9c0cd7c0 legacy=0x7fda9c0b5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:33.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.612+0000 7fda9ad9d700 1 -- 172.21.15.45:0/3553704705 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda9c0b5520 con 0x7fda9c15c9b0 2023-11-28T12:06:33.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.612+0000 7fda9ad9d700 1 --2- 172.21.15.45:0/3553704705 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda9c15c9b0 0x7fda9c0b4bf0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fda8c009840 tx=0x7fda8c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b5c3c88aba39e0d1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:33.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.613+0000 7fda99d9b700 1 -- 172.21.15.45:0/3553704705 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8c011830 con 0x7fda9c15c9b0 2023-11-28T12:06:33.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.613+0000 7fda99d9b700 1 -- 172.21.15.45:0/3553704705 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda8c011990 con 0x7fda9c15c9b0 2023-11-28T12:06:33.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.613+0000 7fda99d9b700 1 -- 172.21.15.45:0/3553704705 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8c011d20 con 0x7fda9c15c9b0 2023-11-28T12:06:33.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.613+0000 7fdaa11ff700 1 -- 172.21.15.45:0/3553704705 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda9c15c9b0 msgr2=0x7fda9c0b4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:33.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.613+0000 7fdaa11ff700 1 --2- 172.21.15.45:0/3553704705 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda9c15c9b0 0x7fda9c0b4bf0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fda8c009840 tx=0x7fda8c009b50 comp rx=0 tx=0).stop 2023-11-28T12:06:33.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.613+0000 7fdaa11ff700 1 -- 172.21.15.45:0/3553704705 shutdown_connections 2023-11-28T12:06:33.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.613+0000 7fdaa11ff700 1 --2- 172.21.15.45:0/3553704705 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda9c15c9b0 0x7fda9c0b4bf0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:33.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.613+0000 7fdaa11ff700 1 -- 172.21.15.45:0/3553704705 >> 172.21.15.45:0/3553704705 conn(0x7fda9c072600 msgr2=0x7fda9c0cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:33.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.613+0000 7fdaa11ff700 1 -- 172.21.15.45:0/3553704705 shutdown_connections 2023-11-28T12:06:33.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.613+0000 7fdaa11ff700 1 -- 172.21.15.45:0/3553704705 wait complete. 2023-11-28T12:06:33.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.615+0000 7fdaa11ff700 1 Processor -- start 2023-11-28T12:06:33.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.615+0000 7fdaa11ff700 1 -- start start 2023-11-28T12:06:33.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.616+0000 7fdaa11ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fda9c0cd7c0 0x7fda9c1f2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:33.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.616+0000 7fdaa11ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda9c15c9b0 0x7fda9c0c92b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:33.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.616+0000 7fdaa11ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda9c161340 0x7fda9c0c78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:33.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.616+0000 7fdaa11ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c1f2eb0 con 0x7fda9c15c9b0 2023-11-28T12:06:33.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.616+0000 7fdaa11ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c0ca050 con 0x7fda9c161340 2023-11-28T12:06:33.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.616+0000 7fdaa11ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c0c97f0 con 0x7fda9c0cd7c0 2023-11-28T12:06:33.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.616+0000 7fda9a59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda9c15c9b0 0x7fda9c0c92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:33.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.616+0000 7fda9a59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda9c15c9b0 0x7fda9c0c92b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35748/0 (socket says 172.21.15.45:35748) 2023-11-28T12:06:33.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.617+0000 7fda9a59c700 1 -- 172.21.15.45:0/2209880926 learned_addr learned my addr 172.21.15.45:0/2209880926 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:33.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.617+0000 7fda9b59e700 1 --2- 172.21.15.45:0/2209880926 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda9c161340 0x7fda9c0c78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:33.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.617+0000 7fda9ad9d700 1 --2- 172.21.15.45:0/2209880926 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fda9c0cd7c0 0x7fda9c1f2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:33.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.617+0000 7fda9a59c700 1 -- 172.21.15.45:0/2209880926 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fda9c0cd7c0 msgr2=0x7fda9c1f2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:33.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.617+0000 7fda9a59c700 1 --2- 172.21.15.45:0/2209880926 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fda9c0cd7c0 0x7fda9c1f2970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:33.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.617+0000 7fda9a59c700 1 -- 172.21.15.45:0/2209880926 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda9c161340 msgr2=0x7fda9c0c78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:33.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.617+0000 7fda9a59c700 1 --2- 172.21.15.45:0/2209880926 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda9c161340 0x7fda9c0c78d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:33.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.617+0000 7fda9a59c700 1 -- 172.21.15.45:0/2209880926 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda8c0094a0 con 0x7fda9c15c9b0 2023-11-28T12:06:33.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.617+0000 7fda9b59e700 1 --2- 172.21.15.45:0/2209880926 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda9c161340 0x7fda9c0c78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:06:33.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.617+0000 7fda9ad9d700 1 --2- 172.21.15.45:0/2209880926 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fda9c0cd7c0 0x7fda9c1f2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:06:33.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.617+0000 7fda9a59c700 1 --2- 172.21.15.45:0/2209880926 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda9c15c9b0 0x7fda9c0c92b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fda9000c4e0 tx=0x7fda9000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:33.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.617+0000 7fda837fe700 1 -- 172.21.15.45:0/2209880926 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda900052d0 con 0x7fda9c15c9b0 2023-11-28T12:06:33.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.617+0000 7fda837fe700 1 -- 172.21.15.45:0/2209880926 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda90005430 con 0x7fda9c15c9b0 2023-11-28T12:06:33.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.617+0000 7fda837fe700 1 -- 172.21.15.45:0/2209880926 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda900038c0 con 0x7fda9c15c9b0 2023-11-28T12:06:33.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.617+0000 7fdaa11ff700 1 -- 172.21.15.45:0/2209880926 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda9c0d15e0 con 0x7fda9c15c9b0 2023-11-28T12:06:33.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.618+0000 7fdaa11ff700 1 -- 172.21.15.45:0/2209880926 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda9c0d1300 con 0x7fda9c15c9b0 2023-11-28T12:06:33.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.619+0000 7fdaa11ff700 1 -- 172.21.15.45:0/2209880926 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda9c0b5130 con 0x7fda9c15c9b0 2023-11-28T12:06:33.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.619+0000 7fda837fe700 1 -- 172.21.15.45:0/2209880926 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fda90019030 con 0x7fda9c15c9b0 2023-11-28T12:06:33.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.620+0000 7fda837fe700 1 --2- 172.21.15.45:0/2209880926 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fda880682f0 0x7fda8806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:33.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.620+0000 7fda837fe700 1 -- 172.21.15.45:0/2209880926 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fda90085130 con 0x7fda9c15c9b0 2023-11-28T12:06:33.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.620+0000 7fda9ad9d700 1 --2- 172.21.15.45:0/2209880926 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fda880682f0 0x7fda8806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:33.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.621+0000 7fda9ad9d700 1 --2- 172.21.15.45:0/2209880926 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fda880682f0 0x7fda8806a7a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fda8c000c00 tx=0x7fda8c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:33.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.624+0000 7fda837fe700 1 -- 172.21.15.45:0/2209880926 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fda900518a0 con 0x7fda9c15c9b0 2023-11-28T12:06:33.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.827+0000 7fdaa11ff700 1 -- 172.21.15.45:0/2209880926 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fda9c0c9af0 con 0x7fda9c15c9b0 2023-11-28T12:06:33.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.828+0000 7fda837fe700 1 -- 172.21.15.45:0/2209880926 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+17849 (secure 0 0 0) 0x7fda90054ec0 con 0x7fda9c15c9b0 2023-11-28T12:06:33.830 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:06:33.830 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":20,"fsid":"bd7c37f1-f7c6-4778-b845-52cf2aa6e366","created":"2023-11-28T12:06:09.045075+0000","modified":"2023-11-28T12:06:30.396046+0000","last_up_change":"2023-11-28T12:06:21.282227+0000","last_in_change":"2023-11-28T12:06:12.560924+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T12:06:21.807108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T12:06:22.491009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T12:06:27.684157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T12:06:28.384679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d0cdd8a-87fd-4f2c-91bd-47bdfa661905","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":115843},{"type":"v1","addr":"172.21.15.45:6808","nonce":115843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":115843},{"type":"v1","addr":"172.21.15.45:6811","nonce":115843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":115843},{"type":"v1","addr":"172.21.15.45:6815","nonce":115843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":115843},{"type":"v1","addr":"172.21.15.45:6813","nonce":115843}]},"public_addr":"172.21.15.45:6808/115843","cluster_addr":"172.21.15.45:6811/115843","heartbeat_back_addr":"172.21.15.45:6815/115843","heartbeat_front_addr":"172.21.15.45:6813/115843","state":["exists","up"]},{"osd":1,"uuid":"c5de4ebd-9ec5-40b3-9caa-9b706fab4c76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":115842},{"type":"v1","addr":"172.21.15.45:6801","nonce":115842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":115842},{"type":"v1","addr":"172.21.15.45:6803","nonce":115842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6807","nonce":115842},{"type":"v1","addr":"172.21.15.45:6809","nonce":115842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":115842},{"type":"v1","addr":"172.21.15.45:6805","nonce":115842}]},"public_addr":"172.21.15.45:6801/115842","cluster_addr":"172.21.15.45:6803/115842","heartbeat_back_addr":"172.21.15.45:6809/115842","heartbeat_front_addr":"172.21.15.45:6805/115842","state":["exists","up"]},{"osd":2,"uuid":"9f4b36b2-65d2-40e7-9fe6-a2991afa71c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":115850},{"type":"v1","addr":"172.21.15.45:6819","nonce":115850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":115850},{"type":"v1","addr":"172.21.15.45:6823","nonce":115850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":115850},{"type":"v1","addr":"172.21.15.45:6831","nonce":115850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":115850},{"type":"v1","addr":"172.21.15.45:6828","nonce":115850}]},"public_addr":"172.21.15.45:6819/115850","cluster_addr":"172.21.15.45:6823/115850","heartbeat_back_addr":"172.21.15.45:6831/115850","heartbeat_front_addr":"172.21.15.45:6828/115850","state":["exists","up"]},{"osd":3,"uuid":"6fe7ef05-4e0d-426c-bf94-44b51d4d550b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":115848},{"type":"v1","addr":"172.21.15.45:6818","nonce":115848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":115848},{"type":"v1","addr":"172.21.15.45:6822","nonce":115848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6827","nonce":115848},{"type":"v1","addr":"172.21.15.45:6829","nonce":115848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":115848},{"type":"v1","addr":"172.21.15.45:6825","nonce":115848}]},"public_addr":"172.21.15.45:6818/115848","cluster_addr":"172.21.15.45:6822/115848","heartbeat_back_addr":"172.21.15.45:6829/115848","heartbeat_front_addr":"172.21.15.45:6825/115848","state":["exists","up"]},{"osd":4,"uuid":"fa403c08-d8a1-4a3a-8384-cb465c1a654c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":116092},{"type":"v1","addr":"172.21.15.152:6801","nonce":116092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":116092},{"type":"v1","addr":"172.21.15.152:6803","nonce":116092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":116092},{"type":"v1","addr":"172.21.15.152:6807","nonce":116092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":116092},{"type":"v1","addr":"172.21.15.152:6805","nonce":116092}]},"public_addr":"172.21.15.152:6801/116092","cluster_addr":"172.21.15.152:6803/116092","heartbeat_back_addr":"172.21.15.152:6807/116092","heartbeat_front_addr":"172.21.15.152:6805/116092","state":["exists","up"]},{"osd":5,"uuid":"399fc450-39fa-43a6-bf80-0b8bcb41bd95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6815","nonce":116093},{"type":"v1","addr":"172.21.15.152:6817","nonce":116093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":116093},{"type":"v1","addr":"172.21.15.152:6819","nonce":116093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":116093},{"type":"v1","addr":"172.21.15.152:6823","nonce":116093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":116093},{"type":"v1","addr":"172.21.15.152:6821","nonce":116093}]},"public_addr":"172.21.15.152:6817/116093","cluster_addr":"172.21.15.152:6819/116093","heartbeat_back_addr":"172.21.15.152:6823/116093","heartbeat_front_addr":"172.21.15.152:6821/116093","state":["exists","up"]},{"osd":6,"uuid":"e59a4017-2d23-4627-836b-e25b2d3ddaaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":116094},{"type":"v1","addr":"172.21.15.152:6809","nonce":116094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":116094},{"type":"v1","addr":"172.21.15.152:6811","nonce":116094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":116094},{"type":"v1","addr":"172.21.15.152:6816","nonce":116094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":116094},{"type":"v1","addr":"172.21.15.152:6813","nonce":116094}]},"public_addr":"172.21.15.152:6809/116094","cluster_addr":"172.21.15.152:6811/116094","heartbeat_back_addr":"172.21.15.152:6816/116094","heartbeat_front_addr":"172.21.15.152:6813/116094","state":["exists","up"]},{"osd":7,"uuid":"8d7f9d4b-bf08-4670-8591-388c0f012a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":116097},{"type":"v1","addr":"172.21.15.152:6825","nonce":116097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":116097},{"type":"v1","addr":"172.21.15.152:6827","nonce":116097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":116097},{"type":"v1","addr":"172.21.15.152:6831","nonce":116097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":116097},{"type":"v1","addr":"172.21.15.152:6829","nonce":116097}]},"public_addr":"172.21.15.152:6825/116097","cluster_addr":"172.21.15.152:6827/116097","heartbeat_back_addr":"172.21.15.152:6831/116097","heartbeat_front_addr":"172.21.15.152:6829/116097","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.937710+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.865423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.159434+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.913090+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.131647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.966255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.972583+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.177209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T12:06:33.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.831+0000 7fdaa11ff700 1 -- 172.21.15.45:0/2209880926 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fda880682f0 msgr2=0x7fda8806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:33.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.831+0000 7fdaa11ff700 1 --2- 172.21.15.45:0/2209880926 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fda880682f0 0x7fda8806a7a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fda8c000c00 tx=0x7fda8c008030 comp rx=0 tx=0).stop 2023-11-28T12:06:33.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.831+0000 7fdaa11ff700 1 -- 172.21.15.45:0/2209880926 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda9c15c9b0 msgr2=0x7fda9c0c92b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:33.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.831+0000 7fdaa11ff700 1 --2- 172.21.15.45:0/2209880926 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda9c15c9b0 0x7fda9c0c92b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fda9000c4e0 tx=0x7fda9000c8a0 comp rx=0 tx=0).stop 2023-11-28T12:06:33.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.831+0000 7fdaa11ff700 1 -- 172.21.15.45:0/2209880926 shutdown_connections 2023-11-28T12:06:33.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.831+0000 7fdaa11ff700 1 --2- 172.21.15.45:0/2209880926 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fda880682f0 0x7fda8806a7a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:33.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.831+0000 7fdaa11ff700 1 --2- 172.21.15.45:0/2209880926 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda9c161340 0x7fda9c0c78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:33.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.831+0000 7fdaa11ff700 1 --2- 172.21.15.45:0/2209880926 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fda9c0cd7c0 0x7fda9c1f2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:33.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.831+0000 7fdaa11ff700 1 --2- 172.21.15.45:0/2209880926 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda9c15c9b0 0x7fda9c0c92b0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:33.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.831+0000 7fdaa11ff700 1 -- 172.21.15.45:0/2209880926 >> 172.21.15.45:0/2209880926 conn(0x7fda9c072600 msgr2=0x7fda9c15ab70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:33.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.831+0000 7fdaa11ff700 1 -- 172.21.15.45:0/2209880926 shutdown_connections 2023-11-28T12:06:33.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:33.831+0000 7fdaa11ff700 1 -- 172.21.15.45:0/2209880926 wait complete. 2023-11-28T12:06:33.850 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-28T12:06:33.850 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T12:06:34.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.053+0000 7f13101ff700 1 Processor -- start 2023-11-28T12:06:34.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.053+0000 7f13101ff700 1 -- start start 2023-11-28T12:06:34.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.054+0000 7f13101ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f130815c9b0 0x7f13080b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:34.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.054+0000 7f13101ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1308161340 0x7f13080d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:34.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.054+0000 7f13101ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f13080d2320 0x7f13080cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:34.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.054+0000 7f13101ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13080b5800 con 0x7f130815c9b0 2023-11-28T12:06:34.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.054+0000 7f13101ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13080d1950 con 0x7f13080d2320 2023-11-28T12:06:34.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.054+0000 7f13101ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13080b5520 con 0x7f1308161340 2023-11-28T12:06:34.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.054+0000 7f130df9b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f130815c9b0 0x7f13080b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:34.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.054+0000 7f130df9b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f130815c9b0 0x7f13080b4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35752/0 (socket says 172.21.15.45:35752) 2023-11-28T12:06:34.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.054+0000 7f130df9b700 1 -- 172.21.15.45:0/1209696379 learned_addr learned my addr 172.21.15.45:0/1209696379 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:34.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.055+0000 7f130e79c700 1 --2- 172.21.15.45:0/1209696379 >> v2:172.21.15.152:3300/0 conn(0x7f13080d2320 0x7f13080cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:34.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.055+0000 7f130d79a700 1 --2- 172.21.15.45:0/1209696379 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1308161340 0x7f13080d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:34.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.055+0000 7f130df9b700 1 -- 172.21.15.45:0/1209696379 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1308161340 msgr2=0x7f13080d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:06:34.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.055+0000 7f130df9b700 1 --2- 172.21.15.45:0/1209696379 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1308161340 0x7f13080d1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:34.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.055+0000 7f130df9b700 1 -- 172.21.15.45:0/1209696379 >> v2:172.21.15.152:3300/0 conn(0x7f13080d2320 msgr2=0x7f13080cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:06:34.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.055+0000 7f130df9b700 1 --2- 172.21.15.45:0/1209696379 >> v2:172.21.15.152:3300/0 conn(0x7f13080d2320 0x7f13080cd7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:34.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.055+0000 7f130df9b700 1 -- 172.21.15.45:0/1209696379 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13080d1300 con 0x7f130815c9b0 2023-11-28T12:06:34.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.055+0000 7f130df9b700 1 --2- 172.21.15.45:0/1209696379 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f130815c9b0 0x7f13080b4bf0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f130808c4d0 tx=0x7f1304009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a73f24d1281a5028 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:34.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.055+0000 7f130cf99700 1 -- 172.21.15.45:0/1209696379 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1304011830 con 0x7f130815c9b0 2023-11-28T12:06:34.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.056+0000 7f130cf99700 1 -- 172.21.15.45:0/1209696379 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1304011990 con 0x7f130815c9b0 2023-11-28T12:06:34.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.056+0000 7f130cf99700 1 -- 172.21.15.45:0/1209696379 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1304011d20 con 0x7f130815c9b0 2023-11-28T12:06:34.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.056+0000 7f13101ff700 1 -- 172.21.15.45:0/1209696379 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f130815c9b0 msgr2=0x7f13080b4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:34.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.056+0000 7f13101ff700 1 --2- 172.21.15.45:0/1209696379 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f130815c9b0 0x7f13080b4bf0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f130808c4d0 tx=0x7f1304009bd0 comp rx=0 tx=0).stop 2023-11-28T12:06:34.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.056+0000 7f13101ff700 1 -- 172.21.15.45:0/1209696379 shutdown_connections 2023-11-28T12:06:34.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.056+0000 7f13101ff700 1 --2- 172.21.15.45:0/1209696379 >> v2:172.21.15.152:3300/0 conn(0x7f13080d2320 0x7f13080cd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:34.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.056+0000 7f13101ff700 1 --2- 172.21.15.45:0/1209696379 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f130815c9b0 0x7f13080b4bf0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:34.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.056+0000 7f13101ff700 1 --2- 172.21.15.45:0/1209696379 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1308161340 0x7f13080d1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:34.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.056+0000 7f13101ff700 1 -- 172.21.15.45:0/1209696379 >> 172.21.15.45:0/1209696379 conn(0x7f1308072600 msgr2=0x7f13080cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:34.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.056+0000 7f13101ff700 1 -- 172.21.15.45:0/1209696379 shutdown_connections 2023-11-28T12:06:34.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.056+0000 7f13101ff700 1 -- 172.21.15.45:0/1209696379 wait complete. 2023-11-28T12:06:34.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.058+0000 7f13101ff700 1 Processor -- start 2023-11-28T12:06:34.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.058+0000 7f13101ff700 1 -- start start 2023-11-28T12:06:34.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.059+0000 7f13101ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13080d2320 0x7f1308159dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:34.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.059+0000 7f13101ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f130815c9b0 0x7f13080caec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:34.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.059+0000 7f13101ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1308161340 0x7f13081f1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:34.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.059+0000 7f13101ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13080c99a0 con 0x7f13080d2320 2023-11-28T12:06:34.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.059+0000 7f13101ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13080c8e20 con 0x7f1308161340 2023-11-28T12:06:34.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.059+0000 7f13101ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13080c9100 con 0x7f130815c9b0 2023-11-28T12:06:34.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.059+0000 7f130df9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13080d2320 0x7f1308159dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:34.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.059+0000 7f130df9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13080d2320 0x7f1308159dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35756/0 (socket says 172.21.15.45:35756) 2023-11-28T12:06:34.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.059+0000 7f130df9b700 1 -- 172.21.15.45:0/1409622892 learned_addr learned my addr 172.21.15.45:0/1409622892 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:34.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.059+0000 7f130e79c700 1 --2- 172.21.15.45:0/1409622892 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1308161340 0x7f13081f1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:34.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.059+0000 7f130d79a700 1 --2- 172.21.15.45:0/1409622892 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f130815c9b0 0x7f13080caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:34.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.060+0000 7f130df9b700 1 -- 172.21.15.45:0/1409622892 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f130815c9b0 msgr2=0x7f13080caec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:34.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.060+0000 7f130df9b700 1 --2- 172.21.15.45:0/1409622892 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f130815c9b0 0x7f13080caec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:34.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.060+0000 7f130df9b700 1 -- 172.21.15.45:0/1409622892 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1308161340 msgr2=0x7f13081f1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:34.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.060+0000 7f130df9b700 1 --2- 172.21.15.45:0/1409622892 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1308161340 0x7f13081f1ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:34.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.060+0000 7f130df9b700 1 -- 172.21.15.45:0/1409622892 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1304009550 con 0x7f13080d2320 2023-11-28T12:06:34.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.060+0000 7f130df9b700 1 --2- 172.21.15.45:0/1409622892 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13080d2320 0x7f1308159dd0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1304009c10 tx=0x7f1304004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:34.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.060+0000 7f12fe7fc700 1 -- 172.21.15.45:0/1409622892 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1304004510 con 0x7f13080d2320 2023-11-28T12:06:34.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.060+0000 7f12fe7fc700 1 -- 172.21.15.45:0/1409622892 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f130401e070 con 0x7f13080d2320 2023-11-28T12:06:34.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.060+0000 7f12fe7fc700 1 -- 172.21.15.45:0/1409622892 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13040038e0 con 0x7f13080d2320 2023-11-28T12:06:34.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.060+0000 7f13101ff700 1 -- 172.21.15.45:0/1409622892 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13080b5130 con 0x7f13080d2320 2023-11-28T12:06:34.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.060+0000 7f13101ff700 1 -- 172.21.15.45:0/1409622892 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13080d15e0 con 0x7f13080d2320 2023-11-28T12:06:34.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.061+0000 7f13101ff700 1 -- 172.21.15.45:0/1409622892 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13080b52c0 con 0x7f13080d2320 2023-11-28T12:06:34.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.062+0000 7f12fe7fc700 1 -- 172.21.15.45:0/1409622892 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f130400f050 con 0x7f13080d2320 2023-11-28T12:06:34.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.063+0000 7f12fe7fc700 1 --2- 172.21.15.45:0/1409622892 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f12ec0682f0 0x7f12ec06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:34.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.063+0000 7f12fe7fc700 1 -- 172.21.15.45:0/1409622892 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1304086aa0 con 0x7f13080d2320 2023-11-28T12:06:34.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.063+0000 7f130d79a700 1 --2- 172.21.15.45:0/1409622892 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f12ec0682f0 0x7f12ec06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:34.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.064+0000 7f130d79a700 1 --2- 172.21.15.45:0/1409622892 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f12ec0682f0 0x7f12ec06a7a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f130806bb60 tx=0x7f12f8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:34.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.067+0000 7f12fe7fc700 1 -- 172.21.15.45:0/1409622892 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f1304053300 con 0x7f13080d2320 2023-11-28T12:06:34.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.266+0000 7f13101ff700 1 -- 172.21.15.45:0/1409622892 --> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f13080745c0 con 0x7f12ec0682f0 2023-11-28T12:06:34.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.278+0000 7f12fe7fc700 1 -- 172.21.15.45:0/1409622892 <== mgr.4100 v2:172.21.15.152:6832/115389 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286932 (secure 0 0 0) 0x7f13080745c0 con 0x7f12ec0682f0 2023-11-28T12:06:34.282 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:06:34.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.282+0000 7f13101ff700 1 -- 172.21.15.45:0/1409622892 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f12ec0682f0 msgr2=0x7f12ec06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:34.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.282+0000 7f13101ff700 1 --2- 172.21.15.45:0/1409622892 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f12ec0682f0 0x7f12ec06a7a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f130806bb60 tx=0x7f12f8008040 comp rx=0 tx=0).stop 2023-11-28T12:06:34.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.282+0000 7f13101ff700 1 -- 172.21.15.45:0/1409622892 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13080d2320 msgr2=0x7f1308159dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:34.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.282+0000 7f13101ff700 1 --2- 172.21.15.45:0/1409622892 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13080d2320 0x7f1308159dd0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1304009c10 tx=0x7f1304004750 comp rx=0 tx=0).stop 2023-11-28T12:06:34.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.282+0000 7f13101ff700 1 -- 172.21.15.45:0/1409622892 shutdown_connections 2023-11-28T12:06:34.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.282+0000 7f13101ff700 1 --2- 172.21.15.45:0/1409622892 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f12ec0682f0 0x7f12ec06a7a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:34.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.282+0000 7f13101ff700 1 --2- 172.21.15.45:0/1409622892 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1308161340 0x7f13081f1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:34.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.282+0000 7f13101ff700 1 --2- 172.21.15.45:0/1409622892 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13080d2320 0x7f1308159dd0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:34.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.282+0000 7f13101ff700 1 --2- 172.21.15.45:0/1409622892 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f130815c9b0 0x7f13080caec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:34.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.282+0000 7f13101ff700 1 -- 172.21.15.45:0/1409622892 >> 172.21.15.45:0/1409622892 conn(0x7f1308072600 msgr2=0x7f130815cd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:34.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.282+0000 7f13101ff700 1 -- 172.21.15.45:0/1409622892 shutdown_connections 2023-11-28T12:06:34.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.282+0000 7f13101ff700 1 -- 172.21.15.45:0/1409622892 wait complete. 2023-11-28T12:06:34.285 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-11-28T12:06:34.301 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2023-11-28T12:06:32.424870+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":142,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":82240,"kb_used_data":2816,"kb_used_omap":0,"kb_used_meta":79360,"kb_avail":754892480,"statfs":{"total":773094113280,"available":773009899520,"internally_reserved":0,"allocated":2883584,"data_stored":1778098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":81264640},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.548135"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.400350+0000","last_change":"2023-11-28T12:06:29.429595+0000","last_active":"2023-11-28T12:06:30.400350+0000","last_peered":"2023-11-28T12:06:30.400350+0000","last_clean":"2023-11-28T12:06:30.400350+0000","last_became_active":"2023-11-28T12:06:29.428839+0000","last_became_peered":"2023-11-28T12:06:29.428839+0000","last_unstale":"2023-11-28T12:06:30.400350+0000","last_undegraded":"2023-11-28T12:06:30.400350+0000","last_fullsized":"2023-11-28T12:06:30.400350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:51:28.536571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.402235+0000","last_change":"2023-11-28T12:06:29.425536+0000","last_active":"2023-11-28T12:06:30.402235+0000","last_peered":"2023-11-28T12:06:30.402235+0000","last_clean":"2023-11-28T12:06:30.402235+0000","last_became_active":"2023-11-28T12:06:29.425250+0000","last_became_peered":"2023-11-28T12:06:29.425250+0000","last_unstale":"2023-11-28T12:06:30.402235+0000","last_undegraded":"2023-11-28T12:06:30.402235+0000","last_fullsized":"2023-11-28T12:06:30.402235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:27:03.452097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432130+0000","last_change":"2023-11-28T12:06:29.419165+0000","last_active":"2023-11-28T12:06:30.432130+0000","last_peered":"2023-11-28T12:06:30.432130+0000","last_clean":"2023-11-28T12:06:30.432130+0000","last_became_active":"2023-11-28T12:06:29.417243+0000","last_became_peered":"2023-11-28T12:06:29.417243+0000","last_unstale":"2023-11-28T12:06:30.432130+0000","last_undegraded":"2023-11-28T12:06:30.432130+0000","last_fullsized":"2023-11-28T12:06:30.432130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:20:33.063079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.402605+0000","last_change":"2023-11-28T12:06:29.422225+0000","last_active":"2023-11-28T12:06:30.402605+0000","last_peered":"2023-11-28T12:06:30.402605+0000","last_clean":"2023-11-28T12:06:30.402605+0000","last_became_active":"2023-11-28T12:06:29.419794+0000","last_became_peered":"2023-11-28T12:06:29.419794+0000","last_unstale":"2023-11-28T12:06:30.402605+0000","last_undegraded":"2023-11-28T12:06:30.402605+0000","last_fullsized":"2023-11-28T12:06:30.402605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:02:26.849301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.430942+0000","last_change":"2023-11-28T12:06:29.426450+0000","last_active":"2023-11-28T12:06:30.430942+0000","last_peered":"2023-11-28T12:06:30.430942+0000","last_clean":"2023-11-28T12:06:30.430942+0000","last_became_active":"2023-11-28T12:06:29.424681+0000","last_became_peered":"2023-11-28T12:06:29.424681+0000","last_unstale":"2023-11-28T12:06:30.430942+0000","last_undegraded":"2023-11-28T12:06:30.430942+0000","last_fullsized":"2023-11-28T12:06:30.430942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:27:03.452097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431570+0000","last_change":"2023-11-28T12:06:29.419827+0000","last_active":"2023-11-28T12:06:30.431570+0000","last_peered":"2023-11-28T12:06:30.431570+0000","last_clean":"2023-11-28T12:06:30.431570+0000","last_became_active":"2023-11-28T12:06:29.419556+0000","last_became_peered":"2023-11-28T12:06:29.419556+0000","last_unstale":"2023-11-28T12:06:30.431570+0000","last_undegraded":"2023-11-28T12:06:30.431570+0000","last_fullsized":"2023-11-28T12:06:30.431570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:05:52.134696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431287+0000","last_change":"2023-11-28T12:06:29.426829+0000","last_active":"2023-11-28T12:06:30.431287+0000","last_peered":"2023-11-28T12:06:30.431287+0000","last_clean":"2023-11-28T12:06:30.431287+0000","last_became_active":"2023-11-28T12:06:29.426579+0000","last_became_peered":"2023-11-28T12:06:29.426579+0000","last_unstale":"2023-11-28T12:06:30.431287+0000","last_undegraded":"2023-11-28T12:06:30.431287+0000","last_fullsized":"2023-11-28T12:06:30.431287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:03:53.795177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.402279+0000","last_change":"2023-11-28T12:06:29.425956+0000","last_active":"2023-11-28T12:06:30.402279+0000","last_peered":"2023-11-28T12:06:30.402279+0000","last_clean":"2023-11-28T12:06:30.402279+0000","last_became_active":"2023-11-28T12:06:29.422623+0000","last_became_peered":"2023-11-28T12:06:29.422623+0000","last_unstale":"2023-11-28T12:06:30.402279+0000","last_undegraded":"2023-11-28T12:06:30.402279+0000","last_fullsized":"2023-11-28T12:06:30.402279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:28:44.482157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432487+0000","last_change":"2023-11-28T12:06:29.431715+0000","last_active":"2023-11-28T12:06:30.432487+0000","last_peered":"2023-11-28T12:06:30.432487+0000","last_clean":"2023-11-28T12:06:30.432487+0000","last_became_active":"2023-11-28T12:06:29.431487+0000","last_became_peered":"2023-11-28T12:06:29.431487+0000","last_unstale":"2023-11-28T12:06:30.432487+0000","last_undegraded":"2023-11-28T12:06:30.432487+0000","last_fullsized":"2023-11-28T12:06:30.432487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:57:52.848285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.402475+0000","last_change":"2023-11-28T12:06:29.421929+0000","last_active":"2023-11-28T12:06:30.402475+0000","last_peered":"2023-11-28T12:06:30.402475+0000","last_clean":"2023-11-28T12:06:30.402475+0000","last_became_active":"2023-11-28T12:06:29.421572+0000","last_became_peered":"2023-11-28T12:06:29.421572+0000","last_unstale":"2023-11-28T12:06:30.402475+0000","last_undegraded":"2023-11-28T12:06:30.402475+0000","last_fullsized":"2023-11-28T12:06:30.402475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:31:18.258195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432165+0000","last_change":"2023-11-28T12:06:29.427047+0000","last_active":"2023-11-28T12:06:30.432165+0000","last_peered":"2023-11-28T12:06:30.432165+0000","last_clean":"2023-11-28T12:06:30.432165+0000","last_became_active":"2023-11-28T12:06:29.418090+0000","last_became_peered":"2023-11-28T12:06:29.418090+0000","last_unstale":"2023-11-28T12:06:30.432165+0000","last_undegraded":"2023-11-28T12:06:30.432165+0000","last_fullsized":"2023-11-28T12:06:30.432165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:24:27.065719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.400209+0000","last_change":"2023-11-28T12:06:29.424306+0000","last_active":"2023-11-28T12:06:30.400209+0000","last_peered":"2023-11-28T12:06:30.400209+0000","last_clean":"2023-11-28T12:06:30.400209+0000","last_became_active":"2023-11-28T12:06:29.424059+0000","last_became_peered":"2023-11-28T12:06:29.424059+0000","last_unstale":"2023-11-28T12:06:30.400209+0000","last_undegraded":"2023-11-28T12:06:30.400209+0000","last_fullsized":"2023-11-28T12:06:30.400209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:10:08.464896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.400054+0000","last_change":"2023-11-28T12:06:29.422496+0000","last_active":"2023-11-28T12:06:30.400054+0000","last_peered":"2023-11-28T12:06:30.400054+0000","last_clean":"2023-11-28T12:06:30.400054+0000","last_became_active":"2023-11-28T12:06:29.422201+0000","last_became_peered":"2023-11-28T12:06:29.422201+0000","last_unstale":"2023-11-28T12:06:30.400054+0000","last_undegraded":"2023-11-28T12:06:30.400054+0000","last_fullsized":"2023-11-28T12:06:30.400054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:22:20.431576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.402686+0000","last_change":"2023-11-28T12:06:29.426168+0000","last_active":"2023-11-28T12:06:30.402686+0000","last_peered":"2023-11-28T12:06:30.402686+0000","last_clean":"2023-11-28T12:06:30.402686+0000","last_became_active":"2023-11-28T12:06:29.425480+0000","last_became_peered":"2023-11-28T12:06:29.425480+0000","last_unstale":"2023-11-28T12:06:30.402686+0000","last_undegraded":"2023-11-28T12:06:30.402686+0000","last_fullsized":"2023-11-28T12:06:30.402686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:13:08.504009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431515+0000","last_change":"2023-11-28T12:06:29.428464+0000","last_active":"2023-11-28T12:06:30.431515+0000","last_peered":"2023-11-28T12:06:30.431515+0000","last_clean":"2023-11-28T12:06:30.431515+0000","last_became_active":"2023-11-28T12:06:29.428110+0000","last_became_peered":"2023-11-28T12:06:29.428110+0000","last_unstale":"2023-11-28T12:06:30.431515+0000","last_undegraded":"2023-11-28T12:06:30.431515+0000","last_fullsized":"2023-11-28T12:06:30.431515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:13:08.504009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431253+0000","last_change":"2023-11-28T12:06:29.416388+0000","last_active":"2023-11-28T12:06:30.431253+0000","last_peered":"2023-11-28T12:06:30.431253+0000","last_clean":"2023-11-28T12:06:30.431253+0000","last_became_active":"2023-11-28T12:06:29.416031+0000","last_became_peered":"2023-11-28T12:06:29.416031+0000","last_unstale":"2023-11-28T12:06:30.431253+0000","last_undegraded":"2023-11-28T12:06:30.431253+0000","last_fullsized":"2023-11-28T12:06:30.431253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:33:22.203612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432609+0000","last_change":"2023-11-28T12:06:29.431468+0000","last_active":"2023-11-28T12:06:30.432609+0000","last_peered":"2023-11-28T12:06:30.432609+0000","last_clean":"2023-11-28T12:06:30.432609+0000","last_became_active":"2023-11-28T12:06:29.430744+0000","last_became_peered":"2023-11-28T12:06:29.430744+0000","last_unstale":"2023-11-28T12:06:30.432609+0000","last_undegraded":"2023-11-28T12:06:30.432609+0000","last_fullsized":"2023-11-28T12:06:30.432609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:13:08.504009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432429+0000","last_change":"2023-11-28T12:06:29.422318+0000","last_active":"2023-11-28T12:06:30.432429+0000","last_peered":"2023-11-28T12:06:30.432429+0000","last_clean":"2023-11-28T12:06:30.432429+0000","last_became_active":"2023-11-28T12:06:29.421236+0000","last_became_peered":"2023-11-28T12:06:29.421236+0000","last_unstale":"2023-11-28T12:06:30.432429+0000","last_undegraded":"2023-11-28T12:06:30.432429+0000","last_fullsized":"2023-11-28T12:06:30.432429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:42:57.391884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.400334+0000","last_change":"2023-11-28T12:06:29.417658+0000","last_active":"2023-11-28T12:06:30.400334+0000","last_peered":"2023-11-28T12:06:30.400334+0000","last_clean":"2023-11-28T12:06:30.400334+0000","last_became_active":"2023-11-28T12:06:29.417101+0000","last_became_peered":"2023-11-28T12:06:29.417101+0000","last_unstale":"2023-11-28T12:06:30.400334+0000","last_undegraded":"2023-11-28T12:06:30.400334+0000","last_fullsized":"2023-11-28T12:06:30.400334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:27:38.882977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432163+0000","last_change":"2023-11-28T12:06:29.420113+0000","last_active":"2023-11-28T12:06:30.432163+0000","last_peered":"2023-11-28T12:06:30.432163+0000","last_clean":"2023-11-28T12:06:30.432163+0000","last_became_active":"2023-11-28T12:06:29.419156+0000","last_became_peered":"2023-11-28T12:06:29.419156+0000","last_unstale":"2023-11-28T12:06:30.432163+0000","last_undegraded":"2023-11-28T12:06:30.432163+0000","last_fullsized":"2023-11-28T12:06:30.432163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:28:34.213514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431510+0000","last_change":"2023-11-28T12:06:29.430718+0000","last_active":"2023-11-28T12:06:30.431510+0000","last_peered":"2023-11-28T12:06:30.431510+0000","last_clean":"2023-11-28T12:06:30.431510+0000","last_became_active":"2023-11-28T12:06:29.430451+0000","last_became_peered":"2023-11-28T12:06:29.430451+0000","last_unstale":"2023-11-28T12:06:30.431510+0000","last_undegraded":"2023-11-28T12:06:30.431510+0000","last_fullsized":"2023-11-28T12:06:30.431510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:07:00.558286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432197+0000","last_change":"2023-11-28T12:06:29.419281+0000","last_active":"2023-11-28T12:06:30.432197+0000","last_peered":"2023-11-28T12:06:30.432197+0000","last_clean":"2023-11-28T12:06:30.432197+0000","last_became_active":"2023-11-28T12:06:29.418987+0000","last_became_peered":"2023-11-28T12:06:29.418987+0000","last_unstale":"2023-11-28T12:06:30.432197+0000","last_undegraded":"2023-11-28T12:06:30.432197+0000","last_fullsized":"2023-11-28T12:06:30.432197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:57:15.470252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.430620+0000","last_change":"2023-11-28T12:06:29.415280+0000","last_active":"2023-11-28T12:06:30.430620+0000","last_peered":"2023-11-28T12:06:30.430620+0000","last_clean":"2023-11-28T12:06:30.430620+0000","last_became_active":"2023-11-28T12:06:29.414999+0000","last_became_peered":"2023-11-28T12:06:29.414999+0000","last_unstale":"2023-11-28T12:06:30.430620+0000","last_undegraded":"2023-11-28T12:06:30.430620+0000","last_fullsized":"2023-11-28T12:06:30.430620+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:27:03.452097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431563+0000","last_change":"2023-11-28T12:06:29.429537+0000","last_active":"2023-11-28T12:06:30.431563+0000","last_peered":"2023-11-28T12:06:30.431563+0000","last_clean":"2023-11-28T12:06:30.431563+0000","last_became_active":"2023-11-28T12:06:29.428962+0000","last_became_peered":"2023-11-28T12:06:29.428962+0000","last_unstale":"2023-11-28T12:06:30.431563+0000","last_undegraded":"2023-11-28T12:06:30.431563+0000","last_fullsized":"2023-11-28T12:06:30.431563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:51:20.319063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431697+0000","last_change":"2023-11-28T12:06:29.421014+0000","last_active":"2023-11-28T12:06:30.431697+0000","last_peered":"2023-11-28T12:06:30.431697+0000","last_clean":"2023-11-28T12:06:30.431697+0000","last_became_active":"2023-11-28T12:06:29.418311+0000","last_became_peered":"2023-11-28T12:06:29.418311+0000","last_unstale":"2023-11-28T12:06:30.431697+0000","last_undegraded":"2023-11-28T12:06:30.431697+0000","last_fullsized":"2023-11-28T12:06:30.431697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:47:58.895820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432093+0000","last_change":"2023-11-28T12:06:29.415605+0000","last_active":"2023-11-28T12:06:30.432093+0000","last_peered":"2023-11-28T12:06:30.432093+0000","last_clean":"2023-11-28T12:06:30.432093+0000","last_became_active":"2023-11-28T12:06:29.413218+0000","last_became_peered":"2023-11-28T12:06:29.413218+0000","last_unstale":"2023-11-28T12:06:30.432093+0000","last_undegraded":"2023-11-28T12:06:30.432093+0000","last_fullsized":"2023-11-28T12:06:30.432093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:03:53.795177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.402352+0000","last_change":"2023-11-28T12:06:29.438175+0000","last_active":"2023-11-28T12:06:30.402352+0000","last_peered":"2023-11-28T12:06:30.402352+0000","last_clean":"2023-11-28T12:06:30.402352+0000","last_became_active":"2023-11-28T12:06:29.437503+0000","last_became_peered":"2023-11-28T12:06:29.437503+0000","last_unstale":"2023-11-28T12:06:30.402352+0000","last_undegraded":"2023-11-28T12:06:30.402352+0000","last_fullsized":"2023-11-28T12:06:30.402352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:57:52.848285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431780+0000","last_change":"2023-11-28T12:06:28.910005+0000","last_active":"2023-11-28T12:06:30.431780+0000","last_peered":"2023-11-28T12:06:30.431780+0000","last_clean":"2023-11-28T12:06:30.431780+0000","last_became_active":"2023-11-28T12:06:28.909736+0000","last_became_peered":"2023-11-28T12:06:28.909736+0000","last_unstale":"2023-11-28T12:06:30.431780+0000","last_undegraded":"2023-11-28T12:06:30.431780+0000","last_fullsized":"2023-11-28T12:06:30.431780+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:27:37.876201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431752+0000","last_change":"2023-11-28T12:06:29.412757+0000","last_active":"2023-11-28T12:06:30.431752+0000","last_peered":"2023-11-28T12:06:30.431752+0000","last_clean":"2023-11-28T12:06:30.431752+0000","last_became_active":"2023-11-28T12:06:29.412424+0000","last_became_peered":"2023-11-28T12:06:29.412424+0000","last_unstale":"2023-11-28T12:06:30.431752+0000","last_undegraded":"2023-11-28T12:06:30.431752+0000","last_fullsized":"2023-11-28T12:06:30.431752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:18:07.794113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431275+0000","last_change":"2023-11-28T12:06:28.915845+0000","last_active":"2023-11-28T12:06:30.431275+0000","last_peered":"2023-11-28T12:06:30.431275+0000","last_clean":"2023-11-28T12:06:30.431275+0000","last_became_active":"2023-11-28T12:06:28.915223+0000","last_became_peered":"2023-11-28T12:06:28.915223+0000","last_unstale":"2023-11-28T12:06:30.431275+0000","last_undegraded":"2023-11-28T12:06:30.431275+0000","last_fullsized":"2023-11-28T12:06:30.431275+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:18:19.943945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432576+0000","last_change":"2023-11-28T12:06:29.431967+0000","last_active":"2023-11-28T12:06:30.432576+0000","last_peered":"2023-11-28T12:06:30.432576+0000","last_clean":"2023-11-28T12:06:30.432576+0000","last_became_active":"2023-11-28T12:06:29.430710+0000","last_became_peered":"2023-11-28T12:06:29.430710+0000","last_unstale":"2023-11-28T12:06:30.432576+0000","last_undegraded":"2023-11-28T12:06:30.432576+0000","last_fullsized":"2023-11-28T12:06:30.432576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:03:53.795177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.430884+0000","last_change":"2023-11-28T12:06:28.901401+0000","last_active":"2023-11-28T12:06:30.430884+0000","last_peered":"2023-11-28T12:06:30.430884+0000","last_clean":"2023-11-28T12:06:30.430884+0000","last_became_active":"2023-11-28T12:06:28.900727+0000","last_became_peered":"2023-11-28T12:06:28.900727+0000","last_unstale":"2023-11-28T12:06:30.430884+0000","last_undegraded":"2023-11-28T12:06:30.430884+0000","last_fullsized":"2023-11-28T12:06:30.430884+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:43:34.311973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.402933+0000","last_change":"2023-11-28T12:06:29.420506+0000","last_active":"2023-11-28T12:06:30.402933+0000","last_peered":"2023-11-28T12:06:30.402933+0000","last_clean":"2023-11-28T12:06:30.402933+0000","last_became_active":"2023-11-28T12:06:29.419616+0000","last_became_peered":"2023-11-28T12:06:29.419616+0000","last_unstale":"2023-11-28T12:06:30.402933+0000","last_undegraded":"2023-11-28T12:06:30.402933+0000","last_fullsized":"2023-11-28T12:06:30.402933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:33:22.203612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432686+0000","last_change":"2023-11-28T12:06:28.904440+0000","last_active":"2023-11-28T12:06:30.432686+0000","last_peered":"2023-11-28T12:06:30.432686+0000","last_clean":"2023-11-28T12:06:30.432686+0000","last_became_active":"2023-11-28T12:06:28.904179+0000","last_became_peered":"2023-11-28T12:06:28.904179+0000","last_unstale":"2023-11-28T12:06:30.432686+0000","last_undegraded":"2023-11-28T12:06:30.432686+0000","last_fullsized":"2023-11-28T12:06:30.432686+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:25:02.799298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.430795+0000","last_change":"2023-11-28T12:06:29.411944+0000","last_active":"2023-11-28T12:06:30.430795+0000","last_peered":"2023-11-28T12:06:30.430795+0000","last_clean":"2023-11-28T12:06:30.430795+0000","last_became_active":"2023-11-28T12:06:29.411564+0000","last_became_peered":"2023-11-28T12:06:29.411564+0000","last_unstale":"2023-11-28T12:06:30.430795+0000","last_undegraded":"2023-11-28T12:06:30.430795+0000","last_fullsized":"2023-11-28T12:06:30.430795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:57:15.470252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.402366+0000","last_change":"2023-11-28T12:06:28.901015+0000","last_active":"2023-11-28T12:06:30.402366+0000","last_peered":"2023-11-28T12:06:30.402366+0000","last_clean":"2023-11-28T12:06:30.402366+0000","last_became_active":"2023-11-28T12:06:28.900724+0000","last_became_peered":"2023-11-28T12:06:28.900724+0000","last_unstale":"2023-11-28T12:06:30.402366+0000","last_undegraded":"2023-11-28T12:06:30.402366+0000","last_fullsized":"2023-11-28T12:06:30.402366+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:25:02.799298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.430807+0000","last_change":"2023-11-28T12:06:29.425082+0000","last_active":"2023-11-28T12:06:30.430807+0000","last_peered":"2023-11-28T12:06:30.430807+0000","last_clean":"2023-11-28T12:06:30.430807+0000","last_became_active":"2023-11-28T12:06:29.424753+0000","last_became_peered":"2023-11-28T12:06:29.424753+0000","last_unstale":"2023-11-28T12:06:30.430807+0000","last_undegraded":"2023-11-28T12:06:30.430807+0000","last_fullsized":"2023-11-28T12:06:30.430807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:57:52.848285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432060+0000","last_change":"2023-11-28T12:06:28.904157+0000","last_active":"2023-11-28T12:06:30.432060+0000","last_peered":"2023-11-28T12:06:30.432060+0000","last_clean":"2023-11-28T12:06:30.432060+0000","last_became_active":"2023-11-28T12:06:28.902746+0000","last_became_peered":"2023-11-28T12:06:28.902746+0000","last_unstale":"2023-11-28T12:06:30.432060+0000","last_undegraded":"2023-11-28T12:06:30.432060+0000","last_fullsized":"2023-11-28T12:06:30.432060+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:33:21.196836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431731+0000","last_change":"2023-11-28T12:06:29.417397+0000","last_active":"2023-11-28T12:06:30.431731+0000","last_peered":"2023-11-28T12:06:30.431731+0000","last_clean":"2023-11-28T12:06:30.431731+0000","last_became_active":"2023-11-28T12:06:29.416301+0000","last_became_peered":"2023-11-28T12:06:29.416301+0000","last_unstale":"2023-11-28T12:06:30.431731+0000","last_undegraded":"2023-11-28T12:06:30.431731+0000","last_fullsized":"2023-11-28T12:06:30.431731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:51:20.319063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"19'6","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432375+0000","last_change":"2023-11-28T12:06:28.907107+0000","last_active":"2023-11-28T12:06:30.432375+0000","last_peered":"2023-11-28T12:06:30.432375+0000","last_clean":"2023-11-28T12:06:30.432375+0000","last_became_active":"2023-11-28T12:06:28.906719+0000","last_became_peered":"2023-11-28T12:06:28.906719+0000","last_unstale":"2023-11-28T12:06:30.432375+0000","last_undegraded":"2023-11-28T12:06:30.432375+0000","last_fullsized":"2023-11-28T12:06:30.432375+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:18:19.943945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432208+0000","last_change":"2023-11-28T12:06:29.421775+0000","last_active":"2023-11-28T12:06:30.432208+0000","last_peered":"2023-11-28T12:06:30.432208+0000","last_clean":"2023-11-28T12:06:30.432208+0000","last_became_active":"2023-11-28T12:06:29.421474+0000","last_became_peered":"2023-11-28T12:06:29.421474+0000","last_unstale":"2023-11-28T12:06:30.432208+0000","last_undegraded":"2023-11-28T12:06:30.432208+0000","last_fullsized":"2023-11-28T12:06:30.432208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:03:53.795177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431365+0000","last_change":"2023-11-28T12:06:28.906549+0000","last_active":"2023-11-28T12:06:30.431365+0000","last_peered":"2023-11-28T12:06:30.431365+0000","last_clean":"2023-11-28T12:06:30.431365+0000","last_became_active":"2023-11-28T12:06:28.906267+0000","last_became_peered":"2023-11-28T12:06:28.906267+0000","last_unstale":"2023-11-28T12:06:30.431365+0000","last_undegraded":"2023-11-28T12:06:30.431365+0000","last_fullsized":"2023-11-28T12:06:30.431365+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:20:03.086957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431336+0000","last_change":"2023-11-28T12:06:29.412345+0000","last_active":"2023-11-28T12:06:30.431336+0000","last_peered":"2023-11-28T12:06:30.431336+0000","last_clean":"2023-11-28T12:06:30.431336+0000","last_became_active":"2023-11-28T12:06:29.412100+0000","last_became_peered":"2023-11-28T12:06:29.412100+0000","last_unstale":"2023-11-28T12:06:30.431336+0000","last_undegraded":"2023-11-28T12:06:30.431336+0000","last_fullsized":"2023-11-28T12:06:30.431336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:08:40.987428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432293+0000","last_change":"2023-11-28T12:06:28.901789+0000","last_active":"2023-11-28T12:06:30.432293+0000","last_peered":"2023-11-28T12:06:30.432293+0000","last_clean":"2023-11-28T12:06:30.432293+0000","last_became_active":"2023-11-28T12:06:28.901317+0000","last_became_peered":"2023-11-28T12:06:28.901317+0000","last_unstale":"2023-11-28T12:06:30.432293+0000","last_undegraded":"2023-11-28T12:06:30.432293+0000","last_fullsized":"2023-11-28T12:06:30.432293+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:18:19.943945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.402428+0000","last_change":"2023-11-28T12:06:29.428820+0000","last_active":"2023-11-28T12:06:30.402428+0000","last_peered":"2023-11-28T12:06:30.402428+0000","last_clean":"2023-11-28T12:06:30.402428+0000","last_became_active":"2023-11-28T12:06:29.428532+0000","last_became_peered":"2023-11-28T12:06:29.428532+0000","last_unstale":"2023-11-28T12:06:30.402428+0000","last_undegraded":"2023-11-28T12:06:30.402428+0000","last_fullsized":"2023-11-28T12:06:30.402428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:03:53.795177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431427+0000","last_change":"2023-11-28T12:06:28.911421+0000","last_active":"2023-11-28T12:06:30.431427+0000","last_peered":"2023-11-28T12:06:30.431427+0000","last_clean":"2023-11-28T12:06:30.431427+0000","last_became_active":"2023-11-28T12:06:28.911098+0000","last_became_peered":"2023-11-28T12:06:28.911098+0000","last_unstale":"2023-11-28T12:06:30.431427+0000","last_undegraded":"2023-11-28T12:06:30.431427+0000","last_fullsized":"2023-11-28T12:06:30.431427+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:57:01.417679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432485+0000","last_change":"2023-11-28T12:06:29.428661+0000","last_active":"2023-11-28T12:06:30.432485+0000","last_peered":"2023-11-28T12:06:30.432485+0000","last_clean":"2023-11-28T12:06:30.432485+0000","last_became_active":"2023-11-28T12:06:29.427044+0000","last_became_peered":"2023-11-28T12:06:29.427044+0000","last_unstale":"2023-11-28T12:06:30.432485+0000","last_undegraded":"2023-11-28T12:06:30.432485+0000","last_fullsized":"2023-11-28T12:06:30.432485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:28:44.482157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.401722+0000","last_change":"2023-11-28T12:06:28.900418+0000","last_active":"2023-11-28T12:06:30.401722+0000","last_peered":"2023-11-28T12:06:30.401722+0000","last_clean":"2023-11-28T12:06:30.401722+0000","last_became_active":"2023-11-28T12:06:28.900135+0000","last_became_peered":"2023-11-28T12:06:28.900135+0000","last_unstale":"2023-11-28T12:06:30.401722+0000","last_undegraded":"2023-11-28T12:06:30.401722+0000","last_fullsized":"2023-11-28T12:06:30.401722+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:51:27.529794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432203+0000","last_change":"2023-11-28T12:06:29.419258+0000","last_active":"2023-11-28T12:06:30.432203+0000","last_peered":"2023-11-28T12:06:30.432203+0000","last_clean":"2023-11-28T12:06:30.432203+0000","last_became_active":"2023-11-28T12:06:29.418964+0000","last_became_peered":"2023-11-28T12:06:29.418964+0000","last_unstale":"2023-11-28T12:06:30.432203+0000","last_undegraded":"2023-11-28T12:06:30.432203+0000","last_fullsized":"2023-11-28T12:06:30.432203+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:28:34.213514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431583+0000","last_change":"2023-11-28T12:06:28.906323+0000","last_active":"2023-11-28T12:06:30.431583+0000","last_peered":"2023-11-28T12:06:30.431583+0000","last_clean":"2023-11-28T12:06:30.431583+0000","last_became_active":"2023-11-28T12:06:28.906018+0000","last_became_peered":"2023-11-28T12:06:28.906018+0000","last_unstale":"2023-11-28T12:06:30.431583+0000","last_undegraded":"2023-11-28T12:06:30.431583+0000","last_fullsized":"2023-11-28T12:06:30.431583+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:43:34.311973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.401855+0000","last_change":"2023-11-28T12:06:29.428058+0000","last_active":"2023-11-28T12:06:30.401855+0000","last_peered":"2023-11-28T12:06:30.401855+0000","last_clean":"2023-11-28T12:06:30.401855+0000","last_became_active":"2023-11-28T12:06:29.427473+0000","last_became_peered":"2023-11-28T12:06:29.427473+0000","last_unstale":"2023-11-28T12:06:30.401855+0000","last_undegraded":"2023-11-28T12:06:30.401855+0000","last_fullsized":"2023-11-28T12:06:30.401855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:07:00.558286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431905+0000","last_change":"2023-11-28T12:06:28.911429+0000","last_active":"2023-11-28T12:06:30.431905+0000","last_peered":"2023-11-28T12:06:30.431905+0000","last_clean":"2023-11-28T12:06:30.431905+0000","last_became_active":"2023-11-28T12:06:28.911128+0000","last_became_peered":"2023-11-28T12:06:28.911128+0000","last_unstale":"2023-11-28T12:06:30.431905+0000","last_undegraded":"2023-11-28T12:06:30.431905+0000","last_fullsized":"2023-11-28T12:06:30.431905+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:05:22.551488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431796+0000","last_change":"2023-11-28T12:06:29.431218+0000","last_active":"2023-11-28T12:06:30.431796+0000","last_peered":"2023-11-28T12:06:30.431796+0000","last_clean":"2023-11-28T12:06:30.431796+0000","last_became_active":"2023-11-28T12:06:29.430478+0000","last_became_peered":"2023-11-28T12:06:29.430478+0000","last_unstale":"2023-11-28T12:06:30.431796+0000","last_undegraded":"2023-11-28T12:06:30.431796+0000","last_fullsized":"2023-11-28T12:06:30.431796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:36:24.619605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432004+0000","last_change":"2023-11-28T12:06:28.909101+0000","last_active":"2023-11-28T12:06:30.432004+0000","last_peered":"2023-11-28T12:06:30.432004+0000","last_clean":"2023-11-28T12:06:30.432004+0000","last_became_active":"2023-11-28T12:06:28.908745+0000","last_became_peered":"2023-11-28T12:06:28.908745+0000","last_unstale":"2023-11-28T12:06:30.432004+0000","last_undegraded":"2023-11-28T12:06:30.432004+0000","last_fullsized":"2023-11-28T12:06:30.432004+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:02:25.842525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.403103+0000","last_change":"2023-11-28T12:06:29.414146+0000","last_active":"2023-11-28T12:06:30.403103+0000","last_peered":"2023-11-28T12:06:30.403103+0000","last_clean":"2023-11-28T12:06:30.403103+0000","last_became_active":"2023-11-28T12:06:29.413597+0000","last_became_peered":"2023-11-28T12:06:29.413597+0000","last_unstale":"2023-11-28T12:06:30.403103+0000","last_undegraded":"2023-11-28T12:06:30.403103+0000","last_fullsized":"2023-11-28T12:06:30.403103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:47:58.895820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.402510+0000","last_change":"2023-11-28T12:06:28.897981+0000","last_active":"2023-11-28T12:06:30.402510+0000","last_peered":"2023-11-28T12:06:30.402510+0000","last_clean":"2023-11-28T12:06:30.402510+0000","last_became_active":"2023-11-28T12:06:28.897618+0000","last_became_peered":"2023-11-28T12:06:28.897618+0000","last_unstale":"2023-11-28T12:06:30.402510+0000","last_undegraded":"2023-11-28T12:06:30.402510+0000","last_fullsized":"2023-11-28T12:06:30.402510+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:22:19.424800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431219+0000","last_change":"2023-11-28T12:06:29.411291+0000","last_active":"2023-11-28T12:06:30.431219+0000","last_peered":"2023-11-28T12:06:30.431219+0000","last_clean":"2023-11-28T12:06:30.431219+0000","last_became_active":"2023-11-28T12:06:29.411041+0000","last_became_peered":"2023-11-28T12:06:29.411041+0000","last_unstale":"2023-11-28T12:06:30.431219+0000","last_undegraded":"2023-11-28T12:06:30.431219+0000","last_fullsized":"2023-11-28T12:06:30.431219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:25:49.001168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431191+0000","last_change":"2023-11-28T12:06:28.899397+0000","last_active":"2023-11-28T12:06:30.431191+0000","last_peered":"2023-11-28T12:06:30.431191+0000","last_clean":"2023-11-28T12:06:30.431191+0000","last_became_active":"2023-11-28T12:06:28.899027+0000","last_became_peered":"2023-11-28T12:06:28.899027+0000","last_unstale":"2023-11-28T12:06:30.431191+0000","last_undegraded":"2023-11-28T12:06:30.431191+0000","last_fullsized":"2023-11-28T12:06:30.431191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:05:22.551488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432275+0000","last_change":"2023-11-28T12:06:29.427339+0000","last_active":"2023-11-28T12:06:30.432275+0000","last_peered":"2023-11-28T12:06:30.432275+0000","last_clean":"2023-11-28T12:06:30.432275+0000","last_became_active":"2023-11-28T12:06:29.422893+0000","last_became_peered":"2023-11-28T12:06:29.422893+0000","last_unstale":"2023-11-28T12:06:30.432275+0000","last_undegraded":"2023-11-28T12:06:30.432275+0000","last_fullsized":"2023-11-28T12:06:30.432275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:57:15.470252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.402371+0000","last_change":"2023-11-28T12:06:28.911788+0000","last_active":"2023-11-28T12:06:30.402371+0000","last_peered":"2023-11-28T12:06:30.402371+0000","last_clean":"2023-11-28T12:06:30.402371+0000","last_became_active":"2023-11-28T12:06:28.910333+0000","last_became_peered":"2023-11-28T12:06:28.910333+0000","last_unstale":"2023-11-28T12:06:30.402371+0000","last_undegraded":"2023-11-28T12:06:30.402371+0000","last_fullsized":"2023-11-28T12:06:30.402371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:10:07.458120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432302+0000","last_change":"2023-11-28T12:06:29.422530+0000","last_active":"2023-11-28T12:06:30.432302+0000","last_peered":"2023-11-28T12:06:30.432302+0000","last_clean":"2023-11-28T12:06:30.432302+0000","last_became_active":"2023-11-28T12:06:29.422148+0000","last_became_peered":"2023-11-28T12:06:29.422148+0000","last_unstale":"2023-11-28T12:06:30.432302+0000","last_undegraded":"2023-11-28T12:06:30.432302+0000","last_fullsized":"2023-11-28T12:06:30.432302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:27:03.452097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431662+0000","last_change":"2023-11-28T12:06:28.906946+0000","last_active":"2023-11-28T12:06:30.431662+0000","last_peered":"2023-11-28T12:06:30.431662+0000","last_clean":"2023-11-28T12:06:30.431662+0000","last_became_active":"2023-11-28T12:06:28.906330+0000","last_became_peered":"2023-11-28T12:06:28.906330+0000","last_unstale":"2023-11-28T12:06:30.431662+0000","last_undegraded":"2023-11-28T12:06:30.431662+0000","last_fullsized":"2023-11-28T12:06:30.431662+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:51:27.529794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432470+0000","last_change":"2023-11-28T12:06:29.422900+0000","last_active":"2023-11-28T12:06:30.432470+0000","last_peered":"2023-11-28T12:06:30.432470+0000","last_clean":"2023-11-28T12:06:30.432470+0000","last_became_active":"2023-11-28T12:06:29.422592+0000","last_became_peered":"2023-11-28T12:06:29.422592+0000","last_unstale":"2023-11-28T12:06:30.432470+0000","last_undegraded":"2023-11-28T12:06:30.432470+0000","last_fullsized":"2023-11-28T12:06:30.432470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:39:17.802039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431015+0000","last_change":"2023-11-28T12:06:28.910918+0000","last_active":"2023-11-28T12:06:30.431015+0000","last_peered":"2023-11-28T12:06:30.431015+0000","last_clean":"2023-11-28T12:06:30.431015+0000","last_became_active":"2023-11-28T12:06:28.910601+0000","last_became_peered":"2023-11-28T12:06:28.910601+0000","last_unstale":"2023-11-28T12:06:30.431015+0000","last_undegraded":"2023-11-28T12:06:30.431015+0000","last_fullsized":"2023-11-28T12:06:30.431015+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:22:19.424800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432528+0000","last_change":"2023-11-28T12:06:29.428654+0000","last_active":"2023-11-28T12:06:30.432528+0000","last_peered":"2023-11-28T12:06:30.432528+0000","last_clean":"2023-11-28T12:06:30.432528+0000","last_became_active":"2023-11-28T12:06:29.428388+0000","last_became_peered":"2023-11-28T12:06:29.428388+0000","last_unstale":"2023-11-28T12:06:30.432528+0000","last_undegraded":"2023-11-28T12:06:30.432528+0000","last_fullsized":"2023-11-28T12:06:30.432528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:13:08.504009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432068+0000","last_change":"2023-11-28T12:06:28.897386+0000","last_active":"2023-11-28T12:06:30.432068+0000","last_peered":"2023-11-28T12:06:30.432068+0000","last_clean":"2023-11-28T12:06:30.432068+0000","last_became_active":"2023-11-28T12:06:28.896863+0000","last_became_peered":"2023-11-28T12:06:28.896863+0000","last_unstale":"2023-11-28T12:06:30.432068+0000","last_undegraded":"2023-11-28T12:06:30.432068+0000","last_fullsized":"2023-11-28T12:06:30.432068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:10:07.458120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T12:06:29.408752+0000","last_change":"2023-11-28T12:06:23.961595+0000","last_active":"2023-11-28T12:06:29.408752+0000","last_peered":"2023-11-28T12:06:29.408752+0000","last_clean":"2023-11-28T12:06:29.408752+0000","last_became_active":"2023-11-28T12:06:23.961257+0000","last_became_peered":"2023-11-28T12:06:23.961257+0000","last_unstale":"2023-11-28T12:06:29.408752+0000","last_undegraded":"2023-11-28T12:06:29.408752+0000","last_fullsized":"2023-11-28T12:06:29.408752+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:30:40.200095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.430465+0000","last_change":"2023-11-28T12:06:29.425702+0000","last_active":"2023-11-28T12:06:30.430465+0000","last_peered":"2023-11-28T12:06:30.430465+0000","last_clean":"2023-11-28T12:06:30.430465+0000","last_became_active":"2023-11-28T12:06:29.425445+0000","last_became_peered":"2023-11-28T12:06:29.425445+0000","last_unstale":"2023-11-28T12:06:30.430465+0000","last_undegraded":"2023-11-28T12:06:30.430465+0000","last_fullsized":"2023-11-28T12:06:30.430465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:03:53.795177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T12:06:29.400425+0000","last_change":"2023-11-28T12:06:23.517505+0000","last_active":"2023-11-28T12:06:29.400425+0000","last_peered":"2023-11-28T12:06:29.400425+0000","last_clean":"2023-11-28T12:06:29.400425+0000","last_became_active":"2023-11-28T12:06:23.517151+0000","last_became_peered":"2023-11-28T12:06:23.517151+0000","last_unstale":"2023-11-28T12:06:29.400425+0000","last_undegraded":"2023-11-28T12:06:29.400425+0000","last_fullsized":"2023-11-28T12:06:29.400425+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:30:40.200095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432594+0000","last_change":"2023-11-28T12:06:28.912292+0000","last_active":"2023-11-28T12:06:30.432594+0000","last_peered":"2023-11-28T12:06:30.432594+0000","last_clean":"2023-11-28T12:06:30.432594+0000","last_became_active":"2023-11-28T12:06:28.910834+0000","last_became_peered":"2023-11-28T12:06:28.910834+0000","last_unstale":"2023-11-28T12:06:30.432594+0000","last_undegraded":"2023-11-28T12:06:30.432594+0000","last_fullsized":"2023-11-28T12:06:30.432594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:51:27.529794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431570+0000","last_change":"2023-11-28T12:06:29.420045+0000","last_active":"2023-11-28T12:06:30.431570+0000","last_peered":"2023-11-28T12:06:30.431570+0000","last_clean":"2023-11-28T12:06:30.431570+0000","last_became_active":"2023-11-28T12:06:29.419739+0000","last_became_peered":"2023-11-28T12:06:29.419739+0000","last_unstale":"2023-11-28T12:06:30.431570+0000","last_undegraded":"2023-11-28T12:06:30.431570+0000","last_fullsized":"2023-11-28T12:06:30.431570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:25:49.001168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T12:06:29.405908+0000","last_change":"2023-11-28T12:06:23.517967+0000","last_active":"2023-11-28T12:06:29.405908+0000","last_peered":"2023-11-28T12:06:29.405908+0000","last_clean":"2023-11-28T12:06:29.405908+0000","last_became_active":"2023-11-28T12:06:23.517495+0000","last_became_peered":"2023-11-28T12:06:23.517495+0000","last_unstale":"2023-11-28T12:06:29.405908+0000","last_undegraded":"2023-11-28T12:06:29.405908+0000","last_fullsized":"2023-11-28T12:06:29.405908+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:51:06.844441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T12:06:29.408596+0000","last_change":"2023-11-28T12:06:23.513472+0000","last_active":"2023-11-28T12:06:29.408596+0000","last_peered":"2023-11-28T12:06:29.408596+0000","last_clean":"2023-11-28T12:06:29.408596+0000","last_became_active":"2023-11-28T12:06:23.513150+0000","last_became_peered":"2023-11-28T12:06:23.513150+0000","last_unstale":"2023-11-28T12:06:29.408596+0000","last_undegraded":"2023-11-28T12:06:29.408596+0000","last_fullsized":"2023-11-28T12:06:29.408596+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:34:18.653049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.430898+0000","last_change":"2023-11-28T12:06:28.909662+0000","last_active":"2023-11-28T12:06:30.430898+0000","last_peered":"2023-11-28T12:06:30.430898+0000","last_clean":"2023-11-28T12:06:30.430898+0000","last_became_active":"2023-11-28T12:06:28.907056+0000","last_became_peered":"2023-11-28T12:06:28.907056+0000","last_unstale":"2023-11-28T12:06:30.430898+0000","last_undegraded":"2023-11-28T12:06:30.430898+0000","last_fullsized":"2023-11-28T12:06:30.430898+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:22:19.424800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432482+0000","last_change":"2023-11-28T12:06:29.420306+0000","last_active":"2023-11-28T12:06:30.432482+0000","last_peered":"2023-11-28T12:06:30.432482+0000","last_clean":"2023-11-28T12:06:30.432482+0000","last_became_active":"2023-11-28T12:06:29.419788+0000","last_became_peered":"2023-11-28T12:06:29.419788+0000","last_unstale":"2023-11-28T12:06:30.432482+0000","last_undegraded":"2023-11-28T12:06:30.432482+0000","last_fullsized":"2023-11-28T12:06:30.432482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:28:34.213514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T12:06:29.409054+0000","last_change":"2023-11-28T12:06:23.903708+0000","last_active":"2023-11-28T12:06:29.409054+0000","last_peered":"2023-11-28T12:06:29.409054+0000","last_clean":"2023-11-28T12:06:29.409054+0000","last_became_active":"2023-11-28T12:06:23.903399+0000","last_became_peered":"2023-11-28T12:06:23.903399+0000","last_unstale":"2023-11-28T12:06:29.409054+0000","last_undegraded":"2023-11-28T12:06:29.409054+0000","last_fullsized":"2023-11-28T12:06:29.409054+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:31:13.187145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.430703+0000","last_change":"2023-11-28T12:06:28.913668+0000","last_active":"2023-11-28T12:06:30.430703+0000","last_peered":"2023-11-28T12:06:30.430703+0000","last_clean":"2023-11-28T12:06:30.430703+0000","last_became_active":"2023-11-28T12:06:28.913342+0000","last_became_peered":"2023-11-28T12:06:28.913342+0000","last_unstale":"2023-11-28T12:06:30.430703+0000","last_undegraded":"2023-11-28T12:06:30.430703+0000","last_fullsized":"2023-11-28T12:06:30.430703+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:10:07.458120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431800+0000","last_change":"2023-11-28T12:06:29.422027+0000","last_active":"2023-11-28T12:06:30.431800+0000","last_peered":"2023-11-28T12:06:30.431800+0000","last_clean":"2023-11-28T12:06:30.431800+0000","last_became_active":"2023-11-28T12:06:29.421737+0000","last_became_peered":"2023-11-28T12:06:29.421737+0000","last_unstale":"2023-11-28T12:06:30.431800+0000","last_undegraded":"2023-11-28T12:06:30.431800+0000","last_fullsized":"2023-11-28T12:06:30.431800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:25:07.078893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T12:06:29.408153+0000","last_change":"2023-11-28T12:06:23.903662+0000","last_active":"2023-11-28T12:06:29.408153+0000","last_peered":"2023-11-28T12:06:29.408153+0000","last_clean":"2023-11-28T12:06:29.408153+0000","last_became_active":"2023-11-28T12:06:23.903354+0000","last_became_peered":"2023-11-28T12:06:23.903354+0000","last_unstale":"2023-11-28T12:06:29.408153+0000","last_undegraded":"2023-11-28T12:06:29.408153+0000","last_fullsized":"2023-11-28T12:06:29.408153+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:02:07.694087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.430927+0000","last_change":"2023-11-28T12:06:28.904988+0000","last_active":"2023-11-28T12:06:30.430927+0000","last_peered":"2023-11-28T12:06:30.430927+0000","last_clean":"2023-11-28T12:06:30.430927+0000","last_became_active":"2023-11-28T12:06:28.904389+0000","last_became_peered":"2023-11-28T12:06:28.904389+0000","last_unstale":"2023-11-28T12:06:30.430927+0000","last_undegraded":"2023-11-28T12:06:30.430927+0000","last_fullsized":"2023-11-28T12:06:30.430927+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:25:02.799298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.402642+0000","last_change":"2023-11-28T12:06:29.424397+0000","last_active":"2023-11-28T12:06:30.402642+0000","last_peered":"2023-11-28T12:06:30.402642+0000","last_clean":"2023-11-28T12:06:30.402642+0000","last_became_active":"2023-11-28T12:06:29.424122+0000","last_became_peered":"2023-11-28T12:06:29.424122+0000","last_unstale":"2023-11-28T12:06:30.402642+0000","last_undegraded":"2023-11-28T12:06:30.402642+0000","last_fullsized":"2023-11-28T12:06:30.402642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:39:12.434022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T12:06:29.415039+0000","last_change":"2023-11-28T12:06:23.903797+0000","last_active":"2023-11-28T12:06:29.415039+0000","last_peered":"2023-11-28T12:06:29.415039+0000","last_clean":"2023-11-28T12:06:29.415039+0000","last_became_active":"2023-11-28T12:06:23.903475+0000","last_became_peered":"2023-11-28T12:06:23.903475+0000","last_unstale":"2023-11-28T12:06:29.415039+0000","last_undegraded":"2023-11-28T12:06:29.415039+0000","last_fullsized":"2023-11-28T12:06:29.415039+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:51:06.844441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432343+0000","last_change":"2023-11-28T12:06:28.905900+0000","last_active":"2023-11-28T12:06:30.432343+0000","last_peered":"2023-11-28T12:06:30.432343+0000","last_clean":"2023-11-28T12:06:30.432343+0000","last_became_active":"2023-11-28T12:06:28.905583+0000","last_became_peered":"2023-11-28T12:06:28.905583+0000","last_unstale":"2023-11-28T12:06:30.432343+0000","last_undegraded":"2023-11-28T12:06:30.432343+0000","last_fullsized":"2023-11-28T12:06:30.432343+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:10:07.458120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432082+0000","last_change":"2023-11-28T12:06:29.412204+0000","last_active":"2023-11-28T12:06:30.432082+0000","last_peered":"2023-11-28T12:06:30.432082+0000","last_clean":"2023-11-28T12:06:30.432082+0000","last_became_active":"2023-11-28T12:06:29.411941+0000","last_became_peered":"2023-11-28T12:06:29.411941+0000","last_unstale":"2023-11-28T12:06:30.432082+0000","last_undegraded":"2023-11-28T12:06:30.432082+0000","last_fullsized":"2023-11-28T12:06:30.432082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:07:00.558286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T12:06:29.403178+0000","last_change":"2023-11-28T12:06:23.903983+0000","last_active":"2023-11-28T12:06:29.403178+0000","last_peered":"2023-11-28T12:06:29.403178+0000","last_clean":"2023-11-28T12:06:29.403178+0000","last_became_active":"2023-11-28T12:06:23.903511+0000","last_became_peered":"2023-11-28T12:06:23.903511+0000","last_unstale":"2023-11-28T12:06:29.403178+0000","last_undegraded":"2023-11-28T12:06:29.403178+0000","last_fullsized":"2023-11-28T12:06:29.403178+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:31:13.187145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432035+0000","last_change":"2023-11-28T12:06:28.914003+0000","last_active":"2023-11-28T12:06:30.432035+0000","last_peered":"2023-11-28T12:06:30.432035+0000","last_clean":"2023-11-28T12:06:30.432035+0000","last_became_active":"2023-11-28T12:06:28.913345+0000","last_became_peered":"2023-11-28T12:06:28.913345+0000","last_unstale":"2023-11-28T12:06:30.432035+0000","last_undegraded":"2023-11-28T12:06:30.432035+0000","last_fullsized":"2023-11-28T12:06:30.432035+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:51:27.529794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431036+0000","last_change":"2023-11-28T12:06:29.419498+0000","last_active":"2023-11-28T12:06:30.431036+0000","last_peered":"2023-11-28T12:06:30.431036+0000","last_clean":"2023-11-28T12:06:30.431036+0000","last_became_active":"2023-11-28T12:06:29.419162+0000","last_became_peered":"2023-11-28T12:06:29.419162+0000","last_unstale":"2023-11-28T12:06:30.431036+0000","last_undegraded":"2023-11-28T12:06:30.431036+0000","last_fullsized":"2023-11-28T12:06:30.431036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:31:18.258195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T12:06:29.405346+0000","last_change":"2023-11-28T12:06:23.517246+0000","last_active":"2023-11-28T12:06:29.405346+0000","last_peered":"2023-11-28T12:06:29.405346+0000","last_clean":"2023-11-28T12:06:29.405346+0000","last_became_active":"2023-11-28T12:06:23.516854+0000","last_became_peered":"2023-11-28T12:06:23.516854+0000","last_unstale":"2023-11-28T12:06:29.405346+0000","last_undegraded":"2023-11-28T12:06:29.405346+0000","last_fullsized":"2023-11-28T12:06:29.405346+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:51:06.844441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.402925+0000","last_change":"2023-11-28T12:06:28.899604+0000","last_active":"2023-11-28T12:06:30.402925+0000","last_peered":"2023-11-28T12:06:30.402925+0000","last_clean":"2023-11-28T12:06:30.402925+0000","last_became_active":"2023-11-28T12:06:28.899322+0000","last_became_peered":"2023-11-28T12:06:28.899322+0000","last_unstale":"2023-11-28T12:06:30.402925+0000","last_undegraded":"2023-11-28T12:06:30.402925+0000","last_fullsized":"2023-11-28T12:06:30.402925+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:05:22.551488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431859+0000","last_change":"2023-11-28T12:06:29.416051+0000","last_active":"2023-11-28T12:06:30.431859+0000","last_peered":"2023-11-28T12:06:30.431859+0000","last_clean":"2023-11-28T12:06:30.431859+0000","last_became_active":"2023-11-28T12:06:29.415796+0000","last_became_peered":"2023-11-28T12:06:29.415796+0000","last_unstale":"2023-11-28T12:06:30.431859+0000","last_undegraded":"2023-11-28T12:06:30.431859+0000","last_fullsized":"2023-11-28T12:06:30.431859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:14:19.511638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431127+0000","last_change":"2023-11-28T12:06:28.911467+0000","last_active":"2023-11-28T12:06:30.431127+0000","last_peered":"2023-11-28T12:06:30.431127+0000","last_clean":"2023-11-28T12:06:30.431127+0000","last_became_active":"2023-11-28T12:06:28.907578+0000","last_became_peered":"2023-11-28T12:06:28.907578+0000","last_unstale":"2023-11-28T12:06:30.431127+0000","last_undegraded":"2023-11-28T12:06:30.431127+0000","last_fullsized":"2023-11-28T12:06:30.431127+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:10:07.458120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.400161+0000","last_change":"2023-11-28T12:06:29.411427+0000","last_active":"2023-11-28T12:06:30.400161+0000","last_peered":"2023-11-28T12:06:30.400161+0000","last_clean":"2023-11-28T12:06:30.400161+0000","last_became_active":"2023-11-28T12:06:29.411146+0000","last_became_peered":"2023-11-28T12:06:29.411146+0000","last_unstale":"2023-11-28T12:06:30.400161+0000","last_undegraded":"2023-11-28T12:06:30.400161+0000","last_fullsized":"2023-11-28T12:06:30.400161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:25:03.806074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.401875+0000","last_change":"2023-11-28T12:06:28.907981+0000","last_active":"2023-11-28T12:06:30.401875+0000","last_peered":"2023-11-28T12:06:30.401875+0000","last_clean":"2023-11-28T12:06:30.401875+0000","last_became_active":"2023-11-28T12:06:28.906662+0000","last_became_peered":"2023-11-28T12:06:28.906662+0000","last_unstale":"2023-11-28T12:06:30.401875+0000","last_undegraded":"2023-11-28T12:06:30.401875+0000","last_fullsized":"2023-11-28T12:06:30.401875+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:57:01.417679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431947+0000","last_change":"2023-11-28T12:06:29.435464+0000","last_active":"2023-11-28T12:06:30.431947+0000","last_peered":"2023-11-28T12:06:30.431947+0000","last_clean":"2023-11-28T12:06:30.431947+0000","last_became_active":"2023-11-28T12:06:29.435154+0000","last_became_peered":"2023-11-28T12:06:29.435154+0000","last_unstale":"2023-11-28T12:06:30.431947+0000","last_undegraded":"2023-11-28T12:06:30.431947+0000","last_fullsized":"2023-11-28T12:06:30.431947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:18:07.794113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.402928+0000","last_change":"2023-11-28T12:06:28.910150+0000","last_active":"2023-11-28T12:06:30.402928+0000","last_peered":"2023-11-28T12:06:30.402928+0000","last_clean":"2023-11-28T12:06:30.402928+0000","last_became_active":"2023-11-28T12:06:28.909642+0000","last_became_peered":"2023-11-28T12:06:28.909642+0000","last_unstale":"2023-11-28T12:06:30.402928+0000","last_undegraded":"2023-11-28T12:06:30.402928+0000","last_fullsized":"2023-11-28T12:06:30.402928+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:43:34.311973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431920+0000","last_change":"2023-11-28T12:06:29.435703+0000","last_active":"2023-11-28T12:06:30.431920+0000","last_peered":"2023-11-28T12:06:30.431920+0000","last_clean":"2023-11-28T12:06:30.431920+0000","last_became_active":"2023-11-28T12:06:29.435414+0000","last_became_peered":"2023-11-28T12:06:29.435414+0000","last_unstale":"2023-11-28T12:06:30.431920+0000","last_undegraded":"2023-11-28T12:06:30.431920+0000","last_fullsized":"2023-11-28T12:06:30.431920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:20:52.473176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431714+0000","last_change":"2023-11-28T12:06:28.896545+0000","last_active":"2023-11-28T12:06:30.431714+0000","last_peered":"2023-11-28T12:06:30.431714+0000","last_clean":"2023-11-28T12:06:30.431714+0000","last_became_active":"2023-11-28T12:06:28.896194+0000","last_became_peered":"2023-11-28T12:06:28.896194+0000","last_unstale":"2023-11-28T12:06:30.431714+0000","last_undegraded":"2023-11-28T12:06:30.431714+0000","last_fullsized":"2023-11-28T12:06:30.431714+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:51:27.529794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.430903+0000","last_change":"2023-11-28T12:06:29.415972+0000","last_active":"2023-11-28T12:06:30.430903+0000","last_peered":"2023-11-28T12:06:30.430903+0000","last_clean":"2023-11-28T12:06:30.430903+0000","last_became_active":"2023-11-28T12:06:29.415403+0000","last_became_peered":"2023-11-28T12:06:29.415403+0000","last_unstale":"2023-11-28T12:06:30.430903+0000","last_undegraded":"2023-11-28T12:06:30.430903+0000","last_fullsized":"2023-11-28T12:06:30.430903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:25:49.001168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432765+0000","last_change":"2023-11-28T12:06:28.904656+0000","last_active":"2023-11-28T12:06:30.432765+0000","last_peered":"2023-11-28T12:06:30.432765+0000","last_clean":"2023-11-28T12:06:30.432765+0000","last_became_active":"2023-11-28T12:06:28.903576+0000","last_became_peered":"2023-11-28T12:06:28.903576+0000","last_unstale":"2023-11-28T12:06:30.432765+0000","last_undegraded":"2023-11-28T12:06:30.432765+0000","last_fullsized":"2023-11-28T12:06:30.432765+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:05:22.551488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431143+0000","last_change":"2023-11-28T12:06:29.433471+0000","last_active":"2023-11-28T12:06:30.431143+0000","last_peered":"2023-11-28T12:06:30.431143+0000","last_clean":"2023-11-28T12:06:30.431143+0000","last_became_active":"2023-11-28T12:06:29.433175+0000","last_became_peered":"2023-11-28T12:06:29.433175+0000","last_unstale":"2023-11-28T12:06:30.431143+0000","last_undegraded":"2023-11-28T12:06:30.431143+0000","last_fullsized":"2023-11-28T12:06:30.431143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:31:18.258195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.402168+0000","last_change":"2023-11-28T12:06:29.409984+0000","last_active":"2023-11-28T12:06:30.402168+0000","last_peered":"2023-11-28T12:06:30.402168+0000","last_clean":"2023-11-28T12:06:30.402168+0000","last_became_active":"2023-11-28T12:06:29.409708+0000","last_became_peered":"2023-11-28T12:06:29.409708+0000","last_unstale":"2023-11-28T12:06:30.402168+0000","last_undegraded":"2023-11-28T12:06:30.402168+0000","last_fullsized":"2023-11-28T12:06:30.402168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:10:24.380829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.430715+0000","last_change":"2023-11-28T12:06:29.412286+0000","last_active":"2023-11-28T12:06:30.430715+0000","last_peered":"2023-11-28T12:06:30.430715+0000","last_clean":"2023-11-28T12:06:30.430715+0000","last_became_active":"2023-11-28T12:06:29.412022+0000","last_became_peered":"2023-11-28T12:06:29.412022+0000","last_unstale":"2023-11-28T12:06:30.430715+0000","last_undegraded":"2023-11-28T12:06:30.430715+0000","last_fullsized":"2023-11-28T12:06:30.430715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:20:52.473176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431676+0000","last_change":"2023-11-28T12:06:29.424994+0000","last_active":"2023-11-28T12:06:30.431676+0000","last_peered":"2023-11-28T12:06:30.431676+0000","last_clean":"2023-11-28T12:06:30.431676+0000","last_became_active":"2023-11-28T12:06:29.424738+0000","last_became_peered":"2023-11-28T12:06:29.424738+0000","last_unstale":"2023-11-28T12:06:30.431676+0000","last_undegraded":"2023-11-28T12:06:30.431676+0000","last_fullsized":"2023-11-28T12:06:30.431676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:08:40.987428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431286+0000","last_change":"2023-11-28T12:06:29.420914+0000","last_active":"2023-11-28T12:06:30.431286+0000","last_peered":"2023-11-28T12:06:30.431286+0000","last_clean":"2023-11-28T12:06:30.431286+0000","last_became_active":"2023-11-28T12:06:29.420396+0000","last_became_peered":"2023-11-28T12:06:29.420396+0000","last_unstale":"2023-11-28T12:06:30.431286+0000","last_undegraded":"2023-11-28T12:06:30.431286+0000","last_fullsized":"2023-11-28T12:06:30.431286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:28:44.482157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431992+0000","last_change":"2023-11-28T12:06:29.418068+0000","last_active":"2023-11-28T12:06:30.431992+0000","last_peered":"2023-11-28T12:06:30.431992+0000","last_clean":"2023-11-28T12:06:30.431992+0000","last_became_active":"2023-11-28T12:06:29.417569+0000","last_became_peered":"2023-11-28T12:06:29.417569+0000","last_unstale":"2023-11-28T12:06:30.431992+0000","last_undegraded":"2023-11-28T12:06:30.431992+0000","last_fullsized":"2023-11-28T12:06:30.431992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:39:12.434022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9072,"kb_used_data":808,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362768,"statfs":{"total":96636764160,"available":96627474432,"internally_reserved":0,"allocated":827392,"data_stored":666560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7888,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":7680,"kb_avail":94363952,"statfs":{"total":96636764160,"available":96628686848,"internally_reserved":0,"allocated":204800,"data_stored":74428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7864320},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13140,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":12352,"kb_avail":94358700,"statfs":{"total":96636764160,"available":96623308800,"internally_reserved":0,"allocated":798720,"data_stored":664796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12648448},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12048,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":11840,"kb_avail":94359792,"statfs":{"total":96636764160,"available":96624427008,"internally_reserved":0,"allocated":204800,"data_stored":73633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12124160},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.877}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86099999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11984,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":11776,"kb_avail":94359856,"statfs":{"total":96636764160,"available":96624492544,"internally_reserved":0,"allocated":204800,"data_stored":74428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12058624},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.311}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12112,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":11904,"kb_avail":94359728,"statfs":{"total":96636764160,"available":96624361472,"internally_reserved":0,"allocated":204800,"data_stored":73157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12189696},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8036,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363804,"statfs":{"total":96636764160,"available":96628535296,"internally_reserved":0,"allocated":225280,"data_stored":76032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.125}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.093}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2050000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2430000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2230000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7960,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363880,"statfs":{"total":96636764160,"available":96628613120,"internally_reserved":0,"allocated":212992,"data_stored":75064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T12:06:34.306 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T12:06:34.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.543+0000 7f8b9b1ff700 1 Processor -- start 2023-11-28T12:06:34.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.543+0000 7f8b9b1ff700 1 -- start start 2023-11-28T12:06:34.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.544+0000 7f8b9b1ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8b9415c9b0 0x7f8b940b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:34.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.544+0000 7f8b9b1ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b940d1950 con 0x7f8b94161340 2023-11-28T12:06:34.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.544+0000 7f8b9b1ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b940d24f0 con 0x7f8b940cd7c0 2023-11-28T12:06:34.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.544+0000 7f8b9b1ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b940b5800 con 0x7f8b9415c9b0 2023-11-28T12:06:34.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.545+0000 7f8b98f9b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8b9415c9b0 0x7f8b940b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:34.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.545+0000 7f8b93fff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f8b94161340 0x7f8b940d1de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:60948/0 (socket says 172.21.15.45:60948) 2023-11-28T12:06:34.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.545+0000 7f8b93fff700 1 -- 172.21.15.45:0/1269741597 learned_addr learned my addr 172.21.15.45:0/1269741597 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:06:34.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.545+0000 7f8b98f9b700 1 -- 172.21.15.45:0/1269741597 >> v1:172.21.15.152:6789/0 conn(0x7f8b940cd7c0 legacy=0x7f8b940b5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:06:34.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.545+0000 7f8b98f9b700 1 -- 172.21.15.45:0/1269741597 >> v1:172.21.15.45:6789/0 conn(0x7f8b94161340 legacy=0x7f8b940d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:34.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.545+0000 7f8b98f9b700 1 -- 172.21.15.45:0/1269741597 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b940b5520 con 0x7f8b9415c9b0 2023-11-28T12:06:34.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.545+0000 7f8b937fe700 1 -- 172.21.15.45:0/1269741597 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 454165152 0 0) 0x7f8b940d1950 con 0x7f8b94161340 2023-11-28T12:06:34.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.545+0000 7f8b98f9b700 1 --2- 172.21.15.45:0/1269741597 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8b9415c9b0 0x7f8b940b4bf0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8b88009840 tx=0x7f8b88009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=392e13059b0e0e0a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:34.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.546+0000 7f8b937fe700 1 -- 172.21.15.45:0/1269741597 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b88004230 con 0x7f8b9415c9b0 2023-11-28T12:06:34.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.546+0000 7f8b937fe700 1 -- 172.21.15.45:0/1269741597 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b88004390 con 0x7f8b9415c9b0 2023-11-28T12:06:34.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.546+0000 7f8b937fe700 1 -- 172.21.15.45:0/1269741597 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b880036a0 con 0x7f8b9415c9b0 2023-11-28T12:06:34.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.546+0000 7f8b9b1ff700 1 -- 172.21.15.45:0/1269741597 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8b9415c9b0 msgr2=0x7f8b940b4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:34.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.546+0000 7f8b9b1ff700 1 --2- 172.21.15.45:0/1269741597 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8b9415c9b0 0x7f8b940b4bf0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8b88009840 tx=0x7f8b88009b50 comp rx=0 tx=0).stop 2023-11-28T12:06:34.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.546+0000 7f8b9b1ff700 1 -- 172.21.15.45:0/1269741597 shutdown_connections 2023-11-28T12:06:34.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.546+0000 7f8b9b1ff700 1 --2- 172.21.15.45:0/1269741597 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8b9415c9b0 0x7f8b940b4bf0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:34.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.546+0000 7f8b9b1ff700 1 -- 172.21.15.45:0/1269741597 >> 172.21.15.45:0/1269741597 conn(0x7f8b94072600 msgr2=0x7f8b940cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:34.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.546+0000 7f8b9b1ff700 1 -- 172.21.15.45:0/1269741597 shutdown_connections 2023-11-28T12:06:34.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.546+0000 7f8b9b1ff700 1 -- 172.21.15.45:0/1269741597 wait complete. 2023-11-28T12:06:34.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.548+0000 7f8b9b1ff700 1 Processor -- start 2023-11-28T12:06:34.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.548+0000 7f8b9b1ff700 1 -- start start 2023-11-28T12:06:34.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.549+0000 7f8b9b1ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8b940cd7c0 0x7f8b941574a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:34.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.549+0000 7f8b9b1ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b9415c9b0 0x7f8b940c6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:34.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.549+0000 7f8b9b1ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8b94161340 0x7f8b9414a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:34.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.549+0000 7f8b9b1ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b940c71e0 con 0x7f8b940cd7c0 2023-11-28T12:06:34.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.549+0000 7f8b9b1ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b940c7460 con 0x7f8b9415c9b0 2023-11-28T12:06:34.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.549+0000 7f8b9b1ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9415f7b0 con 0x7f8b94161340 2023-11-28T12:06:34.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.549+0000 7f8b98f9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8b940cd7c0 0x7f8b941574a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:34.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.549+0000 7f8b98f9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8b940cd7c0 0x7f8b941574a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35774/0 (socket says 172.21.15.45:35774) 2023-11-28T12:06:34.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.549+0000 7f8b98f9b700 1 -- 172.21.15.45:0/4234814352 learned_addr learned my addr 172.21.15.45:0/4234814352 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:34.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.550+0000 7f8b93fff700 1 --2- 172.21.15.45:0/4234814352 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b9415c9b0 0x7f8b940c6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:34.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.550+0000 7f8b9979c700 1 --2- 172.21.15.45:0/4234814352 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8b94161340 0x7f8b9414a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:34.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.550+0000 7f8b98f9b700 1 -- 172.21.15.45:0/4234814352 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8b94161340 msgr2=0x7f8b9414a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:34.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.550+0000 7f8b98f9b700 1 --2- 172.21.15.45:0/4234814352 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8b94161340 0x7f8b9414a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:34.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.550+0000 7f8b98f9b700 1 -- 172.21.15.45:0/4234814352 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b9415c9b0 msgr2=0x7f8b940c6ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:34.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.550+0000 7f8b98f9b700 1 --2- 172.21.15.45:0/4234814352 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b9415c9b0 0x7f8b940c6ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:34.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.550+0000 7f8b98f9b700 1 -- 172.21.15.45:0/4234814352 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b880094a0 con 0x7f8b940cd7c0 2023-11-28T12:06:34.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.550+0000 7f8b93fff700 1 --2- 172.21.15.45:0/4234814352 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b9415c9b0 0x7f8b940c6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:06:34.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.550+0000 7f8b98f9b700 1 --2- 172.21.15.45:0/4234814352 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8b940cd7c0 0x7f8b941574a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8b880090b0 tx=0x7f8b880047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:34.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.550+0000 7f8b917fa700 1 -- 172.21.15.45:0/4234814352 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b88011630 con 0x7f8b940cd7c0 2023-11-28T12:06:34.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.550+0000 7f8b917fa700 1 -- 172.21.15.45:0/4234814352 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b88011790 con 0x7f8b940cd7c0 2023-11-28T12:06:34.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.550+0000 7f8b9b1ff700 1 -- 172.21.15.45:0/4234814352 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b940d15e0 con 0x7f8b940cd7c0 2023-11-28T12:06:34.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.550+0000 7f8b917fa700 1 -- 172.21.15.45:0/4234814352 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b88011b40 con 0x7f8b940cd7c0 2023-11-28T12:06:34.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.550+0000 7f8b9b1ff700 1 -- 172.21.15.45:0/4234814352 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b940d1300 con 0x7f8b940cd7c0 2023-11-28T12:06:34.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.552+0000 7f8b9b1ff700 1 -- 172.21.15.45:0/4234814352 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b941e7740 con 0x7f8b940cd7c0 2023-11-28T12:06:34.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.552+0000 7f8b917fa700 1 -- 172.21.15.45:0/4234814352 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f8b88017020 con 0x7f8b940cd7c0 2023-11-28T12:06:34.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.554+0000 7f8b917fa700 1 --2- 172.21.15.45:0/4234814352 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f8b780682f0 0x7f8b7806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:34.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.554+0000 7f8b917fa700 1 -- 172.21.15.45:0/4234814352 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8b880875d0 con 0x7f8b940cd7c0 2023-11-28T12:06:34.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.554+0000 7f8b93fff700 1 --2- 172.21.15.45:0/4234814352 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f8b780682f0 0x7f8b7806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:34.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.555+0000 7f8b93fff700 1 --2- 172.21.15.45:0/4234814352 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f8b780682f0 0x7f8b7806a7a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8b941f5e00 tx=0x7f8b80009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:34.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.557+0000 7f8b917fa700 1 -- 172.21.15.45:0/4234814352 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f8b941e7740 con 0x7f8b940cd7c0 2023-11-28T12:06:34.739 INFO:tasks.ceph.mds.b.smithi152.stderr:2023-11-28T12:06:34.738+0000 7f6b741f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-28T12:06:34.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.759+0000 7f8b9b1ff700 1 -- 172.21.15.45:0/4234814352 --> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8b940745c0 con 0x7f8b780682f0 2023-11-28T12:06:34.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.768+0000 7f8b917fa700 1 -- 172.21.15.45:0/4234814352 <== mgr.4100 v2:172.21.15.152:6832/115389 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286932 (secure 0 0 0) 0x7f8b940745c0 con 0x7f8b780682f0 2023-11-28T12:06:34.772 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:06:34.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.772+0000 7f8b9b1ff700 1 -- 172.21.15.45:0/4234814352 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f8b780682f0 msgr2=0x7f8b7806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:34.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.772+0000 7f8b9b1ff700 1 --2- 172.21.15.45:0/4234814352 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f8b780682f0 0x7f8b7806a7a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8b941f5e00 tx=0x7f8b80009040 comp rx=0 tx=0).stop 2023-11-28T12:06:34.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.772+0000 7f8b9b1ff700 1 -- 172.21.15.45:0/4234814352 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8b940cd7c0 msgr2=0x7f8b941574a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:34.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.772+0000 7f8b9b1ff700 1 --2- 172.21.15.45:0/4234814352 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8b940cd7c0 0x7f8b941574a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8b880090b0 tx=0x7f8b880047c0 comp rx=0 tx=0).stop 2023-11-28T12:06:34.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.772+0000 7f8b9b1ff700 1 -- 172.21.15.45:0/4234814352 shutdown_connections 2023-11-28T12:06:34.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.772+0000 7f8b9b1ff700 1 --2- 172.21.15.45:0/4234814352 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f8b780682f0 0x7f8b7806a7a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:34.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.772+0000 7f8b9b1ff700 1 --2- 172.21.15.45:0/4234814352 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8b94161340 0x7f8b9414a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:34.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.772+0000 7f8b9b1ff700 1 --2- 172.21.15.45:0/4234814352 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8b940cd7c0 0x7f8b941574a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:34.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.772+0000 7f8b9b1ff700 1 --2- 172.21.15.45:0/4234814352 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8b9415c9b0 0x7f8b940c6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:34.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.772+0000 7f8b9b1ff700 1 -- 172.21.15.45:0/4234814352 >> 172.21.15.45:0/4234814352 conn(0x7f8b94072600 msgr2=0x7f8b94160460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:34.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.772+0000 7f8b9b1ff700 1 -- 172.21.15.45:0/4234814352 shutdown_connections 2023-11-28T12:06:34.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:34.772+0000 7f8b9b1ff700 1 -- 172.21.15.45:0/4234814352 wait complete. 2023-11-28T12:06:34.777 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-11-28T12:06:34.791 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-11-28T12:06:34.425437+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":142,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":82240,"kb_used_data":2816,"kb_used_omap":0,"kb_used_meta":79360,"kb_avail":754892480,"statfs":{"total":773094113280,"available":773009899520,"internally_reserved":0,"allocated":2883584,"data_stored":1778098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":81264640},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001382"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.400350+0000","last_change":"2023-11-28T12:06:29.429595+0000","last_active":"2023-11-28T12:06:30.400350+0000","last_peered":"2023-11-28T12:06:30.400350+0000","last_clean":"2023-11-28T12:06:30.400350+0000","last_became_active":"2023-11-28T12:06:29.428839+0000","last_became_peered":"2023-11-28T12:06:29.428839+0000","last_unstale":"2023-11-28T12:06:30.400350+0000","last_undegraded":"2023-11-28T12:06:30.400350+0000","last_fullsized":"2023-11-28T12:06:30.400350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:51:28.536571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.402235+0000","last_change":"2023-11-28T12:06:29.425536+0000","last_active":"2023-11-28T12:06:30.402235+0000","last_peered":"2023-11-28T12:06:30.402235+0000","last_clean":"2023-11-28T12:06:30.402235+0000","last_became_active":"2023-11-28T12:06:29.425250+0000","last_became_peered":"2023-11-28T12:06:29.425250+0000","last_unstale":"2023-11-28T12:06:30.402235+0000","last_undegraded":"2023-11-28T12:06:30.402235+0000","last_fullsized":"2023-11-28T12:06:30.402235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:27:03.452097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432130+0000","last_change":"2023-11-28T12:06:29.419165+0000","last_active":"2023-11-28T12:06:30.432130+0000","last_peered":"2023-11-28T12:06:30.432130+0000","last_clean":"2023-11-28T12:06:30.432130+0000","last_became_active":"2023-11-28T12:06:29.417243+0000","last_became_peered":"2023-11-28T12:06:29.417243+0000","last_unstale":"2023-11-28T12:06:30.432130+0000","last_undegraded":"2023-11-28T12:06:30.432130+0000","last_fullsized":"2023-11-28T12:06:30.432130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:20:33.063079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.402605+0000","last_change":"2023-11-28T12:06:29.422225+0000","last_active":"2023-11-28T12:06:30.402605+0000","last_peered":"2023-11-28T12:06:30.402605+0000","last_clean":"2023-11-28T12:06:30.402605+0000","last_became_active":"2023-11-28T12:06:29.419794+0000","last_became_peered":"2023-11-28T12:06:29.419794+0000","last_unstale":"2023-11-28T12:06:30.402605+0000","last_undegraded":"2023-11-28T12:06:30.402605+0000","last_fullsized":"2023-11-28T12:06:30.402605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:02:26.849301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.430942+0000","last_change":"2023-11-28T12:06:29.426450+0000","last_active":"2023-11-28T12:06:30.430942+0000","last_peered":"2023-11-28T12:06:30.430942+0000","last_clean":"2023-11-28T12:06:30.430942+0000","last_became_active":"2023-11-28T12:06:29.424681+0000","last_became_peered":"2023-11-28T12:06:29.424681+0000","last_unstale":"2023-11-28T12:06:30.430942+0000","last_undegraded":"2023-11-28T12:06:30.430942+0000","last_fullsized":"2023-11-28T12:06:30.430942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:27:03.452097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431570+0000","last_change":"2023-11-28T12:06:29.419827+0000","last_active":"2023-11-28T12:06:30.431570+0000","last_peered":"2023-11-28T12:06:30.431570+0000","last_clean":"2023-11-28T12:06:30.431570+0000","last_became_active":"2023-11-28T12:06:29.419556+0000","last_became_peered":"2023-11-28T12:06:29.419556+0000","last_unstale":"2023-11-28T12:06:30.431570+0000","last_undegraded":"2023-11-28T12:06:30.431570+0000","last_fullsized":"2023-11-28T12:06:30.431570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:05:52.134696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431287+0000","last_change":"2023-11-28T12:06:29.426829+0000","last_active":"2023-11-28T12:06:30.431287+0000","last_peered":"2023-11-28T12:06:30.431287+0000","last_clean":"2023-11-28T12:06:30.431287+0000","last_became_active":"2023-11-28T12:06:29.426579+0000","last_became_peered":"2023-11-28T12:06:29.426579+0000","last_unstale":"2023-11-28T12:06:30.431287+0000","last_undegraded":"2023-11-28T12:06:30.431287+0000","last_fullsized":"2023-11-28T12:06:30.431287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:03:53.795177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.402279+0000","last_change":"2023-11-28T12:06:29.425956+0000","last_active":"2023-11-28T12:06:30.402279+0000","last_peered":"2023-11-28T12:06:30.402279+0000","last_clean":"2023-11-28T12:06:30.402279+0000","last_became_active":"2023-11-28T12:06:29.422623+0000","last_became_peered":"2023-11-28T12:06:29.422623+0000","last_unstale":"2023-11-28T12:06:30.402279+0000","last_undegraded":"2023-11-28T12:06:30.402279+0000","last_fullsized":"2023-11-28T12:06:30.402279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:28:44.482157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432487+0000","last_change":"2023-11-28T12:06:29.431715+0000","last_active":"2023-11-28T12:06:30.432487+0000","last_peered":"2023-11-28T12:06:30.432487+0000","last_clean":"2023-11-28T12:06:30.432487+0000","last_became_active":"2023-11-28T12:06:29.431487+0000","last_became_peered":"2023-11-28T12:06:29.431487+0000","last_unstale":"2023-11-28T12:06:30.432487+0000","last_undegraded":"2023-11-28T12:06:30.432487+0000","last_fullsized":"2023-11-28T12:06:30.432487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:57:52.848285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.402475+0000","last_change":"2023-11-28T12:06:29.421929+0000","last_active":"2023-11-28T12:06:30.402475+0000","last_peered":"2023-11-28T12:06:30.402475+0000","last_clean":"2023-11-28T12:06:30.402475+0000","last_became_active":"2023-11-28T12:06:29.421572+0000","last_became_peered":"2023-11-28T12:06:29.421572+0000","last_unstale":"2023-11-28T12:06:30.402475+0000","last_undegraded":"2023-11-28T12:06:30.402475+0000","last_fullsized":"2023-11-28T12:06:30.402475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:31:18.258195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432165+0000","last_change":"2023-11-28T12:06:29.427047+0000","last_active":"2023-11-28T12:06:30.432165+0000","last_peered":"2023-11-28T12:06:30.432165+0000","last_clean":"2023-11-28T12:06:30.432165+0000","last_became_active":"2023-11-28T12:06:29.418090+0000","last_became_peered":"2023-11-28T12:06:29.418090+0000","last_unstale":"2023-11-28T12:06:30.432165+0000","last_undegraded":"2023-11-28T12:06:30.432165+0000","last_fullsized":"2023-11-28T12:06:30.432165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:24:27.065719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.400209+0000","last_change":"2023-11-28T12:06:29.424306+0000","last_active":"2023-11-28T12:06:30.400209+0000","last_peered":"2023-11-28T12:06:30.400209+0000","last_clean":"2023-11-28T12:06:30.400209+0000","last_became_active":"2023-11-28T12:06:29.424059+0000","last_became_peered":"2023-11-28T12:06:29.424059+0000","last_unstale":"2023-11-28T12:06:30.400209+0000","last_undegraded":"2023-11-28T12:06:30.400209+0000","last_fullsized":"2023-11-28T12:06:30.400209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:10:08.464896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.400054+0000","last_change":"2023-11-28T12:06:29.422496+0000","last_active":"2023-11-28T12:06:30.400054+0000","last_peered":"2023-11-28T12:06:30.400054+0000","last_clean":"2023-11-28T12:06:30.400054+0000","last_became_active":"2023-11-28T12:06:29.422201+0000","last_became_peered":"2023-11-28T12:06:29.422201+0000","last_unstale":"2023-11-28T12:06:30.400054+0000","last_undegraded":"2023-11-28T12:06:30.400054+0000","last_fullsized":"2023-11-28T12:06:30.400054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:22:20.431576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.402686+0000","last_change":"2023-11-28T12:06:29.426168+0000","last_active":"2023-11-28T12:06:30.402686+0000","last_peered":"2023-11-28T12:06:30.402686+0000","last_clean":"2023-11-28T12:06:30.402686+0000","last_became_active":"2023-11-28T12:06:29.425480+0000","last_became_peered":"2023-11-28T12:06:29.425480+0000","last_unstale":"2023-11-28T12:06:30.402686+0000","last_undegraded":"2023-11-28T12:06:30.402686+0000","last_fullsized":"2023-11-28T12:06:30.402686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:13:08.504009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431515+0000","last_change":"2023-11-28T12:06:29.428464+0000","last_active":"2023-11-28T12:06:30.431515+0000","last_peered":"2023-11-28T12:06:30.431515+0000","last_clean":"2023-11-28T12:06:30.431515+0000","last_became_active":"2023-11-28T12:06:29.428110+0000","last_became_peered":"2023-11-28T12:06:29.428110+0000","last_unstale":"2023-11-28T12:06:30.431515+0000","last_undegraded":"2023-11-28T12:06:30.431515+0000","last_fullsized":"2023-11-28T12:06:30.431515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:13:08.504009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431253+0000","last_change":"2023-11-28T12:06:29.416388+0000","last_active":"2023-11-28T12:06:30.431253+0000","last_peered":"2023-11-28T12:06:30.431253+0000","last_clean":"2023-11-28T12:06:30.431253+0000","last_became_active":"2023-11-28T12:06:29.416031+0000","last_became_peered":"2023-11-28T12:06:29.416031+0000","last_unstale":"2023-11-28T12:06:30.431253+0000","last_undegraded":"2023-11-28T12:06:30.431253+0000","last_fullsized":"2023-11-28T12:06:30.431253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:33:22.203612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432609+0000","last_change":"2023-11-28T12:06:29.431468+0000","last_active":"2023-11-28T12:06:30.432609+0000","last_peered":"2023-11-28T12:06:30.432609+0000","last_clean":"2023-11-28T12:06:30.432609+0000","last_became_active":"2023-11-28T12:06:29.430744+0000","last_became_peered":"2023-11-28T12:06:29.430744+0000","last_unstale":"2023-11-28T12:06:30.432609+0000","last_undegraded":"2023-11-28T12:06:30.432609+0000","last_fullsized":"2023-11-28T12:06:30.432609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:13:08.504009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432429+0000","last_change":"2023-11-28T12:06:29.422318+0000","last_active":"2023-11-28T12:06:30.432429+0000","last_peered":"2023-11-28T12:06:30.432429+0000","last_clean":"2023-11-28T12:06:30.432429+0000","last_became_active":"2023-11-28T12:06:29.421236+0000","last_became_peered":"2023-11-28T12:06:29.421236+0000","last_unstale":"2023-11-28T12:06:30.432429+0000","last_undegraded":"2023-11-28T12:06:30.432429+0000","last_fullsized":"2023-11-28T12:06:30.432429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:42:57.391884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.400334+0000","last_change":"2023-11-28T12:06:29.417658+0000","last_active":"2023-11-28T12:06:30.400334+0000","last_peered":"2023-11-28T12:06:30.400334+0000","last_clean":"2023-11-28T12:06:30.400334+0000","last_became_active":"2023-11-28T12:06:29.417101+0000","last_became_peered":"2023-11-28T12:06:29.417101+0000","last_unstale":"2023-11-28T12:06:30.400334+0000","last_undegraded":"2023-11-28T12:06:30.400334+0000","last_fullsized":"2023-11-28T12:06:30.400334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:27:38.882977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432163+0000","last_change":"2023-11-28T12:06:29.420113+0000","last_active":"2023-11-28T12:06:30.432163+0000","last_peered":"2023-11-28T12:06:30.432163+0000","last_clean":"2023-11-28T12:06:30.432163+0000","last_became_active":"2023-11-28T12:06:29.419156+0000","last_became_peered":"2023-11-28T12:06:29.419156+0000","last_unstale":"2023-11-28T12:06:30.432163+0000","last_undegraded":"2023-11-28T12:06:30.432163+0000","last_fullsized":"2023-11-28T12:06:30.432163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:28:34.213514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431510+0000","last_change":"2023-11-28T12:06:29.430718+0000","last_active":"2023-11-28T12:06:30.431510+0000","last_peered":"2023-11-28T12:06:30.431510+0000","last_clean":"2023-11-28T12:06:30.431510+0000","last_became_active":"2023-11-28T12:06:29.430451+0000","last_became_peered":"2023-11-28T12:06:29.430451+0000","last_unstale":"2023-11-28T12:06:30.431510+0000","last_undegraded":"2023-11-28T12:06:30.431510+0000","last_fullsized":"2023-11-28T12:06:30.431510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:07:00.558286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432197+0000","last_change":"2023-11-28T12:06:29.419281+0000","last_active":"2023-11-28T12:06:30.432197+0000","last_peered":"2023-11-28T12:06:30.432197+0000","last_clean":"2023-11-28T12:06:30.432197+0000","last_became_active":"2023-11-28T12:06:29.418987+0000","last_became_peered":"2023-11-28T12:06:29.418987+0000","last_unstale":"2023-11-28T12:06:30.432197+0000","last_undegraded":"2023-11-28T12:06:30.432197+0000","last_fullsized":"2023-11-28T12:06:30.432197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:57:15.470252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.430620+0000","last_change":"2023-11-28T12:06:29.415280+0000","last_active":"2023-11-28T12:06:30.430620+0000","last_peered":"2023-11-28T12:06:30.430620+0000","last_clean":"2023-11-28T12:06:30.430620+0000","last_became_active":"2023-11-28T12:06:29.414999+0000","last_became_peered":"2023-11-28T12:06:29.414999+0000","last_unstale":"2023-11-28T12:06:30.430620+0000","last_undegraded":"2023-11-28T12:06:30.430620+0000","last_fullsized":"2023-11-28T12:06:30.430620+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:27:03.452097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431563+0000","last_change":"2023-11-28T12:06:29.429537+0000","last_active":"2023-11-28T12:06:30.431563+0000","last_peered":"2023-11-28T12:06:30.431563+0000","last_clean":"2023-11-28T12:06:30.431563+0000","last_became_active":"2023-11-28T12:06:29.428962+0000","last_became_peered":"2023-11-28T12:06:29.428962+0000","last_unstale":"2023-11-28T12:06:30.431563+0000","last_undegraded":"2023-11-28T12:06:30.431563+0000","last_fullsized":"2023-11-28T12:06:30.431563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:51:20.319063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431697+0000","last_change":"2023-11-28T12:06:29.421014+0000","last_active":"2023-11-28T12:06:30.431697+0000","last_peered":"2023-11-28T12:06:30.431697+0000","last_clean":"2023-11-28T12:06:30.431697+0000","last_became_active":"2023-11-28T12:06:29.418311+0000","last_became_peered":"2023-11-28T12:06:29.418311+0000","last_unstale":"2023-11-28T12:06:30.431697+0000","last_undegraded":"2023-11-28T12:06:30.431697+0000","last_fullsized":"2023-11-28T12:06:30.431697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:47:58.895820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432093+0000","last_change":"2023-11-28T12:06:29.415605+0000","last_active":"2023-11-28T12:06:30.432093+0000","last_peered":"2023-11-28T12:06:30.432093+0000","last_clean":"2023-11-28T12:06:30.432093+0000","last_became_active":"2023-11-28T12:06:29.413218+0000","last_became_peered":"2023-11-28T12:06:29.413218+0000","last_unstale":"2023-11-28T12:06:30.432093+0000","last_undegraded":"2023-11-28T12:06:30.432093+0000","last_fullsized":"2023-11-28T12:06:30.432093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:03:53.795177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.402352+0000","last_change":"2023-11-28T12:06:29.438175+0000","last_active":"2023-11-28T12:06:30.402352+0000","last_peered":"2023-11-28T12:06:30.402352+0000","last_clean":"2023-11-28T12:06:30.402352+0000","last_became_active":"2023-11-28T12:06:29.437503+0000","last_became_peered":"2023-11-28T12:06:29.437503+0000","last_unstale":"2023-11-28T12:06:30.402352+0000","last_undegraded":"2023-11-28T12:06:30.402352+0000","last_fullsized":"2023-11-28T12:06:30.402352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:57:52.848285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431780+0000","last_change":"2023-11-28T12:06:28.910005+0000","last_active":"2023-11-28T12:06:30.431780+0000","last_peered":"2023-11-28T12:06:30.431780+0000","last_clean":"2023-11-28T12:06:30.431780+0000","last_became_active":"2023-11-28T12:06:28.909736+0000","last_became_peered":"2023-11-28T12:06:28.909736+0000","last_unstale":"2023-11-28T12:06:30.431780+0000","last_undegraded":"2023-11-28T12:06:30.431780+0000","last_fullsized":"2023-11-28T12:06:30.431780+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:27:37.876201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431752+0000","last_change":"2023-11-28T12:06:29.412757+0000","last_active":"2023-11-28T12:06:30.431752+0000","last_peered":"2023-11-28T12:06:30.431752+0000","last_clean":"2023-11-28T12:06:30.431752+0000","last_became_active":"2023-11-28T12:06:29.412424+0000","last_became_peered":"2023-11-28T12:06:29.412424+0000","last_unstale":"2023-11-28T12:06:30.431752+0000","last_undegraded":"2023-11-28T12:06:30.431752+0000","last_fullsized":"2023-11-28T12:06:30.431752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:18:07.794113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431275+0000","last_change":"2023-11-28T12:06:28.915845+0000","last_active":"2023-11-28T12:06:30.431275+0000","last_peered":"2023-11-28T12:06:30.431275+0000","last_clean":"2023-11-28T12:06:30.431275+0000","last_became_active":"2023-11-28T12:06:28.915223+0000","last_became_peered":"2023-11-28T12:06:28.915223+0000","last_unstale":"2023-11-28T12:06:30.431275+0000","last_undegraded":"2023-11-28T12:06:30.431275+0000","last_fullsized":"2023-11-28T12:06:30.431275+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:18:19.943945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432576+0000","last_change":"2023-11-28T12:06:29.431967+0000","last_active":"2023-11-28T12:06:30.432576+0000","last_peered":"2023-11-28T12:06:30.432576+0000","last_clean":"2023-11-28T12:06:30.432576+0000","last_became_active":"2023-11-28T12:06:29.430710+0000","last_became_peered":"2023-11-28T12:06:29.430710+0000","last_unstale":"2023-11-28T12:06:30.432576+0000","last_undegraded":"2023-11-28T12:06:30.432576+0000","last_fullsized":"2023-11-28T12:06:30.432576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:03:53.795177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.430884+0000","last_change":"2023-11-28T12:06:28.901401+0000","last_active":"2023-11-28T12:06:30.430884+0000","last_peered":"2023-11-28T12:06:30.430884+0000","last_clean":"2023-11-28T12:06:30.430884+0000","last_became_active":"2023-11-28T12:06:28.900727+0000","last_became_peered":"2023-11-28T12:06:28.900727+0000","last_unstale":"2023-11-28T12:06:30.430884+0000","last_undegraded":"2023-11-28T12:06:30.430884+0000","last_fullsized":"2023-11-28T12:06:30.430884+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:43:34.311973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.402933+0000","last_change":"2023-11-28T12:06:29.420506+0000","last_active":"2023-11-28T12:06:30.402933+0000","last_peered":"2023-11-28T12:06:30.402933+0000","last_clean":"2023-11-28T12:06:30.402933+0000","last_became_active":"2023-11-28T12:06:29.419616+0000","last_became_peered":"2023-11-28T12:06:29.419616+0000","last_unstale":"2023-11-28T12:06:30.402933+0000","last_undegraded":"2023-11-28T12:06:30.402933+0000","last_fullsized":"2023-11-28T12:06:30.402933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:33:22.203612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432686+0000","last_change":"2023-11-28T12:06:28.904440+0000","last_active":"2023-11-28T12:06:30.432686+0000","last_peered":"2023-11-28T12:06:30.432686+0000","last_clean":"2023-11-28T12:06:30.432686+0000","last_became_active":"2023-11-28T12:06:28.904179+0000","last_became_peered":"2023-11-28T12:06:28.904179+0000","last_unstale":"2023-11-28T12:06:30.432686+0000","last_undegraded":"2023-11-28T12:06:30.432686+0000","last_fullsized":"2023-11-28T12:06:30.432686+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:25:02.799298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.430795+0000","last_change":"2023-11-28T12:06:29.411944+0000","last_active":"2023-11-28T12:06:30.430795+0000","last_peered":"2023-11-28T12:06:30.430795+0000","last_clean":"2023-11-28T12:06:30.430795+0000","last_became_active":"2023-11-28T12:06:29.411564+0000","last_became_peered":"2023-11-28T12:06:29.411564+0000","last_unstale":"2023-11-28T12:06:30.430795+0000","last_undegraded":"2023-11-28T12:06:30.430795+0000","last_fullsized":"2023-11-28T12:06:30.430795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:57:15.470252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.402366+0000","last_change":"2023-11-28T12:06:28.901015+0000","last_active":"2023-11-28T12:06:30.402366+0000","last_peered":"2023-11-28T12:06:30.402366+0000","last_clean":"2023-11-28T12:06:30.402366+0000","last_became_active":"2023-11-28T12:06:28.900724+0000","last_became_peered":"2023-11-28T12:06:28.900724+0000","last_unstale":"2023-11-28T12:06:30.402366+0000","last_undegraded":"2023-11-28T12:06:30.402366+0000","last_fullsized":"2023-11-28T12:06:30.402366+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:25:02.799298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.430807+0000","last_change":"2023-11-28T12:06:29.425082+0000","last_active":"2023-11-28T12:06:30.430807+0000","last_peered":"2023-11-28T12:06:30.430807+0000","last_clean":"2023-11-28T12:06:30.430807+0000","last_became_active":"2023-11-28T12:06:29.424753+0000","last_became_peered":"2023-11-28T12:06:29.424753+0000","last_unstale":"2023-11-28T12:06:30.430807+0000","last_undegraded":"2023-11-28T12:06:30.430807+0000","last_fullsized":"2023-11-28T12:06:30.430807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:57:52.848285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432060+0000","last_change":"2023-11-28T12:06:28.904157+0000","last_active":"2023-11-28T12:06:30.432060+0000","last_peered":"2023-11-28T12:06:30.432060+0000","last_clean":"2023-11-28T12:06:30.432060+0000","last_became_active":"2023-11-28T12:06:28.902746+0000","last_became_peered":"2023-11-28T12:06:28.902746+0000","last_unstale":"2023-11-28T12:06:30.432060+0000","last_undegraded":"2023-11-28T12:06:30.432060+0000","last_fullsized":"2023-11-28T12:06:30.432060+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:33:21.196836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431731+0000","last_change":"2023-11-28T12:06:29.417397+0000","last_active":"2023-11-28T12:06:30.431731+0000","last_peered":"2023-11-28T12:06:30.431731+0000","last_clean":"2023-11-28T12:06:30.431731+0000","last_became_active":"2023-11-28T12:06:29.416301+0000","last_became_peered":"2023-11-28T12:06:29.416301+0000","last_unstale":"2023-11-28T12:06:30.431731+0000","last_undegraded":"2023-11-28T12:06:30.431731+0000","last_fullsized":"2023-11-28T12:06:30.431731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:51:20.319063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"19'6","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432375+0000","last_change":"2023-11-28T12:06:28.907107+0000","last_active":"2023-11-28T12:06:30.432375+0000","last_peered":"2023-11-28T12:06:30.432375+0000","last_clean":"2023-11-28T12:06:30.432375+0000","last_became_active":"2023-11-28T12:06:28.906719+0000","last_became_peered":"2023-11-28T12:06:28.906719+0000","last_unstale":"2023-11-28T12:06:30.432375+0000","last_undegraded":"2023-11-28T12:06:30.432375+0000","last_fullsized":"2023-11-28T12:06:30.432375+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:18:19.943945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432208+0000","last_change":"2023-11-28T12:06:29.421775+0000","last_active":"2023-11-28T12:06:30.432208+0000","last_peered":"2023-11-28T12:06:30.432208+0000","last_clean":"2023-11-28T12:06:30.432208+0000","last_became_active":"2023-11-28T12:06:29.421474+0000","last_became_peered":"2023-11-28T12:06:29.421474+0000","last_unstale":"2023-11-28T12:06:30.432208+0000","last_undegraded":"2023-11-28T12:06:30.432208+0000","last_fullsized":"2023-11-28T12:06:30.432208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:03:53.795177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431365+0000","last_change":"2023-11-28T12:06:28.906549+0000","last_active":"2023-11-28T12:06:30.431365+0000","last_peered":"2023-11-28T12:06:30.431365+0000","last_clean":"2023-11-28T12:06:30.431365+0000","last_became_active":"2023-11-28T12:06:28.906267+0000","last_became_peered":"2023-11-28T12:06:28.906267+0000","last_unstale":"2023-11-28T12:06:30.431365+0000","last_undegraded":"2023-11-28T12:06:30.431365+0000","last_fullsized":"2023-11-28T12:06:30.431365+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:20:03.086957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431336+0000","last_change":"2023-11-28T12:06:29.412345+0000","last_active":"2023-11-28T12:06:30.431336+0000","last_peered":"2023-11-28T12:06:30.431336+0000","last_clean":"2023-11-28T12:06:30.431336+0000","last_became_active":"2023-11-28T12:06:29.412100+0000","last_became_peered":"2023-11-28T12:06:29.412100+0000","last_unstale":"2023-11-28T12:06:30.431336+0000","last_undegraded":"2023-11-28T12:06:30.431336+0000","last_fullsized":"2023-11-28T12:06:30.431336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:08:40.987428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432293+0000","last_change":"2023-11-28T12:06:28.901789+0000","last_active":"2023-11-28T12:06:30.432293+0000","last_peered":"2023-11-28T12:06:30.432293+0000","last_clean":"2023-11-28T12:06:30.432293+0000","last_became_active":"2023-11-28T12:06:28.901317+0000","last_became_peered":"2023-11-28T12:06:28.901317+0000","last_unstale":"2023-11-28T12:06:30.432293+0000","last_undegraded":"2023-11-28T12:06:30.432293+0000","last_fullsized":"2023-11-28T12:06:30.432293+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:18:19.943945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.402428+0000","last_change":"2023-11-28T12:06:29.428820+0000","last_active":"2023-11-28T12:06:30.402428+0000","last_peered":"2023-11-28T12:06:30.402428+0000","last_clean":"2023-11-28T12:06:30.402428+0000","last_became_active":"2023-11-28T12:06:29.428532+0000","last_became_peered":"2023-11-28T12:06:29.428532+0000","last_unstale":"2023-11-28T12:06:30.402428+0000","last_undegraded":"2023-11-28T12:06:30.402428+0000","last_fullsized":"2023-11-28T12:06:30.402428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:03:53.795177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431427+0000","last_change":"2023-11-28T12:06:28.911421+0000","last_active":"2023-11-28T12:06:30.431427+0000","last_peered":"2023-11-28T12:06:30.431427+0000","last_clean":"2023-11-28T12:06:30.431427+0000","last_became_active":"2023-11-28T12:06:28.911098+0000","last_became_peered":"2023-11-28T12:06:28.911098+0000","last_unstale":"2023-11-28T12:06:30.431427+0000","last_undegraded":"2023-11-28T12:06:30.431427+0000","last_fullsized":"2023-11-28T12:06:30.431427+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:57:01.417679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432485+0000","last_change":"2023-11-28T12:06:29.428661+0000","last_active":"2023-11-28T12:06:30.432485+0000","last_peered":"2023-11-28T12:06:30.432485+0000","last_clean":"2023-11-28T12:06:30.432485+0000","last_became_active":"2023-11-28T12:06:29.427044+0000","last_became_peered":"2023-11-28T12:06:29.427044+0000","last_unstale":"2023-11-28T12:06:30.432485+0000","last_undegraded":"2023-11-28T12:06:30.432485+0000","last_fullsized":"2023-11-28T12:06:30.432485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:28:44.482157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.401722+0000","last_change":"2023-11-28T12:06:28.900418+0000","last_active":"2023-11-28T12:06:30.401722+0000","last_peered":"2023-11-28T12:06:30.401722+0000","last_clean":"2023-11-28T12:06:30.401722+0000","last_became_active":"2023-11-28T12:06:28.900135+0000","last_became_peered":"2023-11-28T12:06:28.900135+0000","last_unstale":"2023-11-28T12:06:30.401722+0000","last_undegraded":"2023-11-28T12:06:30.401722+0000","last_fullsized":"2023-11-28T12:06:30.401722+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:51:27.529794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432203+0000","last_change":"2023-11-28T12:06:29.419258+0000","last_active":"2023-11-28T12:06:30.432203+0000","last_peered":"2023-11-28T12:06:30.432203+0000","last_clean":"2023-11-28T12:06:30.432203+0000","last_became_active":"2023-11-28T12:06:29.418964+0000","last_became_peered":"2023-11-28T12:06:29.418964+0000","last_unstale":"2023-11-28T12:06:30.432203+0000","last_undegraded":"2023-11-28T12:06:30.432203+0000","last_fullsized":"2023-11-28T12:06:30.432203+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:28:34.213514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431583+0000","last_change":"2023-11-28T12:06:28.906323+0000","last_active":"2023-11-28T12:06:30.431583+0000","last_peered":"2023-11-28T12:06:30.431583+0000","last_clean":"2023-11-28T12:06:30.431583+0000","last_became_active":"2023-11-28T12:06:28.906018+0000","last_became_peered":"2023-11-28T12:06:28.906018+0000","last_unstale":"2023-11-28T12:06:30.431583+0000","last_undegraded":"2023-11-28T12:06:30.431583+0000","last_fullsized":"2023-11-28T12:06:30.431583+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:43:34.311973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.401855+0000","last_change":"2023-11-28T12:06:29.428058+0000","last_active":"2023-11-28T12:06:30.401855+0000","last_peered":"2023-11-28T12:06:30.401855+0000","last_clean":"2023-11-28T12:06:30.401855+0000","last_became_active":"2023-11-28T12:06:29.427473+0000","last_became_peered":"2023-11-28T12:06:29.427473+0000","last_unstale":"2023-11-28T12:06:30.401855+0000","last_undegraded":"2023-11-28T12:06:30.401855+0000","last_fullsized":"2023-11-28T12:06:30.401855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:07:00.558286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431905+0000","last_change":"2023-11-28T12:06:28.911429+0000","last_active":"2023-11-28T12:06:30.431905+0000","last_peered":"2023-11-28T12:06:30.431905+0000","last_clean":"2023-11-28T12:06:30.431905+0000","last_became_active":"2023-11-28T12:06:28.911128+0000","last_became_peered":"2023-11-28T12:06:28.911128+0000","last_unstale":"2023-11-28T12:06:30.431905+0000","last_undegraded":"2023-11-28T12:06:30.431905+0000","last_fullsized":"2023-11-28T12:06:30.431905+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:05:22.551488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431796+0000","last_change":"2023-11-28T12:06:29.431218+0000","last_active":"2023-11-28T12:06:30.431796+0000","last_peered":"2023-11-28T12:06:30.431796+0000","last_clean":"2023-11-28T12:06:30.431796+0000","last_became_active":"2023-11-28T12:06:29.430478+0000","last_became_peered":"2023-11-28T12:06:29.430478+0000","last_unstale":"2023-11-28T12:06:30.431796+0000","last_undegraded":"2023-11-28T12:06:30.431796+0000","last_fullsized":"2023-11-28T12:06:30.431796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:36:24.619605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432004+0000","last_change":"2023-11-28T12:06:28.909101+0000","last_active":"2023-11-28T12:06:30.432004+0000","last_peered":"2023-11-28T12:06:30.432004+0000","last_clean":"2023-11-28T12:06:30.432004+0000","last_became_active":"2023-11-28T12:06:28.908745+0000","last_became_peered":"2023-11-28T12:06:28.908745+0000","last_unstale":"2023-11-28T12:06:30.432004+0000","last_undegraded":"2023-11-28T12:06:30.432004+0000","last_fullsized":"2023-11-28T12:06:30.432004+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:02:25.842525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.403103+0000","last_change":"2023-11-28T12:06:29.414146+0000","last_active":"2023-11-28T12:06:30.403103+0000","last_peered":"2023-11-28T12:06:30.403103+0000","last_clean":"2023-11-28T12:06:30.403103+0000","last_became_active":"2023-11-28T12:06:29.413597+0000","last_became_peered":"2023-11-28T12:06:29.413597+0000","last_unstale":"2023-11-28T12:06:30.403103+0000","last_undegraded":"2023-11-28T12:06:30.403103+0000","last_fullsized":"2023-11-28T12:06:30.403103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:47:58.895820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.402510+0000","last_change":"2023-11-28T12:06:28.897981+0000","last_active":"2023-11-28T12:06:30.402510+0000","last_peered":"2023-11-28T12:06:30.402510+0000","last_clean":"2023-11-28T12:06:30.402510+0000","last_became_active":"2023-11-28T12:06:28.897618+0000","last_became_peered":"2023-11-28T12:06:28.897618+0000","last_unstale":"2023-11-28T12:06:30.402510+0000","last_undegraded":"2023-11-28T12:06:30.402510+0000","last_fullsized":"2023-11-28T12:06:30.402510+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:22:19.424800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431219+0000","last_change":"2023-11-28T12:06:29.411291+0000","last_active":"2023-11-28T12:06:30.431219+0000","last_peered":"2023-11-28T12:06:30.431219+0000","last_clean":"2023-11-28T12:06:30.431219+0000","last_became_active":"2023-11-28T12:06:29.411041+0000","last_became_peered":"2023-11-28T12:06:29.411041+0000","last_unstale":"2023-11-28T12:06:30.431219+0000","last_undegraded":"2023-11-28T12:06:30.431219+0000","last_fullsized":"2023-11-28T12:06:30.431219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:25:49.001168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431191+0000","last_change":"2023-11-28T12:06:28.899397+0000","last_active":"2023-11-28T12:06:30.431191+0000","last_peered":"2023-11-28T12:06:30.431191+0000","last_clean":"2023-11-28T12:06:30.431191+0000","last_became_active":"2023-11-28T12:06:28.899027+0000","last_became_peered":"2023-11-28T12:06:28.899027+0000","last_unstale":"2023-11-28T12:06:30.431191+0000","last_undegraded":"2023-11-28T12:06:30.431191+0000","last_fullsized":"2023-11-28T12:06:30.431191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:05:22.551488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432275+0000","last_change":"2023-11-28T12:06:29.427339+0000","last_active":"2023-11-28T12:06:30.432275+0000","last_peered":"2023-11-28T12:06:30.432275+0000","last_clean":"2023-11-28T12:06:30.432275+0000","last_became_active":"2023-11-28T12:06:29.422893+0000","last_became_peered":"2023-11-28T12:06:29.422893+0000","last_unstale":"2023-11-28T12:06:30.432275+0000","last_undegraded":"2023-11-28T12:06:30.432275+0000","last_fullsized":"2023-11-28T12:06:30.432275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:57:15.470252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.402371+0000","last_change":"2023-11-28T12:06:28.911788+0000","last_active":"2023-11-28T12:06:30.402371+0000","last_peered":"2023-11-28T12:06:30.402371+0000","last_clean":"2023-11-28T12:06:30.402371+0000","last_became_active":"2023-11-28T12:06:28.910333+0000","last_became_peered":"2023-11-28T12:06:28.910333+0000","last_unstale":"2023-11-28T12:06:30.402371+0000","last_undegraded":"2023-11-28T12:06:30.402371+0000","last_fullsized":"2023-11-28T12:06:30.402371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:10:07.458120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432302+0000","last_change":"2023-11-28T12:06:29.422530+0000","last_active":"2023-11-28T12:06:30.432302+0000","last_peered":"2023-11-28T12:06:30.432302+0000","last_clean":"2023-11-28T12:06:30.432302+0000","last_became_active":"2023-11-28T12:06:29.422148+0000","last_became_peered":"2023-11-28T12:06:29.422148+0000","last_unstale":"2023-11-28T12:06:30.432302+0000","last_undegraded":"2023-11-28T12:06:30.432302+0000","last_fullsized":"2023-11-28T12:06:30.432302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:27:03.452097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431662+0000","last_change":"2023-11-28T12:06:28.906946+0000","last_active":"2023-11-28T12:06:30.431662+0000","last_peered":"2023-11-28T12:06:30.431662+0000","last_clean":"2023-11-28T12:06:30.431662+0000","last_became_active":"2023-11-28T12:06:28.906330+0000","last_became_peered":"2023-11-28T12:06:28.906330+0000","last_unstale":"2023-11-28T12:06:30.431662+0000","last_undegraded":"2023-11-28T12:06:30.431662+0000","last_fullsized":"2023-11-28T12:06:30.431662+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:51:27.529794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432470+0000","last_change":"2023-11-28T12:06:29.422900+0000","last_active":"2023-11-28T12:06:30.432470+0000","last_peered":"2023-11-28T12:06:30.432470+0000","last_clean":"2023-11-28T12:06:30.432470+0000","last_became_active":"2023-11-28T12:06:29.422592+0000","last_became_peered":"2023-11-28T12:06:29.422592+0000","last_unstale":"2023-11-28T12:06:30.432470+0000","last_undegraded":"2023-11-28T12:06:30.432470+0000","last_fullsized":"2023-11-28T12:06:30.432470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:39:17.802039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431015+0000","last_change":"2023-11-28T12:06:28.910918+0000","last_active":"2023-11-28T12:06:30.431015+0000","last_peered":"2023-11-28T12:06:30.431015+0000","last_clean":"2023-11-28T12:06:30.431015+0000","last_became_active":"2023-11-28T12:06:28.910601+0000","last_became_peered":"2023-11-28T12:06:28.910601+0000","last_unstale":"2023-11-28T12:06:30.431015+0000","last_undegraded":"2023-11-28T12:06:30.431015+0000","last_fullsized":"2023-11-28T12:06:30.431015+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:22:19.424800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432528+0000","last_change":"2023-11-28T12:06:29.428654+0000","last_active":"2023-11-28T12:06:30.432528+0000","last_peered":"2023-11-28T12:06:30.432528+0000","last_clean":"2023-11-28T12:06:30.432528+0000","last_became_active":"2023-11-28T12:06:29.428388+0000","last_became_peered":"2023-11-28T12:06:29.428388+0000","last_unstale":"2023-11-28T12:06:30.432528+0000","last_undegraded":"2023-11-28T12:06:30.432528+0000","last_fullsized":"2023-11-28T12:06:30.432528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:13:08.504009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432068+0000","last_change":"2023-11-28T12:06:28.897386+0000","last_active":"2023-11-28T12:06:30.432068+0000","last_peered":"2023-11-28T12:06:30.432068+0000","last_clean":"2023-11-28T12:06:30.432068+0000","last_became_active":"2023-11-28T12:06:28.896863+0000","last_became_peered":"2023-11-28T12:06:28.896863+0000","last_unstale":"2023-11-28T12:06:30.432068+0000","last_undegraded":"2023-11-28T12:06:30.432068+0000","last_fullsized":"2023-11-28T12:06:30.432068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:10:07.458120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T12:06:29.408752+0000","last_change":"2023-11-28T12:06:23.961595+0000","last_active":"2023-11-28T12:06:29.408752+0000","last_peered":"2023-11-28T12:06:29.408752+0000","last_clean":"2023-11-28T12:06:29.408752+0000","last_became_active":"2023-11-28T12:06:23.961257+0000","last_became_peered":"2023-11-28T12:06:23.961257+0000","last_unstale":"2023-11-28T12:06:29.408752+0000","last_undegraded":"2023-11-28T12:06:29.408752+0000","last_fullsized":"2023-11-28T12:06:29.408752+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:30:40.200095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.430465+0000","last_change":"2023-11-28T12:06:29.425702+0000","last_active":"2023-11-28T12:06:30.430465+0000","last_peered":"2023-11-28T12:06:30.430465+0000","last_clean":"2023-11-28T12:06:30.430465+0000","last_became_active":"2023-11-28T12:06:29.425445+0000","last_became_peered":"2023-11-28T12:06:29.425445+0000","last_unstale":"2023-11-28T12:06:30.430465+0000","last_undegraded":"2023-11-28T12:06:30.430465+0000","last_fullsized":"2023-11-28T12:06:30.430465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:03:53.795177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T12:06:29.400425+0000","last_change":"2023-11-28T12:06:23.517505+0000","last_active":"2023-11-28T12:06:29.400425+0000","last_peered":"2023-11-28T12:06:29.400425+0000","last_clean":"2023-11-28T12:06:29.400425+0000","last_became_active":"2023-11-28T12:06:23.517151+0000","last_became_peered":"2023-11-28T12:06:23.517151+0000","last_unstale":"2023-11-28T12:06:29.400425+0000","last_undegraded":"2023-11-28T12:06:29.400425+0000","last_fullsized":"2023-11-28T12:06:29.400425+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:30:40.200095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432594+0000","last_change":"2023-11-28T12:06:28.912292+0000","last_active":"2023-11-28T12:06:30.432594+0000","last_peered":"2023-11-28T12:06:30.432594+0000","last_clean":"2023-11-28T12:06:30.432594+0000","last_became_active":"2023-11-28T12:06:28.910834+0000","last_became_peered":"2023-11-28T12:06:28.910834+0000","last_unstale":"2023-11-28T12:06:30.432594+0000","last_undegraded":"2023-11-28T12:06:30.432594+0000","last_fullsized":"2023-11-28T12:06:30.432594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:51:27.529794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431570+0000","last_change":"2023-11-28T12:06:29.420045+0000","last_active":"2023-11-28T12:06:30.431570+0000","last_peered":"2023-11-28T12:06:30.431570+0000","last_clean":"2023-11-28T12:06:30.431570+0000","last_became_active":"2023-11-28T12:06:29.419739+0000","last_became_peered":"2023-11-28T12:06:29.419739+0000","last_unstale":"2023-11-28T12:06:30.431570+0000","last_undegraded":"2023-11-28T12:06:30.431570+0000","last_fullsized":"2023-11-28T12:06:30.431570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:25:49.001168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T12:06:29.405908+0000","last_change":"2023-11-28T12:06:23.517967+0000","last_active":"2023-11-28T12:06:29.405908+0000","last_peered":"2023-11-28T12:06:29.405908+0000","last_clean":"2023-11-28T12:06:29.405908+0000","last_became_active":"2023-11-28T12:06:23.517495+0000","last_became_peered":"2023-11-28T12:06:23.517495+0000","last_unstale":"2023-11-28T12:06:29.405908+0000","last_undegraded":"2023-11-28T12:06:29.405908+0000","last_fullsized":"2023-11-28T12:06:29.405908+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:51:06.844441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T12:06:29.408596+0000","last_change":"2023-11-28T12:06:23.513472+0000","last_active":"2023-11-28T12:06:29.408596+0000","last_peered":"2023-11-28T12:06:29.408596+0000","last_clean":"2023-11-28T12:06:29.408596+0000","last_became_active":"2023-11-28T12:06:23.513150+0000","last_became_peered":"2023-11-28T12:06:23.513150+0000","last_unstale":"2023-11-28T12:06:29.408596+0000","last_undegraded":"2023-11-28T12:06:29.408596+0000","last_fullsized":"2023-11-28T12:06:29.408596+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:34:18.653049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.430898+0000","last_change":"2023-11-28T12:06:28.909662+0000","last_active":"2023-11-28T12:06:30.430898+0000","last_peered":"2023-11-28T12:06:30.430898+0000","last_clean":"2023-11-28T12:06:30.430898+0000","last_became_active":"2023-11-28T12:06:28.907056+0000","last_became_peered":"2023-11-28T12:06:28.907056+0000","last_unstale":"2023-11-28T12:06:30.430898+0000","last_undegraded":"2023-11-28T12:06:30.430898+0000","last_fullsized":"2023-11-28T12:06:30.430898+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:22:19.424800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432482+0000","last_change":"2023-11-28T12:06:29.420306+0000","last_active":"2023-11-28T12:06:30.432482+0000","last_peered":"2023-11-28T12:06:30.432482+0000","last_clean":"2023-11-28T12:06:30.432482+0000","last_became_active":"2023-11-28T12:06:29.419788+0000","last_became_peered":"2023-11-28T12:06:29.419788+0000","last_unstale":"2023-11-28T12:06:30.432482+0000","last_undegraded":"2023-11-28T12:06:30.432482+0000","last_fullsized":"2023-11-28T12:06:30.432482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:28:34.213514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T12:06:29.409054+0000","last_change":"2023-11-28T12:06:23.903708+0000","last_active":"2023-11-28T12:06:29.409054+0000","last_peered":"2023-11-28T12:06:29.409054+0000","last_clean":"2023-11-28T12:06:29.409054+0000","last_became_active":"2023-11-28T12:06:23.903399+0000","last_became_peered":"2023-11-28T12:06:23.903399+0000","last_unstale":"2023-11-28T12:06:29.409054+0000","last_undegraded":"2023-11-28T12:06:29.409054+0000","last_fullsized":"2023-11-28T12:06:29.409054+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:31:13.187145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.430703+0000","last_change":"2023-11-28T12:06:28.913668+0000","last_active":"2023-11-28T12:06:30.430703+0000","last_peered":"2023-11-28T12:06:30.430703+0000","last_clean":"2023-11-28T12:06:30.430703+0000","last_became_active":"2023-11-28T12:06:28.913342+0000","last_became_peered":"2023-11-28T12:06:28.913342+0000","last_unstale":"2023-11-28T12:06:30.430703+0000","last_undegraded":"2023-11-28T12:06:30.430703+0000","last_fullsized":"2023-11-28T12:06:30.430703+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:10:07.458120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431800+0000","last_change":"2023-11-28T12:06:29.422027+0000","last_active":"2023-11-28T12:06:30.431800+0000","last_peered":"2023-11-28T12:06:30.431800+0000","last_clean":"2023-11-28T12:06:30.431800+0000","last_became_active":"2023-11-28T12:06:29.421737+0000","last_became_peered":"2023-11-28T12:06:29.421737+0000","last_unstale":"2023-11-28T12:06:30.431800+0000","last_undegraded":"2023-11-28T12:06:30.431800+0000","last_fullsized":"2023-11-28T12:06:30.431800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:25:07.078893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T12:06:29.408153+0000","last_change":"2023-11-28T12:06:23.903662+0000","last_active":"2023-11-28T12:06:29.408153+0000","last_peered":"2023-11-28T12:06:29.408153+0000","last_clean":"2023-11-28T12:06:29.408153+0000","last_became_active":"2023-11-28T12:06:23.903354+0000","last_became_peered":"2023-11-28T12:06:23.903354+0000","last_unstale":"2023-11-28T12:06:29.408153+0000","last_undegraded":"2023-11-28T12:06:29.408153+0000","last_fullsized":"2023-11-28T12:06:29.408153+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:02:07.694087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.430927+0000","last_change":"2023-11-28T12:06:28.904988+0000","last_active":"2023-11-28T12:06:30.430927+0000","last_peered":"2023-11-28T12:06:30.430927+0000","last_clean":"2023-11-28T12:06:30.430927+0000","last_became_active":"2023-11-28T12:06:28.904389+0000","last_became_peered":"2023-11-28T12:06:28.904389+0000","last_unstale":"2023-11-28T12:06:30.430927+0000","last_undegraded":"2023-11-28T12:06:30.430927+0000","last_fullsized":"2023-11-28T12:06:30.430927+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:25:02.799298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.402642+0000","last_change":"2023-11-28T12:06:29.424397+0000","last_active":"2023-11-28T12:06:30.402642+0000","last_peered":"2023-11-28T12:06:30.402642+0000","last_clean":"2023-11-28T12:06:30.402642+0000","last_became_active":"2023-11-28T12:06:29.424122+0000","last_became_peered":"2023-11-28T12:06:29.424122+0000","last_unstale":"2023-11-28T12:06:30.402642+0000","last_undegraded":"2023-11-28T12:06:30.402642+0000","last_fullsized":"2023-11-28T12:06:30.402642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:39:12.434022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T12:06:29.415039+0000","last_change":"2023-11-28T12:06:23.903797+0000","last_active":"2023-11-28T12:06:29.415039+0000","last_peered":"2023-11-28T12:06:29.415039+0000","last_clean":"2023-11-28T12:06:29.415039+0000","last_became_active":"2023-11-28T12:06:23.903475+0000","last_became_peered":"2023-11-28T12:06:23.903475+0000","last_unstale":"2023-11-28T12:06:29.415039+0000","last_undegraded":"2023-11-28T12:06:29.415039+0000","last_fullsized":"2023-11-28T12:06:29.415039+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:51:06.844441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432343+0000","last_change":"2023-11-28T12:06:28.905900+0000","last_active":"2023-11-28T12:06:30.432343+0000","last_peered":"2023-11-28T12:06:30.432343+0000","last_clean":"2023-11-28T12:06:30.432343+0000","last_became_active":"2023-11-28T12:06:28.905583+0000","last_became_peered":"2023-11-28T12:06:28.905583+0000","last_unstale":"2023-11-28T12:06:30.432343+0000","last_undegraded":"2023-11-28T12:06:30.432343+0000","last_fullsized":"2023-11-28T12:06:30.432343+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:10:07.458120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432082+0000","last_change":"2023-11-28T12:06:29.412204+0000","last_active":"2023-11-28T12:06:30.432082+0000","last_peered":"2023-11-28T12:06:30.432082+0000","last_clean":"2023-11-28T12:06:30.432082+0000","last_became_active":"2023-11-28T12:06:29.411941+0000","last_became_peered":"2023-11-28T12:06:29.411941+0000","last_unstale":"2023-11-28T12:06:30.432082+0000","last_undegraded":"2023-11-28T12:06:30.432082+0000","last_fullsized":"2023-11-28T12:06:30.432082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:07:00.558286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T12:06:29.403178+0000","last_change":"2023-11-28T12:06:23.903983+0000","last_active":"2023-11-28T12:06:29.403178+0000","last_peered":"2023-11-28T12:06:29.403178+0000","last_clean":"2023-11-28T12:06:29.403178+0000","last_became_active":"2023-11-28T12:06:23.903511+0000","last_became_peered":"2023-11-28T12:06:23.903511+0000","last_unstale":"2023-11-28T12:06:29.403178+0000","last_undegraded":"2023-11-28T12:06:29.403178+0000","last_fullsized":"2023-11-28T12:06:29.403178+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:31:13.187145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432035+0000","last_change":"2023-11-28T12:06:28.914003+0000","last_active":"2023-11-28T12:06:30.432035+0000","last_peered":"2023-11-28T12:06:30.432035+0000","last_clean":"2023-11-28T12:06:30.432035+0000","last_became_active":"2023-11-28T12:06:28.913345+0000","last_became_peered":"2023-11-28T12:06:28.913345+0000","last_unstale":"2023-11-28T12:06:30.432035+0000","last_undegraded":"2023-11-28T12:06:30.432035+0000","last_fullsized":"2023-11-28T12:06:30.432035+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:51:27.529794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431036+0000","last_change":"2023-11-28T12:06:29.419498+0000","last_active":"2023-11-28T12:06:30.431036+0000","last_peered":"2023-11-28T12:06:30.431036+0000","last_clean":"2023-11-28T12:06:30.431036+0000","last_became_active":"2023-11-28T12:06:29.419162+0000","last_became_peered":"2023-11-28T12:06:29.419162+0000","last_unstale":"2023-11-28T12:06:30.431036+0000","last_undegraded":"2023-11-28T12:06:30.431036+0000","last_fullsized":"2023-11-28T12:06:30.431036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:31:18.258195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T12:06:29.405346+0000","last_change":"2023-11-28T12:06:23.517246+0000","last_active":"2023-11-28T12:06:29.405346+0000","last_peered":"2023-11-28T12:06:29.405346+0000","last_clean":"2023-11-28T12:06:29.405346+0000","last_became_active":"2023-11-28T12:06:23.516854+0000","last_became_peered":"2023-11-28T12:06:23.516854+0000","last_unstale":"2023-11-28T12:06:29.405346+0000","last_undegraded":"2023-11-28T12:06:29.405346+0000","last_fullsized":"2023-11-28T12:06:29.405346+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:51:06.844441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.402925+0000","last_change":"2023-11-28T12:06:28.899604+0000","last_active":"2023-11-28T12:06:30.402925+0000","last_peered":"2023-11-28T12:06:30.402925+0000","last_clean":"2023-11-28T12:06:30.402925+0000","last_became_active":"2023-11-28T12:06:28.899322+0000","last_became_peered":"2023-11-28T12:06:28.899322+0000","last_unstale":"2023-11-28T12:06:30.402925+0000","last_undegraded":"2023-11-28T12:06:30.402925+0000","last_fullsized":"2023-11-28T12:06:30.402925+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:05:22.551488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431859+0000","last_change":"2023-11-28T12:06:29.416051+0000","last_active":"2023-11-28T12:06:30.431859+0000","last_peered":"2023-11-28T12:06:30.431859+0000","last_clean":"2023-11-28T12:06:30.431859+0000","last_became_active":"2023-11-28T12:06:29.415796+0000","last_became_peered":"2023-11-28T12:06:29.415796+0000","last_unstale":"2023-11-28T12:06:30.431859+0000","last_undegraded":"2023-11-28T12:06:30.431859+0000","last_fullsized":"2023-11-28T12:06:30.431859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:14:19.511638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431127+0000","last_change":"2023-11-28T12:06:28.911467+0000","last_active":"2023-11-28T12:06:30.431127+0000","last_peered":"2023-11-28T12:06:30.431127+0000","last_clean":"2023-11-28T12:06:30.431127+0000","last_became_active":"2023-11-28T12:06:28.907578+0000","last_became_peered":"2023-11-28T12:06:28.907578+0000","last_unstale":"2023-11-28T12:06:30.431127+0000","last_undegraded":"2023-11-28T12:06:30.431127+0000","last_fullsized":"2023-11-28T12:06:30.431127+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:10:07.458120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.400161+0000","last_change":"2023-11-28T12:06:29.411427+0000","last_active":"2023-11-28T12:06:30.400161+0000","last_peered":"2023-11-28T12:06:30.400161+0000","last_clean":"2023-11-28T12:06:30.400161+0000","last_became_active":"2023-11-28T12:06:29.411146+0000","last_became_peered":"2023-11-28T12:06:29.411146+0000","last_unstale":"2023-11-28T12:06:30.400161+0000","last_undegraded":"2023-11-28T12:06:30.400161+0000","last_fullsized":"2023-11-28T12:06:30.400161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:25:03.806074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.401875+0000","last_change":"2023-11-28T12:06:28.907981+0000","last_active":"2023-11-28T12:06:30.401875+0000","last_peered":"2023-11-28T12:06:30.401875+0000","last_clean":"2023-11-28T12:06:30.401875+0000","last_became_active":"2023-11-28T12:06:28.906662+0000","last_became_peered":"2023-11-28T12:06:28.906662+0000","last_unstale":"2023-11-28T12:06:30.401875+0000","last_undegraded":"2023-11-28T12:06:30.401875+0000","last_fullsized":"2023-11-28T12:06:30.401875+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:57:01.417679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431947+0000","last_change":"2023-11-28T12:06:29.435464+0000","last_active":"2023-11-28T12:06:30.431947+0000","last_peered":"2023-11-28T12:06:30.431947+0000","last_clean":"2023-11-28T12:06:30.431947+0000","last_became_active":"2023-11-28T12:06:29.435154+0000","last_became_peered":"2023-11-28T12:06:29.435154+0000","last_unstale":"2023-11-28T12:06:30.431947+0000","last_undegraded":"2023-11-28T12:06:30.431947+0000","last_fullsized":"2023-11-28T12:06:30.431947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:18:07.794113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.402928+0000","last_change":"2023-11-28T12:06:28.910150+0000","last_active":"2023-11-28T12:06:30.402928+0000","last_peered":"2023-11-28T12:06:30.402928+0000","last_clean":"2023-11-28T12:06:30.402928+0000","last_became_active":"2023-11-28T12:06:28.909642+0000","last_became_peered":"2023-11-28T12:06:28.909642+0000","last_unstale":"2023-11-28T12:06:30.402928+0000","last_undegraded":"2023-11-28T12:06:30.402928+0000","last_fullsized":"2023-11-28T12:06:30.402928+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:43:34.311973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431920+0000","last_change":"2023-11-28T12:06:29.435703+0000","last_active":"2023-11-28T12:06:30.431920+0000","last_peered":"2023-11-28T12:06:30.431920+0000","last_clean":"2023-11-28T12:06:30.431920+0000","last_became_active":"2023-11-28T12:06:29.435414+0000","last_became_peered":"2023-11-28T12:06:29.435414+0000","last_unstale":"2023-11-28T12:06:30.431920+0000","last_undegraded":"2023-11-28T12:06:30.431920+0000","last_fullsized":"2023-11-28T12:06:30.431920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:20:52.473176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431714+0000","last_change":"2023-11-28T12:06:28.896545+0000","last_active":"2023-11-28T12:06:30.431714+0000","last_peered":"2023-11-28T12:06:30.431714+0000","last_clean":"2023-11-28T12:06:30.431714+0000","last_became_active":"2023-11-28T12:06:28.896194+0000","last_became_peered":"2023-11-28T12:06:28.896194+0000","last_unstale":"2023-11-28T12:06:30.431714+0000","last_undegraded":"2023-11-28T12:06:30.431714+0000","last_fullsized":"2023-11-28T12:06:30.431714+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:51:27.529794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.430903+0000","last_change":"2023-11-28T12:06:29.415972+0000","last_active":"2023-11-28T12:06:30.430903+0000","last_peered":"2023-11-28T12:06:30.430903+0000","last_clean":"2023-11-28T12:06:30.430903+0000","last_became_active":"2023-11-28T12:06:29.415403+0000","last_became_peered":"2023-11-28T12:06:29.415403+0000","last_unstale":"2023-11-28T12:06:30.430903+0000","last_undegraded":"2023-11-28T12:06:30.430903+0000","last_fullsized":"2023-11-28T12:06:30.430903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:25:49.001168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432765+0000","last_change":"2023-11-28T12:06:28.904656+0000","last_active":"2023-11-28T12:06:30.432765+0000","last_peered":"2023-11-28T12:06:30.432765+0000","last_clean":"2023-11-28T12:06:30.432765+0000","last_became_active":"2023-11-28T12:06:28.903576+0000","last_became_peered":"2023-11-28T12:06:28.903576+0000","last_unstale":"2023-11-28T12:06:30.432765+0000","last_undegraded":"2023-11-28T12:06:30.432765+0000","last_fullsized":"2023-11-28T12:06:30.432765+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:05:22.551488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431143+0000","last_change":"2023-11-28T12:06:29.433471+0000","last_active":"2023-11-28T12:06:30.431143+0000","last_peered":"2023-11-28T12:06:30.431143+0000","last_clean":"2023-11-28T12:06:30.431143+0000","last_became_active":"2023-11-28T12:06:29.433175+0000","last_became_peered":"2023-11-28T12:06:29.433175+0000","last_unstale":"2023-11-28T12:06:30.431143+0000","last_undegraded":"2023-11-28T12:06:30.431143+0000","last_fullsized":"2023-11-28T12:06:30.431143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:31:18.258195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.402168+0000","last_change":"2023-11-28T12:06:29.409984+0000","last_active":"2023-11-28T12:06:30.402168+0000","last_peered":"2023-11-28T12:06:30.402168+0000","last_clean":"2023-11-28T12:06:30.402168+0000","last_became_active":"2023-11-28T12:06:29.409708+0000","last_became_peered":"2023-11-28T12:06:29.409708+0000","last_unstale":"2023-11-28T12:06:30.402168+0000","last_undegraded":"2023-11-28T12:06:30.402168+0000","last_fullsized":"2023-11-28T12:06:30.402168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:10:24.380829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.430715+0000","last_change":"2023-11-28T12:06:29.412286+0000","last_active":"2023-11-28T12:06:30.430715+0000","last_peered":"2023-11-28T12:06:30.430715+0000","last_clean":"2023-11-28T12:06:30.430715+0000","last_became_active":"2023-11-28T12:06:29.412022+0000","last_became_peered":"2023-11-28T12:06:29.412022+0000","last_unstale":"2023-11-28T12:06:30.430715+0000","last_undegraded":"2023-11-28T12:06:30.430715+0000","last_fullsized":"2023-11-28T12:06:30.430715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:20:52.473176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431676+0000","last_change":"2023-11-28T12:06:29.424994+0000","last_active":"2023-11-28T12:06:30.431676+0000","last_peered":"2023-11-28T12:06:30.431676+0000","last_clean":"2023-11-28T12:06:30.431676+0000","last_became_active":"2023-11-28T12:06:29.424738+0000","last_became_peered":"2023-11-28T12:06:29.424738+0000","last_unstale":"2023-11-28T12:06:30.431676+0000","last_undegraded":"2023-11-28T12:06:30.431676+0000","last_fullsized":"2023-11-28T12:06:30.431676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:08:40.987428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431286+0000","last_change":"2023-11-28T12:06:29.420914+0000","last_active":"2023-11-28T12:06:30.431286+0000","last_peered":"2023-11-28T12:06:30.431286+0000","last_clean":"2023-11-28T12:06:30.431286+0000","last_became_active":"2023-11-28T12:06:29.420396+0000","last_became_peered":"2023-11-28T12:06:29.420396+0000","last_unstale":"2023-11-28T12:06:30.431286+0000","last_undegraded":"2023-11-28T12:06:30.431286+0000","last_fullsized":"2023-11-28T12:06:30.431286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:28:44.482157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431992+0000","last_change":"2023-11-28T12:06:29.418068+0000","last_active":"2023-11-28T12:06:30.431992+0000","last_peered":"2023-11-28T12:06:30.431992+0000","last_clean":"2023-11-28T12:06:30.431992+0000","last_became_active":"2023-11-28T12:06:29.417569+0000","last_became_peered":"2023-11-28T12:06:29.417569+0000","last_unstale":"2023-11-28T12:06:30.431992+0000","last_undegraded":"2023-11-28T12:06:30.431992+0000","last_fullsized":"2023-11-28T12:06:30.431992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:39:12.434022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9072,"kb_used_data":808,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362768,"statfs":{"total":96636764160,"available":96627474432,"internally_reserved":0,"allocated":827392,"data_stored":666560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7888,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":7680,"kb_avail":94363952,"statfs":{"total":96636764160,"available":96628686848,"internally_reserved":0,"allocated":204800,"data_stored":74428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7864320},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13140,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":12352,"kb_avail":94358700,"statfs":{"total":96636764160,"available":96623308800,"internally_reserved":0,"allocated":798720,"data_stored":664796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12648448},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12048,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":11840,"kb_avail":94359792,"statfs":{"total":96636764160,"available":96624427008,"internally_reserved":0,"allocated":204800,"data_stored":73633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12124160},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.877}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86099999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11984,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":11776,"kb_avail":94359856,"statfs":{"total":96636764160,"available":96624492544,"internally_reserved":0,"allocated":204800,"data_stored":74428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12058624},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.311}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12112,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":11904,"kb_avail":94359728,"statfs":{"total":96636764160,"available":96624361472,"internally_reserved":0,"allocated":204800,"data_stored":73157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12189696},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8036,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363804,"statfs":{"total":96636764160,"available":96628535296,"internally_reserved":0,"allocated":225280,"data_stored":76032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.125}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.093}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2050000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2430000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2230000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7960,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363880,"statfs":{"total":96636764160,"available":96628613120,"internally_reserved":0,"allocated":212992,"data_stored":75064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T12:06:34.796 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-28T12:06:34.796 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-11-28T12:06:34.797 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-11-28T12:06:34.797 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-11-28T12:06:34.797 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-11-28T12:06:35.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.035+0000 7fa8e2bff700 1 Processor -- start 2023-11-28T12:06:35.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.035+0000 7fa8e2bff700 1 -- start start 2023-11-28T12:06:35.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.036+0000 7fa8e2bff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa8dc0b20b0 0x7fa8dc0b0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:35.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.036+0000 7fa8e2bff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8dc0b0230 con 0x7fa8dc0d01b0 2023-11-28T12:06:35.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.036+0000 7fa8e2bff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8dc0b4570 con 0x7fa8dc0d1330 2023-11-28T12:06:35.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.036+0000 7fa8e2bff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8dc15cec0 con 0x7fa8dc0b20b0 2023-11-28T12:06:35.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.036+0000 7fa8e099b700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fa8dc0d01b0 0x7fa8dc0d0c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:60956/0 (socket says 172.21.15.45:60956) 2023-11-28T12:06:35.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.036+0000 7fa8e099b700 1 -- 172.21.15.45:0/346487309 learned_addr learned my addr 172.21.15.45:0/346487309 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:06:35.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.036+0000 7fa8e119c700 1 --2- 172.21.15.45:0/346487309 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa8dc0b20b0 0x7fa8dc0b0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:35.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.037+0000 7fa8db7fe700 1 -- 172.21.15.45:0/346487309 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2666263518 0 0) 0x7fa8dc0b0230 con 0x7fa8dc0d01b0 2023-11-28T12:06:35.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.037+0000 7fa8db7fe700 1 -- 172.21.15.45:0/346487309 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8cc0035b0 con 0x7fa8dc0d01b0 2023-11-28T12:06:35.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.037+0000 7fa8db7fe700 1 -- 172.21.15.45:0/346487309 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2504600028 0 0) 0x7fa8dc0b4570 con 0x7fa8dc0d1330 2023-11-28T12:06:35.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.037+0000 7fa8db7fe700 1 -- 172.21.15.45:0/346487309 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8dc0b0230 con 0x7fa8dc0d1330 2023-11-28T12:06:35.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.037+0000 7fa8e119c700 1 -- 172.21.15.45:0/346487309 >> v1:172.21.15.152:6789/0 conn(0x7fa8dc0d1330 legacy=0x7fa8dc0b06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:35.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.037+0000 7fa8e119c700 1 -- 172.21.15.45:0/346487309 >> v1:172.21.15.45:6789/0 conn(0x7fa8dc0d01b0 legacy=0x7fa8dc0d0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:35.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.037+0000 7fa8e119c700 1 -- 172.21.15.45:0/346487309 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8dc0b4850 con 0x7fa8dc0b20b0 2023-11-28T12:06:35.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.037+0000 7fa8e119c700 1 --2- 172.21.15.45:0/346487309 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa8dc0b20b0 0x7fa8dc0b0dd0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa8d4009dc0 tx=0x7fa8d400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4536fab0242dd478 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:35.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.038+0000 7fa8db7fe700 1 -- 172.21.15.45:0/346487309 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d400e070 con 0x7fa8dc0b20b0 2023-11-28T12:06:35.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.038+0000 7fa8db7fe700 1 -- 172.21.15.45:0/346487309 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8d400bb20 con 0x7fa8dc0b20b0 2023-11-28T12:06:35.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.038+0000 7fa8db7fe700 1 -- 172.21.15.45:0/346487309 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d4012430 con 0x7fa8dc0b20b0 2023-11-28T12:06:35.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.038+0000 7fa8e2bff700 1 -- 172.21.15.45:0/346487309 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa8dc0b20b0 msgr2=0x7fa8dc0b0dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:35.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.038+0000 7fa8e2bff700 1 --2- 172.21.15.45:0/346487309 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa8dc0b20b0 0x7fa8dc0b0dd0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa8d4009dc0 tx=0x7fa8d400b330 comp rx=0 tx=0).stop 2023-11-28T12:06:35.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.038+0000 7fa8e2bff700 1 -- 172.21.15.45:0/346487309 shutdown_connections 2023-11-28T12:06:35.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.038+0000 7fa8e2bff700 1 --2- 172.21.15.45:0/346487309 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa8dc0b20b0 0x7fa8dc0b0dd0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:35.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.038+0000 7fa8e2bff700 1 -- 172.21.15.45:0/346487309 >> 172.21.15.45:0/346487309 conn(0x7fa8dc09c3f0 msgr2=0x7fa8dc0d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:35.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.038+0000 7fa8e2bff700 1 -- 172.21.15.45:0/346487309 shutdown_connections 2023-11-28T12:06:35.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.038+0000 7fa8e2bff700 1 -- 172.21.15.45:0/346487309 wait complete. 2023-11-28T12:06:35.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.040+0000 7fa8e2bff700 1 Processor -- start 2023-11-28T12:06:35.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.040+0000 7fa8e2bff700 1 -- start start 2023-11-28T12:06:35.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.041+0000 7fa8e2bff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa8dc0b20b0 0x7fa8dc1f5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:35.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.041+0000 7fa8e2bff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa8dc0d01b0 0x7fa8dc1f59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:35.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.041+0000 7fa8e2bff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8dc0d1330 0x7fa8dc0cb300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:35.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.041+0000 7fa8e2bff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8dc0cc080 con 0x7fa8dc0d1330 2023-11-28T12:06:35.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.041+0000 7fa8e2bff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8dc1f3030 con 0x7fa8dc0b20b0 2023-11-28T12:06:35.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.041+0000 7fa8e2bff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8dc1f3240 con 0x7fa8dc0d01b0 2023-11-28T12:06:35.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.042+0000 7fa8e119c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8dc0d1330 0x7fa8dc0cb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:35.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.042+0000 7fa8dbfff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa8dc0d01b0 0x7fa8dc1f59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:35.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.042+0000 7fa8e099b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa8dc0b20b0 0x7fa8dc1f5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:35.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.042+0000 7fa8dbfff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa8dc0d01b0 0x7fa8dc1f59a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.45:53568/0 (socket says 172.21.15.45:53568) 2023-11-28T12:06:35.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.042+0000 7fa8dbfff700 1 -- 172.21.15.45:0/4145858598 learned_addr learned my addr 172.21.15.45:0/4145858598 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:35.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.042+0000 7fa8dbfff700 1 -- 172.21.15.45:0/4145858598 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa8dc0b20b0 msgr2=0x7fa8dc1f5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:35.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.042+0000 7fa8dbfff700 1 --2- 172.21.15.45:0/4145858598 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa8dc0b20b0 0x7fa8dc1f5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:35.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.042+0000 7fa8dbfff700 1 -- 172.21.15.45:0/4145858598 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8dc0d1330 msgr2=0x7fa8dc0cb300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:35.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.042+0000 7fa8dbfff700 1 --2- 172.21.15.45:0/4145858598 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8dc0d1330 0x7fa8dc0cb300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:35.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.042+0000 7fa8dbfff700 1 -- 172.21.15.45:0/4145858598 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8d4009a70 con 0x7fa8dc0d01b0 2023-11-28T12:06:35.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.042+0000 7fa8e119c700 1 --2- 172.21.15.45:0/4145858598 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8dc0d1330 0x7fa8dc0cb300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:06:35.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.042+0000 7fa8dbfff700 1 --2- 172.21.15.45:0/4145858598 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa8dc0d01b0 0x7fa8dc1f59a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa8c800c450 tx=0x7fa8c800c760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:35.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.043+0000 7fa8d97fa700 1 -- 172.21.15.45:0/4145858598 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c80052d0 con 0x7fa8dc0d01b0 2023-11-28T12:06:35.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.043+0000 7fa8d97fa700 1 -- 172.21.15.45:0/4145858598 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8c8005430 con 0x7fa8dc0d01b0 2023-11-28T12:06:35.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.043+0000 7fa8e2bff700 1 -- 172.21.15.45:0/4145858598 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8dc0afec0 con 0x7fa8dc0d01b0 2023-11-28T12:06:35.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.043+0000 7fa8d97fa700 1 -- 172.21.15.45:0/4145858598 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c80038c0 con 0x7fa8dc0d01b0 2023-11-28T12:06:35.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.043+0000 7fa8e2bff700 1 -- 172.21.15.45:0/4145858598 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8dc0afbe0 con 0x7fa8dc0d01b0 2023-11-28T12:06:35.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.044+0000 7fa8e2bff700 1 -- 172.21.15.45:0/4145858598 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8dc0b2600 con 0x7fa8dc0d01b0 2023-11-28T12:06:35.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.045+0000 7fa8d97fa700 1 -- 172.21.15.45:0/4145858598 <== mon.2 v2:172.21.15.152:3301/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fa8c8019030 con 0x7fa8dc0d01b0 2023-11-28T12:06:35.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.046+0000 7fa8d97fa700 1 --2- 172.21.15.45:0/4145858598 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fa8c00682f0 0x7fa8c006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:35.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.046+0000 7fa8d97fa700 1 -- 172.21.15.45:0/4145858598 <== mon.2 v2:172.21.15.152:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa8c8084fc0 con 0x7fa8dc0d01b0 2023-11-28T12:06:35.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.046+0000 7fa8e099b700 1 --2- 172.21.15.45:0/4145858598 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fa8c00682f0 0x7fa8c006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:35.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.047+0000 7fa8e099b700 1 --2- 172.21.15.45:0/4145858598 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fa8c00682f0 0x7fa8c006a7a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa8d0007fd0 tx=0x7fa8d0007de0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:35.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.051+0000 7fa8d97fa700 1 -- 172.21.15.45:0/4145858598 <== mon.2 v2:172.21.15.152:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fa8c80517f0 con 0x7fa8dc0d01b0 2023-11-28T12:06:35.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.309+0000 7fa8e2bff700 1 -- 172.21.15.45:0/4145858598 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fa8dc068690 con 0x7fa8dc0d01b0 2023-11-28T12:06:35.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.313+0000 7fa8d97fa700 1 -- 172.21.15.45:0/4145858598 <== mon.2 v2:172.21.15.152:3301/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+166385 (secure 0 0 0) 0x7fa8c800ce60 con 0x7fa8dc0d01b0 2023-11-28T12:06:35.315 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:06:35.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.316+0000 7fa8e2bff700 1 -- 172.21.15.45:0/4145858598 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fa8c00682f0 msgr2=0x7fa8c006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:35.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.316+0000 7fa8e2bff700 1 --2- 172.21.15.45:0/4145858598 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fa8c00682f0 0x7fa8c006a7a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa8d0007fd0 tx=0x7fa8d0007de0 comp rx=0 tx=0).stop 2023-11-28T12:06:35.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.316+0000 7fa8e2bff700 1 -- 172.21.15.45:0/4145858598 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa8dc0d01b0 msgr2=0x7fa8dc1f59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:35.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.316+0000 7fa8e2bff700 1 --2- 172.21.15.45:0/4145858598 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa8dc0d01b0 0x7fa8dc1f59a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa8c800c450 tx=0x7fa8c800c760 comp rx=0 tx=0).stop 2023-11-28T12:06:35.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.316+0000 7fa8e2bff700 1 -- 172.21.15.45:0/4145858598 shutdown_connections 2023-11-28T12:06:35.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.316+0000 7fa8e2bff700 1 --2- 172.21.15.45:0/4145858598 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fa8c00682f0 0x7fa8c006a7a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:35.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.316+0000 7fa8e2bff700 1 --2- 172.21.15.45:0/4145858598 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa8dc0b20b0 0x7fa8dc1f5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:35.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.316+0000 7fa8e2bff700 1 --2- 172.21.15.45:0/4145858598 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8dc0d1330 0x7fa8dc0cb300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:35.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.316+0000 7fa8e2bff700 1 --2- 172.21.15.45:0/4145858598 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa8dc0d01b0 0x7fa8dc1f59a0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:35.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.316+0000 7fa8e2bff700 1 -- 172.21.15.45:0/4145858598 >> 172.21.15.45:0/4145858598 conn(0x7fa8dc09c3f0 msgr2=0x7fa8dc15c370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:35.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.316+0000 7fa8e2bff700 1 -- 172.21.15.45:0/4145858598 shutdown_connections 2023-11-28T12:06:35.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.316+0000 7fa8e2bff700 1 -- 172.21.15.45:0/4145858598 wait complete. 2023-11-28T12:06:35.335 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":5,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":115389},{"type":"v1","addr":"172.21.15.152:6833","nonce":115389}]},"active_addr":"172.21.15.152:6833/115389","active_change":"2023-11-28T12:06:16.410781+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4110,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.152:0","nonce":319301867}]},{"addrvec":[{"type":"v2","addr":"172.21.15.152:0","nonce":2007828951}]},{"addrvec":[{"type":"v2","addr":"172.21.15.152:0","nonce":3736762491}]},{"addrvec":[{"type":"v2","addr":"172.21.15.152:0","nonce":1939559562}]}]} 2023-11-28T12:06:35.338 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-11-28T12:06:35.339 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-11-28T12:06:35.339 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T12:06:35.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.541+0000 7f4a365ff700 1 Processor -- start 2023-11-28T12:06:35.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.541+0000 7f4a365ff700 1 -- start start 2023-11-28T12:06:35.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.542+0000 7f4a365ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f4a300d1330 0x7f4a300b06c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:35.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.542+0000 7f4a365ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4a300b20b0 0x7f4a300b0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:35.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.542+0000 7f4a365ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a300b0230 con 0x7f4a300d01b0 2023-11-28T12:06:35.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.542+0000 7f4a365ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a3015cec0 con 0x7f4a300d1330 2023-11-28T12:06:35.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.542+0000 7f4a365ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a300b4570 con 0x7f4a300b20b0 2023-11-28T12:06:35.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.543+0000 7f4a2f7fe700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f4a300d1330 0x7f4a300b06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:35.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.543+0000 7f4a34b9c700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4a300b20b0 0x7f4a300b0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:35.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.543+0000 7f4a2f7fe700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f4a300d1330 0x7f4a300b06c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.45:44430/0 (socket says 172.21.15.45:44430) 2023-11-28T12:06:35.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.543+0000 7f4a2f7fe700 1 -- 172.21.15.45:0/783749797 learned_addr learned my addr 172.21.15.45:0/783749797 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:35.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.543+0000 7f4a2f7fe700 1 -- 172.21.15.45:0/783749797 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4a300b20b0 msgr2=0x7f4a300b0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:06:35.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.543+0000 7f4a2f7fe700 1 --2- 172.21.15.45:0/783749797 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4a300b20b0 0x7f4a300b0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:35.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.543+0000 7f4a2f7fe700 1 -- 172.21.15.45:0/783749797 >> v1:172.21.15.152:6789/0 conn(0x7f4a300d01b0 legacy=0x7f4a300d0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:35.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.543+0000 7f4a2f7fe700 1 -- 172.21.15.45:0/783749797 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a300b4850 con 0x7f4a300d1330 2023-11-28T12:06:35.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.543+0000 7f4a34b9c700 1 --2- 172.21.15.45:0/783749797 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4a300b20b0 0x7f4a300b0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:06:35.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.543+0000 7f4a2f7fe700 1 --2- 172.21.15.45:0/783749797 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4a300d1330 0x7f4a300b06c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4a240098f0 tx=0x7f4a24009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd7574dedec4b4fd server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:35.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.544+0000 7f4a2effd700 1 -- 172.21.15.45:0/783749797 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a24011830 con 0x7f4a300d1330 2023-11-28T12:06:35.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.544+0000 7f4a2effd700 1 -- 172.21.15.45:0/783749797 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a24011990 con 0x7f4a300d1330 2023-11-28T12:06:35.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.544+0000 7f4a2effd700 1 -- 172.21.15.45:0/783749797 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a24011d20 con 0x7f4a300d1330 2023-11-28T12:06:35.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.544+0000 7f4a365ff700 1 -- 172.21.15.45:0/783749797 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4a300d1330 msgr2=0x7f4a300b06c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:35.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.544+0000 7f4a365ff700 1 --2- 172.21.15.45:0/783749797 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4a300d1330 0x7f4a300b06c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4a240098f0 tx=0x7f4a24009c00 comp rx=0 tx=0).stop 2023-11-28T12:06:35.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.544+0000 7f4a365ff700 1 -- 172.21.15.45:0/783749797 shutdown_connections 2023-11-28T12:06:35.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.544+0000 7f4a365ff700 1 --2- 172.21.15.45:0/783749797 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4a300b20b0 0x7f4a300b0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:35.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.544+0000 7f4a365ff700 1 --2- 172.21.15.45:0/783749797 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4a300d1330 0x7f4a300b06c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:35.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.544+0000 7f4a365ff700 1 -- 172.21.15.45:0/783749797 >> 172.21.15.45:0/783749797 conn(0x7f4a3009c3f0 msgr2=0x7f4a300d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:35.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.544+0000 7f4a365ff700 1 -- 172.21.15.45:0/783749797 shutdown_connections 2023-11-28T12:06:35.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.544+0000 7f4a365ff700 1 -- 172.21.15.45:0/783749797 wait complete. 2023-11-28T12:06:35.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.546+0000 7f4a365ff700 1 Processor -- start 2023-11-28T12:06:35.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.546+0000 7f4a365ff700 1 -- start start 2023-11-28T12:06:35.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.547+0000 7f4a365ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4a300b20b0 0x7f4a3015ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:35.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.547+0000 7f4a365ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4a300d01b0 0x7f4a300cba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:35.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.547+0000 7f4a365ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a300d1330 0x7f4a300ce4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:35.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.547+0000 7f4a365ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a300caae0 con 0x7f4a300d1330 2023-11-28T12:06:35.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.547+0000 7f4a365ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a3015f3f0 con 0x7f4a300d01b0 2023-11-28T12:06:35.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.547+0000 7f4a365ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a300cacd0 con 0x7f4a300b20b0 2023-11-28T12:06:35.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.548+0000 7f4a2ffff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4a300b20b0 0x7f4a3015ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:35.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.548+0000 7f4a34b9c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a300d1330 0x7f4a300ce4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:35.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.548+0000 7f4a2ffff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4a300b20b0 0x7f4a3015ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.45:53578/0 (socket says 172.21.15.45:53578) 2023-11-28T12:06:35.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.548+0000 7f4a2ffff700 1 -- 172.21.15.45:0/3956450984 learned_addr learned my addr 172.21.15.45:0/3956450984 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:35.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.548+0000 7f4a2f7fe700 1 --2- 172.21.15.45:0/3956450984 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4a300d01b0 0x7f4a300cba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:35.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.548+0000 7f4a34b9c700 1 -- 172.21.15.45:0/3956450984 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4a300b20b0 msgr2=0x7f4a3015ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:35.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.548+0000 7f4a34b9c700 1 --2- 172.21.15.45:0/3956450984 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4a300b20b0 0x7f4a3015ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:35.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.548+0000 7f4a34b9c700 1 -- 172.21.15.45:0/3956450984 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4a300d01b0 msgr2=0x7f4a300cba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:35.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.548+0000 7f4a34b9c700 1 --2- 172.21.15.45:0/3956450984 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4a300d01b0 0x7f4a300cba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:35.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.548+0000 7f4a34b9c700 1 -- 172.21.15.45:0/3956450984 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a28009a70 con 0x7f4a300d1330 2023-11-28T12:06:35.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.548+0000 7f4a2ffff700 1 --2- 172.21.15.45:0/3956450984 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4a300b20b0 0x7f4a3015ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:06:35.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.548+0000 7f4a34b9c700 1 --2- 172.21.15.45:0/3956450984 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a300d1330 0x7f4a300ce4e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4a2800ef90 tx=0x7f4a2800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:35.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.548+0000 7f4a2cff9700 1 -- 172.21.15.45:0/3956450984 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a2800ca30 con 0x7f4a300d1330 2023-11-28T12:06:35.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.549+0000 7f4a2cff9700 1 -- 172.21.15.45:0/3956450984 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a2800f040 con 0x7f4a300d1330 2023-11-28T12:06:35.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.549+0000 7f4a365ff700 1 -- 172.21.15.45:0/3956450984 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a24009550 con 0x7f4a300d1330 2023-11-28T12:06:35.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.549+0000 7f4a2cff9700 1 -- 172.21.15.45:0/3956450984 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a2800cdd0 con 0x7f4a300d1330 2023-11-28T12:06:35.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.549+0000 7f4a365ff700 1 -- 172.21.15.45:0/3956450984 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a300afec0 con 0x7f4a300d1330 2023-11-28T12:06:35.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.550+0000 7f4a365ff700 1 -- 172.21.15.45:0/3956450984 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a300afbe0 con 0x7f4a300d1330 2023-11-28T12:06:35.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.551+0000 7f4a2cff9700 1 -- 172.21.15.45:0/3956450984 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f4a28014480 con 0x7f4a300d1330 2023-11-28T12:06:35.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.551+0000 7f4a2cff9700 1 --2- 172.21.15.45:0/3956450984 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f4a1c0682f0 0x7f4a1c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:35.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.552+0000 7f4a2cff9700 1 -- 172.21.15.45:0/3956450984 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4a28086400 con 0x7f4a300d1330 2023-11-28T12:06:35.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.552+0000 7f4a2ffff700 1 --2- 172.21.15.45:0/3956450984 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f4a1c0682f0 0x7f4a1c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:35.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.553+0000 7f4a2ffff700 1 --2- 172.21.15.45:0/3956450984 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f4a1c0682f0 0x7f4a1c06a7a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4a20001d10 tx=0x7f4a20009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:35.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.555+0000 7f4a2cff9700 1 -- 172.21.15.45:0/3956450984 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f4a28052b10 con 0x7f4a300d1330 2023-11-28T12:06:35.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.759+0000 7f4a365ff700 1 -- 172.21.15.45:0/3956450984 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4a300b2600 con 0x7f4a300d1330 2023-11-28T12:06:35.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.760+0000 7f4a2cff9700 1 -- 172.21.15.45:0/3956450984 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+17849 (secure 0 0 0) 0x7f4a28009cc0 con 0x7f4a300d1330 2023-11-28T12:06:35.761 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:06:35.761 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":20,"fsid":"bd7c37f1-f7c6-4778-b845-52cf2aa6e366","created":"2023-11-28T12:06:09.045075+0000","modified":"2023-11-28T12:06:30.396046+0000","last_up_change":"2023-11-28T12:06:21.282227+0000","last_in_change":"2023-11-28T12:06:12.560924+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T12:06:21.807108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T12:06:22.491009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T12:06:27.684157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T12:06:28.384679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d0cdd8a-87fd-4f2c-91bd-47bdfa661905","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":115843},{"type":"v1","addr":"172.21.15.45:6808","nonce":115843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":115843},{"type":"v1","addr":"172.21.15.45:6811","nonce":115843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":115843},{"type":"v1","addr":"172.21.15.45:6815","nonce":115843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":115843},{"type":"v1","addr":"172.21.15.45:6813","nonce":115843}]},"public_addr":"172.21.15.45:6808/115843","cluster_addr":"172.21.15.45:6811/115843","heartbeat_back_addr":"172.21.15.45:6815/115843","heartbeat_front_addr":"172.21.15.45:6813/115843","state":["exists","up"]},{"osd":1,"uuid":"c5de4ebd-9ec5-40b3-9caa-9b706fab4c76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":115842},{"type":"v1","addr":"172.21.15.45:6801","nonce":115842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":115842},{"type":"v1","addr":"172.21.15.45:6803","nonce":115842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6807","nonce":115842},{"type":"v1","addr":"172.21.15.45:6809","nonce":115842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":115842},{"type":"v1","addr":"172.21.15.45:6805","nonce":115842}]},"public_addr":"172.21.15.45:6801/115842","cluster_addr":"172.21.15.45:6803/115842","heartbeat_back_addr":"172.21.15.45:6809/115842","heartbeat_front_addr":"172.21.15.45:6805/115842","state":["exists","up"]},{"osd":2,"uuid":"9f4b36b2-65d2-40e7-9fe6-a2991afa71c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":115850},{"type":"v1","addr":"172.21.15.45:6819","nonce":115850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":115850},{"type":"v1","addr":"172.21.15.45:6823","nonce":115850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":115850},{"type":"v1","addr":"172.21.15.45:6831","nonce":115850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":115850},{"type":"v1","addr":"172.21.15.45:6828","nonce":115850}]},"public_addr":"172.21.15.45:6819/115850","cluster_addr":"172.21.15.45:6823/115850","heartbeat_back_addr":"172.21.15.45:6831/115850","heartbeat_front_addr":"172.21.15.45:6828/115850","state":["exists","up"]},{"osd":3,"uuid":"6fe7ef05-4e0d-426c-bf94-44b51d4d550b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":115848},{"type":"v1","addr":"172.21.15.45:6818","nonce":115848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":115848},{"type":"v1","addr":"172.21.15.45:6822","nonce":115848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6827","nonce":115848},{"type":"v1","addr":"172.21.15.45:6829","nonce":115848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":115848},{"type":"v1","addr":"172.21.15.45:6825","nonce":115848}]},"public_addr":"172.21.15.45:6818/115848","cluster_addr":"172.21.15.45:6822/115848","heartbeat_back_addr":"172.21.15.45:6829/115848","heartbeat_front_addr":"172.21.15.45:6825/115848","state":["exists","up"]},{"osd":4,"uuid":"fa403c08-d8a1-4a3a-8384-cb465c1a654c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":116092},{"type":"v1","addr":"172.21.15.152:6801","nonce":116092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":116092},{"type":"v1","addr":"172.21.15.152:6803","nonce":116092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":116092},{"type":"v1","addr":"172.21.15.152:6807","nonce":116092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":116092},{"type":"v1","addr":"172.21.15.152:6805","nonce":116092}]},"public_addr":"172.21.15.152:6801/116092","cluster_addr":"172.21.15.152:6803/116092","heartbeat_back_addr":"172.21.15.152:6807/116092","heartbeat_front_addr":"172.21.15.152:6805/116092","state":["exists","up"]},{"osd":5,"uuid":"399fc450-39fa-43a6-bf80-0b8bcb41bd95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6815","nonce":116093},{"type":"v1","addr":"172.21.15.152:6817","nonce":116093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":116093},{"type":"v1","addr":"172.21.15.152:6819","nonce":116093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":116093},{"type":"v1","addr":"172.21.15.152:6823","nonce":116093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":116093},{"type":"v1","addr":"172.21.15.152:6821","nonce":116093}]},"public_addr":"172.21.15.152:6817/116093","cluster_addr":"172.21.15.152:6819/116093","heartbeat_back_addr":"172.21.15.152:6823/116093","heartbeat_front_addr":"172.21.15.152:6821/116093","state":["exists","up"]},{"osd":6,"uuid":"e59a4017-2d23-4627-836b-e25b2d3ddaaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":116094},{"type":"v1","addr":"172.21.15.152:6809","nonce":116094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":116094},{"type":"v1","addr":"172.21.15.152:6811","nonce":116094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":116094},{"type":"v1","addr":"172.21.15.152:6816","nonce":116094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":116094},{"type":"v1","addr":"172.21.15.152:6813","nonce":116094}]},"public_addr":"172.21.15.152:6809/116094","cluster_addr":"172.21.15.152:6811/116094","heartbeat_back_addr":"172.21.15.152:6816/116094","heartbeat_front_addr":"172.21.15.152:6813/116094","state":["exists","up"]},{"osd":7,"uuid":"8d7f9d4b-bf08-4670-8591-388c0f012a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":116097},{"type":"v1","addr":"172.21.15.152:6825","nonce":116097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":116097},{"type":"v1","addr":"172.21.15.152:6827","nonce":116097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":116097},{"type":"v1","addr":"172.21.15.152:6831","nonce":116097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":116097},{"type":"v1","addr":"172.21.15.152:6829","nonce":116097}]},"public_addr":"172.21.15.152:6825/116097","cluster_addr":"172.21.15.152:6827/116097","heartbeat_back_addr":"172.21.15.152:6831/116097","heartbeat_front_addr":"172.21.15.152:6829/116097","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.937710+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.865423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.159434+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.913090+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.131647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.966255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.972583+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.177209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T12:06:35.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.762+0000 7f4a365ff700 1 -- 172.21.15.45:0/3956450984 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f4a1c0682f0 msgr2=0x7f4a1c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:35.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.762+0000 7f4a365ff700 1 --2- 172.21.15.45:0/3956450984 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f4a1c0682f0 0x7f4a1c06a7a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4a20001d10 tx=0x7f4a20009040 comp rx=0 tx=0).stop 2023-11-28T12:06:35.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.762+0000 7f4a365ff700 1 -- 172.21.15.45:0/3956450984 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a300d1330 msgr2=0x7f4a300ce4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:35.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.763+0000 7f4a365ff700 1 --2- 172.21.15.45:0/3956450984 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a300d1330 0x7f4a300ce4e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4a2800ef90 tx=0x7f4a2800c3a0 comp rx=0 tx=0).stop 2023-11-28T12:06:35.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.763+0000 7f4a365ff700 1 -- 172.21.15.45:0/3956450984 shutdown_connections 2023-11-28T12:06:35.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.763+0000 7f4a365ff700 1 --2- 172.21.15.45:0/3956450984 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f4a1c0682f0 0x7f4a1c06a7a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:35.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.763+0000 7f4a365ff700 1 --2- 172.21.15.45:0/3956450984 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a300d1330 0x7f4a300ce4e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:35.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.763+0000 7f4a365ff700 1 --2- 172.21.15.45:0/3956450984 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4a300b20b0 0x7f4a3015ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:35.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.763+0000 7f4a365ff700 1 --2- 172.21.15.45:0/3956450984 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4a300d01b0 0x7f4a300cba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:35.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.763+0000 7f4a365ff700 1 -- 172.21.15.45:0/3956450984 >> 172.21.15.45:0/3956450984 conn(0x7f4a3009c3f0 msgr2=0x7f4a3015c400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:35.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.763+0000 7f4a365ff700 1 -- 172.21.15.45:0/3956450984 shutdown_connections 2023-11-28T12:06:35.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.763+0000 7f4a365ff700 1 -- 172.21.15.45:0/3956450984 wait complete. 2023-11-28T12:06:35.782 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-11-28T12:06:35.782 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T12:06:35.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.985+0000 7f9db41ff700 1 Processor -- start 2023-11-28T12:06:35.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.985+0000 7f9db41ff700 1 -- start start 2023-11-28T12:06:35.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.986+0000 7f9db41ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9dac15c9b0 0x7f9dac0b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:35.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.987+0000 7f9db41ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dac0d1950 con 0x7f9dac0cd7c0 2023-11-28T12:06:35.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.987+0000 7f9db41ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dac0d24f0 con 0x7f9dac161340 2023-11-28T12:06:35.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.987+0000 7f9db41ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dac0b5800 con 0x7f9dac15c9b0 2023-11-28T12:06:35.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.987+0000 7f9db279c700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f9dac0cd7c0 0x7f9dac0b5fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:60958/0 (socket says 172.21.15.45:60958) 2023-11-28T12:06:35.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.987+0000 7f9db279c700 1 -- 172.21.15.45:0/389175035 learned_addr learned my addr 172.21.15.45:0/389175035 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:06:35.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.987+0000 7f9db1f9b700 1 --2- 172.21.15.45:0/389175035 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9dac15c9b0 0x7f9dac0b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:35.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.987+0000 7f9db0f99700 1 -- 172.21.15.45:0/389175035 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2375492672 0 0) 0x7f9dac0d1950 con 0x7f9dac0cd7c0 2023-11-28T12:06:35.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.987+0000 7f9db0f99700 1 -- 172.21.15.45:0/389175035 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d980035b0 con 0x7f9dac0cd7c0 2023-11-28T12:06:35.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.987+0000 7f9db0f99700 1 -- 172.21.15.45:0/389175035 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3487908794 0 0) 0x7f9dac0d24f0 con 0x7f9dac161340 2023-11-28T12:06:35.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.987+0000 7f9db0f99700 1 -- 172.21.15.45:0/389175035 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9dac0d1950 con 0x7f9dac161340 2023-11-28T12:06:35.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.987+0000 7f9db1f9b700 1 -- 172.21.15.45:0/389175035 >> v1:172.21.15.152:6789/0 conn(0x7f9dac161340 legacy=0x7f9dac0d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:35.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.987+0000 7f9db1f9b700 1 -- 172.21.15.45:0/389175035 >> v1:172.21.15.45:6789/0 conn(0x7f9dac0cd7c0 legacy=0x7f9dac0b5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:35.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.988+0000 7f9db1f9b700 1 -- 172.21.15.45:0/389175035 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dac0b5520 con 0x7f9dac15c9b0 2023-11-28T12:06:35.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.988+0000 7f9db1f9b700 1 --2- 172.21.15.45:0/389175035 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9dac15c9b0 0x7f9dac0b4bf0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9da8009870 tx=0x7f9da8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=96e1f66f3e6eb10b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:35.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.988+0000 7f9db0f99700 1 -- 172.21.15.45:0/389175035 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da8011830 con 0x7f9dac15c9b0 2023-11-28T12:06:35.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.988+0000 7f9db0f99700 1 -- 172.21.15.45:0/389175035 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9da8011990 con 0x7f9dac15c9b0 2023-11-28T12:06:35.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.988+0000 7f9db0f99700 1 -- 172.21.15.45:0/389175035 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da8011d20 con 0x7f9dac15c9b0 2023-11-28T12:06:35.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.989+0000 7f9db41ff700 1 -- 172.21.15.45:0/389175035 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9dac15c9b0 msgr2=0x7f9dac0b4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:35.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.989+0000 7f9db41ff700 1 --2- 172.21.15.45:0/389175035 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9dac15c9b0 0x7f9dac0b4bf0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9da8009870 tx=0x7f9da8009b80 comp rx=0 tx=0).stop 2023-11-28T12:06:35.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.989+0000 7f9db41ff700 1 -- 172.21.15.45:0/389175035 shutdown_connections 2023-11-28T12:06:35.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.989+0000 7f9db41ff700 1 --2- 172.21.15.45:0/389175035 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9dac15c9b0 0x7f9dac0b4bf0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:35.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.989+0000 7f9db41ff700 1 -- 172.21.15.45:0/389175035 >> 172.21.15.45:0/389175035 conn(0x7f9dac072600 msgr2=0x7f9dac0cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:35.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.989+0000 7f9db41ff700 1 -- 172.21.15.45:0/389175035 shutdown_connections 2023-11-28T12:06:35.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.989+0000 7f9db41ff700 1 -- 172.21.15.45:0/389175035 wait complete. 2023-11-28T12:06:35.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.991+0000 7f9db41ff700 1 Processor -- start 2023-11-28T12:06:35.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.991+0000 7f9db41ff700 1 -- start start 2023-11-28T12:06:35.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.992+0000 7f9db41ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9dac0cd7c0 0x7f9dac1579e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:35.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.992+0000 7f9db41ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9dac15c9b0 0x7f9dac1f3e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:35.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.992+0000 7f9db41ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9dac161340 0x7f9dac1e6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:35.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.992+0000 7f9db41ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dac157f20 con 0x7f9dac15c9b0 2023-11-28T12:06:35.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.992+0000 7f9db41ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dac1f4370 con 0x7f9dac0cd7c0 2023-11-28T12:06:35.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.992+0000 7f9db41ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dac0c8b90 con 0x7f9dac161340 2023-11-28T12:06:35.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.992+0000 7f9db179a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9dac15c9b0 0x7f9dac1f3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:35.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.992+0000 7f9db179a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9dac15c9b0 0x7f9dac1f3e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35798/0 (socket says 172.21.15.45:35798) 2023-11-28T12:06:35.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.992+0000 7f9db179a700 1 -- 172.21.15.45:0/381836343 learned_addr learned my addr 172.21.15.45:0/381836343 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:35.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.992+0000 7f9db1f9b700 1 --2- 172.21.15.45:0/381836343 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9dac0cd7c0 0x7f9dac1579e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:35.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.992+0000 7f9db279c700 1 --2- 172.21.15.45:0/381836343 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9dac161340 0x7f9dac1e6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:35.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.992+0000 7f9db179a700 1 -- 172.21.15.45:0/381836343 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9dac161340 msgr2=0x7f9dac1e6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:35.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.992+0000 7f9db179a700 1 --2- 172.21.15.45:0/381836343 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9dac161340 0x7f9dac1e6440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:35.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.992+0000 7f9db179a700 1 -- 172.21.15.45:0/381836343 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9dac0cd7c0 msgr2=0x7f9dac1579e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:35.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.992+0000 7f9db179a700 1 --2- 172.21.15.45:0/381836343 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9dac0cd7c0 0x7f9dac1579e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:35.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.992+0000 7f9db179a700 1 -- 172.21.15.45:0/381836343 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9da80094a0 con 0x7f9dac15c9b0 2023-11-28T12:06:35.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.993+0000 7f9db179a700 1 --2- 172.21.15.45:0/381836343 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9dac15c9b0 0x7f9dac1f3e30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c00c500 tx=0x7f9d9c00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:35.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.993+0000 7f9da27fc700 1 -- 172.21.15.45:0/381836343 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d9c0052d0 con 0x7f9dac15c9b0 2023-11-28T12:06:35.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.993+0000 7f9da27fc700 1 -- 172.21.15.45:0/381836343 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d9c005450 con 0x7f9dac15c9b0 2023-11-28T12:06:35.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.993+0000 7f9da27fc700 1 -- 172.21.15.45:0/381836343 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d9c0038c0 con 0x7f9dac15c9b0 2023-11-28T12:06:35.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.993+0000 7f9db41ff700 1 -- 172.21.15.45:0/381836343 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dac0d15e0 con 0x7f9dac15c9b0 2023-11-28T12:06:35.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.993+0000 7f9db41ff700 1 -- 172.21.15.45:0/381836343 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dac0d1300 con 0x7f9dac15c9b0 2023-11-28T12:06:35.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.994+0000 7f9db41ff700 1 -- 172.21.15.45:0/381836343 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dac0b5130 con 0x7f9dac15c9b0 2023-11-28T12:06:35.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.995+0000 7f9da27fc700 1 -- 172.21.15.45:0/381836343 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f9d9c019030 con 0x7f9dac15c9b0 2023-11-28T12:06:35.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.996+0000 7f9da27fc700 1 --2- 172.21.15.45:0/381836343 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f9d900682f0 0x7f9d9006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:35.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.996+0000 7f9da27fc700 1 -- 172.21.15.45:0/381836343 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9d9c084fe0 con 0x7f9dac15c9b0 2023-11-28T12:06:35.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.996+0000 7f9db1f9b700 1 --2- 172.21.15.45:0/381836343 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f9d900682f0 0x7f9d9006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:35.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:35.997+0000 7f9db1f9b700 1 --2- 172.21.15.45:0/381836343 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f9d900682f0 0x7f9d9006a7a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9da80097c0 tx=0x7f9da801c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:36.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.000+0000 7f9da27fc700 1 -- 172.21.15.45:0/381836343 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f9d9c0517b0 con 0x7f9dac15c9b0 2023-11-28T12:06:36.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.204+0000 7f9db41ff700 1 -- 172.21.15.45:0/381836343 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9dac0745c0 con 0x7f9dac15c9b0 2023-11-28T12:06:36.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.205+0000 7f9da27fc700 1 -- 172.21.15.45:0/381836343 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+17849 (secure 0 0 0) 0x7f9d9c017090 con 0x7f9dac15c9b0 2023-11-28T12:06:36.206 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:06:36.206 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":20,"fsid":"bd7c37f1-f7c6-4778-b845-52cf2aa6e366","created":"2023-11-28T12:06:09.045075+0000","modified":"2023-11-28T12:06:30.396046+0000","last_up_change":"2023-11-28T12:06:21.282227+0000","last_in_change":"2023-11-28T12:06:12.560924+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T12:06:21.807108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T12:06:22.491009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T12:06:27.684157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T12:06:28.384679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d0cdd8a-87fd-4f2c-91bd-47bdfa661905","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":115843},{"type":"v1","addr":"172.21.15.45:6808","nonce":115843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":115843},{"type":"v1","addr":"172.21.15.45:6811","nonce":115843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":115843},{"type":"v1","addr":"172.21.15.45:6815","nonce":115843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":115843},{"type":"v1","addr":"172.21.15.45:6813","nonce":115843}]},"public_addr":"172.21.15.45:6808/115843","cluster_addr":"172.21.15.45:6811/115843","heartbeat_back_addr":"172.21.15.45:6815/115843","heartbeat_front_addr":"172.21.15.45:6813/115843","state":["exists","up"]},{"osd":1,"uuid":"c5de4ebd-9ec5-40b3-9caa-9b706fab4c76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":115842},{"type":"v1","addr":"172.21.15.45:6801","nonce":115842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":115842},{"type":"v1","addr":"172.21.15.45:6803","nonce":115842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6807","nonce":115842},{"type":"v1","addr":"172.21.15.45:6809","nonce":115842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":115842},{"type":"v1","addr":"172.21.15.45:6805","nonce":115842}]},"public_addr":"172.21.15.45:6801/115842","cluster_addr":"172.21.15.45:6803/115842","heartbeat_back_addr":"172.21.15.45:6809/115842","heartbeat_front_addr":"172.21.15.45:6805/115842","state":["exists","up"]},{"osd":2,"uuid":"9f4b36b2-65d2-40e7-9fe6-a2991afa71c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":115850},{"type":"v1","addr":"172.21.15.45:6819","nonce":115850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":115850},{"type":"v1","addr":"172.21.15.45:6823","nonce":115850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":115850},{"type":"v1","addr":"172.21.15.45:6831","nonce":115850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":115850},{"type":"v1","addr":"172.21.15.45:6828","nonce":115850}]},"public_addr":"172.21.15.45:6819/115850","cluster_addr":"172.21.15.45:6823/115850","heartbeat_back_addr":"172.21.15.45:6831/115850","heartbeat_front_addr":"172.21.15.45:6828/115850","state":["exists","up"]},{"osd":3,"uuid":"6fe7ef05-4e0d-426c-bf94-44b51d4d550b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":115848},{"type":"v1","addr":"172.21.15.45:6818","nonce":115848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":115848},{"type":"v1","addr":"172.21.15.45:6822","nonce":115848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6827","nonce":115848},{"type":"v1","addr":"172.21.15.45:6829","nonce":115848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":115848},{"type":"v1","addr":"172.21.15.45:6825","nonce":115848}]},"public_addr":"172.21.15.45:6818/115848","cluster_addr":"172.21.15.45:6822/115848","heartbeat_back_addr":"172.21.15.45:6829/115848","heartbeat_front_addr":"172.21.15.45:6825/115848","state":["exists","up"]},{"osd":4,"uuid":"fa403c08-d8a1-4a3a-8384-cb465c1a654c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":116092},{"type":"v1","addr":"172.21.15.152:6801","nonce":116092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":116092},{"type":"v1","addr":"172.21.15.152:6803","nonce":116092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":116092},{"type":"v1","addr":"172.21.15.152:6807","nonce":116092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":116092},{"type":"v1","addr":"172.21.15.152:6805","nonce":116092}]},"public_addr":"172.21.15.152:6801/116092","cluster_addr":"172.21.15.152:6803/116092","heartbeat_back_addr":"172.21.15.152:6807/116092","heartbeat_front_addr":"172.21.15.152:6805/116092","state":["exists","up"]},{"osd":5,"uuid":"399fc450-39fa-43a6-bf80-0b8bcb41bd95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6815","nonce":116093},{"type":"v1","addr":"172.21.15.152:6817","nonce":116093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":116093},{"type":"v1","addr":"172.21.15.152:6819","nonce":116093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":116093},{"type":"v1","addr":"172.21.15.152:6823","nonce":116093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":116093},{"type":"v1","addr":"172.21.15.152:6821","nonce":116093}]},"public_addr":"172.21.15.152:6817/116093","cluster_addr":"172.21.15.152:6819/116093","heartbeat_back_addr":"172.21.15.152:6823/116093","heartbeat_front_addr":"172.21.15.152:6821/116093","state":["exists","up"]},{"osd":6,"uuid":"e59a4017-2d23-4627-836b-e25b2d3ddaaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":116094},{"type":"v1","addr":"172.21.15.152:6809","nonce":116094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":116094},{"type":"v1","addr":"172.21.15.152:6811","nonce":116094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":116094},{"type":"v1","addr":"172.21.15.152:6816","nonce":116094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":116094},{"type":"v1","addr":"172.21.15.152:6813","nonce":116094}]},"public_addr":"172.21.15.152:6809/116094","cluster_addr":"172.21.15.152:6811/116094","heartbeat_back_addr":"172.21.15.152:6816/116094","heartbeat_front_addr":"172.21.15.152:6813/116094","state":["exists","up"]},{"osd":7,"uuid":"8d7f9d4b-bf08-4670-8591-388c0f012a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":116097},{"type":"v1","addr":"172.21.15.152:6825","nonce":116097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":116097},{"type":"v1","addr":"172.21.15.152:6827","nonce":116097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":116097},{"type":"v1","addr":"172.21.15.152:6831","nonce":116097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":116097},{"type":"v1","addr":"172.21.15.152:6829","nonce":116097}]},"public_addr":"172.21.15.152:6825/116097","cluster_addr":"172.21.15.152:6827/116097","heartbeat_back_addr":"172.21.15.152:6831/116097","heartbeat_front_addr":"172.21.15.152:6829/116097","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.937710+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.865423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.159434+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.913090+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.131647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.966255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.972583+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.177209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T12:06:36.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.207+0000 7f9db41ff700 1 -- 172.21.15.45:0/381836343 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f9d900682f0 msgr2=0x7f9d9006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:36.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.207+0000 7f9db41ff700 1 --2- 172.21.15.45:0/381836343 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f9d900682f0 0x7f9d9006a7a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9da80097c0 tx=0x7f9da801c040 comp rx=0 tx=0).stop 2023-11-28T12:06:36.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.207+0000 7f9db41ff700 1 -- 172.21.15.45:0/381836343 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9dac15c9b0 msgr2=0x7f9dac1f3e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:36.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.207+0000 7f9db41ff700 1 --2- 172.21.15.45:0/381836343 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9dac15c9b0 0x7f9dac1f3e30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c00c500 tx=0x7f9d9c00c810 comp rx=0 tx=0).stop 2023-11-28T12:06:36.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.207+0000 7f9db41ff700 1 -- 172.21.15.45:0/381836343 shutdown_connections 2023-11-28T12:06:36.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.207+0000 7f9db41ff700 1 --2- 172.21.15.45:0/381836343 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f9d900682f0 0x7f9d9006a7a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:36.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.207+0000 7f9db41ff700 1 --2- 172.21.15.45:0/381836343 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9dac0cd7c0 0x7f9dac1579e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:36.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.207+0000 7f9db41ff700 1 --2- 172.21.15.45:0/381836343 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9dac161340 0x7f9dac1e6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:36.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.207+0000 7f9db41ff700 1 --2- 172.21.15.45:0/381836343 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9dac15c9b0 0x7f9dac1f3e30 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:36.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.207+0000 7f9db41ff700 1 -- 172.21.15.45:0/381836343 >> 172.21.15.45:0/381836343 conn(0x7f9dac072600 msgr2=0x7f9dac0b7160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:36.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.208+0000 7f9db41ff700 1 -- 172.21.15.45:0/381836343 shutdown_connections 2023-11-28T12:06:36.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.208+0000 7f9db41ff700 1 -- 172.21.15.45:0/381836343 wait complete. 2023-11-28T12:06:36.227 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-11-28T12:06:36.227 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-11-28T12:06:36.228 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-11-28T12:06:36.228 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-11-28T12:06:36.228 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-11-28T12:06:36.229 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-11-28T12:06:36.229 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-11-28T12:06:36.229 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-11-28T12:06:36.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.598+0000 7f86c85ff700 1 Processor -- start 2023-11-28T12:06:36.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.599+0000 7f86c85ff700 1 -- start start 2023-11-28T12:06:36.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.601+0000 7f86c85ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f86b80e4c30 0x7f86b8038820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:36.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.601+0000 7f86c85ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f86b8038d60 0x7f86b8054970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:36.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.601+0000 7f86c85ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86b80e0b80 con 0x7f86b803c720 2023-11-28T12:06:36.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.601+0000 7f86c85ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86b80e5180 con 0x7f86b80e4c30 2023-11-28T12:06:36.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.601+0000 7f86c85ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86b8056c60 con 0x7f86b8038d60 2023-11-28T12:06:36.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.601+0000 7f86c5b9a700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f86b80e4c30 0x7f86b8038820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:36.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.601+0000 7f86c5b9a700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f86b80e4c30 0x7f86b8038820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35808/0 (socket says 172.21.15.45:35808) 2023-11-28T12:06:36.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.601+0000 7f86c5b9a700 1 -- 172.21.15.45:0/2890529522 learned_addr learned my addr 172.21.15.45:0/2890529522 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:36.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.602+0000 7f86c5b9a700 1 -- 172.21.15.45:0/2890529522 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f86b8038d60 msgr2=0x7f86b8054970 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T12:06:36.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.602+0000 7f86c5b9a700 1 --2- 172.21.15.45:0/2890529522 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f86b8038d60 0x7f86b8054970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:36.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.602+0000 7f86c5b9a700 1 -- 172.21.15.45:0/2890529522 >> v1:172.21.15.45:6789/0 conn(0x7f86b803c720 legacy=0x7f86b8053060 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T12:06:36.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.602+0000 7f86c5b9a700 1 -- 172.21.15.45:0/2890529522 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86b8056260 con 0x7f86b80e4c30 2023-11-28T12:06:36.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.603+0000 7f86c5b9a700 1 --2- 172.21.15.45:0/2890529522 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86b80e4c30 0x7f86b8038820 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f86b000f9b0 tx=0x7f86b000fcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c7eb721f458aae4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:36.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.603+0000 7f86c5399700 1 -- 172.21.15.45:0/2890529522 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b0009b70 con 0x7f86b80e4c30 2023-11-28T12:06:36.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.603+0000 7f86c5399700 1 -- 172.21.15.45:0/2890529522 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86b0009cd0 con 0x7f86b80e4c30 2023-11-28T12:06:36.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.603+0000 7f86c5399700 1 -- 172.21.15.45:0/2890529522 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b0004230 con 0x7f86b80e4c30 2023-11-28T12:06:36.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.603+0000 7f3b86dff700 1 Processor -- start 2023-11-28T12:06:36.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.604+0000 7f3b86dff700 1 -- start start 2023-11-28T12:06:36.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.605+0000 7f86c85ff700 1 -- 172.21.15.45:0/2890529522 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86b80e4c30 msgr2=0x7f86b8038820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:36.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.605+0000 7f86c85ff700 1 --2- 172.21.15.45:0/2890529522 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86b80e4c30 0x7f86b8038820 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f86b000f9b0 tx=0x7f86b000fcc0 comp rx=0 tx=0).stop 2023-11-28T12:06:36.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.605+0000 7f86c85ff700 1 -- 172.21.15.45:0/2890529522 shutdown_connections 2023-11-28T12:06:36.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.605+0000 7f86c85ff700 1 --2- 172.21.15.45:0/2890529522 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f86b8038d60 0x7f86b8054970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:36.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.605+0000 7f86c85ff700 1 --2- 172.21.15.45:0/2890529522 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86b80e4c30 0x7f86b8038820 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:36.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.605+0000 7f86c85ff700 1 -- 172.21.15.45:0/2890529522 >> 172.21.15.45:0/2890529522 conn(0x7f86b800cf40 msgr2=0x7f86b8053820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:36.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.605+0000 7f86c85ff700 1 -- 172.21.15.45:0/2890529522 shutdown_connections 2023-11-28T12:06:36.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.605+0000 7f86c85ff700 1 -- 172.21.15.45:0/2890529522 wait complete. 2023-11-28T12:06:36.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.608+0000 7f86c85ff700 1 Processor -- start 2023-11-28T12:06:36.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.607+0000 7f80b3dff700 1 Processor -- start 2023-11-28T12:06:36.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.608+0000 7f80b3dff700 1 -- start start 2023-11-28T12:06:36.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.609+0000 7f86c85ff700 1 -- start start 2023-11-28T12:06:36.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.610+0000 7f86c85ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86b8038d60 0x7f86b804fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:36.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.610+0000 7f86c85ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f86b803c720 0x7f86b81735e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:36.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.610+0000 7f86c85ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86b80e4c30 0x7f86b804bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:36.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.611+0000 7f86c85ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86b804edd0 con 0x7f86b8038d60 2023-11-28T12:06:36.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.611+0000 7f86c85ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86b804f0b0 con 0x7f86b80e4c30 2023-11-28T12:06:36.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.611+0000 7f86c5b9a700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f86b803c720 0x7f86b81735e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:36.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.611+0000 7f86c6b9c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86b80e4c30 0x7f86b804bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:36.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.611+0000 7f86c6b9c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86b80e4c30 0x7f86b804bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.45:44458/0 (socket says 172.21.15.45:44458) 2023-11-28T12:06:36.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.611+0000 7f86c6b9c700 1 -- 172.21.15.45:0/3212266462 learned_addr learned my addr 172.21.15.45:0/3212266462 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:36.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.611+0000 7f86c85ff700 1 -- 172.21.15.45:0/3212266462 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86b804f390 con 0x7f86b803c720 2023-11-28T12:06:36.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.610+0000 7f80b3dff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f80ac15c9b0 0x7f80ac0b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:36.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.611+0000 7f80b3dff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80ac0d1950 con 0x7f80ac0cd7c0 2023-11-28T12:06:36.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.611+0000 7f80b3dff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80ac0d24f0 con 0x7f80ac161340 2023-11-28T12:06:36.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.611+0000 7f80b3dff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80ac0b5800 con 0x7f80ac15c9b0 2023-11-28T12:06:36.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.611+0000 7f80b139a700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f80ac161340 0x7f80ac0d1de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.45:55924/0 (socket says 172.21.15.45:55924) 2023-11-28T12:06:36.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.611+0000 7f80b139a700 1 -- 172.21.15.45:0/996764945 learned_addr learned my addr 172.21.15.45:0/996764945 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:06:36.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.612+0000 7f86c639b700 1 --2- 172.21.15.45:0/3212266462 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86b8038d60 0x7f86b804fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:36.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.613+0000 7f80b1b9b700 1 --2- 172.21.15.45:0/996764945 >> v2:172.21.15.45:3300/0 conn(0x7f80ac15c9b0 0x7f80ac0b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:36.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.613+0000 7f86c5b9a700 1 -- 172.21.15.45:0/3212266462 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86b80e4c30 msgr2=0x7f86b804bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:36.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.612+0000 7f3b86dff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3b8006dab0 0x7f3b800ade70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:36.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.612+0000 7f3b86dff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3b800c4f10 0x7f3b800cb1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:36.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.612+0000 7f3b86dff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f3b800c5380 0x7f3b800cb710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:36.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.612+0000 7f3b86dff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b8006c660 con 0x7f3b8006dab0 2023-11-28T12:06:36.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.612+0000 7f3b86dff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b8006ba50 con 0x7f3b800c5380 2023-11-28T12:06:36.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.612+0000 7f3b86dff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b8006bd30 con 0x7f3b800c4f10 2023-11-28T12:06:36.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.613+0000 7f3b8539c700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f3b800c5380 0x7f3b800cb710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:36.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.613+0000 7f3b8539c700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f3b800c5380 0x7f3b800cb710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.45:44468/0 (socket says 172.21.15.45:44468) 2023-11-28T12:06:36.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.613+0000 7f3b8539c700 1 -- 172.21.15.45:0/4007807895 learned_addr learned my addr 172.21.15.45:0/4007807895 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:36.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.613+0000 7f80b0b99700 1 -- 172.21.15.45:0/996764945 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1774197074 0 0) 0x7f80ac0d24f0 con 0x7f80ac161340 2023-11-28T12:06:36.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.613+0000 7f80b0b99700 1 -- 172.21.15.45:0/996764945 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80980035b0 con 0x7f80ac161340 2023-11-28T12:06:36.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.613+0000 7f3b84b9b700 1 --2- 172.21.15.45:0/4007807895 >> v2:172.21.15.45:3300/0 conn(0x7f3b8006dab0 0x7f3b800ade70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:36.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.613+0000 7f86c5b9a700 1 --2- 172.21.15.45:0/3212266462 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86b80e4c30 0x7f86b804bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:36.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.614+0000 7f86c5b9a700 1 -- 172.21.15.45:0/3212266462 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86b8038d60 msgr2=0x7f86b804fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:36.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.614+0000 7f86c5b9a700 1 --2- 172.21.15.45:0/3212266462 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86b8038d60 0x7f86b804fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:36.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.614+0000 7f80b1b9b700 1 -- 172.21.15.45:0/996764945 >> v1:172.21.15.152:6789/0 conn(0x7f80ac161340 legacy=0x7f80ac0d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:36.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.614+0000 7f80b1b9b700 1 -- 172.21.15.45:0/996764945 >> v1:172.21.15.45:6789/0 conn(0x7f80ac0cd7c0 legacy=0x7f80ac0b5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:36.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.614+0000 7f80b1b9b700 1 -- 172.21.15.45:0/996764945 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80ac0b5520 con 0x7f80ac15c9b0 2023-11-28T12:06:36.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.614+0000 7f3b7ffff700 1 --2- 172.21.15.45:0/4007807895 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3b800c4f10 0x7f3b800cb1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:36.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.614+0000 7f3b8539c700 1 -- 172.21.15.45:0/4007807895 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3b800c4f10 msgr2=0x7f3b800cb1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:06:36.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.614+0000 7f3b8539c700 1 --2- 172.21.15.45:0/4007807895 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3b800c4f10 0x7f3b800cb1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:36.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.614+0000 7f3b8539c700 1 -- 172.21.15.45:0/4007807895 >> v2:172.21.15.45:3300/0 conn(0x7f3b8006dab0 msgr2=0x7f3b800ade70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:06:36.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.614+0000 7f3b8539c700 1 --2- 172.21.15.45:0/4007807895 >> v2:172.21.15.45:3300/0 conn(0x7f3b8006dab0 0x7f3b800ade70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:36.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.614+0000 7f3b8539c700 1 -- 172.21.15.45:0/4007807895 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b8006c010 con 0x7f3b800c5380 2023-11-28T12:06:36.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.615+0000 7f86c5b9a700 1 -- 172.21.15.45:0/3212266462 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86b000f610 con 0x7f86b803c720 2023-11-28T12:06:36.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.615+0000 7f86c6b9c700 1 --2- 172.21.15.45:0/3212266462 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86b80e4c30 0x7f86b804bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:06:36.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.615+0000 7f86c639b700 1 --2- 172.21.15.45:0/3212266462 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86b8038d60 0x7f86b804fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:06:36.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.615+0000 7f80b1b9b700 1 --2- 172.21.15.45:0/996764945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80ac15c9b0 0x7f80ac0b4bf0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f809c009840 tx=0x7f809c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5b9dbcb4335c4fc server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:36.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.615+0000 7f86c5b9a700 1 --2- 172.21.15.45:0/3212266462 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f86b803c720 0x7f86b81735e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f86b0019000 tx=0x7f86b0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:36.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.616+0000 7f3b8539c700 1 --2- 172.21.15.45:0/4007807895 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b800c5380 0x7f3b800cb710 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3b8006f530 tx=0x7f3b6c009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=939b9fa7cdb18184 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:36.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.615+0000 7f80b0b99700 1 -- 172.21.15.45:0/996764945 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f809c011830 con 0x7f80ac15c9b0 2023-11-28T12:06:36.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.616+0000 7f80b0b99700 1 -- 172.21.15.45:0/996764945 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f809c011990 con 0x7f80ac15c9b0 2023-11-28T12:06:36.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.616+0000 7f80b0b99700 1 -- 172.21.15.45:0/996764945 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f809c011d00 con 0x7f80ac15c9b0 2023-11-28T12:06:36.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.616+0000 7f86b6ffd700 1 -- 172.21.15.45:0/3212266462 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b0009b70 con 0x7f86b803c720 2023-11-28T12:06:36.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.616+0000 7f0ab9fff700 1 Processor -- start 2023-11-28T12:06:36.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.616+0000 7f3b7f7fe700 1 -- 172.21.15.45:0/4007807895 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b6c011830 con 0x7f3b800c5380 2023-11-28T12:06:36.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.616+0000 7f3b7f7fe700 1 -- 172.21.15.45:0/4007807895 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b6c011990 con 0x7f3b800c5380 2023-11-28T12:06:36.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.616+0000 7f3b7f7fe700 1 -- 172.21.15.45:0/4007807895 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b6c011d20 con 0x7f3b800c5380 2023-11-28T12:06:36.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.616+0000 7f0ab9fff700 1 -- start start 2023-11-28T12:06:36.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.617+0000 7f80b3dff700 1 -- 172.21.15.45:0/996764945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80ac15c9b0 msgr2=0x7f80ac0b4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:36.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.617+0000 7f80b3dff700 1 --2- 172.21.15.45:0/996764945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80ac15c9b0 0x7f80ac0b4bf0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f809c009840 tx=0x7f809c009b50 comp rx=0 tx=0).stop 2023-11-28T12:06:36.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.617+0000 7f80b3dff700 1 -- 172.21.15.45:0/996764945 shutdown_connections 2023-11-28T12:06:36.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.617+0000 7f80b3dff700 1 --2- 172.21.15.45:0/996764945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80ac15c9b0 0x7f80ac0b4bf0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:36.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.617+0000 7f80b3dff700 1 -- 172.21.15.45:0/996764945 >> 172.21.15.45:0/996764945 conn(0x7f80ac072600 msgr2=0x7f80ac0cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:36.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.617+0000 7f80b3dff700 1 -- 172.21.15.45:0/996764945 shutdown_connections 2023-11-28T12:06:36.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.617+0000 7f3b86dff700 1 -- 172.21.15.45:0/4007807895 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b800c5380 msgr2=0x7f3b800cb710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:36.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.617+0000 7f3b86dff700 1 --2- 172.21.15.45:0/4007807895 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b800c5380 0x7f3b800cb710 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3b8006f530 tx=0x7f3b6c009bd0 comp rx=0 tx=0).stop 2023-11-28T12:06:36.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.617+0000 7f80b3dff700 1 -- 172.21.15.45:0/996764945 wait complete. 2023-11-28T12:06:36.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.617+0000 7f181b1ff700 1 Processor -- start 2023-11-28T12:06:36.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.618+0000 7f86b6ffd700 1 -- 172.21.15.45:0/3212266462 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86b0003e50 con 0x7f86b803c720 2023-11-28T12:06:36.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.618+0000 7f3b86dff700 1 -- 172.21.15.45:0/4007807895 shutdown_connections 2023-11-28T12:06:36.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.618+0000 7f3b86dff700 1 --2- 172.21.15.45:0/4007807895 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b800c5380 0x7f3b800cb710 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:36.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.618+0000 7f3b86dff700 1 --2- 172.21.15.45:0/4007807895 >> v2:172.21.15.45:3300/0 conn(0x7f3b8006dab0 0x7f3b800ade70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:36.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.618+0000 7f3b86dff700 1 --2- 172.21.15.45:0/4007807895 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3b800c4f10 0x7f3b800cb1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:36.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.618+0000 7f3b86dff700 1 -- 172.21.15.45:0/4007807895 >> 172.21.15.45:0/4007807895 conn(0x7f3b8006af00 msgr2=0x7f3b800b05a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:36.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.618+0000 7f181b1ff700 1 -- start start 2023-11-28T12:06:36.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.618+0000 7f86c85ff700 1 -- 172.21.15.45:0/3212266462 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86b8056980 con 0x7f86b803c720 2023-11-28T12:06:36.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.618+0000 7f86c85ff700 1 -- 172.21.15.45:0/3212266462 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86b80566a0 con 0x7f86b803c720 2023-11-28T12:06:36.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.618+0000 7f3b86dff700 1 -- 172.21.15.45:0/4007807895 shutdown_connections 2023-11-28T12:06:36.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.618+0000 7f86b6ffd700 1 -- 172.21.15.45:0/3212266462 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b0017690 con 0x7f86b803c720 2023-11-28T12:06:36.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.619+0000 7f243c3ff700 1 Processor -- start 2023-11-28T12:06:36.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.618+0000 7f3b86dff700 1 -- 172.21.15.45:0/4007807895 wait complete. 2023-11-28T12:06:36.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.620+0000 7f80b3dff700 1 Processor -- start 2023-11-28T12:06:36.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.621+0000 7f80b3dff700 1 -- start start 2023-11-28T12:06:36.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.619+0000 7f243c3ff700 1 -- start start 2023-11-28T12:06:36.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.621+0000 7f243c3ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f24340d1330 0x7f24340b06c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:36.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.621+0000 7f243c3ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f24340b20b0 0x7f24340b0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:36.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.621+0000 7f243c3ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24340b0230 con 0x7f24340d01b0 2023-11-28T12:06:36.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.621+0000 7f243c3ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f243415cec0 con 0x7f24340d1330 2023-11-28T12:06:36.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.621+0000 7f243c3ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24340b4570 con 0x7f24340b20b0 2023-11-28T12:06:36.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.621+0000 7f3b86dff700 1 Processor -- start 2023-11-28T12:06:36.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.621+0000 7f86c85ff700 1 -- 172.21.15.45:0/3212266462 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f86a8000fc0 con 0x7f86b803c720 2023-11-28T12:06:36.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.621+0000 7f3b86dff700 1 -- start start 2023-11-28T12:06:36.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.622+0000 7f243999a700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f24340d1330 0x7f24340b06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:36.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.622+0000 7f243a99c700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f24340b20b0 0x7f24340b0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:36.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.622+0000 7f243a99c700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f24340b20b0 0x7f24340b0c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.45:44480/0 (socket says 172.21.15.45:44480) 2023-11-28T12:06:36.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.622+0000 7f243a99c700 1 -- 172.21.15.45:0/2106058881 learned_addr learned my addr 172.21.15.45:0/2106058881 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:36.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.622+0000 7f243a99c700 1 -- 172.21.15.45:0/2106058881 >> v2:172.21.15.45:3300/0 conn(0x7f24340d1330 msgr2=0x7f24340b06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:06:36.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.622+0000 7f243a99c700 1 --2- 172.21.15.45:0/2106058881 >> v2:172.21.15.45:3300/0 conn(0x7f24340d1330 0x7f24340b06c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:36.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.622+0000 7f243a99c700 1 -- 172.21.15.45:0/2106058881 >> v1:172.21.15.152:6789/0 conn(0x7f24340d01b0 legacy=0x7f24340d0c20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-28T12:06:36.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.622+0000 7f243a99c700 1 -- 172.21.15.45:0/2106058881 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24340b4850 con 0x7f24340b20b0 2023-11-28T12:06:36.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.623+0000 7f0ab9fff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0ab40d01b0 0x7f0ab40d0c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:36.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.623+0000 7f0ab9fff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ab40b0230 con 0x7f0ab40b16d0 2023-11-28T12:06:36.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.623+0000 7f0ab9fff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ab40b37d0 con 0x7f0ab40b20b0 2023-11-28T12:06:36.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.623+0000 7f0ab9fff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab415cec0 con 0x7f0ab40d01b0 2023-11-28T12:06:36.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.623+0000 7f80b3dff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f80ac0cd7c0 0x7f80ac1ff590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:36.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.623+0000 7f243a99c700 1 --2- 172.21.15.45:0/2106058881 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24340b20b0 0x7f24340b0c00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2434066e80 tx=0x7f242c009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1ac7f6ba1139b03 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:36.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.620+0000 7f181b1ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f18140d01b0 0x7f18140d0c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:36.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.623+0000 7f3b86dff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b8006dab0 0x7f3b8014be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:36.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.620+0000 7f181b1ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18140b0230 con 0x7f18140b20b0 2023-11-28T12:06:36.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.620+0000 7f181b1ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18140b37d0 con 0x7f18140b16d0 2023-11-28T12:06:36.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.620+0000 7f181b1ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f181415cec0 con 0x7f18140d01b0 2023-11-28T12:06:36.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.623+0000 7f1818f9b700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f18140d01b0 0x7f18140d0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:36.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.623+0000 7f1818f9b700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f18140d01b0 0x7f18140d0c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.45:53612/0 (socket says 172.21.15.45:53612) 2023-11-28T12:06:36.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.623+0000 7f1818f9b700 1 -- 172.21.15.45:0/2864019896 learned_addr learned my addr 172.21.15.45:0/2864019896 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:36.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.624+0000 7f2439199700 1 -- 172.21.15.45:0/2106058881 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f242c004230 con 0x7f24340b20b0 2023-11-28T12:06:36.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.624+0000 7f2439199700 1 -- 172.21.15.45:0/2106058881 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f242c004390 con 0x7f24340b20b0 2023-11-28T12:06:36.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.624+0000 7f2439199700 1 -- 172.21.15.45:0/2106058881 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f242c0036a0 con 0x7f24340b20b0 2023-11-28T12:06:36.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.624+0000 7f3b86dff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b800c4f10 0x7f3b8013aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:36.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.624+0000 7f3b86dff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3b800c5380 0x7f3b80135ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:36.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.624+0000 7f1818f9b700 1 -- 172.21.15.45:0/2864019896 >> v1:172.21.15.152:6789/0 conn(0x7f18140b16d0 legacy=0x7f18140b30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:36.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.624+0000 7f1818f9b700 1 -- 172.21.15.45:0/2864019896 >> v1:172.21.15.45:6789/0 conn(0x7f18140b20b0 legacy=0x7f18140b29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:06:36.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.624+0000 7f1818f9b700 1 -- 172.21.15.45:0/2864019896 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18140b4570 con 0x7f18140d01b0 2023-11-28T12:06:36.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.625+0000 7f1818f9b700 1 --2- 172.21.15.45:0/2864019896 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f18140d01b0 0x7f18140d0c20 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f180c009eb0 tx=0x7f180c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d82026796cfeb9cd server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:36.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.625+0000 7f243c3ff700 1 -- 172.21.15.45:0/2106058881 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24340b20b0 msgr2=0x7f24340b0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:36.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.625+0000 7f243c3ff700 1 --2- 172.21.15.45:0/2106058881 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24340b20b0 0x7f24340b0c00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2434066e80 tx=0x7f242c009bd0 comp rx=0 tx=0).stop 2023-11-28T12:06:36.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.623+0000 7f0ab37fe700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0ab40d01b0 0x7f0ab40d0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:36.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.623+0000 7f0ab37fe700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0ab40d01b0 0x7f0ab40d0c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.45:53616/0 (socket says 172.21.15.45:53616) 2023-11-28T12:06:36.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.623+0000 7f0ab37fe700 1 -- 172.21.15.45:0/3090709395 learned_addr learned my addr 172.21.15.45:0/3090709395 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:36.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.625+0000 7f3b86dff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b80135ac0 con 0x7f3b8006dab0 2023-11-28T12:06:36.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.624+0000 7f0ab37fe700 1 -- 172.21.15.45:0/3090709395 >> v1:172.21.15.152:6789/0 conn(0x7f0ab40b20b0 legacy=0x7f0ab40b29b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-28T12:06:36.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.624+0000 7f0ab37fe700 1 -- 172.21.15.45:0/3090709395 >> v1:172.21.15.45:6789/0 conn(0x7f0ab40b16d0 legacy=0x7f0ab40b30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:36.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.624+0000 7f0ab37fe700 1 -- 172.21.15.45:0/3090709395 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ab40b4570 con 0x7f0ab40d01b0 2023-11-28T12:06:36.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.625+0000 7f243c3ff700 1 -- 172.21.15.45:0/2106058881 shutdown_connections 2023-11-28T12:06:36.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.625+0000 7f3b84b9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b8006dab0 0x7f3b8014be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:36.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.625+0000 7f3b7ffff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b800c4f10 0x7f3b8013aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:36.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.625+0000 7f243c3ff700 1 --2- 172.21.15.45:0/2106058881 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24340b20b0 0x7f24340b0c00 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:36.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.625+0000 7f243c3ff700 1 --2- 172.21.15.45:0/2106058881 >> v2:172.21.15.45:3300/0 conn(0x7f24340d1330 0x7f24340b06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:36.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.625+0000 7f243c3ff700 1 -- 172.21.15.45:0/2106058881 >> 172.21.15.45:0/2106058881 conn(0x7f243409c3f0 msgr2=0x7f24340d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:36.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.625+0000 7f18137fe700 1 -- 172.21.15.45:0/2864019896 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f180c00e070 con 0x7f18140d01b0 2023-11-28T12:06:36.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.625+0000 7f243c3ff700 1 -- 172.21.15.45:0/2106058881 shutdown_connections 2023-11-28T12:06:36.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.625+0000 7f3b8539c700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3b800c5380 0x7f3b80135ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:36.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.625+0000 7f3b86dff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b801354d0 con 0x7f3b800c4f10 2023-11-28T12:06:36.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.625+0000 7f3b86dff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b8013b010 con 0x7f3b800c5380 2023-11-28T12:06:36.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.625+0000 7f3b84b9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b8006dab0 0x7f3b8014be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35868/0 (socket says 172.21.15.45:35868) 2023-11-28T12:06:36.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.625+0000 7f3b84b9b700 1 -- 172.21.15.45:0/3811464814 learned_addr learned my addr 172.21.15.45:0/3811464814 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:36.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.625+0000 7f18137fe700 1 -- 172.21.15.45:0/2864019896 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f180c003a20 con 0x7f18140d01b0 2023-11-28T12:06:36.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.625+0000 7f18137fe700 1 -- 172.21.15.45:0/2864019896 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f180c00e070 con 0x7f18140d01b0 2023-11-28T12:06:36.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.626+0000 7f243c3ff700 1 -- 172.21.15.45:0/2106058881 wait complete. 2023-11-28T12:06:36.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.625+0000 7f80b3dff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f80ac15c9b0 0x7f80ac0c4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:36.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.625+0000 7f80b1b9b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f80ac0cd7c0 0x7f80ac1ff590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:36.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.625+0000 7f80b3dff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80ac161340 0x7f80ac0c5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:36.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.625+0000 7f80b3dff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80ac0cc260 con 0x7f80ac161340 2023-11-28T12:06:36.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.626+0000 7f80b1b9b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f80ac0cd7c0 0x7f80ac1ff590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.45:44488/0 (socket says 172.21.15.45:44488) 2023-11-28T12:06:36.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.626+0000 7f80b1b9b700 1 -- 172.21.15.45:0/4097890424 learned_addr learned my addr 172.21.15.45:0/4097890424 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:36.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.624+0000 7f86b6ffd700 1 -- 172.21.15.45:0/3212266462 <== mon.2 v2:172.21.15.152:3301/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f86b00177f0 con 0x7f86b803c720 2023-11-28T12:06:36.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.626+0000 7f86b6ffd700 1 --2- 172.21.15.45:0/3212266462 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f86a4068340 0x7f86a406a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:36.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.626+0000 7f3b84b9b700 1 -- 172.21.15.45:0/3811464814 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3b800c5380 msgr2=0x7f3b80135ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:36.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.626+0000 7f3b84b9b700 1 --2- 172.21.15.45:0/3811464814 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3b800c5380 0x7f3b80135ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:36.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.627+0000 7f181b1ff700 1 -- 172.21.15.45:0/2864019896 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f18140d01b0 msgr2=0x7f18140d0c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:36.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.625+0000 7f80b3dff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80ac0cb3f0 con 0x7f80ac0cd7c0 2023-11-28T12:06:36.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.627+0000 7f80b3dff700 1 -- 172.21.15.45:0/4097890424 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80ac0cb690 con 0x7f80ac15c9b0 2023-11-28T12:06:36.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.627+0000 7f181b1ff700 1 --2- 172.21.15.45:0/2864019896 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f18140d01b0 0x7f18140d0c20 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f180c009eb0 tx=0x7f180c00b330 comp rx=0 tx=0).stop 2023-11-28T12:06:36.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.627+0000 7f3b84b9b700 1 -- 172.21.15.45:0/3811464814 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b800c4f10 msgr2=0x7f3b8013aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:36.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.627+0000 7f3b84b9b700 1 --2- 172.21.15.45:0/3811464814 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b800c4f10 0x7f3b8013aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:36.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.627+0000 7f3b84b9b700 1 -- 172.21.15.45:0/3811464814 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b6c009550 con 0x7f3b8006dab0 2023-11-28T12:06:36.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.627+0000 7f3b7ffff700 1 --2- 172.21.15.45:0/3811464814 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b800c4f10 0x7f3b8013aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:06:36.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.627+0000 7f3b84b9b700 1 --2- 172.21.15.45:0/3811464814 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b8006dab0 0x7f3b8014be50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3b7400e950 tx=0x7f3b7400ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:36.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.626+0000 7f0ab37fe700 1 --2- 172.21.15.45:0/3090709395 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0ab40d01b0 0x7f0ab40d0c20 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0aa4009950 tx=0x7f0aa4009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=784bbb6c06ce34db server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:36.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.626+0000 7f0ab27fc700 1 -- 172.21.15.45:0/3090709395 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa4009ea0 con 0x7f0ab40d01b0 2023-11-28T12:06:36.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.627+0000 7f0ab27fc700 1 -- 172.21.15.45:0/3090709395 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aa4014d70 con 0x7f0ab40d01b0 2023-11-28T12:06:36.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.627+0000 7f0ab27fc700 1 -- 172.21.15.45:0/3090709395 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa4004250 con 0x7f0ab40d01b0 2023-11-28T12:06:36.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.627+0000 7f181b1ff700 1 -- 172.21.15.45:0/2864019896 shutdown_connections 2023-11-28T12:06:36.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.627+0000 7f181b1ff700 1 --2- 172.21.15.45:0/2864019896 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f18140d01b0 0x7f18140d0c20 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:36.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.627+0000 7f181b1ff700 1 -- 172.21.15.45:0/2864019896 >> 172.21.15.45:0/2864019896 conn(0x7f181409c3f0 msgr2=0x7f18140d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:36.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.627+0000 7f80b139a700 1 --2- 172.21.15.45:0/4097890424 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f80ac15c9b0 0x7f80ac0c4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:36.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.627+0000 7f80b1b9b700 1 -- 172.21.15.45:0/4097890424 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f80ac15c9b0 msgr2=0x7f80ac0c4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:36.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.627+0000 7f0ab9fff700 1 -- 172.21.15.45:0/3090709395 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0ab40d01b0 msgr2=0x7f0ab40d0c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:36.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.627+0000 7f0ab9fff700 1 --2- 172.21.15.45:0/3090709395 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0ab40d01b0 0x7f0ab40d0c20 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0aa4009950 tx=0x7f0aa4009c60 comp rx=0 tx=0).stop 2023-11-28T12:06:36.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.628+0000 7f86c639b700 1 --2- 172.21.15.45:0/3212266462 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f86a4068340 0x7f86a406a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:36.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.628+0000 7f80b1b9b700 1 --2- 172.21.15.45:0/4097890424 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f80ac15c9b0 0x7f80ac0c4b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:36.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.628+0000 7f80b1b9b700 1 -- 172.21.15.45:0/4097890424 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80ac161340 msgr2=0x7f80ac0c5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:36.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.628+0000 7f181b1ff700 1 -- 172.21.15.45:0/2864019896 shutdown_connections 2023-11-28T12:06:36.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.628+0000 7f80b239c700 1 --2- 172.21.15.45:0/4097890424 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80ac161340 0x7f80ac0c5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:36.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.628+0000 7f0ab9fff700 1 -- 172.21.15.45:0/3090709395 shutdown_connections 2023-11-28T12:06:36.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.628+0000 7f0ab9fff700 1 --2- 172.21.15.45:0/3090709395 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0ab40d01b0 0x7f0ab40d0c20 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:36.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.628+0000 7f0ab9fff700 1 -- 172.21.15.45:0/3090709395 >> 172.21.15.45:0/3090709395 conn(0x7f0ab409c3f0 msgr2=0x7f0ab40d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:36.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.628+0000 7f0ab9fff700 1 -- 172.21.15.45:0/3090709395 shutdown_connections 2023-11-28T12:06:36.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.628+0000 7f0ab9fff700 1 -- 172.21.15.45:0/3090709395 wait complete. 2023-11-28T12:06:36.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.628+0000 7f86b6ffd700 1 -- 172.21.15.45:0/3212266462 <== mon.2 v2:172.21.15.152:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f86b0009e40 con 0x7f86b803c720 2023-11-28T12:06:36.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.628+0000 7f80b1b9b700 1 --2- 172.21.15.45:0/4097890424 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80ac161340 0x7f80ac0c5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:36.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.629+0000 7f3b7d7fa700 1 -- 172.21.15.45:0/3811464814 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b7400c7e0 con 0x7f3b8006dab0 2023-11-28T12:06:36.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.628+0000 7f80b1b9b700 1 -- 172.21.15.45:0/4097890424 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f809c0094a0 con 0x7f80ac0cd7c0 2023-11-28T12:06:36.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.628+0000 7f80b239c700 1 --2- 172.21.15.45:0/4097890424 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80ac161340 0x7f80ac0c5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:06:36.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.629+0000 7f86b6ffd700 1 --2- 172.21.15.45:0/3212266462 >> [v2:172.21.15.45:6806/115843,v1:172.21.15.45:6808/115843] conn(0x7f86a4071800 0x7f86a4073c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:36.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.629+0000 7f86b6ffd700 1 -- 172.21.15.45:0/3212266462 --> [v2:172.21.15.45:6806/115843,v1:172.21.15.45:6808/115843] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f86a4074360 con 0x7f86a4071800 2023-11-28T12:06:36.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.629+0000 7f86b6ffd700 1 -- 172.21.15.45:0/3212266462 <== mon.2 v2:172.21.15.152:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f86b0057760 con 0x7f86b803c720 2023-11-28T12:06:36.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.629+0000 7f86c639b700 1 --2- 172.21.15.45:0/3212266462 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f86a4068340 0x7f86a406a7f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f86bc006fd0 tx=0x7f86bc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:36.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.629+0000 7f80b1b9b700 1 --2- 172.21.15.45:0/4097890424 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f80ac0cd7c0 0x7f80ac1ff590 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f809c009fd0 tx=0x7f809c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:36.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.629+0000 7f181b1ff700 1 -- 172.21.15.45:0/2864019896 wait complete. 2023-11-28T12:06:36.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.629+0000 7f3b86dff700 1 -- 172.21.15.45:0/3811464814 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b800cc720 con 0x7f3b8006dab0 2023-11-28T12:06:36.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.629+0000 7f3b86dff700 1 -- 172.21.15.45:0/3811464814 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b8006c2f0 con 0x7f3b8006dab0 2023-11-28T12:06:36.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.629+0000 7f86c6b9c700 1 --2- 172.21.15.45:0/3212266462 >> [v2:172.21.15.45:6806/115843,v1:172.21.15.45:6808/115843] conn(0x7f86a4071800 0x7f86a4073c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:36.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.630+0000 7f80a27fc700 1 -- 172.21.15.45:0/4097890424 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f809c0038a0 con 0x7f80ac0cd7c0 2023-11-28T12:06:36.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.630+0000 7f80b3dff700 1 -- 172.21.15.45:0/4097890424 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80ac0d15e0 con 0x7f80ac0cd7c0 2023-11-28T12:06:36.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.630+0000 7f243c3ff700 1 Processor -- start 2023-11-28T12:06:36.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.630+0000 7f0ab9fff700 1 Processor -- start 2023-11-28T12:06:36.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.630+0000 7f86c6b9c700 1 --2- 172.21.15.45:0/3212266462 >> [v2:172.21.15.45:6806/115843,v1:172.21.15.45:6808/115843] conn(0x7f86a4071800 0x7f86a4073c90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:36.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.631+0000 7f243c3ff700 1 -- start start 2023-11-28T12:06:36.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.630+0000 7f80b3dff700 1 -- 172.21.15.45:0/4097890424 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80ac0d1300 con 0x7f80ac0cd7c0 2023-11-28T12:06:36.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.630+0000 7f80a27fc700 1 -- 172.21.15.45:0/4097890424 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f809c01e070 con 0x7f80ac0cd7c0 2023-11-28T12:06:36.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.631+0000 7f80a27fc700 1 -- 172.21.15.45:0/4097890424 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f809c0038a0 con 0x7f80ac0cd7c0 2023-11-28T12:06:36.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.632+0000 7f80b3dff700 1 -- 172.21.15.45:0/4097890424 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8094000fc0 con 0x7f80ac0cd7c0 2023-11-28T12:06:36.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.632+0000 7f181b1ff700 1 Processor -- start 2023-11-28T12:06:36.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.632+0000 7f181b1ff700 1 -- start start 2023-11-28T12:06:36.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.632+0000 7f0ab9fff700 1 -- start start 2023-11-28T12:06:36.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.633+0000 7f86b6ffd700 1 -- 172.21.15.45:0/3212266462 <== osd.0 v2:172.21.15.45:6806/115843 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f86a4074360 con 0x7f86a4071800 2023-11-28T12:06:36.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.631+0000 7f3b6affd700 1 -- 172.21.15.45:0/3811464814 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3b60000fc0 con 0x7f3b8006dab0 2023-11-28T12:06:36.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.632+0000 7f3b7d7fa700 1 -- 172.21.15.45:0/3811464814 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b7400c940 con 0x7f3b8006dab0 2023-11-28T12:06:36.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.632+0000 7f3b7d7fa700 1 -- 172.21.15.45:0/3811464814 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b7400c7e0 con 0x7f3b8006dab0 2023-11-28T12:06:36.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.634+0000 7f243c3ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f24340b20b0 0x7f24340c9770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:36.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.630+0000 7f7b81bff700 1 Processor -- start 2023-11-28T12:06:36.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.630+0000 7f7b81bff700 1 -- start start 2023-11-28T12:06:36.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.632+0000 7f7b81bff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7b7c0ca900 0x7f7b7c0cad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:36.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.632+0000 7f7b81bff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7b7c06b9e0 0x7f7b7c06be30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:36.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.633+0000 7f7b81bff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b7c15c330 con 0x7f7b7c0b0750 2023-11-28T12:06:36.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.633+0000 7f7b81bff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b7c15d320 con 0x7f7b7c06b9e0 2023-11-28T12:06:36.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.633+0000 7f7b81bff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b7c15c560 con 0x7f7b7c0ca900 2023-11-28T12:06:36.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.633+0000 7f7b7bfff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7b7c06b9e0 0x7f7b7c06be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:36.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.633+0000 7f7b7bfff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7b7c06b9e0 0x7f7b7c06be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35874/0 (socket says 172.21.15.45:35874) 2023-11-28T12:06:36.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.633+0000 7f7b7bfff700 1 -- 172.21.15.45:0/2758668415 learned_addr learned my addr 172.21.15.45:0/2758668415 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:36.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.634+0000 7f7b7bfff700 1 -- 172.21.15.45:0/2758668415 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7b7c0ca900 msgr2=0x7f7b7c0cad70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-28T12:06:36.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.634+0000 7f7b7bfff700 1 --2- 172.21.15.45:0/2758668415 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7b7c0ca900 0x7f7b7c0cad70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:36.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.634+0000 7f7b7bfff700 1 -- 172.21.15.45:0/2758668415 >> v1:172.21.15.152:6789/0 conn(0x7f7b7c0b0750 legacy=0x7f7b7c0b0b20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-28T12:06:36.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.634+0000 7f7b7bfff700 1 -- 172.21.15.45:0/2758668415 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b7c15c840 con 0x7f7b7c06b9e0 2023-11-28T12:06:36.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.634+0000 7f181b1ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f18140b16d0 0x7f181415f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:36.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.634+0000 7f181b1ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f18140b20b0 0x7f181415d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:36.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.634+0000 7f243c3ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24340d01b0 0x7f24340b8110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:36.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.635+0000 7f181b1ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f18140d01b0 0x7f18140b60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:36.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.635+0000 7f181b1ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18140cbbb0 con 0x7f18140d01b0 2023-11-28T12:06:36.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.635+0000 7f7b7bfff700 1 --2- 172.21.15.45:0/2758668415 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b7c06b9e0 0x7f7b7c06be30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7b74009e50 tx=0x7f7b7400bbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=259b6af366a7ed1d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:36.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.635+0000 7f243c3ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24340d1330 0x7f2434154db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:36.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.635+0000 7f243c3ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2434160310 con 0x7f24340d1330 2023-11-28T12:06:36.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.635+0000 7f243c3ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24340c9cb0 con 0x7f24340d01b0 2023-11-28T12:06:36.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.635+0000 7f243c3ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24340b7070 con 0x7f24340b20b0 2023-11-28T12:06:36.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.635+0000 7f181b1ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f181415fdd0 con 0x7f18140b16d0 2023-11-28T12:06:36.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.635+0000 7f1818f9b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f18140b16d0 0x7f181415f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:36.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.635+0000 7f181b1ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18140cb210 con 0x7f18140b20b0 2023-11-28T12:06:36.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.635+0000 7f1818f9b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f18140b16d0 0x7f181415f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.45:44526/0 (socket says 172.21.15.45:44526) 2023-11-28T12:06:36.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.635+0000 7f1813fff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f18140b20b0 0x7f181415d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:36.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.635+0000 7f3b7d7fa700 1 -- 172.21.15.45:0/3811464814 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f3b74023070 con 0x7f3b8006dab0 2023-11-28T12:06:36.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.635+0000 7f243999a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24340d01b0 0x7f24340b8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:36.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.635+0000 7f243999a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24340d01b0 0x7f24340b8110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.45:44516/0 (socket says 172.21.15.45:44516) 2023-11-28T12:06:36.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.635+0000 7f243999a700 1 -- 172.21.15.45:0/3926685670 learned_addr learned my addr 172.21.15.45:0/3926685670 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:36.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.635+0000 7f243a19b700 1 --2- 172.21.15.45:0/3926685670 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f24340b20b0 0x7f24340c9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:36.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.634+0000 7f80a27fc700 1 -- 172.21.15.45:0/4097890424 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f809c00f050 con 0x7f80ac0cd7c0 2023-11-28T12:06:36.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.635+0000 7f80a27fc700 1 --2- 172.21.15.45:0/4097890424 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f8090068350 0x7f809006a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:36.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.636+0000 7f1818f9b700 1 -- 172.21.15.45:0/335088075 learned_addr learned my addr 172.21.15.45:0/335088075 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:36.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.636+0000 7f181979c700 1 --2- 172.21.15.45:0/335088075 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f18140d01b0 0x7f18140b60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:36.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.636+0000 7f80a27fc700 1 -- 172.21.15.45:0/4097890424 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f809c05eec0 con 0x7f80ac0cd7c0 2023-11-28T12:06:36.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.636+0000 7f243999a700 1 -- 172.21.15.45:0/3926685670 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f24340b20b0 msgr2=0x7f24340c9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:36.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.636+0000 7f243999a700 1 --2- 172.21.15.45:0/3926685670 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f24340b20b0 0x7f24340c9770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:36.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.636+0000 7f243999a700 1 -- 172.21.15.45:0/3926685670 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24340d1330 msgr2=0x7f2434154db0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T12:06:36.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.636+0000 7f80a27fc700 1 --2- 172.21.15.45:0/4097890424 >> [v2:172.21.15.45:6817/115850,v1:172.21.15.45:6819/115850] conn(0x7f8090071850 0x7f8090073ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:36.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.636+0000 7f243999a700 1 --2- 172.21.15.45:0/3926685670 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24340d1330 0x7f2434154db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:36.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.636+0000 7f243999a700 1 -- 172.21.15.45:0/3926685670 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f242c009550 con 0x7f24340d01b0 2023-11-28T12:06:36.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.637+0000 7f80b139a700 1 --2- 172.21.15.45:0/4097890424 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f8090068350 0x7f809006a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:36.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.637+0000 7f80a27fc700 1 -- 172.21.15.45:0/4097890424 --> [v2:172.21.15.45:6817/115850,v1:172.21.15.45:6819/115850] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f80900743b0 con 0x7f8090071850 2023-11-28T12:06:36.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.637+0000 7f80a27fc700 1 -- 172.21.15.45:0/4097890424 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f809c0045c0 con 0x7f80ac0cd7c0 2023-11-28T12:06:36.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.637+0000 7f181979c700 1 -- 172.21.15.45:0/335088075 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f18140b20b0 msgr2=0x7f181415d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:36.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.637+0000 7f181979c700 1 --2- 172.21.15.45:0/335088075 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f18140b20b0 0x7f181415d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:36.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.637+0000 7f181979c700 1 -- 172.21.15.45:0/335088075 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f18140b16d0 msgr2=0x7f181415f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:36.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.637+0000 7f181979c700 1 --2- 172.21.15.45:0/335088075 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f18140b16d0 0x7f181415f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:36.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.637+0000 7f243999a700 1 --2- 172.21.15.45:0/3926685670 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24340d01b0 0x7f24340b8110 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f242000e810 tx=0x7f242000ebd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:36.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.637+0000 7f80b239c700 1 --2- 172.21.15.45:0/4097890424 >> [v2:172.21.15.45:6817/115850,v1:172.21.15.45:6819/115850] conn(0x7f8090071850 0x7f8090073ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:36.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.637+0000 7f181979c700 1 -- 172.21.15.45:0/335088075 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f180c009b30 con 0x7f18140d01b0 2023-11-28T12:06:36.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.637+0000 7f0ab9fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ab40b16d0 0x7f0ab4151760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:36.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.637+0000 7f1818f9b700 1 --2- 172.21.15.45:0/335088075 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f18140b16d0 0x7f181415f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:06:36.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.637+0000 7f3b7d7fa700 1 --2- 172.21.15.45:0/3811464814 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f3b64068350 0x7f3b6406a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:36.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.637+0000 7f0ab9fff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0ab40b20b0 0x7f0ab40cba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:36.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.637+0000 7f0ab9fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ab40d01b0 0x7f0ab40ca120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:36.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.638+0000 7f7b7affd700 1 -- 172.21.15.45:0/2758668415 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b74003c20 con 0x7f7b7c06b9e0 2023-11-28T12:06:36.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.638+0000 7f0ab37fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ab40b16d0 0x7f0ab4151760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:36.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.638+0000 7f0ab37fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ab40b16d0 0x7f0ab4151760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.45:44542/0 (socket says 172.21.15.45:44542) 2023-11-28T12:06:36.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.638+0000 7f181979c700 1 --2- 172.21.15.45:0/335088075 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f18140d01b0 0x7f18140b60b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1800000f60 tx=0x7f180000cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:36.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.638+0000 7f0ab2ffd700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0ab40b20b0 0x7f0ab40cba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:36.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.638+0000 7f0ab2ffd700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0ab40b20b0 0x7f0ab40cba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.45:53664/0 (socket says 172.21.15.45:53664) 2023-11-28T12:06:36.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.638+0000 7f2432ffd700 1 -- 172.21.15.45:0/3926685670 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2420013610 con 0x7f24340d01b0 2023-11-28T12:06:36.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.638+0000 7f2432ffd700 1 -- 172.21.15.45:0/3926685670 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2420013770 con 0x7f24340d01b0 2023-11-28T12:06:36.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.638+0000 7f2432ffd700 1 -- 172.21.15.45:0/3926685670 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2420013b00 con 0x7f24340d01b0 2023-11-28T12:06:36.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.638+0000 7f0ab37fe700 1 -- 172.21.15.45:0/4192859652 learned_addr learned my addr 172.21.15.45:0/4192859652 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:36.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.638+0000 7f0ab9fff700 1 -- 172.21.15.45:0/4192859652 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab40cbfa0 con 0x7f0ab40d01b0 2023-11-28T12:06:36.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.638+0000 7f0ab9fff700 1 -- 172.21.15.45:0/4192859652 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab40ca9c0 con 0x7f0ab40b16d0 2023-11-28T12:06:36.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.638+0000 7f0ab9fff700 1 -- 172.21.15.45:0/4192859652 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab40caca0 con 0x7f0ab40b20b0 2023-11-28T12:06:36.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.638+0000 7f18117fa700 1 -- 172.21.15.45:0/335088075 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18000052d0 con 0x7f18140d01b0 2023-11-28T12:06:36.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.639+0000 7f80b239c700 1 --2- 172.21.15.45:0/4097890424 >> [v2:172.21.15.45:6817/115850,v1:172.21.15.45:6819/115850] conn(0x7f8090071850 0x7f8090073ce0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:36.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.639+0000 7f18117fa700 1 -- 172.21.15.45:0/335088075 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1800005430 con 0x7f18140d01b0 2023-11-28T12:06:36.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.639+0000 7f243c3ff700 1 -- 172.21.15.45:0/3926685670 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24340afec0 con 0x7f24340d01b0 2023-11-28T12:06:36.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.638+0000 7f7b7affd700 1 -- 172.21.15.45:0/2758668415 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b74003d80 con 0x7f7b7c06b9e0 2023-11-28T12:06:36.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.639+0000 7f7b7affd700 1 -- 172.21.15.45:0/2758668415 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b74003c20 con 0x7f7b7c06b9e0 2023-11-28T12:06:36.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.638+0000 7f3b7d7fa700 1 -- 172.21.15.45:0/3811464814 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3b74085740 con 0x7f3b8006dab0 2023-11-28T12:06:36.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.638+0000 7f3b7d7fa700 1 --2- 172.21.15.45:0/3811464814 >> [v2:172.21.15.45:6800/115842,v1:172.21.15.45:6801/115842] conn(0x7f3b64070c00 0x7f3b64073010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:36.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.638+0000 7f3b7d7fa700 1 -- 172.21.15.45:0/3811464814 --> [v2:172.21.15.45:6800/115842,v1:172.21.15.45:6801/115842] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3b640736c0 con 0x7f3b64070c00 2023-11-28T12:06:36.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.638+0000 7f3b7d7fa700 1 -- 172.21.15.45:0/3811464814 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3b74087d60 con 0x7f3b8006dab0 2023-11-28T12:06:36.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.639+0000 7f3b7ffff700 1 --2- 172.21.15.45:0/3811464814 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f3b64068350 0x7f3b6406a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:36.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.639+0000 7f0ab37fe700 1 -- 172.21.15.45:0/4192859652 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0ab40b20b0 msgr2=0x7f0ab40cba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:36.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.639+0000 7f0ab37fe700 1 --2- 172.21.15.45:0/4192859652 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0ab40b20b0 0x7f0ab40cba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:36.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.639+0000 7f0ab37fe700 1 -- 172.21.15.45:0/4192859652 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ab40d01b0 msgr2=0x7f0ab40ca120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:36.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.639+0000 7f0ab37fe700 1 --2- 172.21.15.45:0/4192859652 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ab40d01b0 0x7f0ab40ca120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:36.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.639+0000 7f0ab37fe700 1 -- 172.21.15.45:0/4192859652 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aa4009550 con 0x7f0ab40b16d0 2023-11-28T12:06:36.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.639+0000 7f0ab2ffd700 1 --2- 172.21.15.45:0/4192859652 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0ab40b20b0 0x7f0ab40cba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2023-11-28T12:06:36.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.639+0000 7f243c3ff700 1 -- 172.21.15.45:0/3926685670 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24340afbe0 con 0x7f24340d01b0 2023-11-28T12:06:36.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.640+0000 7f0ab37fe700 1 --2- 172.21.15.45:0/4192859652 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ab40b16d0 0x7f0ab4151760 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0aa4000c00 tx=0x7f0aa4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:36.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.640+0000 7f3b8539c700 1 --2- 172.21.15.45:0/3811464814 >> [v2:172.21.15.45:6800/115842,v1:172.21.15.45:6801/115842] conn(0x7f3b64070c00 0x7f3b64073010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:36.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.639+0000 7f18117fa700 1 -- 172.21.15.45:0/335088075 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1800003880 con 0x7f18140d01b0 2023-11-28T12:06:36.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.640+0000 7f0a9bfff700 1 -- 172.21.15.45:0/4192859652 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa4003e40 con 0x7f0ab40b16d0 2023-11-28T12:06:36.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.640+0000 7f0a9bfff700 1 -- 172.21.15.45:0/4192859652 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aa400b5d0 con 0x7f0ab40b16d0 2023-11-28T12:06:36.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.640+0000 7f0a9bfff700 1 -- 172.21.15.45:0/4192859652 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa400b980 con 0x7f0ab40b16d0 2023-11-28T12:06:36.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.640+0000 7f0ab9fff700 1 -- 172.21.15.45:0/4192859652 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ab40afbe0 con 0x7f0ab40b16d0 2023-11-28T12:06:36.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.640+0000 7f181b1ff700 1 -- 172.21.15.45:0/335088075 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18140afbe0 con 0x7f18140d01b0 2023-11-28T12:06:36.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.640+0000 7f181b1ff700 1 -- 172.21.15.45:0/335088075 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18140b4850 con 0x7f18140d01b0 2023-11-28T12:06:36.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.640+0000 7f80b139a700 1 --2- 172.21.15.45:0/4097890424 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f8090068350 0x7f809006a800 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f80a80011e0 tx=0x7f80a8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:36.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.640+0000 7f0ab9fff700 1 -- 172.21.15.45:0/4192859652 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ab40b4850 con 0x7f0ab40b16d0 2023-11-28T12:06:36.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.641+0000 7fda111ff700 1 Processor -- start 2023-11-28T12:06:36.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.641+0000 7f243c3ff700 1 -- 172.21.15.45:0/3926685670 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f24340b2600 con 0x7f24340d01b0 2023-11-28T12:06:36.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.641+0000 7f80a27fc700 1 -- 172.21.15.45:0/4097890424 <== osd.2 v2:172.21.15.45:6817/115850 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f80900743b0 con 0x7f8090071850 2023-11-28T12:06:36.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.641+0000 7f3b7ffff700 1 --2- 172.21.15.45:0/3811464814 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f3b64068350 0x7f3b6406a800 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3b78000ba0 tx=0x7f3b78008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:36.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.641+0000 7fda111ff700 1 -- start start 2023-11-28T12:06:36.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.643+0000 7fda111ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fda0c0d01b0 0x7fda0c0d0c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:36.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.643+0000 7fda111ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fda0c0b20b0 0x7fda0c0d1160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:36.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.642+0000 7f3b8539c700 1 --2- 172.21.15.45:0/3811464814 >> [v2:172.21.15.45:6800/115842,v1:172.21.15.45:6801/115842] conn(0x7f3b64070c00 0x7f3b64073010 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:36.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.643+0000 7fda111ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fda0c0b29b0 0x7fda0c0b2e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:36.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.643+0000 7fda111ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda0c15cec0 con 0x7fda0c0b29b0 2023-11-28T12:06:36.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.644+0000 7f0ab9fff700 1 -- 172.21.15.45:0/4192859652 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0ab40afec0 con 0x7f0ab40b16d0 2023-11-28T12:06:36.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.643+0000 7fda111ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda0c0b0230 con 0x7fda0c0d01b0 2023-11-28T12:06:36.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.643+0000 7fda111ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda0c0b4570 con 0x7fda0c0b20b0 2023-11-28T12:06:36.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.643+0000 7fda0b59e700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fda0c0b29b0 0x7fda0c0b2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:36.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.644+0000 7f7b81bff700 1 -- 172.21.15.45:0/2758668415 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b7c06b9e0 msgr2=0x7f7b7c06be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:36.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.644+0000 7f7b81bff700 1 --2- 172.21.15.45:0/2758668415 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b7c06b9e0 0x7f7b7c06be30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7b74009e50 tx=0x7f7b7400bbc0 comp rx=0 tx=0).stop 2023-11-28T12:06:36.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.645+0000 7f2432ffd700 1 -- 172.21.15.45:0/3926685670 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f2420023070 con 0x7f24340d01b0 2023-11-28T12:06:36.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.643+0000 7fda0b59e700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fda0c0b29b0 0x7fda0c0b2e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35918/0 (socket says 172.21.15.45:35918) 2023-11-28T12:06:36.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.645+0000 7f3b7d7fa700 1 -- 172.21.15.45:0/3811464814 <== osd.1 v2:172.21.15.45:6800/115842 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f3b640736c0 con 0x7f3b64070c00 2023-11-28T12:06:36.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.643+0000 7fda0b59e700 1 -- 172.21.15.45:0/1779780739 learned_addr learned my addr 172.21.15.45:0/1779780739 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:36.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.643+0000 7fda03fff700 1 --2- 172.21.15.45:0/1779780739 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fda0c0b20b0 0x7fda0c0d1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:36.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.644+0000 7fda0ad9d700 1 --2- 172.21.15.45:0/1779780739 >> v2:172.21.15.152:3300/0 conn(0x7fda0c0d01b0 0x7fda0c0d0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:36.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.644+0000 7fda0ad9d700 1 -- 172.21.15.45:0/1779780739 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fda0c0b20b0 msgr2=0x7fda0c0d1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:06:36.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.644+0000 7fda0ad9d700 1 --2- 172.21.15.45:0/1779780739 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fda0c0b20b0 0x7fda0c0d1160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:36.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.644+0000 7fda0ad9d700 1 -- 172.21.15.45:0/1779780739 >> v2:172.21.15.45:3300/0 conn(0x7fda0c0b29b0 msgr2=0x7fda0c0b2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:06:36.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.644+0000 7fda0ad9d700 1 --2- 172.21.15.45:0/1779780739 >> v2:172.21.15.45:3300/0 conn(0x7fda0c0b29b0 0x7fda0c0b2e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:36.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.644+0000 7fda0ad9d700 1 -- 172.21.15.45:0/1779780739 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda0c0b4850 con 0x7fda0c0d01b0 2023-11-28T12:06:36.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.644+0000 7fda0b59e700 1 --2- 172.21.15.45:0/1779780739 >> v2:172.21.15.45:3300/0 conn(0x7fda0c0b29b0 0x7fda0c0b2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:06:36.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.644+0000 7fda0ad9d700 1 --2- 172.21.15.45:0/1779780739 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda0c0d01b0 0x7fda0c0d0c20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fda0c0b5bb0 tx=0x7fd9fc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=32411119528fb4b8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:36.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.645+0000 7fda0a59c700 1 -- 172.21.15.45:0/1779780739 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9fc011830 con 0x7fda0c0d01b0 2023-11-28T12:06:36.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.645+0000 7fda0a59c700 1 -- 172.21.15.45:0/1779780739 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9fc011990 con 0x7fda0c0d01b0 2023-11-28T12:06:36.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.645+0000 7fda0a59c700 1 -- 172.21.15.45:0/1779780739 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9fc011d20 con 0x7fda0c0d01b0 2023-11-28T12:06:36.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.645+0000 7f7b81bff700 1 -- 172.21.15.45:0/2758668415 shutdown_connections 2023-11-28T12:06:36.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.645+0000 7f7b81bff700 1 --2- 172.21.15.45:0/2758668415 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b7c06b9e0 0x7f7b7c06be30 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:36.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.645+0000 7f7b81bff700 1 --2- 172.21.15.45:0/2758668415 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7b7c0ca900 0x7f7b7c0cad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:36.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.645+0000 7f7b81bff700 1 -- 172.21.15.45:0/2758668415 >> 172.21.15.45:0/2758668415 conn(0x7f7b7c0cb750 msgr2=0x7f7b7c0cbb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:36.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.646+0000 7fda111ff700 1 -- 172.21.15.45:0/1779780739 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda0c0d01b0 msgr2=0x7fda0c0d0c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:36.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.646+0000 7fda111ff700 1 --2- 172.21.15.45:0/1779780739 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda0c0d01b0 0x7fda0c0d0c20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fda0c0b5bb0 tx=0x7fd9fc009b50 comp rx=0 tx=0).stop 2023-11-28T12:06:36.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.646+0000 7f7b81bff700 1 -- 172.21.15.45:0/2758668415 shutdown_connections 2023-11-28T12:06:36.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.646+0000 7f7b81bff700 1 -- 172.21.15.45:0/2758668415 wait complete. 2023-11-28T12:06:36.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.644+0000 7f0a9bfff700 1 -- 172.21.15.45:0/4192859652 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f0aa4036070 con 0x7f0ab40b16d0 2023-11-28T12:06:36.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.646+0000 7f0a9bfff700 1 --2- 172.21.15.45:0/4192859652 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f0aa00683c0 0x7f0aa006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:36.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.646+0000 7f0a9bfff700 1 -- 172.21.15.45:0/4192859652 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0aa408fec0 con 0x7f0ab40b16d0 2023-11-28T12:06:36.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.646+0000 7f0a9bfff700 1 --2- 172.21.15.45:0/4192859652 >> [v2:172.21.15.45:6816/115848,v1:172.21.15.45:6818/115848] conn(0x7f0aa0070bf0 0x7f0aa0073000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:36.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.646+0000 7f0a9bfff700 1 -- 172.21.15.45:0/4192859652 --> [v2:172.21.15.45:6816/115848,v1:172.21.15.45:6818/115848] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0aa00736b0 con 0x7f0aa0070bf0 2023-11-28T12:06:36.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.647+0000 7fda111ff700 1 -- 172.21.15.45:0/1779780739 shutdown_connections 2023-11-28T12:06:36.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.647+0000 7fda111ff700 1 --2- 172.21.15.45:0/1779780739 >> v2:172.21.15.45:3300/0 conn(0x7fda0c0b29b0 0x7fda0c0b2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:36.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.647+0000 7fda111ff700 1 --2- 172.21.15.45:0/1779780739 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda0c0d01b0 0x7fda0c0d0c20 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:36.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.647+0000 7fda111ff700 1 --2- 172.21.15.45:0/1779780739 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fda0c0b20b0 0x7fda0c0d1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:36.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.647+0000 7fda111ff700 1 -- 172.21.15.45:0/1779780739 >> 172.21.15.45:0/1779780739 conn(0x7fda0c09c3f0 msgr2=0x7fda0c0d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:36.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.648+0000 7f7b81bff700 1 Processor -- start 2023-11-28T12:06:36.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.648+0000 7f181b1ff700 1 -- 172.21.15.45:0/335088075 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f18140afec0 con 0x7f18140d01b0 2023-11-28T12:06:36.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.647+0000 7f0ab3fff700 1 --2- 172.21.15.45:0/4192859652 >> [v2:172.21.15.45:6816/115848,v1:172.21.15.45:6818/115848] conn(0x7f0aa0070bf0 0x7f0aa0073000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:36.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.648+0000 7f0ab3fff700 1 --2- 172.21.15.45:0/4192859652 >> [v2:172.21.15.45:6816/115848,v1:172.21.15.45:6818/115848] conn(0x7f0aa0070bf0 0x7f0aa0073000 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:36.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.648+0000 7f0a9bfff700 1 -- 172.21.15.45:0/4192859652 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0aa405c6b0 con 0x7f0ab40b16d0 2023-11-28T12:06:36.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.648+0000 7f7b81bff700 1 -- start start 2023-11-28T12:06:36.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.649+0000 7f18117fa700 1 -- 172.21.15.45:0/335088075 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f1800019030 con 0x7f18140d01b0 2023-11-28T12:06:36.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.649+0000 7f7b81bff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b7c06b9e0 0x7f7b7c0b43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:36.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.649+0000 7f0a9bfff700 1 -- 172.21.15.45:0/4192859652 <== osd.3 v2:172.21.15.45:6816/115848 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f0aa00736b0 con 0x7f0aa0070bf0 2023-11-28T12:06:36.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.649+0000 7f7b81bff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7b7c0b0750 0x7f7b7c0c8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:36.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.650+0000 7f7b81bff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b7c0ca900 0x7f7b7c1514b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:36.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.650+0000 7f7b81bff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b7c0c71d0 con 0x7f7b7c06b9e0 2023-11-28T12:06:36.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.650+0000 7f7b81bff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b7c0c7490 con 0x7f7b7c0ca900 2023-11-28T12:06:36.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.650+0000 7f7b81bff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b7c0c7770 con 0x7f7b7c0b0750 2023-11-28T12:06:36.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.650+0000 7f2432ffd700 1 --2- 172.21.15.45:0/3926685670 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f24180683c0 0x7f241806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:36.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.650+0000 7fda111ff700 1 -- 172.21.15.45:0/1779780739 shutdown_connections 2023-11-28T12:06:36.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.650+0000 7f7b7b7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b7c06b9e0 0x7f7b7c0b43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:36.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.650+0000 7fda111ff700 1 -- 172.21.15.45:0/1779780739 wait complete. 2023-11-28T12:06:36.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.650+0000 7f2432ffd700 1 -- 172.21.15.45:0/3926685670 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2420085a80 con 0x7f24340d01b0 2023-11-28T12:06:36.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.650+0000 7f7b7b7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b7c06b9e0 0x7f7b7c0b43a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35928/0 (socket says 172.21.15.45:35928) 2023-11-28T12:06:36.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.650+0000 7f7b7b7fe700 1 -- 172.21.15.45:0/598118579 learned_addr learned my addr 172.21.15.45:0/598118579 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:36.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.651+0000 7f2432ffd700 1 --2- 172.21.15.45:0/3926685670 >> [v2:172.21.15.152:6815/116093,v1:172.21.15.152:6817/116093] conn(0x7f2418070c70 0x7f2418073080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:36.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.651+0000 7f2432ffd700 1 -- 172.21.15.45:0/3926685670 --> [v2:172.21.15.152:6815/116093,v1:172.21.15.152:6817/116093] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2418073730 con 0x7f2418070c70 2023-11-28T12:06:36.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.651+0000 7f2432ffd700 1 -- 172.21.15.45:0/3926685670 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f242008a2a0 con 0x7f24340d01b0 2023-11-28T12:06:36.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.651+0000 7f7b7b7fe700 1 -- 172.21.15.45:0/598118579 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7b7c0b0750 msgr2=0x7f7b7c0c8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:36.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.651+0000 7f7b7b7fe700 1 --2- 172.21.15.45:0/598118579 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7b7c0b0750 0x7f7b7c0c8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:36.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.651+0000 7f7b7b7fe700 1 -- 172.21.15.45:0/598118579 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b7c0ca900 msgr2=0x7f7b7c1514b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:36.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.651+0000 7f7b7b7fe700 1 --2- 172.21.15.45:0/598118579 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b7c0ca900 0x7f7b7c1514b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:36.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.651+0000 7f7b7b7fe700 1 -- 172.21.15.45:0/598118579 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b74009b30 con 0x7f7b7c06b9e0 2023-11-28T12:06:36.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.651+0000 7f18117fa700 1 --2- 172.21.15.45:0/335088075 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f17fc0683c0 0x7f17fc06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:36.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.651+0000 7f7b7b7fe700 1 --2- 172.21.15.45:0/598118579 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b7c06b9e0 0x7f7b7c0b43a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c009fc0 tx=0x7f7b6c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:36.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.651+0000 7f243a19b700 1 --2- 172.21.15.45:0/3926685670 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f24180683c0 0x7f241806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:36.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.651+0000 7f243a99c700 1 --2- 172.21.15.45:0/3926685670 >> [v2:172.21.15.152:6815/116093,v1:172.21.15.152:6817/116093] conn(0x7f2418070c70 0x7f2418073080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:36.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.652+0000 7f7b78ff9700 1 -- 172.21.15.45:0/598118579 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b6c010a30 con 0x7f7b7c06b9e0 2023-11-28T12:06:36.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.652+0000 7f7b78ff9700 1 -- 172.21.15.45:0/598118579 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b6c010bb0 con 0x7f7b7c06b9e0 2023-11-28T12:06:36.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.652+0000 7f7b78ff9700 1 -- 172.21.15.45:0/598118579 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b6c018440 con 0x7f7b7c06b9e0 2023-11-28T12:06:36.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.650+0000 7f0ab2ffd700 1 --2- 172.21.15.45:0/4192859652 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f0aa00683c0 0x7f0aa006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:36.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.652+0000 7f7b81bff700 1 -- 172.21.15.45:0/598118579 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b7c15ce00 con 0x7f7b7c06b9e0 2023-11-28T12:06:36.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.651+0000 7f0ab2ffd700 1 --2- 172.21.15.45:0/4192859652 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f0aa00683c0 0x7f0aa006a870 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0aa8006fd0 tx=0x7f0aa8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:36.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.652+0000 7f18117fa700 1 -- 172.21.15.45:0/335088075 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1800084cc0 con 0x7f18140d01b0 2023-11-28T12:06:36.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.652+0000 7f1818f9b700 1 --2- 172.21.15.45:0/335088075 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f17fc0683c0 0x7f17fc06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:36.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.652+0000 7f243a99c700 1 --2- 172.21.15.45:0/3926685670 >> [v2:172.21.15.152:6815/116093,v1:172.21.15.152:6817/116093] conn(0x7f2418070c70 0x7f2418073080 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:36.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.652+0000 7f243a19b700 1 --2- 172.21.15.45:0/3926685670 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f24180683c0 0x7f241806a870 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2428009f60 tx=0x7f24280094f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:36.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.653+0000 7f18117fa700 1 --2- 172.21.15.45:0/335088075 >> [v2:172.21.15.152:6800/116092,v1:172.21.15.152:6801/116092] conn(0x7f17fc070c70 0x7f17fc073080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:36.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.653+0000 7f18117fa700 1 -- 172.21.15.45:0/335088075 --> [v2:172.21.15.152:6800/116092,v1:172.21.15.152:6801/116092] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f17fc073730 con 0x7f17fc070c70 2023-11-28T12:06:36.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.653+0000 7f18117fa700 1 -- 172.21.15.45:0/335088075 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f18000872e0 con 0x7f18140d01b0 2023-11-28T12:06:36.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.653+0000 7fda111ff700 1 Processor -- start 2023-11-28T12:06:36.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.653+0000 7fda111ff700 1 -- start start 2023-11-28T12:06:36.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.652+0000 7f7b81bff700 1 -- 172.21.15.45:0/598118579 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b7c15cb20 con 0x7f7b7c06b9e0 2023-11-28T12:06:36.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.653+0000 7f7b81bff700 1 -- 172.21.15.45:0/598118579 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7b7c06fc60 con 0x7f7b7c06b9e0 2023-11-28T12:06:36.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.654+0000 7f1813fff700 1 --2- 172.21.15.45:0/335088075 >> [v2:172.21.15.152:6800/116092,v1:172.21.15.152:6801/116092] conn(0x7f17fc070c70 0x7f17fc073080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:36.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.654+0000 7f1813fff700 1 --2- 172.21.15.45:0/335088075 >> [v2:172.21.15.152:6800/116092,v1:172.21.15.152:6801/116092] conn(0x7f17fc070c70 0x7f17fc073080 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:36.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.655+0000 7f1818f9b700 1 --2- 172.21.15.45:0/335088075 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f17fc0683c0 0x7f17fc06a870 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f180c015040 tx=0x7f180c009000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:36.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.655+0000 7f2432ffd700 1 -- 172.21.15.45:0/3926685670 <== osd.5 v2:172.21.15.152:6815/116093 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f2418073730 con 0x7f2418070c70 2023-11-28T12:06:36.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.654+0000 7fda111ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fda0c0b20b0 0x7fda0c0cf570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:36.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.655+0000 7fda111ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda0c0b29b0 0x7fda0c0b7460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:36.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.655+0000 7fda111ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda0c0d01b0 0x7fda0c0b79a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:36.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.655+0000 7fda0ad9d700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fda0c0b20b0 0x7fda0c0cf570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:36.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.655+0000 7fda0ad9d700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fda0c0b20b0 0x7fda0c0cf570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.45:53694/0 (socket says 172.21.15.45:53694) 2023-11-28T12:06:36.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.655+0000 7fda0ad9d700 1 -- 172.21.15.45:0/847245676 learned_addr learned my addr 172.21.15.45:0/847245676 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:36.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.655+0000 7fda111ff700 1 -- 172.21.15.45:0/847245676 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda0c14ac10 con 0x7fda0c0b29b0 2023-11-28T12:06:36.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.655+0000 7f18117fa700 1 -- 172.21.15.45:0/335088075 <== osd.4 v2:172.21.15.152:6800/116092 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f17fc073730 con 0x7f17fc070c70 2023-11-28T12:06:36.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.655+0000 7fda111ff700 1 -- 172.21.15.45:0/847245676 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda0c0cf0e0 con 0x7fda0c0d01b0 2023-11-28T12:06:36.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.655+0000 7fda111ff700 1 -- 172.21.15.45:0/847245676 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda0c0ce7b0 con 0x7fda0c0b20b0 2023-11-28T12:06:36.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.655+0000 7fda0b59e700 1 --2- 172.21.15.45:0/847245676 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda0c0d01b0 0x7fda0c0b79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:36.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.656+0000 7fda0b59e700 1 -- 172.21.15.45:0/847245676 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fda0c0b20b0 msgr2=0x7fda0c0cf570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:36.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.656+0000 7fda0b59e700 1 --2- 172.21.15.45:0/847245676 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fda0c0b20b0 0x7fda0c0cf570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:36.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.656+0000 7fda0b59e700 1 -- 172.21.15.45:0/847245676 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda0c0b29b0 msgr2=0x7fda0c0b7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:36.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.656+0000 7fda0b59e700 1 --2- 172.21.15.45:0/847245676 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda0c0b29b0 0x7fda0c0b7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:36.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.656+0000 7fda0b59e700 1 -- 172.21.15.45:0/847245676 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda04009b30 con 0x7fda0c0d01b0 2023-11-28T12:06:36.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.656+0000 7f7b78ff9700 1 -- 172.21.15.45:0/598118579 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f7b6c01f030 con 0x7f7b7c06b9e0 2023-11-28T12:06:36.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.656+0000 7fda0ad9d700 1 --2- 172.21.15.45:0/847245676 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fda0c0b20b0 0x7fda0c0cf570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:06:36.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.656+0000 7fda0b59e700 1 --2- 172.21.15.45:0/847245676 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda0c0d01b0 0x7fda0c0b79a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fda0400efc0 tx=0x7fda0400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:36.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.657+0000 7fda037fe700 1 -- 172.21.15.45:0/847245676 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda04018070 con 0x7fda0c0d01b0 2023-11-28T12:06:36.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.657+0000 7fda111ff700 1 -- 172.21.15.45:0/847245676 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9fc0094a0 con 0x7fda0c0d01b0 2023-11-28T12:06:36.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.657+0000 7fda111ff700 1 -- 172.21.15.45:0/847245676 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda0c0afec0 con 0x7fda0c0d01b0 2023-11-28T12:06:36.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.657+0000 7fda037fe700 1 -- 172.21.15.45:0/847245676 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda0400f040 con 0x7fda0c0d01b0 2023-11-28T12:06:36.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.657+0000 7fda037fe700 1 -- 172.21.15.45:0/847245676 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda04018070 con 0x7fda0c0d01b0 2023-11-28T12:06:36.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.658+0000 7fda111ff700 1 -- 172.21.15.45:0/847245676 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fda0c0afbe0 con 0x7fda0c0d01b0 2023-11-28T12:06:36.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.658+0000 7f7b78ff9700 1 --2- 172.21.15.45:0/598118579 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f7b600683c0 0x7f7b6006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:36.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.658+0000 7f7b78ff9700 1 -- 172.21.15.45:0/598118579 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7b6c089d60 con 0x7f7b7c06b9e0 2023-11-28T12:06:36.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.658+0000 7f7b78ff9700 1 --2- 172.21.15.45:0/598118579 >> [v2:172.21.15.152:6808/116094,v1:172.21.15.152:6809/116094] conn(0x7f7b60070c70 0x7f7b60073080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:36.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.658+0000 7f7b78ff9700 1 -- 172.21.15.45:0/598118579 --> [v2:172.21.15.152:6808/116094,v1:172.21.15.152:6809/116094] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7b60073730 con 0x7f7b60070c70 2023-11-28T12:06:36.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.658+0000 7f7b78ff9700 1 -- 172.21.15.45:0/598118579 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7b6c08a110 con 0x7f7b7c06b9e0 2023-11-28T12:06:36.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.661+0000 7fda037fe700 1 -- 172.21.15.45:0/847245676 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fda04003a20 con 0x7fda0c0d01b0 2023-11-28T12:06:36.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.661+0000 7f7b73fff700 1 --2- 172.21.15.45:0/598118579 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f7b600683c0 0x7f7b6006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:36.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.662+0000 7f7b73fff700 1 --2- 172.21.15.45:0/598118579 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f7b600683c0 0x7f7b6006a870 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c06c700 tx=0x7f7b64006c30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:36.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.663+0000 7f7b7bfff700 1 --2- 172.21.15.45:0/598118579 >> [v2:172.21.15.152:6808/116094,v1:172.21.15.152:6809/116094] conn(0x7f7b60070c70 0x7f7b60073080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:36.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.663+0000 7fda037fe700 1 --2- 172.21.15.45:0/847245676 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fd9ec0683b0 0x7fd9ec06a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:36.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.663+0000 7fda037fe700 1 -- 172.21.15.45:0/847245676 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fda04086090 con 0x7fda0c0d01b0 2023-11-28T12:06:36.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.663+0000 7fda0ad9d700 1 --2- 172.21.15.45:0/847245676 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fd9ec0683b0 0x7fd9ec06a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:36.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.663+0000 7fda037fe700 1 --2- 172.21.15.45:0/847245676 >> [v2:172.21.15.152:6824/116097,v1:172.21.15.152:6825/116097] conn(0x7fd9ec070be0 0x7fd9ec072ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:36.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.664+0000 7f7b7bfff700 1 --2- 172.21.15.45:0/598118579 >> [v2:172.21.15.152:6808/116094,v1:172.21.15.152:6809/116094] conn(0x7f7b60070c70 0x7f7b60073080 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:36.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.664+0000 7fda037fe700 1 -- 172.21.15.45:0/847245676 --> [v2:172.21.15.152:6824/116097,v1:172.21.15.152:6825/116097] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd9ec0736a0 con 0x7fd9ec070be0 2023-11-28T12:06:36.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.664+0000 7fda037fe700 1 -- 172.21.15.45:0/847245676 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fda04018070 con 0x7fda0c0d01b0 2023-11-28T12:06:36.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.664+0000 7fda03fff700 1 --2- 172.21.15.45:0/847245676 >> [v2:172.21.15.152:6824/116097,v1:172.21.15.152:6825/116097] conn(0x7fd9ec070be0 0x7fd9ec072ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:36.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.665+0000 7fda0ad9d700 1 --2- 172.21.15.45:0/847245676 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fd9ec0683b0 0x7fd9ec06a860 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc013040 tx=0x7fd9fc010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:36.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.665+0000 7fda03fff700 1 --2- 172.21.15.45:0/847245676 >> [v2:172.21.15.152:6824/116097,v1:172.21.15.152:6825/116097] conn(0x7fd9ec070be0 0x7fd9ec072ff0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:36.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.665+0000 7f7b78ff9700 1 -- 172.21.15.45:0/598118579 <== osd.6 v2:172.21.15.152:6808/116094 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f7b60073730 con 0x7f7b60070c70 2023-11-28T12:06:36.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.668+0000 7fda037fe700 1 -- 172.21.15.45:0/847245676 <== osd.7 v2:172.21.15.152:6824/116097 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fd9ec0736a0 con 0x7fd9ec070be0 2023-11-28T12:06:36.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.674+0000 7f86c85ff700 1 -- 172.21.15.45:0/3212266462 --> [v2:172.21.15.45:6806/115843,v1:172.21.15.45:6808/115843] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f86a8002d40 con 0x7f86a4071800 2023-11-28T12:06:36.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.675+0000 7f86b6ffd700 1 -- 172.21.15.45:0/3212266462 <== osd.0 v2:172.21.15.45:6806/115843 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f86a8002d40 con 0x7f86a4071800 2023-11-28T12:06:36.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.676+0000 7f86c85ff700 1 -- 172.21.15.45:0/3212266462 >> [v2:172.21.15.45:6806/115843,v1:172.21.15.45:6808/115843] conn(0x7f86a4071800 msgr2=0x7f86a4073c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:36.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.676+0000 7f86c85ff700 1 --2- 172.21.15.45:0/3212266462 >> [v2:172.21.15.45:6806/115843,v1:172.21.15.45:6808/115843] conn(0x7f86a4071800 0x7f86a4073c90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:36.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.677+0000 7f86c85ff700 1 -- 172.21.15.45:0/3212266462 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f86a4068340 msgr2=0x7f86a406a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:36.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.677+0000 7f86c85ff700 1 --2- 172.21.15.45:0/3212266462 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f86a4068340 0x7f86a406a7f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f86bc006fd0 tx=0x7f86bc008040 comp rx=0 tx=0).stop 2023-11-28T12:06:36.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.677+0000 7f86c85ff700 1 -- 172.21.15.45:0/3212266462 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f86b803c720 msgr2=0x7f86b81735e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:36.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.677+0000 7f86c85ff700 1 --2- 172.21.15.45:0/3212266462 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f86b803c720 0x7f86b81735e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f86b0019000 tx=0x7f86b0004750 comp rx=0 tx=0).stop 2023-11-28T12:06:36.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.677+0000 7f86c6b9c700 1 -- 172.21.15.45:0/3212266462 reap_dead start 2023-11-28T12:06:36.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.677+0000 7f86c85ff700 1 -- 172.21.15.45:0/3212266462 shutdown_connections 2023-11-28T12:06:36.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.677+0000 7f86c85ff700 1 -- 172.21.15.45:0/3212266462 >> 172.21.15.45:0/3212266462 conn(0x7f86b800cf40 msgr2=0x7f86b8038580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:36.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.678+0000 7f86c85ff700 1 -- 172.21.15.45:0/3212266462 shutdown_connections 2023-11-28T12:06:36.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.678+0000 7f86c85ff700 1 -- 172.21.15.45:0/3212266462 wait complete. 2023-11-28T12:06:36.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.679+0000 7f3b6affd700 1 -- 172.21.15.45:0/3811464814 --> [v2:172.21.15.45:6800/115842,v1:172.21.15.45:6801/115842] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3b60002d40 con 0x7f3b64070c00 2023-11-28T12:06:36.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.679+0000 7f3b7d7fa700 1 -- 172.21.15.45:0/3811464814 <== osd.1 v2:172.21.15.45:6800/115842 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3b60002d40 con 0x7f3b64070c00 2023-11-28T12:06:36.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.680+0000 7f3b86dff700 1 -- 172.21.15.45:0/3811464814 >> [v2:172.21.15.45:6800/115842,v1:172.21.15.45:6801/115842] conn(0x7f3b64070c00 msgr2=0x7f3b64073010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:36.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.680+0000 7f3b86dff700 1 --2- 172.21.15.45:0/3811464814 >> [v2:172.21.15.45:6800/115842,v1:172.21.15.45:6801/115842] conn(0x7f3b64070c00 0x7f3b64073010 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:36.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.681+0000 7f3b86dff700 1 -- 172.21.15.45:0/3811464814 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f3b64068350 msgr2=0x7f3b6406a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:36.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.681+0000 7f3b86dff700 1 --2- 172.21.15.45:0/3811464814 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f3b64068350 0x7f3b6406a800 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3b78000ba0 tx=0x7f3b78008040 comp rx=0 tx=0).stop 2023-11-28T12:06:36.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.681+0000 7f3b86dff700 1 -- 172.21.15.45:0/3811464814 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b8006dab0 msgr2=0x7f3b8014be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:36.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.681+0000 7f3b86dff700 1 --2- 172.21.15.45:0/3811464814 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b8006dab0 0x7f3b8014be50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3b7400e950 tx=0x7f3b7400ec60 comp rx=0 tx=0).stop 2023-11-28T12:06:36.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.681+0000 7f3b8539c700 1 -- 172.21.15.45:0/3811464814 reap_dead start 2023-11-28T12:06:36.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.685+0000 7f3b86dff700 1 -- 172.21.15.45:0/3811464814 shutdown_connections 2023-11-28T12:06:36.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.685+0000 7f3b86dff700 1 -- 172.21.15.45:0/3811464814 >> 172.21.15.45:0/3811464814 conn(0x7f3b8006af00 msgr2=0x7f3b800cb060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:36.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.685+0000 7f80b3dff700 1 -- 172.21.15.45:0/4097890424 --> [v2:172.21.15.45:6817/115850,v1:172.21.15.45:6819/115850] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8094002d40 con 0x7f8090071850 2023-11-28T12:06:36.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.685+0000 7f3b86dff700 1 -- 172.21.15.45:0/3811464814 shutdown_connections 2023-11-28T12:06:36.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.685+0000 7f3b86dff700 1 -- 172.21.15.45:0/3811464814 wait complete. 2023-11-28T12:06:36.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.686+0000 7f80a27fc700 1 -- 172.21.15.45:0/4097890424 <== osd.2 v2:172.21.15.45:6817/115850 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8094002d40 con 0x7f8090071850 2023-11-28T12:06:36.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.687+0000 7f80b3dff700 1 -- 172.21.15.45:0/4097890424 >> [v2:172.21.15.45:6817/115850,v1:172.21.15.45:6819/115850] conn(0x7f8090071850 msgr2=0x7f8090073ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:36.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.687+0000 7f80b3dff700 1 --2- 172.21.15.45:0/4097890424 >> [v2:172.21.15.45:6817/115850,v1:172.21.15.45:6819/115850] conn(0x7f8090071850 0x7f8090073ce0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:36.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.687+0000 7f80b3dff700 1 -- 172.21.15.45:0/4097890424 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f8090068350 msgr2=0x7f809006a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:36.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.687+0000 7f80b3dff700 1 --2- 172.21.15.45:0/4097890424 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f8090068350 0x7f809006a800 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f80a80011e0 tx=0x7f80a8009040 comp rx=0 tx=0).stop 2023-11-28T12:06:36.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.687+0000 7f80b3dff700 1 -- 172.21.15.45:0/4097890424 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f80ac0cd7c0 msgr2=0x7f80ac1ff590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:36.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.687+0000 7f80b3dff700 1 --2- 172.21.15.45:0/4097890424 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f80ac0cd7c0 0x7f80ac1ff590 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f809c009fd0 tx=0x7f809c004750 comp rx=0 tx=0).stop 2023-11-28T12:06:36.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.688+0000 7f80b239c700 1 -- 172.21.15.45:0/4097890424 reap_dead start 2023-11-28T12:06:36.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.688+0000 7f80b3dff700 1 -- 172.21.15.45:0/4097890424 shutdown_connections 2023-11-28T12:06:36.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.688+0000 7f80b3dff700 1 -- 172.21.15.45:0/4097890424 >> 172.21.15.45:0/4097890424 conn(0x7f80ac072600 msgr2=0x7f80ac15a600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:36.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.688+0000 7f80b3dff700 1 -- 172.21.15.45:0/4097890424 shutdown_connections 2023-11-28T12:06:36.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.688+0000 7f80b3dff700 1 -- 172.21.15.45:0/4097890424 wait complete. 2023-11-28T12:06:36.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.691+0000 7f181b1ff700 1 -- 172.21.15.45:0/335088075 --> [v2:172.21.15.152:6800/116092,v1:172.21.15.152:6801/116092] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f18140cbcf0 con 0x7f17fc070c70 2023-11-28T12:06:36.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.690+0000 7f0ab9fff700 1 -- 172.21.15.45:0/4192859652 --> [v2:172.21.15.45:6816/115848,v1:172.21.15.45:6818/115848] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0ab4068690 con 0x7f0aa0070bf0 2023-11-28T12:06:36.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.691+0000 7f0a9bfff700 1 -- 172.21.15.45:0/4192859652 <== osd.3 v2:172.21.15.45:6816/115848 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0ab4068690 con 0x7f0aa0070bf0 2023-11-28T12:06:36.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.692+0000 7f243c3ff700 1 -- 172.21.15.45:0/3926685670 --> [v2:172.21.15.152:6815/116093,v1:172.21.15.152:6817/116093] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2434068690 con 0x7f2418070c70 2023-11-28T12:06:36.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.692+0000 7f0ab9fff700 1 -- 172.21.15.45:0/4192859652 >> [v2:172.21.15.45:6816/115848,v1:172.21.15.45:6818/115848] conn(0x7f0aa0070bf0 msgr2=0x7f0aa0073000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:36.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.692+0000 7f0ab9fff700 1 --2- 172.21.15.45:0/4192859652 >> [v2:172.21.15.45:6816/115848,v1:172.21.15.45:6818/115848] conn(0x7f0aa0070bf0 0x7f0aa0073000 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:36.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.692+0000 7f18117fa700 1 -- 172.21.15.45:0/335088075 <== osd.4 v2:172.21.15.152:6800/116092 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f18140cbcf0 con 0x7f17fc070c70 2023-11-28T12:06:36.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.693+0000 7f0ab9fff700 1 -- 172.21.15.45:0/4192859652 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f0aa00683c0 msgr2=0x7f0aa006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:36.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.693+0000 7f0ab9fff700 1 --2- 172.21.15.45:0/4192859652 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f0aa00683c0 0x7f0aa006a870 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0aa8006fd0 tx=0x7f0aa8008040 comp rx=0 tx=0).stop 2023-11-28T12:06:36.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.693+0000 7f0ab9fff700 1 -- 172.21.15.45:0/4192859652 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ab40b16d0 msgr2=0x7f0ab4151760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:36.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.693+0000 7f0ab9fff700 1 --2- 172.21.15.45:0/4192859652 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ab40b16d0 0x7f0ab4151760 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0aa4000c00 tx=0x7f0aa4004750 comp rx=0 tx=0).stop 2023-11-28T12:06:36.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.693+0000 7f181b1ff700 1 -- 172.21.15.45:0/335088075 >> [v2:172.21.15.152:6800/116092,v1:172.21.15.152:6801/116092] conn(0x7f17fc070c70 msgr2=0x7f17fc073080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:36.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.693+0000 7f2432ffd700 1 -- 172.21.15.45:0/3926685670 <== osd.5 v2:172.21.15.152:6815/116093 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2434068690 con 0x7f2418070c70 2023-11-28T12:06:36.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.693+0000 7f0ab3fff700 1 -- 172.21.15.45:0/4192859652 reap_dead start 2023-11-28T12:06:36.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.693+0000 7f181b1ff700 1 --2- 172.21.15.45:0/335088075 >> [v2:172.21.15.152:6800/116092,v1:172.21.15.152:6801/116092] conn(0x7f17fc070c70 0x7f17fc073080 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:36.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.693+0000 7f243c3ff700 1 -- 172.21.15.45:0/3926685670 >> [v2:172.21.15.152:6815/116093,v1:172.21.15.152:6817/116093] conn(0x7f2418070c70 msgr2=0x7f2418073080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:36.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.693+0000 7f243c3ff700 1 --2- 172.21.15.45:0/3926685670 >> [v2:172.21.15.152:6815/116093,v1:172.21.15.152:6817/116093] conn(0x7f2418070c70 0x7f2418073080 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:36.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.693+0000 7f181b1ff700 1 -- 172.21.15.45:0/335088075 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f17fc0683c0 msgr2=0x7f17fc06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:36.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.694+0000 7f181b1ff700 1 --2- 172.21.15.45:0/335088075 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f17fc0683c0 0x7f17fc06a870 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f180c015040 tx=0x7f180c009000 comp rx=0 tx=0).stop 2023-11-28T12:06:36.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.694+0000 7f243c3ff700 1 -- 172.21.15.45:0/3926685670 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f24180683c0 msgr2=0x7f241806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:36.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.694+0000 7f243c3ff700 1 --2- 172.21.15.45:0/3926685670 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f24180683c0 0x7f241806a870 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2428009f60 tx=0x7f24280094f0 comp rx=0 tx=0).stop 2023-11-28T12:06:36.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.694+0000 7f243c3ff700 1 -- 172.21.15.45:0/3926685670 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24340d01b0 msgr2=0x7f24340b8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:36.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.694+0000 7f243c3ff700 1 --2- 172.21.15.45:0/3926685670 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24340d01b0 0x7f24340b8110 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f242000e810 tx=0x7f242000ebd0 comp rx=0 tx=0).stop 2023-11-28T12:06:36.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.694+0000 7f243a99c700 1 -- 172.21.15.45:0/3926685670 reap_dead start 2023-11-28T12:06:36.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.694+0000 7f181b1ff700 1 -- 172.21.15.45:0/335088075 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f18140d01b0 msgr2=0x7f18140b60b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:36.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.694+0000 7f243c3ff700 1 -- 172.21.15.45:0/3926685670 shutdown_connections 2023-11-28T12:06:36.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.694+0000 7f243c3ff700 1 -- 172.21.15.45:0/3926685670 >> 172.21.15.45:0/3926685670 conn(0x7f243409c3f0 msgr2=0x7f243406b6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:36.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.694+0000 7f181b1ff700 1 --2- 172.21.15.45:0/335088075 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f18140d01b0 0x7f18140b60b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1800000f60 tx=0x7f180000cae0 comp rx=0 tx=0).stop 2023-11-28T12:06:36.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.695+0000 7f181979c700 1 -- 172.21.15.45:0/335088075 reap_dead start 2023-11-28T12:06:36.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.695+0000 7f243c3ff700 1 -- 172.21.15.45:0/3926685670 shutdown_connections 2023-11-28T12:06:36.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.695+0000 7f243c3ff700 1 -- 172.21.15.45:0/3926685670 wait complete. 2023-11-28T12:06:36.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.695+0000 7f181b1ff700 1 -- 172.21.15.45:0/335088075 shutdown_connections 2023-11-28T12:06:36.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.695+0000 7f181b1ff700 1 -- 172.21.15.45:0/335088075 >> 172.21.15.45:0/335088075 conn(0x7f181409c3f0 msgr2=0x7f181415c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:36.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.695+0000 7f181b1ff700 1 -- 172.21.15.45:0/335088075 shutdown_connections 2023-11-28T12:06:36.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.695+0000 7f7b81bff700 1 -- 172.21.15.45:0/598118579 --> [v2:172.21.15.152:6808/116094,v1:172.21.15.152:6809/116094] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7b7c0745c0 con 0x7f7b60070c70 2023-11-28T12:06:36.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.696+0000 7f0ab9fff700 1 -- 172.21.15.45:0/4192859652 shutdown_connections 2023-11-28T12:06:36.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.696+0000 7f0ab9fff700 1 -- 172.21.15.45:0/4192859652 >> 172.21.15.45:0/4192859652 conn(0x7f0ab409c3f0 msgr2=0x7f0ab415c1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:36.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.696+0000 7f0ab9fff700 1 -- 172.21.15.45:0/4192859652 shutdown_connections 2023-11-28T12:06:36.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.696+0000 7f0ab9fff700 1 -- 172.21.15.45:0/4192859652 wait complete. 2023-11-28T12:06:36.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.696+0000 7f181b1ff700 1 -- 172.21.15.45:0/335088075 wait complete. 2023-11-28T12:06:36.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.696+0000 7f7b78ff9700 1 -- 172.21.15.45:0/598118579 <== osd.6 v2:172.21.15.152:6808/116094 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7b7c0745c0 con 0x7f7b60070c70 2023-11-28T12:06:36.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.699+0000 7f7b81bff700 1 -- 172.21.15.45:0/598118579 >> [v2:172.21.15.152:6808/116094,v1:172.21.15.152:6809/116094] conn(0x7f7b60070c70 msgr2=0x7f7b60073080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:36.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.699+0000 7f7b81bff700 1 --2- 172.21.15.45:0/598118579 >> [v2:172.21.15.152:6808/116094,v1:172.21.15.152:6809/116094] conn(0x7f7b60070c70 0x7f7b60073080 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:36.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.699+0000 7f7b81bff700 1 -- 172.21.15.45:0/598118579 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f7b600683c0 msgr2=0x7f7b6006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:36.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.700+0000 7f7b81bff700 1 --2- 172.21.15.45:0/598118579 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f7b600683c0 0x7f7b6006a870 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c06c700 tx=0x7f7b64006c30 comp rx=0 tx=0).stop 2023-11-28T12:06:36.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.700+0000 7f7b81bff700 1 -- 172.21.15.45:0/598118579 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b7c06b9e0 msgr2=0x7f7b7c0b43a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:36.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.700+0000 7f7b81bff700 1 --2- 172.21.15.45:0/598118579 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b7c06b9e0 0x7f7b7c0b43a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c009fc0 tx=0x7f7b6c00b8e0 comp rx=0 tx=0).stop 2023-11-28T12:06:36.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.700+0000 7f7b7bfff700 1 -- 172.21.15.45:0/598118579 reap_dead start 2023-11-28T12:06:36.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.700+0000 7f7b81bff700 1 -- 172.21.15.45:0/598118579 shutdown_connections 2023-11-28T12:06:36.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.700+0000 7f7b81bff700 1 -- 172.21.15.45:0/598118579 >> 172.21.15.45:0/598118579 conn(0x7f7b7c0cb750 msgr2=0x7f7b7c0ae730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:36.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.700+0000 7f7b81bff700 1 -- 172.21.15.45:0/598118579 shutdown_connections 2023-11-28T12:06:36.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.701+0000 7f7b81bff700 1 -- 172.21.15.45:0/598118579 wait complete. 2023-11-28T12:06:36.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.703+0000 7fda111ff700 1 -- 172.21.15.45:0/847245676 --> [v2:172.21.15.152:6824/116097,v1:172.21.15.152:6825/116097] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fda0c0b2600 con 0x7fd9ec070be0 2023-11-28T12:06:36.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.704+0000 7fda037fe700 1 -- 172.21.15.45:0/847245676 <== osd.7 v2:172.21.15.152:6824/116097 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fda0c0b2600 con 0x7fd9ec070be0 2023-11-28T12:06:36.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.704+0000 7fda111ff700 1 -- 172.21.15.45:0/847245676 >> [v2:172.21.15.152:6824/116097,v1:172.21.15.152:6825/116097] conn(0x7fd9ec070be0 msgr2=0x7fd9ec072ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:36.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.704+0000 7fda111ff700 1 --2- 172.21.15.45:0/847245676 >> [v2:172.21.15.152:6824/116097,v1:172.21.15.152:6825/116097] conn(0x7fd9ec070be0 0x7fd9ec072ff0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:36.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.705+0000 7fda111ff700 1 -- 172.21.15.45:0/847245676 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fd9ec0683b0 msgr2=0x7fd9ec06a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:36.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.705+0000 7fda111ff700 1 --2- 172.21.15.45:0/847245676 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fd9ec0683b0 0x7fd9ec06a860 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc013040 tx=0x7fd9fc010000 comp rx=0 tx=0).stop 2023-11-28T12:06:36.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.705+0000 7fda111ff700 1 -- 172.21.15.45:0/847245676 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda0c0d01b0 msgr2=0x7fda0c0b79a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:36.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.705+0000 7fda111ff700 1 --2- 172.21.15.45:0/847245676 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda0c0d01b0 0x7fda0c0b79a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fda0400efc0 tx=0x7fda0400c3a0 comp rx=0 tx=0).stop 2023-11-28T12:06:36.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.705+0000 7fda0b59e700 1 -- 172.21.15.45:0/847245676 reap_dead start 2023-11-28T12:06:36.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.706+0000 7fda111ff700 1 -- 172.21.15.45:0/847245676 shutdown_connections 2023-11-28T12:06:36.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.706+0000 7fda111ff700 1 -- 172.21.15.45:0/847245676 >> 172.21.15.45:0/847245676 conn(0x7fda0c09c3f0 msgr2=0x7fda0c0d2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:36.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.706+0000 7fda111ff700 1 -- 172.21.15.45:0/847245676 shutdown_connections 2023-11-28T12:06:36.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:36.706+0000 7fda111ff700 1 -- 172.21.15.45:0/847245676 wait complete. 2023-11-28T12:06:36.734 INFO:teuthology.orchestra.run.smithi045.stdout:55834574853 2023-11-28T12:06:36.735 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-28T12:06:36.735 INFO:teuthology.orchestra.run.smithi045.stdout:55834574855 2023-11-28T12:06:36.736 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-28T12:06:36.736 INFO:teuthology.orchestra.run.smithi045.stdout:55834574854 2023-11-28T12:06:36.737 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-28T12:06:36.737 INFO:teuthology.orchestra.run.smithi045.stdout:55834574853 2023-11-28T12:06:36.738 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-28T12:06:36.738 INFO:teuthology.orchestra.run.smithi045.stdout:55834574853 2023-11-28T12:06:36.739 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-28T12:06:36.740 INFO:teuthology.orchestra.run.smithi045.stdout:55834574853 2023-11-28T12:06:36.740 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-28T12:06:36.740 INFO:teuthology.orchestra.run.smithi045.stdout:55834574854 2023-11-28T12:06:36.741 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-28T12:06:36.742 INFO:teuthology.orchestra.run.smithi045.stdout:55834574855 2023-11-28T12:06:36.742 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-28T12:06:37.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.139+0000 7f7d251ff700 1 Processor -- start 2023-11-28T12:06:37.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.139+0000 7f7d251ff700 1 -- start start 2023-11-28T12:06:37.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.141+0000 7f7d251ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f7d200d01b0 0x7f7d200d0c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:37.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.141+0000 7f7d251ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7d200b16d0 0x7f7d200d1160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:37.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.141+0000 7f7d251ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d200b0230 con 0x7f7d200b20b0 2023-11-28T12:06:37.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.141+0000 7f7d251ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d2015cec0 con 0x7f7d200d01b0 2023-11-28T12:06:37.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.141+0000 7f7d251ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d200b4570 con 0x7f7d200b16d0 2023-11-28T12:06:37.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.142+0000 7f7d1ed9d700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f7d200d01b0 0x7f7d200d0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:37.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.142+0000 7f7d1ed9d700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f7d200d01b0 0x7f7d200d0c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.45:44566/0 (socket says 172.21.15.45:44566) 2023-11-28T12:06:37.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.142+0000 7f7d1ed9d700 1 -- 172.21.15.45:0/905127818 learned_addr learned my addr 172.21.15.45:0/905127818 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:37.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.142+0000 7f7d1659c700 1 --1- 172.21.15.45:0/905127818 >> v1:172.21.15.45:6789/0 conn(0x7f7d200b20b0 0x7f7d200b29b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:32782/0 (socket says 172.21.15.45:32782) 2023-11-28T12:06:37.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.142+0000 7f7d1f59e700 1 --2- 172.21.15.45:0/905127818 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7d200b16d0 0x7f7d200d1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:37.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.143+0000 7f7d1f59e700 1 -- 172.21.15.45:0/905127818 >> v2:172.21.15.152:3300/0 conn(0x7f7d200d01b0 msgr2=0x7f7d200d0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:06:37.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.143+0000 7f7d1e59c700 1 -- 172.21.15.45:0/905127818 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2410374767 0 0) 0x7f7d200b0230 con 0x7f7d200b20b0 2023-11-28T12:06:37.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.143+0000 7f7d1f59e700 1 --2- 172.21.15.45:0/905127818 >> v2:172.21.15.152:3300/0 conn(0x7f7d200d01b0 0x7f7d200d0c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:37.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.143+0000 7f7d1f59e700 1 -- 172.21.15.45:0/905127818 >> v1:172.21.15.45:6789/0 conn(0x7f7d200b20b0 legacy=0x7f7d200b29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:37.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.143+0000 7f7d1f59e700 1 -- 172.21.15.45:0/905127818 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d200b4850 con 0x7f7d200b16d0 2023-11-28T12:06:37.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.143+0000 7f7d1ed9d700 1 --2- 172.21.15.45:0/905127818 >> v2:172.21.15.152:3300/0 conn(0x7f7d200d01b0 0x7f7d200d0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:06:37.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.144+0000 7f7d1f59e700 1 --2- 172.21.15.45:0/905127818 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7d200b16d0 0x7f7d200d1160 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7d18009840 tx=0x7f7d18009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a9dd108139739eb server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:37.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.146+0000 7f7d1e59c700 1 -- 172.21.15.45:0/905127818 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d18011830 con 0x7f7d200b16d0 2023-11-28T12:06:37.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.146+0000 7f7d1e59c700 1 -- 172.21.15.45:0/905127818 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d18011990 con 0x7f7d200b16d0 2023-11-28T12:06:37.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.146+0000 7f7d1e59c700 1 -- 172.21.15.45:0/905127818 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d18011d20 con 0x7f7d200b16d0 2023-11-28T12:06:37.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.147+0000 7f7d251ff700 1 -- 172.21.15.45:0/905127818 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7d200b16d0 msgr2=0x7f7d200d1160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:37.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.147+0000 7f7d251ff700 1 --2- 172.21.15.45:0/905127818 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7d200b16d0 0x7f7d200d1160 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7d18009840 tx=0x7f7d18009b50 comp rx=0 tx=0).stop 2023-11-28T12:06:37.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.151+0000 7f7d251ff700 1 -- 172.21.15.45:0/905127818 shutdown_connections 2023-11-28T12:06:37.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.151+0000 7f7d251ff700 1 --2- 172.21.15.45:0/905127818 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7d200b16d0 0x7f7d200d1160 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:37.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.151+0000 7f7d251ff700 1 --2- 172.21.15.45:0/905127818 >> v2:172.21.15.152:3300/0 conn(0x7f7d200d01b0 0x7f7d200d0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:37.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.151+0000 7f7d251ff700 1 -- 172.21.15.45:0/905127818 >> 172.21.15.45:0/905127818 conn(0x7f7d2009c3f0 msgr2=0x7f7d200d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:37.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.151+0000 7f7d251ff700 1 -- 172.21.15.45:0/905127818 shutdown_connections 2023-11-28T12:06:37.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.151+0000 7f7d251ff700 1 -- 172.21.15.45:0/905127818 wait complete. 2023-11-28T12:06:37.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.155+0000 7f2ef47ff700 1 Processor -- start 2023-11-28T12:06:37.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.155+0000 7f2ef47ff700 1 -- start start 2023-11-28T12:06:37.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.155+0000 7f7d251ff700 1 Processor -- start 2023-11-28T12:06:37.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.156+0000 7f6f7b9ff700 1 Processor -- start 2023-11-28T12:06:37.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.156+0000 7f6f7b9ff700 1 -- start start 2023-11-28T12:06:37.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.158+0000 7f6f7b9ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f6f7406d4f0 0x7f6f740b0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:37.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.157+0000 7f7d251ff700 1 -- start start 2023-11-28T12:06:37.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.158+0000 7f7d251ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7d200b16d0 0x7f7d2009cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:37.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.158+0000 7f7d251ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7d200b20b0 0x7f7d2009e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:37.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.158+0000 7f7d251ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d200d01b0 0x7f7d20153710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:37.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.158+0000 7f7d251ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d2009d2a0 con 0x7f7d200d01b0 2023-11-28T12:06:37.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.159+0000 7f7d251ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d2009ebc0 con 0x7f7d200b20b0 2023-11-28T12:06:37.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.159+0000 7f7d251ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d20153c50 con 0x7f7d200b16d0 2023-11-28T12:06:37.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.158+0000 7f6f7b9ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6f740b0bb0 0x7f6f7406b820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:37.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.158+0000 7f6f7b9ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f740b1010 con 0x7f6f74158890 2023-11-28T12:06:37.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.158+0000 7f6f7b9ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f7415c490 con 0x7f6f740b0bb0 2023-11-28T12:06:37.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.158+0000 7f6f7b9ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f7415c730 con 0x7f6f7406d4f0 2023-11-28T12:06:37.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.159+0000 7f7d1f59e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d200d01b0 0x7f7d20153710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:37.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.159+0000 7f6f79f9c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6f740b0bb0 0x7f6f7406b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:37.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.159+0000 7f6f7979b700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f6f74158890 0x7f6f740ce110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.45:55980/0 (socket says 172.21.15.45:55980) 2023-11-28T12:06:37.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.159+0000 7f6f7979b700 1 -- 172.21.15.45:0/1771197767 learned_addr learned my addr 172.21.15.45:0/1771197767 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:06:37.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.160+0000 7f6f79f9c700 1 -- 172.21.15.45:0/1771197767 >> v2:172.21.15.152:3300/0 conn(0x7f6f7406d4f0 msgr2=0x7f6f740b0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:06:37.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.160+0000 7f6f79f9c700 1 --2- 172.21.15.45:0/1771197767 >> v2:172.21.15.152:3300/0 conn(0x7f6f7406d4f0 0x7f6f740b0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:37.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.160+0000 7f6f79f9c700 1 -- 172.21.15.45:0/1771197767 >> v1:172.21.15.152:6789/0 conn(0x7f6f74158890 legacy=0x7f6f740ce110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:37.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.161+0000 7f6f79f9c700 1 -- 172.21.15.45:0/1771197767 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f7415ca10 con 0x7f6f740b0bb0 2023-11-28T12:06:37.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.161+0000 7f7d1f59e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d200d01b0 0x7f7d20153710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35938/0 (socket says 172.21.15.45:35938) 2023-11-28T12:06:37.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.161+0000 7f7d1f59e700 1 -- 172.21.15.45:0/1604448381 learned_addr learned my addr 172.21.15.45:0/1604448381 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:37.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.161+0000 7f7d1f59e700 1 -- 172.21.15.45:0/1604448381 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7d200b16d0 msgr2=0x7f7d2009cd60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-28T12:06:37.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.161+0000 7f7d1f59e700 1 --2- 172.21.15.45:0/1604448381 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7d200b16d0 0x7f7d2009cd60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:37.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.161+0000 7f7d1f59e700 1 -- 172.21.15.45:0/1604448381 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7d200b20b0 msgr2=0x7f7d2009e680 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-28T12:06:37.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.161+0000 7f7d1f59e700 1 --2- 172.21.15.45:0/1604448381 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7d200b20b0 0x7f7d2009e680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:37.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.161+0000 7f7d1f59e700 1 -- 172.21.15.45:0/1604448381 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d08009550 con 0x7f7d200d01b0 2023-11-28T12:06:37.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.161+0000 7f6f79f9c700 1 --2- 172.21.15.45:0/1771197767 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f740b0bb0 0x7f6f7406b820 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6f740669d0 tx=0x7f6f6c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3adefe0320aa204 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:37.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.162+0000 7f2ef47ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2eec158890 0x7f2eec0ce110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:37.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.162+0000 7f2ef47ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2eec0b0d80 0x7f2eec06b820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:37.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.162+0000 7f6f6bfff700 1 -- 172.21.15.45:0/1771197767 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f6c011830 con 0x7f6f740b0bb0 2023-11-28T12:06:37.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.162+0000 7f6f6bfff700 1 -- 172.21.15.45:0/1771197767 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f6c011990 con 0x7f6f740b0bb0 2023-11-28T12:06:37.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.162+0000 7f6f6bfff700 1 -- 172.21.15.45:0/1771197767 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f6c011830 con 0x7f6f740b0bb0 2023-11-28T12:06:37.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.162+0000 7f2ef47ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2eec15c490 con 0x7f2eec06d4f0 2023-11-28T12:06:37.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.162+0000 7f2ef259b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2eec158890 0x7f2eec0ce110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:37.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.162+0000 7f2ef259b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2eec158890 0x7f2eec0ce110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35958/0 (socket says 172.21.15.45:35958) 2023-11-28T12:06:37.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.162+0000 7f2ef259b700 1 -- 172.21.15.45:0/1950416972 learned_addr learned my addr 172.21.15.45:0/1950416972 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:37.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.162+0000 7f7d1f59e700 1 --2- 172.21.15.45:0/1604448381 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d200d01b0 0x7f7d20153710 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7d18009b90 tx=0x7f7d18004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:37.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.163+0000 7f6f7b9ff700 1 -- 172.21.15.45:0/1771197767 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f740b0bb0 msgr2=0x7f6f7406b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:37.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.164+0000 7f6f7b9ff700 1 --2- 172.21.15.45:0/1771197767 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f740b0bb0 0x7f6f7406b820 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6f740669d0 tx=0x7f6f6c009b20 comp rx=0 tx=0).stop 2023-11-28T12:06:37.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.164+0000 7f544bdff700 1 Processor -- start 2023-11-28T12:06:37.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.165+0000 7f6f7b9ff700 1 -- 172.21.15.45:0/1771197767 shutdown_connections 2023-11-28T12:06:37.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.165+0000 7f6f7b9ff700 1 --2- 172.21.15.45:0/1771197767 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f740b0bb0 0x7f6f7406b820 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:37.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.165+0000 7f6f7b9ff700 1 --2- 172.21.15.45:0/1771197767 >> v2:172.21.15.152:3300/0 conn(0x7f6f7406d4f0 0x7f6f740b0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:37.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.165+0000 7f6f7b9ff700 1 -- 172.21.15.45:0/1771197767 >> 172.21.15.45:0/1771197767 conn(0x7f6f740cb670 msgr2=0x7f6f740cba70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:37.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.165+0000 7f2ef2d9c700 1 --2- 172.21.15.45:0/1950416972 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2eec0b0d80 0x7f2eec06b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:37.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.163+0000 7f7d17fff700 1 -- 172.21.15.45:0/1604448381 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d180044d0 con 0x7f7d200d01b0 2023-11-28T12:06:37.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.163+0000 7f7d17fff700 1 -- 172.21.15.45:0/1604448381 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d1801f070 con 0x7f7d200d01b0 2023-11-28T12:06:37.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.163+0000 7f7d17fff700 1 -- 172.21.15.45:0/1604448381 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d180038e0 con 0x7f7d200d01b0 2023-11-28T12:06:37.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.163+0000 7f7d251ff700 1 -- 172.21.15.45:0/1604448381 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d180094a0 con 0x7f7d200d01b0 2023-11-28T12:06:37.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.163+0000 7f7d251ff700 1 -- 172.21.15.45:0/1604448381 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d200afec0 con 0x7f7d200d01b0 2023-11-28T12:06:37.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.165+0000 7f544bdff700 1 -- start start 2023-11-28T12:06:37.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.166+0000 7f2ef47ff700 1 -- 172.21.15.45:0/1950416972 --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2eec0ce650 con 0x7f2eec158890 2023-11-28T12:06:37.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.166+0000 7f2ef47ff700 1 -- 172.21.15.45:0/1950416972 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eec15c730 con 0x7f2eec0b0d80 2023-11-28T12:06:37.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.165+0000 7f7d251ff700 1 -- 172.21.15.45:0/1604448381 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d040052f0 con 0x7f7d200d01b0 2023-11-28T12:06:37.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.166+0000 7f6f7b9ff700 1 -- 172.21.15.45:0/1771197767 shutdown_connections 2023-11-28T12:06:37.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.167+0000 7f544bdff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5444158890 0x7f54440ce110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:37.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.167+0000 7f544bdff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f544406d4f0 0x7f54440b0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:37.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.167+0000 7f544bdff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f54440b0bb0 0x7f54440cc730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:37.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.167+0000 7f544bdff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54440b1030 con 0x7f5444158890 2023-11-28T12:06:37.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.167+0000 7f544bdff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f544415c490 con 0x7f54440b0bb0 2023-11-28T12:06:37.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.167+0000 7f544bdff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54440ce650 con 0x7f544406d4f0 2023-11-28T12:06:37.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.168+0000 7f544939a700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f544406d4f0 0x7f54440b0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:37.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.168+0000 7f544939a700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f544406d4f0 0x7f54440b0670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.45:53744/0 (socket says 172.21.15.45:53744) 2023-11-28T12:06:37.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.168+0000 7f544939a700 1 -- 172.21.15.45:0/817827997 learned_addr learned my addr 172.21.15.45:0/817827997 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:37.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.168+0000 7f544a39c700 1 --2- 172.21.15.45:0/817827997 >> v2:172.21.15.152:3300/0 conn(0x7f54440b0bb0 0x7f54440cc730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:37.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.166+0000 7f2ef1599700 1 -- 172.21.15.45:0/1950416972 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3001343311 0 0) 0x7f2eec15c490 con 0x7f2eec06d4f0 2023-11-28T12:06:37.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.167+0000 7f2ef1599700 1 -- 172.21.15.45:0/1950416972 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ed80079c0 con 0x7f2eec06d4f0 2023-11-28T12:06:37.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.166+0000 7f6f7b9ff700 1 -- 172.21.15.45:0/1771197767 wait complete. 2023-11-28T12:06:37.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.167+0000 7f2ef259b700 1 -- 172.21.15.45:0/1950416972 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2eec0b0d80 msgr2=0x7f2eec06b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:06:37.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.167+0000 7f2ef259b700 1 --2- 172.21.15.45:0/1950416972 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2eec0b0d80 0x7f2eec06b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:37.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.167+0000 7f2ef259b700 1 -- 172.21.15.45:0/1950416972 >> v1:172.21.15.152:6789/0 conn(0x7f2eec06d4f0 legacy=0x7f2eec0b0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:37.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.167+0000 7f2ef259b700 1 -- 172.21.15.45:0/1950416972 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eec15ca10 con 0x7f2eec158890 2023-11-28T12:06:37.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.169+0000 7f6f7b9ff700 1 Processor -- start 2023-11-28T12:06:37.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.169+0000 7f2ef259b700 1 --2- 172.21.15.45:0/1950416972 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2eec158890 0x7f2eec0ce110 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2ee800c760 tx=0x7f2ee800a450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fa71e3f8aca9528 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:37.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.169+0000 7f544939a700 1 -- 172.21.15.45:0/817827997 >> v2:172.21.15.152:3300/0 conn(0x7f54440b0bb0 msgr2=0x7f54440cc730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:06:37.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.169+0000 7f6f7b9ff700 1 -- start start 2023-11-28T12:06:37.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.169+0000 7f544939a700 1 --2- 172.21.15.45:0/817827997 >> v2:172.21.15.152:3300/0 conn(0x7f54440b0bb0 0x7f54440cc730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:37.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.170+0000 7f2ef1599700 1 -- 172.21.15.45:0/1950416972 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee800c480 con 0x7f2eec158890 2023-11-28T12:06:37.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.170+0000 7f2ef1599700 1 -- 172.21.15.45:0/1950416972 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ee80076f0 con 0x7f2eec158890 2023-11-28T12:06:37.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.169+0000 7f544939a700 1 -- 172.21.15.45:0/817827997 >> v2:172.21.15.45:3300/0 conn(0x7f5444158890 msgr2=0x7f54440ce110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:06:37.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.170+0000 7f5449b9b700 1 --2- 172.21.15.45:0/817827997 >> v2:172.21.15.45:3300/0 conn(0x7f5444158890 0x7f54440ce110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:37.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.170+0000 7f544939a700 1 --2- 172.21.15.45:0/817827997 >> v2:172.21.15.45:3300/0 conn(0x7f5444158890 0x7f54440ce110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:37.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.170+0000 7f544939a700 1 -- 172.21.15.45:0/817827997 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f544415c730 con 0x7f544406d4f0 2023-11-28T12:06:37.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.170+0000 7f5449b9b700 1 --2- 172.21.15.45:0/817827997 >> v2:172.21.15.45:3300/0 conn(0x7f5444158890 0x7f54440ce110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:06:37.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.170+0000 7fd5dcbff700 1 Processor -- start 2023-11-28T12:06:37.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.170+0000 7fd5dcbff700 1 -- start start 2023-11-28T12:06:37.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.171+0000 7f2ef1599700 1 -- 172.21.15.45:0/1950416972 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee800c480 con 0x7f2eec158890 2023-11-28T12:06:37.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.171+0000 7f544939a700 1 --2- 172.21.15.45:0/817827997 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f544406d4f0 0x7f54440b0670 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f544406d4a0 tx=0x7f544000d330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93d6cf12a810b609 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:37.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.171+0000 7f6f7b9ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6f7406d4f0 0x7f6f74149350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:37.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.171+0000 7f6f7b9ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6f740b0bb0 0x7f6f741f13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:37.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.171+0000 7f7d17fff700 1 -- 172.21.15.45:0/1604448381 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f7d1800f050 con 0x7f7d200d01b0 2023-11-28T12:06:37.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.172+0000 7f5448b99700 1 -- 172.21.15.45:0/817827997 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5440010070 con 0x7f544406d4f0 2023-11-28T12:06:37.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.172+0000 7fd5dcbff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fd5d8158890 0x7fd5d80ce110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:37.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.172+0000 7f5448b99700 1 -- 172.21.15.45:0/817827997 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f544000d9d0 con 0x7f544406d4f0 2023-11-28T12:06:37.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.172+0000 7f5448b99700 1 -- 172.21.15.45:0/817827997 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f544000dd60 con 0x7f544406d4f0 2023-11-28T12:06:37.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.172+0000 7fd5dcbff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5d815c490 con 0x7fd5d80b0d80 2023-11-28T12:06:37.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.172+0000 7fd5dcbff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5d80ce650 con 0x7fd5d806d4f0 2023-11-28T12:06:37.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.172+0000 7fd5dcbff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5d815c730 con 0x7fd5d8158890 2023-11-28T12:06:37.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.172+0000 7f6f7b9ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f74158890 0x7f6f741f1900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:37.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.172+0000 7f6f7979b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6f7406d4f0 0x7f6f74149350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:37.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.172+0000 7f6f7b9ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f7415a480 con 0x7f6f74158890 2023-11-28T12:06:37.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.172+0000 7f6f7b9ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f74157c50 con 0x7f6f7406d4f0 2023-11-28T12:06:37.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.172+0000 7f6f7b9ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f741f1f10 con 0x7f6f740b0bb0 2023-11-28T12:06:37.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.172+0000 7f6f7979b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6f7406d4f0 0x7f6f74149350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.45:44592/0 (socket says 172.21.15.45:44592) 2023-11-28T12:06:37.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.172+0000 7f6f7979b700 1 -- 172.21.15.45:0/3970923122 learned_addr learned my addr 172.21.15.45:0/3970923122 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:37.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.172+0000 7f6f78f9a700 1 --2- 172.21.15.45:0/3970923122 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6f740b0bb0 0x7f6f741f13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:37.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.172+0000 7f6f79f9c700 1 --2- 172.21.15.45:0/3970923122 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f74158890 0x7f6f741f1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:37.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.172+0000 7f6f78f9a700 1 -- 172.21.15.45:0/3970923122 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6f7406d4f0 msgr2=0x7f6f74149350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:37.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.173+0000 7f6f78f9a700 1 --2- 172.21.15.45:0/3970923122 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6f7406d4f0 0x7f6f74149350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:37.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.173+0000 7f6f78f9a700 1 -- 172.21.15.45:0/3970923122 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f74158890 msgr2=0x7f6f741f1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:37.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.173+0000 7f6f78f9a700 1 --2- 172.21.15.45:0/3970923122 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f74158890 0x7f6f741f1900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:37.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.173+0000 7fd5d5d9b700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fd5d806d4f0 0x7fd5d80b0670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.45:56010/0 (socket says 172.21.15.45:56010) 2023-11-28T12:06:37.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.173+0000 7fd5d5d9b700 1 -- 172.21.15.45:0/3164389513 learned_addr learned my addr 172.21.15.45:0/3164389513 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:06:37.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.173+0000 7f6f78f9a700 1 -- 172.21.15.45:0/3970923122 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f6c0094a0 con 0x7f6f740b0bb0 2023-11-28T12:06:37.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.173+0000 7f544bdff700 1 -- 172.21.15.45:0/817827997 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f544406d4f0 msgr2=0x7f54440b0670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:37.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.173+0000 7f544bdff700 1 --2- 172.21.15.45:0/817827997 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f544406d4f0 0x7f54440b0670 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f544406d4a0 tx=0x7f544000d330 comp rx=0 tx=0).stop 2023-11-28T12:06:37.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.173+0000 7f2ef47ff700 1 -- 172.21.15.45:0/1950416972 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2eec158890 msgr2=0x7f2eec0ce110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:37.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.173+0000 7f2ef47ff700 1 --2- 172.21.15.45:0/1950416972 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2eec158890 0x7f2eec0ce110 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2ee800c760 tx=0x7f2ee800a450 comp rx=0 tx=0).stop 2023-11-28T12:06:37.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.173+0000 7f6f79f9c700 1 --2- 172.21.15.45:0/3970923122 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f74158890 0x7f6f741f1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:06:37.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.173+0000 7f544bdff700 1 -- 172.21.15.45:0/817827997 shutdown_connections 2023-11-28T12:06:37.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.173+0000 7f544bdff700 1 --2- 172.21.15.45:0/817827997 >> v2:172.21.15.152:3300/0 conn(0x7f54440b0bb0 0x7f54440cc730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:37.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.173+0000 7f544bdff700 1 --2- 172.21.15.45:0/817827997 >> v2:172.21.15.45:3300/0 conn(0x7f5444158890 0x7f54440ce110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:37.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.173+0000 7f544bdff700 1 --2- 172.21.15.45:0/817827997 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f544406d4f0 0x7f54440b0670 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:37.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.173+0000 7f544bdff700 1 -- 172.21.15.45:0/817827997 >> 172.21.15.45:0/817827997 conn(0x7f54440cb670 msgr2=0x7f54440cba70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:37.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.174+0000 7f544bdff700 1 -- 172.21.15.45:0/817827997 shutdown_connections 2023-11-28T12:06:37.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.174+0000 7f544bdff700 1 -- 172.21.15.45:0/817827997 wait complete. 2023-11-28T12:06:37.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.173+0000 7f2ef47ff700 1 -- 172.21.15.45:0/1950416972 shutdown_connections 2023-11-28T12:06:37.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.173+0000 7f2ef47ff700 1 --2- 172.21.15.45:0/1950416972 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2eec0b0d80 0x7f2eec06b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:37.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.173+0000 7f2ef47ff700 1 --2- 172.21.15.45:0/1950416972 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2eec158890 0x7f2eec0ce110 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:37.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.173+0000 7f2ef47ff700 1 -- 172.21.15.45:0/1950416972 >> 172.21.15.45:0/1950416972 conn(0x7f2eec0cb670 msgr2=0x7f2eec0cba70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:37.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.174+0000 7fd5d559a700 1 -- 172.21.15.45:0/3164389513 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1260736706 0 0) 0x7fd5d80ce650 con 0x7fd5d806d4f0 2023-11-28T12:06:37.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.174+0000 7fd5d659c700 1 --2- 172.21.15.45:0/3164389513 >> v2:172.21.15.152:3300/0 conn(0x7fd5d8158890 0x7fd5d80ce110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:37.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.174+0000 7f6f78f9a700 1 --2- 172.21.15.45:0/3970923122 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6f740b0bb0 0x7f6f741f13c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6f7000bd70 tx=0x7f6f7000be50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:37.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.174+0000 7fd5d559a700 1 -- 172.21.15.45:0/3164389513 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5c00046c0 con 0x7fd5d806d4f0 2023-11-28T12:06:37.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.175+0000 7f6f69ffb700 1 -- 172.21.15.45:0/3970923122 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f7001dd60 con 0x7f6f740b0bb0 2023-11-28T12:06:37.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.175+0000 7f7d17fff700 1 --2- 172.21.15.45:0/1604448381 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f7d00068340 0x7f7d0006a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:37.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.175+0000 7f6f69ffb700 1 -- 172.21.15.45:0/3970923122 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f70025440 con 0x7f6f740b0bb0 2023-11-28T12:06:37.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.175+0000 7f6f7b9ff700 1 -- 172.21.15.45:0/3970923122 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f740c9370 con 0x7f6f740b0bb0 2023-11-28T12:06:37.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.175+0000 7f7d17fff700 1 -- 172.21.15.45:0/1604448381 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7d18021070 con 0x7f7d200d01b0 2023-11-28T12:06:37.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.175+0000 7f6f69ffb700 1 -- 172.21.15.45:0/3970923122 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f700257f0 con 0x7f6f740b0bb0 2023-11-28T12:06:37.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.176+0000 7fd5d559a700 1 -- 172.21.15.45:0/3164389513 <== mon.1 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3663749161 0 0) 0x7fd5c00046c0 con 0x7fd5d806d4f0 2023-11-28T12:06:37.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.176+0000 7fd5d559a700 1 -- 172.21.15.45:0/3164389513 >> v2:172.21.15.152:3300/0 conn(0x7fd5d8158890 msgr2=0x7fd5d80ce110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:06:37.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.176+0000 7fd5d559a700 1 --2- 172.21.15.45:0/3164389513 >> v2:172.21.15.152:3300/0 conn(0x7fd5d8158890 0x7fd5d80ce110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:37.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.176+0000 7fd5d559a700 1 -- 172.21.15.45:0/3164389513 >> v1:172.21.15.45:6789/0 conn(0x7fd5d80b0d80 legacy=0x7fd5d806b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:37.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.176+0000 7fd5d559a700 1 -- 172.21.15.45:0/3164389513 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5d815ca10 con 0x7fd5d806d4f0 2023-11-28T12:06:37.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.176+0000 7f6f7b9ff700 1 -- 172.21.15.45:0/3970923122 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f7415ccf0 con 0x7f6f740b0bb0 2023-11-28T12:06:37.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.177+0000 7f7d1ed9d700 1 --2- 172.21.15.45:0/1604448381 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f7d00068340 0x7f7d0006a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:37.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.176+0000 7f544bdff700 1 Processor -- start 2023-11-28T12:06:37.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.177+0000 7f544bdff700 1 -- start start 2023-11-28T12:06:37.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.177+0000 7f2ef47ff700 1 -- 172.21.15.45:0/1950416972 shutdown_connections 2023-11-28T12:06:37.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.177+0000 7f2ef47ff700 1 -- 172.21.15.45:0/1950416972 wait complete. 2023-11-28T12:06:37.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.176+0000 7fd5d559a700 1 -- 172.21.15.45:0/3164389513 <== mon.1 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3460218165 0 0) 0x7fd5cc004d60 con 0x7fd5d806d4f0 2023-11-28T12:06:37.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.176+0000 7fd5d559a700 1 -- 172.21.15.45:0/3164389513 >> v1:172.21.15.152:6789/0 conn(0x7fd5d806d4f0 legacy=0x7fd5d80b0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:37.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.176+0000 7fd5d559a700 1 --2- 172.21.15.45:0/3164389513 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5c0004b60 0x7fd5c0004f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:37.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.176+0000 7fd5d559a700 1 --2- 172.21.15.45:0/3164389513 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd5c0005960 0x7fd5c0005dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:37.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.176+0000 7fd5d559a700 1 --2- 172.21.15.45:0/3164389513 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5c0006310 0x7fd5c00034d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:37.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.176+0000 7fd5d559a700 1 -- 172.21.15.45:0/3164389513 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d815c730 con 0x7fd5c0006310 2023-11-28T12:06:37.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.176+0000 7fd5d559a700 1 -- 172.21.15.45:0/3164389513 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c0003bf0 con 0x7fd5c0004b60 2023-11-28T12:06:37.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.176+0000 7fd5d559a700 1 -- 172.21.15.45:0/3164389513 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c0003db0 con 0x7fd5c0005960 2023-11-28T12:06:37.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.176+0000 7fd5d6d9d700 1 --2- 172.21.15.45:0/3164389513 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5c0006310 0x7fd5c00034d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:37.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.177+0000 7fd5d6d9d700 1 -- 172.21.15.45:0/3164389513 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd5c0005960 msgr2=0x7fd5c0005dd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T12:06:37.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.177+0000 7fd5d6d9d700 1 --2- 172.21.15.45:0/3164389513 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd5c0005960 0x7fd5c0005dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:37.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.177+0000 7fd5d6d9d700 1 -- 172.21.15.45:0/3164389513 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5c0004b60 msgr2=0x7fd5c0004f70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-28T12:06:37.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.177+0000 7fd5d6d9d700 1 --2- 172.21.15.45:0/3164389513 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5c0004b60 0x7fd5c0004f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:37.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.178+0000 7fd5d6d9d700 1 -- 172.21.15.45:0/3164389513 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5c00046c0 con 0x7fd5c0006310 2023-11-28T12:06:37.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.178+0000 7fd5d6d9d700 1 -- 172.21.15.45:0/3164389513 reap_dead start 2023-11-28T12:06:37.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.178+0000 7fd5d6d9d700 1 --2- 172.21.15.45:0/3164389513 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5c0006310 0x7fd5c00034d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd5d80ca140 tx=0x7fd5c0006990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8012740676ba402 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:37.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.178+0000 7f544bdff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f544406d4f0 0x7f544414f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:37.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.178+0000 7f544bdff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f54440b0bb0 0x7f5444158c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:37.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.178+0000 7f544bdff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5444158890 0x7f544414fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:37.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.178+0000 7f544bdff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f544414f9f0 con 0x7f5444158890 2023-11-28T12:06:37.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.178+0000 7f544bdff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54440b2e50 con 0x7f54440b0bb0 2023-11-28T12:06:37.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.178+0000 7f544bdff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54440c7440 con 0x7f544406d4f0 2023-11-28T12:06:37.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.179+0000 7f544a39c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5444158890 0x7f544414fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:37.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.179+0000 7f6f7b9ff700 1 -- 172.21.15.45:0/3970923122 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f540052f0 con 0x7f6f740b0bb0 2023-11-28T12:06:37.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.179+0000 7f544939a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f54440b0bb0 0x7f5444158c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:37.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.179+0000 7f544939a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f54440b0bb0 0x7f5444158c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.45:44622/0 (socket says 172.21.15.45:44622) 2023-11-28T12:06:37.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.179+0000 7f544939a700 1 -- 172.21.15.45:0/1946667527 learned_addr learned my addr 172.21.15.45:0/1946667527 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:37.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.180+0000 7f5449b9b700 1 --2- 172.21.15.45:0/1946667527 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f544406d4f0 0x7f544414f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:37.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.180+0000 7f544939a700 1 -- 172.21.15.45:0/1946667527 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f544406d4f0 msgr2=0x7f544414f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:37.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.180+0000 7f2ef47ff700 1 Processor -- start 2023-11-28T12:06:37.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.180+0000 7f544939a700 1 --2- 172.21.15.45:0/1946667527 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f544406d4f0 0x7f544414f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:37.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.180+0000 7f544939a700 1 -- 172.21.15.45:0/1946667527 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5444158890 msgr2=0x7f544414fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:37.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.180+0000 7f544939a700 1 --2- 172.21.15.45:0/1946667527 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5444158890 0x7f544414fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:37.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.180+0000 7f544939a700 1 -- 172.21.15.45:0/1946667527 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54400085d0 con 0x7f54440b0bb0 2023-11-28T12:06:37.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.181+0000 7f7d1ed9d700 1 --2- 172.21.15.45:0/1604448381 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f7d00068340 0x7f7d0006a7f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7d200ce430 tx=0x7f7d080092c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:37.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.181+0000 7f6f69ffb700 1 -- 172.21.15.45:0/3970923122 <== mon.2 v2:172.21.15.152:3301/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f6f7002c030 con 0x7f6f740b0bb0 2023-11-28T12:06:37.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.181+0000 7f2ef47ff700 1 -- start start 2023-11-28T12:06:37.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.182+0000 7f544939a700 1 --2- 172.21.15.45:0/1946667527 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f54440b0bb0 0x7f5444158c60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f544000d370 tx=0x7f5440004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:37.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.182+0000 7f543a7fc700 1 -- 172.21.15.45:0/1946667527 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5440004510 con 0x7f54440b0bb0 2023-11-28T12:06:37.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.182+0000 7f543a7fc700 1 -- 172.21.15.45:0/1946667527 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54400036a0 con 0x7f54440b0bb0 2023-11-28T12:06:37.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.182+0000 7f6f69ffb700 1 --2- 172.21.15.45:0/3970923122 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f6f58068340 0x7f6f5806a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:37.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.182+0000 7f6f69ffb700 1 -- 172.21.15.45:0/3970923122 <== mon.2 v2:172.21.15.152:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6f70006e40 con 0x7f6f740b0bb0 2023-11-28T12:06:37.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.183+0000 7f543a7fc700 1 -- 172.21.15.45:0/1946667527 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5440003a30 con 0x7f54440b0bb0 2023-11-28T12:06:37.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.183+0000 7fc7f4f9d700 1 Processor -- start 2023-11-28T12:06:37.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.183+0000 7f2ef47ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2eec06d4f0 0x7f2eec15b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:37.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.183+0000 7fd5d559a700 1 -- 172.21.15.45:0/3164389513 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c80052d0 con 0x7fd5c0006310 2023-11-28T12:06:37.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.183+0000 7fd5d559a700 1 -- 172.21.15.45:0/3164389513 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5c8005430 con 0x7fd5c0006310 2023-11-28T12:06:37.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.183+0000 7fd5d559a700 1 -- 172.21.15.45:0/3164389513 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c80038c0 con 0x7fd5c0006310 2023-11-28T12:06:37.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.183+0000 7fc7f4f9d700 1 -- start start 2023-11-28T12:06:37.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.183+0000 7f7d17fff700 1 -- 172.21.15.45:0/1604448381 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f7d18053d30 con 0x7f7d200d01b0 2023-11-28T12:06:37.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.184+0000 7f544bdff700 1 -- 172.21.15.45:0/1946667527 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f544415ccf0 con 0x7f54440b0bb0 2023-11-28T12:06:37.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.184+0000 7f544bdff700 1 -- 172.21.15.45:0/1946667527 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f544415ca10 con 0x7f54440b0bb0 2023-11-28T12:06:37.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.183+0000 7f2ef47ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2eec0b0d80 0x7f2eec156ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:37.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.183+0000 7f2ef47ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2eec158890 0x7f2eec0c8010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:37.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.184+0000 7f2ef259b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2eec06d4f0 0x7f2eec15b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:37.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.184+0000 7f2ef259b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2eec06d4f0 0x7f2eec15b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36000/0 (socket says 172.21.15.45:36000) 2023-11-28T12:06:37.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.184+0000 7f2ef259b700 1 -- 172.21.15.45:0/531148959 learned_addr learned my addr 172.21.15.45:0/531148959 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:37.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.184+0000 7f2ef47ff700 1 -- 172.21.15.45:0/531148959 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eec159a60 con 0x7f2eec06d4f0 2023-11-28T12:06:37.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.184+0000 7f2ef47ff700 1 -- 172.21.15.45:0/531148959 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eec1493e0 con 0x7f2eec0b0d80 2023-11-28T12:06:37.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.184+0000 7f2ef47ff700 1 -- 172.21.15.45:0/531148959 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eec156ff0 con 0x7f2eec158890 2023-11-28T12:06:37.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.184+0000 7fd5dcbff700 1 -- 172.21.15.45:0/3164389513 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5c0006310 msgr2=0x7fd5c00034d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:37.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.184+0000 7fd5dcbff700 1 --2- 172.21.15.45:0/3164389513 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5c0006310 0x7fd5c00034d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd5d80ca140 tx=0x7fd5c0006990 comp rx=0 tx=0).stop 2023-11-28T12:06:37.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.185+0000 7fd5dcbff700 1 -- 172.21.15.45:0/3164389513 shutdown_connections 2023-11-28T12:06:37.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.185+0000 7fd5dcbff700 1 --2- 172.21.15.45:0/3164389513 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5c0006310 0x7fd5c00034d0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:37.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.185+0000 7f2ef1d9a700 1 --2- 172.21.15.45:0/531148959 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2eec0b0d80 0x7f2eec156ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:37.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.185+0000 7f2ef2d9c700 1 --2- 172.21.15.45:0/531148959 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2eec158890 0x7f2eec0c8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:37.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.185+0000 7fd5dcbff700 1 -- 172.21.15.45:0/3164389513 >> 172.21.15.45:0/3164389513 conn(0x7fd5d80cb670 msgr2=0x7fd5d80cba70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:37.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.185+0000 7fd5dcbff700 1 -- 172.21.15.45:0/3164389513 shutdown_connections 2023-11-28T12:06:37.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.185+0000 7f6f7979b700 1 --2- 172.21.15.45:0/3970923122 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f6f58068340 0x7f6f5806a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:37.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.185+0000 7f2ef2d9c700 1 -- 172.21.15.45:0/531148959 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2eec0b0d80 msgr2=0x7f2eec156ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:37.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.185+0000 7f2ef2d9c700 1 --2- 172.21.15.45:0/531148959 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2eec0b0d80 0x7f2eec156ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:37.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.186+0000 7f2ef2d9c700 1 -- 172.21.15.45:0/531148959 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2eec06d4f0 msgr2=0x7f2eec15b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:37.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.186+0000 7f2ef2d9c700 1 --2- 172.21.15.45:0/531148959 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2eec06d4f0 0x7f2eec15b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:37.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.186+0000 7f2ef2d9c700 1 -- 172.21.15.45:0/531148959 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ee8006070 con 0x7f2eec158890 2023-11-28T12:06:37.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.185+0000 7fd5dcbff700 1 -- 172.21.15.45:0/3164389513 wait complete. 2023-11-28T12:06:37.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.186+0000 7f2ef2d9c700 1 --2- 172.21.15.45:0/531148959 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2eec158890 0x7f2eec0c8010 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2ee4008330 tx=0x7f2ee4004320 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:37.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.186+0000 7f6f7979b700 1 --2- 172.21.15.45:0/3970923122 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f6f58068340 0x7f6f5806a7f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6f64007fd0 tx=0x7f6f64009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:37.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.187+0000 7f6f69ffb700 1 -- 172.21.15.45:0/3970923122 <== mon.2 v2:172.21.15.152:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f6f700633f0 con 0x7f6f740b0bb0 2023-11-28T12:06:37.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.187+0000 7f2ee2ffd700 1 -- 172.21.15.45:0/531148959 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee4018040 con 0x7f2eec158890 2023-11-28T12:06:37.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.187+0000 7f2ee2ffd700 1 -- 172.21.15.45:0/531148959 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ee400a2d0 con 0x7f2eec158890 2023-11-28T12:06:37.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.187+0000 7f2ee2ffd700 1 -- 172.21.15.45:0/531148959 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee401d680 con 0x7f2eec158890 2023-11-28T12:06:37.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.187+0000 7f40635ff700 1 Processor -- start 2023-11-28T12:06:37.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.187+0000 7f2ef47ff700 1 -- 172.21.15.45:0/531148959 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2eec0c9370 con 0x7f2eec158890 2023-11-28T12:06:37.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.187+0000 7f40635ff700 1 -- start start 2023-11-28T12:06:37.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.187+0000 7f2ef47ff700 1 -- 172.21.15.45:0/531148959 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2eec15ccf0 con 0x7f2eec158890 2023-11-28T12:06:37.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.187+0000 7f543a7fc700 1 -- 172.21.15.45:0/1946667527 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f5440014070 con 0x7f54440b0bb0 2023-11-28T12:06:37.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.188+0000 7f544bdff700 1 -- 172.21.15.45:0/1946667527 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54440c9370 con 0x7f54440b0bb0 2023-11-28T12:06:37.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.190+0000 7f543a7fc700 1 --2- 172.21.15.45:0/1946667527 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5428068340 0x7f542806a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:37.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.190+0000 7f543a7fc700 1 -- 172.21.15.45:0/1946667527 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5440087320 con 0x7f54440b0bb0 2023-11-28T12:06:37.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.190+0000 7f5449b9b700 1 --2- 172.21.15.45:0/1946667527 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5428068340 0x7f542806a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:37.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.189+0000 7f40635ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f405c06d4d0 0x7f405c0b0a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:37.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.189+0000 7f40635ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f405c06b820 0x7f405c06bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:37.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.189+0000 7f40635ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f405c0b0f80 con 0x7f405c0b0670 2023-11-28T12:06:37.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.189+0000 7f40635ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f405c0ad6e0 con 0x7f405c06b820 2023-11-28T12:06:37.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.189+0000 7f40635ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f405c0aca60 con 0x7f405c06d4d0 2023-11-28T12:06:37.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.189+0000 7fc7f4f9d700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fc7e803b3c0 0x7fc7e80ed610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:37.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.190+0000 7fc7f4f9d700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7e8007a10 con 0x7fc7e8038410 2023-11-28T12:06:37.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.190+0000 7fc7f4f9d700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7e8053880 con 0x7fc7e80558e0 2023-11-28T12:06:37.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.190+0000 7fc7effff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fc7e803b3c0 0x7fc7e80ed610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:37.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.190+0000 7fc7effff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fc7e803b3c0 0x7fc7e80ed610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.45:44640/0 (socket says 172.21.15.45:44640) 2023-11-28T12:06:37.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.190+0000 7fc7effff700 1 -- 172.21.15.45:0/2275327120 learned_addr learned my addr 172.21.15.45:0/2275327120 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:37.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.190+0000 7fc7f4f9d700 1 -- 172.21.15.45:0/2275327120 --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7e803c080 con 0x7fc7e803b3c0 2023-11-28T12:06:37.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.191+0000 7f406139b700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f405c0b0670 0x7f405c0cc730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:32824/0 (socket says 172.21.15.45:32824) 2023-11-28T12:06:37.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.191+0000 7f406139b700 1 -- 172.21.15.45:0/782399592 learned_addr learned my addr 172.21.15.45:0/782399592 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:06:37.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.190+0000 7f2ef47ff700 1 -- 172.21.15.45:0/531148959 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2eec158c60 con 0x7f2eec158890 2023-11-28T12:06:37.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.191+0000 7f4061b9c700 1 --2- 172.21.15.45:0/782399592 >> v2:172.21.15.45:3300/0 conn(0x7f405c06b820 0x7f405c06bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:37.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.191+0000 7f4060b9a700 1 --2- 172.21.15.45:0/782399592 >> v2:172.21.15.152:3300/0 conn(0x7f405c06d4d0 0x7f405c0b0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:37.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.192+0000 7fc7ee7fc700 1 -- 172.21.15.45:0/2275327120 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3186727882 0 0) 0x7fc7e8007a10 con 0x7fc7e8038410 2023-11-28T12:06:37.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.192+0000 7f2ee2ffd700 1 -- 172.21.15.45:0/531148959 <== mon.2 v2:172.21.15.152:3301/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f2ee401d7e0 con 0x7f2eec158890 2023-11-28T12:06:37.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.192+0000 7fc7ee7fc700 1 -- 172.21.15.45:0/2275327120 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7e00035b0 con 0x7fc7e8038410 2023-11-28T12:06:37.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.192+0000 7fd5dcbff700 1 Processor -- start 2023-11-28T12:06:37.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.192+0000 7f4061b9c700 1 -- 172.21.15.45:0/782399592 >> v2:172.21.15.152:3300/0 conn(0x7f405c06d4d0 msgr2=0x7f405c0b0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:06:37.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.192+0000 7f4061b9c700 1 --2- 172.21.15.45:0/782399592 >> v2:172.21.15.152:3300/0 conn(0x7f405c06d4d0 0x7f405c0b0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:37.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.192+0000 7f4061b9c700 1 -- 172.21.15.45:0/782399592 >> v1:172.21.15.45:6789/0 conn(0x7f405c0b0670 legacy=0x7f405c0cc730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:37.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.192+0000 7f4061b9c700 1 -- 172.21.15.45:0/782399592 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f405c0acd40 con 0x7f405c06b820 2023-11-28T12:06:37.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.192+0000 7fc7effff700 1 -- 172.21.15.45:0/2275327120 >> v1:172.21.15.152:6789/0 conn(0x7fc7e80558e0 legacy=0x7fc7e803acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:06:37.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.192+0000 7fc7effff700 1 -- 172.21.15.45:0/2275327120 >> v1:172.21.15.45:6789/0 conn(0x7fc7e8038410 legacy=0x7fc7e8006d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:37.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.192+0000 7fc7effff700 1 -- 172.21.15.45:0/2275327120 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7e8007730 con 0x7fc7e803b3c0 2023-11-28T12:06:37.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.192+0000 7f5449b9b700 1 --2- 172.21.15.45:0/1946667527 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5428068340 0x7f542806a7f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f54440b0b80 tx=0x7f5434008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:37.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.192+0000 7fd5dcbff700 1 -- start start 2023-11-28T12:06:37.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.193+0000 7f4061b9c700 1 --2- 172.21.15.45:0/782399592 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f405c06b820 0x7f405c06bca0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f404c009840 tx=0x7f404c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9501f34e1213a2ef server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:37.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.193+0000 7fc7effff700 1 --2- 172.21.15.45:0/2275327120 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7e803b3c0 0x7fc7e80ed610 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc7f0061e10 tx=0x7fc7f0068c60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5cfcc8b23bc6c114 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:37.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.193+0000 7f4053fff700 1 -- 172.21.15.45:0/782399592 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f404c011830 con 0x7f405c06b820 2023-11-28T12:06:37.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.193+0000 7f4053fff700 1 -- 172.21.15.45:0/782399592 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f404c011990 con 0x7f405c06b820 2023-11-28T12:06:37.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.193+0000 7f4053fff700 1 -- 172.21.15.45:0/782399592 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f404c011d20 con 0x7f405c06b820 2023-11-28T12:06:37.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.194+0000 7f2ee2ffd700 1 --2- 172.21.15.45:0/531148959 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f2ed00683c0 0x7f2ed006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:37.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.194+0000 7f2ee2ffd700 1 -- 172.21.15.45:0/531148959 <== mon.2 v2:172.21.15.152:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2ee408e360 con 0x7f2eec158890 2023-11-28T12:06:37.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.194+0000 7fc7ee7fc700 1 -- 172.21.15.45:0/2275327120 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f00671d0 con 0x7fc7e803b3c0 2023-11-28T12:06:37.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.194+0000 7f40635ff700 1 -- 172.21.15.45:0/782399592 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f405c06b820 msgr2=0x7f405c06bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:37.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.194+0000 7f40635ff700 1 --2- 172.21.15.45:0/782399592 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f405c06b820 0x7f405c06bca0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f404c009840 tx=0x7f404c009b50 comp rx=0 tx=0).stop 2023-11-28T12:06:37.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.194+0000 7fc7ee7fc700 1 -- 172.21.15.45:0/2275327120 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7f0067330 con 0x7fc7e803b3c0 2023-11-28T12:06:37.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.194+0000 7fc7ee7fc700 1 -- 172.21.15.45:0/2275327120 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f00676a0 con 0x7fc7e803b3c0 2023-11-28T12:06:37.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.195+0000 7f40635ff700 1 -- 172.21.15.45:0/782399592 shutdown_connections 2023-11-28T12:06:37.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.195+0000 7f40635ff700 1 --2- 172.21.15.45:0/782399592 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f405c06b820 0x7f405c06bca0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:37.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.195+0000 7f40635ff700 1 --2- 172.21.15.45:0/782399592 >> v2:172.21.15.152:3300/0 conn(0x7f405c06d4d0 0x7f405c0b0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:37.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.195+0000 7f40635ff700 1 -- 172.21.15.45:0/782399592 >> 172.21.15.45:0/782399592 conn(0x7f405c0cb670 msgr2=0x7f405c0cba70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:37.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.194+0000 7f2ef259b700 1 --2- 172.21.15.45:0/531148959 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f2ed00683c0 0x7f2ed006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:37.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.195+0000 7f543a7fc700 1 -- 172.21.15.45:0/1946667527 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f5440053b80 con 0x7f54440b0bb0 2023-11-28T12:06:37.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.195+0000 7f40635ff700 1 -- 172.21.15.45:0/782399592 shutdown_connections 2023-11-28T12:06:37.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.195+0000 7fd5dcbff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5c0006310 0x7fd5d80c5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:37.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.195+0000 7fd5dcbff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd5d8153460 0x7fd5d80c47e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:37.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.195+0000 7fd5dcbff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5d80c4d20 0x7fd5d815b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:37.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.195+0000 7fd5dcbff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d80c51c0 con 0x7fd5c0006310 2023-11-28T12:06:37.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.195+0000 7fd5dcbff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d8154210 con 0x7fd5d80c4d20 2023-11-28T12:06:37.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.195+0000 7fd5dcbff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d815bd70 con 0x7fd5d8153460 2023-11-28T12:06:37.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.196+0000 7f2ee2ffd700 1 -- 172.21.15.45:0/531148959 <== mon.2 v2:172.21.15.152:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f2ee40555e0 con 0x7f2eec158890 2023-11-28T12:06:37.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.197+0000 7f2ef259b700 1 --2- 172.21.15.45:0/531148959 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f2ed00683c0 0x7f2ed006a870 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2ee8000c00 tx=0x7f2ee8011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:37.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.195+0000 7f40635ff700 1 -- 172.21.15.45:0/782399592 wait complete. 2023-11-28T12:06:37.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.196+0000 7fc7f4f9d700 1 -- 172.21.15.45:0/2275327120 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7e803b3c0 msgr2=0x7fc7e80ed610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:37.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.196+0000 7fc7f4f9d700 1 --2- 172.21.15.45:0/2275327120 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7e803b3c0 0x7fc7e80ed610 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc7f0061e10 tx=0x7fc7f0068c60 comp rx=0 tx=0).stop 2023-11-28T12:06:37.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.198+0000 7fc7f4f9d700 1 -- 172.21.15.45:0/2275327120 shutdown_connections 2023-11-28T12:06:37.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.198+0000 7fc7f4f9d700 1 --2- 172.21.15.45:0/2275327120 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7e803b3c0 0x7fc7e80ed610 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:37.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.198+0000 7fc7f4f9d700 1 -- 172.21.15.45:0/2275327120 >> 172.21.15.45:0/2275327120 conn(0x7fc7e8055cb0 msgr2=0x7fc7e8056080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:37.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.198+0000 7f40635ff700 1 Processor -- start 2023-11-28T12:06:37.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.199+0000 7f580559d700 1 Processor -- start 2023-11-28T12:06:37.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.199+0000 7f580559d700 1 -- start start 2023-11-28T12:06:37.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.196+0000 7fd5d659c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5c0006310 0x7fd5d80c5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:37.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.200+0000 7f40635ff700 1 -- start start 2023-11-28T12:06:37.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.201+0000 7f580559d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f57f80e2800 0x7f57f8056f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:37.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.202+0000 7f40635ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f405c06b820 0x7f405c158700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:37.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.202+0000 7f40635ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f405c06d4d0 0x7f405c0c2690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:37.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.202+0000 7f580559d700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f57f8038520 0x7f57f80554c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:37.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.202+0000 7f580559d700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57f80e3980 con 0x7f57f803ac50 2023-11-28T12:06:37.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.202+0000 7f406139b700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f405c06b820 0x7f405c158700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:37.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.203+0000 7f406139b700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f405c06b820 0x7f405c158700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.45:53806/0 (socket says 172.21.15.45:53806) 2023-11-28T12:06:37.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.202+0000 7f40635ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f405c0b0670 0x7f405c156af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:37.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.203+0000 7f40635ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f405c0c3150 con 0x7f405c06d4d0 2023-11-28T12:06:37.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.203+0000 7f40635ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f405c0b2230 con 0x7f405c0b0670 2023-11-28T12:06:37.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.203+0000 7f5804d9c700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f57f803ac50 0x7f57f80066c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.45:56020/0 (socket says 172.21.15.45:56020) 2023-11-28T12:06:37.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.203+0000 7f5804d9c700 1 -- 172.21.15.45:0/1139034624 learned_addr learned my addr 172.21.15.45:0/1139034624 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:06:37.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.203+0000 7f40635ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f405c0b2510 con 0x7f405c06b820 2023-11-28T12:06:37.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.196+0000 7fd5d5d9b700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd5d8153460 0x7fd5d80c47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:37.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.196+0000 7fd5d659c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5c0006310 0x7fd5d80c5d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36024/0 (socket says 172.21.15.45:36024) 2023-11-28T12:06:37.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.196+0000 7fd5d659c700 1 -- 172.21.15.45:0/109727412 learned_addr learned my addr 172.21.15.45:0/109727412 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:37.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.203+0000 7f580559d700 1 -- 172.21.15.45:0/1139034624 --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57f80e3eb0 con 0x7f57f80e2800 2023-11-28T12:06:37.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.203+0000 7f406139b700 1 -- 172.21.15.45:0/568633515 learned_addr learned my addr 172.21.15.45:0/568633515 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:37.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.196+0000 7fd5d6d9d700 1 --2- 172.21.15.45:0/109727412 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5d80c4d20 0x7fd5d815b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:37.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.197+0000 7fd5d659c700 1 -- 172.21.15.45:0/109727412 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd5d8153460 msgr2=0x7fd5d80c47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:37.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.197+0000 7fd5d659c700 1 --2- 172.21.15.45:0/109727412 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd5d8153460 0x7fd5d80c47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:37.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.197+0000 7fd5d659c700 1 -- 172.21.15.45:0/109727412 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5d80c4d20 msgr2=0x7fd5d815b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:37.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.197+0000 7fd5d659c700 1 --2- 172.21.15.45:0/109727412 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5d80c4d20 0x7fd5d815b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:37.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.197+0000 7fd5d659c700 1 -- 172.21.15.45:0/109727412 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5d80c9370 con 0x7fd5c0006310 2023-11-28T12:06:37.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.198+0000 7fd5d659c700 1 --2- 172.21.15.45:0/109727412 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5c0006310 0x7fd5d80c5d70 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd5d000ee50 tx=0x7fd5d000b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:37.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.198+0000 7fd5c6ffd700 1 -- 172.21.15.45:0/109727412 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d0010040 con 0x7fd5c0006310 2023-11-28T12:06:37.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.198+0000 7fd5dcbff700 1 -- 172.21.15.45:0/109727412 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5d815ccf0 con 0x7fd5c0006310 2023-11-28T12:06:37.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.198+0000 7fd5dcbff700 1 -- 172.21.15.45:0/109727412 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5d8158c60 con 0x7fd5c0006310 2023-11-28T12:06:37.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.199+0000 7fd5c6ffd700 1 -- 172.21.15.45:0/109727412 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5d000bd30 con 0x7fd5c0006310 2023-11-28T12:06:37.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.199+0000 7fd5c6ffd700 1 -- 172.21.15.45:0/109727412 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d0010040 con 0x7fd5c0006310 2023-11-28T12:06:37.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.203+0000 7f580559d700 1 -- 172.21.15.45:0/1139034624 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57f8053950 con 0x7f57f8038520 2023-11-28T12:06:37.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.201+0000 7fd5dcbff700 1 -- 172.21.15.45:0/109727412 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5bc0052f0 con 0x7fd5c0006310 2023-11-28T12:06:37.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.202+0000 7fd5c6ffd700 1 -- 172.21.15.45:0/109727412 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fd5d001d400 con 0x7fd5c0006310 2023-11-28T12:06:37.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.203+0000 7f57ff7fe700 1 --2- 172.21.15.45:0/1139034624 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f57f8038520 0x7f57f80554c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:37.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.203+0000 7f57fffff700 1 --2- 172.21.15.45:0/1139034624 >> v2:172.21.15.45:3300/0 conn(0x7f57f80e2800 0x7f57f8056f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:37.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.203+0000 7fc7f4f9d700 1 -- 172.21.15.45:0/2275327120 shutdown_connections 2023-11-28T12:06:37.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.203+0000 7f57feffd700 1 -- 172.21.15.45:0/1139034624 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3053506767 0 0) 0x7f57f80e3980 con 0x7f57f803ac50 2023-11-28T12:06:37.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.203+0000 7f4061b9c700 1 --2- 172.21.15.45:0/568633515 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f405c0b0670 0x7f405c156af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:37.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.204+0000 7f406139b700 1 -- 172.21.15.45:0/568633515 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f405c0b0670 msgr2=0x7f405c156af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:37.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.204+0000 7f406139b700 1 --2- 172.21.15.45:0/568633515 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f405c0b0670 0x7f405c156af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:37.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.204+0000 7f406139b700 1 -- 172.21.15.45:0/568633515 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f405c06d4d0 msgr2=0x7f405c0c2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:37.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.204+0000 7f406139b700 1 --2- 172.21.15.45:0/568633515 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f405c06d4d0 0x7f405c0c2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:37.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.204+0000 7f406139b700 1 -- 172.21.15.45:0/568633515 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f404c0094a0 con 0x7f405c06b820 2023-11-28T12:06:37.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.204+0000 7f57feffd700 1 -- 172.21.15.45:0/1139034624 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57f00035b0 con 0x7f57f803ac50 2023-11-28T12:06:37.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.203+0000 7fc7f4f9d700 1 -- 172.21.15.45:0/2275327120 wait complete. 2023-11-28T12:06:37.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.204+0000 7f57ff7fe700 1 -- 172.21.15.45:0/1139034624 >> v2:172.21.15.45:3300/0 conn(0x7f57f80e2800 msgr2=0x7f57f8056f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:06:37.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.204+0000 7f57ff7fe700 1 --2- 172.21.15.45:0/1139034624 >> v2:172.21.15.45:3300/0 conn(0x7f57f80e2800 0x7f57f8056f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:37.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.204+0000 7f57feffd700 1 -- 172.21.15.45:0/1139034624 <== mon.1 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4064746129 0 0) 0x7f57f00035b0 con 0x7f57f803ac50 2023-11-28T12:06:37.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.204+0000 7f57ff7fe700 1 -- 172.21.15.45:0/1139034624 >> v1:172.21.15.152:6789/0 conn(0x7f57f803ac50 legacy=0x7f57f80066c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:37.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.204+0000 7f57ff7fe700 1 -- 172.21.15.45:0/1139034624 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57f80e3bd0 con 0x7f57f8038520 2023-11-28T12:06:37.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.205+0000 7f57ff7fe700 1 --2- 172.21.15.45:0/1139034624 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f57f8038520 0x7f57f80554c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f57f4009870 tx=0x7f57f4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=28aa01a9bffee481 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:37.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.204+0000 7f406139b700 1 --2- 172.21.15.45:0/568633515 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f405c06b820 0x7f405c158700 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f405400c480 tx=0x7f405400c840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:37.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.205+0000 7f57feffd700 1 -- 172.21.15.45:0/1139034624 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57ec001670 con 0x7f57f8038520 2023-11-28T12:06:37.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.206+0000 7f4051ffb700 1 -- 172.21.15.45:0/568633515 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4054005e30 con 0x7f405c06b820 2023-11-28T12:06:37.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.206+0000 7f4051ffb700 1 -- 172.21.15.45:0/568633515 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40540070d0 con 0x7f405c06b820 2023-11-28T12:06:37.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.206+0000 7f4051ffb700 1 -- 172.21.15.45:0/568633515 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4054005e30 con 0x7f405c06b820 2023-11-28T12:06:37.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.206+0000 7f57feffd700 1 -- 172.21.15.45:0/1139034624 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57f4004030 con 0x7f57f8038520 2023-11-28T12:06:37.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.206+0000 7f57feffd700 1 -- 172.21.15.45:0/1139034624 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57f40043a0 con 0x7f57f8038520 2023-11-28T12:06:37.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.207+0000 7f580559d700 1 -- 172.21.15.45:0/1139034624 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f57f8038520 msgr2=0x7f57f80554c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:37.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.207+0000 7f580559d700 1 --2- 172.21.15.45:0/1139034624 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f57f8038520 0x7f57f80554c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f57f4009870 tx=0x7f57f4009b80 comp rx=0 tx=0).stop 2023-11-28T12:06:37.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.207+0000 7fc7f4f9d700 1 Processor -- start 2023-11-28T12:06:37.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.207+0000 7fc7f4f9d700 1 -- start start 2023-11-28T12:06:37.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.206+0000 7f40635ff700 1 -- 172.21.15.45:0/568633515 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f405c0ad300 con 0x7f405c06b820 2023-11-28T12:06:37.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.206+0000 7f40635ff700 1 -- 172.21.15.45:0/568633515 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f405c0ad020 con 0x7f405c06b820 2023-11-28T12:06:37.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.209+0000 7fc7f4f9d700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc7e8038410 0x7fc7e80d8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:37.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.209+0000 7fc7f4f9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc7e803b3c0 0x7fc7e80505a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:37.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.209+0000 7fc7f4f9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7e80558e0 0x7fc7e80e4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:37.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.209+0000 7fc7f4f9d700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e804e010 con 0x7fc7e803b3c0 2023-11-28T12:06:37.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.209+0000 7fc7f4f9d700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e817c2e0 con 0x7fc7e80558e0 2023-11-28T12:06:37.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.209+0000 7fc7f4f9d700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e80d8940 con 0x7fc7e8038410 2023-11-28T12:06:37.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.209+0000 7f580559d700 1 -- 172.21.15.45:0/1139034624 shutdown_connections 2023-11-28T12:06:37.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.209+0000 7f580559d700 1 --2- 172.21.15.45:0/1139034624 >> v2:172.21.15.45:3300/0 conn(0x7f57f80e2800 0x7f57f8056f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:37.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.209+0000 7f580559d700 1 --2- 172.21.15.45:0/1139034624 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f57f8038520 0x7f57f80554c0 secure :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f57f4009870 tx=0x7f57f4009b80 comp rx=0 tx=0).stop 2023-11-28T12:06:37.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.209+0000 7f580559d700 1 -- 172.21.15.45:0/1139034624 >> 172.21.15.45:0/1139034624 conn(0x7f57f8055c50 msgr2=0x7f57f8056050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:37.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.210+0000 7fc7eeffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc7e803b3c0 0x7fc7e80505a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:37.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.210+0000 7fc7eeffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc7e803b3c0 0x7fc7e80505a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36050/0 (socket says 172.21.15.45:36050) 2023-11-28T12:06:37.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.210+0000 7fc7eeffd700 1 -- 172.21.15.45:0/2829223331 learned_addr learned my addr 172.21.15.45:0/2829223331 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:37.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.210+0000 7fc7ef7fe700 1 --2- 172.21.15.45:0/2829223331 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc7e8038410 0x7fc7e80d8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:37.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.210+0000 7fc7effff700 1 --2- 172.21.15.45:0/2829223331 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7e80558e0 0x7fc7e80e4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:37.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.210+0000 7fc7eeffd700 1 -- 172.21.15.45:0/2829223331 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc7e8038410 msgr2=0x7fc7e80d8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:37.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.210+0000 7fc7eeffd700 1 --2- 172.21.15.45:0/2829223331 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc7e8038410 0x7fc7e80d8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:37.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.211+0000 7f580559d700 1 -- 172.21.15.45:0/1139034624 shutdown_connections 2023-11-28T12:06:37.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.211+0000 7f580559d700 1 -- 172.21.15.45:0/1139034624 wait complete. 2023-11-28T12:06:37.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.211+0000 7f4051ffb700 1 -- 172.21.15.45:0/568633515 <== mon.2 v2:172.21.15.152:3301/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f4054019030 con 0x7f405c06b820 2023-11-28T12:06:37.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.210+0000 7fc7eeffd700 1 -- 172.21.15.45:0/2829223331 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7e80558e0 msgr2=0x7fc7e80e4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:37.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.210+0000 7fc7eeffd700 1 --2- 172.21.15.45:0/2829223331 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7e80558e0 0x7fc7e80e4600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:37.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.210+0000 7fc7eeffd700 1 -- 172.21.15.45:0/2829223331 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7f0068020 con 0x7fc7e803b3c0 2023-11-28T12:06:37.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.213+0000 7fc7effff700 1 --2- 172.21.15.45:0/2829223331 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7e80558e0 0x7fc7e80e4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:06:37.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.212+0000 7f40635ff700 1 -- 172.21.15.45:0/568633515 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f405c15caf0 con 0x7f405c06b820 2023-11-28T12:06:37.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.211+0000 7fd5c6ffd700 1 --2- 172.21.15.45:0/109727412 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fd5b80682e0 0x7fd5b806a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:37.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.212+0000 7fd5c6ffd700 1 -- 172.21.15.45:0/109727412 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd5d0086180 con 0x7fd5c0006310 2023-11-28T12:06:37.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.214+0000 7fd5c6ffd700 1 -- 172.21.15.45:0/109727412 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fd5d0052980 con 0x7fd5c0006310 2023-11-28T12:06:37.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.214+0000 7f580559d700 1 Processor -- start 2023-11-28T12:06:37.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.214+0000 7fd5d5d9b700 1 --2- 172.21.15.45:0/109727412 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fd5b80682e0 0x7fd5b806a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:37.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.215+0000 7fc7eeffd700 1 --2- 172.21.15.45:0/2829223331 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc7e803b3c0 0x7fc7e80505a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc00b4a0 tx=0x7fc7dc00b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:37.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.214+0000 7f580559d700 1 -- start start 2023-11-28T12:06:37.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.215+0000 7fd5d5d9b700 1 --2- 172.21.15.45:0/109727412 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fd5b80682e0 0x7fd5b806a790 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd5d8067d20 tx=0x7fd5d815c620 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:37.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.215+0000 7f4051ffb700 1 --2- 172.21.15.45:0/568633515 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f4040068350 0x7f404006a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:37.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.215+0000 7f4051ffb700 1 -- 172.21.15.45:0/568633515 <== mon.2 v2:172.21.15.152:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4054084bf0 con 0x7f405c06b820 2023-11-28T12:06:37.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.216+0000 7fc7dbfff700 1 -- 172.21.15.45:0/2829223331 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc011830 con 0x7fc7e803b3c0 2023-11-28T12:06:37.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.216+0000 7fc7dbfff700 1 -- 172.21.15.45:0/2829223331 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7dc011990 con 0x7fc7e803b3c0 2023-11-28T12:06:37.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.216+0000 7fc7dbfff700 1 -- 172.21.15.45:0/2829223331 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc011d40 con 0x7fc7e803b3c0 2023-11-28T12:06:37.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.217+0000 7f4060b9a700 1 --2- 172.21.15.45:0/568633515 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f4040068350 0x7f404006a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:37.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.217+0000 7fc7f4f9d700 1 -- 172.21.15.45:0/2829223331 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7e8053ad0 con 0x7fc7e803b3c0 2023-11-28T12:06:37.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.217+0000 7f580559d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57f803ac50 0x7f57f8052890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:37.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.217+0000 7f580559d700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f57f80e2800 0x7f57f8050cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:37.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.218+0000 7f580559d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57f80577a0 0x7f57f80d4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:37.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.218+0000 7fc7f4f9d700 1 -- 172.21.15.45:0/2829223331 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7e8054090 con 0x7fc7e803b3c0 2023-11-28T12:06:37.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.218+0000 7f57ff7fe700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f57f80e2800 0x7f57f8050cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:37.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.218+0000 7f57ff7fe700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f57f80e2800 0x7f57f8050cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.45:53834/0 (socket says 172.21.15.45:53834) 2023-11-28T12:06:37.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.218+0000 7f57fffff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57f803ac50 0x7f57f8052890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:37.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.218+0000 7f57fffff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57f803ac50 0x7f57f8052890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.45:44686/0 (socket says 172.21.15.45:44686) 2023-11-28T12:06:37.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.218+0000 7f580559d700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57f8052dd0 con 0x7f57f80577a0 2023-11-28T12:06:37.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.218+0000 7f580559d700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57f804d880 con 0x7f57f803ac50 2023-11-28T12:06:37.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.218+0000 7f580559d700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57f8051750 con 0x7f57f80e2800 2023-11-28T12:06:37.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.218+0000 7f57ff7fe700 1 -- 172.21.15.45:0/1700812559 learned_addr learned my addr 172.21.15.45:0/1700812559 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:37.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.219+0000 7f5804d9c700 1 --2- 172.21.15.45:0/1700812559 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57f80577a0 0x7f57f80d4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:37.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.219+0000 7f4060b9a700 1 --2- 172.21.15.45:0/568633515 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f4040068350 0x7f404006a800 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f40580070b0 tx=0x7f4058007040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:37.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.219+0000 7f57fffff700 1 -- 172.21.15.45:0/1700812559 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f57f80e2800 msgr2=0x7f57f8050cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:37.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.219+0000 7f57fffff700 1 --2- 172.21.15.45:0/1700812559 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f57f80e2800 0x7f57f8050cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:37.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.219+0000 7f57fffff700 1 -- 172.21.15.45:0/1700812559 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57f80577a0 msgr2=0x7f57f80d4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:37.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.219+0000 7f57fffff700 1 --2- 172.21.15.45:0/1700812559 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57f80577a0 0x7f57f80d4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:37.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.219+0000 7f57fffff700 1 -- 172.21.15.45:0/1700812559 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57f40094a0 con 0x7f57f803ac50 2023-11-28T12:06:37.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.219+0000 7f57ff7fe700 1 --2- 172.21.15.45:0/1700812559 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f57f80e2800 0x7f57f8050cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:06:37.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.219+0000 7f4051ffb700 1 -- 172.21.15.45:0/568633515 <== mon.2 v2:172.21.15.152:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f405404b5e0 con 0x7f405c06b820 2023-11-28T12:06:37.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.219+0000 7f57fffff700 1 --2- 172.21.15.45:0/1700812559 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57f803ac50 0x7f57f8052890 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f58000642d0 tx=0x7f5800068520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:37.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.220+0000 7f57fcff9700 1 -- 172.21.15.45:0/1700812559 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5800072970 con 0x7f57f803ac50 2023-11-28T12:06:37.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.220+0000 7f57fcff9700 1 -- 172.21.15.45:0/1700812559 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58000673d0 con 0x7f57f803ac50 2023-11-28T12:06:37.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.220+0000 7f57fcff9700 1 -- 172.21.15.45:0/1700812559 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5800067740 con 0x7f57f803ac50 2023-11-28T12:06:37.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.220+0000 7f580559d700 1 -- 172.21.15.45:0/1700812559 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57f8055a00 con 0x7f57f803ac50 2023-11-28T12:06:37.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.220+0000 7f580559d700 1 -- 172.21.15.45:0/1700812559 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57f8053bf0 con 0x7f57f803ac50 2023-11-28T12:06:37.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.221+0000 7f580559d700 1 -- 172.21.15.45:0/1700812559 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57f8053f60 con 0x7f57f803ac50 2023-11-28T12:06:37.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.222+0000 7fc7f4f9d700 1 -- 172.21.15.45:0/2829223331 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7e8053db0 con 0x7fc7e803b3c0 2023-11-28T12:06:37.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.223+0000 7f57fcff9700 1 -- 172.21.15.45:0/1700812559 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f580009a030 con 0x7f57f803ac50 2023-11-28T12:06:37.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.222+0000 7fc7dbfff700 1 -- 172.21.15.45:0/2829223331 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fc7dc00f050 con 0x7fc7e803b3c0 2023-11-28T12:06:37.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.224+0000 7fc7dbfff700 1 --2- 172.21.15.45:0/2829223331 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fc7d4068340 0x7fc7d406a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:37.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.224+0000 7fc7dbfff700 1 -- 172.21.15.45:0/2829223331 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc7dc085790 con 0x7fc7e803b3c0 2023-11-28T12:06:37.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.224+0000 7fc7ef7fe700 1 --2- 172.21.15.45:0/2829223331 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fc7d4068340 0x7fc7d406a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:37.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.226+0000 7f57fcff9700 1 --2- 172.21.15.45:0/1700812559 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f57e40683c0 0x7f57e406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:37.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.226+0000 7f57fcff9700 1 -- 172.21.15.45:0/1700812559 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f58001003e0 con 0x7f57f803ac50 2023-11-28T12:06:37.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.226+0000 7fc7ef7fe700 1 --2- 172.21.15.45:0/2829223331 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fc7d4068340 0x7fc7d406a7f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc7e40011e0 tx=0x7fc7e4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:37.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.226+0000 7f57ff7fe700 1 --2- 172.21.15.45:0/1700812559 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f57e40683c0 0x7f57e406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:37.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.227+0000 7f57ff7fe700 1 --2- 172.21.15.45:0/1700812559 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f57e40683c0 0x7f57e406a870 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f57f4009bc0 tx=0x7f57f401c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:37.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.230+0000 7f57fcff9700 1 -- 172.21.15.45:0/1700812559 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f58000d0600 con 0x7f57f803ac50 2023-11-28T12:06:37.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.233+0000 7fc7dbfff700 1 -- 172.21.15.45:0/2829223331 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fc7dc051f80 con 0x7fc7e803b3c0 2023-11-28T12:06:37.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.628+0000 7f6f7b9ff700 1 -- 172.21.15.45:0/3970923122 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6f540055a0 con 0x7f6f740b0bb0 2023-11-28T12:06:37.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.629+0000 7f6f69ffb700 1 -- 172.21.15.45:0/3970923122 <== mon.2 v2:172.21.15.152:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6f7002a020 con 0x7f6f740b0bb0 2023-11-28T12:06:37.633 INFO:teuthology.orchestra.run.smithi045.stdout:55834574853 2023-11-28T12:06:37.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.635+0000 7f6f7b9ff700 1 -- 172.21.15.45:0/3970923122 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f6f58068340 msgr2=0x7f6f5806a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:37.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.635+0000 7f6f7b9ff700 1 --2- 172.21.15.45:0/3970923122 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f6f58068340 0x7f6f5806a7f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6f64007fd0 tx=0x7f6f64009040 comp rx=0 tx=0).stop 2023-11-28T12:06:37.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.635+0000 7f6f7b9ff700 1 -- 172.21.15.45:0/3970923122 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6f740b0bb0 msgr2=0x7f6f741f13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:37.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.635+0000 7f6f7b9ff700 1 --2- 172.21.15.45:0/3970923122 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6f740b0bb0 0x7f6f741f13c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6f7000bd70 tx=0x7f6f7000be50 comp rx=0 tx=0).stop 2023-11-28T12:06:37.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.635+0000 7f6f7b9ff700 1 -- 172.21.15.45:0/3970923122 shutdown_connections 2023-11-28T12:06:37.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.635+0000 7f6f7b9ff700 1 --2- 172.21.15.45:0/3970923122 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f6f58068340 0x7f6f5806a7f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:37.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.635+0000 7f6f7b9ff700 1 --2- 172.21.15.45:0/3970923122 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6f7406d4f0 0x7f6f74149350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:37.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.635+0000 7f6f7b9ff700 1 --2- 172.21.15.45:0/3970923122 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f74158890 0x7f6f741f1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:37.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.635+0000 7f6f7b9ff700 1 --2- 172.21.15.45:0/3970923122 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6f740b0bb0 0x7f6f741f13c0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:37.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.635+0000 7f6f7b9ff700 1 -- 172.21.15.45:0/3970923122 >> 172.21.15.45:0/3970923122 conn(0x7f6f740cb670 msgr2=0x7f6f74153060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:37.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.636+0000 7f6f7b9ff700 1 -- 172.21.15.45:0/3970923122 shutdown_connections 2023-11-28T12:06:37.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.636+0000 7f6f7b9ff700 1 -- 172.21.15.45:0/3970923122 wait complete. 2023-11-28T12:06:37.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.657+0000 7f544bdff700 1 -- 172.21.15.45:0/1946667527 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f54440c7580 con 0x7f54440b0bb0 2023-11-28T12:06:37.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.658+0000 7f543a7fc700 1 -- 172.21.15.45:0/1946667527 <== mon.1 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f54440c7580 con 0x7f54440b0bb0 2023-11-28T12:06:37.661 INFO:teuthology.orchestra.run.smithi045.stdout:55834574851 2023-11-28T12:06:37.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.662+0000 7f7d251ff700 1 -- 172.21.15.45:0/1604448381 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7d040055a0 con 0x7f7d200d01b0 2023-11-28T12:06:37.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.662+0000 7f544bdff700 1 -- 172.21.15.45:0/1946667527 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5428068340 msgr2=0x7f542806a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:37.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.662+0000 7f544bdff700 1 --2- 172.21.15.45:0/1946667527 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5428068340 0x7f542806a7f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f54440b0b80 tx=0x7f5434008040 comp rx=0 tx=0).stop 2023-11-28T12:06:37.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.662+0000 7f544bdff700 1 -- 172.21.15.45:0/1946667527 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f54440b0bb0 msgr2=0x7f5444158c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:37.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.662+0000 7f544bdff700 1 --2- 172.21.15.45:0/1946667527 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f54440b0bb0 0x7f5444158c60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f544000d370 tx=0x7f5440004750 comp rx=0 tx=0).stop 2023-11-28T12:06:37.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.663+0000 7f7d17fff700 1 -- 172.21.15.45:0/1604448381 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7d18057350 con 0x7f7d200d01b0 2023-11-28T12:06:37.664 INFO:teuthology.orchestra.run.smithi045.stdout:55834574851 2023-11-28T12:06:37.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.663+0000 7f544bdff700 1 -- 172.21.15.45:0/1946667527 shutdown_connections 2023-11-28T12:06:37.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.663+0000 7f544bdff700 1 --2- 172.21.15.45:0/1946667527 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5428068340 0x7f542806a7f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:37.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.663+0000 7f544bdff700 1 --2- 172.21.15.45:0/1946667527 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5444158890 0x7f544414fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:37.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.663+0000 7f544bdff700 1 --2- 172.21.15.45:0/1946667527 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f544406d4f0 0x7f544414f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:37.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.663+0000 7f544bdff700 1 --2- 172.21.15.45:0/1946667527 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f54440b0bb0 0x7f5444158c60 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:37.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.663+0000 7f544bdff700 1 -- 172.21.15.45:0/1946667527 >> 172.21.15.45:0/1946667527 conn(0x7f54440cb670 msgr2=0x7f54440cd590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:37.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.664+0000 7f544bdff700 1 -- 172.21.15.45:0/1946667527 shutdown_connections 2023-11-28T12:06:37.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.664+0000 7f544bdff700 1 -- 172.21.15.45:0/1946667527 wait complete. 2023-11-28T12:06:37.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.668+0000 7f7d251ff700 1 -- 172.21.15.45:0/1604448381 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f7d00068340 msgr2=0x7f7d0006a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:37.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.668+0000 7f7d251ff700 1 --2- 172.21.15.45:0/1604448381 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f7d00068340 0x7f7d0006a7f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7d200ce430 tx=0x7f7d080092c0 comp rx=0 tx=0).stop 2023-11-28T12:06:37.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.668+0000 7f7d251ff700 1 -- 172.21.15.45:0/1604448381 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d200d01b0 msgr2=0x7f7d20153710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:37.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.668+0000 7f7d251ff700 1 --2- 172.21.15.45:0/1604448381 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d200d01b0 0x7f7d20153710 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7d18009b90 tx=0x7f7d18004750 comp rx=0 tx=0).stop 2023-11-28T12:06:37.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.668+0000 7f2ef47ff700 1 -- 172.21.15.45:0/531148959 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2eec0745c0 con 0x7f2eec158890 2023-11-28T12:06:37.670 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574853 for osd.1 2023-11-28T12:06:37.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.669+0000 7f2ee2ffd700 1 -- 172.21.15.45:0/531148959 <== mon.2 v2:172.21.15.152:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2ee405ab50 con 0x7f2eec158890 2023-11-28T12:06:37.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.669+0000 7f7d251ff700 1 -- 172.21.15.45:0/1604448381 shutdown_connections 2023-11-28T12:06:37.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.669+0000 7f7d251ff700 1 --2- 172.21.15.45:0/1604448381 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f7d00068340 0x7f7d0006a7f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:37.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.669+0000 7f7d251ff700 1 --2- 172.21.15.45:0/1604448381 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d200d01b0 0x7f7d20153710 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:37.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.669+0000 7f7d251ff700 1 --2- 172.21.15.45:0/1604448381 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7d200b16d0 0x7f7d2009cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:37.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.669+0000 7f7d251ff700 1 --2- 172.21.15.45:0/1604448381 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7d200b20b0 0x7f7d2009e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:37.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.669+0000 7f7d251ff700 1 -- 172.21.15.45:0/1604448381 >> 172.21.15.45:0/1604448381 conn(0x7f7d2009c3f0 msgr2=0x7f7d200cf7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:37.671 INFO:teuthology.orchestra.run.smithi045.stdout:55834574852 2023-11-28T12:06:37.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.669+0000 7f7d251ff700 1 -- 172.21.15.45:0/1604448381 shutdown_connections 2023-11-28T12:06:37.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.669+0000 7f7d251ff700 1 -- 172.21.15.45:0/1604448381 wait complete. 2023-11-28T12:06:37.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.673+0000 7f2ef47ff700 1 -- 172.21.15.45:0/531148959 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f2ed00683c0 msgr2=0x7f2ed006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:37.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.673+0000 7f2ef47ff700 1 --2- 172.21.15.45:0/531148959 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f2ed00683c0 0x7f2ed006a870 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2ee8000c00 tx=0x7f2ee8011000 comp rx=0 tx=0).stop 2023-11-28T12:06:37.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.673+0000 7f2ef47ff700 1 -- 172.21.15.45:0/531148959 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2eec158890 msgr2=0x7f2eec0c8010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:37.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.673+0000 7f2ef47ff700 1 --2- 172.21.15.45:0/531148959 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2eec158890 0x7f2eec0c8010 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2ee4008330 tx=0x7f2ee4004320 comp rx=0 tx=0).stop 2023-11-28T12:06:37.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.673+0000 7f2ef47ff700 1 -- 172.21.15.45:0/531148959 shutdown_connections 2023-11-28T12:06:37.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.673+0000 7f2ef47ff700 1 --2- 172.21.15.45:0/531148959 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f2ed00683c0 0x7f2ed006a870 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:37.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.673+0000 7f2ef47ff700 1 --2- 172.21.15.45:0/531148959 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2eec158890 0x7f2eec0c8010 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:37.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.673+0000 7f2ef47ff700 1 --2- 172.21.15.45:0/531148959 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2eec06d4f0 0x7f2eec15b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:37.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.673+0000 7f2ef47ff700 1 --2- 172.21.15.45:0/531148959 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2eec0b0d80 0x7f2eec156ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:37.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.673+0000 7f2ef47ff700 1 -- 172.21.15.45:0/531148959 >> 172.21.15.45:0/531148959 conn(0x7f2eec0cb670 msgr2=0x7f2eec0ca870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:37.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.674+0000 7f2ef47ff700 1 -- 172.21.15.45:0/531148959 shutdown_connections 2023-11-28T12:06:37.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.674+0000 7f2ef47ff700 1 -- 172.21.15.45:0/531148959 wait complete. 2023-11-28T12:06:37.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.679+0000 7fd5dcbff700 1 -- 172.21.15.45:0/109727412 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd5bc0055a0 con 0x7fd5c0006310 2023-11-28T12:06:37.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.681+0000 7fd5c6ffd700 1 -- 172.21.15.45:0/109727412 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd5d0055fa0 con 0x7fd5c0006310 2023-11-28T12:06:37.682 INFO:teuthology.orchestra.run.smithi045.stdout:55834574851 2023-11-28T12:06:37.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.681+0000 7fc7f4f9d700 1 -- 172.21.15.45:0/2829223331 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fc7e8005940 con 0x7fc7e803b3c0 2023-11-28T12:06:37.683 INFO:teuthology.orchestra.run.smithi045.stdout:55834574852 2023-11-28T12:06:37.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.682+0000 7fc7dbfff700 1 -- 172.21.15.45:0/2829223331 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc7dc0555a0 con 0x7fc7e803b3c0 2023-11-28T12:06:37.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.684+0000 7fc7f4f9d700 1 -- 172.21.15.45:0/2829223331 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fc7d4068340 msgr2=0x7fc7d406a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:37.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.684+0000 7fc7f4f9d700 1 --2- 172.21.15.45:0/2829223331 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fc7d4068340 0x7fc7d406a7f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc7e40011e0 tx=0x7fc7e4009040 comp rx=0 tx=0).stop 2023-11-28T12:06:37.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.685+0000 7fc7f4f9d700 1 -- 172.21.15.45:0/2829223331 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc7e803b3c0 msgr2=0x7fc7e80505a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:37.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.685+0000 7fc7f4f9d700 1 --2- 172.21.15.45:0/2829223331 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc7e803b3c0 0x7fc7e80505a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc00b4a0 tx=0x7fc7dc00b7b0 comp rx=0 tx=0).stop 2023-11-28T12:06:37.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.685+0000 7f40635ff700 1 -- 172.21.15.45:0/568633515 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f405c0b2650 con 0x7f405c06b820 2023-11-28T12:06:37.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.685+0000 7fc7f4f9d700 1 -- 172.21.15.45:0/2829223331 shutdown_connections 2023-11-28T12:06:37.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.685+0000 7fc7f4f9d700 1 --2- 172.21.15.45:0/2829223331 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fc7d4068340 0x7fc7d406a7f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:37.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.685+0000 7fc7f4f9d700 1 --2- 172.21.15.45:0/2829223331 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7e80558e0 0x7fc7e80e4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:37.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.685+0000 7fc7f4f9d700 1 --2- 172.21.15.45:0/2829223331 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc7e8038410 0x7fc7e80d8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:37.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.685+0000 7fc7f4f9d700 1 --2- 172.21.15.45:0/2829223331 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc7e803b3c0 0x7fc7e80505a0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:37.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.685+0000 7fc7f4f9d700 1 -- 172.21.15.45:0/2829223331 >> 172.21.15.45:0/2829223331 conn(0x7fc7e8055cb0 msgr2=0x7fc7e803a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:37.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.685+0000 7fc7f4f9d700 1 -- 172.21.15.45:0/2829223331 shutdown_connections 2023-11-28T12:06:37.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.685+0000 7fc7f4f9d700 1 -- 172.21.15.45:0/2829223331 wait complete. 2023-11-28T12:06:37.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.686+0000 7f4051ffb700 1 -- 172.21.15.45:0/568633515 <== mon.2 v2:172.21.15.152:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f405c0b2650 con 0x7f405c06b820 2023-11-28T12:06:37.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.686+0000 7fd5dcbff700 1 -- 172.21.15.45:0/109727412 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fd5b80682e0 msgr2=0x7fd5b806a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:37.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.686+0000 7fd5dcbff700 1 --2- 172.21.15.45:0/109727412 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fd5b80682e0 0x7fd5b806a790 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd5d8067d20 tx=0x7fd5d815c620 comp rx=0 tx=0).stop 2023-11-28T12:06:37.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.686+0000 7fd5dcbff700 1 -- 172.21.15.45:0/109727412 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5c0006310 msgr2=0x7fd5d80c5d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:37.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.686+0000 7fd5dcbff700 1 --2- 172.21.15.45:0/109727412 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5c0006310 0x7fd5d80c5d70 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd5d000ee50 tx=0x7fd5d000b390 comp rx=0 tx=0).stop 2023-11-28T12:06:37.688 INFO:teuthology.orchestra.run.smithi045.stdout:55834574851 2023-11-28T12:06:37.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.686+0000 7fd5dcbff700 1 -- 172.21.15.45:0/109727412 shutdown_connections 2023-11-28T12:06:37.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.686+0000 7fd5dcbff700 1 --2- 172.21.15.45:0/109727412 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fd5b80682e0 0x7fd5b806a790 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:37.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.686+0000 7fd5dcbff700 1 --2- 172.21.15.45:0/109727412 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5d80c4d20 0x7fd5d815b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:37.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.686+0000 7fd5dcbff700 1 --2- 172.21.15.45:0/109727412 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5c0006310 0x7fd5d80c5d70 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:37.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.686+0000 7fd5dcbff700 1 --2- 172.21.15.45:0/109727412 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd5d8153460 0x7fd5d80c47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:37.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.686+0000 7fd5dcbff700 1 -- 172.21.15.45:0/109727412 >> 172.21.15.45:0/109727412 conn(0x7fd5d80cb670 msgr2=0x7fd5d80ca900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:37.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.686+0000 7fd5dcbff700 1 -- 172.21.15.45:0/109727412 shutdown_connections 2023-11-28T12:06:37.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.686+0000 7fd5dcbff700 1 -- 172.21.15.45:0/109727412 wait complete. 2023-11-28T12:06:37.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.691+0000 7f40635ff700 1 -- 172.21.15.45:0/568633515 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f4040068350 msgr2=0x7f404006a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:37.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.691+0000 7f40635ff700 1 --2- 172.21.15.45:0/568633515 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f4040068350 0x7f404006a800 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f40580070b0 tx=0x7f4058007040 comp rx=0 tx=0).stop 2023-11-28T12:06:37.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.691+0000 7f40635ff700 1 -- 172.21.15.45:0/568633515 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f405c06b820 msgr2=0x7f405c158700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:37.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.691+0000 7f40635ff700 1 --2- 172.21.15.45:0/568633515 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f405c06b820 0x7f405c158700 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f405400c480 tx=0x7f405400c840 comp rx=0 tx=0).stop 2023-11-28T12:06:37.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.691+0000 7f40635ff700 1 -- 172.21.15.45:0/568633515 shutdown_connections 2023-11-28T12:06:37.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.691+0000 7f40635ff700 1 --2- 172.21.15.45:0/568633515 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f4040068350 0x7f404006a800 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:37.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.691+0000 7f40635ff700 1 --2- 172.21.15.45:0/568633515 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f405c0b0670 0x7f405c156af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:37.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.691+0000 7f40635ff700 1 --2- 172.21.15.45:0/568633515 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f405c06b820 0x7f405c158700 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:37.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.691+0000 7f40635ff700 1 --2- 172.21.15.45:0/568633515 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f405c06d4d0 0x7f405c0c2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:37.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.691+0000 7f40635ff700 1 -- 172.21.15.45:0/568633515 >> 172.21.15.45:0/568633515 conn(0x7f405c0cb670 msgr2=0x7f405c0afda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:37.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.692+0000 7f40635ff700 1 -- 172.21.15.45:0/568633515 shutdown_connections 2023-11-28T12:06:37.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.695+0000 7f40635ff700 1 -- 172.21.15.45:0/568633515 wait complete. 2023-11-28T12:06:37.697 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574851 for osd.4 2023-11-28T12:06:37.704 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574851 for osd.0 2023-11-28T12:06:37.704 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574852 for osd.2 2023-11-28T12:06:37.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.705+0000 7f580559d700 1 -- 172.21.15.45:0/1700812559 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f57f80054f0 con 0x7f57f803ac50 2023-11-28T12:06:37.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.706+0000 7f57fcff9700 1 -- 172.21.15.45:0/1700812559 <== mon.1 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5800098090 con 0x7f57f803ac50 2023-11-28T12:06:37.707 INFO:teuthology.orchestra.run.smithi045.stdout:55834574853 2023-11-28T12:06:37.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.710+0000 7f580559d700 1 -- 172.21.15.45:0/1700812559 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f57e40683c0 msgr2=0x7f57e406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:37.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.710+0000 7f580559d700 1 --2- 172.21.15.45:0/1700812559 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f57e40683c0 0x7f57e406a870 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f57f4009bc0 tx=0x7f57f401c040 comp rx=0 tx=0).stop 2023-11-28T12:06:37.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.710+0000 7f580559d700 1 -- 172.21.15.45:0/1700812559 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57f803ac50 msgr2=0x7f57f8052890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:37.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.710+0000 7f580559d700 1 --2- 172.21.15.45:0/1700812559 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57f803ac50 0x7f57f8052890 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f58000642d0 tx=0x7f5800068520 comp rx=0 tx=0).stop 2023-11-28T12:06:37.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.710+0000 7f580559d700 1 -- 172.21.15.45:0/1700812559 shutdown_connections 2023-11-28T12:06:37.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.710+0000 7f580559d700 1 --2- 172.21.15.45:0/1700812559 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f57e40683c0 0x7f57e406a870 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:37.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.710+0000 7f580559d700 1 --2- 172.21.15.45:0/1700812559 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57f803ac50 0x7f57f8052890 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:37.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.710+0000 7f580559d700 1 --2- 172.21.15.45:0/1700812559 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57f80577a0 0x7f57f80d4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:37.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.710+0000 7f580559d700 1 --2- 172.21.15.45:0/1700812559 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f57f80e2800 0x7f57f8050cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:37.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.710+0000 7f580559d700 1 -- 172.21.15.45:0/1700812559 >> 172.21.15.45:0/1700812559 conn(0x7f57f8055c50 msgr2=0x7f57f80e4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:37.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.710+0000 7f580559d700 1 -- 172.21.15.45:0/1700812559 shutdown_connections 2023-11-28T12:06:37.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:37.710+0000 7f580559d700 1 -- 172.21.15.45:0/1700812559 wait complete. 2023-11-28T12:06:37.712 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574852 for osd.5 2023-11-28T12:06:37.715 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574851 for osd.3 2023-11-28T12:06:37.728 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574851 for osd.6 2023-11-28T12:06:37.732 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574853 for osd.7 2023-11-28T12:06:38.673 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-28T12:06:38.698 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-28T12:06:38.705 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-28T12:06:38.706 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-28T12:06:38.713 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-28T12:06:38.716 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-28T12:06:38.729 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-28T12:06:38.733 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-28T12:06:39.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.012+0000 7f386e5ff700 1 Processor -- start 2023-11-28T12:06:39.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.012+0000 7f386e5ff700 1 -- start start 2023-11-28T12:06:39.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.014+0000 7f386e5ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3868158890 0x7f38680ce110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:39.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.015+0000 7f386e5ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f386806d4f0 0x7f38680b0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:39.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.015+0000 7f386e5ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f38680b0bb0 0x7f38680cc730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:39.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.015+0000 7f386e5ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38680b1030 con 0x7f386806d4f0 2023-11-28T12:06:39.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.015+0000 7f386e5ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f386815c490 con 0x7f38680b0bb0 2023-11-28T12:06:39.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.015+0000 7f386e5ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38680ce650 con 0x7f3868158890 2023-11-28T12:06:39.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.015+0000 7f386cb9c700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f38680b0bb0 0x7f38680cc730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:39.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.016+0000 7f386cb9c700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f38680b0bb0 0x7f38680cc730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.45:44692/0 (socket says 172.21.15.45:44692) 2023-11-28T12:06:39.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.016+0000 7f386cb9c700 1 -- 172.21.15.45:0/3604623330 learned_addr learned my addr 172.21.15.45:0/3604623330 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:39.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.016+0000 7f386cb9c700 1 -- 172.21.15.45:0/3604623330 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3868158890 msgr2=0x7f38680ce110 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-28T12:06:39.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.016+0000 7f386cb9c700 1 --2- 172.21.15.45:0/3604623330 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3868158890 0x7f38680ce110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:39.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.016+0000 7f386cb9c700 1 -- 172.21.15.45:0/3604623330 >> v2:172.21.15.45:3300/0 conn(0x7f386806d4f0 msgr2=0x7f38680b0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:06:39.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.016+0000 7f386cb9c700 1 --2- 172.21.15.45:0/3604623330 >> v2:172.21.15.45:3300/0 conn(0x7f386806d4f0 0x7f38680b0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:39.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.016+0000 7f386cb9c700 1 -- 172.21.15.45:0/3604623330 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f386815c730 con 0x7f38680b0bb0 2023-11-28T12:06:39.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.017+0000 7f386cb9c700 1 --2- 172.21.15.45:0/3604623330 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f38680b0bb0 0x7f38680cc730 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f386806d4a0 tx=0x7f3858009520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa912d6f1839ab3c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:39.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.017+0000 7f3866ffd700 1 -- 172.21.15.45:0/3604623330 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3858009bb0 con 0x7f38680b0bb0 2023-11-28T12:06:39.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.017+0000 7f3866ffd700 1 -- 172.21.15.45:0/3604623330 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3858009d10 con 0x7f38680b0bb0 2023-11-28T12:06:39.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.017+0000 7f3866ffd700 1 -- 172.21.15.45:0/3604623330 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f385800a0a0 con 0x7f38680b0bb0 2023-11-28T12:06:39.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.018+0000 7f386e5ff700 1 -- 172.21.15.45:0/3604623330 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f38680b0bb0 msgr2=0x7f38680cc730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:39.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.018+0000 7f386e5ff700 1 --2- 172.21.15.45:0/3604623330 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f38680b0bb0 0x7f38680cc730 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f386806d4a0 tx=0x7f3858009520 comp rx=0 tx=0).stop 2023-11-28T12:06:39.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.019+0000 7f386e5ff700 1 -- 172.21.15.45:0/3604623330 shutdown_connections 2023-11-28T12:06:39.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.019+0000 7f386e5ff700 1 --2- 172.21.15.45:0/3604623330 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3868158890 0x7f38680ce110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:39.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.019+0000 7f386e5ff700 1 --2- 172.21.15.45:0/3604623330 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f38680b0bb0 0x7f38680cc730 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:39.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.019+0000 7f386e5ff700 1 --2- 172.21.15.45:0/3604623330 >> v2:172.21.15.45:3300/0 conn(0x7f386806d4f0 0x7f38680b0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:39.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.019+0000 7f386e5ff700 1 -- 172.21.15.45:0/3604623330 >> 172.21.15.45:0/3604623330 conn(0x7f38680cb670 msgr2=0x7f38680cba70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:39.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.023+0000 7f386e5ff700 1 -- 172.21.15.45:0/3604623330 shutdown_connections 2023-11-28T12:06:39.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.023+0000 7f386e5ff700 1 -- 172.21.15.45:0/3604623330 wait complete. 2023-11-28T12:06:39.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.026+0000 7f386e5ff700 1 Processor -- start 2023-11-28T12:06:39.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.027+0000 7f386e5ff700 1 -- start start 2023-11-28T12:06:39.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.029+0000 7f386e5ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f386806d4f0 0x7f3868147110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:39.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.029+0000 7f386e5ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38680b0bb0 0x7f38680c3950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:39.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.030+0000 7f3867fff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f386806d4f0 0x7f3868147110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:39.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.030+0000 7f3867fff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f386806d4f0 0x7f3868147110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.45:53854/0 (socket says 172.21.15.45:53854) 2023-11-28T12:06:39.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.030+0000 7f3867fff700 1 -- 172.21.15.45:0/2411090817 learned_addr learned my addr 172.21.15.45:0/2411090817 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:39.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.030+0000 7f386e5ff700 1 --2- 172.21.15.45:0/2411090817 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3868158890 0x7f3868070d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:39.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.030+0000 7f386e5ff700 1 -- 172.21.15.45:0/2411090817 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3868147650 con 0x7f38680b0bb0 2023-11-28T12:06:39.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.030+0000 7f386e5ff700 1 -- 172.21.15.45:0/2411090817 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f386814fea0 con 0x7f3868158890 2023-11-28T12:06:39.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.030+0000 7f386e5ff700 1 -- 172.21.15.45:0/2411090817 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38680c43d0 con 0x7f386806d4f0 2023-11-28T12:06:39.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.030+0000 7f386cb9c700 1 --2- 172.21.15.45:0/2411090817 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3868158890 0x7f3868070d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:39.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.030+0000 7f38677fe700 1 --2- 172.21.15.45:0/2411090817 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38680b0bb0 0x7f38680c3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:39.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.031+0000 7f386cb9c700 1 -- 172.21.15.45:0/2411090817 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f386806d4f0 msgr2=0x7f3868147110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:39.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.031+0000 7f386cb9c700 1 --2- 172.21.15.45:0/2411090817 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f386806d4f0 0x7f3868147110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:39.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.031+0000 7f386cb9c700 1 -- 172.21.15.45:0/2411090817 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38680b0bb0 msgr2=0x7f38680c3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:39.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.031+0000 7f386cb9c700 1 --2- 172.21.15.45:0/2411090817 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38680b0bb0 0x7f38680c3950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:39.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.031+0000 7f386cb9c700 1 -- 172.21.15.45:0/2411090817 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f385800a5f0 con 0x7f3868158890 2023-11-28T12:06:39.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.031+0000 7f38677fe700 1 --2- 172.21.15.45:0/2411090817 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38680b0bb0 0x7f38680c3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:06:39.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.032+0000 7f3867fff700 1 --2- 172.21.15.45:0/2411090817 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f386806d4f0 0x7f3868147110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:06:39.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.032+0000 7f386cb9c700 1 --2- 172.21.15.45:0/2411090817 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3868158890 0x7f3868070d40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f385801f000 tx=0x7f3858004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:39.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.033+0000 7f3864ff9700 1 -- 172.21.15.45:0/2411090817 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3858028070 con 0x7f3868158890 2023-11-28T12:06:39.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.033+0000 7f386e5ff700 1 -- 172.21.15.45:0/2411090817 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f386815ccf0 con 0x7f3868158890 2023-11-28T12:06:39.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.033+0000 7f3864ff9700 1 -- 172.21.15.45:0/2411090817 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3858019850 con 0x7f3868158890 2023-11-28T12:06:39.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.033+0000 7f3864ff9700 1 -- 172.21.15.45:0/2411090817 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3858028070 con 0x7f3868158890 2023-11-28T12:06:39.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.035+0000 7f386e5ff700 1 -- 172.21.15.45:0/2411090817 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f386815ca10 con 0x7f3868158890 2023-11-28T12:06:39.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.036+0000 7f3864ff9700 1 -- 172.21.15.45:0/2411090817 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f3858033020 con 0x7f3868158890 2023-11-28T12:06:39.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.038+0000 7f386e5ff700 1 -- 172.21.15.45:0/2411090817 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38680c9370 con 0x7f3868158890 2023-11-28T12:06:39.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.038+0000 7f3864ff9700 1 --2- 172.21.15.45:0/2411090817 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f384c068320 0x7f384c06a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:39.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.039+0000 7f3864ff9700 1 -- 172.21.15.45:0/2411090817 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3858020360 con 0x7f3868158890 2023-11-28T12:06:39.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.039+0000 7f3867fff700 1 --2- 172.21.15.45:0/2411090817 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f384c068320 0x7f384c06a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:39.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.041+0000 7f3867fff700 1 --2- 172.21.15.45:0/2411090817 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f384c068320 0x7f384c06a7d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f385c006fd0 tx=0x7f385c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:39.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.046+0000 7f3864ff9700 1 -- 172.21.15.45:0/2411090817 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f385805b000 con 0x7f3868158890 2023-11-28T12:06:39.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.080+0000 7f53139ff700 1 Processor -- start 2023-11-28T12:06:39.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.081+0000 7f53139ff700 1 -- start start 2023-11-28T12:06:39.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.083+0000 7f53139ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f530c0c1fd0 0x7f530c161220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:39.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.083+0000 7f53139ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f530c164e60 0x7f530c1652e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:39.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.083+0000 7f53139ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f530c162210 con 0x7f530c0ce480 2023-11-28T12:06:39.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.083+0000 7f53139ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f530c161760 con 0x7f530c164e60 2023-11-28T12:06:39.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.083+0000 7f53139ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f530c1649d0 con 0x7f530c0c1fd0 2023-11-28T12:06:39.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.083+0000 7f5310f9a700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f530c0c1fd0 0x7f530c161220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:39.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.083+0000 7f5310f9a700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f530c0c1fd0 0x7f530c161220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.45:53856/0 (socket says 172.21.15.45:53856) 2023-11-28T12:06:39.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.083+0000 7f5310f9a700 1 -- 172.21.15.45:0/3062683918 learned_addr learned my addr 172.21.15.45:0/3062683918 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:39.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.084+0000 7f5311f9c700 1 --2- 172.21.15.45:0/3062683918 >> v2:172.21.15.152:3300/0 conn(0x7f530c164e60 0x7f530c1652e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:39.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.084+0000 7f5310f9a700 1 -- 172.21.15.45:0/3062683918 >> v2:172.21.15.152:3300/0 conn(0x7f530c164e60 msgr2=0x7f530c1652e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:06:39.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.085+0000 7f5310f9a700 1 --2- 172.21.15.45:0/3062683918 >> v2:172.21.15.152:3300/0 conn(0x7f530c164e60 0x7f530c1652e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:39.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.085+0000 7f5310f9a700 1 -- 172.21.15.45:0/3062683918 >> v1:172.21.15.152:6789/0 conn(0x7f530c0ce480 legacy=0x7f530c06b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:06:39.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.085+0000 7f5310f9a700 1 -- 172.21.15.45:0/3062683918 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f530c06c020 con 0x7f530c0c1fd0 2023-11-28T12:06:39.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.085+0000 7f5310f9a700 1 --2- 172.21.15.45:0/3062683918 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f530c0c1fd0 0x7f530c161220 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f53080098f0 tx=0x7f5308009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b785316434c97dfd server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:39.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.085+0000 7f5303fff700 1 -- 172.21.15.45:0/3062683918 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5308004230 con 0x7f530c0c1fd0 2023-11-28T12:06:39.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.085+0000 7f5303fff700 1 -- 172.21.15.45:0/3062683918 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5308004390 con 0x7f530c0c1fd0 2023-11-28T12:06:39.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.085+0000 7f5303fff700 1 -- 172.21.15.45:0/3062683918 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53080036a0 con 0x7f530c0c1fd0 2023-11-28T12:06:39.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.086+0000 7f53139ff700 1 -- 172.21.15.45:0/3062683918 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f530c0c1fd0 msgr2=0x7f530c161220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:39.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.086+0000 7f53139ff700 1 --2- 172.21.15.45:0/3062683918 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f530c0c1fd0 0x7f530c161220 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f53080098f0 tx=0x7f5308009c00 comp rx=0 tx=0).stop 2023-11-28T12:06:39.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.087+0000 7f53139ff700 1 -- 172.21.15.45:0/3062683918 shutdown_connections 2023-11-28T12:06:39.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.087+0000 7f53139ff700 1 --2- 172.21.15.45:0/3062683918 >> v2:172.21.15.152:3300/0 conn(0x7f530c164e60 0x7f530c1652e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:39.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.087+0000 7f53139ff700 1 --2- 172.21.15.45:0/3062683918 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f530c0c1fd0 0x7f530c161220 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:39.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.087+0000 7f53139ff700 1 -- 172.21.15.45:0/3062683918 >> 172.21.15.45:0/3062683918 conn(0x7f530c0cb670 msgr2=0x7f530c0cba70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:39.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.089+0000 7f53139ff700 1 -- 172.21.15.45:0/3062683918 shutdown_connections 2023-11-28T12:06:39.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.089+0000 7f53139ff700 1 -- 172.21.15.45:0/3062683918 wait complete. 2023-11-28T12:06:39.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.091+0000 7f08dd5ff700 1 Processor -- start 2023-11-28T12:06:39.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.091+0000 7f53139ff700 1 Processor -- start 2023-11-28T12:06:39.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.092+0000 7f53139ff700 1 -- start start 2023-11-28T12:06:39.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.093+0000 7f53139ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f530c0c1fd0 0x7f530c154070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:39.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.093+0000 7f53139ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f530c0ce480 0x7f530c071120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:39.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.093+0000 7f53139ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f530c164e60 0x7f530c071660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:39.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.093+0000 7f53139ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f530c15e550 con 0x7f530c0c1fd0 2023-11-28T12:06:39.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.093+0000 7f53139ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f530c0c5c30 con 0x7f530c164e60 2023-11-28T12:06:39.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.093+0000 7f53139ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f530c1545b0 con 0x7f530c0ce480 2023-11-28T12:06:39.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.091+0000 7f08dd5ff700 1 -- start start 2023-11-28T12:06:39.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.093+0000 7f08dd5ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f08d80d01b0 0x7f08d80d0c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:39.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.093+0000 7f08dd5ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f08d80b20b0 0x7f08d80d1160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:39.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.093+0000 7f08dd5ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08d80b0230 con 0x7f08d80b29b0 2023-11-28T12:06:39.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.094+0000 7f531179b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f530c0c1fd0 0x7f530c154070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:39.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.093+0000 7f08dd5ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08d815cec0 con 0x7f08d80b20b0 2023-11-28T12:06:39.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.093+0000 7f08dd5ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08d80b4570 con 0x7f08d80d01b0 2023-11-28T12:06:39.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.094+0000 7f531179b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f530c0c1fd0 0x7f530c154070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36090/0 (socket says 172.21.15.45:36090) 2023-11-28T12:06:39.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.094+0000 7f531179b700 1 -- 172.21.15.45:0/2856750653 learned_addr learned my addr 172.21.15.45:0/2856750653 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:39.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.095+0000 7f5310f9a700 1 --2- 172.21.15.45:0/2856750653 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f530c0ce480 0x7f530c071120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:39.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.096+0000 7f531179b700 1 -- 172.21.15.45:0/2856750653 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f530c0ce480 msgr2=0x7f530c071120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:39.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.096+0000 7f531179b700 1 --2- 172.21.15.45:0/2856750653 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f530c0ce480 0x7f530c071120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:39.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.096+0000 7f08d6ffd700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f08d80d01b0 0x7f08d80d0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:39.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.096+0000 7f531179b700 1 -- 172.21.15.45:0/2856750653 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f530c164e60 msgr2=0x7f530c071660 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-28T12:06:39.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.096+0000 7f531179b700 1 --2- 172.21.15.45:0/2856750653 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f530c164e60 0x7f530c071660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:39.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.096+0000 7f08d67fc700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f08d80b20b0 0x7f08d80d1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:39.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.096+0000 7f08d67fc700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f08d80b20b0 0x7f08d80d1160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36100/0 (socket says 172.21.15.45:36100) 2023-11-28T12:06:39.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.096+0000 7f08d67fc700 1 -- 172.21.15.45:0/1340788260 learned_addr learned my addr 172.21.15.45:0/1340788260 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:39.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.096+0000 7f531179b700 1 -- 172.21.15.45:0/2856750653 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5308009550 con 0x7f530c0c1fd0 2023-11-28T12:06:39.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.097+0000 7f08d67fc700 1 -- 172.21.15.45:0/1340788260 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f08d80d01b0 msgr2=0x7f08d80d0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:06:39.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.096+0000 7f08d77fe700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f08d80b29b0 0x7f08d80b2e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:32826/0 (socket says 172.21.15.45:32826) 2023-11-28T12:06:39.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.097+0000 7f08d67fc700 1 --2- 172.21.15.45:0/1340788260 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f08d80d01b0 0x7f08d80d0c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:39.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.097+0000 7f531179b700 1 --2- 172.21.15.45:0/2856750653 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f530c0c1fd0 0x7f530c154070 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f530400cc50 tx=0x7f530400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:39.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.097+0000 7f08d67fc700 1 -- 172.21.15.45:0/1340788260 >> v1:172.21.15.45:6789/0 conn(0x7f08d80b29b0 legacy=0x7f08d80b2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:06:39.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.098+0000 7f08d67fc700 1 -- 172.21.15.45:0/1340788260 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08d80b4850 con 0x7f08d80b20b0 2023-11-28T12:06:39.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.098+0000 7f5301ffb700 1 -- 172.21.15.45:0/2856750653 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f530400ade0 con 0x7f530c0c1fd0 2023-11-28T12:06:39.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.098+0000 7f5301ffb700 1 -- 172.21.15.45:0/2856750653 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f530400ce50 con 0x7f530c0c1fd0 2023-11-28T12:06:39.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.098+0000 7f5301ffb700 1 -- 172.21.15.45:0/2856750653 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5304012660 con 0x7f530c0c1fd0 2023-11-28T12:06:39.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.098+0000 7f53139ff700 1 -- 172.21.15.45:0/2856750653 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f530c161970 con 0x7f530c0c1fd0 2023-11-28T12:06:39.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.098+0000 7f08d6ffd700 1 --2- 172.21.15.45:0/1340788260 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f08d80d01b0 0x7f08d80d0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:06:39.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.099+0000 7f08d67fc700 1 --2- 172.21.15.45:0/1340788260 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08d80b20b0 0x7f08d80d1160 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f08c80098f0 tx=0x7f08c8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb1745a0dd5f46d2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:39.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.100+0000 7f08d5ffb700 1 -- 172.21.15.45:0/1340788260 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c8004230 con 0x7f08d80b20b0 2023-11-28T12:06:39.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.100+0000 7f08d5ffb700 1 -- 172.21.15.45:0/1340788260 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08c8004390 con 0x7f08d80b20b0 2023-11-28T12:06:39.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.100+0000 7f08d5ffb700 1 -- 172.21.15.45:0/1340788260 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c80036a0 con 0x7f08d80b20b0 2023-11-28T12:06:39.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.103+0000 7fedec5ff700 1 Processor -- start 2023-11-28T12:06:39.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.103+0000 7f08dd5ff700 1 -- 172.21.15.45:0/1340788260 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08d80b20b0 msgr2=0x7f08d80d1160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:39.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.103+0000 7f53139ff700 1 -- 172.21.15.45:0/2856750653 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f530c0c2420 con 0x7f530c0c1fd0 2023-11-28T12:06:39.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.103+0000 7fedec5ff700 1 -- start start 2023-11-28T12:06:39.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.104+0000 7f08dd5ff700 1 --2- 172.21.15.45:0/1340788260 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08d80b20b0 0x7f08d80d1160 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f08c80098f0 tx=0x7f08c8009c00 comp rx=0 tx=0).stop 2023-11-28T12:06:39.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.105+0000 7f3f5e79d700 1 Processor -- start 2023-11-28T12:06:39.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.105+0000 7f3f5e79d700 1 -- start start 2023-11-28T12:06:39.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.106+0000 7fedec5ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fede4158890 0x7fede40ce110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:39.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.106+0000 7fedec5ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fede40b0d80 0x7fede406b820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:39.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.107+0000 7fedea39b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fede4158890 0x7fede40ce110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:39.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.105+0000 7f5301ffb700 1 -- 172.21.15.45:0/2856750653 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f5304010050 con 0x7f530c0c1fd0 2023-11-28T12:06:39.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.106+0000 7f53139ff700 1 -- 172.21.15.45:0/2856750653 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f530c161c50 con 0x7f530c0c1fd0 2023-11-28T12:06:39.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.107+0000 7fedea39b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fede4158890 0x7fede40ce110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36114/0 (socket says 172.21.15.45:36114) 2023-11-28T12:06:39.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.107+0000 7fedea39b700 1 -- 172.21.15.45:0/3186444740 learned_addr learned my addr 172.21.15.45:0/3186444740 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:39.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.107+0000 7fedeab9c700 1 --2- 172.21.15.45:0/3186444740 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fede40b0d80 0x7fede406b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:39.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.107+0000 7fedec5ff700 1 -- 172.21.15.45:0/3186444740 --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fede415c490 con 0x7fede406d4f0 2023-11-28T12:06:39.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.107+0000 7f08dd5ff700 1 -- 172.21.15.45:0/1340788260 shutdown_connections 2023-11-28T12:06:39.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.107+0000 7fedec5ff700 1 -- 172.21.15.45:0/3186444740 --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fede40ce650 con 0x7fede4158890 2023-11-28T12:06:39.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.107+0000 7fedec5ff700 1 -- 172.21.15.45:0/3186444740 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fede415c730 con 0x7fede40b0d80 2023-11-28T12:06:39.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.107+0000 7f08dd5ff700 1 --2- 172.21.15.45:0/1340788260 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f08d80d01b0 0x7f08d80d0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:39.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.108+0000 7f08dd5ff700 1 --2- 172.21.15.45:0/1340788260 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08d80b20b0 0x7f08d80d1160 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:39.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.108+0000 7f08dd5ff700 1 -- 172.21.15.45:0/1340788260 >> 172.21.15.45:0/1340788260 conn(0x7f08d809c3f0 msgr2=0x7f08d80d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:39.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.108+0000 7f3f5e79d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3f5806c810 0x7f3f5806ce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:39.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.108+0000 7f3f5e79d700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f3f580cc020 0x7f3f581586e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:39.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.108+0000 7f3f5e79d700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3f580ccbe0 0x7f3f580cd060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:39.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.108+0000 7f3f5e79d700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f580cd5a0 con 0x7f3f5806c810 2023-11-28T12:06:39.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.108+0000 7f3f5e79d700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f580cc790 con 0x7f3f580cc020 2023-11-28T12:06:39.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.108+0000 7f3f5e79d700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f580cacf0 con 0x7f3f580ccbe0 2023-11-28T12:06:39.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.108+0000 7f3f5cf9a700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f3f580cc020 0x7f3f581586e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:39.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.108+0000 7f3f5cf9a700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f3f580cc020 0x7f3f581586e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.45:44748/0 (socket says 172.21.15.45:44748) 2023-11-28T12:06:39.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.108+0000 7f3f5cf9a700 1 -- 172.21.15.45:0/3841716435 learned_addr learned my addr 172.21.15.45:0/3841716435 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:39.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.108+0000 7f3f5df9c700 1 --2- 172.21.15.45:0/3841716435 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3f580ccbe0 0x7f3f580cd060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:39.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.109+0000 7f08dd5ff700 1 -- 172.21.15.45:0/1340788260 shutdown_connections 2023-11-28T12:06:39.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.109+0000 7fede9399700 1 -- 172.21.15.45:0/3186444740 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2393458374 0 0) 0x7fede415c490 con 0x7fede406d4f0 2023-11-28T12:06:39.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.109+0000 7fede9399700 1 -- 172.21.15.45:0/3186444740 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fedd00035b0 con 0x7fede406d4f0 2023-11-28T12:06:39.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.109+0000 7f08dd5ff700 1 -- 172.21.15.45:0/1340788260 wait complete. 2023-11-28T12:06:39.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.110+0000 7f5301ffb700 1 --2- 172.21.15.45:0/2856750653 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f52f0068340 0x7f52f006a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:39.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.109+0000 7f3f5df9c700 1 -- 172.21.15.45:0/3841716435 >> v2:172.21.15.152:3300/0 conn(0x7f3f580cc020 msgr2=0x7f3f581586e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:06:39.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.109+0000 7f3f5df9c700 1 --2- 172.21.15.45:0/3841716435 >> v2:172.21.15.152:3300/0 conn(0x7f3f580cc020 0x7f3f581586e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:39.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.109+0000 7f3f5df9c700 1 -- 172.21.15.45:0/3841716435 >> v2:172.21.15.45:3300/0 conn(0x7f3f5806c810 msgr2=0x7f3f5806ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:06:39.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.109+0000 7f3f5df9c700 1 --2- 172.21.15.45:0/3841716435 >> v2:172.21.15.45:3300/0 conn(0x7f3f5806c810 0x7f3f5806ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:39.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.109+0000 7f3f5df9c700 1 -- 172.21.15.45:0/3841716435 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f580cafd0 con 0x7f3f580ccbe0 2023-11-28T12:06:39.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.109+0000 7f3f5cf9a700 1 --2- 172.21.15.45:0/3841716435 >> v2:172.21.15.152:3300/0 conn(0x7f3f580cc020 0x7f3f581586e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:06:39.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.110+0000 7f3f5df9c700 1 --2- 172.21.15.45:0/3841716435 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3f580ccbe0 0x7f3f580cd060 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3f5815d460 tx=0x7f3f5000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb9dd23e9e3822ea server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:39.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.110+0000 7f3f4ffff700 1 -- 172.21.15.45:0/3841716435 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f5000e070 con 0x7f3f580ccbe0 2023-11-28T12:06:39.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.110+0000 7f3f4ffff700 1 -- 172.21.15.45:0/3841716435 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f5000bb20 con 0x7f3f580ccbe0 2023-11-28T12:06:39.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.110+0000 7f3f4ffff700 1 -- 172.21.15.45:0/3841716435 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f50012430 con 0x7f3f580ccbe0 2023-11-28T12:06:39.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.100+0000 7fc772bff700 1 Processor -- start 2023-11-28T12:06:39.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.100+0000 7fc772bff700 1 -- start start 2023-11-28T12:06:39.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.102+0000 7fc772bff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fc76c0cacb0 0x7fc76c0cb080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:39.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.102+0000 7fc772bff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc76c0b0d80 0x7fc76c0ce260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:39.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.103+0000 7fc772bff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc76c06c2f0 con 0x7fc76c0cde10 2023-11-28T12:06:39.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.103+0000 7fc77119c700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc76c0b0d80 0x7fc76c0ce260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:39.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.103+0000 7fc76bfff700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fc76c0cde10 0x7fc76c0b0670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.45:56034/0 (socket says 172.21.15.45:56034) 2023-11-28T12:06:39.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.103+0000 7fc76bfff700 1 -- 172.21.15.45:0/3395877827 learned_addr learned my addr 172.21.15.45:0/3395877827 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:06:39.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.103+0000 7fc77099b700 1 --2- 172.21.15.45:0/3395877827 >> v2:172.21.15.152:3300/0 conn(0x7fc76c0cacb0 0x7fc76c0cb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:39.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.104+0000 7fc772bff700 1 -- 172.21.15.45:0/3395877827 --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc76c0ce7a0 con 0x7fc76c0cacb0 2023-11-28T12:06:39.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.104+0000 7fc772bff700 1 -- 172.21.15.45:0/3395877827 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc76c06b9c0 con 0x7fc76c0b0d80 2023-11-28T12:06:39.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.105+0000 7fc77119c700 1 -- 172.21.15.45:0/3395877827 >> v2:172.21.15.152:3300/0 conn(0x7fc76c0cacb0 msgr2=0x7fc76c0cb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:06:39.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.105+0000 7fc77119c700 1 --2- 172.21.15.45:0/3395877827 >> v2:172.21.15.152:3300/0 conn(0x7fc76c0cacb0 0x7fc76c0cb080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:39.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.105+0000 7fc77119c700 1 -- 172.21.15.45:0/3395877827 >> v1:172.21.15.152:6789/0 conn(0x7fc76c0cde10 legacy=0x7fc76c0b0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:39.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.105+0000 7fc77119c700 1 -- 172.21.15.45:0/3395877827 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc76c06bca0 con 0x7fc76c0b0d80 2023-11-28T12:06:39.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.106+0000 7fc77119c700 1 --2- 172.21.15.45:0/3395877827 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc76c0b0d80 0x7fc76c0ce260 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc764009840 tx=0x7fc764009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c48afdfbf028b8f0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:39.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.106+0000 7fc76b7fe700 1 -- 172.21.15.45:0/3395877827 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc764004230 con 0x7fc76c0b0d80 2023-11-28T12:06:39.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.106+0000 7fc76b7fe700 1 -- 172.21.15.45:0/3395877827 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc764004390 con 0x7fc76c0b0d80 2023-11-28T12:06:39.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.107+0000 7fc76b7fe700 1 -- 172.21.15.45:0/3395877827 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc764004230 con 0x7fc76c0b0d80 2023-11-28T12:06:39.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.107+0000 7fc772bff700 1 -- 172.21.15.45:0/3395877827 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc76c0b0d80 msgr2=0x7fc76c0ce260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:39.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.107+0000 7fc772bff700 1 --2- 172.21.15.45:0/3395877827 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc76c0b0d80 0x7fc76c0ce260 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc764009840 tx=0x7fc764009b50 comp rx=0 tx=0).stop 2023-11-28T12:06:39.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.108+0000 7fc772bff700 1 -- 172.21.15.45:0/3395877827 shutdown_connections 2023-11-28T12:06:39.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.108+0000 7fc772bff700 1 --2- 172.21.15.45:0/3395877827 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc76c0b0d80 0x7fc76c0ce260 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:39.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.108+0000 7fc772bff700 1 --2- 172.21.15.45:0/3395877827 >> v2:172.21.15.152:3300/0 conn(0x7fc76c0cacb0 0x7fc76c0cb080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:39.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.108+0000 7fc772bff700 1 -- 172.21.15.45:0/3395877827 >> 172.21.15.45:0/3395877827 conn(0x7fc76c0cb670 msgr2=0x7fc76c0cba70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:39.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.108+0000 7fc772bff700 1 -- 172.21.15.45:0/3395877827 shutdown_connections 2023-11-28T12:06:39.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.108+0000 7fc772bff700 1 -- 172.21.15.45:0/3395877827 wait complete. 2023-11-28T12:06:39.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.109+0000 7fedeab9c700 1 -- 172.21.15.45:0/3186444740 >> v2:172.21.15.45:3300/0 conn(0x7fede4158890 msgr2=0x7fede40ce110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:06:39.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.109+0000 7fedeab9c700 1 --2- 172.21.15.45:0/3186444740 >> v2:172.21.15.45:3300/0 conn(0x7fede4158890 0x7fede40ce110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:39.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.109+0000 7fedeab9c700 1 -- 172.21.15.45:0/3186444740 >> v1:172.21.15.152:6789/0 conn(0x7fede406d4f0 legacy=0x7fede40b0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:39.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.109+0000 7fedeab9c700 1 -- 172.21.15.45:0/3186444740 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fede415ca10 con 0x7fede40b0d80 2023-11-28T12:06:39.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.110+0000 7fedea39b700 1 --2- 172.21.15.45:0/3186444740 >> v2:172.21.15.45:3300/0 conn(0x7fede4158890 0x7fede40ce110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:06:39.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.110+0000 7fedeab9c700 1 --2- 172.21.15.45:0/3186444740 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fede40b0d80 0x7fede406b820 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7feddc009d90 tx=0x7feddc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3bec15b8a15cb33e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:39.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.112+0000 7f3f5e79d700 1 -- 172.21.15.45:0/3841716435 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3f580ccbe0 msgr2=0x7f3f580cd060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:39.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.112+0000 7f3f5e79d700 1 --2- 172.21.15.45:0/3841716435 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3f580ccbe0 0x7f3f580cd060 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3f5815d460 tx=0x7f3f5000b330 comp rx=0 tx=0).stop 2023-11-28T12:06:39.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.111+0000 7fede9399700 1 -- 172.21.15.45:0/3186444740 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feddc00e070 con 0x7fede40b0d80 2023-11-28T12:06:39.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.111+0000 7fede9399700 1 -- 172.21.15.45:0/3186444740 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feddc00bb20 con 0x7fede40b0d80 2023-11-28T12:06:39.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.111+0000 7fede9399700 1 -- 172.21.15.45:0/3186444740 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feddc013540 con 0x7fede40b0d80 2023-11-28T12:06:39.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.112+0000 7fedec5ff700 1 -- 172.21.15.45:0/3186444740 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fede40b0d80 msgr2=0x7fede406b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:39.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.112+0000 7fedec5ff700 1 --2- 172.21.15.45:0/3186444740 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fede40b0d80 0x7fede406b820 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7feddc009d90 tx=0x7feddc00b330 comp rx=0 tx=0).stop 2023-11-28T12:06:39.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.112+0000 7f3f5e79d700 1 -- 172.21.15.45:0/3841716435 shutdown_connections 2023-11-28T12:06:39.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.112+0000 7f3f5e79d700 1 --2- 172.21.15.45:0/3841716435 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3f580ccbe0 0x7f3f580cd060 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:39.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.112+0000 7f3f5e79d700 1 --2- 172.21.15.45:0/3841716435 >> v2:172.21.15.45:3300/0 conn(0x7f3f5806c810 0x7f3f5806ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:39.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.112+0000 7f3f5e79d700 1 --2- 172.21.15.45:0/3841716435 >> v2:172.21.15.152:3300/0 conn(0x7f3f580cc020 0x7f3f581586e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:39.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.112+0000 7f3f5e79d700 1 -- 172.21.15.45:0/3841716435 >> 172.21.15.45:0/3841716435 conn(0x7f3f580cb510 msgr2=0x7f3f580cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:39.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.112+0000 7fedec5ff700 1 -- 172.21.15.45:0/3186444740 shutdown_connections 2023-11-28T12:06:39.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.112+0000 7f3f5e79d700 1 -- 172.21.15.45:0/3841716435 shutdown_connections 2023-11-28T12:06:39.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.112+0000 7fedec5ff700 1 --2- 172.21.15.45:0/3186444740 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fede40b0d80 0x7fede406b820 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:39.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.112+0000 7fedec5ff700 1 --2- 172.21.15.45:0/3186444740 >> v2:172.21.15.45:3300/0 conn(0x7fede4158890 0x7fede40ce110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:39.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.110+0000 7f5301ffb700 1 -- 172.21.15.45:0/2856750653 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5304085650 con 0x7f530c0c1fd0 2023-11-28T12:06:39.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.113+0000 7f5310f9a700 1 --2- 172.21.15.45:0/2856750653 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f52f0068340 0x7f52f006a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:39.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.113+0000 7fedec5ff700 1 -- 172.21.15.45:0/3186444740 >> 172.21.15.45:0/3186444740 conn(0x7fede40cb670 msgr2=0x7fede40cba70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:39.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.113+0000 7fedec5ff700 1 -- 172.21.15.45:0/3186444740 shutdown_connections 2023-11-28T12:06:39.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.113+0000 7fedec5ff700 1 -- 172.21.15.45:0/3186444740 wait complete. 2023-11-28T12:06:39.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.113+0000 7fc772bff700 1 Processor -- start 2023-11-28T12:06:39.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.114+0000 7fc772bff700 1 -- start start 2023-11-28T12:06:39.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.115+0000 7fc772bff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc76c0b0d80 0x7fc76c1586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:39.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.115+0000 7fc772bff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc76c0cacb0 0x7fc76c158be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:39.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.115+0000 7fc772bff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc76c0cde10 0x7fc76c15ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:39.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.115+0000 7fc772bff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc76c08a080 con 0x7fc76c0cacb0 2023-11-28T12:06:39.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.115+0000 7fc772bff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc76c159120 con 0x7fc76c0cde10 2023-11-28T12:06:39.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.115+0000 7fc772bff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc76c1596b0 con 0x7fc76c0b0d80 2023-11-28T12:06:39.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.112+0000 7f3f5e79d700 1 -- 172.21.15.45:0/3841716435 wait complete. 2023-11-28T12:06:39.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.116+0000 7f3f5e79d700 1 Processor -- start 2023-11-28T12:06:39.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.116+0000 7fc77099b700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc76c0b0d80 0x7fc76c1586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:39.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.116+0000 7fc76bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc76c0cacb0 0x7fc76c158be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:39.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.116+0000 7f3f5e79d700 1 -- start start 2023-11-28T12:06:39.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.116+0000 7fc77119c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc76c0cde10 0x7fc76c15ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:39.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.116+0000 7fc77119c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc76c0cde10 0x7fc76c15ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.45:44758/0 (socket says 172.21.15.45:44758) 2023-11-28T12:06:39.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.116+0000 7fc77119c700 1 -- 172.21.15.45:0/2349548253 learned_addr learned my addr 172.21.15.45:0/2349548253 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:39.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.116+0000 7fedec5ff700 1 Processor -- start 2023-11-28T12:06:39.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.117+0000 7fedec5ff700 1 -- start start 2023-11-28T12:06:39.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.117+0000 7fc77119c700 1 -- 172.21.15.45:0/2349548253 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc76c0b0d80 msgr2=0x7fc76c1586a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:39.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.117+0000 7fc77119c700 1 --2- 172.21.15.45:0/2349548253 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc76c0b0d80 0x7fc76c1586a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:39.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.117+0000 7fc77119c700 1 -- 172.21.15.45:0/2349548253 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc76c0cacb0 msgr2=0x7fc76c158be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:39.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.117+0000 7fc77119c700 1 --2- 172.21.15.45:0/2349548253 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc76c0cacb0 0x7fc76c158be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:39.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.117+0000 7fc77119c700 1 -- 172.21.15.45:0/2349548253 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7640094a0 con 0x7fc76c0cde10 2023-11-28T12:06:39.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.117+0000 7fc77099b700 1 --2- 172.21.15.45:0/2349548253 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc76c0b0d80 0x7fc76c1586a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:06:39.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.118+0000 7f3f5e79d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f580cc020 0x7f3f580c5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:39.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.119+0000 7f3f5e79d700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3f580ccbe0 0x7f3f581fe590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:39.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.119+0000 7f3f5e79d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3f581e21a0 0x7f3f5815b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:39.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.118+0000 7fc77119c700 1 --2- 172.21.15.45:0/2349548253 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc76c0cde10 0x7fc76c15ba60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc764004000 tx=0x7fc764004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:39.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.118+0000 7fc7697fa700 1 -- 172.21.15.45:0/2349548253 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc764006cf0 con 0x7fc76c0cde10 2023-11-28T12:06:39.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.119+0000 7fc7697fa700 1 -- 172.21.15.45:0/2349548253 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc764006e50 con 0x7fc76c0cde10 2023-11-28T12:06:39.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.119+0000 7fc7697fa700 1 -- 172.21.15.45:0/2349548253 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7640237c0 con 0x7fc76c0cde10 2023-11-28T12:06:39.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.119+0000 7fc772bff700 1 -- 172.21.15.45:0/2349548253 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc76c06c780 con 0x7fc76c0cde10 2023-11-28T12:06:39.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.119+0000 7fedec5ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fede406d4f0 0x7fede41471a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:39.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.117+0000 7f5310f9a700 1 --2- 172.21.15.45:0/2856750653 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f52f0068340 0x7f52f006a7f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5308009130 tx=0x7f5308008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:39.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.119+0000 7f3f5e79d700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f581fead0 con 0x7f3f581e21a0 2023-11-28T12:06:39.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.119+0000 7f3f5e79d700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f581e2610 con 0x7f3f580cc020 2023-11-28T12:06:39.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.119+0000 7fc772bff700 1 -- 172.21.15.45:0/2349548253 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc76c06bf80 con 0x7fc76c0cde10 2023-11-28T12:06:39.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.119+0000 7f3f5e79d700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f581e28f0 con 0x7f3f580ccbe0 2023-11-28T12:06:39.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.119+0000 7fedec5ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fede40b0d80 0x7fede4156d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:39.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.119+0000 7fedec5ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fede4158890 0x7fede41572b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:39.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.120+0000 7fedec5ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fede4153960 con 0x7fede40b0d80 2023-11-28T12:06:39.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.120+0000 7fedec5ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fede4152ce0 con 0x7fede406d4f0 2023-11-28T12:06:39.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.120+0000 7fedec5ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fede4152fc0 con 0x7fede4158890 2023-11-28T12:06:39.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.120+0000 7fedea39b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fede406d4f0 0x7fede41471a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:39.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.120+0000 7fedeab9c700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fede4158890 0x7fede41572b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:39.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.120+0000 7fedeab9c700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fede4158890 0x7fede41572b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.45:53934/0 (socket says 172.21.15.45:53934) 2023-11-28T12:06:39.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.120+0000 7fedeab9c700 1 -- 172.21.15.45:0/4108476030 learned_addr learned my addr 172.21.15.45:0/4108476030 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:39.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.119+0000 7f3f5d79b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f580cc020 0x7f3f580c5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:39.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.119+0000 7f3f5d79b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f580cc020 0x7f3f580c5b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.45:44760/0 (socket says 172.21.15.45:44760) 2023-11-28T12:06:39.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.119+0000 7f3f5d79b700 1 -- 172.21.15.45:0/2874344334 learned_addr learned my addr 172.21.15.45:0/2874344334 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:39.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.119+0000 7f3f5cf9a700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3f580ccbe0 0x7f3f581fe590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:39.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.120+0000 7fedeab9c700 1 -- 172.21.15.45:0/4108476030 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fede406d4f0 msgr2=0x7fede41471a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:39.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.120+0000 7fedeab9c700 1 --2- 172.21.15.45:0/4108476030 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fede406d4f0 0x7fede41471a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:39.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.120+0000 7fedeab9c700 1 -- 172.21.15.45:0/4108476030 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fede40b0d80 msgr2=0x7fede4156d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:39.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.120+0000 7fedeab9c700 1 --2- 172.21.15.45:0/4108476030 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fede40b0d80 0x7fede4156d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:39.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.120+0000 7fedeab9c700 1 -- 172.21.15.45:0/4108476030 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feddc009a70 con 0x7fede4158890 2023-11-28T12:06:39.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.121+0000 7f3f5cf9a700 1 -- 172.21.15.45:0/2874344334 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f580cc020 msgr2=0x7f3f580c5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:39.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.121+0000 7f3f5cf9a700 1 --2- 172.21.15.45:0/2874344334 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f580cc020 0x7f3f580c5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:39.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.121+0000 7f3f5cf9a700 1 -- 172.21.15.45:0/2874344334 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3f581e21a0 msgr2=0x7f3f5815b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:39.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.121+0000 7f3f5cf9a700 1 --2- 172.21.15.45:0/2874344334 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3f581e21a0 0x7f3f5815b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:39.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.121+0000 7f3f5cf9a700 1 -- 172.21.15.45:0/2874344334 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f4800b7f0 con 0x7f3f580ccbe0 2023-11-28T12:06:39.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.121+0000 7f08dd5ff700 1 Processor -- start 2023-11-28T12:06:39.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.121+0000 7fedeab9c700 1 --2- 172.21.15.45:0/4108476030 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fede4158890 0x7fede41572b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7feddc015040 tx=0x7feddc004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:39.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.122+0000 7f08dd5ff700 1 -- start start 2023-11-28T12:06:39.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.122+0000 7feddaffd700 1 -- 172.21.15.45:0/4108476030 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feddc004960 con 0x7fede4158890 2023-11-28T12:06:39.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.122+0000 7feddaffd700 1 -- 172.21.15.45:0/4108476030 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feddc012430 con 0x7fede4158890 2023-11-28T12:06:39.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.122+0000 7feddaffd700 1 -- 172.21.15.45:0/4108476030 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feddc0127c0 con 0x7fede4158890 2023-11-28T12:06:39.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.123+0000 7f5301ffb700 1 -- 172.21.15.45:0/2856750653 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f5304085e60 con 0x7f530c0c1fd0 2023-11-28T12:06:39.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.123+0000 7fc7697fa700 1 -- 172.21.15.45:0/2349548253 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fc76403e070 con 0x7fc76c0cde10 2023-11-28T12:06:39.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.123+0000 7fc772bff700 1 -- 172.21.15.45:0/2349548253 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7500052f0 con 0x7fc76c0cde10 2023-11-28T12:06:39.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.123+0000 7fedec5ff700 1 -- 172.21.15.45:0/4108476030 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fede40c9370 con 0x7fede4158890 2023-11-28T12:06:39.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.123+0000 7f3f5cf9a700 1 --2- 172.21.15.45:0/2874344334 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3f580ccbe0 0x7f3f581fe590 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3f4800dd90 tx=0x7f3f48009400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:39.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.123+0000 7fedec5ff700 1 -- 172.21.15.45:0/4108476030 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fede415ccf0 con 0x7fede4158890 2023-11-28T12:06:39.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.124+0000 7f3f4dffb700 1 -- 172.21.15.45:0/2874344334 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4800de80 con 0x7f3f580ccbe0 2023-11-28T12:06:39.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.124+0000 7fc7697fa700 1 --2- 172.21.15.45:0/2349548253 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fc74c068340 0x7fc74c06a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:39.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.124+0000 7f08dd5ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f08d80b20b0 0x7f08d81525e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:39.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.124+0000 7f3f5e79d700 1 -- 172.21.15.45:0/2874344334 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f50009a70 con 0x7f3f580ccbe0 2023-11-28T12:06:39.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.124+0000 7f3f4dffb700 1 -- 172.21.15.45:0/2874344334 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f48009c20 con 0x7f3f580ccbe0 2023-11-28T12:06:39.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.124+0000 7f3f4dffb700 1 -- 172.21.15.45:0/2874344334 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4800de80 con 0x7f3f580ccbe0 2023-11-28T12:06:39.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.124+0000 7f3f5e79d700 1 -- 172.21.15.45:0/2874344334 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f5806d390 con 0x7f3f580ccbe0 2023-11-28T12:06:39.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.124+0000 7f08dd5ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08d80b29b0 0x7f08d80b5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:39.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.124+0000 7f08dd5ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f08d80d01b0 0x7f08d80b64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:39.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.124+0000 7f08dd5ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08d80c73a0 con 0x7f08d80b29b0 2023-11-28T12:06:39.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.125+0000 7fc77099b700 1 --2- 172.21.15.45:0/2349548253 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fc74c068340 0x7fc74c06a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:39.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.124+0000 7f08dd5ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08d815b110 con 0x7f08d80b20b0 2023-11-28T12:06:39.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.124+0000 7f08dd5ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08d80c6a70 con 0x7f08d80d01b0 2023-11-28T12:06:39.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.125+0000 7f08d67fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08d80b29b0 0x7f08d80b5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:39.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.125+0000 7f08d67fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08d80b29b0 0x7f08d80b5fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36150/0 (socket says 172.21.15.45:36150) 2023-11-28T12:06:39.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.125+0000 7f08d67fc700 1 -- 172.21.15.45:0/82175296 learned_addr learned my addr 172.21.15.45:0/82175296 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:39.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.125+0000 7f08d77fe700 1 --2- 172.21.15.45:0/82175296 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f08d80d01b0 0x7f08d80b64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:39.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.125+0000 7fc7697fa700 1 -- 172.21.15.45:0/2349548253 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc76403f350 con 0x7fc76c0cde10 2023-11-28T12:06:39.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.126+0000 7f08d77fe700 1 -- 172.21.15.45:0/82175296 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f08d80b20b0 msgr2=0x7f08d81525e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-28T12:06:39.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.126+0000 7f08d77fe700 1 --2- 172.21.15.45:0/82175296 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f08d80b20b0 0x7f08d81525e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:39.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.126+0000 7f08d77fe700 1 -- 172.21.15.45:0/82175296 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08d80b29b0 msgr2=0x7f08d80b5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:39.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.127+0000 7f3f5e79d700 1 -- 172.21.15.45:0/2874344334 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f580cb2b0 con 0x7f3f580ccbe0 2023-11-28T12:06:39.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.126+0000 7f08d77fe700 1 --2- 172.21.15.45:0/82175296 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08d80b29b0 0x7f08d80b5fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:39.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.126+0000 7f08d77fe700 1 -- 172.21.15.45:0/82175296 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08c8009550 con 0x7f08d80d01b0 2023-11-28T12:06:39.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.127+0000 7f08d77fe700 1 --2- 172.21.15.45:0/82175296 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f08d80d01b0 0x7f08d80b64e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f08cc00c410 tx=0x7f08cc005810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:39.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.127+0000 7feddaffd700 1 -- 172.21.15.45:0/4108476030 <== mon.2 v2:172.21.15.152:3301/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7feddc012920 con 0x7fede4158890 2023-11-28T12:06:39.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.128+0000 7fedec5ff700 1 -- 172.21.15.45:0/4108476030 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fede4158c60 con 0x7fede4158890 2023-11-28T12:06:39.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.128+0000 7f3f4dffb700 1 -- 172.21.15.45:0/2874344334 <== mon.2 v2:172.21.15.152:3301/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f3f4801e030 con 0x7f3f580ccbe0 2023-11-28T12:06:39.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.128+0000 7fc77099b700 1 --2- 172.21.15.45:0/2349548253 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fc74c068340 0x7fc74c06a7f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc754011fd0 tx=0x7fc754008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:39.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.128+0000 7f08bf7fe700 1 -- 172.21.15.45:0/82175296 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08cc005cb0 con 0x7f08d80d01b0 2023-11-28T12:06:39.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.128+0000 7f08bf7fe700 1 -- 172.21.15.45:0/82175296 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08cc005e10 con 0x7f08d80d01b0 2023-11-28T12:06:39.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.128+0000 7f08bf7fe700 1 -- 172.21.15.45:0/82175296 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08cc007310 con 0x7f08d80d01b0 2023-11-28T12:06:39.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.128+0000 7f08dd5ff700 1 -- 172.21.15.45:0/82175296 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08d80afec0 con 0x7f08d80d01b0 2023-11-28T12:06:39.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.129+0000 7f08dd5ff700 1 -- 172.21.15.45:0/82175296 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08d80afbe0 con 0x7f08d80d01b0 2023-11-28T12:06:39.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.129+0000 7f3f4dffb700 1 --2- 172.21.15.45:0/2874344334 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f3f3c068350 0x7f3f3c06a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:39.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.130+0000 7f3f4dffb700 1 -- 172.21.15.45:0/2874344334 <== mon.2 v2:172.21.15.152:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3f4800b050 con 0x7f3f580ccbe0 2023-11-28T12:06:39.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.130+0000 7feddaffd700 1 --2- 172.21.15.45:0/4108476030 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fedc80683c0 0x7fedc806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:39.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.130+0000 7feddaffd700 1 -- 172.21.15.45:0/4108476030 <== mon.2 v2:172.21.15.152:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7feddc087e30 con 0x7fede4158890 2023-11-28T12:06:39.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.130+0000 7f08dd5ff700 1 -- 172.21.15.45:0/82175296 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08d80b2600 con 0x7f08d80d01b0 2023-11-28T12:06:39.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.130+0000 7f3f5d79b700 1 --2- 172.21.15.45:0/2874344334 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f3f3c068350 0x7f3f3c06a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:39.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.130+0000 7fedea39b700 1 --2- 172.21.15.45:0/4108476030 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fedc80683c0 0x7fedc806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:39.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.131+0000 7f3f5d79b700 1 --2- 172.21.15.45:0/2874344334 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f3f3c068350 0x7f3f3c06a800 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3f54009ac0 tx=0x7f3f540091c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:39.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.131+0000 7fc7697fa700 1 -- 172.21.15.45:0/2349548253 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fc764065370 con 0x7fc76c0cde10 2023-11-28T12:06:39.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.131+0000 7fedea39b700 1 --2- 172.21.15.45:0/4108476030 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fedc80683c0 0x7fedc806a870 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fede0006fd0 tx=0x7fede0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:39.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.136+0000 7f3f4dffb700 1 -- 172.21.15.45:0/2874344334 <== mon.2 v2:172.21.15.152:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f3f4808a060 con 0x7f3f580ccbe0 2023-11-28T12:06:39.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.141+0000 7f08bf7fe700 1 -- 172.21.15.45:0/82175296 <== mon.2 v2:172.21.15.152:3301/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f08cc019030 con 0x7f08d80d01b0 2023-11-28T12:06:39.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.141+0000 7feddaffd700 1 -- 172.21.15.45:0/4108476030 <== mon.2 v2:172.21.15.152:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7feddc08b030 con 0x7fede4158890 2023-11-28T12:06:39.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.142+0000 7f08bf7fe700 1 --2- 172.21.15.45:0/82175296 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f08c40683c0 0x7f08c406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:39.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.143+0000 7f08bf7fe700 1 -- 172.21.15.45:0/82175296 <== mon.2 v2:172.21.15.152:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f08cc0853b0 con 0x7f08d80d01b0 2023-11-28T12:06:39.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.143+0000 7f08bf7fe700 1 -- 172.21.15.45:0/82175296 <== mon.2 v2:172.21.15.152:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f08cc0555d0 con 0x7f08d80d01b0 2023-11-28T12:06:39.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.144+0000 7f08d6ffd700 1 --2- 172.21.15.45:0/82175296 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f08c40683c0 0x7f08c406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:39.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.144+0000 7f08d6ffd700 1 --2- 172.21.15.45:0/82175296 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f08c40683c0 0x7f08c406a870 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f08d0007dd0 tx=0x7f08d0007300 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:39.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.151+0000 7f505a1ff700 1 Processor -- start 2023-11-28T12:06:39.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.151+0000 7f505a1ff700 1 -- start start 2023-11-28T12:06:39.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.154+0000 7f505a1ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f50540b3090 0x7f50540cc4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:39.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.154+0000 7f505a1ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f50540cb620 0x7f50540ceb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:39.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.155+0000 7f505a1ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f505415ad60 con 0x7f50540cf070 2023-11-28T12:06:39.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.155+0000 7f505a1ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50540cf4f0 con 0x7f50540b3090 2023-11-28T12:06:39.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.155+0000 7f505a1ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50540adb90 con 0x7f50540cb620 2023-11-28T12:06:39.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.155+0000 7f5053fff700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f50540cf070 0x7f50540cd920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.45:56042/0 (socket says 172.21.15.45:56042) 2023-11-28T12:06:39.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.155+0000 7f5053fff700 1 -- 172.21.15.45:0/3159233165 learned_addr learned my addr 172.21.15.45:0/3159233165 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:06:39.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.155+0000 7f5052ffd700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f50540cb620 0x7f50540ceb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:39.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.156+0000 7f50537fe700 1 --2- 172.21.15.45:0/3159233165 >> v2:172.21.15.152:3300/0 conn(0x7f50540b3090 0x7f50540cc4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:39.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.156+0000 7f5052ffd700 1 -- 172.21.15.45:0/3159233165 >> v2:172.21.15.152:3300/0 conn(0x7f50540b3090 msgr2=0x7f50540cc4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:06:39.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.156+0000 7f5052ffd700 1 --2- 172.21.15.45:0/3159233165 >> v2:172.21.15.152:3300/0 conn(0x7f50540b3090 0x7f50540cc4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:39.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.156+0000 7f5052ffd700 1 -- 172.21.15.45:0/3159233165 >> v1:172.21.15.152:6789/0 conn(0x7f50540cf070 legacy=0x7f50540cd920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:39.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.158+0000 7f5052ffd700 1 -- 172.21.15.45:0/3159233165 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50540ccdd0 con 0x7f50540cb620 2023-11-28T12:06:39.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.158+0000 7f50537fe700 1 --2- 172.21.15.45:0/3159233165 >> v2:172.21.15.152:3300/0 conn(0x7f50540b3090 0x7f50540cc4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:06:39.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.158+0000 7f5052ffd700 1 --2- 172.21.15.45:0/3159233165 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f50540cb620 0x7f50540ceb30 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5044009840 tx=0x7f5044009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6029da80b6ea9587 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:39.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.159+0000 7f50527fc700 1 -- 172.21.15.45:0/3159233165 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5044004230 con 0x7f50540cb620 2023-11-28T12:06:39.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.159+0000 7f50527fc700 1 -- 172.21.15.45:0/3159233165 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5044004390 con 0x7f50540cb620 2023-11-28T12:06:39.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.159+0000 7f50527fc700 1 -- 172.21.15.45:0/3159233165 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50440036a0 con 0x7f50540cb620 2023-11-28T12:06:39.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.160+0000 7f505a1ff700 1 -- 172.21.15.45:0/3159233165 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f50540cb620 msgr2=0x7f50540ceb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:39.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.160+0000 7f505a1ff700 1 --2- 172.21.15.45:0/3159233165 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f50540cb620 0x7f50540ceb30 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5044009840 tx=0x7f5044009b50 comp rx=0 tx=0).stop 2023-11-28T12:06:39.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.160+0000 7f505a1ff700 1 -- 172.21.15.45:0/3159233165 shutdown_connections 2023-11-28T12:06:39.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.160+0000 7f505a1ff700 1 --2- 172.21.15.45:0/3159233165 >> v2:172.21.15.152:3300/0 conn(0x7f50540b3090 0x7f50540cc4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:39.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.160+0000 7f505a1ff700 1 --2- 172.21.15.45:0/3159233165 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f50540cb620 0x7f50540ceb30 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:39.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.160+0000 7f505a1ff700 1 -- 172.21.15.45:0/3159233165 >> 172.21.15.45:0/3159233165 conn(0x7f505409a230 msgr2=0x7f505408afd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:39.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.160+0000 7f505a1ff700 1 -- 172.21.15.45:0/3159233165 shutdown_connections 2023-11-28T12:06:39.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.160+0000 7f505a1ff700 1 -- 172.21.15.45:0/3159233165 wait complete. 2023-11-28T12:06:39.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.163+0000 7f505a1ff700 1 Processor -- start 2023-11-28T12:06:39.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.164+0000 7f505a1ff700 1 -- start start 2023-11-28T12:06:39.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.166+0000 7f505a1ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50540b3090 0x7f5054159f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:39.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.166+0000 7f505a1ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f50540cb620 0x7f50540c4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:39.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.167+0000 7f505a1ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f50540cf070 0x7f50541ef960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:39.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.167+0000 7f5052ffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f50540cb620 0x7f50540c4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:39.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.167+0000 7f5052ffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f50540cb620 0x7f50540c4d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.45:44792/0 (socket says 172.21.15.45:44792) 2023-11-28T12:06:39.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.167+0000 7f5053fff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f50540cf070 0x7f50541ef960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:39.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.167+0000 7f5053fff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f50540cf070 0x7f50541ef960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.45:53972/0 (socket says 172.21.15.45:53972) 2023-11-28T12:06:39.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.167+0000 7f50537fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50540b3090 0x7f5054159f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:39.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.168+0000 7f5052ffd700 1 -- 172.21.15.45:0/563163851 learned_addr learned my addr 172.21.15.45:0/563163851 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:39.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.168+0000 7f505a1ff700 1 -- 172.21.15.45:0/563163851 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50540c8900 con 0x7f50540b3090 2023-11-28T12:06:39.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.168+0000 7f505a1ff700 1 -- 172.21.15.45:0/563163851 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50540c8be0 con 0x7f50540cb620 2023-11-28T12:06:39.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.168+0000 7f505a1ff700 1 -- 172.21.15.45:0/563163851 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50540c8ec0 con 0x7f50540cf070 2023-11-28T12:06:39.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.169+0000 7f50537fe700 1 -- 172.21.15.45:0/563163851 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f50540cf070 msgr2=0x7f50541ef960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:39.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.169+0000 7f50537fe700 1 --2- 172.21.15.45:0/563163851 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f50540cf070 0x7f50541ef960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:39.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.169+0000 7f50537fe700 1 -- 172.21.15.45:0/563163851 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f50540cb620 msgr2=0x7f50540c4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:39.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.169+0000 7f50537fe700 1 --2- 172.21.15.45:0/563163851 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f50540cb620 0x7f50540c4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:39.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.169+0000 7f50537fe700 1 -- 172.21.15.45:0/563163851 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50440094a0 con 0x7f50540b3090 2023-11-28T12:06:39.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.170+0000 7f50537fe700 1 --2- 172.21.15.45:0/563163851 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50540b3090 0x7f5054159f40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f504c007ef0 tx=0x7f504c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:39.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.170+0000 7f503bfff700 1 -- 172.21.15.45:0/563163851 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f504c00de90 con 0x7f50540b3090 2023-11-28T12:06:39.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.171+0000 7f505a1ff700 1 -- 172.21.15.45:0/563163851 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50540cd390 con 0x7f50540b3090 2023-11-28T12:06:39.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.171+0000 7f503bfff700 1 -- 172.21.15.45:0/563163851 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f504c00f040 con 0x7f50540b3090 2023-11-28T12:06:39.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.171+0000 7f503bfff700 1 -- 172.21.15.45:0/563163851 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f504c003c40 con 0x7f50540b3090 2023-11-28T12:06:39.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.171+0000 7f505a1ff700 1 -- 172.21.15.45:0/563163851 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50540cd0b0 con 0x7f50540b3090 2023-11-28T12:06:39.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.173+0000 7f505a1ff700 1 -- 172.21.15.45:0/563163851 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50540adde0 con 0x7f50540b3090 2023-11-28T12:06:39.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.175+0000 7f503bfff700 1 -- 172.21.15.45:0/563163851 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f504c01c030 con 0x7f50540b3090 2023-11-28T12:06:39.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.176+0000 7f503bfff700 1 --2- 172.21.15.45:0/563163851 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f50400682f0 0x7f504006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:39.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.176+0000 7f503bfff700 1 -- 172.21.15.45:0/563163851 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f504c085c60 con 0x7f50540b3090 2023-11-28T12:06:39.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.179+0000 7f5052ffd700 1 --2- 172.21.15.45:0/563163851 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f50400682f0 0x7f504006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:39.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.183+0000 7f5052ffd700 1 --2- 172.21.15.45:0/563163851 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f50400682f0 0x7f504006a7a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5044004720 tx=0x7f5044008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:39.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.186+0000 7f503bfff700 1 -- 172.21.15.45:0/563163851 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f504c04e5e0 con 0x7f50540b3090 2023-11-28T12:06:39.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.186+0000 7efcb759d700 1 Processor -- start 2023-11-28T12:06:39.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.187+0000 7efcb759d700 1 -- start start 2023-11-28T12:06:39.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.189+0000 7efcb759d700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7efca80df6f0 0x7efca8050480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:39.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.190+0000 7efcb759d700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7efca80378b0 0x7efca8037d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:39.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.190+0000 7efcb759d700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efca8038270 con 0x7efca8051fe0 2023-11-28T12:06:39.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.190+0000 7efcb759d700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efca8052450 con 0x7efca80378b0 2023-11-28T12:06:39.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.190+0000 7efcb759d700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efca8039390 con 0x7efca80df6f0 2023-11-28T12:06:39.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.191+0000 7efcb659b700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7efca80df6f0 0x7efca8050480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:39.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.191+0000 7efcb659b700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7efca80df6f0 0x7efca8050480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.45:53978/0 (socket says 172.21.15.45:53978) 2023-11-28T12:06:39.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.191+0000 7efcb659b700 1 -- 172.21.15.45:0/625052651 learned_addr learned my addr 172.21.15.45:0/625052651 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:39.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.191+0000 7efcb6d9c700 1 --2- 172.21.15.45:0/625052651 >> v2:172.21.15.152:3300/0 conn(0x7efca80378b0 0x7efca8037d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:39.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.191+0000 7efcb6d9c700 1 -- 172.21.15.45:0/625052651 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7efca80df6f0 msgr2=0x7efca8050480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:06:39.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.191+0000 7efcb6d9c700 1 --2- 172.21.15.45:0/625052651 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7efca80df6f0 0x7efca8050480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:39.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.191+0000 7efcb6d9c700 1 -- 172.21.15.45:0/625052651 >> v1:172.21.15.45:6789/0 conn(0x7efca8051fe0 legacy=0x7efca8038c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:06:39.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.191+0000 7efcb6d9c700 1 -- 172.21.15.45:0/625052651 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efca80544b0 con 0x7efca80378b0 2023-11-28T12:06:39.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.192+0000 7efcb6d9c700 1 --2- 172.21.15.45:0/625052651 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efca80378b0 0x7efca8037d30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7efcb004e910 tx=0x7efcb0068c60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9b8bcdbd80e07c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:39.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.192+0000 7efcb5599700 1 -- 172.21.15.45:0/625052651 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb00671d0 con 0x7efca80378b0 2023-11-28T12:06:39.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.192+0000 7efcb5599700 1 -- 172.21.15.45:0/625052651 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcb0067330 con 0x7efca80378b0 2023-11-28T12:06:39.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.192+0000 7efcb5599700 1 -- 172.21.15.45:0/625052651 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb00676e0 con 0x7efca80378b0 2023-11-28T12:06:39.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.193+0000 7efcb759d700 1 -- 172.21.15.45:0/625052651 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efca80378b0 msgr2=0x7efca8037d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:39.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.193+0000 7efcb759d700 1 --2- 172.21.15.45:0/625052651 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efca80378b0 0x7efca8037d30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7efcb004e910 tx=0x7efcb0068c60 comp rx=0 tx=0).stop 2023-11-28T12:06:39.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.197+0000 7efcb759d700 1 -- 172.21.15.45:0/625052651 shutdown_connections 2023-11-28T12:06:39.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.197+0000 7efcb759d700 1 --2- 172.21.15.45:0/625052651 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efca80378b0 0x7efca8037d30 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:39.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.197+0000 7efcb759d700 1 --2- 172.21.15.45:0/625052651 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7efca80df6f0 0x7efca8050480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:39.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.197+0000 7efcb759d700 1 -- 172.21.15.45:0/625052651 >> 172.21.15.45:0/625052651 conn(0x7efca80528b0 msgr2=0x7efca8052cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:39.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.197+0000 7efcb759d700 1 -- 172.21.15.45:0/625052651 shutdown_connections 2023-11-28T12:06:39.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.197+0000 7efcb759d700 1 -- 172.21.15.45:0/625052651 wait complete. 2023-11-28T12:06:39.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.201+0000 7efcb759d700 1 Processor -- start 2023-11-28T12:06:39.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.201+0000 7efcb759d700 1 -- start start 2023-11-28T12:06:39.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.203+0000 7efcb759d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efca80378b0 0x7efca80d9b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:39.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.204+0000 7efcb759d700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7efca8051fe0 0x7efca80d9470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:39.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.204+0000 7efcb659b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efca80378b0 0x7efca80d9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:39.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.204+0000 7efcb659b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efca80378b0 0x7efca80d9b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.45:44818/0 (socket says 172.21.15.45:44818) 2023-11-28T12:06:39.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.204+0000 7efcb659b700 1 -- 172.21.15.45:0/363440453 learned_addr learned my addr 172.21.15.45:0/363440453 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:39.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.204+0000 7efcb5d9a700 1 --2- 172.21.15.45:0/363440453 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7efca8051fe0 0x7efca80d9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:39.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.204+0000 7efcb759d700 1 --2- 172.21.15.45:0/363440453 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efca80df6f0 0x7efca80daba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:39.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.205+0000 7efcb759d700 1 -- 172.21.15.45:0/363440453 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca80d99b0 con 0x7efca80df6f0 2023-11-28T12:06:39.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.205+0000 7efcb759d700 1 -- 172.21.15.45:0/363440453 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca804fd30 con 0x7efca80378b0 2023-11-28T12:06:39.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.205+0000 7efcb759d700 1 -- 172.21.15.45:0/363440453 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efca804f400 con 0x7efca8051fe0 2023-11-28T12:06:39.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.205+0000 7efcb6d9c700 1 --2- 172.21.15.45:0/363440453 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efca80df6f0 0x7efca80daba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:39.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.206+0000 7efcb5d9a700 1 -- 172.21.15.45:0/363440453 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efca80378b0 msgr2=0x7efca80d9b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:39.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.207+0000 7efcb5d9a700 1 --2- 172.21.15.45:0/363440453 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efca80378b0 0x7efca80d9b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:39.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.207+0000 7efcb5d9a700 1 -- 172.21.15.45:0/363440453 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efca80df6f0 msgr2=0x7efca80daba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:39.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.207+0000 7efcb5d9a700 1 --2- 172.21.15.45:0/363440453 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efca80df6f0 0x7efca80daba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:39.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.207+0000 7efcb5d9a700 1 -- 172.21.15.45:0/363440453 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcb0068020 con 0x7efca8051fe0 2023-11-28T12:06:39.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.207+0000 7efcb6d9c700 1 --2- 172.21.15.45:0/363440453 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efca80df6f0 0x7efca80daba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:06:39.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.208+0000 7efcb5d9a700 1 --2- 172.21.15.45:0/363440453 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7efca8051fe0 0x7efca80d9470 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7efca000c410 tx=0x7efca000c720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:39.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.208+0000 7efca6ffd700 1 -- 172.21.15.45:0/363440453 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca00054e0 con 0x7efca8051fe0 2023-11-28T12:06:39.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.209+0000 7efcb759d700 1 -- 172.21.15.45:0/363440453 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efca8054750 con 0x7efca8051fe0 2023-11-28T12:06:39.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.209+0000 7efcb759d700 1 -- 172.21.15.45:0/363440453 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efca80dfac0 con 0x7efca8051fe0 2023-11-28T12:06:39.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.209+0000 7efca6ffd700 1 -- 172.21.15.45:0/363440453 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efca000ce90 con 0x7efca8051fe0 2023-11-28T12:06:39.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.209+0000 7efca6ffd700 1 -- 172.21.15.45:0/363440453 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca00038c0 con 0x7efca8051fe0 2023-11-28T12:06:39.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.211+0000 7efcb759d700 1 -- 172.21.15.45:0/363440453 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efca8054a30 con 0x7efca8051fe0 2023-11-28T12:06:39.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.214+0000 7efca6ffd700 1 -- 172.21.15.45:0/363440453 <== mon.2 v2:172.21.15.152:3301/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7efca0019030 con 0x7efca8051fe0 2023-11-28T12:06:39.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.216+0000 7efca6ffd700 1 --2- 172.21.15.45:0/363440453 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7efc940682f0 0x7efc9406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:39.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.217+0000 7efca6ffd700 1 -- 172.21.15.45:0/363440453 <== mon.2 v2:172.21.15.152:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7efca0084fe0 con 0x7efca8051fe0 2023-11-28T12:06:39.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.217+0000 7efcb659b700 1 --2- 172.21.15.45:0/363440453 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7efc940682f0 0x7efc9406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:39.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.219+0000 7efcb659b700 1 --2- 172.21.15.45:0/363440453 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7efc940682f0 0x7efc9406a7a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7efcac009520 tx=0x7efcac008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:39.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.220+0000 7efca6ffd700 1 -- 172.21.15.45:0/363440453 <== mon.2 v2:172.21.15.152:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7efca0051770 con 0x7efca8051fe0 2023-11-28T12:06:39.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.494+0000 7f386e5ff700 1 -- 172.21.15.45:0/2411090817 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f38680745c0 con 0x7f3868158890 2023-11-28T12:06:39.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.496+0000 7f3864ff9700 1 -- 172.21.15.45:0/2411090817 <== mon.1 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f385801d070 con 0x7f3868158890 2023-11-28T12:06:39.497 INFO:teuthology.orchestra.run.smithi045.stdout:55834574855 2023-11-28T12:06:39.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.500+0000 7f386e5ff700 1 -- 172.21.15.45:0/2411090817 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f384c068320 msgr2=0x7f384c06a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:39.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.501+0000 7f386e5ff700 1 --2- 172.21.15.45:0/2411090817 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f384c068320 0x7f384c06a7d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f385c006fd0 tx=0x7f385c009190 comp rx=0 tx=0).stop 2023-11-28T12:06:39.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.501+0000 7f386e5ff700 1 -- 172.21.15.45:0/2411090817 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3868158890 msgr2=0x7f3868070d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:39.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.501+0000 7f386e5ff700 1 --2- 172.21.15.45:0/2411090817 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3868158890 0x7f3868070d40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f385801f000 tx=0x7f3858004750 comp rx=0 tx=0).stop 2023-11-28T12:06:39.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.501+0000 7f386e5ff700 1 -- 172.21.15.45:0/2411090817 shutdown_connections 2023-11-28T12:06:39.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.502+0000 7f386e5ff700 1 --2- 172.21.15.45:0/2411090817 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f384c068320 0x7f384c06a7d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:39.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.502+0000 7f386e5ff700 1 --2- 172.21.15.45:0/2411090817 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3868158890 0x7f3868070d40 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:39.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.502+0000 7f386e5ff700 1 --2- 172.21.15.45:0/2411090817 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f386806d4f0 0x7f3868147110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:39.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.502+0000 7f386e5ff700 1 --2- 172.21.15.45:0/2411090817 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38680b0bb0 0x7f38680c3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:39.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.502+0000 7f386e5ff700 1 -- 172.21.15.45:0/2411090817 >> 172.21.15.45:0/2411090817 conn(0x7f38680cb670 msgr2=0x7f3868156da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:39.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.503+0000 7f386e5ff700 1 -- 172.21.15.45:0/2411090817 shutdown_connections 2023-11-28T12:06:39.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.503+0000 7f386e5ff700 1 -- 172.21.15.45:0/2411090817 wait complete. 2023-11-28T12:06:39.536 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.1 2023-11-28T12:06:39.536 DEBUG:teuthology.parallel:result is None 2023-11-28T12:06:39.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.583+0000 7f505a1ff700 1 -- 172.21.15.45:0/563163851 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f50540c93b0 con 0x7f50540b3090 2023-11-28T12:06:39.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.583+0000 7f503bfff700 1 -- 172.21.15.45:0/563163851 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f504c052400 con 0x7f50540b3090 2023-11-28T12:06:39.585 INFO:teuthology.orchestra.run.smithi045.stdout:55834574853 2023-11-28T12:06:39.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.586+0000 7f505a1ff700 1 -- 172.21.15.45:0/563163851 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f50400682f0 msgr2=0x7f504006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:39.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.586+0000 7f505a1ff700 1 --2- 172.21.15.45:0/563163851 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f50400682f0 0x7f504006a7a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5044004720 tx=0x7f5044008030 comp rx=0 tx=0).stop 2023-11-28T12:06:39.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.586+0000 7f505a1ff700 1 -- 172.21.15.45:0/563163851 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50540b3090 msgr2=0x7f5054159f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:39.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.586+0000 7f505a1ff700 1 --2- 172.21.15.45:0/563163851 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50540b3090 0x7f5054159f40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f504c007ef0 tx=0x7f504c00d3b0 comp rx=0 tx=0).stop 2023-11-28T12:06:39.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.586+0000 7f505a1ff700 1 -- 172.21.15.45:0/563163851 shutdown_connections 2023-11-28T12:06:39.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.586+0000 7f505a1ff700 1 --2- 172.21.15.45:0/563163851 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f50400682f0 0x7f504006a7a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:39.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.586+0000 7f505a1ff700 1 --2- 172.21.15.45:0/563163851 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f50540cf070 0x7f50541ef960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:39.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.586+0000 7f505a1ff700 1 --2- 172.21.15.45:0/563163851 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50540b3090 0x7f5054159f40 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:39.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.586+0000 7f505a1ff700 1 --2- 172.21.15.45:0/563163851 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f50540cb620 0x7f50540c4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:39.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.586+0000 7f505a1ff700 1 -- 172.21.15.45:0/563163851 >> 172.21.15.45:0/563163851 conn(0x7f505409a230 msgr2=0x7f50540cdf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:39.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.587+0000 7f505a1ff700 1 -- 172.21.15.45:0/563163851 shutdown_connections 2023-11-28T12:06:39.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.587+0000 7f505a1ff700 1 -- 172.21.15.45:0/563163851 wait complete. 2023-11-28T12:06:39.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.589+0000 7f53139ff700 1 -- 172.21.15.45:0/2856750653 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f530c0b40a0 con 0x7f530c0c1fd0 2023-11-28T12:06:39.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.590+0000 7f3f5e79d700 1 -- 172.21.15.45:0/2874344334 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3f58158c20 con 0x7f3f580ccbe0 2023-11-28T12:06:39.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.590+0000 7f5301ffb700 1 -- 172.21.15.45:0/2856750653 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f530c0b40a0 con 0x7f530c0c1fd0 2023-11-28T12:06:39.592 INFO:teuthology.orchestra.run.smithi045.stdout:55834574853 2023-11-28T12:06:39.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.590+0000 7f3f4dffb700 1 -- 172.21.15.45:0/2874344334 <== mon.2 v2:172.21.15.152:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3f4801c020 con 0x7f3f580ccbe0 2023-11-28T12:06:39.592 INFO:teuthology.orchestra.run.smithi045.stdout:55834574854 2023-11-28T12:06:39.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.593+0000 7fc772bff700 1 -- 172.21.15.45:0/2349548253 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fc750005870 con 0x7fc76c0cde10 2023-11-28T12:06:39.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.593+0000 7fedec5ff700 1 -- 172.21.15.45:0/4108476030 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fede4153d00 con 0x7fede4158890 2023-11-28T12:06:39.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.594+0000 7f53139ff700 1 -- 172.21.15.45:0/2856750653 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f52f0068340 msgr2=0x7f52f006a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:39.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.594+0000 7f53139ff700 1 --2- 172.21.15.45:0/2856750653 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f52f0068340 0x7f52f006a7f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5308009130 tx=0x7f5308008030 comp rx=0 tx=0).stop 2023-11-28T12:06:39.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.594+0000 7f53139ff700 1 -- 172.21.15.45:0/2856750653 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f530c0c1fd0 msgr2=0x7f530c154070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:39.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.594+0000 7f53139ff700 1 --2- 172.21.15.45:0/2856750653 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f530c0c1fd0 0x7f530c154070 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f530400cc50 tx=0x7f530400a340 comp rx=0 tx=0).stop 2023-11-28T12:06:39.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.594+0000 7f53139ff700 1 -- 172.21.15.45:0/2856750653 shutdown_connections 2023-11-28T12:06:39.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.594+0000 7feddaffd700 1 -- 172.21.15.45:0/4108476030 <== mon.2 v2:172.21.15.152:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fede4153d00 con 0x7fede4158890 2023-11-28T12:06:39.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.594+0000 7f53139ff700 1 --2- 172.21.15.45:0/2856750653 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f52f0068340 0x7f52f006a7f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:39.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.594+0000 7f53139ff700 1 --2- 172.21.15.45:0/2856750653 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f530c164e60 0x7f530c071660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:39.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.594+0000 7f53139ff700 1 --2- 172.21.15.45:0/2856750653 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f530c0c1fd0 0x7f530c154070 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:39.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.594+0000 7f53139ff700 1 --2- 172.21.15.45:0/2856750653 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f530c0ce480 0x7f530c071120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:39.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.594+0000 7f53139ff700 1 -- 172.21.15.45:0/2856750653 >> 172.21.15.45:0/2856750653 conn(0x7f530c0cb670 msgr2=0x7f530c1636a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:39.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.594+0000 7fc7697fa700 1 -- 172.21.15.45:0/2349548253 <== mon.1 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc764065510 con 0x7fc76c0cde10 2023-11-28T12:06:39.597 INFO:teuthology.orchestra.run.smithi045.stdout:55834574853 2023-11-28T12:06:39.597 INFO:teuthology.orchestra.run.smithi045.stdout:55834574854 2023-11-28T12:06:39.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.595+0000 7f3f5e79d700 1 -- 172.21.15.45:0/2874344334 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f3f3c068350 msgr2=0x7f3f3c06a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:39.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.595+0000 7f3f5e79d700 1 --2- 172.21.15.45:0/2874344334 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f3f3c068350 0x7f3f3c06a800 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3f54009ac0 tx=0x7f3f540091c0 comp rx=0 tx=0).stop 2023-11-28T12:06:39.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.595+0000 7f3f5e79d700 1 -- 172.21.15.45:0/2874344334 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3f580ccbe0 msgr2=0x7f3f581fe590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:39.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.595+0000 7f3f5e79d700 1 --2- 172.21.15.45:0/2874344334 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3f580ccbe0 0x7f3f581fe590 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3f4800dd90 tx=0x7f3f48009400 comp rx=0 tx=0).stop 2023-11-28T12:06:39.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.595+0000 7f3f5e79d700 1 -- 172.21.15.45:0/2874344334 shutdown_connections 2023-11-28T12:06:39.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.595+0000 7f3f5e79d700 1 --2- 172.21.15.45:0/2874344334 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f3f3c068350 0x7f3f3c06a800 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:39.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.595+0000 7f3f5e79d700 1 --2- 172.21.15.45:0/2874344334 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3f580cc020 0x7f3f580c5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:39.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.595+0000 7f3f5e79d700 1 --2- 172.21.15.45:0/2874344334 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3f581e21a0 0x7f3f5815b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:39.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.595+0000 7f3f5e79d700 1 --2- 172.21.15.45:0/2874344334 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3f580ccbe0 0x7f3f581fe590 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:39.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.595+0000 7f3f5e79d700 1 -- 172.21.15.45:0/2874344334 >> 172.21.15.45:0/2874344334 conn(0x7f3f580cb510 msgr2=0x7f3f58157ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:39.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.595+0000 7f53139ff700 1 -- 172.21.15.45:0/2856750653 shutdown_connections 2023-11-28T12:06:39.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.595+0000 7f3f5e79d700 1 -- 172.21.15.45:0/2874344334 shutdown_connections 2023-11-28T12:06:39.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.595+0000 7f53139ff700 1 -- 172.21.15.45:0/2856750653 wait complete. 2023-11-28T12:06:39.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.596+0000 7f3f5e79d700 1 -- 172.21.15.45:0/2874344334 wait complete. 2023-11-28T12:06:39.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.598+0000 7fc772bff700 1 -- 172.21.15.45:0/2349548253 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fc74c068340 msgr2=0x7fc74c06a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:39.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.598+0000 7fc772bff700 1 --2- 172.21.15.45:0/2349548253 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fc74c068340 0x7fc74c06a7f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc754011fd0 tx=0x7fc754008040 comp rx=0 tx=0).stop 2023-11-28T12:06:39.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.598+0000 7fc772bff700 1 -- 172.21.15.45:0/2349548253 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc76c0cde10 msgr2=0x7fc76c15ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:39.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.598+0000 7fc772bff700 1 --2- 172.21.15.45:0/2349548253 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc76c0cde10 0x7fc76c15ba60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc764004000 tx=0x7fc764004750 comp rx=0 tx=0).stop 2023-11-28T12:06:39.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.598+0000 7fedec5ff700 1 -- 172.21.15.45:0/4108476030 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fedc80683c0 msgr2=0x7fedc806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:39.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.598+0000 7fedec5ff700 1 --2- 172.21.15.45:0/4108476030 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fedc80683c0 0x7fedc806a870 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fede0006fd0 tx=0x7fede0008040 comp rx=0 tx=0).stop 2023-11-28T12:06:39.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.598+0000 7fedec5ff700 1 -- 172.21.15.45:0/4108476030 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fede4158890 msgr2=0x7fede41572b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:39.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.598+0000 7fedec5ff700 1 --2- 172.21.15.45:0/4108476030 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fede4158890 0x7fede41572b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7feddc015040 tx=0x7feddc004ad0 comp rx=0 tx=0).stop 2023-11-28T12:06:39.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.598+0000 7fedec5ff700 1 -- 172.21.15.45:0/4108476030 shutdown_connections 2023-11-28T12:06:39.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.598+0000 7fedec5ff700 1 --2- 172.21.15.45:0/4108476030 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fedc80683c0 0x7fedc806a870 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:39.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.598+0000 7fedec5ff700 1 --2- 172.21.15.45:0/4108476030 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fede406d4f0 0x7fede41471a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:39.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.598+0000 7fedec5ff700 1 --2- 172.21.15.45:0/4108476030 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fede4158890 0x7fede41572b0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:39.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.598+0000 7fedec5ff700 1 --2- 172.21.15.45:0/4108476030 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fede40b0d80 0x7fede4156d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:39.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.598+0000 7fedec5ff700 1 -- 172.21.15.45:0/4108476030 >> 172.21.15.45:0/4108476030 conn(0x7fede40cb670 msgr2=0x7fede40ca830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:39.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.598+0000 7fc772bff700 1 -- 172.21.15.45:0/2349548253 shutdown_connections 2023-11-28T12:06:39.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.598+0000 7fc772bff700 1 --2- 172.21.15.45:0/2349548253 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fc74c068340 0x7fc74c06a7f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:39.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.598+0000 7fc772bff700 1 --2- 172.21.15.45:0/2349548253 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc76c0cde10 0x7fc76c15ba60 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:39.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.598+0000 7fc772bff700 1 --2- 172.21.15.45:0/2349548253 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc76c0b0d80 0x7fc76c1586a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:39.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.598+0000 7fc772bff700 1 --2- 172.21.15.45:0/2349548253 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc76c0cacb0 0x7fc76c158be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:39.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.598+0000 7fc772bff700 1 -- 172.21.15.45:0/2349548253 >> 172.21.15.45:0/2349548253 conn(0x7fc76c0cb670 msgr2=0x7fc76c0b2e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:39.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.598+0000 7fc772bff700 1 -- 172.21.15.45:0/2349548253 shutdown_connections 2023-11-28T12:06:39.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.599+0000 7fedec5ff700 1 -- 172.21.15.45:0/4108476030 shutdown_connections 2023-11-28T12:06:39.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.599+0000 7fc772bff700 1 -- 172.21.15.45:0/2349548253 wait complete. 2023-11-28T12:06:39.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.599+0000 7fedec5ff700 1 -- 172.21.15.45:0/4108476030 wait complete. 2023-11-28T12:06:39.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.599+0000 7f08dd5ff700 1 -- 172.21.15.45:0/82175296 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f08d80c6bb0 con 0x7f08d80d01b0 2023-11-28T12:06:39.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.600+0000 7f08bf7fe700 1 -- 172.21.15.45:0/82175296 <== mon.2 v2:172.21.15.152:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f08d80c6bb0 con 0x7f08d80d01b0 2023-11-28T12:06:39.612 INFO:teuthology.orchestra.run.smithi045.stdout:55834574853 2023-11-28T12:06:39.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.604+0000 7f08dd5ff700 1 -- 172.21.15.45:0/82175296 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f08c40683c0 msgr2=0x7f08c406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:39.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.604+0000 7f08dd5ff700 1 --2- 172.21.15.45:0/82175296 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f08c40683c0 0x7f08c406a870 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f08d0007dd0 tx=0x7f08d0007300 comp rx=0 tx=0).stop 2023-11-28T12:06:39.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.604+0000 7f08dd5ff700 1 -- 172.21.15.45:0/82175296 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f08d80d01b0 msgr2=0x7f08d80b64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:39.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.604+0000 7f08dd5ff700 1 --2- 172.21.15.45:0/82175296 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f08d80d01b0 0x7f08d80b64e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f08cc00c410 tx=0x7f08cc005810 comp rx=0 tx=0).stop 2023-11-28T12:06:39.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.604+0000 7f08dd5ff700 1 -- 172.21.15.45:0/82175296 shutdown_connections 2023-11-28T12:06:39.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.604+0000 7f08dd5ff700 1 --2- 172.21.15.45:0/82175296 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f08c40683c0 0x7f08c406a870 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:39.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.604+0000 7f08dd5ff700 1 --2- 172.21.15.45:0/82175296 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f08d80b20b0 0x7f08d81525e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:39.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.604+0000 7f08dd5ff700 1 --2- 172.21.15.45:0/82175296 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f08d80d01b0 0x7f08d80b64e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:39.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.604+0000 7f08dd5ff700 1 --2- 172.21.15.45:0/82175296 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08d80b29b0 0x7f08d80b5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:39.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.604+0000 7f08dd5ff700 1 -- 172.21.15.45:0/82175296 >> 172.21.15.45:0/82175296 conn(0x7f08d809c3f0 msgr2=0x7f08d806b4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:39.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.605+0000 7f08dd5ff700 1 -- 172.21.15.45:0/82175296 shutdown_connections 2023-11-28T12:06:39.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.605+0000 7f08dd5ff700 1 -- 172.21.15.45:0/82175296 wait complete. 2023-11-28T12:06:39.617 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.6 2023-11-28T12:06:39.617 DEBUG:teuthology.parallel:result is None 2023-11-28T12:06:39.632 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.0 2023-11-28T12:06:39.632 DEBUG:teuthology.parallel:result is None 2023-11-28T12:06:39.635 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.2 2023-11-28T12:06:39.635 DEBUG:teuthology.parallel:result is None 2023-11-28T12:06:39.636 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.5 2023-11-28T12:06:39.636 DEBUG:teuthology.parallel:result is None 2023-11-28T12:06:39.637 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.3 2023-11-28T12:06:39.638 DEBUG:teuthology.parallel:result is None 2023-11-28T12:06:39.639 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.4 2023-11-28T12:06:39.640 DEBUG:teuthology.parallel:result is None 2023-11-28T12:06:39.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.650+0000 7efcb759d700 1 -- 172.21.15.45:0/363440453 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7efca8005940 con 0x7efca8051fe0 2023-11-28T12:06:39.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.651+0000 7efca6ffd700 1 -- 172.21.15.45:0/363440453 <== mon.2 v2:172.21.15.152:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efca0017020 con 0x7efca8051fe0 2023-11-28T12:06:39.652 INFO:teuthology.orchestra.run.smithi045.stdout:55834574855 2023-11-28T12:06:39.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.653+0000 7efcb759d700 1 -- 172.21.15.45:0/363440453 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7efc940682f0 msgr2=0x7efc9406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:39.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.653+0000 7efcb759d700 1 --2- 172.21.15.45:0/363440453 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7efc940682f0 0x7efc9406a7a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7efcac009520 tx=0x7efcac008040 comp rx=0 tx=0).stop 2023-11-28T12:06:39.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.653+0000 7efcb759d700 1 -- 172.21.15.45:0/363440453 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7efca8051fe0 msgr2=0x7efca80d9470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:39.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.653+0000 7efcb759d700 1 --2- 172.21.15.45:0/363440453 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7efca8051fe0 0x7efca80d9470 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7efca000c410 tx=0x7efca000c720 comp rx=0 tx=0).stop 2023-11-28T12:06:39.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.653+0000 7efcb759d700 1 -- 172.21.15.45:0/363440453 shutdown_connections 2023-11-28T12:06:39.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.653+0000 7efcb759d700 1 --2- 172.21.15.45:0/363440453 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7efc940682f0 0x7efc9406a7a0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:39.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.653+0000 7efcb759d700 1 --2- 172.21.15.45:0/363440453 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efca80378b0 0x7efca80d9b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:39.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.653+0000 7efcb759d700 1 --2- 172.21.15.45:0/363440453 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efca80df6f0 0x7efca80daba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:39.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.653+0000 7efcb759d700 1 --2- 172.21.15.45:0/363440453 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7efca8051fe0 0x7efca80d9470 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:39.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.653+0000 7efcb759d700 1 -- 172.21.15.45:0/363440453 >> 172.21.15.45:0/363440453 conn(0x7efca80528b0 msgr2=0x7efca80539e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:39.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.653+0000 7efcb759d700 1 -- 172.21.15.45:0/363440453 shutdown_connections 2023-11-28T12:06:39.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.653+0000 7efcb759d700 1 -- 172.21.15.45:0/363440453 wait complete. 2023-11-28T12:06:39.672 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.7 2023-11-28T12:06:39.672 DEBUG:teuthology.parallel:result is None 2023-11-28T12:06:39.672 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-28T12:06:39.672 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T12:06:39.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.915+0000 7f34401ff700 1 Processor -- start 2023-11-28T12:06:39.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.916+0000 7f34401ff700 1 -- start start 2023-11-28T12:06:39.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.917+0000 7f34401ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f34380d1330 0x7f34380b06c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:39.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.917+0000 7f34401ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f34380b20b0 0x7f34380b0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:39.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.917+0000 7f34401ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34380b0230 con 0x7f34380d01b0 2023-11-28T12:06:39.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.917+0000 7f34401ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f343815cec0 con 0x7f34380b20b0 2023-11-28T12:06:39.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.917+0000 7f34401ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34380b4570 con 0x7f34380d1330 2023-11-28T12:06:39.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.917+0000 7f343df9b700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f34380d01b0 0x7f34380d0c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:32840/0 (socket says 172.21.15.45:32840) 2023-11-28T12:06:39.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.917+0000 7f343df9b700 1 -- 172.21.15.45:0/146365571 learned_addr learned my addr 172.21.15.45:0/146365571 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:06:39.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.917+0000 7f343d79a700 1 --2- 172.21.15.45:0/146365571 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f34380d1330 0x7f34380b06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:39.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.917+0000 7f343cf99700 1 -- 172.21.15.45:0/146365571 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 125073384 0 0) 0x7f34380b0230 con 0x7f34380d01b0 2023-11-28T12:06:39.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.917+0000 7f343e79c700 1 --2- 172.21.15.45:0/146365571 >> v2:172.21.15.152:3300/0 conn(0x7f34380b20b0 0x7f34380b0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:39.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.918+0000 7f343cf99700 1 -- 172.21.15.45:0/146365571 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34240035b0 con 0x7f34380d01b0 2023-11-28T12:06:39.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.918+0000 7f343d79a700 1 -- 172.21.15.45:0/146365571 >> v2:172.21.15.152:3300/0 conn(0x7f34380b20b0 msgr2=0x7f34380b0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:06:39.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.918+0000 7f343d79a700 1 --2- 172.21.15.45:0/146365571 >> v2:172.21.15.152:3300/0 conn(0x7f34380b20b0 0x7f34380b0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:39.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.918+0000 7f343d79a700 1 -- 172.21.15.45:0/146365571 >> v1:172.21.15.45:6789/0 conn(0x7f34380d01b0 legacy=0x7f34380d0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:39.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.918+0000 7f343cf99700 1 -- 172.21.15.45:0/146365571 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2333664314 0 0) 0x7f34240035b0 con 0x7f34380d01b0 2023-11-28T12:06:39.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.918+0000 7f343d79a700 1 -- 172.21.15.45:0/146365571 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34380b4850 con 0x7f34380d1330 2023-11-28T12:06:39.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.918+0000 7f343e79c700 1 --2- 172.21.15.45:0/146365571 >> v2:172.21.15.152:3300/0 conn(0x7f34380b20b0 0x7f34380b0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:06:39.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.918+0000 7f343d79a700 1 --2- 172.21.15.45:0/146365571 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f34380d1330 0x7f34380b06c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3428009840 tx=0x7f3428009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ba7e9648af99b39 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:39.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.919+0000 7f343cf99700 1 -- 172.21.15.45:0/146365571 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3434001670 con 0x7f34380d1330 2023-11-28T12:06:39.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.919+0000 7f343cf99700 1 -- 172.21.15.45:0/146365571 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3428004030 con 0x7f34380d1330 2023-11-28T12:06:39.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.919+0000 7f343cf99700 1 -- 172.21.15.45:0/146365571 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34280043c0 con 0x7f34380d1330 2023-11-28T12:06:39.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.919+0000 7f34401ff700 1 -- 172.21.15.45:0/146365571 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f34380d1330 msgr2=0x7f34380b06c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:39.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.919+0000 7f34401ff700 1 --2- 172.21.15.45:0/146365571 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f34380d1330 0x7f34380b06c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3428009840 tx=0x7f3428009b50 comp rx=0 tx=0).stop 2023-11-28T12:06:39.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.919+0000 7f34401ff700 1 -- 172.21.15.45:0/146365571 shutdown_connections 2023-11-28T12:06:39.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.919+0000 7f34401ff700 1 --2- 172.21.15.45:0/146365571 >> v2:172.21.15.152:3300/0 conn(0x7f34380b20b0 0x7f34380b0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:39.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.919+0000 7f34401ff700 1 --2- 172.21.15.45:0/146365571 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f34380d1330 0x7f34380b06c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:39.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.919+0000 7f34401ff700 1 -- 172.21.15.45:0/146365571 >> 172.21.15.45:0/146365571 conn(0x7f343809c3f0 msgr2=0x7f34380d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:39.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.919+0000 7f34401ff700 1 -- 172.21.15.45:0/146365571 shutdown_connections 2023-11-28T12:06:39.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.920+0000 7f34401ff700 1 -- 172.21.15.45:0/146365571 wait complete. 2023-11-28T12:06:39.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.921+0000 7f34401ff700 1 Processor -- start 2023-11-28T12:06:39.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.921+0000 7f34401ff700 1 -- start start 2023-11-28T12:06:39.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.922+0000 7f34401ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34380b20b0 0x7f3438159530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:39.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.922+0000 7f34401ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f34380d01b0 0x7f343815f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:39.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.922+0000 7f34401ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f34380d1330 0x7f343806b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:39.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.922+0000 7f34401ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f343815d000 con 0x7f34380d1330 2023-11-28T12:06:39.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.922+0000 7f34401ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3438159a70 con 0x7f34380b20b0 2023-11-28T12:06:39.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.922+0000 7f34401ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f343815fd10 con 0x7f34380d01b0 2023-11-28T12:06:39.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.923+0000 7f343e79c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f34380d1330 0x7f343806b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:39.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.923+0000 7f343df9b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34380b20b0 0x7f3438159530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:39.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.923+0000 7f343e79c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f34380d1330 0x7f343806b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36176/0 (socket says 172.21.15.45:36176) 2023-11-28T12:06:39.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.923+0000 7f343e79c700 1 -- 172.21.15.45:0/1981063045 learned_addr learned my addr 172.21.15.45:0/1981063045 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:39.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.923+0000 7f343d79a700 1 --2- 172.21.15.45:0/1981063045 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f34380d01b0 0x7f343815f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:39.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.923+0000 7f343e79c700 1 -- 172.21.15.45:0/1981063045 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f34380d01b0 msgr2=0x7f343815f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:39.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.923+0000 7f343e79c700 1 --2- 172.21.15.45:0/1981063045 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f34380d01b0 0x7f343815f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:39.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.923+0000 7f343e79c700 1 -- 172.21.15.45:0/1981063045 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34380b20b0 msgr2=0x7f3438159530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:39.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.923+0000 7f343e79c700 1 --2- 172.21.15.45:0/1981063045 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34380b20b0 0x7f3438159530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:39.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.923+0000 7f343e79c700 1 -- 172.21.15.45:0/1981063045 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3430009a70 con 0x7f34380d1330 2023-11-28T12:06:39.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.923+0000 7f343e79c700 1 --2- 172.21.15.45:0/1981063045 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f34380d1330 0x7f343806b4f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f343000efb0 tx=0x7f343000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:39.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.924+0000 7f342e7fc700 1 -- 172.21.15.45:0/1981063045 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f343000cc90 con 0x7f34380d1330 2023-11-28T12:06:39.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.924+0000 7f342e7fc700 1 -- 172.21.15.45:0/1981063045 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f343000f040 con 0x7f34380d1330 2023-11-28T12:06:39.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.924+0000 7f34401ff700 1 -- 172.21.15.45:0/1981063045 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34280094a0 con 0x7f34380d1330 2023-11-28T12:06:39.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.924+0000 7f342e7fc700 1 -- 172.21.15.45:0/1981063045 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3430014480 con 0x7f34380d1330 2023-11-28T12:06:39.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.924+0000 7f34401ff700 1 -- 172.21.15.45:0/1981063045 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34380afec0 con 0x7f34380d1330 2023-11-28T12:06:39.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.925+0000 7f34401ff700 1 -- 172.21.15.45:0/1981063045 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34380afbe0 con 0x7f34380d1330 2023-11-28T12:06:39.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.926+0000 7f342e7fc700 1 -- 172.21.15.45:0/1981063045 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f34300145e0 con 0x7f34380d1330 2023-11-28T12:06:39.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.927+0000 7f342e7fc700 1 --2- 172.21.15.45:0/1981063045 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f341c0682f0 0x7f341c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:39.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.927+0000 7f342e7fc700 1 -- 172.21.15.45:0/1981063045 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3430086b20 con 0x7f34380d1330 2023-11-28T12:06:39.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.927+0000 7f343df9b700 1 --2- 172.21.15.45:0/1981063045 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f341c0682f0 0x7f341c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:39.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.928+0000 7f343df9b700 1 --2- 172.21.15.45:0/1981063045 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f341c0682f0 0x7f341c06a7a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3434000f60 tx=0x7f3434001230 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:39.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:39.931+0000 7f342e7fc700 1 -- 172.21.15.45:0/1981063045 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f3430053290 con 0x7f34380d1330 2023-11-28T12:06:40.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.130+0000 7f34401ff700 1 -- 172.21.15.45:0/1981063045 --> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f34380b2600 con 0x7f341c0682f0 2023-11-28T12:06:40.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.140+0000 7f342e7fc700 1 -- 172.21.15.45:0/1981063045 <== mgr.4100 v2:172.21.15.152:6832/115389 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286854 (secure 0 0 0) 0x7f34380b2600 con 0x7f341c0682f0 2023-11-28T12:06:40.144 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:06:40.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.144+0000 7f34401ff700 1 -- 172.21.15.45:0/1981063045 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f341c0682f0 msgr2=0x7f341c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:40.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.144+0000 7f34401ff700 1 --2- 172.21.15.45:0/1981063045 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f341c0682f0 0x7f341c06a7a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3434000f60 tx=0x7f3434001230 comp rx=0 tx=0).stop 2023-11-28T12:06:40.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.144+0000 7f34401ff700 1 -- 172.21.15.45:0/1981063045 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f34380d1330 msgr2=0x7f343806b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:40.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.144+0000 7f34401ff700 1 --2- 172.21.15.45:0/1981063045 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f34380d1330 0x7f343806b4f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f343000efb0 tx=0x7f343000c3a0 comp rx=0 tx=0).stop 2023-11-28T12:06:40.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.144+0000 7f34401ff700 1 -- 172.21.15.45:0/1981063045 shutdown_connections 2023-11-28T12:06:40.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.144+0000 7f34401ff700 1 --2- 172.21.15.45:0/1981063045 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f341c0682f0 0x7f341c06a7a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:40.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.144+0000 7f34401ff700 1 --2- 172.21.15.45:0/1981063045 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f34380b20b0 0x7f3438159530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:40.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.144+0000 7f34401ff700 1 --2- 172.21.15.45:0/1981063045 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f34380d1330 0x7f343806b4f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:40.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.144+0000 7f34401ff700 1 --2- 172.21.15.45:0/1981063045 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f34380d01b0 0x7f343815f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:40.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.144+0000 7f34401ff700 1 -- 172.21.15.45:0/1981063045 >> 172.21.15.45:0/1981063045 conn(0x7f343809c3f0 msgr2=0x7f343815c400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:40.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.144+0000 7f34401ff700 1 -- 172.21.15.45:0/1981063045 shutdown_connections 2023-11-28T12:06:40.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.144+0000 7f34401ff700 1 -- 172.21.15.45:0/1981063045 wait complete. 2023-11-28T12:06:40.148 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-11-28T12:06:40.163 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-11-28T12:06:38.426273+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":82304,"kb_used_data":2816,"kb_used_omap":0,"kb_used_meta":79424,"kb_avail":754892416,"statfs":{"total":773094113280,"available":773009833984,"internally_reserved":0,"allocated":2883584,"data_stored":1778098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":81330176},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.027884"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.400350+0000","last_change":"2023-11-28T12:06:29.429595+0000","last_active":"2023-11-28T12:06:30.400350+0000","last_peered":"2023-11-28T12:06:30.400350+0000","last_clean":"2023-11-28T12:06:30.400350+0000","last_became_active":"2023-11-28T12:06:29.428839+0000","last_became_peered":"2023-11-28T12:06:29.428839+0000","last_unstale":"2023-11-28T12:06:30.400350+0000","last_undegraded":"2023-11-28T12:06:30.400350+0000","last_fullsized":"2023-11-28T12:06:30.400350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:51:28.536571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.402235+0000","last_change":"2023-11-28T12:06:29.425536+0000","last_active":"2023-11-28T12:06:30.402235+0000","last_peered":"2023-11-28T12:06:30.402235+0000","last_clean":"2023-11-28T12:06:30.402235+0000","last_became_active":"2023-11-28T12:06:29.425250+0000","last_became_peered":"2023-11-28T12:06:29.425250+0000","last_unstale":"2023-11-28T12:06:30.402235+0000","last_undegraded":"2023-11-28T12:06:30.402235+0000","last_fullsized":"2023-11-28T12:06:30.402235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:27:03.452097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432130+0000","last_change":"2023-11-28T12:06:29.419165+0000","last_active":"2023-11-28T12:06:30.432130+0000","last_peered":"2023-11-28T12:06:30.432130+0000","last_clean":"2023-11-28T12:06:30.432130+0000","last_became_active":"2023-11-28T12:06:29.417243+0000","last_became_peered":"2023-11-28T12:06:29.417243+0000","last_unstale":"2023-11-28T12:06:30.432130+0000","last_undegraded":"2023-11-28T12:06:30.432130+0000","last_fullsized":"2023-11-28T12:06:30.432130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:20:33.063079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.402605+0000","last_change":"2023-11-28T12:06:29.422225+0000","last_active":"2023-11-28T12:06:30.402605+0000","last_peered":"2023-11-28T12:06:30.402605+0000","last_clean":"2023-11-28T12:06:30.402605+0000","last_became_active":"2023-11-28T12:06:29.419794+0000","last_became_peered":"2023-11-28T12:06:29.419794+0000","last_unstale":"2023-11-28T12:06:30.402605+0000","last_undegraded":"2023-11-28T12:06:30.402605+0000","last_fullsized":"2023-11-28T12:06:30.402605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:02:26.849301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.430942+0000","last_change":"2023-11-28T12:06:29.426450+0000","last_active":"2023-11-28T12:06:30.430942+0000","last_peered":"2023-11-28T12:06:30.430942+0000","last_clean":"2023-11-28T12:06:30.430942+0000","last_became_active":"2023-11-28T12:06:29.424681+0000","last_became_peered":"2023-11-28T12:06:29.424681+0000","last_unstale":"2023-11-28T12:06:30.430942+0000","last_undegraded":"2023-11-28T12:06:30.430942+0000","last_fullsized":"2023-11-28T12:06:30.430942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:27:03.452097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431570+0000","last_change":"2023-11-28T12:06:29.419827+0000","last_active":"2023-11-28T12:06:30.431570+0000","last_peered":"2023-11-28T12:06:30.431570+0000","last_clean":"2023-11-28T12:06:30.431570+0000","last_became_active":"2023-11-28T12:06:29.419556+0000","last_became_peered":"2023-11-28T12:06:29.419556+0000","last_unstale":"2023-11-28T12:06:30.431570+0000","last_undegraded":"2023-11-28T12:06:30.431570+0000","last_fullsized":"2023-11-28T12:06:30.431570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:05:52.134696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431287+0000","last_change":"2023-11-28T12:06:29.426829+0000","last_active":"2023-11-28T12:06:30.431287+0000","last_peered":"2023-11-28T12:06:30.431287+0000","last_clean":"2023-11-28T12:06:30.431287+0000","last_became_active":"2023-11-28T12:06:29.426579+0000","last_became_peered":"2023-11-28T12:06:29.426579+0000","last_unstale":"2023-11-28T12:06:30.431287+0000","last_undegraded":"2023-11-28T12:06:30.431287+0000","last_fullsized":"2023-11-28T12:06:30.431287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:03:53.795177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.402279+0000","last_change":"2023-11-28T12:06:29.425956+0000","last_active":"2023-11-28T12:06:30.402279+0000","last_peered":"2023-11-28T12:06:30.402279+0000","last_clean":"2023-11-28T12:06:30.402279+0000","last_became_active":"2023-11-28T12:06:29.422623+0000","last_became_peered":"2023-11-28T12:06:29.422623+0000","last_unstale":"2023-11-28T12:06:30.402279+0000","last_undegraded":"2023-11-28T12:06:30.402279+0000","last_fullsized":"2023-11-28T12:06:30.402279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:28:44.482157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432487+0000","last_change":"2023-11-28T12:06:29.431715+0000","last_active":"2023-11-28T12:06:30.432487+0000","last_peered":"2023-11-28T12:06:30.432487+0000","last_clean":"2023-11-28T12:06:30.432487+0000","last_became_active":"2023-11-28T12:06:29.431487+0000","last_became_peered":"2023-11-28T12:06:29.431487+0000","last_unstale":"2023-11-28T12:06:30.432487+0000","last_undegraded":"2023-11-28T12:06:30.432487+0000","last_fullsized":"2023-11-28T12:06:30.432487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:57:52.848285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.402475+0000","last_change":"2023-11-28T12:06:29.421929+0000","last_active":"2023-11-28T12:06:30.402475+0000","last_peered":"2023-11-28T12:06:30.402475+0000","last_clean":"2023-11-28T12:06:30.402475+0000","last_became_active":"2023-11-28T12:06:29.421572+0000","last_became_peered":"2023-11-28T12:06:29.421572+0000","last_unstale":"2023-11-28T12:06:30.402475+0000","last_undegraded":"2023-11-28T12:06:30.402475+0000","last_fullsized":"2023-11-28T12:06:30.402475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:31:18.258195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432165+0000","last_change":"2023-11-28T12:06:29.427047+0000","last_active":"2023-11-28T12:06:30.432165+0000","last_peered":"2023-11-28T12:06:30.432165+0000","last_clean":"2023-11-28T12:06:30.432165+0000","last_became_active":"2023-11-28T12:06:29.418090+0000","last_became_peered":"2023-11-28T12:06:29.418090+0000","last_unstale":"2023-11-28T12:06:30.432165+0000","last_undegraded":"2023-11-28T12:06:30.432165+0000","last_fullsized":"2023-11-28T12:06:30.432165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:24:27.065719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.400209+0000","last_change":"2023-11-28T12:06:29.424306+0000","last_active":"2023-11-28T12:06:30.400209+0000","last_peered":"2023-11-28T12:06:30.400209+0000","last_clean":"2023-11-28T12:06:30.400209+0000","last_became_active":"2023-11-28T12:06:29.424059+0000","last_became_peered":"2023-11-28T12:06:29.424059+0000","last_unstale":"2023-11-28T12:06:30.400209+0000","last_undegraded":"2023-11-28T12:06:30.400209+0000","last_fullsized":"2023-11-28T12:06:30.400209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:10:08.464896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.400054+0000","last_change":"2023-11-28T12:06:29.422496+0000","last_active":"2023-11-28T12:06:30.400054+0000","last_peered":"2023-11-28T12:06:30.400054+0000","last_clean":"2023-11-28T12:06:30.400054+0000","last_became_active":"2023-11-28T12:06:29.422201+0000","last_became_peered":"2023-11-28T12:06:29.422201+0000","last_unstale":"2023-11-28T12:06:30.400054+0000","last_undegraded":"2023-11-28T12:06:30.400054+0000","last_fullsized":"2023-11-28T12:06:30.400054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:22:20.431576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.402686+0000","last_change":"2023-11-28T12:06:29.426168+0000","last_active":"2023-11-28T12:06:30.402686+0000","last_peered":"2023-11-28T12:06:30.402686+0000","last_clean":"2023-11-28T12:06:30.402686+0000","last_became_active":"2023-11-28T12:06:29.425480+0000","last_became_peered":"2023-11-28T12:06:29.425480+0000","last_unstale":"2023-11-28T12:06:30.402686+0000","last_undegraded":"2023-11-28T12:06:30.402686+0000","last_fullsized":"2023-11-28T12:06:30.402686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:13:08.504009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431515+0000","last_change":"2023-11-28T12:06:29.428464+0000","last_active":"2023-11-28T12:06:30.431515+0000","last_peered":"2023-11-28T12:06:30.431515+0000","last_clean":"2023-11-28T12:06:30.431515+0000","last_became_active":"2023-11-28T12:06:29.428110+0000","last_became_peered":"2023-11-28T12:06:29.428110+0000","last_unstale":"2023-11-28T12:06:30.431515+0000","last_undegraded":"2023-11-28T12:06:30.431515+0000","last_fullsized":"2023-11-28T12:06:30.431515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:13:08.504009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431253+0000","last_change":"2023-11-28T12:06:29.416388+0000","last_active":"2023-11-28T12:06:30.431253+0000","last_peered":"2023-11-28T12:06:30.431253+0000","last_clean":"2023-11-28T12:06:30.431253+0000","last_became_active":"2023-11-28T12:06:29.416031+0000","last_became_peered":"2023-11-28T12:06:29.416031+0000","last_unstale":"2023-11-28T12:06:30.431253+0000","last_undegraded":"2023-11-28T12:06:30.431253+0000","last_fullsized":"2023-11-28T12:06:30.431253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:33:22.203612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432609+0000","last_change":"2023-11-28T12:06:29.431468+0000","last_active":"2023-11-28T12:06:30.432609+0000","last_peered":"2023-11-28T12:06:30.432609+0000","last_clean":"2023-11-28T12:06:30.432609+0000","last_became_active":"2023-11-28T12:06:29.430744+0000","last_became_peered":"2023-11-28T12:06:29.430744+0000","last_unstale":"2023-11-28T12:06:30.432609+0000","last_undegraded":"2023-11-28T12:06:30.432609+0000","last_fullsized":"2023-11-28T12:06:30.432609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:13:08.504009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432429+0000","last_change":"2023-11-28T12:06:29.422318+0000","last_active":"2023-11-28T12:06:30.432429+0000","last_peered":"2023-11-28T12:06:30.432429+0000","last_clean":"2023-11-28T12:06:30.432429+0000","last_became_active":"2023-11-28T12:06:29.421236+0000","last_became_peered":"2023-11-28T12:06:29.421236+0000","last_unstale":"2023-11-28T12:06:30.432429+0000","last_undegraded":"2023-11-28T12:06:30.432429+0000","last_fullsized":"2023-11-28T12:06:30.432429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:42:57.391884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.400334+0000","last_change":"2023-11-28T12:06:29.417658+0000","last_active":"2023-11-28T12:06:30.400334+0000","last_peered":"2023-11-28T12:06:30.400334+0000","last_clean":"2023-11-28T12:06:30.400334+0000","last_became_active":"2023-11-28T12:06:29.417101+0000","last_became_peered":"2023-11-28T12:06:29.417101+0000","last_unstale":"2023-11-28T12:06:30.400334+0000","last_undegraded":"2023-11-28T12:06:30.400334+0000","last_fullsized":"2023-11-28T12:06:30.400334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:27:38.882977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432163+0000","last_change":"2023-11-28T12:06:29.420113+0000","last_active":"2023-11-28T12:06:30.432163+0000","last_peered":"2023-11-28T12:06:30.432163+0000","last_clean":"2023-11-28T12:06:30.432163+0000","last_became_active":"2023-11-28T12:06:29.419156+0000","last_became_peered":"2023-11-28T12:06:29.419156+0000","last_unstale":"2023-11-28T12:06:30.432163+0000","last_undegraded":"2023-11-28T12:06:30.432163+0000","last_fullsized":"2023-11-28T12:06:30.432163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:28:34.213514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431510+0000","last_change":"2023-11-28T12:06:29.430718+0000","last_active":"2023-11-28T12:06:30.431510+0000","last_peered":"2023-11-28T12:06:30.431510+0000","last_clean":"2023-11-28T12:06:30.431510+0000","last_became_active":"2023-11-28T12:06:29.430451+0000","last_became_peered":"2023-11-28T12:06:29.430451+0000","last_unstale":"2023-11-28T12:06:30.431510+0000","last_undegraded":"2023-11-28T12:06:30.431510+0000","last_fullsized":"2023-11-28T12:06:30.431510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:07:00.558286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432197+0000","last_change":"2023-11-28T12:06:29.419281+0000","last_active":"2023-11-28T12:06:30.432197+0000","last_peered":"2023-11-28T12:06:30.432197+0000","last_clean":"2023-11-28T12:06:30.432197+0000","last_became_active":"2023-11-28T12:06:29.418987+0000","last_became_peered":"2023-11-28T12:06:29.418987+0000","last_unstale":"2023-11-28T12:06:30.432197+0000","last_undegraded":"2023-11-28T12:06:30.432197+0000","last_fullsized":"2023-11-28T12:06:30.432197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:57:15.470252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.430620+0000","last_change":"2023-11-28T12:06:29.415280+0000","last_active":"2023-11-28T12:06:30.430620+0000","last_peered":"2023-11-28T12:06:30.430620+0000","last_clean":"2023-11-28T12:06:30.430620+0000","last_became_active":"2023-11-28T12:06:29.414999+0000","last_became_peered":"2023-11-28T12:06:29.414999+0000","last_unstale":"2023-11-28T12:06:30.430620+0000","last_undegraded":"2023-11-28T12:06:30.430620+0000","last_fullsized":"2023-11-28T12:06:30.430620+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:27:03.452097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431563+0000","last_change":"2023-11-28T12:06:29.429537+0000","last_active":"2023-11-28T12:06:30.431563+0000","last_peered":"2023-11-28T12:06:30.431563+0000","last_clean":"2023-11-28T12:06:30.431563+0000","last_became_active":"2023-11-28T12:06:29.428962+0000","last_became_peered":"2023-11-28T12:06:29.428962+0000","last_unstale":"2023-11-28T12:06:30.431563+0000","last_undegraded":"2023-11-28T12:06:30.431563+0000","last_fullsized":"2023-11-28T12:06:30.431563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:51:20.319063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431697+0000","last_change":"2023-11-28T12:06:29.421014+0000","last_active":"2023-11-28T12:06:30.431697+0000","last_peered":"2023-11-28T12:06:30.431697+0000","last_clean":"2023-11-28T12:06:30.431697+0000","last_became_active":"2023-11-28T12:06:29.418311+0000","last_became_peered":"2023-11-28T12:06:29.418311+0000","last_unstale":"2023-11-28T12:06:30.431697+0000","last_undegraded":"2023-11-28T12:06:30.431697+0000","last_fullsized":"2023-11-28T12:06:30.431697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:47:58.895820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432093+0000","last_change":"2023-11-28T12:06:29.415605+0000","last_active":"2023-11-28T12:06:30.432093+0000","last_peered":"2023-11-28T12:06:30.432093+0000","last_clean":"2023-11-28T12:06:30.432093+0000","last_became_active":"2023-11-28T12:06:29.413218+0000","last_became_peered":"2023-11-28T12:06:29.413218+0000","last_unstale":"2023-11-28T12:06:30.432093+0000","last_undegraded":"2023-11-28T12:06:30.432093+0000","last_fullsized":"2023-11-28T12:06:30.432093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:03:53.795177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.402352+0000","last_change":"2023-11-28T12:06:29.438175+0000","last_active":"2023-11-28T12:06:30.402352+0000","last_peered":"2023-11-28T12:06:30.402352+0000","last_clean":"2023-11-28T12:06:30.402352+0000","last_became_active":"2023-11-28T12:06:29.437503+0000","last_became_peered":"2023-11-28T12:06:29.437503+0000","last_unstale":"2023-11-28T12:06:30.402352+0000","last_undegraded":"2023-11-28T12:06:30.402352+0000","last_fullsized":"2023-11-28T12:06:30.402352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:57:52.848285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431780+0000","last_change":"2023-11-28T12:06:28.910005+0000","last_active":"2023-11-28T12:06:30.431780+0000","last_peered":"2023-11-28T12:06:30.431780+0000","last_clean":"2023-11-28T12:06:30.431780+0000","last_became_active":"2023-11-28T12:06:28.909736+0000","last_became_peered":"2023-11-28T12:06:28.909736+0000","last_unstale":"2023-11-28T12:06:30.431780+0000","last_undegraded":"2023-11-28T12:06:30.431780+0000","last_fullsized":"2023-11-28T12:06:30.431780+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:27:37.876201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431752+0000","last_change":"2023-11-28T12:06:29.412757+0000","last_active":"2023-11-28T12:06:30.431752+0000","last_peered":"2023-11-28T12:06:30.431752+0000","last_clean":"2023-11-28T12:06:30.431752+0000","last_became_active":"2023-11-28T12:06:29.412424+0000","last_became_peered":"2023-11-28T12:06:29.412424+0000","last_unstale":"2023-11-28T12:06:30.431752+0000","last_undegraded":"2023-11-28T12:06:30.431752+0000","last_fullsized":"2023-11-28T12:06:30.431752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:18:07.794113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431275+0000","last_change":"2023-11-28T12:06:28.915845+0000","last_active":"2023-11-28T12:06:30.431275+0000","last_peered":"2023-11-28T12:06:30.431275+0000","last_clean":"2023-11-28T12:06:30.431275+0000","last_became_active":"2023-11-28T12:06:28.915223+0000","last_became_peered":"2023-11-28T12:06:28.915223+0000","last_unstale":"2023-11-28T12:06:30.431275+0000","last_undegraded":"2023-11-28T12:06:30.431275+0000","last_fullsized":"2023-11-28T12:06:30.431275+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:18:19.943945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432576+0000","last_change":"2023-11-28T12:06:29.431967+0000","last_active":"2023-11-28T12:06:30.432576+0000","last_peered":"2023-11-28T12:06:30.432576+0000","last_clean":"2023-11-28T12:06:30.432576+0000","last_became_active":"2023-11-28T12:06:29.430710+0000","last_became_peered":"2023-11-28T12:06:29.430710+0000","last_unstale":"2023-11-28T12:06:30.432576+0000","last_undegraded":"2023-11-28T12:06:30.432576+0000","last_fullsized":"2023-11-28T12:06:30.432576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:03:53.795177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.430884+0000","last_change":"2023-11-28T12:06:28.901401+0000","last_active":"2023-11-28T12:06:30.430884+0000","last_peered":"2023-11-28T12:06:30.430884+0000","last_clean":"2023-11-28T12:06:30.430884+0000","last_became_active":"2023-11-28T12:06:28.900727+0000","last_became_peered":"2023-11-28T12:06:28.900727+0000","last_unstale":"2023-11-28T12:06:30.430884+0000","last_undegraded":"2023-11-28T12:06:30.430884+0000","last_fullsized":"2023-11-28T12:06:30.430884+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:43:34.311973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.402933+0000","last_change":"2023-11-28T12:06:29.420506+0000","last_active":"2023-11-28T12:06:30.402933+0000","last_peered":"2023-11-28T12:06:30.402933+0000","last_clean":"2023-11-28T12:06:30.402933+0000","last_became_active":"2023-11-28T12:06:29.419616+0000","last_became_peered":"2023-11-28T12:06:29.419616+0000","last_unstale":"2023-11-28T12:06:30.402933+0000","last_undegraded":"2023-11-28T12:06:30.402933+0000","last_fullsized":"2023-11-28T12:06:30.402933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:33:22.203612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432686+0000","last_change":"2023-11-28T12:06:28.904440+0000","last_active":"2023-11-28T12:06:30.432686+0000","last_peered":"2023-11-28T12:06:30.432686+0000","last_clean":"2023-11-28T12:06:30.432686+0000","last_became_active":"2023-11-28T12:06:28.904179+0000","last_became_peered":"2023-11-28T12:06:28.904179+0000","last_unstale":"2023-11-28T12:06:30.432686+0000","last_undegraded":"2023-11-28T12:06:30.432686+0000","last_fullsized":"2023-11-28T12:06:30.432686+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:25:02.799298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.430795+0000","last_change":"2023-11-28T12:06:29.411944+0000","last_active":"2023-11-28T12:06:30.430795+0000","last_peered":"2023-11-28T12:06:30.430795+0000","last_clean":"2023-11-28T12:06:30.430795+0000","last_became_active":"2023-11-28T12:06:29.411564+0000","last_became_peered":"2023-11-28T12:06:29.411564+0000","last_unstale":"2023-11-28T12:06:30.430795+0000","last_undegraded":"2023-11-28T12:06:30.430795+0000","last_fullsized":"2023-11-28T12:06:30.430795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:57:15.470252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.402366+0000","last_change":"2023-11-28T12:06:28.901015+0000","last_active":"2023-11-28T12:06:30.402366+0000","last_peered":"2023-11-28T12:06:30.402366+0000","last_clean":"2023-11-28T12:06:30.402366+0000","last_became_active":"2023-11-28T12:06:28.900724+0000","last_became_peered":"2023-11-28T12:06:28.900724+0000","last_unstale":"2023-11-28T12:06:30.402366+0000","last_undegraded":"2023-11-28T12:06:30.402366+0000","last_fullsized":"2023-11-28T12:06:30.402366+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:25:02.799298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.430807+0000","last_change":"2023-11-28T12:06:29.425082+0000","last_active":"2023-11-28T12:06:30.430807+0000","last_peered":"2023-11-28T12:06:30.430807+0000","last_clean":"2023-11-28T12:06:30.430807+0000","last_became_active":"2023-11-28T12:06:29.424753+0000","last_became_peered":"2023-11-28T12:06:29.424753+0000","last_unstale":"2023-11-28T12:06:30.430807+0000","last_undegraded":"2023-11-28T12:06:30.430807+0000","last_fullsized":"2023-11-28T12:06:30.430807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:57:52.848285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432060+0000","last_change":"2023-11-28T12:06:28.904157+0000","last_active":"2023-11-28T12:06:30.432060+0000","last_peered":"2023-11-28T12:06:30.432060+0000","last_clean":"2023-11-28T12:06:30.432060+0000","last_became_active":"2023-11-28T12:06:28.902746+0000","last_became_peered":"2023-11-28T12:06:28.902746+0000","last_unstale":"2023-11-28T12:06:30.432060+0000","last_undegraded":"2023-11-28T12:06:30.432060+0000","last_fullsized":"2023-11-28T12:06:30.432060+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:33:21.196836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431731+0000","last_change":"2023-11-28T12:06:29.417397+0000","last_active":"2023-11-28T12:06:30.431731+0000","last_peered":"2023-11-28T12:06:30.431731+0000","last_clean":"2023-11-28T12:06:30.431731+0000","last_became_active":"2023-11-28T12:06:29.416301+0000","last_became_peered":"2023-11-28T12:06:29.416301+0000","last_unstale":"2023-11-28T12:06:30.431731+0000","last_undegraded":"2023-11-28T12:06:30.431731+0000","last_fullsized":"2023-11-28T12:06:30.431731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:51:20.319063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"19'6","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432375+0000","last_change":"2023-11-28T12:06:28.907107+0000","last_active":"2023-11-28T12:06:30.432375+0000","last_peered":"2023-11-28T12:06:30.432375+0000","last_clean":"2023-11-28T12:06:30.432375+0000","last_became_active":"2023-11-28T12:06:28.906719+0000","last_became_peered":"2023-11-28T12:06:28.906719+0000","last_unstale":"2023-11-28T12:06:30.432375+0000","last_undegraded":"2023-11-28T12:06:30.432375+0000","last_fullsized":"2023-11-28T12:06:30.432375+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:18:19.943945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432208+0000","last_change":"2023-11-28T12:06:29.421775+0000","last_active":"2023-11-28T12:06:30.432208+0000","last_peered":"2023-11-28T12:06:30.432208+0000","last_clean":"2023-11-28T12:06:30.432208+0000","last_became_active":"2023-11-28T12:06:29.421474+0000","last_became_peered":"2023-11-28T12:06:29.421474+0000","last_unstale":"2023-11-28T12:06:30.432208+0000","last_undegraded":"2023-11-28T12:06:30.432208+0000","last_fullsized":"2023-11-28T12:06:30.432208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:03:53.795177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431365+0000","last_change":"2023-11-28T12:06:28.906549+0000","last_active":"2023-11-28T12:06:30.431365+0000","last_peered":"2023-11-28T12:06:30.431365+0000","last_clean":"2023-11-28T12:06:30.431365+0000","last_became_active":"2023-11-28T12:06:28.906267+0000","last_became_peered":"2023-11-28T12:06:28.906267+0000","last_unstale":"2023-11-28T12:06:30.431365+0000","last_undegraded":"2023-11-28T12:06:30.431365+0000","last_fullsized":"2023-11-28T12:06:30.431365+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:20:03.086957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431336+0000","last_change":"2023-11-28T12:06:29.412345+0000","last_active":"2023-11-28T12:06:30.431336+0000","last_peered":"2023-11-28T12:06:30.431336+0000","last_clean":"2023-11-28T12:06:30.431336+0000","last_became_active":"2023-11-28T12:06:29.412100+0000","last_became_peered":"2023-11-28T12:06:29.412100+0000","last_unstale":"2023-11-28T12:06:30.431336+0000","last_undegraded":"2023-11-28T12:06:30.431336+0000","last_fullsized":"2023-11-28T12:06:30.431336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:08:40.987428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432293+0000","last_change":"2023-11-28T12:06:28.901789+0000","last_active":"2023-11-28T12:06:30.432293+0000","last_peered":"2023-11-28T12:06:30.432293+0000","last_clean":"2023-11-28T12:06:30.432293+0000","last_became_active":"2023-11-28T12:06:28.901317+0000","last_became_peered":"2023-11-28T12:06:28.901317+0000","last_unstale":"2023-11-28T12:06:30.432293+0000","last_undegraded":"2023-11-28T12:06:30.432293+0000","last_fullsized":"2023-11-28T12:06:30.432293+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:18:19.943945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.402428+0000","last_change":"2023-11-28T12:06:29.428820+0000","last_active":"2023-11-28T12:06:30.402428+0000","last_peered":"2023-11-28T12:06:30.402428+0000","last_clean":"2023-11-28T12:06:30.402428+0000","last_became_active":"2023-11-28T12:06:29.428532+0000","last_became_peered":"2023-11-28T12:06:29.428532+0000","last_unstale":"2023-11-28T12:06:30.402428+0000","last_undegraded":"2023-11-28T12:06:30.402428+0000","last_fullsized":"2023-11-28T12:06:30.402428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:03:53.795177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431427+0000","last_change":"2023-11-28T12:06:28.911421+0000","last_active":"2023-11-28T12:06:30.431427+0000","last_peered":"2023-11-28T12:06:30.431427+0000","last_clean":"2023-11-28T12:06:30.431427+0000","last_became_active":"2023-11-28T12:06:28.911098+0000","last_became_peered":"2023-11-28T12:06:28.911098+0000","last_unstale":"2023-11-28T12:06:30.431427+0000","last_undegraded":"2023-11-28T12:06:30.431427+0000","last_fullsized":"2023-11-28T12:06:30.431427+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:57:01.417679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432485+0000","last_change":"2023-11-28T12:06:29.428661+0000","last_active":"2023-11-28T12:06:30.432485+0000","last_peered":"2023-11-28T12:06:30.432485+0000","last_clean":"2023-11-28T12:06:30.432485+0000","last_became_active":"2023-11-28T12:06:29.427044+0000","last_became_peered":"2023-11-28T12:06:29.427044+0000","last_unstale":"2023-11-28T12:06:30.432485+0000","last_undegraded":"2023-11-28T12:06:30.432485+0000","last_fullsized":"2023-11-28T12:06:30.432485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:28:44.482157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.401722+0000","last_change":"2023-11-28T12:06:28.900418+0000","last_active":"2023-11-28T12:06:30.401722+0000","last_peered":"2023-11-28T12:06:30.401722+0000","last_clean":"2023-11-28T12:06:30.401722+0000","last_became_active":"2023-11-28T12:06:28.900135+0000","last_became_peered":"2023-11-28T12:06:28.900135+0000","last_unstale":"2023-11-28T12:06:30.401722+0000","last_undegraded":"2023-11-28T12:06:30.401722+0000","last_fullsized":"2023-11-28T12:06:30.401722+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:51:27.529794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432203+0000","last_change":"2023-11-28T12:06:29.419258+0000","last_active":"2023-11-28T12:06:30.432203+0000","last_peered":"2023-11-28T12:06:30.432203+0000","last_clean":"2023-11-28T12:06:30.432203+0000","last_became_active":"2023-11-28T12:06:29.418964+0000","last_became_peered":"2023-11-28T12:06:29.418964+0000","last_unstale":"2023-11-28T12:06:30.432203+0000","last_undegraded":"2023-11-28T12:06:30.432203+0000","last_fullsized":"2023-11-28T12:06:30.432203+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:28:34.213514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431583+0000","last_change":"2023-11-28T12:06:28.906323+0000","last_active":"2023-11-28T12:06:30.431583+0000","last_peered":"2023-11-28T12:06:30.431583+0000","last_clean":"2023-11-28T12:06:30.431583+0000","last_became_active":"2023-11-28T12:06:28.906018+0000","last_became_peered":"2023-11-28T12:06:28.906018+0000","last_unstale":"2023-11-28T12:06:30.431583+0000","last_undegraded":"2023-11-28T12:06:30.431583+0000","last_fullsized":"2023-11-28T12:06:30.431583+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:43:34.311973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.401855+0000","last_change":"2023-11-28T12:06:29.428058+0000","last_active":"2023-11-28T12:06:30.401855+0000","last_peered":"2023-11-28T12:06:30.401855+0000","last_clean":"2023-11-28T12:06:30.401855+0000","last_became_active":"2023-11-28T12:06:29.427473+0000","last_became_peered":"2023-11-28T12:06:29.427473+0000","last_unstale":"2023-11-28T12:06:30.401855+0000","last_undegraded":"2023-11-28T12:06:30.401855+0000","last_fullsized":"2023-11-28T12:06:30.401855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:07:00.558286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431905+0000","last_change":"2023-11-28T12:06:28.911429+0000","last_active":"2023-11-28T12:06:30.431905+0000","last_peered":"2023-11-28T12:06:30.431905+0000","last_clean":"2023-11-28T12:06:30.431905+0000","last_became_active":"2023-11-28T12:06:28.911128+0000","last_became_peered":"2023-11-28T12:06:28.911128+0000","last_unstale":"2023-11-28T12:06:30.431905+0000","last_undegraded":"2023-11-28T12:06:30.431905+0000","last_fullsized":"2023-11-28T12:06:30.431905+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:05:22.551488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431796+0000","last_change":"2023-11-28T12:06:29.431218+0000","last_active":"2023-11-28T12:06:30.431796+0000","last_peered":"2023-11-28T12:06:30.431796+0000","last_clean":"2023-11-28T12:06:30.431796+0000","last_became_active":"2023-11-28T12:06:29.430478+0000","last_became_peered":"2023-11-28T12:06:29.430478+0000","last_unstale":"2023-11-28T12:06:30.431796+0000","last_undegraded":"2023-11-28T12:06:30.431796+0000","last_fullsized":"2023-11-28T12:06:30.431796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:36:24.619605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432004+0000","last_change":"2023-11-28T12:06:28.909101+0000","last_active":"2023-11-28T12:06:30.432004+0000","last_peered":"2023-11-28T12:06:30.432004+0000","last_clean":"2023-11-28T12:06:30.432004+0000","last_became_active":"2023-11-28T12:06:28.908745+0000","last_became_peered":"2023-11-28T12:06:28.908745+0000","last_unstale":"2023-11-28T12:06:30.432004+0000","last_undegraded":"2023-11-28T12:06:30.432004+0000","last_fullsized":"2023-11-28T12:06:30.432004+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:02:25.842525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.403103+0000","last_change":"2023-11-28T12:06:29.414146+0000","last_active":"2023-11-28T12:06:30.403103+0000","last_peered":"2023-11-28T12:06:30.403103+0000","last_clean":"2023-11-28T12:06:30.403103+0000","last_became_active":"2023-11-28T12:06:29.413597+0000","last_became_peered":"2023-11-28T12:06:29.413597+0000","last_unstale":"2023-11-28T12:06:30.403103+0000","last_undegraded":"2023-11-28T12:06:30.403103+0000","last_fullsized":"2023-11-28T12:06:30.403103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:47:58.895820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.402510+0000","last_change":"2023-11-28T12:06:28.897981+0000","last_active":"2023-11-28T12:06:30.402510+0000","last_peered":"2023-11-28T12:06:30.402510+0000","last_clean":"2023-11-28T12:06:30.402510+0000","last_became_active":"2023-11-28T12:06:28.897618+0000","last_became_peered":"2023-11-28T12:06:28.897618+0000","last_unstale":"2023-11-28T12:06:30.402510+0000","last_undegraded":"2023-11-28T12:06:30.402510+0000","last_fullsized":"2023-11-28T12:06:30.402510+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:22:19.424800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431219+0000","last_change":"2023-11-28T12:06:29.411291+0000","last_active":"2023-11-28T12:06:30.431219+0000","last_peered":"2023-11-28T12:06:30.431219+0000","last_clean":"2023-11-28T12:06:30.431219+0000","last_became_active":"2023-11-28T12:06:29.411041+0000","last_became_peered":"2023-11-28T12:06:29.411041+0000","last_unstale":"2023-11-28T12:06:30.431219+0000","last_undegraded":"2023-11-28T12:06:30.431219+0000","last_fullsized":"2023-11-28T12:06:30.431219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:25:49.001168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431191+0000","last_change":"2023-11-28T12:06:28.899397+0000","last_active":"2023-11-28T12:06:30.431191+0000","last_peered":"2023-11-28T12:06:30.431191+0000","last_clean":"2023-11-28T12:06:30.431191+0000","last_became_active":"2023-11-28T12:06:28.899027+0000","last_became_peered":"2023-11-28T12:06:28.899027+0000","last_unstale":"2023-11-28T12:06:30.431191+0000","last_undegraded":"2023-11-28T12:06:30.431191+0000","last_fullsized":"2023-11-28T12:06:30.431191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:05:22.551488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432275+0000","last_change":"2023-11-28T12:06:29.427339+0000","last_active":"2023-11-28T12:06:30.432275+0000","last_peered":"2023-11-28T12:06:30.432275+0000","last_clean":"2023-11-28T12:06:30.432275+0000","last_became_active":"2023-11-28T12:06:29.422893+0000","last_became_peered":"2023-11-28T12:06:29.422893+0000","last_unstale":"2023-11-28T12:06:30.432275+0000","last_undegraded":"2023-11-28T12:06:30.432275+0000","last_fullsized":"2023-11-28T12:06:30.432275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:57:15.470252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.402371+0000","last_change":"2023-11-28T12:06:28.911788+0000","last_active":"2023-11-28T12:06:30.402371+0000","last_peered":"2023-11-28T12:06:30.402371+0000","last_clean":"2023-11-28T12:06:30.402371+0000","last_became_active":"2023-11-28T12:06:28.910333+0000","last_became_peered":"2023-11-28T12:06:28.910333+0000","last_unstale":"2023-11-28T12:06:30.402371+0000","last_undegraded":"2023-11-28T12:06:30.402371+0000","last_fullsized":"2023-11-28T12:06:30.402371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:10:07.458120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432302+0000","last_change":"2023-11-28T12:06:29.422530+0000","last_active":"2023-11-28T12:06:30.432302+0000","last_peered":"2023-11-28T12:06:30.432302+0000","last_clean":"2023-11-28T12:06:30.432302+0000","last_became_active":"2023-11-28T12:06:29.422148+0000","last_became_peered":"2023-11-28T12:06:29.422148+0000","last_unstale":"2023-11-28T12:06:30.432302+0000","last_undegraded":"2023-11-28T12:06:30.432302+0000","last_fullsized":"2023-11-28T12:06:30.432302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:27:03.452097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431662+0000","last_change":"2023-11-28T12:06:28.906946+0000","last_active":"2023-11-28T12:06:30.431662+0000","last_peered":"2023-11-28T12:06:30.431662+0000","last_clean":"2023-11-28T12:06:30.431662+0000","last_became_active":"2023-11-28T12:06:28.906330+0000","last_became_peered":"2023-11-28T12:06:28.906330+0000","last_unstale":"2023-11-28T12:06:30.431662+0000","last_undegraded":"2023-11-28T12:06:30.431662+0000","last_fullsized":"2023-11-28T12:06:30.431662+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:51:27.529794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432470+0000","last_change":"2023-11-28T12:06:29.422900+0000","last_active":"2023-11-28T12:06:30.432470+0000","last_peered":"2023-11-28T12:06:30.432470+0000","last_clean":"2023-11-28T12:06:30.432470+0000","last_became_active":"2023-11-28T12:06:29.422592+0000","last_became_peered":"2023-11-28T12:06:29.422592+0000","last_unstale":"2023-11-28T12:06:30.432470+0000","last_undegraded":"2023-11-28T12:06:30.432470+0000","last_fullsized":"2023-11-28T12:06:30.432470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:39:17.802039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431015+0000","last_change":"2023-11-28T12:06:28.910918+0000","last_active":"2023-11-28T12:06:30.431015+0000","last_peered":"2023-11-28T12:06:30.431015+0000","last_clean":"2023-11-28T12:06:30.431015+0000","last_became_active":"2023-11-28T12:06:28.910601+0000","last_became_peered":"2023-11-28T12:06:28.910601+0000","last_unstale":"2023-11-28T12:06:30.431015+0000","last_undegraded":"2023-11-28T12:06:30.431015+0000","last_fullsized":"2023-11-28T12:06:30.431015+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:22:19.424800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432528+0000","last_change":"2023-11-28T12:06:29.428654+0000","last_active":"2023-11-28T12:06:30.432528+0000","last_peered":"2023-11-28T12:06:30.432528+0000","last_clean":"2023-11-28T12:06:30.432528+0000","last_became_active":"2023-11-28T12:06:29.428388+0000","last_became_peered":"2023-11-28T12:06:29.428388+0000","last_unstale":"2023-11-28T12:06:30.432528+0000","last_undegraded":"2023-11-28T12:06:30.432528+0000","last_fullsized":"2023-11-28T12:06:30.432528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:13:08.504009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432068+0000","last_change":"2023-11-28T12:06:28.897386+0000","last_active":"2023-11-28T12:06:30.432068+0000","last_peered":"2023-11-28T12:06:30.432068+0000","last_clean":"2023-11-28T12:06:30.432068+0000","last_became_active":"2023-11-28T12:06:28.896863+0000","last_became_peered":"2023-11-28T12:06:28.896863+0000","last_unstale":"2023-11-28T12:06:30.432068+0000","last_undegraded":"2023-11-28T12:06:30.432068+0000","last_fullsized":"2023-11-28T12:06:30.432068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:10:07.458120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T12:06:29.408752+0000","last_change":"2023-11-28T12:06:23.961595+0000","last_active":"2023-11-28T12:06:29.408752+0000","last_peered":"2023-11-28T12:06:29.408752+0000","last_clean":"2023-11-28T12:06:29.408752+0000","last_became_active":"2023-11-28T12:06:23.961257+0000","last_became_peered":"2023-11-28T12:06:23.961257+0000","last_unstale":"2023-11-28T12:06:29.408752+0000","last_undegraded":"2023-11-28T12:06:29.408752+0000","last_fullsized":"2023-11-28T12:06:29.408752+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:30:40.200095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.430465+0000","last_change":"2023-11-28T12:06:29.425702+0000","last_active":"2023-11-28T12:06:30.430465+0000","last_peered":"2023-11-28T12:06:30.430465+0000","last_clean":"2023-11-28T12:06:30.430465+0000","last_became_active":"2023-11-28T12:06:29.425445+0000","last_became_peered":"2023-11-28T12:06:29.425445+0000","last_unstale":"2023-11-28T12:06:30.430465+0000","last_undegraded":"2023-11-28T12:06:30.430465+0000","last_fullsized":"2023-11-28T12:06:30.430465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:03:53.795177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T12:06:29.400425+0000","last_change":"2023-11-28T12:06:23.517505+0000","last_active":"2023-11-28T12:06:29.400425+0000","last_peered":"2023-11-28T12:06:29.400425+0000","last_clean":"2023-11-28T12:06:29.400425+0000","last_became_active":"2023-11-28T12:06:23.517151+0000","last_became_peered":"2023-11-28T12:06:23.517151+0000","last_unstale":"2023-11-28T12:06:29.400425+0000","last_undegraded":"2023-11-28T12:06:29.400425+0000","last_fullsized":"2023-11-28T12:06:29.400425+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:30:40.200095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:31.490278+0000","last_change":"2023-11-28T12:06:28.912292+0000","last_active":"2023-11-28T12:06:31.490278+0000","last_peered":"2023-11-28T12:06:31.490278+0000","last_clean":"2023-11-28T12:06:31.490278+0000","last_became_active":"2023-11-28T12:06:28.910834+0000","last_became_peered":"2023-11-28T12:06:28.910834+0000","last_unstale":"2023-11-28T12:06:31.490278+0000","last_undegraded":"2023-11-28T12:06:31.490278+0000","last_fullsized":"2023-11-28T12:06:31.490278+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:51:27.529794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431570+0000","last_change":"2023-11-28T12:06:29.420045+0000","last_active":"2023-11-28T12:06:30.431570+0000","last_peered":"2023-11-28T12:06:30.431570+0000","last_clean":"2023-11-28T12:06:30.431570+0000","last_became_active":"2023-11-28T12:06:29.419739+0000","last_became_peered":"2023-11-28T12:06:29.419739+0000","last_unstale":"2023-11-28T12:06:30.431570+0000","last_undegraded":"2023-11-28T12:06:30.431570+0000","last_fullsized":"2023-11-28T12:06:30.431570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:25:49.001168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T12:06:29.405908+0000","last_change":"2023-11-28T12:06:23.517967+0000","last_active":"2023-11-28T12:06:29.405908+0000","last_peered":"2023-11-28T12:06:29.405908+0000","last_clean":"2023-11-28T12:06:29.405908+0000","last_became_active":"2023-11-28T12:06:23.517495+0000","last_became_peered":"2023-11-28T12:06:23.517495+0000","last_unstale":"2023-11-28T12:06:29.405908+0000","last_undegraded":"2023-11-28T12:06:29.405908+0000","last_fullsized":"2023-11-28T12:06:29.405908+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:51:06.844441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T12:06:29.408596+0000","last_change":"2023-11-28T12:06:23.513472+0000","last_active":"2023-11-28T12:06:29.408596+0000","last_peered":"2023-11-28T12:06:29.408596+0000","last_clean":"2023-11-28T12:06:29.408596+0000","last_became_active":"2023-11-28T12:06:23.513150+0000","last_became_peered":"2023-11-28T12:06:23.513150+0000","last_unstale":"2023-11-28T12:06:29.408596+0000","last_undegraded":"2023-11-28T12:06:29.408596+0000","last_fullsized":"2023-11-28T12:06:29.408596+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:34:18.653049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.430898+0000","last_change":"2023-11-28T12:06:28.909662+0000","last_active":"2023-11-28T12:06:30.430898+0000","last_peered":"2023-11-28T12:06:30.430898+0000","last_clean":"2023-11-28T12:06:30.430898+0000","last_became_active":"2023-11-28T12:06:28.907056+0000","last_became_peered":"2023-11-28T12:06:28.907056+0000","last_unstale":"2023-11-28T12:06:30.430898+0000","last_undegraded":"2023-11-28T12:06:30.430898+0000","last_fullsized":"2023-11-28T12:06:30.430898+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:22:19.424800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432482+0000","last_change":"2023-11-28T12:06:29.420306+0000","last_active":"2023-11-28T12:06:30.432482+0000","last_peered":"2023-11-28T12:06:30.432482+0000","last_clean":"2023-11-28T12:06:30.432482+0000","last_became_active":"2023-11-28T12:06:29.419788+0000","last_became_peered":"2023-11-28T12:06:29.419788+0000","last_unstale":"2023-11-28T12:06:30.432482+0000","last_undegraded":"2023-11-28T12:06:30.432482+0000","last_fullsized":"2023-11-28T12:06:30.432482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:28:34.213514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T12:06:29.409054+0000","last_change":"2023-11-28T12:06:23.903708+0000","last_active":"2023-11-28T12:06:29.409054+0000","last_peered":"2023-11-28T12:06:29.409054+0000","last_clean":"2023-11-28T12:06:29.409054+0000","last_became_active":"2023-11-28T12:06:23.903399+0000","last_became_peered":"2023-11-28T12:06:23.903399+0000","last_unstale":"2023-11-28T12:06:29.409054+0000","last_undegraded":"2023-11-28T12:06:29.409054+0000","last_fullsized":"2023-11-28T12:06:29.409054+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:31:13.187145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.430703+0000","last_change":"2023-11-28T12:06:28.913668+0000","last_active":"2023-11-28T12:06:30.430703+0000","last_peered":"2023-11-28T12:06:30.430703+0000","last_clean":"2023-11-28T12:06:30.430703+0000","last_became_active":"2023-11-28T12:06:28.913342+0000","last_became_peered":"2023-11-28T12:06:28.913342+0000","last_unstale":"2023-11-28T12:06:30.430703+0000","last_undegraded":"2023-11-28T12:06:30.430703+0000","last_fullsized":"2023-11-28T12:06:30.430703+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:10:07.458120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431800+0000","last_change":"2023-11-28T12:06:29.422027+0000","last_active":"2023-11-28T12:06:30.431800+0000","last_peered":"2023-11-28T12:06:30.431800+0000","last_clean":"2023-11-28T12:06:30.431800+0000","last_became_active":"2023-11-28T12:06:29.421737+0000","last_became_peered":"2023-11-28T12:06:29.421737+0000","last_unstale":"2023-11-28T12:06:30.431800+0000","last_undegraded":"2023-11-28T12:06:30.431800+0000","last_fullsized":"2023-11-28T12:06:30.431800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:25:07.078893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T12:06:29.408153+0000","last_change":"2023-11-28T12:06:23.903662+0000","last_active":"2023-11-28T12:06:29.408153+0000","last_peered":"2023-11-28T12:06:29.408153+0000","last_clean":"2023-11-28T12:06:29.408153+0000","last_became_active":"2023-11-28T12:06:23.903354+0000","last_became_peered":"2023-11-28T12:06:23.903354+0000","last_unstale":"2023-11-28T12:06:29.408153+0000","last_undegraded":"2023-11-28T12:06:29.408153+0000","last_fullsized":"2023-11-28T12:06:29.408153+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:02:07.694087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.430927+0000","last_change":"2023-11-28T12:06:28.904988+0000","last_active":"2023-11-28T12:06:30.430927+0000","last_peered":"2023-11-28T12:06:30.430927+0000","last_clean":"2023-11-28T12:06:30.430927+0000","last_became_active":"2023-11-28T12:06:28.904389+0000","last_became_peered":"2023-11-28T12:06:28.904389+0000","last_unstale":"2023-11-28T12:06:30.430927+0000","last_undegraded":"2023-11-28T12:06:30.430927+0000","last_fullsized":"2023-11-28T12:06:30.430927+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:25:02.799298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.402642+0000","last_change":"2023-11-28T12:06:29.424397+0000","last_active":"2023-11-28T12:06:30.402642+0000","last_peered":"2023-11-28T12:06:30.402642+0000","last_clean":"2023-11-28T12:06:30.402642+0000","last_became_active":"2023-11-28T12:06:29.424122+0000","last_became_peered":"2023-11-28T12:06:29.424122+0000","last_unstale":"2023-11-28T12:06:30.402642+0000","last_undegraded":"2023-11-28T12:06:30.402642+0000","last_fullsized":"2023-11-28T12:06:30.402642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:39:12.434022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T12:06:29.415039+0000","last_change":"2023-11-28T12:06:23.903797+0000","last_active":"2023-11-28T12:06:29.415039+0000","last_peered":"2023-11-28T12:06:29.415039+0000","last_clean":"2023-11-28T12:06:29.415039+0000","last_became_active":"2023-11-28T12:06:23.903475+0000","last_became_peered":"2023-11-28T12:06:23.903475+0000","last_unstale":"2023-11-28T12:06:29.415039+0000","last_undegraded":"2023-11-28T12:06:29.415039+0000","last_fullsized":"2023-11-28T12:06:29.415039+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:51:06.844441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432343+0000","last_change":"2023-11-28T12:06:28.905900+0000","last_active":"2023-11-28T12:06:30.432343+0000","last_peered":"2023-11-28T12:06:30.432343+0000","last_clean":"2023-11-28T12:06:30.432343+0000","last_became_active":"2023-11-28T12:06:28.905583+0000","last_became_peered":"2023-11-28T12:06:28.905583+0000","last_unstale":"2023-11-28T12:06:30.432343+0000","last_undegraded":"2023-11-28T12:06:30.432343+0000","last_fullsized":"2023-11-28T12:06:30.432343+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:10:07.458120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432082+0000","last_change":"2023-11-28T12:06:29.412204+0000","last_active":"2023-11-28T12:06:30.432082+0000","last_peered":"2023-11-28T12:06:30.432082+0000","last_clean":"2023-11-28T12:06:30.432082+0000","last_became_active":"2023-11-28T12:06:29.411941+0000","last_became_peered":"2023-11-28T12:06:29.411941+0000","last_unstale":"2023-11-28T12:06:30.432082+0000","last_undegraded":"2023-11-28T12:06:30.432082+0000","last_fullsized":"2023-11-28T12:06:30.432082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:07:00.558286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T12:06:29.403178+0000","last_change":"2023-11-28T12:06:23.903983+0000","last_active":"2023-11-28T12:06:29.403178+0000","last_peered":"2023-11-28T12:06:29.403178+0000","last_clean":"2023-11-28T12:06:29.403178+0000","last_became_active":"2023-11-28T12:06:23.903511+0000","last_became_peered":"2023-11-28T12:06:23.903511+0000","last_unstale":"2023-11-28T12:06:29.403178+0000","last_undegraded":"2023-11-28T12:06:29.403178+0000","last_fullsized":"2023-11-28T12:06:29.403178+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:31:13.187145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432035+0000","last_change":"2023-11-28T12:06:28.914003+0000","last_active":"2023-11-28T12:06:30.432035+0000","last_peered":"2023-11-28T12:06:30.432035+0000","last_clean":"2023-11-28T12:06:30.432035+0000","last_became_active":"2023-11-28T12:06:28.913345+0000","last_became_peered":"2023-11-28T12:06:28.913345+0000","last_unstale":"2023-11-28T12:06:30.432035+0000","last_undegraded":"2023-11-28T12:06:30.432035+0000","last_fullsized":"2023-11-28T12:06:30.432035+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:51:27.529794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431036+0000","last_change":"2023-11-28T12:06:29.419498+0000","last_active":"2023-11-28T12:06:30.431036+0000","last_peered":"2023-11-28T12:06:30.431036+0000","last_clean":"2023-11-28T12:06:30.431036+0000","last_became_active":"2023-11-28T12:06:29.419162+0000","last_became_peered":"2023-11-28T12:06:29.419162+0000","last_unstale":"2023-11-28T12:06:30.431036+0000","last_undegraded":"2023-11-28T12:06:30.431036+0000","last_fullsized":"2023-11-28T12:06:30.431036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:31:18.258195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T12:06:29.405346+0000","last_change":"2023-11-28T12:06:23.517246+0000","last_active":"2023-11-28T12:06:29.405346+0000","last_peered":"2023-11-28T12:06:29.405346+0000","last_clean":"2023-11-28T12:06:29.405346+0000","last_became_active":"2023-11-28T12:06:23.516854+0000","last_became_peered":"2023-11-28T12:06:23.516854+0000","last_unstale":"2023-11-28T12:06:29.405346+0000","last_undegraded":"2023-11-28T12:06:29.405346+0000","last_fullsized":"2023-11-28T12:06:29.405346+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:51:06.844441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.402925+0000","last_change":"2023-11-28T12:06:28.899604+0000","last_active":"2023-11-28T12:06:30.402925+0000","last_peered":"2023-11-28T12:06:30.402925+0000","last_clean":"2023-11-28T12:06:30.402925+0000","last_became_active":"2023-11-28T12:06:28.899322+0000","last_became_peered":"2023-11-28T12:06:28.899322+0000","last_unstale":"2023-11-28T12:06:30.402925+0000","last_undegraded":"2023-11-28T12:06:30.402925+0000","last_fullsized":"2023-11-28T12:06:30.402925+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:05:22.551488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431859+0000","last_change":"2023-11-28T12:06:29.416051+0000","last_active":"2023-11-28T12:06:30.431859+0000","last_peered":"2023-11-28T12:06:30.431859+0000","last_clean":"2023-11-28T12:06:30.431859+0000","last_became_active":"2023-11-28T12:06:29.415796+0000","last_became_peered":"2023-11-28T12:06:29.415796+0000","last_unstale":"2023-11-28T12:06:30.431859+0000","last_undegraded":"2023-11-28T12:06:30.431859+0000","last_fullsized":"2023-11-28T12:06:30.431859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:14:19.511638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431127+0000","last_change":"2023-11-28T12:06:28.911467+0000","last_active":"2023-11-28T12:06:30.431127+0000","last_peered":"2023-11-28T12:06:30.431127+0000","last_clean":"2023-11-28T12:06:30.431127+0000","last_became_active":"2023-11-28T12:06:28.907578+0000","last_became_peered":"2023-11-28T12:06:28.907578+0000","last_unstale":"2023-11-28T12:06:30.431127+0000","last_undegraded":"2023-11-28T12:06:30.431127+0000","last_fullsized":"2023-11-28T12:06:30.431127+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:10:07.458120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.400161+0000","last_change":"2023-11-28T12:06:29.411427+0000","last_active":"2023-11-28T12:06:30.400161+0000","last_peered":"2023-11-28T12:06:30.400161+0000","last_clean":"2023-11-28T12:06:30.400161+0000","last_became_active":"2023-11-28T12:06:29.411146+0000","last_became_peered":"2023-11-28T12:06:29.411146+0000","last_unstale":"2023-11-28T12:06:30.400161+0000","last_undegraded":"2023-11-28T12:06:30.400161+0000","last_fullsized":"2023-11-28T12:06:30.400161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:25:03.806074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.401875+0000","last_change":"2023-11-28T12:06:28.907981+0000","last_active":"2023-11-28T12:06:30.401875+0000","last_peered":"2023-11-28T12:06:30.401875+0000","last_clean":"2023-11-28T12:06:30.401875+0000","last_became_active":"2023-11-28T12:06:28.906662+0000","last_became_peered":"2023-11-28T12:06:28.906662+0000","last_unstale":"2023-11-28T12:06:30.401875+0000","last_undegraded":"2023-11-28T12:06:30.401875+0000","last_fullsized":"2023-11-28T12:06:30.401875+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:57:01.417679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431947+0000","last_change":"2023-11-28T12:06:29.435464+0000","last_active":"2023-11-28T12:06:30.431947+0000","last_peered":"2023-11-28T12:06:30.431947+0000","last_clean":"2023-11-28T12:06:30.431947+0000","last_became_active":"2023-11-28T12:06:29.435154+0000","last_became_peered":"2023-11-28T12:06:29.435154+0000","last_unstale":"2023-11-28T12:06:30.431947+0000","last_undegraded":"2023-11-28T12:06:30.431947+0000","last_fullsized":"2023-11-28T12:06:30.431947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:18:07.794113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.402928+0000","last_change":"2023-11-28T12:06:28.910150+0000","last_active":"2023-11-28T12:06:30.402928+0000","last_peered":"2023-11-28T12:06:30.402928+0000","last_clean":"2023-11-28T12:06:30.402928+0000","last_became_active":"2023-11-28T12:06:28.909642+0000","last_became_peered":"2023-11-28T12:06:28.909642+0000","last_unstale":"2023-11-28T12:06:30.402928+0000","last_undegraded":"2023-11-28T12:06:30.402928+0000","last_fullsized":"2023-11-28T12:06:30.402928+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:43:34.311973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431920+0000","last_change":"2023-11-28T12:06:29.435703+0000","last_active":"2023-11-28T12:06:30.431920+0000","last_peered":"2023-11-28T12:06:30.431920+0000","last_clean":"2023-11-28T12:06:30.431920+0000","last_became_active":"2023-11-28T12:06:29.435414+0000","last_became_peered":"2023-11-28T12:06:29.435414+0000","last_unstale":"2023-11-28T12:06:30.431920+0000","last_undegraded":"2023-11-28T12:06:30.431920+0000","last_fullsized":"2023-11-28T12:06:30.431920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:20:52.473176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431714+0000","last_change":"2023-11-28T12:06:28.896545+0000","last_active":"2023-11-28T12:06:30.431714+0000","last_peered":"2023-11-28T12:06:30.431714+0000","last_clean":"2023-11-28T12:06:30.431714+0000","last_became_active":"2023-11-28T12:06:28.896194+0000","last_became_peered":"2023-11-28T12:06:28.896194+0000","last_unstale":"2023-11-28T12:06:30.431714+0000","last_undegraded":"2023-11-28T12:06:30.431714+0000","last_fullsized":"2023-11-28T12:06:30.431714+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:51:27.529794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.430903+0000","last_change":"2023-11-28T12:06:29.415972+0000","last_active":"2023-11-28T12:06:30.430903+0000","last_peered":"2023-11-28T12:06:30.430903+0000","last_clean":"2023-11-28T12:06:30.430903+0000","last_became_active":"2023-11-28T12:06:29.415403+0000","last_became_peered":"2023-11-28T12:06:29.415403+0000","last_unstale":"2023-11-28T12:06:30.430903+0000","last_undegraded":"2023-11-28T12:06:30.430903+0000","last_fullsized":"2023-11-28T12:06:30.430903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:25:49.001168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432765+0000","last_change":"2023-11-28T12:06:28.904656+0000","last_active":"2023-11-28T12:06:30.432765+0000","last_peered":"2023-11-28T12:06:30.432765+0000","last_clean":"2023-11-28T12:06:30.432765+0000","last_became_active":"2023-11-28T12:06:28.903576+0000","last_became_peered":"2023-11-28T12:06:28.903576+0000","last_unstale":"2023-11-28T12:06:30.432765+0000","last_undegraded":"2023-11-28T12:06:30.432765+0000","last_fullsized":"2023-11-28T12:06:30.432765+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:05:22.551488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431143+0000","last_change":"2023-11-28T12:06:29.433471+0000","last_active":"2023-11-28T12:06:30.431143+0000","last_peered":"2023-11-28T12:06:30.431143+0000","last_clean":"2023-11-28T12:06:30.431143+0000","last_became_active":"2023-11-28T12:06:29.433175+0000","last_became_peered":"2023-11-28T12:06:29.433175+0000","last_unstale":"2023-11-28T12:06:30.431143+0000","last_undegraded":"2023-11-28T12:06:30.431143+0000","last_fullsized":"2023-11-28T12:06:30.431143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:31:18.258195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.402168+0000","last_change":"2023-11-28T12:06:29.409984+0000","last_active":"2023-11-28T12:06:30.402168+0000","last_peered":"2023-11-28T12:06:30.402168+0000","last_clean":"2023-11-28T12:06:30.402168+0000","last_became_active":"2023-11-28T12:06:29.409708+0000","last_became_peered":"2023-11-28T12:06:29.409708+0000","last_unstale":"2023-11-28T12:06:30.402168+0000","last_undegraded":"2023-11-28T12:06:30.402168+0000","last_fullsized":"2023-11-28T12:06:30.402168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:10:24.380829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.430715+0000","last_change":"2023-11-28T12:06:29.412286+0000","last_active":"2023-11-28T12:06:30.430715+0000","last_peered":"2023-11-28T12:06:30.430715+0000","last_clean":"2023-11-28T12:06:30.430715+0000","last_became_active":"2023-11-28T12:06:29.412022+0000","last_became_peered":"2023-11-28T12:06:29.412022+0000","last_unstale":"2023-11-28T12:06:30.430715+0000","last_undegraded":"2023-11-28T12:06:30.430715+0000","last_fullsized":"2023-11-28T12:06:30.430715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:20:52.473176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431676+0000","last_change":"2023-11-28T12:06:29.424994+0000","last_active":"2023-11-28T12:06:30.431676+0000","last_peered":"2023-11-28T12:06:30.431676+0000","last_clean":"2023-11-28T12:06:30.431676+0000","last_became_active":"2023-11-28T12:06:29.424738+0000","last_became_peered":"2023-11-28T12:06:29.424738+0000","last_unstale":"2023-11-28T12:06:30.431676+0000","last_undegraded":"2023-11-28T12:06:30.431676+0000","last_fullsized":"2023-11-28T12:06:30.431676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:08:40.987428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431286+0000","last_change":"2023-11-28T12:06:29.420914+0000","last_active":"2023-11-28T12:06:30.431286+0000","last_peered":"2023-11-28T12:06:30.431286+0000","last_clean":"2023-11-28T12:06:30.431286+0000","last_became_active":"2023-11-28T12:06:29.420396+0000","last_became_peered":"2023-11-28T12:06:29.420396+0000","last_unstale":"2023-11-28T12:06:30.431286+0000","last_undegraded":"2023-11-28T12:06:30.431286+0000","last_fullsized":"2023-11-28T12:06:30.431286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:28:44.482157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431992+0000","last_change":"2023-11-28T12:06:29.418068+0000","last_active":"2023-11-28T12:06:30.431992+0000","last_peered":"2023-11-28T12:06:30.431992+0000","last_clean":"2023-11-28T12:06:30.431992+0000","last_became_active":"2023-11-28T12:06:29.417569+0000","last_became_peered":"2023-11-28T12:06:29.417569+0000","last_unstale":"2023-11-28T12:06:30.431992+0000","last_undegraded":"2023-11-28T12:06:30.431992+0000","last_fullsized":"2023-11-28T12:06:30.431992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:39:12.434022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9072,"kb_used_data":808,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362768,"statfs":{"total":96636764160,"available":96627474432,"internally_reserved":0,"allocated":827392,"data_stored":666560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.819}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7888,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":7680,"kb_avail":94363952,"statfs":{"total":96636764160,"available":96628686848,"internally_reserved":0,"allocated":204800,"data_stored":74428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7864320},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13140,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":12352,"kb_avail":94358700,"statfs":{"total":96636764160,"available":96623308800,"internally_reserved":0,"allocated":798720,"data_stored":664796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12648448},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12112,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":11904,"kb_avail":94359728,"statfs":{"total":96636764160,"available":96624361472,"internally_reserved":0,"allocated":204800,"data_stored":73633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12189696},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11984,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":11776,"kb_avail":94359856,"statfs":{"total":96636764160,"available":96624492544,"internally_reserved":0,"allocated":204800,"data_stored":74428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12058624},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12112,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":11904,"kb_avail":94359728,"statfs":{"total":96636764160,"available":96624361472,"internally_reserved":0,"allocated":204800,"data_stored":73157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12189696},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8036,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363804,"statfs":{"total":96636764160,"available":96628535296,"internally_reserved":0,"allocated":225280,"data_stored":76032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.018}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.999}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7960,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363880,"statfs":{"total":96636764160,"available":96628613120,"internally_reserved":0,"allocated":212992,"data_stored":75064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T12:06:40.168 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T12:06:40.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.405+0000 7f60ecfff700 1 Processor -- start 2023-11-28T12:06:40.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.405+0000 7f60ecfff700 1 -- start start 2023-11-28T12:06:40.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.406+0000 7f60ecfff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f60e8161340 0x7f60e80d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:40.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.406+0000 7f60ecfff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f60e80d2320 0x7f60e80cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:40.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.406+0000 7f60ecfff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60e80d1950 con 0x7f60e815c9b0 2023-11-28T12:06:40.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.406+0000 7f60ecfff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60e80b5800 con 0x7f60e80d2320 2023-11-28T12:06:40.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.406+0000 7f60ecfff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60e80b5300 con 0x7f60e8161340 2023-11-28T12:06:40.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.407+0000 7f60e659c700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f60e815c9b0 0x7f60e80b4bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:32844/0 (socket says 172.21.15.45:32844) 2023-11-28T12:06:40.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.407+0000 7f60e659c700 1 -- 172.21.15.45:0/4186582238 learned_addr learned my addr 172.21.15.45:0/4186582238 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:06:40.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.407+0000 7f60e6d9d700 1 --2- 172.21.15.45:0/4186582238 >> v2:172.21.15.45:3300/0 conn(0x7f60e80d2320 0x7f60e80cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:40.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.407+0000 7f60e5d9b700 1 --2- 172.21.15.45:0/4186582238 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f60e8161340 0x7f60e80d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:40.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.407+0000 7f60e559a700 1 -- 172.21.15.45:0/4186582238 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3017013607 0 0) 0x7f60e80d1950 con 0x7f60e815c9b0 2023-11-28T12:06:40.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.407+0000 7f60e559a700 1 -- 172.21.15.45:0/4186582238 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60d00035b0 con 0x7f60e815c9b0 2023-11-28T12:06:40.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.407+0000 7f60e6d9d700 1 -- 172.21.15.45:0/4186582238 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f60e8161340 msgr2=0x7f60e80d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:06:40.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.407+0000 7f60e6d9d700 1 --2- 172.21.15.45:0/4186582238 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f60e8161340 0x7f60e80d1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:40.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.407+0000 7f60e6d9d700 1 -- 172.21.15.45:0/4186582238 >> v1:172.21.15.45:6789/0 conn(0x7f60e815c9b0 legacy=0x7f60e80b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:40.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.407+0000 7f60e6d9d700 1 -- 172.21.15.45:0/4186582238 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60e80b5520 con 0x7f60e80d2320 2023-11-28T12:06:40.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.407+0000 7f60e5d9b700 1 --2- 172.21.15.45:0/4186582238 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f60e8161340 0x7f60e80d1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:06:40.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.408+0000 7f60e6d9d700 1 --2- 172.21.15.45:0/4186582238 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60e80d2320 0x7f60e80cd7c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f60e0009dc0 tx=0x7f60e000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c28aec2bd305df1d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:40.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.408+0000 7f60e559a700 1 -- 172.21.15.45:0/4186582238 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e000e070 con 0x7f60e80d2320 2023-11-28T12:06:40.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.408+0000 7f60e559a700 1 -- 172.21.15.45:0/4186582238 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60e000bae0 con 0x7f60e80d2320 2023-11-28T12:06:40.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.408+0000 7f60e559a700 1 -- 172.21.15.45:0/4186582238 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e000be90 con 0x7f60e80d2320 2023-11-28T12:06:40.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.408+0000 7f60ecfff700 1 -- 172.21.15.45:0/4186582238 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60e80d2320 msgr2=0x7f60e80cd7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:40.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.408+0000 7f60ecfff700 1 --2- 172.21.15.45:0/4186582238 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60e80d2320 0x7f60e80cd7c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f60e0009dc0 tx=0x7f60e000b330 comp rx=0 tx=0).stop 2023-11-28T12:06:40.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.408+0000 7f60ecfff700 1 -- 172.21.15.45:0/4186582238 shutdown_connections 2023-11-28T12:06:40.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.408+0000 7f60ecfff700 1 --2- 172.21.15.45:0/4186582238 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60e80d2320 0x7f60e80cd7c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:40.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.408+0000 7f60ecfff700 1 --2- 172.21.15.45:0/4186582238 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f60e8161340 0x7f60e80d1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:40.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.408+0000 7f60ecfff700 1 -- 172.21.15.45:0/4186582238 >> 172.21.15.45:0/4186582238 conn(0x7f60e8072600 msgr2=0x7f60e80cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:40.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.408+0000 7f60ecfff700 1 -- 172.21.15.45:0/4186582238 shutdown_connections 2023-11-28T12:06:40.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.409+0000 7f60ecfff700 1 -- 172.21.15.45:0/4186582238 wait complete. 2023-11-28T12:06:40.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.410+0000 7f60ecfff700 1 Processor -- start 2023-11-28T12:06:40.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.410+0000 7f60ecfff700 1 -- start start 2023-11-28T12:06:40.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.411+0000 7f60ecfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60e80d2320 0x7f60e8156e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:40.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.411+0000 7f60ecfff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f60e815c9b0 0x7f60e80b7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:40.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.411+0000 7f60ecfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60e8161340 0x7f60e81e78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:40.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.411+0000 7f60ecfff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e81e7430 con 0x7f60e8161340 2023-11-28T12:06:40.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.411+0000 7f60ecfff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e81e6820 con 0x7f60e80d2320 2023-11-28T12:06:40.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.411+0000 7f60ecfff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60e81e6b00 con 0x7f60e815c9b0 2023-11-28T12:06:40.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.411+0000 7f60e6d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60e8161340 0x7f60e81e78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:40.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.412+0000 7f60e6d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60e8161340 0x7f60e81e78c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36200/0 (socket says 172.21.15.45:36200) 2023-11-28T12:06:40.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.412+0000 7f60e6d9d700 1 -- 172.21.15.45:0/3282073861 learned_addr learned my addr 172.21.15.45:0/3282073861 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:40.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.412+0000 7f60e659c700 1 --2- 172.21.15.45:0/3282073861 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60e80d2320 0x7f60e8156e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:40.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.412+0000 7f60e5d9b700 1 --2- 172.21.15.45:0/3282073861 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f60e815c9b0 0x7f60e80b7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:40.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.412+0000 7f60e6d9d700 1 -- 172.21.15.45:0/3282073861 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f60e815c9b0 msgr2=0x7f60e80b7ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:40.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.412+0000 7f60e6d9d700 1 --2- 172.21.15.45:0/3282073861 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f60e815c9b0 0x7f60e80b7ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:40.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.412+0000 7f60e6d9d700 1 -- 172.21.15.45:0/3282073861 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60e80d2320 msgr2=0x7f60e8156e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:40.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.412+0000 7f60e6d9d700 1 --2- 172.21.15.45:0/3282073861 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60e80d2320 0x7f60e8156e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:40.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.412+0000 7f60e6d9d700 1 -- 172.21.15.45:0/3282073861 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60e0009a70 con 0x7f60e8161340 2023-11-28T12:06:40.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.412+0000 7f60e6d9d700 1 --2- 172.21.15.45:0/3282073861 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60e8161340 0x7f60e81e78c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f60e000b370 tx=0x7f60e0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:40.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.412+0000 7f60d6ffd700 1 -- 172.21.15.45:0/3282073861 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e0004730 con 0x7f60e8161340 2023-11-28T12:06:40.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.412+0000 7f60d6ffd700 1 -- 172.21.15.45:0/3282073861 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60e0020070 con 0x7f60e8161340 2023-11-28T12:06:40.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.412+0000 7f60ecfff700 1 -- 172.21.15.45:0/3282073861 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60e80d15e0 con 0x7f60e8161340 2023-11-28T12:06:40.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.412+0000 7f60d6ffd700 1 -- 172.21.15.45:0/3282073861 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e0027480 con 0x7f60e8161340 2023-11-28T12:06:40.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.413+0000 7f60ecfff700 1 -- 172.21.15.45:0/3282073861 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60e80d1300 con 0x7f60e8161340 2023-11-28T12:06:40.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.414+0000 7f60ecfff700 1 -- 172.21.15.45:0/3282073861 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60e815cd80 con 0x7f60e8161340 2023-11-28T12:06:40.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.414+0000 7f60d6ffd700 1 -- 172.21.15.45:0/3282073861 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f60e0012430 con 0x7f60e8161340 2023-11-28T12:06:40.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.415+0000 7f60d6ffd700 1 --2- 172.21.15.45:0/3282073861 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f60c80682f0 0x7f60c806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:40.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.415+0000 7f60d6ffd700 1 -- 172.21.15.45:0/3282073861 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f60e0022070 con 0x7f60e8161340 2023-11-28T12:06:40.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.416+0000 7f60e659c700 1 --2- 172.21.15.45:0/3282073861 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f60c80682f0 0x7f60c806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:40.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.416+0000 7f60e659c700 1 --2- 172.21.15.45:0/3282073861 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f60c80682f0 0x7f60c806a7a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f60d80011e0 tx=0x7f60d8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:40.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.419+0000 7f60d6ffd700 1 -- 172.21.15.45:0/3282073861 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f60e008c070 con 0x7f60e8161340 2023-11-28T12:06:40.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.616+0000 7f60ecfff700 1 -- 172.21.15.45:0/3282073861 --> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f60e80745c0 con 0x7f60c80682f0 2023-11-28T12:06:40.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.625+0000 7f60d6ffd700 1 -- 172.21.15.45:0/3282073861 <== mgr.4100 v2:172.21.15.152:6832/115389 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286855 (secure 0 0 0) 0x7f60e80745c0 con 0x7f60c80682f0 2023-11-28T12:06:40.630 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:06:40.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.629+0000 7f60ecfff700 1 -- 172.21.15.45:0/3282073861 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f60c80682f0 msgr2=0x7f60c806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:40.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.629+0000 7f60ecfff700 1 --2- 172.21.15.45:0/3282073861 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f60c80682f0 0x7f60c806a7a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f60d80011e0 tx=0x7f60d8009040 comp rx=0 tx=0).stop 2023-11-28T12:06:40.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.629+0000 7f60ecfff700 1 -- 172.21.15.45:0/3282073861 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60e8161340 msgr2=0x7f60e81e78c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:40.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.629+0000 7f60ecfff700 1 --2- 172.21.15.45:0/3282073861 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60e8161340 0x7f60e81e78c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f60e000b370 tx=0x7f60e0004ad0 comp rx=0 tx=0).stop 2023-11-28T12:06:40.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.630+0000 7f60ecfff700 1 -- 172.21.15.45:0/3282073861 shutdown_connections 2023-11-28T12:06:40.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.630+0000 7f60ecfff700 1 --2- 172.21.15.45:0/3282073861 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f60c80682f0 0x7f60c806a7a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:40.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.630+0000 7f60ecfff700 1 --2- 172.21.15.45:0/3282073861 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f60e80d2320 0x7f60e8156e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:40.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.630+0000 7f60ecfff700 1 --2- 172.21.15.45:0/3282073861 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60e8161340 0x7f60e81e78c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:40.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.630+0000 7f60ecfff700 1 --2- 172.21.15.45:0/3282073861 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f60e815c9b0 0x7f60e80b7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:40.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.630+0000 7f60ecfff700 1 -- 172.21.15.45:0/3282073861 >> 172.21.15.45:0/3282073861 conn(0x7f60e8072600 msgr2=0x7f60e815e270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:40.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.630+0000 7f60ecfff700 1 -- 172.21.15.45:0/3282073861 shutdown_connections 2023-11-28T12:06:40.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.630+0000 7f60ecfff700 1 -- 172.21.15.45:0/3282073861 wait complete. 2023-11-28T12:06:40.634 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-11-28T12:06:40.649 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-11-28T12:06:40.426951+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":82304,"kb_used_data":2816,"kb_used_omap":0,"kb_used_meta":79424,"kb_avail":754892416,"statfs":{"total":773094113280,"available":773009833984,"internally_reserved":0,"allocated":2883584,"data_stored":1778098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":81330176},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.027163"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.400350+0000","last_change":"2023-11-28T12:06:29.429595+0000","last_active":"2023-11-28T12:06:30.400350+0000","last_peered":"2023-11-28T12:06:30.400350+0000","last_clean":"2023-11-28T12:06:30.400350+0000","last_became_active":"2023-11-28T12:06:29.428839+0000","last_became_peered":"2023-11-28T12:06:29.428839+0000","last_unstale":"2023-11-28T12:06:30.400350+0000","last_undegraded":"2023-11-28T12:06:30.400350+0000","last_fullsized":"2023-11-28T12:06:30.400350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:51:28.536571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.402235+0000","last_change":"2023-11-28T12:06:29.425536+0000","last_active":"2023-11-28T12:06:30.402235+0000","last_peered":"2023-11-28T12:06:30.402235+0000","last_clean":"2023-11-28T12:06:30.402235+0000","last_became_active":"2023-11-28T12:06:29.425250+0000","last_became_peered":"2023-11-28T12:06:29.425250+0000","last_unstale":"2023-11-28T12:06:30.402235+0000","last_undegraded":"2023-11-28T12:06:30.402235+0000","last_fullsized":"2023-11-28T12:06:30.402235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:27:03.452097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432130+0000","last_change":"2023-11-28T12:06:29.419165+0000","last_active":"2023-11-28T12:06:30.432130+0000","last_peered":"2023-11-28T12:06:30.432130+0000","last_clean":"2023-11-28T12:06:30.432130+0000","last_became_active":"2023-11-28T12:06:29.417243+0000","last_became_peered":"2023-11-28T12:06:29.417243+0000","last_unstale":"2023-11-28T12:06:30.432130+0000","last_undegraded":"2023-11-28T12:06:30.432130+0000","last_fullsized":"2023-11-28T12:06:30.432130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:20:33.063079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.402605+0000","last_change":"2023-11-28T12:06:29.422225+0000","last_active":"2023-11-28T12:06:30.402605+0000","last_peered":"2023-11-28T12:06:30.402605+0000","last_clean":"2023-11-28T12:06:30.402605+0000","last_became_active":"2023-11-28T12:06:29.419794+0000","last_became_peered":"2023-11-28T12:06:29.419794+0000","last_unstale":"2023-11-28T12:06:30.402605+0000","last_undegraded":"2023-11-28T12:06:30.402605+0000","last_fullsized":"2023-11-28T12:06:30.402605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:02:26.849301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.430942+0000","last_change":"2023-11-28T12:06:29.426450+0000","last_active":"2023-11-28T12:06:30.430942+0000","last_peered":"2023-11-28T12:06:30.430942+0000","last_clean":"2023-11-28T12:06:30.430942+0000","last_became_active":"2023-11-28T12:06:29.424681+0000","last_became_peered":"2023-11-28T12:06:29.424681+0000","last_unstale":"2023-11-28T12:06:30.430942+0000","last_undegraded":"2023-11-28T12:06:30.430942+0000","last_fullsized":"2023-11-28T12:06:30.430942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:27:03.452097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431570+0000","last_change":"2023-11-28T12:06:29.419827+0000","last_active":"2023-11-28T12:06:30.431570+0000","last_peered":"2023-11-28T12:06:30.431570+0000","last_clean":"2023-11-28T12:06:30.431570+0000","last_became_active":"2023-11-28T12:06:29.419556+0000","last_became_peered":"2023-11-28T12:06:29.419556+0000","last_unstale":"2023-11-28T12:06:30.431570+0000","last_undegraded":"2023-11-28T12:06:30.431570+0000","last_fullsized":"2023-11-28T12:06:30.431570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:05:52.134696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431287+0000","last_change":"2023-11-28T12:06:29.426829+0000","last_active":"2023-11-28T12:06:30.431287+0000","last_peered":"2023-11-28T12:06:30.431287+0000","last_clean":"2023-11-28T12:06:30.431287+0000","last_became_active":"2023-11-28T12:06:29.426579+0000","last_became_peered":"2023-11-28T12:06:29.426579+0000","last_unstale":"2023-11-28T12:06:30.431287+0000","last_undegraded":"2023-11-28T12:06:30.431287+0000","last_fullsized":"2023-11-28T12:06:30.431287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:03:53.795177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.402279+0000","last_change":"2023-11-28T12:06:29.425956+0000","last_active":"2023-11-28T12:06:30.402279+0000","last_peered":"2023-11-28T12:06:30.402279+0000","last_clean":"2023-11-28T12:06:30.402279+0000","last_became_active":"2023-11-28T12:06:29.422623+0000","last_became_peered":"2023-11-28T12:06:29.422623+0000","last_unstale":"2023-11-28T12:06:30.402279+0000","last_undegraded":"2023-11-28T12:06:30.402279+0000","last_fullsized":"2023-11-28T12:06:30.402279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:28:44.482157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432487+0000","last_change":"2023-11-28T12:06:29.431715+0000","last_active":"2023-11-28T12:06:30.432487+0000","last_peered":"2023-11-28T12:06:30.432487+0000","last_clean":"2023-11-28T12:06:30.432487+0000","last_became_active":"2023-11-28T12:06:29.431487+0000","last_became_peered":"2023-11-28T12:06:29.431487+0000","last_unstale":"2023-11-28T12:06:30.432487+0000","last_undegraded":"2023-11-28T12:06:30.432487+0000","last_fullsized":"2023-11-28T12:06:30.432487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:57:52.848285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.402475+0000","last_change":"2023-11-28T12:06:29.421929+0000","last_active":"2023-11-28T12:06:30.402475+0000","last_peered":"2023-11-28T12:06:30.402475+0000","last_clean":"2023-11-28T12:06:30.402475+0000","last_became_active":"2023-11-28T12:06:29.421572+0000","last_became_peered":"2023-11-28T12:06:29.421572+0000","last_unstale":"2023-11-28T12:06:30.402475+0000","last_undegraded":"2023-11-28T12:06:30.402475+0000","last_fullsized":"2023-11-28T12:06:30.402475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:31:18.258195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432165+0000","last_change":"2023-11-28T12:06:29.427047+0000","last_active":"2023-11-28T12:06:30.432165+0000","last_peered":"2023-11-28T12:06:30.432165+0000","last_clean":"2023-11-28T12:06:30.432165+0000","last_became_active":"2023-11-28T12:06:29.418090+0000","last_became_peered":"2023-11-28T12:06:29.418090+0000","last_unstale":"2023-11-28T12:06:30.432165+0000","last_undegraded":"2023-11-28T12:06:30.432165+0000","last_fullsized":"2023-11-28T12:06:30.432165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:24:27.065719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.400209+0000","last_change":"2023-11-28T12:06:29.424306+0000","last_active":"2023-11-28T12:06:30.400209+0000","last_peered":"2023-11-28T12:06:30.400209+0000","last_clean":"2023-11-28T12:06:30.400209+0000","last_became_active":"2023-11-28T12:06:29.424059+0000","last_became_peered":"2023-11-28T12:06:29.424059+0000","last_unstale":"2023-11-28T12:06:30.400209+0000","last_undegraded":"2023-11-28T12:06:30.400209+0000","last_fullsized":"2023-11-28T12:06:30.400209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:10:08.464896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.400054+0000","last_change":"2023-11-28T12:06:29.422496+0000","last_active":"2023-11-28T12:06:30.400054+0000","last_peered":"2023-11-28T12:06:30.400054+0000","last_clean":"2023-11-28T12:06:30.400054+0000","last_became_active":"2023-11-28T12:06:29.422201+0000","last_became_peered":"2023-11-28T12:06:29.422201+0000","last_unstale":"2023-11-28T12:06:30.400054+0000","last_undegraded":"2023-11-28T12:06:30.400054+0000","last_fullsized":"2023-11-28T12:06:30.400054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:22:20.431576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.402686+0000","last_change":"2023-11-28T12:06:29.426168+0000","last_active":"2023-11-28T12:06:30.402686+0000","last_peered":"2023-11-28T12:06:30.402686+0000","last_clean":"2023-11-28T12:06:30.402686+0000","last_became_active":"2023-11-28T12:06:29.425480+0000","last_became_peered":"2023-11-28T12:06:29.425480+0000","last_unstale":"2023-11-28T12:06:30.402686+0000","last_undegraded":"2023-11-28T12:06:30.402686+0000","last_fullsized":"2023-11-28T12:06:30.402686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:13:08.504009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431515+0000","last_change":"2023-11-28T12:06:29.428464+0000","last_active":"2023-11-28T12:06:30.431515+0000","last_peered":"2023-11-28T12:06:30.431515+0000","last_clean":"2023-11-28T12:06:30.431515+0000","last_became_active":"2023-11-28T12:06:29.428110+0000","last_became_peered":"2023-11-28T12:06:29.428110+0000","last_unstale":"2023-11-28T12:06:30.431515+0000","last_undegraded":"2023-11-28T12:06:30.431515+0000","last_fullsized":"2023-11-28T12:06:30.431515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:13:08.504009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431253+0000","last_change":"2023-11-28T12:06:29.416388+0000","last_active":"2023-11-28T12:06:30.431253+0000","last_peered":"2023-11-28T12:06:30.431253+0000","last_clean":"2023-11-28T12:06:30.431253+0000","last_became_active":"2023-11-28T12:06:29.416031+0000","last_became_peered":"2023-11-28T12:06:29.416031+0000","last_unstale":"2023-11-28T12:06:30.431253+0000","last_undegraded":"2023-11-28T12:06:30.431253+0000","last_fullsized":"2023-11-28T12:06:30.431253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:33:22.203612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432609+0000","last_change":"2023-11-28T12:06:29.431468+0000","last_active":"2023-11-28T12:06:30.432609+0000","last_peered":"2023-11-28T12:06:30.432609+0000","last_clean":"2023-11-28T12:06:30.432609+0000","last_became_active":"2023-11-28T12:06:29.430744+0000","last_became_peered":"2023-11-28T12:06:29.430744+0000","last_unstale":"2023-11-28T12:06:30.432609+0000","last_undegraded":"2023-11-28T12:06:30.432609+0000","last_fullsized":"2023-11-28T12:06:30.432609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:13:08.504009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432429+0000","last_change":"2023-11-28T12:06:29.422318+0000","last_active":"2023-11-28T12:06:30.432429+0000","last_peered":"2023-11-28T12:06:30.432429+0000","last_clean":"2023-11-28T12:06:30.432429+0000","last_became_active":"2023-11-28T12:06:29.421236+0000","last_became_peered":"2023-11-28T12:06:29.421236+0000","last_unstale":"2023-11-28T12:06:30.432429+0000","last_undegraded":"2023-11-28T12:06:30.432429+0000","last_fullsized":"2023-11-28T12:06:30.432429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:42:57.391884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.400334+0000","last_change":"2023-11-28T12:06:29.417658+0000","last_active":"2023-11-28T12:06:30.400334+0000","last_peered":"2023-11-28T12:06:30.400334+0000","last_clean":"2023-11-28T12:06:30.400334+0000","last_became_active":"2023-11-28T12:06:29.417101+0000","last_became_peered":"2023-11-28T12:06:29.417101+0000","last_unstale":"2023-11-28T12:06:30.400334+0000","last_undegraded":"2023-11-28T12:06:30.400334+0000","last_fullsized":"2023-11-28T12:06:30.400334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:27:38.882977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432163+0000","last_change":"2023-11-28T12:06:29.420113+0000","last_active":"2023-11-28T12:06:30.432163+0000","last_peered":"2023-11-28T12:06:30.432163+0000","last_clean":"2023-11-28T12:06:30.432163+0000","last_became_active":"2023-11-28T12:06:29.419156+0000","last_became_peered":"2023-11-28T12:06:29.419156+0000","last_unstale":"2023-11-28T12:06:30.432163+0000","last_undegraded":"2023-11-28T12:06:30.432163+0000","last_fullsized":"2023-11-28T12:06:30.432163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:28:34.213514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431510+0000","last_change":"2023-11-28T12:06:29.430718+0000","last_active":"2023-11-28T12:06:30.431510+0000","last_peered":"2023-11-28T12:06:30.431510+0000","last_clean":"2023-11-28T12:06:30.431510+0000","last_became_active":"2023-11-28T12:06:29.430451+0000","last_became_peered":"2023-11-28T12:06:29.430451+0000","last_unstale":"2023-11-28T12:06:30.431510+0000","last_undegraded":"2023-11-28T12:06:30.431510+0000","last_fullsized":"2023-11-28T12:06:30.431510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:07:00.558286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432197+0000","last_change":"2023-11-28T12:06:29.419281+0000","last_active":"2023-11-28T12:06:30.432197+0000","last_peered":"2023-11-28T12:06:30.432197+0000","last_clean":"2023-11-28T12:06:30.432197+0000","last_became_active":"2023-11-28T12:06:29.418987+0000","last_became_peered":"2023-11-28T12:06:29.418987+0000","last_unstale":"2023-11-28T12:06:30.432197+0000","last_undegraded":"2023-11-28T12:06:30.432197+0000","last_fullsized":"2023-11-28T12:06:30.432197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:57:15.470252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.430620+0000","last_change":"2023-11-28T12:06:29.415280+0000","last_active":"2023-11-28T12:06:30.430620+0000","last_peered":"2023-11-28T12:06:30.430620+0000","last_clean":"2023-11-28T12:06:30.430620+0000","last_became_active":"2023-11-28T12:06:29.414999+0000","last_became_peered":"2023-11-28T12:06:29.414999+0000","last_unstale":"2023-11-28T12:06:30.430620+0000","last_undegraded":"2023-11-28T12:06:30.430620+0000","last_fullsized":"2023-11-28T12:06:30.430620+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:27:03.452097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431563+0000","last_change":"2023-11-28T12:06:29.429537+0000","last_active":"2023-11-28T12:06:30.431563+0000","last_peered":"2023-11-28T12:06:30.431563+0000","last_clean":"2023-11-28T12:06:30.431563+0000","last_became_active":"2023-11-28T12:06:29.428962+0000","last_became_peered":"2023-11-28T12:06:29.428962+0000","last_unstale":"2023-11-28T12:06:30.431563+0000","last_undegraded":"2023-11-28T12:06:30.431563+0000","last_fullsized":"2023-11-28T12:06:30.431563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:51:20.319063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431697+0000","last_change":"2023-11-28T12:06:29.421014+0000","last_active":"2023-11-28T12:06:30.431697+0000","last_peered":"2023-11-28T12:06:30.431697+0000","last_clean":"2023-11-28T12:06:30.431697+0000","last_became_active":"2023-11-28T12:06:29.418311+0000","last_became_peered":"2023-11-28T12:06:29.418311+0000","last_unstale":"2023-11-28T12:06:30.431697+0000","last_undegraded":"2023-11-28T12:06:30.431697+0000","last_fullsized":"2023-11-28T12:06:30.431697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:47:58.895820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432093+0000","last_change":"2023-11-28T12:06:29.415605+0000","last_active":"2023-11-28T12:06:30.432093+0000","last_peered":"2023-11-28T12:06:30.432093+0000","last_clean":"2023-11-28T12:06:30.432093+0000","last_became_active":"2023-11-28T12:06:29.413218+0000","last_became_peered":"2023-11-28T12:06:29.413218+0000","last_unstale":"2023-11-28T12:06:30.432093+0000","last_undegraded":"2023-11-28T12:06:30.432093+0000","last_fullsized":"2023-11-28T12:06:30.432093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:03:53.795177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.402352+0000","last_change":"2023-11-28T12:06:29.438175+0000","last_active":"2023-11-28T12:06:30.402352+0000","last_peered":"2023-11-28T12:06:30.402352+0000","last_clean":"2023-11-28T12:06:30.402352+0000","last_became_active":"2023-11-28T12:06:29.437503+0000","last_became_peered":"2023-11-28T12:06:29.437503+0000","last_unstale":"2023-11-28T12:06:30.402352+0000","last_undegraded":"2023-11-28T12:06:30.402352+0000","last_fullsized":"2023-11-28T12:06:30.402352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:57:52.848285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431780+0000","last_change":"2023-11-28T12:06:28.910005+0000","last_active":"2023-11-28T12:06:30.431780+0000","last_peered":"2023-11-28T12:06:30.431780+0000","last_clean":"2023-11-28T12:06:30.431780+0000","last_became_active":"2023-11-28T12:06:28.909736+0000","last_became_peered":"2023-11-28T12:06:28.909736+0000","last_unstale":"2023-11-28T12:06:30.431780+0000","last_undegraded":"2023-11-28T12:06:30.431780+0000","last_fullsized":"2023-11-28T12:06:30.431780+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:27:37.876201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431752+0000","last_change":"2023-11-28T12:06:29.412757+0000","last_active":"2023-11-28T12:06:30.431752+0000","last_peered":"2023-11-28T12:06:30.431752+0000","last_clean":"2023-11-28T12:06:30.431752+0000","last_became_active":"2023-11-28T12:06:29.412424+0000","last_became_peered":"2023-11-28T12:06:29.412424+0000","last_unstale":"2023-11-28T12:06:30.431752+0000","last_undegraded":"2023-11-28T12:06:30.431752+0000","last_fullsized":"2023-11-28T12:06:30.431752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:18:07.794113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431275+0000","last_change":"2023-11-28T12:06:28.915845+0000","last_active":"2023-11-28T12:06:30.431275+0000","last_peered":"2023-11-28T12:06:30.431275+0000","last_clean":"2023-11-28T12:06:30.431275+0000","last_became_active":"2023-11-28T12:06:28.915223+0000","last_became_peered":"2023-11-28T12:06:28.915223+0000","last_unstale":"2023-11-28T12:06:30.431275+0000","last_undegraded":"2023-11-28T12:06:30.431275+0000","last_fullsized":"2023-11-28T12:06:30.431275+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:18:19.943945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432576+0000","last_change":"2023-11-28T12:06:29.431967+0000","last_active":"2023-11-28T12:06:30.432576+0000","last_peered":"2023-11-28T12:06:30.432576+0000","last_clean":"2023-11-28T12:06:30.432576+0000","last_became_active":"2023-11-28T12:06:29.430710+0000","last_became_peered":"2023-11-28T12:06:29.430710+0000","last_unstale":"2023-11-28T12:06:30.432576+0000","last_undegraded":"2023-11-28T12:06:30.432576+0000","last_fullsized":"2023-11-28T12:06:30.432576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:03:53.795177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.430884+0000","last_change":"2023-11-28T12:06:28.901401+0000","last_active":"2023-11-28T12:06:30.430884+0000","last_peered":"2023-11-28T12:06:30.430884+0000","last_clean":"2023-11-28T12:06:30.430884+0000","last_became_active":"2023-11-28T12:06:28.900727+0000","last_became_peered":"2023-11-28T12:06:28.900727+0000","last_unstale":"2023-11-28T12:06:30.430884+0000","last_undegraded":"2023-11-28T12:06:30.430884+0000","last_fullsized":"2023-11-28T12:06:30.430884+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:43:34.311973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.402933+0000","last_change":"2023-11-28T12:06:29.420506+0000","last_active":"2023-11-28T12:06:30.402933+0000","last_peered":"2023-11-28T12:06:30.402933+0000","last_clean":"2023-11-28T12:06:30.402933+0000","last_became_active":"2023-11-28T12:06:29.419616+0000","last_became_peered":"2023-11-28T12:06:29.419616+0000","last_unstale":"2023-11-28T12:06:30.402933+0000","last_undegraded":"2023-11-28T12:06:30.402933+0000","last_fullsized":"2023-11-28T12:06:30.402933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:33:22.203612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432686+0000","last_change":"2023-11-28T12:06:28.904440+0000","last_active":"2023-11-28T12:06:30.432686+0000","last_peered":"2023-11-28T12:06:30.432686+0000","last_clean":"2023-11-28T12:06:30.432686+0000","last_became_active":"2023-11-28T12:06:28.904179+0000","last_became_peered":"2023-11-28T12:06:28.904179+0000","last_unstale":"2023-11-28T12:06:30.432686+0000","last_undegraded":"2023-11-28T12:06:30.432686+0000","last_fullsized":"2023-11-28T12:06:30.432686+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:25:02.799298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.430795+0000","last_change":"2023-11-28T12:06:29.411944+0000","last_active":"2023-11-28T12:06:30.430795+0000","last_peered":"2023-11-28T12:06:30.430795+0000","last_clean":"2023-11-28T12:06:30.430795+0000","last_became_active":"2023-11-28T12:06:29.411564+0000","last_became_peered":"2023-11-28T12:06:29.411564+0000","last_unstale":"2023-11-28T12:06:30.430795+0000","last_undegraded":"2023-11-28T12:06:30.430795+0000","last_fullsized":"2023-11-28T12:06:30.430795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:57:15.470252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.402366+0000","last_change":"2023-11-28T12:06:28.901015+0000","last_active":"2023-11-28T12:06:30.402366+0000","last_peered":"2023-11-28T12:06:30.402366+0000","last_clean":"2023-11-28T12:06:30.402366+0000","last_became_active":"2023-11-28T12:06:28.900724+0000","last_became_peered":"2023-11-28T12:06:28.900724+0000","last_unstale":"2023-11-28T12:06:30.402366+0000","last_undegraded":"2023-11-28T12:06:30.402366+0000","last_fullsized":"2023-11-28T12:06:30.402366+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:25:02.799298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.430807+0000","last_change":"2023-11-28T12:06:29.425082+0000","last_active":"2023-11-28T12:06:30.430807+0000","last_peered":"2023-11-28T12:06:30.430807+0000","last_clean":"2023-11-28T12:06:30.430807+0000","last_became_active":"2023-11-28T12:06:29.424753+0000","last_became_peered":"2023-11-28T12:06:29.424753+0000","last_unstale":"2023-11-28T12:06:30.430807+0000","last_undegraded":"2023-11-28T12:06:30.430807+0000","last_fullsized":"2023-11-28T12:06:30.430807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:57:52.848285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432060+0000","last_change":"2023-11-28T12:06:28.904157+0000","last_active":"2023-11-28T12:06:30.432060+0000","last_peered":"2023-11-28T12:06:30.432060+0000","last_clean":"2023-11-28T12:06:30.432060+0000","last_became_active":"2023-11-28T12:06:28.902746+0000","last_became_peered":"2023-11-28T12:06:28.902746+0000","last_unstale":"2023-11-28T12:06:30.432060+0000","last_undegraded":"2023-11-28T12:06:30.432060+0000","last_fullsized":"2023-11-28T12:06:30.432060+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:33:21.196836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431731+0000","last_change":"2023-11-28T12:06:29.417397+0000","last_active":"2023-11-28T12:06:30.431731+0000","last_peered":"2023-11-28T12:06:30.431731+0000","last_clean":"2023-11-28T12:06:30.431731+0000","last_became_active":"2023-11-28T12:06:29.416301+0000","last_became_peered":"2023-11-28T12:06:29.416301+0000","last_unstale":"2023-11-28T12:06:30.431731+0000","last_undegraded":"2023-11-28T12:06:30.431731+0000","last_fullsized":"2023-11-28T12:06:30.431731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:51:20.319063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"19'6","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432375+0000","last_change":"2023-11-28T12:06:28.907107+0000","last_active":"2023-11-28T12:06:30.432375+0000","last_peered":"2023-11-28T12:06:30.432375+0000","last_clean":"2023-11-28T12:06:30.432375+0000","last_became_active":"2023-11-28T12:06:28.906719+0000","last_became_peered":"2023-11-28T12:06:28.906719+0000","last_unstale":"2023-11-28T12:06:30.432375+0000","last_undegraded":"2023-11-28T12:06:30.432375+0000","last_fullsized":"2023-11-28T12:06:30.432375+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:18:19.943945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432208+0000","last_change":"2023-11-28T12:06:29.421775+0000","last_active":"2023-11-28T12:06:30.432208+0000","last_peered":"2023-11-28T12:06:30.432208+0000","last_clean":"2023-11-28T12:06:30.432208+0000","last_became_active":"2023-11-28T12:06:29.421474+0000","last_became_peered":"2023-11-28T12:06:29.421474+0000","last_unstale":"2023-11-28T12:06:30.432208+0000","last_undegraded":"2023-11-28T12:06:30.432208+0000","last_fullsized":"2023-11-28T12:06:30.432208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:03:53.795177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431365+0000","last_change":"2023-11-28T12:06:28.906549+0000","last_active":"2023-11-28T12:06:30.431365+0000","last_peered":"2023-11-28T12:06:30.431365+0000","last_clean":"2023-11-28T12:06:30.431365+0000","last_became_active":"2023-11-28T12:06:28.906267+0000","last_became_peered":"2023-11-28T12:06:28.906267+0000","last_unstale":"2023-11-28T12:06:30.431365+0000","last_undegraded":"2023-11-28T12:06:30.431365+0000","last_fullsized":"2023-11-28T12:06:30.431365+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:20:03.086957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431336+0000","last_change":"2023-11-28T12:06:29.412345+0000","last_active":"2023-11-28T12:06:30.431336+0000","last_peered":"2023-11-28T12:06:30.431336+0000","last_clean":"2023-11-28T12:06:30.431336+0000","last_became_active":"2023-11-28T12:06:29.412100+0000","last_became_peered":"2023-11-28T12:06:29.412100+0000","last_unstale":"2023-11-28T12:06:30.431336+0000","last_undegraded":"2023-11-28T12:06:30.431336+0000","last_fullsized":"2023-11-28T12:06:30.431336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:08:40.987428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432293+0000","last_change":"2023-11-28T12:06:28.901789+0000","last_active":"2023-11-28T12:06:30.432293+0000","last_peered":"2023-11-28T12:06:30.432293+0000","last_clean":"2023-11-28T12:06:30.432293+0000","last_became_active":"2023-11-28T12:06:28.901317+0000","last_became_peered":"2023-11-28T12:06:28.901317+0000","last_unstale":"2023-11-28T12:06:30.432293+0000","last_undegraded":"2023-11-28T12:06:30.432293+0000","last_fullsized":"2023-11-28T12:06:30.432293+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:18:19.943945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.402428+0000","last_change":"2023-11-28T12:06:29.428820+0000","last_active":"2023-11-28T12:06:30.402428+0000","last_peered":"2023-11-28T12:06:30.402428+0000","last_clean":"2023-11-28T12:06:30.402428+0000","last_became_active":"2023-11-28T12:06:29.428532+0000","last_became_peered":"2023-11-28T12:06:29.428532+0000","last_unstale":"2023-11-28T12:06:30.402428+0000","last_undegraded":"2023-11-28T12:06:30.402428+0000","last_fullsized":"2023-11-28T12:06:30.402428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:03:53.795177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431427+0000","last_change":"2023-11-28T12:06:28.911421+0000","last_active":"2023-11-28T12:06:30.431427+0000","last_peered":"2023-11-28T12:06:30.431427+0000","last_clean":"2023-11-28T12:06:30.431427+0000","last_became_active":"2023-11-28T12:06:28.911098+0000","last_became_peered":"2023-11-28T12:06:28.911098+0000","last_unstale":"2023-11-28T12:06:30.431427+0000","last_undegraded":"2023-11-28T12:06:30.431427+0000","last_fullsized":"2023-11-28T12:06:30.431427+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:57:01.417679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432485+0000","last_change":"2023-11-28T12:06:29.428661+0000","last_active":"2023-11-28T12:06:30.432485+0000","last_peered":"2023-11-28T12:06:30.432485+0000","last_clean":"2023-11-28T12:06:30.432485+0000","last_became_active":"2023-11-28T12:06:29.427044+0000","last_became_peered":"2023-11-28T12:06:29.427044+0000","last_unstale":"2023-11-28T12:06:30.432485+0000","last_undegraded":"2023-11-28T12:06:30.432485+0000","last_fullsized":"2023-11-28T12:06:30.432485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:28:44.482157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.401722+0000","last_change":"2023-11-28T12:06:28.900418+0000","last_active":"2023-11-28T12:06:30.401722+0000","last_peered":"2023-11-28T12:06:30.401722+0000","last_clean":"2023-11-28T12:06:30.401722+0000","last_became_active":"2023-11-28T12:06:28.900135+0000","last_became_peered":"2023-11-28T12:06:28.900135+0000","last_unstale":"2023-11-28T12:06:30.401722+0000","last_undegraded":"2023-11-28T12:06:30.401722+0000","last_fullsized":"2023-11-28T12:06:30.401722+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:51:27.529794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432203+0000","last_change":"2023-11-28T12:06:29.419258+0000","last_active":"2023-11-28T12:06:30.432203+0000","last_peered":"2023-11-28T12:06:30.432203+0000","last_clean":"2023-11-28T12:06:30.432203+0000","last_became_active":"2023-11-28T12:06:29.418964+0000","last_became_peered":"2023-11-28T12:06:29.418964+0000","last_unstale":"2023-11-28T12:06:30.432203+0000","last_undegraded":"2023-11-28T12:06:30.432203+0000","last_fullsized":"2023-11-28T12:06:30.432203+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:28:34.213514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431583+0000","last_change":"2023-11-28T12:06:28.906323+0000","last_active":"2023-11-28T12:06:30.431583+0000","last_peered":"2023-11-28T12:06:30.431583+0000","last_clean":"2023-11-28T12:06:30.431583+0000","last_became_active":"2023-11-28T12:06:28.906018+0000","last_became_peered":"2023-11-28T12:06:28.906018+0000","last_unstale":"2023-11-28T12:06:30.431583+0000","last_undegraded":"2023-11-28T12:06:30.431583+0000","last_fullsized":"2023-11-28T12:06:30.431583+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:43:34.311973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.401855+0000","last_change":"2023-11-28T12:06:29.428058+0000","last_active":"2023-11-28T12:06:30.401855+0000","last_peered":"2023-11-28T12:06:30.401855+0000","last_clean":"2023-11-28T12:06:30.401855+0000","last_became_active":"2023-11-28T12:06:29.427473+0000","last_became_peered":"2023-11-28T12:06:29.427473+0000","last_unstale":"2023-11-28T12:06:30.401855+0000","last_undegraded":"2023-11-28T12:06:30.401855+0000","last_fullsized":"2023-11-28T12:06:30.401855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:07:00.558286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431905+0000","last_change":"2023-11-28T12:06:28.911429+0000","last_active":"2023-11-28T12:06:30.431905+0000","last_peered":"2023-11-28T12:06:30.431905+0000","last_clean":"2023-11-28T12:06:30.431905+0000","last_became_active":"2023-11-28T12:06:28.911128+0000","last_became_peered":"2023-11-28T12:06:28.911128+0000","last_unstale":"2023-11-28T12:06:30.431905+0000","last_undegraded":"2023-11-28T12:06:30.431905+0000","last_fullsized":"2023-11-28T12:06:30.431905+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:05:22.551488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431796+0000","last_change":"2023-11-28T12:06:29.431218+0000","last_active":"2023-11-28T12:06:30.431796+0000","last_peered":"2023-11-28T12:06:30.431796+0000","last_clean":"2023-11-28T12:06:30.431796+0000","last_became_active":"2023-11-28T12:06:29.430478+0000","last_became_peered":"2023-11-28T12:06:29.430478+0000","last_unstale":"2023-11-28T12:06:30.431796+0000","last_undegraded":"2023-11-28T12:06:30.431796+0000","last_fullsized":"2023-11-28T12:06:30.431796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:36:24.619605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432004+0000","last_change":"2023-11-28T12:06:28.909101+0000","last_active":"2023-11-28T12:06:30.432004+0000","last_peered":"2023-11-28T12:06:30.432004+0000","last_clean":"2023-11-28T12:06:30.432004+0000","last_became_active":"2023-11-28T12:06:28.908745+0000","last_became_peered":"2023-11-28T12:06:28.908745+0000","last_unstale":"2023-11-28T12:06:30.432004+0000","last_undegraded":"2023-11-28T12:06:30.432004+0000","last_fullsized":"2023-11-28T12:06:30.432004+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:02:25.842525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.403103+0000","last_change":"2023-11-28T12:06:29.414146+0000","last_active":"2023-11-28T12:06:30.403103+0000","last_peered":"2023-11-28T12:06:30.403103+0000","last_clean":"2023-11-28T12:06:30.403103+0000","last_became_active":"2023-11-28T12:06:29.413597+0000","last_became_peered":"2023-11-28T12:06:29.413597+0000","last_unstale":"2023-11-28T12:06:30.403103+0000","last_undegraded":"2023-11-28T12:06:30.403103+0000","last_fullsized":"2023-11-28T12:06:30.403103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:47:58.895820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.402510+0000","last_change":"2023-11-28T12:06:28.897981+0000","last_active":"2023-11-28T12:06:30.402510+0000","last_peered":"2023-11-28T12:06:30.402510+0000","last_clean":"2023-11-28T12:06:30.402510+0000","last_became_active":"2023-11-28T12:06:28.897618+0000","last_became_peered":"2023-11-28T12:06:28.897618+0000","last_unstale":"2023-11-28T12:06:30.402510+0000","last_undegraded":"2023-11-28T12:06:30.402510+0000","last_fullsized":"2023-11-28T12:06:30.402510+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:22:19.424800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431219+0000","last_change":"2023-11-28T12:06:29.411291+0000","last_active":"2023-11-28T12:06:30.431219+0000","last_peered":"2023-11-28T12:06:30.431219+0000","last_clean":"2023-11-28T12:06:30.431219+0000","last_became_active":"2023-11-28T12:06:29.411041+0000","last_became_peered":"2023-11-28T12:06:29.411041+0000","last_unstale":"2023-11-28T12:06:30.431219+0000","last_undegraded":"2023-11-28T12:06:30.431219+0000","last_fullsized":"2023-11-28T12:06:30.431219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:25:49.001168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431191+0000","last_change":"2023-11-28T12:06:28.899397+0000","last_active":"2023-11-28T12:06:30.431191+0000","last_peered":"2023-11-28T12:06:30.431191+0000","last_clean":"2023-11-28T12:06:30.431191+0000","last_became_active":"2023-11-28T12:06:28.899027+0000","last_became_peered":"2023-11-28T12:06:28.899027+0000","last_unstale":"2023-11-28T12:06:30.431191+0000","last_undegraded":"2023-11-28T12:06:30.431191+0000","last_fullsized":"2023-11-28T12:06:30.431191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:05:22.551488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432275+0000","last_change":"2023-11-28T12:06:29.427339+0000","last_active":"2023-11-28T12:06:30.432275+0000","last_peered":"2023-11-28T12:06:30.432275+0000","last_clean":"2023-11-28T12:06:30.432275+0000","last_became_active":"2023-11-28T12:06:29.422893+0000","last_became_peered":"2023-11-28T12:06:29.422893+0000","last_unstale":"2023-11-28T12:06:30.432275+0000","last_undegraded":"2023-11-28T12:06:30.432275+0000","last_fullsized":"2023-11-28T12:06:30.432275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:57:15.470252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.402371+0000","last_change":"2023-11-28T12:06:28.911788+0000","last_active":"2023-11-28T12:06:30.402371+0000","last_peered":"2023-11-28T12:06:30.402371+0000","last_clean":"2023-11-28T12:06:30.402371+0000","last_became_active":"2023-11-28T12:06:28.910333+0000","last_became_peered":"2023-11-28T12:06:28.910333+0000","last_unstale":"2023-11-28T12:06:30.402371+0000","last_undegraded":"2023-11-28T12:06:30.402371+0000","last_fullsized":"2023-11-28T12:06:30.402371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:10:07.458120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432302+0000","last_change":"2023-11-28T12:06:29.422530+0000","last_active":"2023-11-28T12:06:30.432302+0000","last_peered":"2023-11-28T12:06:30.432302+0000","last_clean":"2023-11-28T12:06:30.432302+0000","last_became_active":"2023-11-28T12:06:29.422148+0000","last_became_peered":"2023-11-28T12:06:29.422148+0000","last_unstale":"2023-11-28T12:06:30.432302+0000","last_undegraded":"2023-11-28T12:06:30.432302+0000","last_fullsized":"2023-11-28T12:06:30.432302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:27:03.452097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431662+0000","last_change":"2023-11-28T12:06:28.906946+0000","last_active":"2023-11-28T12:06:30.431662+0000","last_peered":"2023-11-28T12:06:30.431662+0000","last_clean":"2023-11-28T12:06:30.431662+0000","last_became_active":"2023-11-28T12:06:28.906330+0000","last_became_peered":"2023-11-28T12:06:28.906330+0000","last_unstale":"2023-11-28T12:06:30.431662+0000","last_undegraded":"2023-11-28T12:06:30.431662+0000","last_fullsized":"2023-11-28T12:06:30.431662+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:51:27.529794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432470+0000","last_change":"2023-11-28T12:06:29.422900+0000","last_active":"2023-11-28T12:06:30.432470+0000","last_peered":"2023-11-28T12:06:30.432470+0000","last_clean":"2023-11-28T12:06:30.432470+0000","last_became_active":"2023-11-28T12:06:29.422592+0000","last_became_peered":"2023-11-28T12:06:29.422592+0000","last_unstale":"2023-11-28T12:06:30.432470+0000","last_undegraded":"2023-11-28T12:06:30.432470+0000","last_fullsized":"2023-11-28T12:06:30.432470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:39:17.802039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431015+0000","last_change":"2023-11-28T12:06:28.910918+0000","last_active":"2023-11-28T12:06:30.431015+0000","last_peered":"2023-11-28T12:06:30.431015+0000","last_clean":"2023-11-28T12:06:30.431015+0000","last_became_active":"2023-11-28T12:06:28.910601+0000","last_became_peered":"2023-11-28T12:06:28.910601+0000","last_unstale":"2023-11-28T12:06:30.431015+0000","last_undegraded":"2023-11-28T12:06:30.431015+0000","last_fullsized":"2023-11-28T12:06:30.431015+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:22:19.424800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432528+0000","last_change":"2023-11-28T12:06:29.428654+0000","last_active":"2023-11-28T12:06:30.432528+0000","last_peered":"2023-11-28T12:06:30.432528+0000","last_clean":"2023-11-28T12:06:30.432528+0000","last_became_active":"2023-11-28T12:06:29.428388+0000","last_became_peered":"2023-11-28T12:06:29.428388+0000","last_unstale":"2023-11-28T12:06:30.432528+0000","last_undegraded":"2023-11-28T12:06:30.432528+0000","last_fullsized":"2023-11-28T12:06:30.432528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:13:08.504009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432068+0000","last_change":"2023-11-28T12:06:28.897386+0000","last_active":"2023-11-28T12:06:30.432068+0000","last_peered":"2023-11-28T12:06:30.432068+0000","last_clean":"2023-11-28T12:06:30.432068+0000","last_became_active":"2023-11-28T12:06:28.896863+0000","last_became_peered":"2023-11-28T12:06:28.896863+0000","last_unstale":"2023-11-28T12:06:30.432068+0000","last_undegraded":"2023-11-28T12:06:30.432068+0000","last_fullsized":"2023-11-28T12:06:30.432068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:10:07.458120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T12:06:29.408752+0000","last_change":"2023-11-28T12:06:23.961595+0000","last_active":"2023-11-28T12:06:29.408752+0000","last_peered":"2023-11-28T12:06:29.408752+0000","last_clean":"2023-11-28T12:06:29.408752+0000","last_became_active":"2023-11-28T12:06:23.961257+0000","last_became_peered":"2023-11-28T12:06:23.961257+0000","last_unstale":"2023-11-28T12:06:29.408752+0000","last_undegraded":"2023-11-28T12:06:29.408752+0000","last_fullsized":"2023-11-28T12:06:29.408752+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:30:40.200095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.430465+0000","last_change":"2023-11-28T12:06:29.425702+0000","last_active":"2023-11-28T12:06:30.430465+0000","last_peered":"2023-11-28T12:06:30.430465+0000","last_clean":"2023-11-28T12:06:30.430465+0000","last_became_active":"2023-11-28T12:06:29.425445+0000","last_became_peered":"2023-11-28T12:06:29.425445+0000","last_unstale":"2023-11-28T12:06:30.430465+0000","last_undegraded":"2023-11-28T12:06:30.430465+0000","last_fullsized":"2023-11-28T12:06:30.430465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:03:53.795177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T12:06:29.400425+0000","last_change":"2023-11-28T12:06:23.517505+0000","last_active":"2023-11-28T12:06:29.400425+0000","last_peered":"2023-11-28T12:06:29.400425+0000","last_clean":"2023-11-28T12:06:29.400425+0000","last_became_active":"2023-11-28T12:06:23.517151+0000","last_became_peered":"2023-11-28T12:06:23.517151+0000","last_unstale":"2023-11-28T12:06:29.400425+0000","last_undegraded":"2023-11-28T12:06:29.400425+0000","last_fullsized":"2023-11-28T12:06:29.400425+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:30:40.200095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:31.490278+0000","last_change":"2023-11-28T12:06:28.912292+0000","last_active":"2023-11-28T12:06:31.490278+0000","last_peered":"2023-11-28T12:06:31.490278+0000","last_clean":"2023-11-28T12:06:31.490278+0000","last_became_active":"2023-11-28T12:06:28.910834+0000","last_became_peered":"2023-11-28T12:06:28.910834+0000","last_unstale":"2023-11-28T12:06:31.490278+0000","last_undegraded":"2023-11-28T12:06:31.490278+0000","last_fullsized":"2023-11-28T12:06:31.490278+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:51:27.529794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431570+0000","last_change":"2023-11-28T12:06:29.420045+0000","last_active":"2023-11-28T12:06:30.431570+0000","last_peered":"2023-11-28T12:06:30.431570+0000","last_clean":"2023-11-28T12:06:30.431570+0000","last_became_active":"2023-11-28T12:06:29.419739+0000","last_became_peered":"2023-11-28T12:06:29.419739+0000","last_unstale":"2023-11-28T12:06:30.431570+0000","last_undegraded":"2023-11-28T12:06:30.431570+0000","last_fullsized":"2023-11-28T12:06:30.431570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:25:49.001168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T12:06:29.405908+0000","last_change":"2023-11-28T12:06:23.517967+0000","last_active":"2023-11-28T12:06:29.405908+0000","last_peered":"2023-11-28T12:06:29.405908+0000","last_clean":"2023-11-28T12:06:29.405908+0000","last_became_active":"2023-11-28T12:06:23.517495+0000","last_became_peered":"2023-11-28T12:06:23.517495+0000","last_unstale":"2023-11-28T12:06:29.405908+0000","last_undegraded":"2023-11-28T12:06:29.405908+0000","last_fullsized":"2023-11-28T12:06:29.405908+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:51:06.844441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T12:06:29.408596+0000","last_change":"2023-11-28T12:06:23.513472+0000","last_active":"2023-11-28T12:06:29.408596+0000","last_peered":"2023-11-28T12:06:29.408596+0000","last_clean":"2023-11-28T12:06:29.408596+0000","last_became_active":"2023-11-28T12:06:23.513150+0000","last_became_peered":"2023-11-28T12:06:23.513150+0000","last_unstale":"2023-11-28T12:06:29.408596+0000","last_undegraded":"2023-11-28T12:06:29.408596+0000","last_fullsized":"2023-11-28T12:06:29.408596+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:34:18.653049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.430898+0000","last_change":"2023-11-28T12:06:28.909662+0000","last_active":"2023-11-28T12:06:30.430898+0000","last_peered":"2023-11-28T12:06:30.430898+0000","last_clean":"2023-11-28T12:06:30.430898+0000","last_became_active":"2023-11-28T12:06:28.907056+0000","last_became_peered":"2023-11-28T12:06:28.907056+0000","last_unstale":"2023-11-28T12:06:30.430898+0000","last_undegraded":"2023-11-28T12:06:30.430898+0000","last_fullsized":"2023-11-28T12:06:30.430898+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:22:19.424800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432482+0000","last_change":"2023-11-28T12:06:29.420306+0000","last_active":"2023-11-28T12:06:30.432482+0000","last_peered":"2023-11-28T12:06:30.432482+0000","last_clean":"2023-11-28T12:06:30.432482+0000","last_became_active":"2023-11-28T12:06:29.419788+0000","last_became_peered":"2023-11-28T12:06:29.419788+0000","last_unstale":"2023-11-28T12:06:30.432482+0000","last_undegraded":"2023-11-28T12:06:30.432482+0000","last_fullsized":"2023-11-28T12:06:30.432482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:28:34.213514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T12:06:29.409054+0000","last_change":"2023-11-28T12:06:23.903708+0000","last_active":"2023-11-28T12:06:29.409054+0000","last_peered":"2023-11-28T12:06:29.409054+0000","last_clean":"2023-11-28T12:06:29.409054+0000","last_became_active":"2023-11-28T12:06:23.903399+0000","last_became_peered":"2023-11-28T12:06:23.903399+0000","last_unstale":"2023-11-28T12:06:29.409054+0000","last_undegraded":"2023-11-28T12:06:29.409054+0000","last_fullsized":"2023-11-28T12:06:29.409054+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:31:13.187145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.430703+0000","last_change":"2023-11-28T12:06:28.913668+0000","last_active":"2023-11-28T12:06:30.430703+0000","last_peered":"2023-11-28T12:06:30.430703+0000","last_clean":"2023-11-28T12:06:30.430703+0000","last_became_active":"2023-11-28T12:06:28.913342+0000","last_became_peered":"2023-11-28T12:06:28.913342+0000","last_unstale":"2023-11-28T12:06:30.430703+0000","last_undegraded":"2023-11-28T12:06:30.430703+0000","last_fullsized":"2023-11-28T12:06:30.430703+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:10:07.458120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431800+0000","last_change":"2023-11-28T12:06:29.422027+0000","last_active":"2023-11-28T12:06:30.431800+0000","last_peered":"2023-11-28T12:06:30.431800+0000","last_clean":"2023-11-28T12:06:30.431800+0000","last_became_active":"2023-11-28T12:06:29.421737+0000","last_became_peered":"2023-11-28T12:06:29.421737+0000","last_unstale":"2023-11-28T12:06:30.431800+0000","last_undegraded":"2023-11-28T12:06:30.431800+0000","last_fullsized":"2023-11-28T12:06:30.431800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:25:07.078893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T12:06:29.408153+0000","last_change":"2023-11-28T12:06:23.903662+0000","last_active":"2023-11-28T12:06:29.408153+0000","last_peered":"2023-11-28T12:06:29.408153+0000","last_clean":"2023-11-28T12:06:29.408153+0000","last_became_active":"2023-11-28T12:06:23.903354+0000","last_became_peered":"2023-11-28T12:06:23.903354+0000","last_unstale":"2023-11-28T12:06:29.408153+0000","last_undegraded":"2023-11-28T12:06:29.408153+0000","last_fullsized":"2023-11-28T12:06:29.408153+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:02:07.694087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.430927+0000","last_change":"2023-11-28T12:06:28.904988+0000","last_active":"2023-11-28T12:06:30.430927+0000","last_peered":"2023-11-28T12:06:30.430927+0000","last_clean":"2023-11-28T12:06:30.430927+0000","last_became_active":"2023-11-28T12:06:28.904389+0000","last_became_peered":"2023-11-28T12:06:28.904389+0000","last_unstale":"2023-11-28T12:06:30.430927+0000","last_undegraded":"2023-11-28T12:06:30.430927+0000","last_fullsized":"2023-11-28T12:06:30.430927+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:25:02.799298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.402642+0000","last_change":"2023-11-28T12:06:29.424397+0000","last_active":"2023-11-28T12:06:30.402642+0000","last_peered":"2023-11-28T12:06:30.402642+0000","last_clean":"2023-11-28T12:06:30.402642+0000","last_became_active":"2023-11-28T12:06:29.424122+0000","last_became_peered":"2023-11-28T12:06:29.424122+0000","last_unstale":"2023-11-28T12:06:30.402642+0000","last_undegraded":"2023-11-28T12:06:30.402642+0000","last_fullsized":"2023-11-28T12:06:30.402642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:39:12.434022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T12:06:29.415039+0000","last_change":"2023-11-28T12:06:23.903797+0000","last_active":"2023-11-28T12:06:29.415039+0000","last_peered":"2023-11-28T12:06:29.415039+0000","last_clean":"2023-11-28T12:06:29.415039+0000","last_became_active":"2023-11-28T12:06:23.903475+0000","last_became_peered":"2023-11-28T12:06:23.903475+0000","last_unstale":"2023-11-28T12:06:29.415039+0000","last_undegraded":"2023-11-28T12:06:29.415039+0000","last_fullsized":"2023-11-28T12:06:29.415039+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:51:06.844441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432343+0000","last_change":"2023-11-28T12:06:28.905900+0000","last_active":"2023-11-28T12:06:30.432343+0000","last_peered":"2023-11-28T12:06:30.432343+0000","last_clean":"2023-11-28T12:06:30.432343+0000","last_became_active":"2023-11-28T12:06:28.905583+0000","last_became_peered":"2023-11-28T12:06:28.905583+0000","last_unstale":"2023-11-28T12:06:30.432343+0000","last_undegraded":"2023-11-28T12:06:30.432343+0000","last_fullsized":"2023-11-28T12:06:30.432343+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:10:07.458120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432082+0000","last_change":"2023-11-28T12:06:29.412204+0000","last_active":"2023-11-28T12:06:30.432082+0000","last_peered":"2023-11-28T12:06:30.432082+0000","last_clean":"2023-11-28T12:06:30.432082+0000","last_became_active":"2023-11-28T12:06:29.411941+0000","last_became_peered":"2023-11-28T12:06:29.411941+0000","last_unstale":"2023-11-28T12:06:30.432082+0000","last_undegraded":"2023-11-28T12:06:30.432082+0000","last_fullsized":"2023-11-28T12:06:30.432082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:07:00.558286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T12:06:29.403178+0000","last_change":"2023-11-28T12:06:23.903983+0000","last_active":"2023-11-28T12:06:29.403178+0000","last_peered":"2023-11-28T12:06:29.403178+0000","last_clean":"2023-11-28T12:06:29.403178+0000","last_became_active":"2023-11-28T12:06:23.903511+0000","last_became_peered":"2023-11-28T12:06:23.903511+0000","last_unstale":"2023-11-28T12:06:29.403178+0000","last_undegraded":"2023-11-28T12:06:29.403178+0000","last_fullsized":"2023-11-28T12:06:29.403178+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:31:13.187145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432035+0000","last_change":"2023-11-28T12:06:28.914003+0000","last_active":"2023-11-28T12:06:30.432035+0000","last_peered":"2023-11-28T12:06:30.432035+0000","last_clean":"2023-11-28T12:06:30.432035+0000","last_became_active":"2023-11-28T12:06:28.913345+0000","last_became_peered":"2023-11-28T12:06:28.913345+0000","last_unstale":"2023-11-28T12:06:30.432035+0000","last_undegraded":"2023-11-28T12:06:30.432035+0000","last_fullsized":"2023-11-28T12:06:30.432035+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:51:27.529794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431036+0000","last_change":"2023-11-28T12:06:29.419498+0000","last_active":"2023-11-28T12:06:30.431036+0000","last_peered":"2023-11-28T12:06:30.431036+0000","last_clean":"2023-11-28T12:06:30.431036+0000","last_became_active":"2023-11-28T12:06:29.419162+0000","last_became_peered":"2023-11-28T12:06:29.419162+0000","last_unstale":"2023-11-28T12:06:30.431036+0000","last_undegraded":"2023-11-28T12:06:30.431036+0000","last_fullsized":"2023-11-28T12:06:30.431036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:31:18.258195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T12:06:29.405346+0000","last_change":"2023-11-28T12:06:23.517246+0000","last_active":"2023-11-28T12:06:29.405346+0000","last_peered":"2023-11-28T12:06:29.405346+0000","last_clean":"2023-11-28T12:06:29.405346+0000","last_became_active":"2023-11-28T12:06:23.516854+0000","last_became_peered":"2023-11-28T12:06:23.516854+0000","last_unstale":"2023-11-28T12:06:29.405346+0000","last_undegraded":"2023-11-28T12:06:29.405346+0000","last_fullsized":"2023-11-28T12:06:29.405346+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:51:06.844441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.402925+0000","last_change":"2023-11-28T12:06:28.899604+0000","last_active":"2023-11-28T12:06:30.402925+0000","last_peered":"2023-11-28T12:06:30.402925+0000","last_clean":"2023-11-28T12:06:30.402925+0000","last_became_active":"2023-11-28T12:06:28.899322+0000","last_became_peered":"2023-11-28T12:06:28.899322+0000","last_unstale":"2023-11-28T12:06:30.402925+0000","last_undegraded":"2023-11-28T12:06:30.402925+0000","last_fullsized":"2023-11-28T12:06:30.402925+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:05:22.551488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431859+0000","last_change":"2023-11-28T12:06:29.416051+0000","last_active":"2023-11-28T12:06:30.431859+0000","last_peered":"2023-11-28T12:06:30.431859+0000","last_clean":"2023-11-28T12:06:30.431859+0000","last_became_active":"2023-11-28T12:06:29.415796+0000","last_became_peered":"2023-11-28T12:06:29.415796+0000","last_unstale":"2023-11-28T12:06:30.431859+0000","last_undegraded":"2023-11-28T12:06:30.431859+0000","last_fullsized":"2023-11-28T12:06:30.431859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:14:19.511638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431127+0000","last_change":"2023-11-28T12:06:28.911467+0000","last_active":"2023-11-28T12:06:30.431127+0000","last_peered":"2023-11-28T12:06:30.431127+0000","last_clean":"2023-11-28T12:06:30.431127+0000","last_became_active":"2023-11-28T12:06:28.907578+0000","last_became_peered":"2023-11-28T12:06:28.907578+0000","last_unstale":"2023-11-28T12:06:30.431127+0000","last_undegraded":"2023-11-28T12:06:30.431127+0000","last_fullsized":"2023-11-28T12:06:30.431127+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:10:07.458120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.400161+0000","last_change":"2023-11-28T12:06:29.411427+0000","last_active":"2023-11-28T12:06:30.400161+0000","last_peered":"2023-11-28T12:06:30.400161+0000","last_clean":"2023-11-28T12:06:30.400161+0000","last_became_active":"2023-11-28T12:06:29.411146+0000","last_became_peered":"2023-11-28T12:06:29.411146+0000","last_unstale":"2023-11-28T12:06:30.400161+0000","last_undegraded":"2023-11-28T12:06:30.400161+0000","last_fullsized":"2023-11-28T12:06:30.400161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:25:03.806074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.401875+0000","last_change":"2023-11-28T12:06:28.907981+0000","last_active":"2023-11-28T12:06:30.401875+0000","last_peered":"2023-11-28T12:06:30.401875+0000","last_clean":"2023-11-28T12:06:30.401875+0000","last_became_active":"2023-11-28T12:06:28.906662+0000","last_became_peered":"2023-11-28T12:06:28.906662+0000","last_unstale":"2023-11-28T12:06:30.401875+0000","last_undegraded":"2023-11-28T12:06:30.401875+0000","last_fullsized":"2023-11-28T12:06:30.401875+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:57:01.417679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431947+0000","last_change":"2023-11-28T12:06:29.435464+0000","last_active":"2023-11-28T12:06:30.431947+0000","last_peered":"2023-11-28T12:06:30.431947+0000","last_clean":"2023-11-28T12:06:30.431947+0000","last_became_active":"2023-11-28T12:06:29.435154+0000","last_became_peered":"2023-11-28T12:06:29.435154+0000","last_unstale":"2023-11-28T12:06:30.431947+0000","last_undegraded":"2023-11-28T12:06:30.431947+0000","last_fullsized":"2023-11-28T12:06:30.431947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:18:07.794113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.402928+0000","last_change":"2023-11-28T12:06:28.910150+0000","last_active":"2023-11-28T12:06:30.402928+0000","last_peered":"2023-11-28T12:06:30.402928+0000","last_clean":"2023-11-28T12:06:30.402928+0000","last_became_active":"2023-11-28T12:06:28.909642+0000","last_became_peered":"2023-11-28T12:06:28.909642+0000","last_unstale":"2023-11-28T12:06:30.402928+0000","last_undegraded":"2023-11-28T12:06:30.402928+0000","last_fullsized":"2023-11-28T12:06:30.402928+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:43:34.311973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431920+0000","last_change":"2023-11-28T12:06:29.435703+0000","last_active":"2023-11-28T12:06:30.431920+0000","last_peered":"2023-11-28T12:06:30.431920+0000","last_clean":"2023-11-28T12:06:30.431920+0000","last_became_active":"2023-11-28T12:06:29.435414+0000","last_became_peered":"2023-11-28T12:06:29.435414+0000","last_unstale":"2023-11-28T12:06:30.431920+0000","last_undegraded":"2023-11-28T12:06:30.431920+0000","last_fullsized":"2023-11-28T12:06:30.431920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:20:52.473176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431714+0000","last_change":"2023-11-28T12:06:28.896545+0000","last_active":"2023-11-28T12:06:30.431714+0000","last_peered":"2023-11-28T12:06:30.431714+0000","last_clean":"2023-11-28T12:06:30.431714+0000","last_became_active":"2023-11-28T12:06:28.896194+0000","last_became_peered":"2023-11-28T12:06:28.896194+0000","last_unstale":"2023-11-28T12:06:30.431714+0000","last_undegraded":"2023-11-28T12:06:30.431714+0000","last_fullsized":"2023-11-28T12:06:30.431714+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:51:27.529794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.430903+0000","last_change":"2023-11-28T12:06:29.415972+0000","last_active":"2023-11-28T12:06:30.430903+0000","last_peered":"2023-11-28T12:06:30.430903+0000","last_clean":"2023-11-28T12:06:30.430903+0000","last_became_active":"2023-11-28T12:06:29.415403+0000","last_became_peered":"2023-11-28T12:06:29.415403+0000","last_unstale":"2023-11-28T12:06:30.430903+0000","last_undegraded":"2023-11-28T12:06:30.430903+0000","last_fullsized":"2023-11-28T12:06:30.430903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:25:49.001168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.432765+0000","last_change":"2023-11-28T12:06:28.904656+0000","last_active":"2023-11-28T12:06:30.432765+0000","last_peered":"2023-11-28T12:06:30.432765+0000","last_clean":"2023-11-28T12:06:30.432765+0000","last_became_active":"2023-11-28T12:06:28.903576+0000","last_became_peered":"2023-11-28T12:06:28.903576+0000","last_unstale":"2023-11-28T12:06:30.432765+0000","last_undegraded":"2023-11-28T12:06:30.432765+0000","last_fullsized":"2023-11-28T12:06:30.432765+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:27.868274+0000","last_clean_scrub_stamp":"2023-11-28T12:06:27.868274+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:05:22.551488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431143+0000","last_change":"2023-11-28T12:06:29.433471+0000","last_active":"2023-11-28T12:06:30.431143+0000","last_peered":"2023-11-28T12:06:30.431143+0000","last_clean":"2023-11-28T12:06:30.431143+0000","last_became_active":"2023-11-28T12:06:29.433175+0000","last_became_peered":"2023-11-28T12:06:29.433175+0000","last_unstale":"2023-11-28T12:06:30.431143+0000","last_undegraded":"2023-11-28T12:06:30.431143+0000","last_fullsized":"2023-11-28T12:06:30.431143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:31:18.258195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.402168+0000","last_change":"2023-11-28T12:06:29.409984+0000","last_active":"2023-11-28T12:06:30.402168+0000","last_peered":"2023-11-28T12:06:30.402168+0000","last_clean":"2023-11-28T12:06:30.402168+0000","last_became_active":"2023-11-28T12:06:29.409708+0000","last_became_peered":"2023-11-28T12:06:29.409708+0000","last_unstale":"2023-11-28T12:06:30.402168+0000","last_undegraded":"2023-11-28T12:06:30.402168+0000","last_fullsized":"2023-11-28T12:06:30.402168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:10:24.380829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.430715+0000","last_change":"2023-11-28T12:06:29.412286+0000","last_active":"2023-11-28T12:06:30.430715+0000","last_peered":"2023-11-28T12:06:30.430715+0000","last_clean":"2023-11-28T12:06:30.430715+0000","last_became_active":"2023-11-28T12:06:29.412022+0000","last_became_peered":"2023-11-28T12:06:29.412022+0000","last_unstale":"2023-11-28T12:06:30.430715+0000","last_undegraded":"2023-11-28T12:06:30.430715+0000","last_fullsized":"2023-11-28T12:06:30.430715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:20:52.473176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431676+0000","last_change":"2023-11-28T12:06:29.424994+0000","last_active":"2023-11-28T12:06:30.431676+0000","last_peered":"2023-11-28T12:06:30.431676+0000","last_clean":"2023-11-28T12:06:30.431676+0000","last_became_active":"2023-11-28T12:06:29.424738+0000","last_became_peered":"2023-11-28T12:06:29.424738+0000","last_unstale":"2023-11-28T12:06:30.431676+0000","last_undegraded":"2023-11-28T12:06:30.431676+0000","last_fullsized":"2023-11-28T12:06:30.431676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:08:40.987428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431286+0000","last_change":"2023-11-28T12:06:29.420914+0000","last_active":"2023-11-28T12:06:30.431286+0000","last_peered":"2023-11-28T12:06:30.431286+0000","last_clean":"2023-11-28T12:06:30.431286+0000","last_became_active":"2023-11-28T12:06:29.420396+0000","last_became_peered":"2023-11-28T12:06:29.420396+0000","last_unstale":"2023-11-28T12:06:30.431286+0000","last_undegraded":"2023-11-28T12:06:30.431286+0000","last_fullsized":"2023-11-28T12:06:30.431286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:28:44.482157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T12:06:30.431992+0000","last_change":"2023-11-28T12:06:29.418068+0000","last_active":"2023-11-28T12:06:30.431992+0000","last_peered":"2023-11-28T12:06:30.431992+0000","last_clean":"2023-11-28T12:06:30.431992+0000","last_became_active":"2023-11-28T12:06:29.417569+0000","last_became_peered":"2023-11-28T12:06:29.417569+0000","last_unstale":"2023-11-28T12:06:30.431992+0000","last_undegraded":"2023-11-28T12:06:30.431992+0000","last_fullsized":"2023-11-28T12:06:30.431992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:28.875051+0000","last_clean_scrub_stamp":"2023-11-28T12:06:28.875051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:39:12.434022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9072,"kb_used_data":808,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362768,"statfs":{"total":96636764160,"available":96627474432,"internally_reserved":0,"allocated":827392,"data_stored":666560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.819}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7888,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":7680,"kb_avail":94363952,"statfs":{"total":96636764160,"available":96628686848,"internally_reserved":0,"allocated":204800,"data_stored":74428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7864320},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13140,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":12352,"kb_avail":94358700,"statfs":{"total":96636764160,"available":96623308800,"internally_reserved":0,"allocated":798720,"data_stored":664796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12648448},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12112,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":11904,"kb_avail":94359728,"statfs":{"total":96636764160,"available":96624361472,"internally_reserved":0,"allocated":204800,"data_stored":73633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12189696},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11984,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":11776,"kb_avail":94359856,"statfs":{"total":96636764160,"available":96624492544,"internally_reserved":0,"allocated":204800,"data_stored":74428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12058624},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12112,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":11904,"kb_avail":94359728,"statfs":{"total":96636764160,"available":96624361472,"internally_reserved":0,"allocated":204800,"data_stored":73157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12189696},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8036,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363804,"statfs":{"total":96636764160,"available":96628535296,"internally_reserved":0,"allocated":225280,"data_stored":76032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.018}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.999}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7960,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363880,"statfs":{"total":96636764160,"available":96628613120,"internally_reserved":0,"allocated":212992,"data_stored":75064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T12:06:40.654 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-28T12:06:40.654 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-11-28T12:06:40.654 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-11-28T12:06:40.654 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T12:06:40.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.890+0000 7f5d735ff700 1 Processor -- start 2023-11-28T12:06:40.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.891+0000 7f5d735ff700 1 -- start start 2023-11-28T12:06:40.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.892+0000 7f5d735ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5d6c0d1330 0x7f5d6c0b06c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:40.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.892+0000 7f5d735ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f5d6c0b20b0 0x7f5d6c0b0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:40.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.892+0000 7f5d735ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d6c0b0230 con 0x7f5d6c0d01b0 2023-11-28T12:06:40.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.892+0000 7f5d735ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d6c15cec0 con 0x7f5d6c0d1330 2023-11-28T12:06:40.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.892+0000 7f5d735ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d6c0b4570 con 0x7f5d6c0b20b0 2023-11-28T12:06:40.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.892+0000 7f5d70b9a700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5d6c0d1330 0x7f5d6c0b06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:40.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.892+0000 7f5d71b9c700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f5d6c0b20b0 0x7f5d6c0b0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:40.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.892+0000 7f5d71b9c700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f5d6c0b20b0 0x7f5d6c0b0c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.45:44870/0 (socket says 172.21.15.45:44870) 2023-11-28T12:06:40.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.892+0000 7f5d71b9c700 1 -- 172.21.15.45:0/1213228531 learned_addr learned my addr 172.21.15.45:0/1213228531 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:40.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.892+0000 7f5d70b9a700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5d6c0d1330 0x7f5d6c0b06c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36208/0 (socket says 172.21.15.45:36208) 2023-11-28T12:06:40.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.893+0000 7f5d70b9a700 1 -- 172.21.15.45:0/1213228531 >> v2:172.21.15.152:3300/0 conn(0x7f5d6c0b20b0 msgr2=0x7f5d6c0b0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:06:40.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.893+0000 7f5d70b9a700 1 --2- 172.21.15.45:0/1213228531 >> v2:172.21.15.152:3300/0 conn(0x7f5d6c0b20b0 0x7f5d6c0b0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:40.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.893+0000 7f5d70b9a700 1 -- 172.21.15.45:0/1213228531 >> v1:172.21.15.152:6789/0 conn(0x7f5d6c0d01b0 legacy=0x7f5d6c0d0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:40.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.893+0000 7f5d70b9a700 1 -- 172.21.15.45:0/1213228531 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d6c0b4850 con 0x7f5d6c0d1330 2023-11-28T12:06:40.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.893+0000 7f5d71b9c700 1 --2- 172.21.15.45:0/1213228531 >> v2:172.21.15.152:3300/0 conn(0x7f5d6c0b20b0 0x7f5d6c0b0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:06:40.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.893+0000 7f5d70b9a700 1 --2- 172.21.15.45:0/1213228531 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d6c0d1330 0x7f5d6c0b06c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c066e80 tx=0x7f5d5c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ac01e4e0b0c103b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:40.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.893+0000 7f5d63fff700 1 -- 172.21.15.45:0/1213228531 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d5c011830 con 0x7f5d6c0d1330 2023-11-28T12:06:40.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.893+0000 7f5d63fff700 1 -- 172.21.15.45:0/1213228531 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d5c011990 con 0x7f5d6c0d1330 2023-11-28T12:06:40.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.893+0000 7f5d63fff700 1 -- 172.21.15.45:0/1213228531 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d5c011d20 con 0x7f5d6c0d1330 2023-11-28T12:06:40.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.894+0000 7f5d735ff700 1 -- 172.21.15.45:0/1213228531 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d6c0d1330 msgr2=0x7f5d6c0b06c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:40.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.894+0000 7f5d735ff700 1 --2- 172.21.15.45:0/1213228531 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d6c0d1330 0x7f5d6c0b06c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c066e80 tx=0x7f5d5c009b20 comp rx=0 tx=0).stop 2023-11-28T12:06:40.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.894+0000 7f5d735ff700 1 -- 172.21.15.45:0/1213228531 shutdown_connections 2023-11-28T12:06:40.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.894+0000 7f5d735ff700 1 --2- 172.21.15.45:0/1213228531 >> v2:172.21.15.152:3300/0 conn(0x7f5d6c0b20b0 0x7f5d6c0b0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:40.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.894+0000 7f5d735ff700 1 --2- 172.21.15.45:0/1213228531 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d6c0d1330 0x7f5d6c0b06c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:40.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.894+0000 7f5d735ff700 1 -- 172.21.15.45:0/1213228531 >> 172.21.15.45:0/1213228531 conn(0x7f5d6c09c3f0 msgr2=0x7f5d6c0d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:40.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.894+0000 7f5d735ff700 1 -- 172.21.15.45:0/1213228531 shutdown_connections 2023-11-28T12:06:40.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.894+0000 7f5d735ff700 1 -- 172.21.15.45:0/1213228531 wait complete. 2023-11-28T12:06:40.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.896+0000 7f5d735ff700 1 Processor -- start 2023-11-28T12:06:40.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.896+0000 7f5d735ff700 1 -- start start 2023-11-28T12:06:40.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.897+0000 7f5d735ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d6c0b20b0 0x7f5d6c1e7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:40.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.897+0000 7f5d735ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5d6c0d01b0 0x7f5d6c1e8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:40.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.897+0000 7f5d735ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5d6c0d1330 0x7f5d6c15a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:40.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.897+0000 7f5d735ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d6c09d120 con 0x7f5d6c0b20b0 2023-11-28T12:06:40.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.897+0000 7f5d735ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d6c1e6380 con 0x7f5d6c0d01b0 2023-11-28T12:06:40.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.897+0000 7f5d735ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d6c1e6660 con 0x7f5d6c0d1330 2023-11-28T12:06:40.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.897+0000 7f5d7139b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d6c0b20b0 0x7f5d6c1e7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:40.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.897+0000 7f5d7139b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d6c0b20b0 0x7f5d6c1e7420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36216/0 (socket says 172.21.15.45:36216) 2023-11-28T12:06:40.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.897+0000 7f5d7139b700 1 -- 172.21.15.45:0/1087504278 learned_addr learned my addr 172.21.15.45:0/1087504278 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:40.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.897+0000 7f5d70b9a700 1 --2- 172.21.15.45:0/1087504278 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5d6c0d01b0 0x7f5d6c1e8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:40.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.897+0000 7f5d71b9c700 1 --2- 172.21.15.45:0/1087504278 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5d6c0d1330 0x7f5d6c15a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:40.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.897+0000 7f5d7139b700 1 -- 172.21.15.45:0/1087504278 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5d6c0d1330 msgr2=0x7f5d6c15a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:40.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.897+0000 7f5d7139b700 1 --2- 172.21.15.45:0/1087504278 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5d6c0d1330 0x7f5d6c15a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:40.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.897+0000 7f5d7139b700 1 -- 172.21.15.45:0/1087504278 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5d6c0d01b0 msgr2=0x7f5d6c1e8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:40.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.897+0000 7f5d7139b700 1 --2- 172.21.15.45:0/1087504278 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5d6c0d01b0 0x7f5d6c1e8680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:40.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.897+0000 7f5d7139b700 1 -- 172.21.15.45:0/1087504278 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d64009b30 con 0x7f5d6c0b20b0 2023-11-28T12:06:40.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.897+0000 7f5d7139b700 1 --2- 172.21.15.45:0/1087504278 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d6c0b20b0 0x7f5d6c1e7420 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5d6800c4e0 tx=0x7f5d6800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:40.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.898+0000 7f5d61ffb700 1 -- 172.21.15.45:0/1087504278 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d680052d0 con 0x7f5d6c0b20b0 2023-11-28T12:06:40.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.898+0000 7f5d61ffb700 1 -- 172.21.15.45:0/1087504278 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d68005430 con 0x7f5d6c0b20b0 2023-11-28T12:06:40.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.898+0000 7f5d61ffb700 1 -- 172.21.15.45:0/1087504278 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d680038c0 con 0x7f5d6c0b20b0 2023-11-28T12:06:40.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.898+0000 7f5d735ff700 1 -- 172.21.15.45:0/1087504278 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d5c0094a0 con 0x7f5d6c0b20b0 2023-11-28T12:06:40.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.898+0000 7f5d735ff700 1 -- 172.21.15.45:0/1087504278 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d6c0afec0 con 0x7f5d6c0b20b0 2023-11-28T12:06:40.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.899+0000 7f5d735ff700 1 -- 172.21.15.45:0/1087504278 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d6c0afbe0 con 0x7f5d6c0b20b0 2023-11-28T12:06:40.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.900+0000 7f5d61ffb700 1 -- 172.21.15.45:0/1087504278 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f5d68019030 con 0x7f5d6c0b20b0 2023-11-28T12:06:40.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.901+0000 7f5d61ffb700 1 --2- 172.21.15.45:0/1087504278 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5d500682f0 0x7f5d5006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:40.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.901+0000 7f5d61ffb700 1 -- 172.21.15.45:0/1087504278 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5d68085130 con 0x7f5d6c0b20b0 2023-11-28T12:06:40.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.902+0000 7f5d70b9a700 1 --2- 172.21.15.45:0/1087504278 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5d500682f0 0x7f5d5006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:40.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.902+0000 7f5d70b9a700 1 --2- 172.21.15.45:0/1087504278 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5d500682f0 0x7f5d5006a7a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c0d1720 tx=0x7f5d5c01c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:40.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:40.905+0000 7f5d61ffb700 1 -- 172.21.15.45:0/1087504278 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f5d680518a0 con 0x7f5d6c0b20b0 2023-11-28T12:06:41.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.153+0000 7f5d735ff700 1 -- 172.21.15.45:0/1087504278 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f5d6c0b2600 con 0x7f5d6c0b20b0 2023-11-28T12:06:41.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.153+0000 7f5d61ffb700 1 -- 172.21.15.45:0/1087504278 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f5d68054ec0 con 0x7f5d6c0b20b0 2023-11-28T12:06:41.154 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:06:41.155 INFO:teuthology.orchestra.run.smithi045.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-11-28T12:06:41.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.156+0000 7f5d735ff700 1 -- 172.21.15.45:0/1087504278 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5d500682f0 msgr2=0x7f5d5006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:41.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.156+0000 7f5d735ff700 1 --2- 172.21.15.45:0/1087504278 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5d500682f0 0x7f5d5006a7a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c0d1720 tx=0x7f5d5c01c040 comp rx=0 tx=0).stop 2023-11-28T12:06:41.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.156+0000 7f5d735ff700 1 -- 172.21.15.45:0/1087504278 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d6c0b20b0 msgr2=0x7f5d6c1e7420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:41.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.156+0000 7f5d735ff700 1 --2- 172.21.15.45:0/1087504278 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d6c0b20b0 0x7f5d6c1e7420 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5d6800c4e0 tx=0x7f5d6800c8a0 comp rx=0 tx=0).stop 2023-11-28T12:06:41.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.156+0000 7f5d735ff700 1 -- 172.21.15.45:0/1087504278 shutdown_connections 2023-11-28T12:06:41.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.156+0000 7f5d735ff700 1 --2- 172.21.15.45:0/1087504278 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5d500682f0 0x7f5d5006a7a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:41.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.156+0000 7f5d735ff700 1 --2- 172.21.15.45:0/1087504278 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5d6c0d1330 0x7f5d6c15a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:41.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.156+0000 7f5d735ff700 1 --2- 172.21.15.45:0/1087504278 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d6c0b20b0 0x7f5d6c1e7420 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:41.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.156+0000 7f5d735ff700 1 --2- 172.21.15.45:0/1087504278 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5d6c0d01b0 0x7f5d6c1e8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:41.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.156+0000 7f5d735ff700 1 -- 172.21.15.45:0/1087504278 >> 172.21.15.45:0/1087504278 conn(0x7f5d6c09c3f0 msgr2=0x7f5d6c06b6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:41.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.156+0000 7f5d735ff700 1 -- 172.21.15.45:0/1087504278 shutdown_connections 2023-11-28T12:06:41.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.156+0000 7f5d735ff700 1 -- 172.21.15.45:0/1087504278 wait complete. 2023-11-28T12:06:41.174 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-11-28T12:06:41.175 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T12:06:41.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.376+0000 7f3b581ff700 1 Processor -- start 2023-11-28T12:06:41.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.377+0000 7f3b581ff700 1 -- start start 2023-11-28T12:06:41.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.378+0000 7f3b581ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3b5015c9b0 0x7f3b500b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:41.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.378+0000 7f3b581ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f3b50161340 0x7f3b500d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:41.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.378+0000 7f3b581ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b500d1950 con 0x7f3b500d2320 2023-11-28T12:06:41.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.378+0000 7f3b581ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b500b5800 con 0x7f3b5015c9b0 2023-11-28T12:06:41.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.378+0000 7f3b581ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b500b5520 con 0x7f3b50161340 2023-11-28T12:06:41.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.378+0000 7f3b55f9b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3b5015c9b0 0x7f3b500b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:41.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.378+0000 7f3b5679c700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f3b500d2320 0x7f3b500cd7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:32854/0 (socket says 172.21.15.45:32854) 2023-11-28T12:06:41.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.378+0000 7f3b5679c700 1 -- 172.21.15.45:0/2738352955 learned_addr learned my addr 172.21.15.45:0/2738352955 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:06:41.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.378+0000 7f3b5579a700 1 --2- 172.21.15.45:0/2738352955 >> v2:172.21.15.152:3300/0 conn(0x7f3b50161340 0x7f3b500d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:41.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.379+0000 7f3b55f9b700 1 -- 172.21.15.45:0/2738352955 >> v2:172.21.15.152:3300/0 conn(0x7f3b50161340 msgr2=0x7f3b500d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:06:41.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.379+0000 7f3b55f9b700 1 --2- 172.21.15.45:0/2738352955 >> v2:172.21.15.152:3300/0 conn(0x7f3b50161340 0x7f3b500d1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:41.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.379+0000 7f3b55f9b700 1 -- 172.21.15.45:0/2738352955 >> v1:172.21.15.45:6789/0 conn(0x7f3b500d2320 legacy=0x7f3b500cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:41.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.379+0000 7f3b55f9b700 1 -- 172.21.15.45:0/2738352955 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b500d1300 con 0x7f3b5015c9b0 2023-11-28T12:06:41.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.379+0000 7f3b54f99700 1 -- 172.21.15.45:0/2738352955 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1299199510 0 0) 0x7f3b500d1950 con 0x7f3b500d2320 2023-11-28T12:06:41.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.379+0000 7f3b5579a700 1 --2- 172.21.15.45:0/2738352955 >> v2:172.21.15.152:3300/0 conn(0x7f3b50161340 0x7f3b500d1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:06:41.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.379+0000 7f3b55f9b700 1 --2- 172.21.15.45:0/2738352955 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b5015c9b0 0x7f3b500b4bf0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3b500685c0 tx=0x7f3b4c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a571f79524ab2b4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:41.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.379+0000 7f3b54f99700 1 -- 172.21.15.45:0/2738352955 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c011830 con 0x7f3b5015c9b0 2023-11-28T12:06:41.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.379+0000 7f3b54f99700 1 -- 172.21.15.45:0/2738352955 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b4c011990 con 0x7f3b5015c9b0 2023-11-28T12:06:41.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.379+0000 7f3b54f99700 1 -- 172.21.15.45:0/2738352955 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c011d20 con 0x7f3b5015c9b0 2023-11-28T12:06:41.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.380+0000 7f3b581ff700 1 -- 172.21.15.45:0/2738352955 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b5015c9b0 msgr2=0x7f3b500b4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:41.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.380+0000 7f3b581ff700 1 --2- 172.21.15.45:0/2738352955 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b5015c9b0 0x7f3b500b4bf0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3b500685c0 tx=0x7f3b4c009b20 comp rx=0 tx=0).stop 2023-11-28T12:06:41.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.380+0000 7f3b581ff700 1 -- 172.21.15.45:0/2738352955 shutdown_connections 2023-11-28T12:06:41.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.380+0000 7f3b581ff700 1 --2- 172.21.15.45:0/2738352955 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b5015c9b0 0x7f3b500b4bf0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:41.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.380+0000 7f3b581ff700 1 --2- 172.21.15.45:0/2738352955 >> v2:172.21.15.152:3300/0 conn(0x7f3b50161340 0x7f3b500d1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:41.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.380+0000 7f3b581ff700 1 -- 172.21.15.45:0/2738352955 >> 172.21.15.45:0/2738352955 conn(0x7f3b50072600 msgr2=0x7f3b500cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:41.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.380+0000 7f3b581ff700 1 -- 172.21.15.45:0/2738352955 shutdown_connections 2023-11-28T12:06:41.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.380+0000 7f3b581ff700 1 -- 172.21.15.45:0/2738352955 wait complete. 2023-11-28T12:06:41.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.382+0000 7f3b581ff700 1 Processor -- start 2023-11-28T12:06:41.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.382+0000 7f3b581ff700 1 -- start start 2023-11-28T12:06:41.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.384+0000 7f3b581ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b500d2320 0x7f3b50150100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:41.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.384+0000 7f3b581ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b5015c9b0 0x7f3b5015f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:41.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.384+0000 7f3b581ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3b50161340 0x7f3b5015f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:41.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.384+0000 7f3b581ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b50154a80 con 0x7f3b5015c9b0 2023-11-28T12:06:41.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.384+0000 7f3b581ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b50153f00 con 0x7f3b500d2320 2023-11-28T12:06:41.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.384+0000 7f3b581ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b501541e0 con 0x7f3b50161340 2023-11-28T12:06:41.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.384+0000 7f3b5579a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b5015c9b0 0x7f3b5015f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:41.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.384+0000 7f3b5579a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b5015c9b0 0x7f3b5015f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36228/0 (socket says 172.21.15.45:36228) 2023-11-28T12:06:41.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.384+0000 7f3b5579a700 1 -- 172.21.15.45:0/3247889693 learned_addr learned my addr 172.21.15.45:0/3247889693 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:41.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.384+0000 7f3b55f9b700 1 --2- 172.21.15.45:0/3247889693 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b500d2320 0x7f3b50150100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:41.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.384+0000 7f3b5679c700 1 --2- 172.21.15.45:0/3247889693 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3b50161340 0x7f3b5015f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:41.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.384+0000 7f3b5579a700 1 -- 172.21.15.45:0/3247889693 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3b50161340 msgr2=0x7f3b5015f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:41.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.384+0000 7f3b5579a700 1 --2- 172.21.15.45:0/3247889693 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3b50161340 0x7f3b5015f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:41.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.384+0000 7f3b5579a700 1 -- 172.21.15.45:0/3247889693 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b500d2320 msgr2=0x7f3b50150100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:41.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.384+0000 7f3b5579a700 1 --2- 172.21.15.45:0/3247889693 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b500d2320 0x7f3b50150100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:41.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.384+0000 7f3b5579a700 1 -- 172.21.15.45:0/3247889693 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b4c0094a0 con 0x7f3b5015c9b0 2023-11-28T12:06:41.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.385+0000 7f3b5579a700 1 --2- 172.21.15.45:0/3247889693 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b5015c9b0 0x7f3b5015f100 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3b4000c750 tx=0x7f3b4000ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:41.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.385+0000 7f3b467fc700 1 -- 172.21.15.45:0/3247889693 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b40011800 con 0x7f3b5015c9b0 2023-11-28T12:06:41.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.385+0000 7f3b467fc700 1 -- 172.21.15.45:0/3247889693 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b40011960 con 0x7f3b5015c9b0 2023-11-28T12:06:41.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.385+0000 7f3b581ff700 1 -- 172.21.15.45:0/3247889693 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b500b5130 con 0x7f3b5015c9b0 2023-11-28T12:06:41.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.385+0000 7f3b467fc700 1 -- 172.21.15.45:0/3247889693 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b40011cd0 con 0x7f3b5015c9b0 2023-11-28T12:06:41.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.385+0000 7f3b581ff700 1 -- 172.21.15.45:0/3247889693 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b500d15e0 con 0x7f3b5015c9b0 2023-11-28T12:06:41.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.386+0000 7f3b581ff700 1 -- 172.21.15.45:0/3247889693 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b500b52c0 con 0x7f3b5015c9b0 2023-11-28T12:06:41.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.387+0000 7f3b467fc700 1 -- 172.21.15.45:0/3247889693 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f3b40020070 con 0x7f3b5015c9b0 2023-11-28T12:06:41.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.388+0000 7f3b467fc700 1 --2- 172.21.15.45:0/3247889693 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f3b340682f0 0x7f3b3406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:41.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.388+0000 7f3b467fc700 1 -- 172.21.15.45:0/3247889693 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3b40085a60 con 0x7f3b5015c9b0 2023-11-28T12:06:41.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.388+0000 7f3b55f9b700 1 --2- 172.21.15.45:0/3247889693 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f3b340682f0 0x7f3b3406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:41.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.389+0000 7f3b55f9b700 1 --2- 172.21.15.45:0/3247889693 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f3b340682f0 0x7f3b3406a7a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c0090b0 tx=0x7f3b4c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:41.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.392+0000 7f3b467fc700 1 -- 172.21.15.45:0/3247889693 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f3b400521d0 con 0x7f3b5015c9b0 2023-11-28T12:06:41.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.599+0000 7f3b581ff700 1 -- 172.21.15.45:0/3247889693 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3b500745c0 con 0x7f3b5015c9b0 2023-11-28T12:06:41.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.600+0000 7f3b467fc700 1 -- 172.21.15.45:0/3247889693 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+17849 (secure 0 0 0) 0x7f3b400557f0 con 0x7f3b5015c9b0 2023-11-28T12:06:41.601 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:06:41.601 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":20,"fsid":"bd7c37f1-f7c6-4778-b845-52cf2aa6e366","created":"2023-11-28T12:06:09.045075+0000","modified":"2023-11-28T12:06:30.396046+0000","last_up_change":"2023-11-28T12:06:21.282227+0000","last_in_change":"2023-11-28T12:06:12.560924+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T12:06:21.807108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T12:06:22.491009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T12:06:27.684157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T12:06:28.384679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d0cdd8a-87fd-4f2c-91bd-47bdfa661905","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":115843},{"type":"v1","addr":"172.21.15.45:6808","nonce":115843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":115843},{"type":"v1","addr":"172.21.15.45:6811","nonce":115843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":115843},{"type":"v1","addr":"172.21.15.45:6815","nonce":115843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":115843},{"type":"v1","addr":"172.21.15.45:6813","nonce":115843}]},"public_addr":"172.21.15.45:6808/115843","cluster_addr":"172.21.15.45:6811/115843","heartbeat_back_addr":"172.21.15.45:6815/115843","heartbeat_front_addr":"172.21.15.45:6813/115843","state":["exists","up"]},{"osd":1,"uuid":"c5de4ebd-9ec5-40b3-9caa-9b706fab4c76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":115842},{"type":"v1","addr":"172.21.15.45:6801","nonce":115842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":115842},{"type":"v1","addr":"172.21.15.45:6803","nonce":115842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6807","nonce":115842},{"type":"v1","addr":"172.21.15.45:6809","nonce":115842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":115842},{"type":"v1","addr":"172.21.15.45:6805","nonce":115842}]},"public_addr":"172.21.15.45:6801/115842","cluster_addr":"172.21.15.45:6803/115842","heartbeat_back_addr":"172.21.15.45:6809/115842","heartbeat_front_addr":"172.21.15.45:6805/115842","state":["exists","up"]},{"osd":2,"uuid":"9f4b36b2-65d2-40e7-9fe6-a2991afa71c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":115850},{"type":"v1","addr":"172.21.15.45:6819","nonce":115850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":115850},{"type":"v1","addr":"172.21.15.45:6823","nonce":115850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":115850},{"type":"v1","addr":"172.21.15.45:6831","nonce":115850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":115850},{"type":"v1","addr":"172.21.15.45:6828","nonce":115850}]},"public_addr":"172.21.15.45:6819/115850","cluster_addr":"172.21.15.45:6823/115850","heartbeat_back_addr":"172.21.15.45:6831/115850","heartbeat_front_addr":"172.21.15.45:6828/115850","state":["exists","up"]},{"osd":3,"uuid":"6fe7ef05-4e0d-426c-bf94-44b51d4d550b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":115848},{"type":"v1","addr":"172.21.15.45:6818","nonce":115848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":115848},{"type":"v1","addr":"172.21.15.45:6822","nonce":115848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6827","nonce":115848},{"type":"v1","addr":"172.21.15.45:6829","nonce":115848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":115848},{"type":"v1","addr":"172.21.15.45:6825","nonce":115848}]},"public_addr":"172.21.15.45:6818/115848","cluster_addr":"172.21.15.45:6822/115848","heartbeat_back_addr":"172.21.15.45:6829/115848","heartbeat_front_addr":"172.21.15.45:6825/115848","state":["exists","up"]},{"osd":4,"uuid":"fa403c08-d8a1-4a3a-8384-cb465c1a654c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":116092},{"type":"v1","addr":"172.21.15.152:6801","nonce":116092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":116092},{"type":"v1","addr":"172.21.15.152:6803","nonce":116092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":116092},{"type":"v1","addr":"172.21.15.152:6807","nonce":116092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":116092},{"type":"v1","addr":"172.21.15.152:6805","nonce":116092}]},"public_addr":"172.21.15.152:6801/116092","cluster_addr":"172.21.15.152:6803/116092","heartbeat_back_addr":"172.21.15.152:6807/116092","heartbeat_front_addr":"172.21.15.152:6805/116092","state":["exists","up"]},{"osd":5,"uuid":"399fc450-39fa-43a6-bf80-0b8bcb41bd95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6815","nonce":116093},{"type":"v1","addr":"172.21.15.152:6817","nonce":116093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":116093},{"type":"v1","addr":"172.21.15.152:6819","nonce":116093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":116093},{"type":"v1","addr":"172.21.15.152:6823","nonce":116093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":116093},{"type":"v1","addr":"172.21.15.152:6821","nonce":116093}]},"public_addr":"172.21.15.152:6817/116093","cluster_addr":"172.21.15.152:6819/116093","heartbeat_back_addr":"172.21.15.152:6823/116093","heartbeat_front_addr":"172.21.15.152:6821/116093","state":["exists","up"]},{"osd":6,"uuid":"e59a4017-2d23-4627-836b-e25b2d3ddaaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":116094},{"type":"v1","addr":"172.21.15.152:6809","nonce":116094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":116094},{"type":"v1","addr":"172.21.15.152:6811","nonce":116094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":116094},{"type":"v1","addr":"172.21.15.152:6816","nonce":116094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":116094},{"type":"v1","addr":"172.21.15.152:6813","nonce":116094}]},"public_addr":"172.21.15.152:6809/116094","cluster_addr":"172.21.15.152:6811/116094","heartbeat_back_addr":"172.21.15.152:6816/116094","heartbeat_front_addr":"172.21.15.152:6813/116094","state":["exists","up"]},{"osd":7,"uuid":"8d7f9d4b-bf08-4670-8591-388c0f012a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":116097},{"type":"v1","addr":"172.21.15.152:6825","nonce":116097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":116097},{"type":"v1","addr":"172.21.15.152:6827","nonce":116097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":116097},{"type":"v1","addr":"172.21.15.152:6831","nonce":116097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":116097},{"type":"v1","addr":"172.21.15.152:6829","nonce":116097}]},"public_addr":"172.21.15.152:6825/116097","cluster_addr":"172.21.15.152:6827/116097","heartbeat_back_addr":"172.21.15.152:6831/116097","heartbeat_front_addr":"172.21.15.152:6829/116097","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.937710+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.865423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.159434+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.913090+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.131647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.966255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.972583+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.177209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T12:06:41.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.603+0000 7f3b581ff700 1 -- 172.21.15.45:0/3247889693 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f3b340682f0 msgr2=0x7f3b3406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:41.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.603+0000 7f3b581ff700 1 --2- 172.21.15.45:0/3247889693 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f3b340682f0 0x7f3b3406a7a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c0090b0 tx=0x7f3b4c008030 comp rx=0 tx=0).stop 2023-11-28T12:06:41.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.603+0000 7f3b581ff700 1 -- 172.21.15.45:0/3247889693 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b5015c9b0 msgr2=0x7f3b5015f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:41.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.603+0000 7f3b581ff700 1 --2- 172.21.15.45:0/3247889693 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b5015c9b0 0x7f3b5015f100 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3b4000c750 tx=0x7f3b4000ca60 comp rx=0 tx=0).stop 2023-11-28T12:06:41.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.603+0000 7f3b581ff700 1 -- 172.21.15.45:0/3247889693 shutdown_connections 2023-11-28T12:06:41.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.603+0000 7f3b581ff700 1 --2- 172.21.15.45:0/3247889693 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f3b340682f0 0x7f3b3406a7a0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:41.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.603+0000 7f3b581ff700 1 --2- 172.21.15.45:0/3247889693 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b500d2320 0x7f3b50150100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:41.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.603+0000 7f3b581ff700 1 --2- 172.21.15.45:0/3247889693 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3b50161340 0x7f3b5015f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:41.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.603+0000 7f3b581ff700 1 --2- 172.21.15.45:0/3247889693 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b5015c9b0 0x7f3b5015f100 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:41.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.603+0000 7f3b581ff700 1 -- 172.21.15.45:0/3247889693 >> 172.21.15.45:0/3247889693 conn(0x7f3b50072600 msgr2=0x7f3b500b5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:41.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.603+0000 7f3b581ff700 1 -- 172.21.15.45:0/3247889693 shutdown_connections 2023-11-28T12:06:41.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.603+0000 7f3b581ff700 1 -- 172.21.15.45:0/3247889693 wait complete. 2023-11-28T12:06:41.621 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-28T12:06:21.807108+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-28T12:06:22.491009+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T12:06:27.684157+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T12:06:28.384679+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T12:06:41.622 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T12:06:41.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.826+0000 7f78d45ff700 1 Processor -- start 2023-11-28T12:06:41.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.826+0000 7f78d45ff700 1 -- start start 2023-11-28T12:06:41.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.828+0000 7f78d45ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f78cc0d1330 0x7f78cc0b06c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:41.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.828+0000 7f78d45ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f78cc0b20b0 0x7f78cc0b0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:41.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.828+0000 7f78d45ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78cc0b0230 con 0x7f78cc0d01b0 2023-11-28T12:06:41.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.828+0000 7f78d45ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78cc15cec0 con 0x7f78cc0d1330 2023-11-28T12:06:41.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.828+0000 7f78d45ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78cc0b4570 con 0x7f78cc0b20b0 2023-11-28T12:06:41.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.828+0000 7f78d239b700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f78cc0d01b0 0x7f78cc0d0c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:32868/0 (socket says 172.21.15.45:32868) 2023-11-28T12:06:41.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.828+0000 7f78d239b700 1 -- 172.21.15.45:0/941482806 learned_addr learned my addr 172.21.15.45:0/941482806 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:06:41.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.828+0000 7f78d1b9a700 1 --2- 172.21.15.45:0/941482806 >> v2:172.21.15.45:3300/0 conn(0x7f78cc0d1330 0x7f78cc0b06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:41.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.828+0000 7f78d1399700 1 -- 172.21.15.45:0/941482806 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2698538032 0 0) 0x7f78cc0b0230 con 0x7f78cc0d01b0 2023-11-28T12:06:41.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.828+0000 7f78d2b9c700 1 --2- 172.21.15.45:0/941482806 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f78cc0b20b0 0x7f78cc0b0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:41.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.828+0000 7f78d1399700 1 -- 172.21.15.45:0/941482806 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78b80035b0 con 0x7f78cc0d01b0 2023-11-28T12:06:41.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.828+0000 7f78d1b9a700 1 -- 172.21.15.45:0/941482806 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f78cc0b20b0 msgr2=0x7f78cc0b0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:06:41.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.828+0000 7f78d1b9a700 1 --2- 172.21.15.45:0/941482806 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f78cc0b20b0 0x7f78cc0b0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:41.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.828+0000 7f78d1b9a700 1 -- 172.21.15.45:0/941482806 >> v1:172.21.15.45:6789/0 conn(0x7f78cc0d01b0 legacy=0x7f78cc0d0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:41.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.828+0000 7f78d1b9a700 1 -- 172.21.15.45:0/941482806 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78cc0b4850 con 0x7f78cc0d1330 2023-11-28T12:06:41.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.828+0000 7f78d2b9c700 1 --2- 172.21.15.45:0/941482806 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f78cc0b20b0 0x7f78cc0b0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:06:41.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.829+0000 7f78d1b9a700 1 --2- 172.21.15.45:0/941482806 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78cc0d1330 0x7f78cc0b06c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f78bc009840 tx=0x7f78bc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca6b8d700c7a927f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:41.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.829+0000 7f78d1399700 1 -- 172.21.15.45:0/941482806 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78bc004230 con 0x7f78cc0d1330 2023-11-28T12:06:41.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.829+0000 7f78d1399700 1 -- 172.21.15.45:0/941482806 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78bc004390 con 0x7f78cc0d1330 2023-11-28T12:06:41.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.829+0000 7f78d1399700 1 -- 172.21.15.45:0/941482806 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78bc0036a0 con 0x7f78cc0d1330 2023-11-28T12:06:41.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.829+0000 7f78d45ff700 1 -- 172.21.15.45:0/941482806 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78cc0d1330 msgr2=0x7f78cc0b06c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:41.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.829+0000 7f78d45ff700 1 --2- 172.21.15.45:0/941482806 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78cc0d1330 0x7f78cc0b06c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f78bc009840 tx=0x7f78bc009b50 comp rx=0 tx=0).stop 2023-11-28T12:06:41.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.829+0000 7f78d45ff700 1 -- 172.21.15.45:0/941482806 shutdown_connections 2023-11-28T12:06:41.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.829+0000 7f78d45ff700 1 --2- 172.21.15.45:0/941482806 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f78cc0b20b0 0x7f78cc0b0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:41.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.829+0000 7f78d45ff700 1 --2- 172.21.15.45:0/941482806 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78cc0d1330 0x7f78cc0b06c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:41.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.829+0000 7f78d45ff700 1 -- 172.21.15.45:0/941482806 >> 172.21.15.45:0/941482806 conn(0x7f78cc09c3f0 msgr2=0x7f78cc0d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:41.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.830+0000 7f78d45ff700 1 -- 172.21.15.45:0/941482806 shutdown_connections 2023-11-28T12:06:41.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.830+0000 7f78d45ff700 1 -- 172.21.15.45:0/941482806 wait complete. 2023-11-28T12:06:41.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.832+0000 7f78d45ff700 1 Processor -- start 2023-11-28T12:06:41.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.832+0000 7f78d45ff700 1 -- start start 2023-11-28T12:06:41.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.833+0000 7f78d45ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f78cc0b20b0 0x7f78cc0b78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:41.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.833+0000 7f78d45ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f78cc0d01b0 0x7f78cc15da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:41.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.833+0000 7f78d45ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78cc0d1330 0x7f78cc15dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:41.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.833+0000 7f78d45ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78cc1f1d40 con 0x7f78cc0d1330 2023-11-28T12:06:41.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.833+0000 7f78d45ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78cc15d310 con 0x7f78cc0d01b0 2023-11-28T12:06:41.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.833+0000 7f78d45ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78cc0b8230 con 0x7f78cc0b20b0 2023-11-28T12:06:41.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.834+0000 7f78d2b9c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78cc0d1330 0x7f78cc15dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:41.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.834+0000 7f78d2b9c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78cc0d1330 0x7f78cc15dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36246/0 (socket says 172.21.15.45:36246) 2023-11-28T12:06:41.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.834+0000 7f78d2b9c700 1 -- 172.21.15.45:0/982480903 learned_addr learned my addr 172.21.15.45:0/982480903 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:41.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.834+0000 7f78d239b700 1 --2- 172.21.15.45:0/982480903 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f78cc0b20b0 0x7f78cc0b78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:41.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.834+0000 7f78d1b9a700 1 --2- 172.21.15.45:0/982480903 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f78cc0d01b0 0x7f78cc15da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:41.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.834+0000 7f78d2b9c700 1 -- 172.21.15.45:0/982480903 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f78cc0b20b0 msgr2=0x7f78cc0b78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:41.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.834+0000 7f78d2b9c700 1 --2- 172.21.15.45:0/982480903 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f78cc0b20b0 0x7f78cc0b78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:41.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.834+0000 7f78d2b9c700 1 -- 172.21.15.45:0/982480903 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f78cc0d01b0 msgr2=0x7f78cc15da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:41.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.834+0000 7f78d2b9c700 1 --2- 172.21.15.45:0/982480903 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f78cc0d01b0 0x7f78cc15da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:41.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.834+0000 7f78d2b9c700 1 -- 172.21.15.45:0/982480903 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78bc0094a0 con 0x7f78cc0d1330 2023-11-28T12:06:41.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.834+0000 7f78d2b9c700 1 --2- 172.21.15.45:0/982480903 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78cc0d1330 0x7f78cc15dfc0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f78c400ce80 tx=0x7f78c400ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:41.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.835+0000 7f78c2ffd700 1 -- 172.21.15.45:0/982480903 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c400ad40 con 0x7f78cc0d1330 2023-11-28T12:06:41.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.835+0000 7f78c2ffd700 1 -- 172.21.15.45:0/982480903 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78c4015440 con 0x7f78cc0d1330 2023-11-28T12:06:41.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.835+0000 7f78d45ff700 1 -- 172.21.15.45:0/982480903 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78cc0afec0 con 0x7f78cc0d1330 2023-11-28T12:06:41.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.835+0000 7f78c2ffd700 1 -- 172.21.15.45:0/982480903 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c400aea0 con 0x7f78cc0d1330 2023-11-28T12:06:41.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.835+0000 7f78d45ff700 1 -- 172.21.15.45:0/982480903 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78cc0afbe0 con 0x7f78cc0d1330 2023-11-28T12:06:41.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.836+0000 7f78d45ff700 1 -- 172.21.15.45:0/982480903 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78cc0b2600 con 0x7f78cc0d1330 2023-11-28T12:06:41.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.837+0000 7f78c2ffd700 1 -- 172.21.15.45:0/982480903 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f78c401c030 con 0x7f78cc0d1330 2023-11-28T12:06:41.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.838+0000 7f78c2ffd700 1 --2- 172.21.15.45:0/982480903 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f78b00682f0 0x7f78b006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:41.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.838+0000 7f78c2ffd700 1 -- 172.21.15.45:0/982480903 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f78c4085ff0 con 0x7f78cc0d1330 2023-11-28T12:06:41.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.838+0000 7f78d239b700 1 --2- 172.21.15.45:0/982480903 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f78b00682f0 0x7f78b006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:41.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.839+0000 7f78d239b700 1 --2- 172.21.15.45:0/982480903 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f78b00682f0 0x7f78b006a7a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f78c8007b10 tx=0x7f78c8007a60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:41.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:41.842+0000 7f78c2ffd700 1 -- 172.21.15.45:0/982480903 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f78c40527c0 con 0x7f78cc0d1330 2023-11-28T12:06:42.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.044+0000 7f78d45ff700 1 -- 172.21.15.45:0/982480903 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f78cc068690 con 0x7f78cc0d1330 2023-11-28T12:06:42.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.044+0000 7f78c2ffd700 1 -- 172.21.15.45:0/982480903 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7f78c401a020 con 0x7f78cc0d1330 2023-11-28T12:06:42.045 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-11-28T12:06:42.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.047+0000 7f78d45ff700 1 -- 172.21.15.45:0/982480903 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f78b00682f0 msgr2=0x7f78b006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:42.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.047+0000 7f78d45ff700 1 --2- 172.21.15.45:0/982480903 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f78b00682f0 0x7f78b006a7a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f78c8007b10 tx=0x7f78c8007a60 comp rx=0 tx=0).stop 2023-11-28T12:06:42.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.047+0000 7f78d45ff700 1 -- 172.21.15.45:0/982480903 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78cc0d1330 msgr2=0x7f78cc15dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:42.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.047+0000 7f78d45ff700 1 --2- 172.21.15.45:0/982480903 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78cc0d1330 0x7f78cc15dfc0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f78c400ce80 tx=0x7f78c400ceb0 comp rx=0 tx=0).stop 2023-11-28T12:06:42.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.047+0000 7f78d45ff700 1 -- 172.21.15.45:0/982480903 shutdown_connections 2023-11-28T12:06:42.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.047+0000 7f78d45ff700 1 --2- 172.21.15.45:0/982480903 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f78b00682f0 0x7f78b006a7a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:42.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.047+0000 7f78d45ff700 1 --2- 172.21.15.45:0/982480903 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78cc0d1330 0x7f78cc15dfc0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:42.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.047+0000 7f78d45ff700 1 --2- 172.21.15.45:0/982480903 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f78cc0b20b0 0x7f78cc0b78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:42.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.047+0000 7f78d45ff700 1 --2- 172.21.15.45:0/982480903 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f78cc0d01b0 0x7f78cc15da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:42.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.047+0000 7f78d45ff700 1 -- 172.21.15.45:0/982480903 >> 172.21.15.45:0/982480903 conn(0x7f78cc09c3f0 msgr2=0x7f78cc0b06c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:42.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.047+0000 7f78d45ff700 1 -- 172.21.15.45:0/982480903 shutdown_connections 2023-11-28T12:06:42.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.047+0000 7f78d45ff700 1 -- 172.21.15.45:0/982480903 wait complete. 2023-11-28T12:06:42.065 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T12:06:42.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.271+0000 7fae1e7ff700 1 Processor -- start 2023-11-28T12:06:42.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.272+0000 7fae1e7ff700 1 -- start start 2023-11-28T12:06:42.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.273+0000 7fae1e7ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fae1815c9b0 0x7fae180b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:42.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.273+0000 7fae1e7ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae180d1950 con 0x7fae180cd7c0 2023-11-28T12:06:42.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.273+0000 7fae1e7ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae180d24f0 con 0x7fae18161340 2023-11-28T12:06:42.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.273+0000 7fae1e7ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae180b5800 con 0x7fae1815c9b0 2023-11-28T12:06:42.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.273+0000 7fae1cd9c700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fae180cd7c0 0x7fae180b5fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:37782/0 (socket says 172.21.15.45:37782) 2023-11-28T12:06:42.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.273+0000 7fae1cd9c700 1 -- 172.21.15.45:0/841384651 learned_addr learned my addr 172.21.15.45:0/841384651 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:06:42.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.273+0000 7fae17fff700 1 --2- 172.21.15.45:0/841384651 >> v2:172.21.15.152:3300/0 conn(0x7fae1815c9b0 0x7fae180b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:42.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.274+0000 7fae16ffd700 1 -- 172.21.15.45:0/841384651 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3888546281 0 0) 0x7fae180d1950 con 0x7fae180cd7c0 2023-11-28T12:06:42.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.274+0000 7fae16ffd700 1 -- 172.21.15.45:0/841384651 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae000035b0 con 0x7fae180cd7c0 2023-11-28T12:06:42.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.274+0000 7fae16ffd700 1 -- 172.21.15.45:0/841384651 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3096712368 0 0) 0x7fae180d24f0 con 0x7fae18161340 2023-11-28T12:06:42.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.274+0000 7fae16ffd700 1 -- 172.21.15.45:0/841384651 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae180d1950 con 0x7fae18161340 2023-11-28T12:06:42.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.274+0000 7fae17fff700 1 -- 172.21.15.45:0/841384651 >> v1:172.21.15.152:6789/0 conn(0x7fae18161340 legacy=0x7fae180d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:42.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.274+0000 7fae17fff700 1 -- 172.21.15.45:0/841384651 >> v1:172.21.15.45:6789/0 conn(0x7fae180cd7c0 legacy=0x7fae180b5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:42.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.274+0000 7fae17fff700 1 -- 172.21.15.45:0/841384651 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae180b5520 con 0x7fae1815c9b0 2023-11-28T12:06:42.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.274+0000 7fae17fff700 1 --2- 172.21.15.45:0/841384651 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae1815c9b0 0x7fae180b4bf0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fae08009840 tx=0x7fae08009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e192d4ea57690328 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:42.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.274+0000 7fae16ffd700 1 -- 172.21.15.45:0/841384651 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae08011830 con 0x7fae1815c9b0 2023-11-28T12:06:42.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.274+0000 7fae16ffd700 1 -- 172.21.15.45:0/841384651 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae08011990 con 0x7fae1815c9b0 2023-11-28T12:06:42.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.274+0000 7fae16ffd700 1 -- 172.21.15.45:0/841384651 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae08011d20 con 0x7fae1815c9b0 2023-11-28T12:06:42.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.275+0000 7fae1e7ff700 1 -- 172.21.15.45:0/841384651 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae1815c9b0 msgr2=0x7fae180b4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:42.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.275+0000 7fae1e7ff700 1 --2- 172.21.15.45:0/841384651 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae1815c9b0 0x7fae180b4bf0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fae08009840 tx=0x7fae08009b50 comp rx=0 tx=0).stop 2023-11-28T12:06:42.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.275+0000 7fae1e7ff700 1 -- 172.21.15.45:0/841384651 shutdown_connections 2023-11-28T12:06:42.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.275+0000 7fae1e7ff700 1 --2- 172.21.15.45:0/841384651 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae1815c9b0 0x7fae180b4bf0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:42.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.275+0000 7fae1e7ff700 1 -- 172.21.15.45:0/841384651 >> 172.21.15.45:0/841384651 conn(0x7fae18072600 msgr2=0x7fae180cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:42.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.275+0000 7fae1e7ff700 1 -- 172.21.15.45:0/841384651 shutdown_connections 2023-11-28T12:06:42.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.275+0000 7fae1e7ff700 1 -- 172.21.15.45:0/841384651 wait complete. 2023-11-28T12:06:42.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.277+0000 7fae1e7ff700 1 Processor -- start 2023-11-28T12:06:42.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.277+0000 7fae1e7ff700 1 -- start start 2023-11-28T12:06:42.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.278+0000 7fae1e7ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fae180cd7c0 0x7fae18156ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:42.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.278+0000 7fae1e7ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fae1815c9b0 0x7fae180ca240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:42.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.278+0000 7fae1e7ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae18161340 0x7fae18156740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:42.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.278+0000 7fae1e7ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae180ca780 con 0x7fae1815c9b0 2023-11-28T12:06:42.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.278+0000 7fae1e7ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae18156c80 con 0x7fae18161340 2023-11-28T12:06:42.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.278+0000 7fae1e7ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae180c7fa0 con 0x7fae180cd7c0 2023-11-28T12:06:42.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.278+0000 7fae177fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fae1815c9b0 0x7fae180ca240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:42.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.278+0000 7fae177fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fae1815c9b0 0x7fae180ca240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60434/0 (socket says 172.21.15.45:60434) 2023-11-28T12:06:42.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.278+0000 7fae177fe700 1 -- 172.21.15.45:0/3555225368 learned_addr learned my addr 172.21.15.45:0/3555225368 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:42.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.278+0000 7fae17fff700 1 --2- 172.21.15.45:0/3555225368 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fae180cd7c0 0x7fae18156ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:42.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.278+0000 7fae1cd9c700 1 --2- 172.21.15.45:0/3555225368 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae18161340 0x7fae18156740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:42.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.278+0000 7fae177fe700 1 -- 172.21.15.45:0/3555225368 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fae180cd7c0 msgr2=0x7fae18156ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:42.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.278+0000 7fae177fe700 1 --2- 172.21.15.45:0/3555225368 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fae180cd7c0 0x7fae18156ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:42.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.278+0000 7fae177fe700 1 -- 172.21.15.45:0/3555225368 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae18161340 msgr2=0x7fae18156740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:42.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.278+0000 7fae177fe700 1 --2- 172.21.15.45:0/3555225368 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae18161340 0x7fae18156740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:42.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.279+0000 7fae177fe700 1 -- 172.21.15.45:0/3555225368 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae080094a0 con 0x7fae1815c9b0 2023-11-28T12:06:42.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.279+0000 7fae177fe700 1 --2- 172.21.15.45:0/3555225368 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fae1815c9b0 0x7fae180ca240 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fae0c00c520 tx=0x7fae0c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:42.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.279+0000 7fae14ff9700 1 -- 172.21.15.45:0/3555225368 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae0c0052d0 con 0x7fae1815c9b0 2023-11-28T12:06:42.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.279+0000 7fae14ff9700 1 -- 172.21.15.45:0/3555225368 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae0c005430 con 0x7fae1815c9b0 2023-11-28T12:06:42.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.279+0000 7fae14ff9700 1 -- 172.21.15.45:0/3555225368 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae0c0038c0 con 0x7fae1815c9b0 2023-11-28T12:06:42.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.279+0000 7fae1e7ff700 1 -- 172.21.15.45:0/3555225368 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae180d15e0 con 0x7fae1815c9b0 2023-11-28T12:06:42.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.279+0000 7fae1e7ff700 1 -- 172.21.15.45:0/3555225368 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae180d1300 con 0x7fae1815c9b0 2023-11-28T12:06:42.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.280+0000 7fae1e7ff700 1 -- 172.21.15.45:0/3555225368 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae180b5130 con 0x7fae1815c9b0 2023-11-28T12:06:42.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.281+0000 7fae14ff9700 1 -- 172.21.15.45:0/3555225368 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fae0c019030 con 0x7fae1815c9b0 2023-11-28T12:06:42.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.282+0000 7fae14ff9700 1 --2- 172.21.15.45:0/3555225368 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fae040682f0 0x7fae0406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:42.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.282+0000 7fae14ff9700 1 -- 172.21.15.45:0/3555225368 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fae0c084fe0 con 0x7fae1815c9b0 2023-11-28T12:06:42.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.283+0000 7fae17fff700 1 --2- 172.21.15.45:0/3555225368 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fae040682f0 0x7fae0406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:42.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.283+0000 7fae17fff700 1 --2- 172.21.15.45:0/3555225368 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fae040682f0 0x7fae0406a7a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fae08009fd0 tx=0x7fae0801c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:42.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.286+0000 7fae14ff9700 1 -- 172.21.15.45:0/3555225368 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fae0c0517e0 con 0x7fae1815c9b0 2023-11-28T12:06:42.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.486+0000 7fae1e7ff700 1 -- 172.21.15.45:0/3555225368 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fae180745c0 con 0x7fae1815c9b0 2023-11-28T12:06:42.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.487+0000 7fae14ff9700 1 -- 172.21.15.45:0/3555225368 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fae0c054e00 con 0x7fae1815c9b0 2023-11-28T12:06:42.487 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-11-28T12:06:42.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.489+0000 7fae1e7ff700 1 -- 172.21.15.45:0/3555225368 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fae040682f0 msgr2=0x7fae0406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:42.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.489+0000 7fae1e7ff700 1 --2- 172.21.15.45:0/3555225368 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fae040682f0 0x7fae0406a7a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fae08009fd0 tx=0x7fae0801c040 comp rx=0 tx=0).stop 2023-11-28T12:06:42.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.489+0000 7fae1e7ff700 1 -- 172.21.15.45:0/3555225368 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fae1815c9b0 msgr2=0x7fae180ca240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:42.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.489+0000 7fae1e7ff700 1 --2- 172.21.15.45:0/3555225368 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fae1815c9b0 0x7fae180ca240 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fae0c00c520 tx=0x7fae0c00c830 comp rx=0 tx=0).stop 2023-11-28T12:06:42.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.489+0000 7fae1e7ff700 1 -- 172.21.15.45:0/3555225368 shutdown_connections 2023-11-28T12:06:42.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.489+0000 7fae1e7ff700 1 --2- 172.21.15.45:0/3555225368 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fae040682f0 0x7fae0406a7a0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:42.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.489+0000 7fae1e7ff700 1 --2- 172.21.15.45:0/3555225368 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae18161340 0x7fae18156740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:42.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.489+0000 7fae1e7ff700 1 --2- 172.21.15.45:0/3555225368 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fae180cd7c0 0x7fae18156ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:42.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.489+0000 7fae1e7ff700 1 --2- 172.21.15.45:0/3555225368 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fae1815c9b0 0x7fae180ca240 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:42.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.489+0000 7fae1e7ff700 1 -- 172.21.15.45:0/3555225368 >> 172.21.15.45:0/3555225368 conn(0x7fae18072600 msgr2=0x7fae18160460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:42.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.489+0000 7fae1e7ff700 1 -- 172.21.15.45:0/3555225368 shutdown_connections 2023-11-28T12:06:42.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.489+0000 7fae1e7ff700 1 -- 172.21.15.45:0/3555225368 wait complete. 2023-11-28T12:06:42.508 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T12:06:42.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.713+0000 7f296b1ff700 1 Processor -- start 2023-11-28T12:06:42.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.714+0000 7f296b1ff700 1 -- start start 2023-11-28T12:06:42.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.715+0000 7f296b1ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f296415c9b0 0x7f29640b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:42.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.715+0000 7f296b1ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2964161340 0x7f29640d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:42.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.715+0000 7f296b1ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f29640d2320 0x7f29640cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:42.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.715+0000 7f296b1ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29640b5800 con 0x7f29640d2320 2023-11-28T12:06:42.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.715+0000 7f296b1ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29640d1950 con 0x7f296415c9b0 2023-11-28T12:06:42.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.715+0000 7f296b1ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29640b5520 con 0x7f2964161340 2023-11-28T12:06:42.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.715+0000 7f296979c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f29640d2320 0x7f29640cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:42.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.715+0000 7f296979c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f29640d2320 0x7f29640cd7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60450/0 (socket says 172.21.15.45:60450) 2023-11-28T12:06:42.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.715+0000 7f296979c700 1 -- 172.21.15.45:0/236699899 learned_addr learned my addr 172.21.15.45:0/236699899 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:42.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.715+0000 7f2968f9b700 1 --2- 172.21.15.45:0/236699899 >> v2:172.21.15.152:3300/0 conn(0x7f296415c9b0 0x7f29640b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:42.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.715+0000 7f2963fff700 1 --2- 172.21.15.45:0/236699899 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2964161340 0x7f29640d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:42.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.715+0000 7f296979c700 1 -- 172.21.15.45:0/236699899 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2964161340 msgr2=0x7f29640d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:06:42.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.715+0000 7f296979c700 1 --2- 172.21.15.45:0/236699899 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2964161340 0x7f29640d1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:42.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.715+0000 7f296979c700 1 -- 172.21.15.45:0/236699899 >> v2:172.21.15.152:3300/0 conn(0x7f296415c9b0 msgr2=0x7f29640b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:06:42.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.715+0000 7f296979c700 1 --2- 172.21.15.45:0/236699899 >> v2:172.21.15.152:3300/0 conn(0x7f296415c9b0 0x7f29640b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:42.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.715+0000 7f296979c700 1 -- 172.21.15.45:0/236699899 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29640d1300 con 0x7f29640d2320 2023-11-28T12:06:42.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.716+0000 7f296979c700 1 --2- 172.21.15.45:0/236699899 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29640d2320 0x7f29640cd7c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2964067460 tx=0x7f295c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc1939b247d3d33b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:42.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.716+0000 7f29637fe700 1 -- 172.21.15.45:0/236699899 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f295c00e070 con 0x7f29640d2320 2023-11-28T12:06:42.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.716+0000 7f29637fe700 1 -- 172.21.15.45:0/236699899 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f295c00b9c0 con 0x7f29640d2320 2023-11-28T12:06:42.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.716+0000 7f29637fe700 1 -- 172.21.15.45:0/236699899 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f295c00bd70 con 0x7f29640d2320 2023-11-28T12:06:42.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.716+0000 7f296b1ff700 1 -- 172.21.15.45:0/236699899 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29640d2320 msgr2=0x7f29640cd7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:42.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.716+0000 7f296b1ff700 1 --2- 172.21.15.45:0/236699899 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29640d2320 0x7f29640cd7c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2964067460 tx=0x7f295c00b330 comp rx=0 tx=0).stop 2023-11-28T12:06:42.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.717+0000 7f296b1ff700 1 -- 172.21.15.45:0/236699899 shutdown_connections 2023-11-28T12:06:42.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.717+0000 7f296b1ff700 1 --2- 172.21.15.45:0/236699899 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29640d2320 0x7f29640cd7c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:42.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.717+0000 7f296b1ff700 1 --2- 172.21.15.45:0/236699899 >> v2:172.21.15.152:3300/0 conn(0x7f296415c9b0 0x7f29640b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:42.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.717+0000 7f296b1ff700 1 --2- 172.21.15.45:0/236699899 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2964161340 0x7f29640d1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:42.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.717+0000 7f296b1ff700 1 -- 172.21.15.45:0/236699899 >> 172.21.15.45:0/236699899 conn(0x7f2964072600 msgr2=0x7f29640cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:42.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.717+0000 7f296b1ff700 1 -- 172.21.15.45:0/236699899 shutdown_connections 2023-11-28T12:06:42.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.717+0000 7f296b1ff700 1 -- 172.21.15.45:0/236699899 wait complete. 2023-11-28T12:06:42.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.718+0000 7f296b1ff700 1 Processor -- start 2023-11-28T12:06:42.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.718+0000 7f296b1ff700 1 -- start start 2023-11-28T12:06:42.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.719+0000 7f296b1ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29640d2320 0x7f2964153e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:42.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.719+0000 7f296b1ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f296415c9b0 0x7f296415fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:42.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.719+0000 7f296b1ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2964161340 0x7f29641502a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:42.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.719+0000 7f296b1ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f296414e120 con 0x7f29640d2320 2023-11-28T12:06:42.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.719+0000 7f296b1ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2964160080 con 0x7f2964161340 2023-11-28T12:06:42.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.719+0000 7f296b1ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f296414eb30 con 0x7f296415c9b0 2023-11-28T12:06:42.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.720+0000 7f2968f9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29640d2320 0x7f2964153e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:42.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.720+0000 7f2968f9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29640d2320 0x7f2964153e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60454/0 (socket says 172.21.15.45:60454) 2023-11-28T12:06:42.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.720+0000 7f2968f9b700 1 -- 172.21.15.45:0/4109843246 learned_addr learned my addr 172.21.15.45:0/4109843246 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:42.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.720+0000 7f296979c700 1 --2- 172.21.15.45:0/4109843246 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2964161340 0x7f29641502a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:42.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.720+0000 7f2963fff700 1 --2- 172.21.15.45:0/4109843246 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f296415c9b0 0x7f296415fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:42.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.720+0000 7f2968f9b700 1 -- 172.21.15.45:0/4109843246 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f296415c9b0 msgr2=0x7f296415fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:42.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.720+0000 7f2968f9b700 1 --2- 172.21.15.45:0/4109843246 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f296415c9b0 0x7f296415fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:42.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.720+0000 7f2968f9b700 1 -- 172.21.15.45:0/4109843246 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2964161340 msgr2=0x7f29641502a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:42.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.720+0000 7f2968f9b700 1 --2- 172.21.15.45:0/4109843246 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2964161340 0x7f29641502a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:42.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.720+0000 7f2968f9b700 1 -- 172.21.15.45:0/4109843246 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f295c009b30 con 0x7f29640d2320 2023-11-28T12:06:42.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.720+0000 7f2968f9b700 1 --2- 172.21.15.45:0/4109843246 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29640d2320 0x7f2964153e80 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f295800d800 tx=0x7f295800db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:42.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.721+0000 7f29617fa700 1 -- 172.21.15.45:0/4109843246 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29580125f0 con 0x7f29640d2320 2023-11-28T12:06:42.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.721+0000 7f29617fa700 1 -- 172.21.15.45:0/4109843246 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2958012750 con 0x7f29640d2320 2023-11-28T12:06:42.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.721+0000 7f29617fa700 1 -- 172.21.15.45:0/4109843246 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2958012b00 con 0x7f29640d2320 2023-11-28T12:06:42.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.721+0000 7f296b1ff700 1 -- 172.21.15.45:0/4109843246 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29640b5130 con 0x7f29640d2320 2023-11-28T12:06:42.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.721+0000 7f296b1ff700 1 -- 172.21.15.45:0/4109843246 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29640d15e0 con 0x7f29640d2320 2023-11-28T12:06:42.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.722+0000 7f296b1ff700 1 -- 172.21.15.45:0/4109843246 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29640b52c0 con 0x7f29640d2320 2023-11-28T12:06:42.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.723+0000 7f29617fa700 1 -- 172.21.15.45:0/4109843246 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f2958012c60 con 0x7f29640d2320 2023-11-28T12:06:42.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.724+0000 7f29617fa700 1 --2- 172.21.15.45:0/4109843246 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f29480682f0 0x7f294806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:42.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.724+0000 7f29617fa700 1 -- 172.21.15.45:0/4109843246 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2958085f60 con 0x7f29640d2320 2023-11-28T12:06:42.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.724+0000 7f2963fff700 1 --2- 172.21.15.45:0/4109843246 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f29480682f0 0x7f294806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:42.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.725+0000 7f2963fff700 1 --2- 172.21.15.45:0/4109843246 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f29480682f0 0x7f294806a7a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2964151030 tx=0x7f2950008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:42.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.727+0000 7f29617fa700 1 -- 172.21.15.45:0/4109843246 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f29580526d0 con 0x7f29640d2320 2023-11-28T12:06:42.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.930+0000 7f296b1ff700 1 -- 172.21.15.45:0/4109843246 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f29640745c0 con 0x7f29640d2320 2023-11-28T12:06:42.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.931+0000 7f29617fa700 1 -- 172.21.15.45:0/4109843246 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2958055cf0 con 0x7f29640d2320 2023-11-28T12:06:42.932 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-11-28T12:06:42.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.933+0000 7f296b1ff700 1 -- 172.21.15.45:0/4109843246 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f29480682f0 msgr2=0x7f294806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:42.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.933+0000 7f296b1ff700 1 --2- 172.21.15.45:0/4109843246 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f29480682f0 0x7f294806a7a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2964151030 tx=0x7f2950008040 comp rx=0 tx=0).stop 2023-11-28T12:06:42.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.933+0000 7f296b1ff700 1 -- 172.21.15.45:0/4109843246 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29640d2320 msgr2=0x7f2964153e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:42.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.933+0000 7f296b1ff700 1 --2- 172.21.15.45:0/4109843246 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29640d2320 0x7f2964153e80 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f295800d800 tx=0x7f295800db10 comp rx=0 tx=0).stop 2023-11-28T12:06:42.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.933+0000 7f296b1ff700 1 -- 172.21.15.45:0/4109843246 shutdown_connections 2023-11-28T12:06:42.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.933+0000 7f296b1ff700 1 --2- 172.21.15.45:0/4109843246 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f29480682f0 0x7f294806a7a0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:42.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.933+0000 7f296b1ff700 1 --2- 172.21.15.45:0/4109843246 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2964161340 0x7f29641502a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:42.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.933+0000 7f296b1ff700 1 --2- 172.21.15.45:0/4109843246 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29640d2320 0x7f2964153e80 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:42.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.933+0000 7f296b1ff700 1 --2- 172.21.15.45:0/4109843246 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f296415c9b0 0x7f296415fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:42.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.933+0000 7f296b1ff700 1 -- 172.21.15.45:0/4109843246 >> 172.21.15.45:0/4109843246 conn(0x7f2964072600 msgr2=0x7f296415cf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:42.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.933+0000 7f296b1ff700 1 -- 172.21.15.45:0/4109843246 shutdown_connections 2023-11-28T12:06:42.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:42.933+0000 7f296b1ff700 1 -- 172.21.15.45:0/4109843246 wait complete. 2023-11-28T12:06:42.952 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T12:06:43.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.157+0000 7f7e6d5ff700 1 Processor -- start 2023-11-28T12:06:43.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.158+0000 7f7e6d5ff700 1 -- start start 2023-11-28T12:06:43.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.159+0000 7f7e6d5ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7e6815c9b0 0x7f7e680b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:43.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.159+0000 7f7e6d5ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7e68161340 0x7f7e680d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:43.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.159+0000 7f7e6d5ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e680d1950 con 0x7f7e680d2320 2023-11-28T12:06:43.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.159+0000 7f7e6d5ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e680b5800 con 0x7f7e68161340 2023-11-28T12:06:43.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.159+0000 7f7e6d5ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e680b5520 con 0x7f7e6815c9b0 2023-11-28T12:06:43.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.159+0000 7f7e667fc700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7e68161340 0x7f7e680d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:43.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.159+0000 7f7e667fc700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7e68161340 0x7f7e680d1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60458/0 (socket says 172.21.15.45:60458) 2023-11-28T12:06:43.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.159+0000 7f7e667fc700 1 -- 172.21.15.45:0/1989594823 learned_addr learned my addr 172.21.15.45:0/1989594823 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:43.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.159+0000 7f7e66ffd700 1 --2- 172.21.15.45:0/1989594823 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7e6815c9b0 0x7f7e680b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:43.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.159+0000 7f7e667fc700 1 -- 172.21.15.45:0/1989594823 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7e6815c9b0 msgr2=0x7f7e680b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:06:43.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.160+0000 7f7e667fc700 1 --2- 172.21.15.45:0/1989594823 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7e6815c9b0 0x7f7e680b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:43.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.160+0000 7f7e667fc700 1 -- 172.21.15.45:0/1989594823 >> v1:172.21.15.152:6789/0 conn(0x7f7e680d2320 legacy=0x7f7e680cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:43.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.160+0000 7f7e667fc700 1 -- 172.21.15.45:0/1989594823 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e680d1300 con 0x7f7e68161340 2023-11-28T12:06:43.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.160+0000 7f7e66ffd700 1 --2- 172.21.15.45:0/1989594823 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7e6815c9b0 0x7f7e680b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:06:43.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.160+0000 7f7e667fc700 1 --2- 172.21.15.45:0/1989594823 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e68161340 0x7f7e680d1de0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c0098f0 tx=0x7f7e5c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a150c4c8f60e2e1d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:43.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.160+0000 7f7e65ffb700 1 -- 172.21.15.45:0/1989594823 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c00b8a0 con 0x7f7e68161340 2023-11-28T12:06:43.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.160+0000 7f7e65ffb700 1 -- 172.21.15.45:0/1989594823 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e5c00ba00 con 0x7f7e68161340 2023-11-28T12:06:43.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.160+0000 7f7e65ffb700 1 -- 172.21.15.45:0/1989594823 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c00bd90 con 0x7f7e68161340 2023-11-28T12:06:43.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.161+0000 7f7e6d5ff700 1 -- 172.21.15.45:0/1989594823 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e68161340 msgr2=0x7f7e680d1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:43.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.161+0000 7f7e6d5ff700 1 --2- 172.21.15.45:0/1989594823 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e68161340 0x7f7e680d1de0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c0098f0 tx=0x7f7e5c009c00 comp rx=0 tx=0).stop 2023-11-28T12:06:43.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.161+0000 7f7e6d5ff700 1 -- 172.21.15.45:0/1989594823 shutdown_connections 2023-11-28T12:06:43.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.161+0000 7f7e6d5ff700 1 --2- 172.21.15.45:0/1989594823 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7e6815c9b0 0x7f7e680b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:43.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.161+0000 7f7e6d5ff700 1 --2- 172.21.15.45:0/1989594823 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e68161340 0x7f7e680d1de0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:43.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.161+0000 7f7e6d5ff700 1 -- 172.21.15.45:0/1989594823 >> 172.21.15.45:0/1989594823 conn(0x7f7e68072600 msgr2=0x7f7e680cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:43.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.161+0000 7f7e6d5ff700 1 -- 172.21.15.45:0/1989594823 shutdown_connections 2023-11-28T12:06:43.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.161+0000 7f7e6d5ff700 1 -- 172.21.15.45:0/1989594823 wait complete. 2023-11-28T12:06:43.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.162+0000 7f7e6d5ff700 1 Processor -- start 2023-11-28T12:06:43.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.163+0000 7f7e6d5ff700 1 -- start start 2023-11-28T12:06:43.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.163+0000 7f7e6d5ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7e680d2320 0x7f7e68150200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:43.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.164+0000 7f7e6d5ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7e6815c9b0 0x7f7e681e7f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:43.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.164+0000 7f7e6d5ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e68161340 0x7f7e6815ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:43.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.164+0000 7f7e6d5ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e681545a0 con 0x7f7e68161340 2023-11-28T12:06:43.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.164+0000 7f7e6d5ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e681e6a60 con 0x7f7e6815c9b0 2023-11-28T12:06:43.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.164+0000 7f7e6d5ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e681e6d40 con 0x7f7e680d2320 2023-11-28T12:06:43.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.164+0000 7f7e677fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e68161340 0x7f7e6815ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:43.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.164+0000 7f7e66ffd700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7e680d2320 0x7f7e68150200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:43.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.164+0000 7f7e677fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e68161340 0x7f7e6815ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60474/0 (socket says 172.21.15.45:60474) 2023-11-28T12:06:43.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.164+0000 7f7e677fe700 1 -- 172.21.15.45:0/1486081445 learned_addr learned my addr 172.21.15.45:0/1486081445 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:43.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.164+0000 7f7e667fc700 1 --2- 172.21.15.45:0/1486081445 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7e6815c9b0 0x7f7e681e7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:43.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.164+0000 7f7e677fe700 1 -- 172.21.15.45:0/1486081445 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7e680d2320 msgr2=0x7f7e68150200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:43.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.164+0000 7f7e677fe700 1 --2- 172.21.15.45:0/1486081445 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7e680d2320 0x7f7e68150200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:43.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.164+0000 7f7e677fe700 1 -- 172.21.15.45:0/1486081445 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7e6815c9b0 msgr2=0x7f7e681e7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:43.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.164+0000 7f7e677fe700 1 --2- 172.21.15.45:0/1486081445 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7e6815c9b0 0x7f7e681e7f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:43.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.164+0000 7f7e677fe700 1 -- 172.21.15.45:0/1486081445 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e5c009550 con 0x7f7e68161340 2023-11-28T12:06:43.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.165+0000 7f7e677fe700 1 --2- 172.21.15.45:0/1486081445 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e68161340 0x7f7e6815ebd0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7e6000cb50 tx=0x7f7e6000ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:43.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.165+0000 7f7e4f7fe700 1 -- 172.21.15.45:0/1486081445 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e60003c00 con 0x7f7e68161340 2023-11-28T12:06:43.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.165+0000 7f7e4f7fe700 1 -- 172.21.15.45:0/1486081445 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e60003d60 con 0x7f7e68161340 2023-11-28T12:06:43.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.165+0000 7f7e6d5ff700 1 -- 172.21.15.45:0/1486081445 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e680b5130 con 0x7f7e68161340 2023-11-28T12:06:43.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.165+0000 7f7e4f7fe700 1 -- 172.21.15.45:0/1486081445 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6000aa20 con 0x7f7e68161340 2023-11-28T12:06:43.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.165+0000 7f7e6d5ff700 1 -- 172.21.15.45:0/1486081445 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e680d15e0 con 0x7f7e68161340 2023-11-28T12:06:43.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.166+0000 7f7e6d5ff700 1 -- 172.21.15.45:0/1486081445 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e680b52c0 con 0x7f7e68161340 2023-11-28T12:06:43.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.167+0000 7f7e4f7fe700 1 -- 172.21.15.45:0/1486081445 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f7e60010050 con 0x7f7e68161340 2023-11-28T12:06:43.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.168+0000 7f7e4f7fe700 1 --2- 172.21.15.45:0/1486081445 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f7e540682f0 0x7f7e5406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:43.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.168+0000 7f7e4f7fe700 1 -- 172.21.15.45:0/1486081445 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7e60085c10 con 0x7f7e68161340 2023-11-28T12:06:43.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.168+0000 7f7e66ffd700 1 --2- 172.21.15.45:0/1486081445 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f7e540682f0 0x7f7e5406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:43.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.169+0000 7f7e66ffd700 1 --2- 172.21.15.45:0/1486081445 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f7e540682f0 0x7f7e5406a7a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7e58006f10 tx=0x7f7e58008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:43.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.172+0000 7f7e4f7fe700 1 -- 172.21.15.45:0/1486081445 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f7e60052380 con 0x7f7e68161340 2023-11-28T12:06:43.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.372+0000 7f7e6d5ff700 1 -- 172.21.15.45:0/1486081445 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7e68154740 con 0x7f7e68161340 2023-11-28T12:06:43.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.373+0000 7f7e4f7fe700 1 -- 172.21.15.45:0/1486081445 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7e600559a0 con 0x7f7e68161340 2023-11-28T12:06:43.375 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-11-28T12:06:43.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.375+0000 7f7e6d5ff700 1 -- 172.21.15.45:0/1486081445 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f7e540682f0 msgr2=0x7f7e5406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:43.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.375+0000 7f7e6d5ff700 1 --2- 172.21.15.45:0/1486081445 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f7e540682f0 0x7f7e5406a7a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7e58006f10 tx=0x7f7e58008040 comp rx=0 tx=0).stop 2023-11-28T12:06:43.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.375+0000 7f7e6d5ff700 1 -- 172.21.15.45:0/1486081445 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e68161340 msgr2=0x7f7e6815ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:43.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.375+0000 7f7e6d5ff700 1 --2- 172.21.15.45:0/1486081445 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e68161340 0x7f7e6815ebd0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7e6000cb50 tx=0x7f7e6000ce60 comp rx=0 tx=0).stop 2023-11-28T12:06:43.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.375+0000 7f7e6d5ff700 1 -- 172.21.15.45:0/1486081445 shutdown_connections 2023-11-28T12:06:43.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.375+0000 7f7e6d5ff700 1 --2- 172.21.15.45:0/1486081445 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f7e540682f0 0x7f7e5406a7a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:43.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.375+0000 7f7e6d5ff700 1 --2- 172.21.15.45:0/1486081445 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e68161340 0x7f7e6815ebd0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:43.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.375+0000 7f7e6d5ff700 1 --2- 172.21.15.45:0/1486081445 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7e680d2320 0x7f7e68150200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:43.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.375+0000 7f7e6d5ff700 1 --2- 172.21.15.45:0/1486081445 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7e6815c9b0 0x7f7e681e7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:43.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.375+0000 7f7e6d5ff700 1 -- 172.21.15.45:0/1486081445 >> 172.21.15.45:0/1486081445 conn(0x7f7e68072600 msgr2=0x7f7e6815cd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:43.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.375+0000 7f7e6d5ff700 1 -- 172.21.15.45:0/1486081445 shutdown_connections 2023-11-28T12:06:43.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.375+0000 7f7e6d5ff700 1 -- 172.21.15.45:0/1486081445 wait complete. 2023-11-28T12:06:43.394 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T12:06:43.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.596+0000 7f61e0bff700 1 Processor -- start 2023-11-28T12:06:43.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.596+0000 7f61e0bff700 1 -- start start 2023-11-28T12:06:43.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.598+0000 7f61e0bff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f61dc161340 0x7f61dc0d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:43.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.598+0000 7f61e0bff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61dc0d1950 con 0x7f61dc15c9b0 2023-11-28T12:06:43.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.598+0000 7f61e0bff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61dc0b5520 con 0x7f61dc0d2320 2023-11-28T12:06:43.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.598+0000 7f61e0bff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61dc0b5800 con 0x7f61dc161340 2023-11-28T12:06:43.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.598+0000 7f61d3fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f61dc161340 0x7f61dc0d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:43.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.598+0000 7f61da59c700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f61dc15c9b0 0x7f61dc0b4bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:37792/0 (socket says 172.21.15.45:37792) 2023-11-28T12:06:43.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.598+0000 7f61da59c700 1 -- 172.21.15.45:0/2643074387 learned_addr learned my addr 172.21.15.45:0/2643074387 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:06:43.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.599+0000 7f61d3fff700 1 -- 172.21.15.45:0/2643074387 >> v1:172.21.15.152:6789/0 conn(0x7f61dc0d2320 legacy=0x7f61dc0cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:43.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.599+0000 7f61d3fff700 1 -- 172.21.15.45:0/2643074387 >> v1:172.21.15.45:6789/0 conn(0x7f61dc15c9b0 legacy=0x7f61dc0b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:43.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.599+0000 7f61d3fff700 1 -- 172.21.15.45:0/2643074387 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61dc0d1300 con 0x7f61dc161340 2023-11-28T12:06:43.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.599+0000 7f61d3fff700 1 --2- 172.21.15.45:0/2643074387 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f61dc161340 0x7f61dc0d1de0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f61c4009840 tx=0x7f61c4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae914915ce68229d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:43.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.599+0000 7f61d9d9b700 1 -- 172.21.15.45:0/2643074387 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c4011830 con 0x7f61dc161340 2023-11-28T12:06:43.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.599+0000 7f61d9d9b700 1 -- 172.21.15.45:0/2643074387 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61c4011990 con 0x7f61dc161340 2023-11-28T12:06:43.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.599+0000 7f61d9d9b700 1 -- 172.21.15.45:0/2643074387 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c4011d20 con 0x7f61dc161340 2023-11-28T12:06:43.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.600+0000 7f61e0bff700 1 -- 172.21.15.45:0/2643074387 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f61dc161340 msgr2=0x7f61dc0d1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:43.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.600+0000 7f61e0bff700 1 --2- 172.21.15.45:0/2643074387 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f61dc161340 0x7f61dc0d1de0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f61c4009840 tx=0x7f61c4009b50 comp rx=0 tx=0).stop 2023-11-28T12:06:43.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.600+0000 7f61e0bff700 1 -- 172.21.15.45:0/2643074387 shutdown_connections 2023-11-28T12:06:43.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.600+0000 7f61e0bff700 1 --2- 172.21.15.45:0/2643074387 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f61dc161340 0x7f61dc0d1de0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:43.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.600+0000 7f61e0bff700 1 -- 172.21.15.45:0/2643074387 >> 172.21.15.45:0/2643074387 conn(0x7f61dc072600 msgr2=0x7f61dc0cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:43.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.600+0000 7f61e0bff700 1 -- 172.21.15.45:0/2643074387 shutdown_connections 2023-11-28T12:06:43.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.600+0000 7f61e0bff700 1 -- 172.21.15.45:0/2643074387 wait complete. 2023-11-28T12:06:43.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.602+0000 7f61e0bff700 1 Processor -- start 2023-11-28T12:06:43.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.603+0000 7f61e0bff700 1 -- start start 2023-11-28T12:06:43.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.604+0000 7f61e0bff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f61dc0d2320 0x7f61dc0c82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:43.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.604+0000 7f61e0bff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f61dc15c9b0 0x7f61dc150650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:43.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.604+0000 7f61e0bff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f61dc161340 0x7f61dc1517a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:43.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.604+0000 7f61e0bff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61dc0c8830 con 0x7f61dc161340 2023-11-28T12:06:43.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.604+0000 7f61e0bff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61dc0c7830 con 0x7f61dc0d2320 2023-11-28T12:06:43.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.604+0000 7f61e0bff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61dc0c9d80 con 0x7f61dc15c9b0 2023-11-28T12:06:43.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.604+0000 7f61dad9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f61dc161340 0x7f61dc1517a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:43.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.604+0000 7f61da59c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f61dc0d2320 0x7f61dc0c82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:43.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.604+0000 7f61dad9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f61dc161340 0x7f61dc1517a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60488/0 (socket says 172.21.15.45:60488) 2023-11-28T12:06:43.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.604+0000 7f61dad9d700 1 -- 172.21.15.45:0/565570534 learned_addr learned my addr 172.21.15.45:0/565570534 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:43.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.604+0000 7f61d3fff700 1 --2- 172.21.15.45:0/565570534 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f61dc15c9b0 0x7f61dc150650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:43.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.605+0000 7f61dad9d700 1 -- 172.21.15.45:0/565570534 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f61dc15c9b0 msgr2=0x7f61dc150650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:43.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.605+0000 7f61dad9d700 1 --2- 172.21.15.45:0/565570534 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f61dc15c9b0 0x7f61dc150650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:43.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.605+0000 7f61dad9d700 1 -- 172.21.15.45:0/565570534 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f61dc0d2320 msgr2=0x7f61dc0c82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:43.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.605+0000 7f61dad9d700 1 --2- 172.21.15.45:0/565570534 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f61dc0d2320 0x7f61dc0c82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:43.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.605+0000 7f61dad9d700 1 -- 172.21.15.45:0/565570534 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61c40094a0 con 0x7f61dc161340 2023-11-28T12:06:43.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.605+0000 7f61dad9d700 1 --2- 172.21.15.45:0/565570534 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f61dc161340 0x7f61dc1517a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f61d400cbc0 tx=0x7f61d400ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:43.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.605+0000 7f61d2ffd700 1 -- 172.21.15.45:0/565570534 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d4003c00 con 0x7f61dc161340 2023-11-28T12:06:43.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.605+0000 7f61d2ffd700 1 -- 172.21.15.45:0/565570534 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61d4003d60 con 0x7f61dc161340 2023-11-28T12:06:43.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.605+0000 7f61e0bff700 1 -- 172.21.15.45:0/565570534 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61dc15cd80 con 0x7f61dc161340 2023-11-28T12:06:43.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.605+0000 7f61d2ffd700 1 -- 172.21.15.45:0/565570534 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d400aae0 con 0x7f61dc161340 2023-11-28T12:06:43.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.605+0000 7f61e0bff700 1 -- 172.21.15.45:0/565570534 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61dc0d15e0 con 0x7f61dc161340 2023-11-28T12:06:43.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.606+0000 7f61e0bff700 1 -- 172.21.15.45:0/565570534 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61dc15cf10 con 0x7f61dc161340 2023-11-28T12:06:43.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.607+0000 7f61d2ffd700 1 -- 172.21.15.45:0/565570534 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f61d4010050 con 0x7f61dc161340 2023-11-28T12:06:43.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.608+0000 7f61d2ffd700 1 --2- 172.21.15.45:0/565570534 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f61bc068320 0x7f61bc06a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:43.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.608+0000 7f61d2ffd700 1 -- 172.21.15.45:0/565570534 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f61d4085bd0 con 0x7f61dc161340 2023-11-28T12:06:43.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.608+0000 7f61da59c700 1 --2- 172.21.15.45:0/565570534 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f61bc068320 0x7f61bc06a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:43.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.609+0000 7f61da59c700 1 --2- 172.21.15.45:0/565570534 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f61bc068320 0x7f61bc06a7d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f61cc005910 tx=0x7f61cc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:43.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.612+0000 7f61d2ffd700 1 -- 172.21.15.45:0/565570534 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f61d4052340 con 0x7f61dc161340 2023-11-28T12:06:43.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.864+0000 7f61e0bff700 1 -- 172.21.15.45:0/565570534 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f61dc0745c0 con 0x7f61dc161340 2023-11-28T12:06:43.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.865+0000 7f61d2ffd700 1 -- 172.21.15.45:0/565570534 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4648 (secure 0 0 0) 0x7f61d4055960 con 0x7f61dc161340 2023-11-28T12:06:43.866 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:06:43.866 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1163718907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6835","nonce":1163718907},{"type":"v1","addr":"172.21.15.152:6837","nonce":1163718907}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4282,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/2292614522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":2292614522},{"type":"v1","addr":"172.21.15.45:6834","nonce":2292614522}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4285,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/3920917053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":3920917053},{"type":"v1","addr":"172.21.15.45:6835","nonce":3920917053}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T12:06:29.394171+0000","modified":"2023-11-28T12:06:32.886491+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.152:6836/3624153928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":3624153928},{"type":"v1","addr":"172.21.15.152:6836","nonce":3624153928}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T12:06:43.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.867+0000 7f61e0bff700 1 -- 172.21.15.45:0/565570534 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f61bc068320 msgr2=0x7f61bc06a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:43.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.867+0000 7f61e0bff700 1 --2- 172.21.15.45:0/565570534 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f61bc068320 0x7f61bc06a7d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f61cc005910 tx=0x7f61cc009040 comp rx=0 tx=0).stop 2023-11-28T12:06:43.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.867+0000 7f61e0bff700 1 -- 172.21.15.45:0/565570534 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f61dc161340 msgr2=0x7f61dc1517a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:43.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.867+0000 7f61e0bff700 1 --2- 172.21.15.45:0/565570534 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f61dc161340 0x7f61dc1517a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f61d400cbc0 tx=0x7f61d400ced0 comp rx=0 tx=0).stop 2023-11-28T12:06:43.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.867+0000 7f61e0bff700 1 -- 172.21.15.45:0/565570534 shutdown_connections 2023-11-28T12:06:43.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.867+0000 7f61e0bff700 1 --2- 172.21.15.45:0/565570534 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f61bc068320 0x7f61bc06a7d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:43.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.867+0000 7f61e0bff700 1 --2- 172.21.15.45:0/565570534 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f61dc0d2320 0x7f61dc0c82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:43.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.867+0000 7f61e0bff700 1 --2- 172.21.15.45:0/565570534 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f61dc161340 0x7f61dc1517a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:43.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.867+0000 7f61e0bff700 1 --2- 172.21.15.45:0/565570534 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f61dc15c9b0 0x7f61dc150650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:43.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.867+0000 7f61e0bff700 1 -- 172.21.15.45:0/565570534 >> 172.21.15.45:0/565570534 conn(0x7f61dc072600 msgr2=0x7f61dc0b63a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:43.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.868+0000 7f61e0bff700 1 -- 172.21.15.45:0/565570534 shutdown_connections 2023-11-28T12:06:43.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:43.868+0000 7f61e0bff700 1 -- 172.21.15.45:0/565570534 wait complete. 2023-11-28T12:06:43.870 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 8 2023-11-28T12:06:44.290 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-28T12:06:29.394171+0000', 'modified': '2023-11-28T12:06:32.886491+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4288}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4288': {'gid': 4288, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.152:6836/3624153928', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6834', 'nonce': 3624153928}, {'type': 'v1', 'addr': '172.21.15.152:6836', 'nonce': 3624153928}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-28T12:06:44.290 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-28T12:06:44.290 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-11-28T12:06:44.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.496+0000 7f5df79ff700 1 Processor -- start 2023-11-28T12:06:44.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.496+0000 7f5df79ff700 1 -- start start 2023-11-28T12:06:44.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.497+0000 7f5df79ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5df00d1330 0x7f5df00b06c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:44.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.497+0000 7f5df79ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f5df00b20b0 0x7f5df00b0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:44.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.497+0000 7f5df79ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5df00b0230 con 0x7f5df00d01b0 2023-11-28T12:06:44.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.497+0000 7f5df79ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5df015cec0 con 0x7f5df00b20b0 2023-11-28T12:06:44.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.497+0000 7f5df79ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5df00b4570 con 0x7f5df00d1330 2023-11-28T12:06:44.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.498+0000 7f5df5f9c700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f5df00b20b0 0x7f5df00b0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:44.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.498+0000 7f5df4f9a700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5df00d1330 0x7f5df00b06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:44.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.498+0000 7f5df579b700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f5df00d01b0 0x7f5df00d0c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.45:47482/0 (socket says 172.21.15.45:47482) 2023-11-28T12:06:44.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.498+0000 7f5df579b700 1 -- 172.21.15.45:0/2134112878 learned_addr learned my addr 172.21.15.45:0/2134112878 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:06:44.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.498+0000 7f5de7fff700 1 -- 172.21.15.45:0/2134112878 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4269876825 0 0) 0x7f5df00b0230 con 0x7f5df00d01b0 2023-11-28T12:06:44.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.498+0000 7f5de7fff700 1 -- 172.21.15.45:0/2134112878 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ddc0035b0 con 0x7f5df00d01b0 2023-11-28T12:06:44.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.498+0000 7f5df4f9a700 1 -- 172.21.15.45:0/2134112878 >> v2:172.21.15.152:3300/0 conn(0x7f5df00b20b0 msgr2=0x7f5df00b0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:06:44.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.498+0000 7f5df4f9a700 1 --2- 172.21.15.45:0/2134112878 >> v2:172.21.15.152:3300/0 conn(0x7f5df00b20b0 0x7f5df00b0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:44.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.498+0000 7f5df4f9a700 1 -- 172.21.15.45:0/2134112878 >> v1:172.21.15.152:6789/0 conn(0x7f5df00d01b0 legacy=0x7f5df00d0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:44.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.498+0000 7f5df4f9a700 1 -- 172.21.15.45:0/2134112878 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5df00b4850 con 0x7f5df00d1330 2023-11-28T12:06:44.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.498+0000 7f5df5f9c700 1 --2- 172.21.15.45:0/2134112878 >> v2:172.21.15.152:3300/0 conn(0x7f5df00b20b0 0x7f5df00b0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:06:44.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.499+0000 7f5df4f9a700 1 --2- 172.21.15.45:0/2134112878 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5df00d1330 0x7f5df00b06c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5de0009840 tx=0x7f5de0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6fa9acf81a90a278 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:44.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.499+0000 7f5de7fff700 1 -- 172.21.15.45:0/2134112878 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de0011830 con 0x7f5df00d1330 2023-11-28T12:06:44.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.499+0000 7f5de7fff700 1 -- 172.21.15.45:0/2134112878 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5de0011990 con 0x7f5df00d1330 2023-11-28T12:06:44.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.499+0000 7f5de7fff700 1 -- 172.21.15.45:0/2134112878 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de0011d20 con 0x7f5df00d1330 2023-11-28T12:06:44.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.499+0000 7f5df79ff700 1 -- 172.21.15.45:0/2134112878 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5df00d1330 msgr2=0x7f5df00b06c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:44.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.499+0000 7f5df79ff700 1 --2- 172.21.15.45:0/2134112878 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5df00d1330 0x7f5df00b06c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5de0009840 tx=0x7f5de0009b50 comp rx=0 tx=0).stop 2023-11-28T12:06:44.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.500+0000 7f5df79ff700 1 -- 172.21.15.45:0/2134112878 shutdown_connections 2023-11-28T12:06:44.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.500+0000 7f5df79ff700 1 --2- 172.21.15.45:0/2134112878 >> v2:172.21.15.152:3300/0 conn(0x7f5df00b20b0 0x7f5df00b0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:44.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.500+0000 7f5df79ff700 1 --2- 172.21.15.45:0/2134112878 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5df00d1330 0x7f5df00b06c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:44.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.500+0000 7f5df79ff700 1 -- 172.21.15.45:0/2134112878 >> 172.21.15.45:0/2134112878 conn(0x7f5df009c3f0 msgr2=0x7f5df00d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:44.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.500+0000 7f5df79ff700 1 -- 172.21.15.45:0/2134112878 shutdown_connections 2023-11-28T12:06:44.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.500+0000 7f5df79ff700 1 -- 172.21.15.45:0/2134112878 wait complete. 2023-11-28T12:06:44.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.501+0000 7f5df79ff700 1 Processor -- start 2023-11-28T12:06:44.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.501+0000 7f5df79ff700 1 -- start start 2023-11-28T12:06:44.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.502+0000 7f5df79ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5df00b20b0 0x7f5df01f60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:44.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.502+0000 7f5df79ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5df00d01b0 0x7f5df00b6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:44.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.502+0000 7f5df79ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5df00d1330 0x7f5df015a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:44.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.502+0000 7f5df79ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df00b6db0 con 0x7f5df00d1330 2023-11-28T12:06:44.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.502+0000 7f5df79ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df015a8a0 con 0x7f5df00d01b0 2023-11-28T12:06:44.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.502+0000 7f5df79ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5df00b7200 con 0x7f5df00b20b0 2023-11-28T12:06:44.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.503+0000 7f5df5f9c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5df00d1330 0x7f5df015a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:44.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.503+0000 7f5df579b700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5df00b20b0 0x7f5df01f60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:44.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.503+0000 7f5df4f9a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5df00d01b0 0x7f5df00b6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:44.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.503+0000 7f5df5f9c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5df00d1330 0x7f5df015a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60496/0 (socket says 172.21.15.45:60496) 2023-11-28T12:06:44.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.503+0000 7f5df5f9c700 1 -- 172.21.15.45:0/436551499 learned_addr learned my addr 172.21.15.45:0/436551499 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:44.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.503+0000 7f5df5f9c700 1 -- 172.21.15.45:0/436551499 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5df00b20b0 msgr2=0x7f5df01f60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:44.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.503+0000 7f5df5f9c700 1 --2- 172.21.15.45:0/436551499 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5df00b20b0 0x7f5df01f60f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:44.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.503+0000 7f5df5f9c700 1 -- 172.21.15.45:0/436551499 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5df00d01b0 msgr2=0x7f5df00b6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:44.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.503+0000 7f5df5f9c700 1 --2- 172.21.15.45:0/436551499 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5df00d01b0 0x7f5df00b6870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:44.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.503+0000 7f5df5f9c700 1 -- 172.21.15.45:0/436551499 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5de8009a70 con 0x7f5df00d1330 2023-11-28T12:06:44.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.503+0000 7f5df5f9c700 1 --2- 172.21.15.45:0/436551499 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5df00d1330 0x7f5df015a360 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5de800efb0 tx=0x7f5de800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:44.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.504+0000 7f5de5ffb700 1 -- 172.21.15.45:0/436551499 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de800cc90 con 0x7f5df00d1330 2023-11-28T12:06:44.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.504+0000 7f5de5ffb700 1 -- 172.21.15.45:0/436551499 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5de800f040 con 0x7f5df00d1330 2023-11-28T12:06:44.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.504+0000 7f5de5ffb700 1 -- 172.21.15.45:0/436551499 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de8014480 con 0x7f5df00d1330 2023-11-28T12:06:44.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.504+0000 7f5df79ff700 1 -- 172.21.15.45:0/436551499 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5de00094a0 con 0x7f5df00d1330 2023-11-28T12:06:44.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.504+0000 7f5df79ff700 1 -- 172.21.15.45:0/436551499 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5df00afec0 con 0x7f5df00d1330 2023-11-28T12:06:44.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.506+0000 7f5de5ffb700 1 -- 172.21.15.45:0/436551499 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f5de80145e0 con 0x7f5df00d1330 2023-11-28T12:06:44.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.507+0000 7f5de5ffb700 1 --2- 172.21.15.45:0/436551499 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5dd40682f0 0x7f5dd406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:44.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.507+0000 7f5de5ffb700 1 -- 172.21.15.45:0/436551499 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5de8086b50 con 0x7f5df00d1330 2023-11-28T12:06:44.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.507+0000 7f5df579b700 1 --2- 172.21.15.45:0/436551499 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5dd40682f0 0x7f5dd406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:44.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.508+0000 7f5df579b700 1 --2- 172.21.15.45:0/436551499 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5dd40682f0 0x7f5dd406a7a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5dec007fd0 tx=0x7f5dec007dc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:44.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.509+0000 7f5e0b396b80 1 Processor -- start 2023-11-28T12:06:44.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.509+0000 7f5e0b396b80 1 -- start start 2023-11-28T12:06:44.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.510+0000 7f5e0b396b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fe36866f50 0x55fe368209f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:44.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.510+0000 7f5e0b396b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fe3685dac0 0x55fe36867320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:44.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.510+0000 7f5e0b396b80 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55fe36849660 0x55fe36821b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:44.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.510+0000 7f5e0b396b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe3679ede0 con 0x55fe36866f50 2023-11-28T12:06:44.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.510+0000 7f5e0b396b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe3670b140 con 0x55fe3685dac0 2023-11-28T12:06:44.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.510+0000 7f5e0b396b80 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fe36779db0 con 0x55fe36849660 2023-11-28T12:06:44.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.510+0000 7f5df579b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fe36866f50 0x55fe368209f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:44.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.510+0000 7f5df579b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fe36866f50 0x55fe368209f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60498/0 (socket says 172.21.15.45:60498) 2023-11-28T12:06:44.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.510+0000 7f5df579b700 1 -- 172.21.15.45:0/1001005667 learned_addr learned my addr 172.21.15.45:0/1001005667 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:44.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.510+0000 7f5df4f9a700 1 --2- 172.21.15.45:0/1001005667 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fe3685dac0 0x55fe36867320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:44.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.511+0000 7f5df5f9c700 1 --2- 172.21.15.45:0/1001005667 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55fe36849660 0x55fe36821b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:44.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.511+0000 7f5df579b700 1 -- 172.21.15.45:0/1001005667 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55fe36849660 msgr2=0x55fe36821b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:06:44.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.511+0000 7f5df579b700 1 --2- 172.21.15.45:0/1001005667 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55fe36849660 0x55fe36821b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:44.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.511+0000 7f5df579b700 1 -- 172.21.15.45:0/1001005667 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fe3685dac0 msgr2=0x55fe36867320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:06:44.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.511+0000 7f5df579b700 1 --2- 172.21.15.45:0/1001005667 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fe3685dac0 0x55fe36867320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:44.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.511+0000 7f5df579b700 1 -- 172.21.15.45:0/1001005667 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fe36567790 con 0x55fe36866f50 2023-11-28T12:06:44.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.511+0000 7f5df579b700 1 --2- 172.21.15.45:0/1001005667 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fe36866f50 0x55fe368209f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5dec005bd0 tx=0x7f5dec012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32d1808fe55d283 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:44.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.511+0000 7f5dd2ffd700 1 -- 172.21.15.45:0/1001005667 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dec006340 con 0x55fe36866f50 2023-11-28T12:06:44.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.511+0000 7f5dd2ffd700 1 -- 172.21.15.45:0/1001005667 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dec0064a0 con 0x55fe36866f50 2023-11-28T12:06:44.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.511+0000 7f5dd2ffd700 1 -- 172.21.15.45:0/1001005667 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dec006810 con 0x55fe36866f50 2023-11-28T12:06:44.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.512+0000 7f5e0b396b80 1 -- 172.21.15.45:0/1001005667 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fe36866f50 msgr2=0x55fe368209f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:44.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.512+0000 7f5e0b396b80 1 --2- 172.21.15.45:0/1001005667 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fe36866f50 0x55fe368209f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5dec005bd0 tx=0x7f5dec012000 comp rx=0 tx=0).stop 2023-11-28T12:06:44.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.512+0000 7f5e0b396b80 1 -- 172.21.15.45:0/1001005667 shutdown_connections 2023-11-28T12:06:44.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.512+0000 7f5e0b396b80 1 --2- 172.21.15.45:0/1001005667 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55fe36849660 0x55fe36821b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:44.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.512+0000 7f5e0b396b80 1 --2- 172.21.15.45:0/1001005667 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fe36866f50 0x55fe368209f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:44.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.512+0000 7f5e0b396b80 1 --2- 172.21.15.45:0/1001005667 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fe3685dac0 0x55fe36867320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:44.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.512+0000 7f5e0b396b80 1 -- 172.21.15.45:0/1001005667 >> 172.21.15.45:0/1001005667 conn(0x55fe36816d20 msgr2=0x55fe3681ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:44.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.512+0000 7f5e0b396b80 1 -- 172.21.15.45:0/1001005667 shutdown_connections 2023-11-28T12:06:44.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.512+0000 7f5e0b396b80 1 -- 172.21.15.45:0/1001005667 wait complete. 2023-11-28T12:06:44.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.513+0000 7f5e0b396b80 1 -- start start 2023-11-28T12:06:44.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.513+0000 7f5e0b396b80 1 Processor -- start 2023-11-28T12:06:44.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.515+0000 7f5e0b396b80 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55fe36849660 0x55fe36879d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:44.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.515+0000 7f5e0b396b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fe3685dac0 0x55fe368469a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:44.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.515+0000 7f5e0b396b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fe36866f50 0x55fe36862970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:44.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.515+0000 7f5e0b396b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe36773120 con 0x55fe36866f50 2023-11-28T12:06:44.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.515+0000 7f5e0b396b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe36568390 con 0x55fe3685dac0 2023-11-28T12:06:44.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.515+0000 7f5e0b396b80 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fe3670b340 con 0x55fe36849660 2023-11-28T12:06:44.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.515+0000 7f5e0b396b80 10 client.0 _ll_register_callbacks cb 0x55fe36711400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T12:06:44.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.515+0000 7f5df5f9c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fe36866f50 0x55fe36862970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:44.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.515+0000 7f5df5f9c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fe36866f50 0x55fe36862970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60502/0 (socket says 172.21.15.45:60502) 2023-11-28T12:06:44.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.515+0000 7f5df5f9c700 1 -- 172.21.15.45:0/3816043692 learned_addr learned my addr 172.21.15.45:0/3816043692 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:44.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.515+0000 7f5df579b700 1 --2- 172.21.15.45:0/3816043692 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55fe36849660 0x55fe36879d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:44.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.515+0000 7f5df4f9a700 1 --2- 172.21.15.45:0/3816043692 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fe3685dac0 0x55fe368469a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:44.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.516+0000 7f5df5f9c700 1 -- 172.21.15.45:0/3816043692 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55fe36849660 msgr2=0x55fe36879d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:06:44.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.516+0000 7f5df5f9c700 1 --2- 172.21.15.45:0/3816043692 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55fe36849660 0x55fe36879d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:44.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.516+0000 7f5df5f9c700 1 -- 172.21.15.45:0/3816043692 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fe3685dac0 msgr2=0x55fe368469a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:06:44.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.516+0000 7f5df5f9c700 1 --2- 172.21.15.45:0/3816043692 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fe3685dac0 0x55fe368469a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:44.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.516+0000 7f5df5f9c700 1 -- 172.21.15.45:0/3816043692 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ddc0035b0 con 0x55fe36866f50 2023-11-28T12:06:44.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.516+0000 7f5df5f9c700 1 --2- 172.21.15.45:0/3816043692 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fe36866f50 0x55fe36862970 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5de8007220 tx=0x7f5de8053910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd15d4af54291ef8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:44.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.516+0000 7f5dcbfff700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-11-28T12:06:44.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.516+0000 7f5dcbfff700 1 -- 172.21.15.45:0/3816043692 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de805ee50 con 0x55fe36866f50 2023-11-28T12:06:44.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.516+0000 7f5dcbfff700 1 -- 172.21.15.45:0/3816043692 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5de8024bd0 con 0x55fe36866f50 2023-11-28T12:06:44.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.516+0000 7f5e0b396b80 1 -- 172.21.15.45:0/3816043692 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fe36777030 con 0x55fe36866f50 2023-11-28T12:06:44.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.516+0000 7f5dcbfff700 1 -- 172.21.15.45:0/3816043692 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5de8024d90 con 0x55fe36866f50 2023-11-28T12:06:44.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.516+0000 7f5e0b396b80 10 client.4605 fetch_fsmap learned FSMap version 8 2023-11-28T12:06:44.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.516+0000 7f5e0b396b80 1 -- 172.21.15.45:0/3816043692 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55fe366540a0 con 0x55fe36866f50 2023-11-28T12:06:44.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.516+0000 7f5dcbfff700 1 -- 172.21.15.45:0/3816043692 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fe36777030 con 0x55fe36866f50 2023-11-28T12:06:44.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.517+0000 7f5dcbfff700 1 -- 172.21.15.45:0/3816043692 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 8) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f5de8052d70 con 0x55fe36866f50 2023-11-28T12:06:44.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.517+0000 7f5e0b396b80 10 client.4605 fetch_fsmap finished waiting for FSMap version 8 2023-11-28T12:06:44.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.517+0000 7f5e0b396b80 10 client.4605 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-28T12:06:44.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.517+0000 7f5e0b396b80 20 client.4605 populate_metadata read hostname 'smithi045' 2023-11-28T12:06:44.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.517+0000 7f5e0b396b80 1 --2- 172.21.15.45:0/3816043692 >> [v2:172.21.15.152:6834/3624153928,v1:172.21.15.152:6836/3624153928] conn(0x55fe36845610 0x55fe368459e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:44.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.517+0000 7f5e0b396b80 4 client.4605 mds_command: new command op to 4288 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-28T12:06:44.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.517+0000 7f5e0b396b80 1 -- 172.21.15.45:0/3816043692 --> [v2:172.21.15.152:6834/3624153928,v1:172.21.15.152:6836/3624153928] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fe365c2ef0 con 0x55fe36845610 2023-11-28T12:06:44.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.517+0000 7f5df579b700 1 --2- 172.21.15.45:0/3816043692 >> [v2:172.21.15.152:6834/3624153928,v1:172.21.15.152:6836/3624153928] conn(0x55fe36845610 0x55fe368459e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:44.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.518+0000 7f5df579b700 1 --2- 172.21.15.45:0/3816043692 >> [v2:172.21.15.152:6834/3624153928,v1:172.21.15.152:6836/3624153928] conn(0x55fe36845610 0x55fe368459e0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b03da9fa7fd113e1 server_cookie=5dcc27ae15532ac1 in_seq=0 out_seq=0 2023-11-28T12:06:44.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.518+0000 7f5dcbfff700 10 client.4605 ms_handle_connect on v2:172.21.15.152:6834/3624153928 2023-11-28T12:06:44.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.518+0000 7f5dcbfff700 1 -- 172.21.15.45:0/3816043692 <== mds.0 v2:172.21.15.152:6834/3624153928 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x55fe365c2ef0 con 0x55fe36845610 2023-11-28T12:06:44.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.518+0000 7f5dcbfff700 10 client.4605 handle_command_reply: tid=0 2023-11-28T12:06:44.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.519+0000 7f5e0b396b80 1 client.4605 shutdown 2023-11-28T12:06:44.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.519+0000 7f5e0b396b80 1 -- 172.21.15.45:0/3816043692 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fe36866f50 msgr2=0x55fe36862970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:44.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.519+0000 7f5e0b396b80 1 --2- 172.21.15.45:0/3816043692 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fe36866f50 0x55fe36862970 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5de8007220 tx=0x7f5de8053910 comp rx=0 tx=0).stop 2023-11-28T12:06:44.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.519+0000 7f5e0b396b80 1 -- 172.21.15.45:0/3816043692 shutdown_connections 2023-11-28T12:06:44.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.519+0000 7f5e0b396b80 1 --2- 172.21.15.45:0/3816043692 >> [v2:172.21.15.152:6834/3624153928,v1:172.21.15.152:6836/3624153928] conn(0x55fe36845610 0x55fe368459e0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:44.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.519+0000 7f5e0b396b80 1 --2- 172.21.15.45:0/3816043692 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fe36866f50 0x55fe36862970 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:44.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.519+0000 7f5e0b396b80 1 --2- 172.21.15.45:0/3816043692 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55fe36849660 0x55fe36879d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:44.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.519+0000 7f5dcbfff700 0 client.4605 ms_handle_reset on v2:172.21.15.152:6834/3624153928 2023-11-28T12:06:44.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.519+0000 7f5e0b396b80 1 --2- 172.21.15.45:0/3816043692 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fe3685dac0 0x55fe368469a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:44.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.519+0000 7f5e0b396b80 1 -- 172.21.15.45:0/3816043692 >> 172.21.15.45:0/3816043692 conn(0x55fe36816d20 msgr2=0x55fe3681ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:44.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.519+0000 7f5e0b396b80 1 -- 172.21.15.45:0/3816043692 shutdown_connections 2023-11-28T12:06:44.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.519+0000 7f5e0b396b80 1 -- 172.21.15.45:0/3816043692 wait complete. 2023-11-28T12:06:44.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.519+0000 7f5e0b396b80 20 client.4605 trim_cache size 0 max 16384 2023-11-28T12:06:44.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.537+0000 7f5e0b396b80 1 Processor -- start 2023-11-28T12:06:44.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.537+0000 7f5e0b396b80 1 -- start start 2023-11-28T12:06:44.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.538+0000 7f5e0b396b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fe36849660 0x55fe36862740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:44.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.538+0000 7f5e0b396b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fe3685dac0 0x55fe36879290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:44.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.538+0000 7f5e0b396b80 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55fe36866f50 0x55fe36821fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:44.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.538+0000 7f5e0b396b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe3681e920 con 0x55fe3685dac0 2023-11-28T12:06:44.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.538+0000 7f5e0b396b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe3684fa10 con 0x55fe36849660 2023-11-28T12:06:44.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.538+0000 7f5e0b396b80 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fe3684f7f0 con 0x55fe36866f50 2023-11-28T12:06:44.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.538+0000 7f5df4f9a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fe3685dac0 0x55fe36879290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:44.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.538+0000 7f5df4f9a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fe3685dac0 0x55fe36879290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60506/0 (socket says 172.21.15.45:60506) 2023-11-28T12:06:44.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.538+0000 7f5df4f9a700 1 -- 172.21.15.45:0/70164846 learned_addr learned my addr 172.21.15.45:0/70164846 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:44.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.539+0000 7f5df579b700 1 --2- 172.21.15.45:0/70164846 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fe36849660 0x55fe36862740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:44.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.539+0000 7f5df5f9c700 1 --2- 172.21.15.45:0/70164846 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55fe36866f50 0x55fe36821fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:44.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.539+0000 7f5df4f9a700 1 -- 172.21.15.45:0/70164846 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55fe36866f50 msgr2=0x55fe36821fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:06:44.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.539+0000 7f5df4f9a700 1 --2- 172.21.15.45:0/70164846 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55fe36866f50 0x55fe36821fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:44.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.539+0000 7f5df4f9a700 1 -- 172.21.15.45:0/70164846 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fe36849660 msgr2=0x55fe36862740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:06:44.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.539+0000 7f5df4f9a700 1 --2- 172.21.15.45:0/70164846 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fe36849660 0x55fe36862740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:44.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.539+0000 7f5df4f9a700 1 -- 172.21.15.45:0/70164846 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fe3673a2e0 con 0x55fe3685dac0 2023-11-28T12:06:44.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.539+0000 7f5df579b700 1 --2- 172.21.15.45:0/70164846 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fe36849660 0x55fe36862740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:06:44.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.539+0000 7f5df4f9a700 1 --2- 172.21.15.45:0/70164846 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fe3685dac0 0x55fe36879290 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5de0013000 tx=0x7f5de0010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=823d21ccedf9bbbf server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:44.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.539+0000 7f5dd37fe700 1 -- 172.21.15.45:0/70164846 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de0011d00 con 0x55fe3685dac0 2023-11-28T12:06:44.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.539+0000 7f5dd37fe700 1 -- 172.21.15.45:0/70164846 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5de0004040 con 0x55fe3685dac0 2023-11-28T12:06:44.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.539+0000 7f5dd37fe700 1 -- 172.21.15.45:0/70164846 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de00043f0 con 0x55fe3685dac0 2023-11-28T12:06:44.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.540+0000 7f5e0b396b80 1 -- 172.21.15.45:0/70164846 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fe3685dac0 msgr2=0x55fe36879290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:44.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.540+0000 7f5e0b396b80 1 --2- 172.21.15.45:0/70164846 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fe3685dac0 0x55fe36879290 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5de0013000 tx=0x7f5de0010000 comp rx=0 tx=0).stop 2023-11-28T12:06:44.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.540+0000 7f5e0b396b80 1 -- 172.21.15.45:0/70164846 shutdown_connections 2023-11-28T12:06:44.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.540+0000 7f5e0b396b80 1 --2- 172.21.15.45:0/70164846 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fe36849660 0x55fe36862740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:44.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.540+0000 7f5e0b396b80 1 --2- 172.21.15.45:0/70164846 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55fe36866f50 0x55fe36821fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:44.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.540+0000 7f5e0b396b80 1 --2- 172.21.15.45:0/70164846 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fe3685dac0 0x55fe36879290 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:44.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.540+0000 7f5e0b396b80 1 -- 172.21.15.45:0/70164846 >> 172.21.15.45:0/70164846 conn(0x55fe36816d20 msgr2=0x55fe368232d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:44.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.540+0000 7f5e0b396b80 1 -- 172.21.15.45:0/70164846 shutdown_connections 2023-11-28T12:06:44.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.540+0000 7f5e0b396b80 1 -- 172.21.15.45:0/70164846 wait complete. 2023-11-28T12:06:44.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.541+0000 7f5e0b396b80 1 -- start start 2023-11-28T12:06:44.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.541+0000 7f5e0b396b80 1 Processor -- start 2023-11-28T12:06:44.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.542+0000 7f5e0b396b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fe36849660 0x55fe36865c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:44.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.542+0000 7f5e0b396b80 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55fe3685dac0 0x55fe368cf700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:44.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.542+0000 7f5e0b396b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fe36866f50 0x55fe368cfc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:44.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.542+0000 7f5e0b396b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe36847c20 con 0x55fe36849660 2023-11-28T12:06:44.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.542+0000 7f5e0b396b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe3681f430 con 0x55fe36866f50 2023-11-28T12:06:44.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.542+0000 7f5e0b396b80 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fe368cf250 con 0x55fe3685dac0 2023-11-28T12:06:44.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.542+0000 7f5e0b396b80 10 client.0 _ll_register_callbacks cb 0x55fe36711400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T12:06:44.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.542+0000 7f5df579b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fe36849660 0x55fe36865c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:44.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.542+0000 7f5df579b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fe36849660 0x55fe36865c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60508/0 (socket says 172.21.15.45:60508) 2023-11-28T12:06:44.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.542+0000 7f5df579b700 1 -- 172.21.15.45:0/1052525497 learned_addr learned my addr 172.21.15.45:0/1052525497 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:44.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.542+0000 7f5df4f9a700 1 --2- 172.21.15.45:0/1052525497 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55fe3685dac0 0x55fe368cf700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:44.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.542+0000 7f5df5f9c700 1 --2- 172.21.15.45:0/1052525497 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fe36866f50 0x55fe368cfc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:44.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.543+0000 7f5df579b700 1 -- 172.21.15.45:0/1052525497 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55fe3685dac0 msgr2=0x55fe368cf700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:06:44.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.543+0000 7f5df579b700 1 --2- 172.21.15.45:0/1052525497 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55fe3685dac0 0x55fe368cf700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:44.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.543+0000 7f5df579b700 1 -- 172.21.15.45:0/1052525497 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fe36866f50 msgr2=0x55fe368cfc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:06:44.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.543+0000 7f5df579b700 1 --2- 172.21.15.45:0/1052525497 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fe36866f50 0x55fe368cfc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:44.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.543+0000 7f5df579b700 1 -- 172.21.15.45:0/1052525497 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5df00b4850 con 0x55fe36849660 2023-11-28T12:06:44.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.543+0000 7f5df579b700 1 --2- 172.21.15.45:0/1052525497 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fe36849660 0x55fe36865c00 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5dec01f000 tx=0x7f5dec000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12794485651e73b1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:44.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.543+0000 7f5dcbfff700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-11-28T12:06:44.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.543+0000 7f5dcbfff700 1 -- 172.21.15.45:0/1052525497 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dec006690 con 0x55fe36849660 2023-11-28T12:06:44.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.543+0000 7f5dcbfff700 1 -- 172.21.15.45:0/1052525497 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5dec01b050 con 0x55fe36849660 2023-11-28T12:06:44.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.543+0000 7f5e0b396b80 1 -- 172.21.15.45:0/1052525497 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5dec0064a0 con 0x55fe36849660 2023-11-28T12:06:44.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.543+0000 7f5dcbfff700 1 -- 172.21.15.45:0/1052525497 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5dec0067f0 con 0x55fe36849660 2023-11-28T12:06:44.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.543+0000 7f5e0b396b80 10 client.4611 fetch_fsmap learned FSMap version 8 2023-11-28T12:06:44.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.543+0000 7f5e0b396b80 1 -- 172.21.15.45:0/1052525497 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55fe365c81d0 con 0x55fe36849660 2023-11-28T12:06:44.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.544+0000 7f5dcbfff700 1 -- 172.21.15.45:0/1052525497 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dec0064a0 con 0x55fe36849660 2023-11-28T12:06:44.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.544+0000 7f5dcbfff700 1 -- 172.21.15.45:0/1052525497 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 8) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f5dec012070 con 0x55fe36849660 2023-11-28T12:06:44.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.544+0000 7f5e0b396b80 10 client.4611 fetch_fsmap finished waiting for FSMap version 8 2023-11-28T12:06:44.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.544+0000 7f5e0b396b80 10 client.4611 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-28T12:06:44.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.544+0000 7f5e0b396b80 20 client.4611 populate_metadata read hostname 'smithi045' 2023-11-28T12:06:44.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.544+0000 7f5e0b396b80 1 --2- 172.21.15.45:0/1052525497 >> [v2:172.21.15.152:6834/3624153928,v1:172.21.15.152:6836/3624153928] conn(0x55fe368cb050 0x55fe368cb420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:44.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.544+0000 7f5e0b396b80 4 client.4611 mds_command: new command op to 4288 tid=0[{"prefix": "status"}] 2023-11-28T12:06:44.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.544+0000 7f5e0b396b80 1 -- 172.21.15.45:0/1052525497 --> [v2:172.21.15.152:6834/3624153928,v1:172.21.15.152:6836/3624153928] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55fe365f8040 con 0x55fe368cb050 2023-11-28T12:06:44.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.544+0000 7f5df4f9a700 1 --2- 172.21.15.45:0/1052525497 >> [v2:172.21.15.152:6834/3624153928,v1:172.21.15.152:6836/3624153928] conn(0x55fe368cb050 0x55fe368cb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:44.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.545+0000 7f5df4f9a700 1 --2- 172.21.15.45:0/1052525497 >> [v2:172.21.15.152:6834/3624153928,v1:172.21.15.152:6836/3624153928] conn(0x55fe368cb050 0x55fe368cb420 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75f1e35b5f454c2d server_cookie=42c370e94f47296e in_seq=0 out_seq=0 2023-11-28T12:06:44.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.545+0000 7f5dcbfff700 10 client.4611 ms_handle_connect on v2:172.21.15.152:6834/3624153928 2023-11-28T12:06:44.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.545+0000 7f5dcbfff700 1 -- 172.21.15.45:0/1052525497 <== mds.0 v2:172.21.15.152:6834/3624153928 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+318 (crc 0 0 0) 0x55fe365f8040 con 0x55fe368cb050 2023-11-28T12:06:44.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.545+0000 7f5dcbfff700 10 client.4611 handle_command_reply: tid=0 2023-11-28T12:06:44.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.545+0000 7f5e0b396b80 1 client.4611 shutdown 2023-11-28T12:06:44.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.545+0000 7f5e0b396b80 1 -- 172.21.15.45:0/1052525497 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fe36849660 msgr2=0x55fe36865c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:44.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.545+0000 7f5e0b396b80 1 --2- 172.21.15.45:0/1052525497 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fe36849660 0x55fe36865c00 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5dec01f000 tx=0x7f5dec000ed0 comp rx=0 tx=0).stop 2023-11-28T12:06:44.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.545+0000 7f5e0b396b80 1 -- 172.21.15.45:0/1052525497 shutdown_connections 2023-11-28T12:06:44.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.545+0000 7f5e0b396b80 1 --2- 172.21.15.45:0/1052525497 >> [v2:172.21.15.152:6834/3624153928,v1:172.21.15.152:6836/3624153928] conn(0x55fe368cb050 0x55fe368cb420 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:44.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.545+0000 7f5e0b396b80 1 --2- 172.21.15.45:0/1052525497 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55fe36866f50 0x55fe368cfc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:44.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.545+0000 7f5dcbfff700 0 client.4611 ms_handle_reset on v2:172.21.15.152:6834/3624153928 2023-11-28T12:06:44.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.545+0000 7f5e0b396b80 1 --2- 172.21.15.45:0/1052525497 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fe36849660 0x55fe36865c00 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:44.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.545+0000 7f5e0b396b80 1 --2- 172.21.15.45:0/1052525497 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55fe3685dac0 0x55fe368cf700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:44.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.545+0000 7f5e0b396b80 1 -- 172.21.15.45:0/1052525497 >> 172.21.15.45:0/1052525497 conn(0x55fe36816d20 msgr2=0x55fe368785c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:44.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.545+0000 7f5e0b396b80 1 -- 172.21.15.45:0/1052525497 shutdown_connections 2023-11-28T12:06:44.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.546+0000 7f5e0b396b80 1 -- 172.21.15.45:0/1052525497 wait complete. 2023-11-28T12:06:44.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.546+0000 7f5e0b396b80 20 client.4611 trim_cache size 0 max 16384 2023-11-28T12:06:44.555 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-11-28T12:06:44.555 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_fsid": "bd7c37f1-f7c6-4778-b845-52cf2aa6e366", 2023-11-28T12:06:44.556 INFO:teuthology.orchestra.run.smithi045.stdout: "whoami": 0, 2023-11-28T12:06:44.556 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 4288, 2023-11-28T12:06:44.556 INFO:teuthology.orchestra.run.smithi045.stdout: "want_state": "up:active", 2023-11-28T12:06:44.556 INFO:teuthology.orchestra.run.smithi045.stdout: "state": "up:active", 2023-11-28T12:06:44.556 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs", 2023-11-28T12:06:44.556 INFO:teuthology.orchestra.run.smithi045.stdout: "rank_uptime": 15.148099471, 2023-11-28T12:06:44.556 INFO:teuthology.orchestra.run.smithi045.stdout: "mdsmap_epoch": 8, 2023-11-28T12:06:44.556 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch": 20, 2023-11-28T12:06:44.556 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch_barrier": 20, 2023-11-28T12:06:44.556 INFO:teuthology.orchestra.run.smithi045.stdout: "uptime": 20.824772862 2023-11-28T12:06:44.556 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-11-28T12:06:44.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.546+0000 7f5df79ff700 1 -- 172.21.15.45:0/436551499 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5dd40682f0 msgr2=0x7f5dd406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:44.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.546+0000 7f5df79ff700 1 --2- 172.21.15.45:0/436551499 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5dd40682f0 0x7f5dd406a7a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5dec007fd0 tx=0x7f5dec007dc0 comp rx=0 tx=0).stop 2023-11-28T12:06:44.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.546+0000 7f5df79ff700 1 -- 172.21.15.45:0/436551499 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5df00d1330 msgr2=0x7f5df015a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:44.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.546+0000 7f5df79ff700 1 --2- 172.21.15.45:0/436551499 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5df00d1330 0x7f5df015a360 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5de800efb0 tx=0x7f5de800c3a0 comp rx=0 tx=0).stop 2023-11-28T12:06:44.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.546+0000 7f5df79ff700 1 -- 172.21.15.45:0/436551499 shutdown_connections 2023-11-28T12:06:44.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.546+0000 7f5df79ff700 1 --2- 172.21.15.45:0/436551499 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5dd40682f0 0x7f5dd406a7a0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:44.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.546+0000 7f5df79ff700 1 --2- 172.21.15.45:0/436551499 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5df00d1330 0x7f5df015a360 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:44.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.546+0000 7f5df79ff700 1 --2- 172.21.15.45:0/436551499 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5df00b20b0 0x7f5df01f60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:44.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.546+0000 7f5df79ff700 1 --2- 172.21.15.45:0/436551499 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5df00d01b0 0x7f5df00b6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:44.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.546+0000 7f5df79ff700 1 -- 172.21.15.45:0/436551499 >> 172.21.15.45:0/436551499 conn(0x7f5df009c3f0 msgr2=0x7f5df00b5290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:44.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.546+0000 7f5df79ff700 1 -- 172.21.15.45:0/436551499 shutdown_connections 2023-11-28T12:06:44.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:44.546+0000 7f5df79ff700 1 -- 172.21.15.45:0/436551499 wait complete. 2023-11-28T12:06:44.564 INFO:teuthology.run_tasks:Running task kclient... 2023-11-28T12:06:44.588 INFO:tasks.kclient:Mounting kernel clients... 2023-11-28T12:06:44.588 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-11-28T12:06:44.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:06:44.589 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2023-11-28T12:06:44.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:06:44.637 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link delete ceph-brx 2023-11-28T12:06:44.751 INFO:teuthology.orchestra.run.smithi045.stderr:Cannot find device "ceph-brx" 2023-11-28T12:06:44.754 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T12:06:44.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:06:44.755 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2023-11-28T12:06:44.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:06:44.803 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link delete ceph-brx 2023-11-28T12:06:44.875 INFO:teuthology.orchestra.run.smithi045.stderr:Cannot find device "ceph-brx" 2023-11-28T12:06:44.878 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T12:06:44.878 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:06:44.878 DEBUG:teuthology.orchestra.run.smithi152:> ip netns list 2023-11-28T12:06:44.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:06:44.935 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link delete ceph-brx 2023-11-28T12:06:45.012 INFO:teuthology.orchestra.run.smithi152.stderr:Cannot find device "ceph-brx" 2023-11-28T12:06:45.015 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T12:06:45.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:06:45.015 DEBUG:teuthology.orchestra.run.smithi152:> ip netns list 2023-11-28T12:06:45.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:06:45.063 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link delete ceph-brx 2023-11-28T12:06:45.135 INFO:teuthology.orchestra.run.smithi152.stderr:Cannot find device "ceph-brx" 2023-11-28T12:06:45.137 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T12:06:45.139 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2023-11-28T12:06:45.140 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-28T12:06:45.141 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-28T12:06:45.141 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T12:06:45.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:45.344+0000 7f727adff700 1 Processor -- start 2023-11-28T12:06:45.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:45.345+0000 7f727adff700 1 -- start start 2023-11-28T12:06:45.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:45.346+0000 7f727adff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f7274159860 0x7f72740c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:45.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:45.346+0000 7f727adff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72740ccc00 con 0x7f72740b0d80 2023-11-28T12:06:45.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:45.346+0000 7f727adff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72740ccec0 con 0x7f7274159490 2023-11-28T12:06:45.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:45.346+0000 7f727adff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72740cd1a0 con 0x7f7274159860 2023-11-28T12:06:45.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:45.346+0000 7f727939c700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f72740b0d80 0x7f72740c9a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:37802/0 (socket says 172.21.15.45:37802) 2023-11-28T12:06:45.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:45.346+0000 7f727939c700 1 -- 172.21.15.45:0/2365723199 learned_addr learned my addr 172.21.15.45:0/2365723199 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:06:45.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:45.346+0000 7f7273fff700 1 --2- 172.21.15.45:0/2365723199 >> v2:172.21.15.152:3300/0 conn(0x7f7274159860 0x7f72740c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:45.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:45.346+0000 7f72737fe700 1 -- 172.21.15.45:0/2365723199 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3095584299 0 0) 0x7f72740ccc00 con 0x7f72740b0d80 2023-11-28T12:06:45.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:45.347+0000 7f72737fe700 1 -- 172.21.15.45:0/2365723199 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72640057c0 con 0x7f72740b0d80 2023-11-28T12:06:45.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:45.347+0000 7f72737fe700 1 -- 172.21.15.45:0/2365723199 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4151929113 0 0) 0x7f72740ccec0 con 0x7f7274159490 2023-11-28T12:06:45.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:45.347+0000 7f72737fe700 1 -- 172.21.15.45:0/2365723199 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72740ccc00 con 0x7f7274159490 2023-11-28T12:06:45.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:45.347+0000 7f7273fff700 1 -- 172.21.15.45:0/2365723199 >> v1:172.21.15.152:6789/0 conn(0x7f7274159490 legacy=0x7f72740b0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:45.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:45.347+0000 7f7273fff700 1 -- 172.21.15.45:0/2365723199 >> v1:172.21.15.45:6789/0 conn(0x7f72740b0d80 legacy=0x7f72740c9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:45.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:45.347+0000 7f7273fff700 1 -- 172.21.15.45:0/2365723199 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72740cd480 con 0x7f7274159860 2023-11-28T12:06:45.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:45.347+0000 7f7273fff700 1 --2- 172.21.15.45:0/2365723199 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7274159860 0x7f72740c94c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7260009840 tx=0x7f7260009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26e1cd22493e5d02 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:45.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:45.347+0000 7f72737fe700 1 -- 172.21.15.45:0/2365723199 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7260011830 con 0x7f7274159860 2023-11-28T12:06:45.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:45.347+0000 7f72737fe700 1 -- 172.21.15.45:0/2365723199 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7260011990 con 0x7f7274159860 2023-11-28T12:06:45.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:45.347+0000 7f72737fe700 1 -- 172.21.15.45:0/2365723199 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7260011d20 con 0x7f7274159860 2023-11-28T12:06:45.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:45.348+0000 7f727adff700 1 -- 172.21.15.45:0/2365723199 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7274159860 msgr2=0x7f72740c94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:45.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:45.348+0000 7f727adff700 1 --2- 172.21.15.45:0/2365723199 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7274159860 0x7f72740c94c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7260009840 tx=0x7f7260009b50 comp rx=0 tx=0).stop 2023-11-28T12:06:45.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:45.348+0000 7f727adff700 1 -- 172.21.15.45:0/2365723199 shutdown_connections 2023-11-28T12:06:45.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:45.348+0000 7f727adff700 1 --2- 172.21.15.45:0/2365723199 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7274159860 0x7f72740c94c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:45.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:45.348+0000 7f727adff700 1 -- 172.21.15.45:0/2365723199 >> 172.21.15.45:0/2365723199 conn(0x7f72740cb670 msgr2=0x7f72740cba70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:45.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:45.348+0000 7f727adff700 1 -- 172.21.15.45:0/2365723199 shutdown_connections 2023-11-28T12:06:45.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:45.348+0000 7f727adff700 1 -- 172.21.15.45:0/2365723199 wait complete. 2023-11-28T12:06:45.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:45.350+0000 7f727adff700 1 Processor -- start 2023-11-28T12:06:45.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:45.350+0000 7f727adff700 1 -- start start 2023-11-28T12:06:45.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:45.351+0000 7f727adff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f72740b0d80 0x7f72740c8320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:45.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:45.351+0000 7f727adff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7274159490 0x7f72740c8860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:45.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:45.351+0000 7f727adff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72741534b0 0x7f72741edec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:45.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:45.351+0000 7f727adff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72740c8da0 con 0x7f72741534b0 2023-11-28T12:06:45.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:45.351+0000 7f727adff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72740c5f80 con 0x7f72740b0d80 2023-11-28T12:06:45.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:45.351+0000 7f727adff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72740b2cd0 con 0x7f7274159490 2023-11-28T12:06:45.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:45.351+0000 7f727939c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72741534b0 0x7f72741edec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:45.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:45.351+0000 7f727939c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72741534b0 0x7f72741edec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60518/0 (socket says 172.21.15.45:60518) 2023-11-28T12:06:45.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:45.351+0000 7f727939c700 1 -- 172.21.15.45:0/3683841680 learned_addr learned my addr 172.21.15.45:0/3683841680 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:45.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:45.351+0000 7f7273fff700 1 --2- 172.21.15.45:0/3683841680 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7274159490 0x7f72740c8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:45.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:45.351+0000 7f7278b9b700 1 --2- 172.21.15.45:0/3683841680 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f72740b0d80 0x7f72740c8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:45.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:45.351+0000 7f727939c700 1 -- 172.21.15.45:0/3683841680 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7274159490 msgr2=0x7f72740c8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:45.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:45.351+0000 7f727939c700 1 --2- 172.21.15.45:0/3683841680 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7274159490 0x7f72740c8860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:45.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:45.351+0000 7f727939c700 1 -- 172.21.15.45:0/3683841680 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f72740b0d80 msgr2=0x7f72740c8320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:45.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:45.351+0000 7f727939c700 1 --2- 172.21.15.45:0/3683841680 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f72740b0d80 0x7f72740c8320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:45.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:45.351+0000 7f727939c700 1 -- 172.21.15.45:0/3683841680 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72600094a0 con 0x7f72741534b0 2023-11-28T12:06:45.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:45.351+0000 7f7278b9b700 1 --2- 172.21.15.45:0/3683841680 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f72740b0d80 0x7f72740c8320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:06:45.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:45.352+0000 7f727939c700 1 --2- 172.21.15.45:0/3683841680 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72741534b0 0x7f72741edec0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f726c00cba0 tx=0x7f726c00ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:45.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:45.352+0000 7f72717fa700 1 -- 172.21.15.45:0/3683841680 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726c00aa70 con 0x7f72741534b0 2023-11-28T12:06:45.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:45.352+0000 7f72717fa700 1 -- 172.21.15.45:0/3683841680 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f726c00abd0 con 0x7f72741534b0 2023-11-28T12:06:45.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:45.352+0000 7f72717fa700 1 -- 172.21.15.45:0/3683841680 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726c012400 con 0x7f72741534b0 2023-11-28T12:06:45.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:45.352+0000 7f727adff700 1 -- 172.21.15.45:0/3683841680 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72740cdc80 con 0x7f72741534b0 2023-11-28T12:06:45.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:45.352+0000 7f727adff700 1 -- 172.21.15.45:0/3683841680 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72740cd760 con 0x7f72741534b0 2023-11-28T12:06:45.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:45.353+0000 7f727adff700 1 -- 172.21.15.45:0/3683841680 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72740cde10 con 0x7f72741534b0 2023-11-28T12:06:45.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:45.354+0000 7f72717fa700 1 -- 172.21.15.45:0/3683841680 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f726c019030 con 0x7f72741534b0 2023-11-28T12:06:45.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:45.355+0000 7f72717fa700 1 --2- 172.21.15.45:0/3683841680 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f72580682f0 0x7f725806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:45.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:45.355+0000 7f72717fa700 1 -- 172.21.15.45:0/3683841680 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f726c085870 con 0x7f72741534b0 2023-11-28T12:06:45.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:45.356+0000 7f7278b9b700 1 --2- 172.21.15.45:0/3683841680 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f72580682f0 0x7f725806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:45.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:45.356+0000 7f7278b9b700 1 --2- 172.21.15.45:0/3683841680 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f72580682f0 0x7f725806a7a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f72680011e0 tx=0x7f7268009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:45.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:45.359+0000 7f72717fa700 1 -- 172.21.15.45:0/3683841680 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f726c0520d0 con 0x7f72741534b0 2023-11-28T12:06:45.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:45.610+0000 7f727adff700 1 -- 172.21.15.45:0/3683841680 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f72740745c0 con 0x7f72741534b0 2023-11-28T12:06:45.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:45.611+0000 7f72717fa700 1 -- 172.21.15.45:0/3683841680 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f726c017060 con 0x7f72741534b0 2023-11-28T12:06:45.611 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-28T12:06:45.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:45.613+0000 7f727adff700 1 -- 172.21.15.45:0/3683841680 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f72580682f0 msgr2=0x7f725806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:45.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:45.613+0000 7f727adff700 1 --2- 172.21.15.45:0/3683841680 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f72580682f0 0x7f725806a7a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f72680011e0 tx=0x7f7268009040 comp rx=0 tx=0).stop 2023-11-28T12:06:45.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:45.613+0000 7f727adff700 1 -- 172.21.15.45:0/3683841680 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72741534b0 msgr2=0x7f72741edec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:45.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:45.613+0000 7f727adff700 1 --2- 172.21.15.45:0/3683841680 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72741534b0 0x7f72741edec0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f726c00cba0 tx=0x7f726c00ceb0 comp rx=0 tx=0).stop 2023-11-28T12:06:45.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:45.613+0000 7f727adff700 1 -- 172.21.15.45:0/3683841680 shutdown_connections 2023-11-28T12:06:45.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:45.613+0000 7f727adff700 1 --2- 172.21.15.45:0/3683841680 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f72580682f0 0x7f725806a7a0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:45.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:45.613+0000 7f727adff700 1 --2- 172.21.15.45:0/3683841680 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f72740b0d80 0x7f72740c8320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:45.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:45.613+0000 7f727adff700 1 --2- 172.21.15.45:0/3683841680 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72741534b0 0x7f72741edec0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:45.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:45.613+0000 7f727adff700 1 --2- 172.21.15.45:0/3683841680 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7274159490 0x7f72740c8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:45.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:45.613+0000 7f727adff700 1 -- 172.21.15.45:0/3683841680 >> 172.21.15.45:0/3683841680 conn(0x7f72740cb670 msgr2=0x7f727415c310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:45.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:45.613+0000 7f727adff700 1 -- 172.21.15.45:0/3683841680 shutdown_connections 2023-11-28T12:06:45.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:45.613+0000 7f727adff700 1 -- 172.21.15.45:0/3683841680 wait complete. 2023-11-28T12:06:45.632 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-28T12:06:45.632 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T12:06:45.632 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi045.front.sepia.ceph.com 2023-11-28T12:06:45.632 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-28T12:06:45.632 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-28T12:06:45.633 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-28T12:06:45.633 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-28T12:06:45.633 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T12:06:45.633 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T12:06:45.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:06:45.633 DEBUG:teuthology.orchestra.run.smithi045:> ip addr 2023-11-28T12:06:45.680 INFO:teuthology.orchestra.run.smithi045.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T12:06:45.680 INFO:teuthology.orchestra.run.smithi045.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T12:06:45.680 INFO:teuthology.orchestra.run.smithi045.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T12:06:45.680 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T12:06:45.680 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 ::1/128 scope host 2023-11-28T12:06:45.680 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T12:06:45.680 INFO:teuthology.orchestra.run.smithi045.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-28T12:06:45.681 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a6 brd ff:ff:ff:ff:ff:ff 2023-11-28T12:06:45.681 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f0 2023-11-28T12:06:45.681 INFO:teuthology.orchestra.run.smithi045.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-28T12:06:45.681 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a7 brd ff:ff:ff:ff:ff:ff 2023-11-28T12:06:45.681 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f1 2023-11-28T12:06:45.681 INFO:teuthology.orchestra.run.smithi045.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T12:06:45.681 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:be brd ff:ff:ff:ff:ff:ff 2023-11-28T12:06:45.681 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f0 2023-11-28T12:06:45.681 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.21.15.45/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-11-28T12:06:45.681 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft 41983sec preferred_lft 41983sec 2023-11-28T12:06:45.681 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::ec4:7aff:febd:12be/64 scope link 2023-11-28T12:06:45.681 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T12:06:45.681 INFO:teuthology.orchestra.run.smithi045.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-28T12:06:45.682 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:bf brd ff:ff:ff:ff:ff:ff 2023-11-28T12:06:45.682 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f1 2023-11-28T12:06:45.683 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-28T12:06:45.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:06:45.683 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-11-28T12:06:45.683 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-11-28T12:06:45.683 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link add name ceph-brx type bridge 2023-11-28T12:06:45.683 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip addr flush dev ceph-brx 2023-11-28T12:06:45.683 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set ceph-brx up 2023-11-28T12:06:45.683 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-28T12:06:45.684 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-11-28T12:06:46.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:06:46.152 DEBUG:teuthology.orchestra.run.smithi045:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T12:06:46.260 INFO:teuthology.orchestra.run.smithi045.stdout:1 2023-11-28T12:06:46.264 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:06:46.264 DEBUG:teuthology.orchestra.run.smithi045:> route 2023-11-28T12:06:46.385 INFO:teuthology.orchestra.run.smithi045.stdout:Kernel IP routing table 2023-11-28T12:06:46.385 INFO:teuthology.orchestra.run.smithi045.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T12:06:46.385 INFO:teuthology.orchestra.run.smithi045.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-11-28T12:06:46.386 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-11-28T12:06:46.386 INFO:teuthology.orchestra.run.smithi045.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T12:06:46.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:06:46.387 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-11-28T12:06:46.387 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-11-28T12:06:46.388 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-28T12:06:46.388 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-28T12:06:46.388 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-28T12:06:46.388 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-11-28T12:06:47.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:06:47.088 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2023-11-28T12:06:47.136 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:06:47.136 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list-id 2023-11-28T12:06:47.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:06:47.184 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-11-28T12:06:47.184 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-11-28T12:06:47.184 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T12:06:47.184 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-11-28T12:06:47.184 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-11-28T12:06:47.331 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-11-28T12:06:47.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:06:47.331 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-11-28T12:06:47.331 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-11-28T12:06:47.331 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-11-28T12:06:47.331 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-28T12:06:47.331 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-11-28T12:06:47.332 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-11-28T12:06:47.332 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-11-28T12:06:47.332 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-11-28T12:06:47.606 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:06:47.607 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-11-28T12:06:47.607 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-11-28T12:06:47.607 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set brx.0 up 2023-11-28T12:06:47.607 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set dev brx.0 master ceph-brx 2023-11-28T12:06:47.607 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-11-28T12:06:47.782 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T12:06:47.782 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-28T12:06:47.829 INFO:teuthology.orchestra.run.smithi045.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-28T12:06:47.829 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T12:06:47.829 DEBUG:teuthology.orchestra.run.smithi045:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-28T12:06:47.875 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-28T12:06:47.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:06:47.875 DEBUG:teuthology.orchestra.run.smithi045:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-28T12:06:48.023 INFO:teuthology.orchestra.run.smithi045.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-28T12:06:48.023 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-28T12:06:48.024 INFO:teuthology.orchestra.run.smithi045.stdout:invalid new device string format 2023-11-28T12:06:48.469 INFO:teuthology.orchestra.run.smithi045.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-28T12:06:48.469 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-28T12:06:48.469 INFO:teuthology.orchestra.run.smithi045.stdout:invalid new device string format 2023-11-28T12:06:48.469 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: resolved to: "172.21.15.45:3300,172.21.15.152:3300,172.21.15.152:3301" 2023-11-28T12:06:48.469 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-28T12:06:48.495 INFO:teuthology.orchestra.run.smithi045.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-28T12:06:48.496 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-28T12:06:48.496 INFO:teuthology.orchestra.run.smithi045.stdout:invalid new device string format 2023-11-28T12:06:48.496 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: resolved to: "172.21.15.45:3300,172.21.15.152:3300,172.21.15.152:3301" 2023-11-28T12:06:48.497 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-28T12:06:48.497 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: resolved to: "172.21.15.45:6789,172.21.15.152:6789,172.21.15.152:6790" 2023-11-28T12:06:48.497 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.45:6789,172.21.15.152:6789,172.21.15.152:6790:/ 2023-11-28T12:06:48.497 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=bd7c37f1-f7c6-4778-b845-52cf2aa6e366" will pass to kernel 2023-11-28T12:06:48.502 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-28T12:06:48.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:06:48.503 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-28T12:06:48.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:06:48.576 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-28T12:06:48.693 INFO:teuthology.orchestra.run.smithi045.stdout:client4620 2023-11-28T12:06:48.693 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T12:06:48.694 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T12:06:48.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:06:48.741 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-28T12:06:48.873 INFO:teuthology.orchestra.run.smithi045.stdout:client4620 2023-11-28T12:06:48.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:06:48.874 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-28T12:06:48.965 INFO:teuthology.orchestra.run.smithi045.stdout:client4620 2023-11-28T12:06:48.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:06:48.965 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/bd7c37f1-f7c6-4778-b845-52cf2aa6e366.client4620/status') 2023-11-28T12:06:49.074 INFO:teuthology.orchestra.run.smithi045.stdout:instance: client.4620 (3)192.168.0.1:0/17244853 2023-11-28T12:06:49.074 INFO:teuthology.orchestra.run.smithi045.stdout:blocklisted: false 2023-11-28T12:06:49.075 INFO:teuthology.orchestra.run.smithi045.stderr:0+1 records in 2023-11-28T12:06:49.075 INFO:teuthology.orchestra.run.smithi045.stderr:0+1 records out 2023-11-28T12:06:49.075 INFO:teuthology.orchestra.run.smithi045.stderr:67 bytes copied, 5.6857e-05 s, 1.2 MB/s 2023-11-28T12:06:49.077 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2023-11-28T12:06:49.078 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-28T12:06:49.078 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-11-28T12:06:49.078 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T12:06:49.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:49.280+0000 7f1f84dff700 1 Processor -- start 2023-11-28T12:06:49.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:49.280+0000 7f1f84dff700 1 -- start start 2023-11-28T12:06:49.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:49.281+0000 7f1f84dff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1f8015c9b0 0x7f1f800b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:49.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:49.281+0000 7f1f84dff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f800d1950 con 0x7f1f800cd7c0 2023-11-28T12:06:49.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:49.281+0000 7f1f84dff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f800d24f0 con 0x7f1f80161340 2023-11-28T12:06:49.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:49.281+0000 7f1f84dff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f800b5800 con 0x7f1f8015c9b0 2023-11-28T12:06:49.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:49.281+0000 7f1f7ed9d700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f1f800cd7c0 0x7f1f800b5fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:37814/0 (socket says 172.21.15.45:37814) 2023-11-28T12:06:49.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:49.281+0000 7f1f7ed9d700 1 -- 172.21.15.45:0/2309216989 learned_addr learned my addr 172.21.15.45:0/2309216989 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:06:49.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:49.282+0000 7f1f7e59c700 1 --2- 172.21.15.45:0/2309216989 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1f8015c9b0 0x7f1f800b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:49.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:49.282+0000 7f1f7dd9b700 1 -- 172.21.15.45:0/2309216989 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1841963900 0 0) 0x7f1f800d1950 con 0x7f1f800cd7c0 2023-11-28T12:06:49.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:49.282+0000 7f1f7dd9b700 1 -- 172.21.15.45:0/2309216989 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f6c0035b0 con 0x7f1f800cd7c0 2023-11-28T12:06:49.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:49.282+0000 7f1f7dd9b700 1 -- 172.21.15.45:0/2309216989 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3501505572 0 0) 0x7f1f800d24f0 con 0x7f1f80161340 2023-11-28T12:06:49.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:49.282+0000 7f1f7dd9b700 1 -- 172.21.15.45:0/2309216989 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f800d1950 con 0x7f1f80161340 2023-11-28T12:06:49.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:49.282+0000 7f1f7dd9b700 1 -- 172.21.15.45:0/2309216989 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3720586076 0 0) 0x7f1f6c0035b0 con 0x7f1f800cd7c0 2023-11-28T12:06:49.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:49.282+0000 7f1f7e59c700 1 -- 172.21.15.45:0/2309216989 >> v1:172.21.15.152:6789/0 conn(0x7f1f80161340 legacy=0x7f1f800d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:49.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:49.282+0000 7f1f7e59c700 1 -- 172.21.15.45:0/2309216989 >> v1:172.21.15.45:6789/0 conn(0x7f1f800cd7c0 legacy=0x7f1f800b5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:49.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:49.282+0000 7f1f7e59c700 1 -- 172.21.15.45:0/2309216989 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f800b5520 con 0x7f1f8015c9b0 2023-11-28T12:06:49.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:49.283+0000 7f1f7e59c700 1 --2- 172.21.15.45:0/2309216989 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1f8015c9b0 0x7f1f800b4bf0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1f70009870 tx=0x7f1f70009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c39e82bc28bb577d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:49.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:49.283+0000 7f1f7dd9b700 1 -- 172.21.15.45:0/2309216989 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f780019f0 con 0x7f1f8015c9b0 2023-11-28T12:06:49.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:49.283+0000 7f1f7dd9b700 1 -- 172.21.15.45:0/2309216989 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f70004030 con 0x7f1f8015c9b0 2023-11-28T12:06:49.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:49.283+0000 7f1f7dd9b700 1 -- 172.21.15.45:0/2309216989 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f700043c0 con 0x7f1f8015c9b0 2023-11-28T12:06:49.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:49.283+0000 7f1f84dff700 1 -- 172.21.15.45:0/2309216989 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1f8015c9b0 msgr2=0x7f1f800b4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:49.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:49.283+0000 7f1f84dff700 1 --2- 172.21.15.45:0/2309216989 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1f8015c9b0 0x7f1f800b4bf0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1f70009870 tx=0x7f1f70009b80 comp rx=0 tx=0).stop 2023-11-28T12:06:49.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:49.283+0000 7f1f84dff700 1 -- 172.21.15.45:0/2309216989 shutdown_connections 2023-11-28T12:06:49.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:49.283+0000 7f1f84dff700 1 --2- 172.21.15.45:0/2309216989 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1f8015c9b0 0x7f1f800b4bf0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:49.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:49.283+0000 7f1f84dff700 1 -- 172.21.15.45:0/2309216989 >> 172.21.15.45:0/2309216989 conn(0x7f1f80072600 msgr2=0x7f1f800cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:49.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:49.283+0000 7f1f84dff700 1 -- 172.21.15.45:0/2309216989 shutdown_connections 2023-11-28T12:06:49.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:49.284+0000 7f1f84dff700 1 -- 172.21.15.45:0/2309216989 wait complete. 2023-11-28T12:06:49.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:49.285+0000 7f1f84dff700 1 Processor -- start 2023-11-28T12:06:49.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:49.286+0000 7f1f84dff700 1 -- start start 2023-11-28T12:06:49.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:49.286+0000 7f1f84dff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f800cd7c0 0x7f1f801e6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:49.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:49.286+0000 7f1f84dff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1f8015c9b0 0x7f1f80157200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:49.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:49.287+0000 7f1f84dff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1f80161340 0x7f1f801e8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:49.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:49.287+0000 7f1f84dff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f801e82b0 con 0x7f1f800cd7c0 2023-11-28T12:06:49.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:49.287+0000 7f1f84dff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f801e6d40 con 0x7f1f80161340 2023-11-28T12:06:49.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:49.287+0000 7f1f84dff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f801e7020 con 0x7f1f8015c9b0 2023-11-28T12:06:49.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:49.287+0000 7f1f7e59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f800cd7c0 0x7f1f801e6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:49.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:49.287+0000 7f1f7e59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f800cd7c0 0x7f1f801e6480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60534/0 (socket says 172.21.15.45:60534) 2023-11-28T12:06:49.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:49.287+0000 7f1f7e59c700 1 -- 172.21.15.45:0/3034641341 learned_addr learned my addr 172.21.15.45:0/3034641341 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:49.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:49.287+0000 7f1f7ed9d700 1 --2- 172.21.15.45:0/3034641341 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1f80161340 0x7f1f801e8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:49.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:49.287+0000 7f1f7e59c700 1 -- 172.21.15.45:0/3034641341 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1f8015c9b0 msgr2=0x7f1f80157200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:49.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:49.287+0000 7f1f77fff700 1 --2- 172.21.15.45:0/3034641341 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1f8015c9b0 0x7f1f80157200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:49.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:49.287+0000 7f1f7e59c700 1 --2- 172.21.15.45:0/3034641341 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1f8015c9b0 0x7f1f80157200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:49.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:49.287+0000 7f1f7e59c700 1 -- 172.21.15.45:0/3034641341 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1f80161340 msgr2=0x7f1f801e8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:49.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:49.287+0000 7f1f7e59c700 1 --2- 172.21.15.45:0/3034641341 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1f80161340 0x7f1f801e8740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:49.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:49.287+0000 7f1f7e59c700 1 -- 172.21.15.45:0/3034641341 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f700094a0 con 0x7f1f800cd7c0 2023-11-28T12:06:49.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:49.287+0000 7f1f7ed9d700 1 --2- 172.21.15.45:0/3034641341 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1f80161340 0x7f1f801e8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:06:49.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:49.287+0000 7f1f77fff700 1 --2- 172.21.15.45:0/3034641341 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1f8015c9b0 0x7f1f80157200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:06:49.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:49.288+0000 7f1f7e59c700 1 --2- 172.21.15.45:0/3034641341 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f800cd7c0 0x7f1f801e6480 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1f70000c00 tx=0x7f1f70004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:49.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:49.288+0000 7f1f76ffd700 1 -- 172.21.15.45:0/3034641341 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f70003e30 con 0x7f1f800cd7c0 2023-11-28T12:06:49.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:49.288+0000 7f1f76ffd700 1 -- 172.21.15.45:0/3034641341 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f7001f070 con 0x7f1f800cd7c0 2023-11-28T12:06:49.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:49.288+0000 7f1f76ffd700 1 -- 172.21.15.45:0/3034641341 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f70011870 con 0x7f1f800cd7c0 2023-11-28T12:06:49.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:49.288+0000 7f1f84dff700 1 -- 172.21.15.45:0/3034641341 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f800d15e0 con 0x7f1f800cd7c0 2023-11-28T12:06:49.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:49.288+0000 7f1f84dff700 1 -- 172.21.15.45:0/3034641341 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f800d1300 con 0x7f1f800cd7c0 2023-11-28T12:06:49.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:49.289+0000 7f1f84dff700 1 -- 172.21.15.45:0/3034641341 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f800b5130 con 0x7f1f800cd7c0 2023-11-28T12:06:49.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:49.290+0000 7f1f76ffd700 1 -- 172.21.15.45:0/3034641341 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f1f7002a020 con 0x7f1f800cd7c0 2023-11-28T12:06:49.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:49.291+0000 7f1f76ffd700 1 --2- 172.21.15.45:0/3034641341 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f1f600682f0 0x7f1f6006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:49.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:49.291+0000 7f1f76ffd700 1 -- 172.21.15.45:0/3034641341 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1f70087260 con 0x7f1f800cd7c0 2023-11-28T12:06:49.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:49.291+0000 7f1f77fff700 1 --2- 172.21.15.45:0/3034641341 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f1f600682f0 0x7f1f6006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:49.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:49.292+0000 7f1f77fff700 1 --2- 172.21.15.45:0/3034641341 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f1f600682f0 0x7f1f6006a7a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1f801f6600 tx=0x7f1f68009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:49.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:49.296+0000 7f1f76ffd700 1 -- 172.21.15.45:0/3034641341 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f1f700539d0 con 0x7f1f800cd7c0 2023-11-28T12:06:49.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:49.550+0000 7f1f84dff700 1 -- 172.21.15.45:0/3034641341 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1f800745c0 con 0x7f1f800cd7c0 2023-11-28T12:06:49.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:49.550+0000 7f1f76ffd700 1 -- 172.21.15.45:0/3034641341 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1f70056ff0 con 0x7f1f800cd7c0 2023-11-28T12:06:49.552 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-28T12:06:49.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:49.552+0000 7f1f84dff700 1 -- 172.21.15.45:0/3034641341 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f1f600682f0 msgr2=0x7f1f6006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:49.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:49.552+0000 7f1f84dff700 1 --2- 172.21.15.45:0/3034641341 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f1f600682f0 0x7f1f6006a7a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1f801f6600 tx=0x7f1f68009040 comp rx=0 tx=0).stop 2023-11-28T12:06:49.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:49.552+0000 7f1f84dff700 1 -- 172.21.15.45:0/3034641341 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f800cd7c0 msgr2=0x7f1f801e6480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:49.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:49.552+0000 7f1f84dff700 1 --2- 172.21.15.45:0/3034641341 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f800cd7c0 0x7f1f801e6480 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1f70000c00 tx=0x7f1f70004750 comp rx=0 tx=0).stop 2023-11-28T12:06:49.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:49.553+0000 7f1f84dff700 1 -- 172.21.15.45:0/3034641341 shutdown_connections 2023-11-28T12:06:49.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:49.553+0000 7f1f84dff700 1 --2- 172.21.15.45:0/3034641341 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f1f600682f0 0x7f1f6006a7a0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:49.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:49.553+0000 7f1f84dff700 1 --2- 172.21.15.45:0/3034641341 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1f80161340 0x7f1f801e8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:49.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:49.553+0000 7f1f84dff700 1 --2- 172.21.15.45:0/3034641341 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f800cd7c0 0x7f1f801e6480 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:49.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:49.553+0000 7f1f84dff700 1 --2- 172.21.15.45:0/3034641341 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1f8015c9b0 0x7f1f80157200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:49.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:49.553+0000 7f1f84dff700 1 -- 172.21.15.45:0/3034641341 >> 172.21.15.45:0/3034641341 conn(0x7f1f80072600 msgr2=0x7f1f800b70b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:49.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:49.553+0000 7f1f84dff700 1 -- 172.21.15.45:0/3034641341 shutdown_connections 2023-11-28T12:06:49.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:49.553+0000 7f1f84dff700 1 -- 172.21.15.45:0/3034641341 wait complete. 2023-11-28T12:06:49.572 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-28T12:06:49.573 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T12:06:49.573 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi045.front.sepia.ceph.com 2023-11-28T12:06:49.573 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-11-28T12:06:49.573 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-11-28T12:06:49.573 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-28T12:06:49.574 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-28T12:06:49.574 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T12:06:49.574 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-11-28T12:06:49.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:06:49.575 DEBUG:teuthology.orchestra.run.smithi045:> ip addr 2023-11-28T12:06:49.623 INFO:teuthology.orchestra.run.smithi045.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T12:06:49.623 INFO:teuthology.orchestra.run.smithi045.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T12:06:49.623 INFO:teuthology.orchestra.run.smithi045.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T12:06:49.624 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T12:06:49.624 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 ::1/128 scope host 2023-11-28T12:06:49.624 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T12:06:49.624 INFO:teuthology.orchestra.run.smithi045.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-28T12:06:49.624 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a6 brd ff:ff:ff:ff:ff:ff 2023-11-28T12:06:49.624 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f0 2023-11-28T12:06:49.624 INFO:teuthology.orchestra.run.smithi045.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-28T12:06:49.624 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a7 brd ff:ff:ff:ff:ff:ff 2023-11-28T12:06:49.624 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f1 2023-11-28T12:06:49.624 INFO:teuthology.orchestra.run.smithi045.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T12:06:49.624 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:be brd ff:ff:ff:ff:ff:ff 2023-11-28T12:06:49.625 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f0 2023-11-28T12:06:49.625 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.21.15.45/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-11-28T12:06:49.625 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft 41979sec preferred_lft 41979sec 2023-11-28T12:06:49.625 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::ec4:7aff:febd:12be/64 scope link 2023-11-28T12:06:49.625 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T12:06:49.625 INFO:teuthology.orchestra.run.smithi045.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-28T12:06:49.625 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:bf brd ff:ff:ff:ff:ff:ff 2023-11-28T12:06:49.625 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f1 2023-11-28T12:06:49.625 INFO:teuthology.orchestra.run.smithi045.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T12:06:49.625 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 62:87:bf:4a:62:2a brd ff:ff:ff:ff:ff:ff 2023-11-28T12:06:49.625 INFO:teuthology.orchestra.run.smithi045.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-28T12:06:49.625 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T12:06:49.626 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::c479:bdff:fe23:e158/64 scope link 2023-11-28T12:06:49.626 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T12:06:49.626 INFO:teuthology.orchestra.run.smithi045.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T12:06:49.626 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 62:87:bf:4a:62:2a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T12:06:49.626 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::6087:bfff:fe4a:622a/64 scope link 2023-11-28T12:06:49.626 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T12:06:49.626 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:06:49.626 DEBUG:teuthology.orchestra.run.smithi045:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T12:06:49.695 INFO:teuthology.orchestra.run.smithi045.stdout:1 2023-11-28T12:06:49.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:06:49.699 DEBUG:teuthology.orchestra.run.smithi045:> route 2023-11-28T12:06:49.750 INFO:teuthology.orchestra.run.smithi045.stdout:Kernel IP routing table 2023-11-28T12:06:49.750 INFO:teuthology.orchestra.run.smithi045.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T12:06:49.750 INFO:teuthology.orchestra.run.smithi045.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-11-28T12:06:49.750 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-11-28T12:06:49.751 INFO:teuthology.orchestra.run.smithi045.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T12:06:49.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:06:49.751 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-11-28T12:06:49.751 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-11-28T12:06:49.752 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-28T12:06:49.752 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-28T12:06:49.752 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-28T12:06:49.752 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-11-28T12:06:49.925 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:06:49.926 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2023-11-28T12:06:49.974 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-28T12:06:49.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:06:49.975 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list-id 2023-11-28T12:06:50.021 INFO:teuthology.orchestra.run.smithi045.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-11-28T12:06:50.022 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:06:50.022 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-11-28T12:06:50.022 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-11-28T12:06:50.023 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T12:06:50.023 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-11-28T12:06:50.023 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-11-28T12:06:50.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:06:50.168 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-11-28T12:06:50.240 INFO:teuthology.orchestra.run.smithi045.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T12:06:50.241 INFO:teuthology.orchestra.run.smithi045.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T12:06:50.241 INFO:teuthology.orchestra.run.smithi045.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T12:06:50.241 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T12:06:50.241 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 ::1/128 scope host 2023-11-28T12:06:50.241 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T12:06:50.241 INFO:teuthology.orchestra.run.smithi045.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T12:06:50.241 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether da:3f:2d:9d:f7:05 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-28T12:06:50.241 INFO:teuthology.orchestra.run.smithi045.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-28T12:06:50.241 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T12:06:50.241 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::d83f:2dff:fe9d:f705/64 scope link 2023-11-28T12:06:50.241 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T12:06:50.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:06:50.243 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-11-28T12:06:50.316 INFO:teuthology.orchestra.run.smithi045.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T12:06:50.316 INFO:teuthology.orchestra.run.smithi045.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T12:06:50.316 INFO:teuthology.orchestra.run.smithi045.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T12:06:50.316 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T12:06:50.316 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 ::1/128 scope host 2023-11-28T12:06:50.316 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T12:06:50.316 INFO:teuthology.orchestra.run.smithi045.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T12:06:50.317 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether da:3f:2d:9d:f7:05 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-28T12:06:50.317 INFO:teuthology.orchestra.run.smithi045.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-28T12:06:50.317 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T12:06:50.317 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::d83f:2dff:fe9d:f705/64 scope link 2023-11-28T12:06:50.317 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T12:06:50.319 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-11-28T12:06:50.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:06:50.319 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-11-28T12:06:50.319 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-11-28T12:06:50.319 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-11-28T12:06:50.319 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-11-28T12:06:50.320 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-11-28T12:06:50.320 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-11-28T12:06:50.320 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-11-28T12:06:50.320 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-11-28T12:06:50.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:06:50.571 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-11-28T12:06:50.571 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-11-28T12:06:50.572 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set brx.1 up 2023-11-28T12:06:50.572 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set dev brx.1 master ceph-brx 2023-11-28T12:06:50.572 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-11-28T12:06:50.746 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T12:06:50.746 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-11-28T12:06:50.793 INFO:teuthology.orchestra.run.smithi045.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-11-28T12:06:50.793 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T12:06:50.794 DEBUG:teuthology.orchestra.run.smithi045:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-11-28T12:06:50.840 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-28T12:06:50.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:06:50.840 DEBUG:teuthology.orchestra.run.smithi045:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-11-28T12:06:50.987 INFO:teuthology.orchestra.run.smithi045.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-11-28T12:06:50.987 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-11-28T12:06:50.987 INFO:teuthology.orchestra.run.smithi045.stdout:invalid new device string format 2023-11-28T12:06:51.003 INFO:teuthology.orchestra.run.smithi045.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-11-28T12:06:51.003 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-11-28T12:06:51.003 INFO:teuthology.orchestra.run.smithi045.stdout:invalid new device string format 2023-11-28T12:06:51.003 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: resolved to: "172.21.15.45:3300,172.21.15.152:3300,172.21.15.152:3301" 2023-11-28T12:06:51.004 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-28T12:06:51.026 INFO:teuthology.orchestra.run.smithi045.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-11-28T12:06:51.026 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-11-28T12:06:51.026 INFO:teuthology.orchestra.run.smithi045.stdout:invalid new device string format 2023-11-28T12:06:51.026 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: resolved to: "172.21.15.45:3300,172.21.15.152:3300,172.21.15.152:3301" 2023-11-28T12:06:51.026 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-28T12:06:51.026 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: resolved to: "172.21.15.45:6789,172.21.15.152:6789,172.21.15.152:6790" 2023-11-28T12:06:51.026 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.45:6789,172.21.15.152:6789,172.21.15.152:6790:/ 2023-11-28T12:06:51.026 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=bd7c37f1-f7c6-4778-b845-52cf2aa6e366" will pass to kernel 2023-11-28T12:06:51.031 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-28T12:06:51.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:06:51.032 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-11-28T12:06:51.103 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:06:51.103 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-28T12:06:51.191 INFO:teuthology.orchestra.run.smithi045.stdout:client4629 2023-11-28T12:06:51.192 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T12:06:51.192 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T12:06:51.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:06:51.238 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-28T12:06:51.367 INFO:teuthology.orchestra.run.smithi045.stdout:client4629 2023-11-28T12:06:51.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:06:51.368 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-28T12:06:51.456 INFO:teuthology.orchestra.run.smithi045.stdout:client4629 2023-11-28T12:06:51.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:06:51.457 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/bd7c37f1-f7c6-4778-b845-52cf2aa6e366.client4629/status') 2023-11-28T12:06:51.565 INFO:teuthology.orchestra.run.smithi045.stdout:instance: client.4629 (3)192.168.0.2:0/1566207873 2023-11-28T12:06:51.566 INFO:teuthology.orchestra.run.smithi045.stdout:blocklisted: false 2023-11-28T12:06:51.566 INFO:teuthology.orchestra.run.smithi045.stderr:0+1 records in 2023-11-28T12:06:51.566 INFO:teuthology.orchestra.run.smithi045.stderr:0+1 records out 2023-11-28T12:06:51.566 INFO:teuthology.orchestra.run.smithi045.stderr:69 bytes copied, 5.4026e-05 s, 1.3 MB/s 2023-11-28T12:06:51.568 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2023-11-28T12:06:51.569 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-28T12:06:51.569 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-28T12:06:51.569 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T12:06:51.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:51.772+0000 7f34825ff700 1 Processor -- start 2023-11-28T12:06:51.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:51.772+0000 7f34825ff700 1 -- start start 2023-11-28T12:06:51.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:51.773+0000 7f34825ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f347c15c9b0 0x7f347c0b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:51.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:51.773+0000 7f34825ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f347c0cd7c0 0x7f347c0cdc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:51.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:51.774+0000 7f34825ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f347c0ce160 con 0x7f347c161340 2023-11-28T12:06:51.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:51.774+0000 7f34825ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f347c0b5800 con 0x7f347c0cd7c0 2023-11-28T12:06:51.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:51.774+0000 7f34825ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f347c0d1950 con 0x7f347c15c9b0 2023-11-28T12:06:51.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:51.774+0000 7f3480b9c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f347c0cd7c0 0x7f347c0cdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:51.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:51.774+0000 7f347b7fe700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f347c161340 0x7f347c0d1de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:37822/0 (socket says 172.21.15.45:37822) 2023-11-28T12:06:51.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:51.774+0000 7f347b7fe700 1 -- 172.21.15.45:0/2604414434 learned_addr learned my addr 172.21.15.45:0/2604414434 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:06:51.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:51.774+0000 7f347bfff700 1 --2- 172.21.15.45:0/2604414434 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f347c15c9b0 0x7f347c0b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:51.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:51.774+0000 7f3480b9c700 1 -- 172.21.15.45:0/2604414434 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f347c15c9b0 msgr2=0x7f347c0b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:06:51.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:51.774+0000 7f3480b9c700 1 --2- 172.21.15.45:0/2604414434 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f347c15c9b0 0x7f347c0b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:51.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:51.774+0000 7f3480b9c700 1 -- 172.21.15.45:0/2604414434 >> v1:172.21.15.45:6789/0 conn(0x7f347c161340 legacy=0x7f347c0d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:51.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:51.774+0000 7f3480b9c700 1 -- 172.21.15.45:0/2604414434 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f347c0d24f0 con 0x7f347c0cd7c0 2023-11-28T12:06:51.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:51.774+0000 7f347affd700 1 -- 172.21.15.45:0/2604414434 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3751925783 0 0) 0x7f347c0ce160 con 0x7f347c161340 2023-11-28T12:06:51.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:51.775+0000 7f3480b9c700 1 --2- 172.21.15.45:0/2604414434 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f347c0cd7c0 0x7f347c0cdc20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3474009d90 tx=0x7f347400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=595866660ff52dba server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:51.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:51.775+0000 7f347affd700 1 -- 172.21.15.45:0/2604414434 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f347400e070 con 0x7f347c0cd7c0 2023-11-28T12:06:51.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:51.775+0000 7f347affd700 1 -- 172.21.15.45:0/2604414434 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f347400bb20 con 0x7f347c0cd7c0 2023-11-28T12:06:51.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:51.775+0000 7f347affd700 1 -- 172.21.15.45:0/2604414434 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3474012430 con 0x7f347c0cd7c0 2023-11-28T12:06:51.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:51.775+0000 7f34825ff700 1 -- 172.21.15.45:0/2604414434 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f347c0cd7c0 msgr2=0x7f347c0cdc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:51.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:51.775+0000 7f34825ff700 1 --2- 172.21.15.45:0/2604414434 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f347c0cd7c0 0x7f347c0cdc20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3474009d90 tx=0x7f347400b330 comp rx=0 tx=0).stop 2023-11-28T12:06:51.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:51.775+0000 7f34825ff700 1 -- 172.21.15.45:0/2604414434 shutdown_connections 2023-11-28T12:06:51.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:51.775+0000 7f34825ff700 1 --2- 172.21.15.45:0/2604414434 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f347c0cd7c0 0x7f347c0cdc20 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:51.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:51.775+0000 7f34825ff700 1 --2- 172.21.15.45:0/2604414434 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f347c15c9b0 0x7f347c0b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:51.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:51.775+0000 7f34825ff700 1 -- 172.21.15.45:0/2604414434 >> 172.21.15.45:0/2604414434 conn(0x7f347c072600 msgr2=0x7f347c0cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:51.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:51.776+0000 7f34825ff700 1 -- 172.21.15.45:0/2604414434 shutdown_connections 2023-11-28T12:06:51.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:51.776+0000 7f34825ff700 1 -- 172.21.15.45:0/2604414434 wait complete. 2023-11-28T12:06:51.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:51.777+0000 7f34825ff700 1 Processor -- start 2023-11-28T12:06:51.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:51.778+0000 7f34825ff700 1 -- start start 2023-11-28T12:06:51.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:51.778+0000 7f34825ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f347c0cd7c0 0x7f347c14a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:51.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:51.779+0000 7f34825ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f347c15c9b0 0x7f347c0c95c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:51.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:51.779+0000 7f34825ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f347c161340 0x7f347c1f2a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:51.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:51.779+0000 7f34825ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f347c1e83f0 con 0x7f347c0cd7c0 2023-11-28T12:06:51.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:51.779+0000 7f34825ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f347c1e77e0 con 0x7f347c161340 2023-11-28T12:06:51.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:51.779+0000 7f34825ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f347c1e7ac0 con 0x7f347c15c9b0 2023-11-28T12:06:51.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:51.779+0000 7f347bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f347c0cd7c0 0x7f347c14a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:51.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:51.779+0000 7f347bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f347c0cd7c0 0x7f347c14a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60550/0 (socket says 172.21.15.45:60550) 2023-11-28T12:06:51.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:51.779+0000 7f347bfff700 1 -- 172.21.15.45:0/2668737739 learned_addr learned my addr 172.21.15.45:0/2668737739 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:51.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:51.779+0000 7f347b7fe700 1 --2- 172.21.15.45:0/2668737739 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f347c15c9b0 0x7f347c0c95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:51.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:51.779+0000 7f3480b9c700 1 --2- 172.21.15.45:0/2668737739 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f347c161340 0x7f347c1f2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:51.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:51.779+0000 7f347bfff700 1 -- 172.21.15.45:0/2668737739 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f347c15c9b0 msgr2=0x7f347c0c95c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:51.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:51.779+0000 7f347bfff700 1 --2- 172.21.15.45:0/2668737739 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f347c15c9b0 0x7f347c0c95c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:51.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:51.779+0000 7f347bfff700 1 -- 172.21.15.45:0/2668737739 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f347c161340 msgr2=0x7f347c1f2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:51.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:51.779+0000 7f347bfff700 1 --2- 172.21.15.45:0/2668737739 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f347c161340 0x7f347c1f2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:51.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:51.779+0000 7f347bfff700 1 -- 172.21.15.45:0/2668737739 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3474009a70 con 0x7f347c0cd7c0 2023-11-28T12:06:51.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:51.779+0000 7f347bfff700 1 --2- 172.21.15.45:0/2668737739 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f347c0cd7c0 0x7f347c14a5f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f346c00e870 tx=0x7f346c00ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:51.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:51.780+0000 7f3478ff9700 1 -- 172.21.15.45:0/2668737739 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f346c009590 con 0x7f347c0cd7c0 2023-11-28T12:06:51.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:51.780+0000 7f3478ff9700 1 -- 172.21.15.45:0/2668737739 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f346c00ee70 con 0x7f347c0cd7c0 2023-11-28T12:06:51.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:51.780+0000 7f3478ff9700 1 -- 172.21.15.45:0/2668737739 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f346c00ca50 con 0x7f347c0cd7c0 2023-11-28T12:06:51.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:51.780+0000 7f34825ff700 1 -- 172.21.15.45:0/2668737739 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f347c0d1300 con 0x7f347c0cd7c0 2023-11-28T12:06:51.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:51.780+0000 7f34825ff700 1 -- 172.21.15.45:0/2668737739 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f347c0b5520 con 0x7f347c0cd7c0 2023-11-28T12:06:51.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:51.781+0000 7f34825ff700 1 -- 172.21.15.45:0/2668737739 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f347c0d15e0 con 0x7f347c0cd7c0 2023-11-28T12:06:51.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:51.782+0000 7f3478ff9700 1 -- 172.21.15.45:0/2668737739 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f346c019030 con 0x7f347c0cd7c0 2023-11-28T12:06:51.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:51.783+0000 7f3478ff9700 1 --2- 172.21.15.45:0/2668737739 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f34680682f0 0x7f346806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:51.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:51.783+0000 7f3478ff9700 1 -- 172.21.15.45:0/2668737739 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f346c085b80 con 0x7f347c0cd7c0 2023-11-28T12:06:51.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:51.784+0000 7f347b7fe700 1 --2- 172.21.15.45:0/2668737739 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f34680682f0 0x7f346806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:51.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:51.784+0000 7f347b7fe700 1 --2- 172.21.15.45:0/2668737739 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f34680682f0 0x7f346806a7a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f347c15fac0 tx=0x7f3470007c90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:51.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:51.787+0000 7f3478ff9700 1 -- 172.21.15.45:0/2668737739 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f346c0522f0 con 0x7f347c0cd7c0 2023-11-28T12:06:52.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:52.035+0000 7f34825ff700 1 -- 172.21.15.45:0/2668737739 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f347c1e86d0 con 0x7f347c0cd7c0 2023-11-28T12:06:52.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:52.035+0000 7f3478ff9700 1 -- 172.21.15.45:0/2668737739 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f346c055910 con 0x7f347c0cd7c0 2023-11-28T12:06:52.037 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-28T12:06:52.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:52.038+0000 7f34825ff700 1 -- 172.21.15.45:0/2668737739 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f34680682f0 msgr2=0x7f346806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:52.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:52.038+0000 7f34825ff700 1 --2- 172.21.15.45:0/2668737739 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f34680682f0 0x7f346806a7a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f347c15fac0 tx=0x7f3470007c90 comp rx=0 tx=0).stop 2023-11-28T12:06:52.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:52.038+0000 7f34825ff700 1 -- 172.21.15.45:0/2668737739 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f347c0cd7c0 msgr2=0x7f347c14a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:52.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:52.038+0000 7f34825ff700 1 --2- 172.21.15.45:0/2668737739 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f347c0cd7c0 0x7f347c14a5f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f346c00e870 tx=0x7f346c00ec30 comp rx=0 tx=0).stop 2023-11-28T12:06:52.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:52.038+0000 7f34825ff700 1 -- 172.21.15.45:0/2668737739 shutdown_connections 2023-11-28T12:06:52.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:52.038+0000 7f34825ff700 1 --2- 172.21.15.45:0/2668737739 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f34680682f0 0x7f346806a7a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:52.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:52.038+0000 7f34825ff700 1 --2- 172.21.15.45:0/2668737739 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f347c161340 0x7f347c1f2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:52.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:52.038+0000 7f34825ff700 1 --2- 172.21.15.45:0/2668737739 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f347c0cd7c0 0x7f347c14a5f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:52.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:52.038+0000 7f34825ff700 1 --2- 172.21.15.45:0/2668737739 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f347c15c9b0 0x7f347c0c95c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:52.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:52.038+0000 7f34825ff700 1 -- 172.21.15.45:0/2668737739 >> 172.21.15.45:0/2668737739 conn(0x7f347c072600 msgr2=0x7f347c0b5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:52.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:52.038+0000 7f34825ff700 1 -- 172.21.15.45:0/2668737739 shutdown_connections 2023-11-28T12:06:52.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:52.038+0000 7f34825ff700 1 -- 172.21.15.45:0/2668737739 wait complete. 2023-11-28T12:06:52.058 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-28T12:06:52.058 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T12:06:52.058 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi152.front.sepia.ceph.com 2023-11-28T12:06:52.058 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-28T12:06:52.058 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-28T12:06:52.058 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-28T12:06:52.058 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-28T12:06:52.058 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T12:06:52.058 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-28T12:06:52.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:06:52.059 DEBUG:teuthology.orchestra.run.smithi152:> ip addr 2023-11-28T12:06:52.110 INFO:teuthology.orchestra.run.smithi152.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T12:06:52.111 INFO:teuthology.orchestra.run.smithi152.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T12:06:52.111 INFO:teuthology.orchestra.run.smithi152.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T12:06:52.111 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2023-11-28T12:06:52.111 INFO:teuthology.orchestra.run.smithi152.stdout: inet6 ::1/128 scope host 2023-11-28T12:06:52.111 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2023-11-28T12:06:52.111 INFO:teuthology.orchestra.run.smithi152.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-28T12:06:52.111 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 0c:c4:7a:da:6c:44 brd ff:ff:ff:ff:ff:ff 2023-11-28T12:06:52.111 INFO:teuthology.orchestra.run.smithi152.stdout: altname enp7s0f0 2023-11-28T12:06:52.111 INFO:teuthology.orchestra.run.smithi152.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-28T12:06:52.111 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 0c:c4:7a:da:6c:45 brd ff:ff:ff:ff:ff:ff 2023-11-28T12:06:52.111 INFO:teuthology.orchestra.run.smithi152.stdout: altname enp7s0f1 2023-11-28T12:06:52.112 INFO:teuthology.orchestra.run.smithi152.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-28T12:06:52.112 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 0c:c4:7a:88:6d:e2 brd ff:ff:ff:ff:ff:ff 2023-11-28T12:06:52.112 INFO:teuthology.orchestra.run.smithi152.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T12:06:52.112 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 0c:c4:7a:88:6d:e3 brd ff:ff:ff:ff:ff:ff 2023-11-28T12:06:52.112 INFO:teuthology.orchestra.run.smithi152.stdout: inet 172.21.15.152/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-28T12:06:52.112 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft 42052sec preferred_lft 42052sec 2023-11-28T12:06:52.112 INFO:teuthology.orchestra.run.smithi152.stdout: inet6 fe80::ec4:7aff:fe88:6de3/64 scope link 2023-11-28T12:06:52.112 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2023-11-28T12:06:52.113 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-28T12:06:52.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:06:52.113 DEBUG:teuthology.orchestra.run.smithi152:> (cd / && exec bash -c ' 2023-11-28T12:06:52.113 DEBUG:teuthology.orchestra.run.smithi152:> set -e 2023-11-28T12:06:52.113 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link add name ceph-brx type bridge 2023-11-28T12:06:52.114 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip addr flush dev ceph-brx 2023-11-28T12:06:52.114 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link set ceph-brx up 2023-11-28T12:06:52.114 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-28T12:06:52.114 DEBUG:teuthology.orchestra.run.smithi152:> ') 2023-11-28T12:06:52.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:06:52.545 DEBUG:teuthology.orchestra.run.smithi152:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T12:06:52.653 INFO:teuthology.orchestra.run.smithi152.stdout:1 2023-11-28T12:06:52.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:06:52.657 DEBUG:teuthology.orchestra.run.smithi152:> route 2023-11-28T12:06:52.740 INFO:teuthology.orchestra.run.smithi152.stdout:Kernel IP routing table 2023-11-28T12:06:52.740 INFO:teuthology.orchestra.run.smithi152.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T12:06:52.740 INFO:teuthology.orchestra.run.smithi152.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-28T12:06:52.740 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-28T12:06:52.740 INFO:teuthology.orchestra.run.smithi152.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T12:06:52.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:06:52.741 DEBUG:teuthology.orchestra.run.smithi152:> (cd / && exec bash -c ' 2023-11-28T12:06:52.741 DEBUG:teuthology.orchestra.run.smithi152:> set -e 2023-11-28T12:06:52.741 DEBUG:teuthology.orchestra.run.smithi152:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-28T12:06:52.741 DEBUG:teuthology.orchestra.run.smithi152:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-28T12:06:52.741 DEBUG:teuthology.orchestra.run.smithi152:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-28T12:06:52.741 DEBUG:teuthology.orchestra.run.smithi152:> ') 2023-11-28T12:06:53.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:06:53.435 DEBUG:teuthology.orchestra.run.smithi152:> ip netns list 2023-11-28T12:06:53.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:06:53.484 DEBUG:teuthology.orchestra.run.smithi152:> ip netns list-id 2023-11-28T12:06:53.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:06:53.531 DEBUG:teuthology.orchestra.run.smithi152:> (cd / && exec bash -c ' 2023-11-28T12:06:53.531 DEBUG:teuthology.orchestra.run.smithi152:> set -e 2023-11-28T12:06:53.531 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-28T12:06:53.532 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-11-28T12:06:53.532 DEBUG:teuthology.orchestra.run.smithi152:> ') 2023-11-28T12:06:53.676 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-11-28T12:06:53.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:06:53.677 DEBUG:teuthology.orchestra.run.smithi152:> (cd / && exec bash -c ' 2023-11-28T12:06:53.677 DEBUG:teuthology.orchestra.run.smithi152:> set -e 2023-11-28T12:06:53.677 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-11-28T12:06:53.677 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-28T12:06:53.677 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-11-28T12:06:53.677 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-11-28T12:06:53.677 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-11-28T12:06:53.678 DEBUG:teuthology.orchestra.run.smithi152:> ') 2023-11-28T12:06:53.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:06:53.948 DEBUG:teuthology.orchestra.run.smithi152:> (cd / && exec bash -c ' 2023-11-28T12:06:53.948 DEBUG:teuthology.orchestra.run.smithi152:> set -e 2023-11-28T12:06:53.948 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link set brx.0 up 2023-11-28T12:06:53.948 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link set dev brx.0 master ceph-brx 2023-11-28T12:06:53.948 DEBUG:teuthology.orchestra.run.smithi152:> ') 2023-11-28T12:06:54.128 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T12:06:54.128 DEBUG:teuthology.orchestra.run.smithi152:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-28T12:06:54.183 INFO:teuthology.orchestra.run.smithi152.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-28T12:06:54.184 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T12:06:54.184 DEBUG:teuthology.orchestra.run.smithi152:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-28T12:06:54.271 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-28T12:06:54.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:06:54.272 DEBUG:teuthology.orchestra.run.smithi152:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-28T12:06:54.421 INFO:teuthology.orchestra.run.smithi152.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-28T12:06:54.422 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-11-28T12:06:54.422 INFO:teuthology.orchestra.run.smithi152.stdout:invalid new device string format 2023-11-28T12:06:54.861 INFO:teuthology.orchestra.run.smithi152.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-28T12:06:54.861 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-11-28T12:06:54.861 INFO:teuthology.orchestra.run.smithi152.stdout:invalid new device string format 2023-11-28T12:06:54.861 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: resolved to: "172.21.15.45:3300,172.21.15.152:3300,172.21.15.152:3301" 2023-11-28T12:06:54.862 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-28T12:06:54.886 INFO:teuthology.orchestra.run.smithi152.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-28T12:06:54.886 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-11-28T12:06:54.886 INFO:teuthology.orchestra.run.smithi152.stdout:invalid new device string format 2023-11-28T12:06:54.886 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: resolved to: "172.21.15.45:3300,172.21.15.152:3300,172.21.15.152:3301" 2023-11-28T12:06:54.886 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-28T12:06:54.886 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: resolved to: "172.21.15.45:6789,172.21.15.152:6789,172.21.15.152:6790" 2023-11-28T12:06:54.886 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.45:6789,172.21.15.152:6789,172.21.15.152:6790:/ 2023-11-28T12:06:54.887 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=bd7c37f1-f7c6-4778-b845-52cf2aa6e366" will pass to kernel 2023-11-28T12:06:54.891 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-28T12:06:54.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:06:54.892 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-28T12:06:54.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:06:54.964 DEBUG:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-28T12:06:55.061 INFO:teuthology.orchestra.run.smithi152.stdout:client4641 2023-11-28T12:06:55.061 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-11-28T12:06:55.061 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T12:06:55.108 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:06:55.108 DEBUG:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-28T12:06:55.237 INFO:teuthology.orchestra.run.smithi152.stdout:client4641 2023-11-28T12:06:55.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:06:55.238 DEBUG:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-28T12:06:55.326 INFO:teuthology.orchestra.run.smithi152.stdout:client4641 2023-11-28T12:06:55.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:06:55.327 DEBUG:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/bd7c37f1-f7c6-4778-b845-52cf2aa6e366.client4641/status') 2023-11-28T12:06:55.435 INFO:teuthology.orchestra.run.smithi152.stdout:instance: client.4641 (3)172.21.15.152:0/2962433018 2023-11-28T12:06:55.436 INFO:teuthology.orchestra.run.smithi152.stdout:blocklisted: false 2023-11-28T12:06:55.436 INFO:teuthology.orchestra.run.smithi152.stderr:0+1 records in 2023-11-28T12:06:55.436 INFO:teuthology.orchestra.run.smithi152.stderr:0+1 records out 2023-11-28T12:06:55.436 INFO:teuthology.orchestra.run.smithi152.stderr:71 bytes copied, 5.3959e-05 s, 1.3 MB/s 2023-11-28T12:06:55.438 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2023-11-28T12:06:55.439 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-28T12:06:55.439 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-11-28T12:06:55.439 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T12:06:55.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:55.652+0000 7fa15e7ff700 1 Processor -- start 2023-11-28T12:06:55.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:55.652+0000 7fa15e7ff700 1 -- start start 2023-11-28T12:06:55.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:55.654+0000 7fa15e7ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa15815c9b0 0x7fa1580b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:55.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:55.654+0000 7fa15e7ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1580d1950 con 0x7fa158161340 2023-11-28T12:06:55.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:55.654+0000 7fa15e7ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1580d24f0 con 0x7fa1580cd7c0 2023-11-28T12:06:55.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:55.654+0000 7fa15e7ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1580b5800 con 0x7fa15815c9b0 2023-11-28T12:06:55.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:55.654+0000 7fa1577fe700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fa158161340 0x7fa1580d1de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:52692/0 (socket says 172.21.15.45:52692) 2023-11-28T12:06:55.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:55.654+0000 7fa1577fe700 1 -- 172.21.15.45:0/474767162 learned_addr learned my addr 172.21.15.45:0/474767162 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:06:55.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:55.654+0000 7fa157fff700 1 --2- 172.21.15.45:0/474767162 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa15815c9b0 0x7fa1580b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:55.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:55.654+0000 7fa156ffd700 1 -- 172.21.15.45:0/474767162 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 278445640 0 0) 0x7fa1580d1950 con 0x7fa158161340 2023-11-28T12:06:55.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:55.654+0000 7fa156ffd700 1 -- 172.21.15.45:0/474767162 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1400035b0 con 0x7fa158161340 2023-11-28T12:06:55.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:55.655+0000 7fa156ffd700 1 -- 172.21.15.45:0/474767162 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 162555154 0 0) 0x7fa1580d24f0 con 0x7fa1580cd7c0 2023-11-28T12:06:55.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:55.655+0000 7fa156ffd700 1 -- 172.21.15.45:0/474767162 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1580d1950 con 0x7fa1580cd7c0 2023-11-28T12:06:55.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:55.655+0000 7fa157fff700 1 -- 172.21.15.45:0/474767162 >> v1:172.21.15.152:6789/0 conn(0x7fa1580cd7c0 legacy=0x7fa1580b5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:55.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:55.655+0000 7fa157fff700 1 -- 172.21.15.45:0/474767162 >> v1:172.21.15.45:6789/0 conn(0x7fa158161340 legacy=0x7fa1580d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:55.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:55.655+0000 7fa156ffd700 1 -- 172.21.15.45:0/474767162 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3637744738 0 0) 0x7fa1400035b0 con 0x7fa158161340 2023-11-28T12:06:55.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:55.655+0000 7fa157fff700 1 -- 172.21.15.45:0/474767162 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1580b5520 con 0x7fa15815c9b0 2023-11-28T12:06:55.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:55.655+0000 7fa157fff700 1 --2- 172.21.15.45:0/474767162 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa15815c9b0 0x7fa1580b4bf0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa148009870 tx=0x7fa148009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5fd62c51cc982e9b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:55.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:55.655+0000 7fa156ffd700 1 -- 172.21.15.45:0/474767162 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14c001670 con 0x7fa15815c9b0 2023-11-28T12:06:55.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:55.655+0000 7fa156ffd700 1 -- 172.21.15.45:0/474767162 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa148004030 con 0x7fa15815c9b0 2023-11-28T12:06:55.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:55.655+0000 7fa156ffd700 1 -- 172.21.15.45:0/474767162 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1480043c0 con 0x7fa15815c9b0 2023-11-28T12:06:55.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:55.656+0000 7fa15e7ff700 1 -- 172.21.15.45:0/474767162 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa15815c9b0 msgr2=0x7fa1580b4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:55.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:55.656+0000 7fa15e7ff700 1 --2- 172.21.15.45:0/474767162 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa15815c9b0 0x7fa1580b4bf0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa148009870 tx=0x7fa148009b80 comp rx=0 tx=0).stop 2023-11-28T12:06:55.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:55.656+0000 7fa15e7ff700 1 -- 172.21.15.45:0/474767162 shutdown_connections 2023-11-28T12:06:55.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:55.656+0000 7fa15e7ff700 1 --2- 172.21.15.45:0/474767162 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa15815c9b0 0x7fa1580b4bf0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:55.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:55.656+0000 7fa15e7ff700 1 -- 172.21.15.45:0/474767162 >> 172.21.15.45:0/474767162 conn(0x7fa158072600 msgr2=0x7fa1580cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:55.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:55.656+0000 7fa15e7ff700 1 -- 172.21.15.45:0/474767162 shutdown_connections 2023-11-28T12:06:55.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:55.656+0000 7fa15e7ff700 1 -- 172.21.15.45:0/474767162 wait complete. 2023-11-28T12:06:55.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:55.658+0000 7fa15e7ff700 1 Processor -- start 2023-11-28T12:06:55.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:55.658+0000 7fa15e7ff700 1 -- start start 2023-11-28T12:06:55.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:55.659+0000 7fa15e7ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa1580cd7c0 0x7fa1581e6d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:55.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:55.659+0000 7fa15e7ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa15815c9b0 0x7fa1581f2260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:55.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:55.659+0000 7fa15e7ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa158161340 0x7fa1580cb600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:55.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:55.659+0000 7fa15e7ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1581e7450 con 0x7fa158161340 2023-11-28T12:06:55.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:55.659+0000 7fa15e7ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1581e7240 con 0x7fa15815c9b0 2023-11-28T12:06:55.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:55.659+0000 7fa15e7ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1580cd2c0 con 0x7fa1580cd7c0 2023-11-28T12:06:55.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:55.659+0000 7fa15cd9c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa158161340 0x7fa1580cb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:55.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:55.659+0000 7fa157fff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa1580cd7c0 0x7fa1581e6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:55.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:55.659+0000 7fa15cd9c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa158161340 0x7fa1580cb600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60136/0 (socket says 172.21.15.45:60136) 2023-11-28T12:06:55.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:55.659+0000 7fa15cd9c700 1 -- 172.21.15.45:0/1931491665 learned_addr learned my addr 172.21.15.45:0/1931491665 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:55.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:55.659+0000 7fa1577fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa15815c9b0 0x7fa1581f2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:55.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:55.659+0000 7fa157fff700 1 -- 172.21.15.45:0/1931491665 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa15815c9b0 msgr2=0x7fa1581f2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:55.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:55.659+0000 7fa157fff700 1 --2- 172.21.15.45:0/1931491665 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa15815c9b0 0x7fa1581f2260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:55.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:55.660+0000 7fa157fff700 1 -- 172.21.15.45:0/1931491665 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa158161340 msgr2=0x7fa1580cb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:55.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:55.660+0000 7fa157fff700 1 --2- 172.21.15.45:0/1931491665 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa158161340 0x7fa1580cb600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:55.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:55.660+0000 7fa157fff700 1 -- 172.21.15.45:0/1931491665 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1480094a0 con 0x7fa1580cd7c0 2023-11-28T12:06:55.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:55.660+0000 7fa15cd9c700 1 --2- 172.21.15.45:0/1931491665 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa158161340 0x7fa1580cb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:06:55.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:55.660+0000 7fa157fff700 1 --2- 172.21.15.45:0/1931491665 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa1580cd7c0 0x7fa1581e6d00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa148015000 tx=0x7fa148004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:55.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:55.660+0000 7fa154ff9700 1 -- 172.21.15.45:0/1931491665 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa148003c50 con 0x7fa1580cd7c0 2023-11-28T12:06:55.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:55.660+0000 7fa154ff9700 1 -- 172.21.15.45:0/1931491665 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa14801f070 con 0x7fa1580cd7c0 2023-11-28T12:06:55.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:55.660+0000 7fa15e7ff700 1 -- 172.21.15.45:0/1931491665 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1580d15e0 con 0x7fa1580cd7c0 2023-11-28T12:06:55.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:55.660+0000 7fa154ff9700 1 -- 172.21.15.45:0/1931491665 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa148011630 con 0x7fa1580cd7c0 2023-11-28T12:06:55.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:55.660+0000 7fa15e7ff700 1 -- 172.21.15.45:0/1931491665 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1580d1300 con 0x7fa1580cd7c0 2023-11-28T12:06:55.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:55.661+0000 7fa15e7ff700 1 -- 172.21.15.45:0/1931491665 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1580b5130 con 0x7fa1580cd7c0 2023-11-28T12:06:55.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:55.662+0000 7fa154ff9700 1 -- 172.21.15.45:0/1931491665 <== mon.2 v2:172.21.15.152:3301/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fa14802a020 con 0x7fa1580cd7c0 2023-11-28T12:06:55.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:55.663+0000 7fa154ff9700 1 --2- 172.21.15.45:0/1931491665 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fa1440682f0 0x7fa14406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:55.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:55.663+0000 7fa154ff9700 1 -- 172.21.15.45:0/1931491665 <== mon.2 v2:172.21.15.152:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa148087090 con 0x7fa1580cd7c0 2023-11-28T12:06:55.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:55.663+0000 7fa1577fe700 1 --2- 172.21.15.45:0/1931491665 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fa1440682f0 0x7fa14406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:55.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:55.664+0000 7fa1577fe700 1 --2- 172.21.15.45:0/1931491665 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fa1440682f0 0x7fa14406a7a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa1581e86e0 tx=0x7fa14c007be0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:55.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:55.668+0000 7fa154ff9700 1 -- 172.21.15.45:0/1931491665 <== mon.2 v2:172.21.15.152:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fa148053800 con 0x7fa1580cd7c0 2023-11-28T12:06:55.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:55.920+0000 7fa15e7ff700 1 -- 172.21.15.45:0/1931491665 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa1580745c0 con 0x7fa1580cd7c0 2023-11-28T12:06:55.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:55.920+0000 7fa154ff9700 1 -- 172.21.15.45:0/1931491665 <== mon.2 v2:172.21.15.152:3301/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa148056e20 con 0x7fa1580cd7c0 2023-11-28T12:06:55.922 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-28T12:06:55.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:55.923+0000 7fa15e7ff700 1 -- 172.21.15.45:0/1931491665 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fa1440682f0 msgr2=0x7fa14406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:55.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:55.923+0000 7fa15e7ff700 1 --2- 172.21.15.45:0/1931491665 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fa1440682f0 0x7fa14406a7a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa1581e86e0 tx=0x7fa14c007be0 comp rx=0 tx=0).stop 2023-11-28T12:06:55.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:55.923+0000 7fa15e7ff700 1 -- 172.21.15.45:0/1931491665 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa1580cd7c0 msgr2=0x7fa1581e6d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:55.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:55.923+0000 7fa15e7ff700 1 --2- 172.21.15.45:0/1931491665 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa1580cd7c0 0x7fa1581e6d00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa148015000 tx=0x7fa148004750 comp rx=0 tx=0).stop 2023-11-28T12:06:55.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:55.923+0000 7fa15e7ff700 1 -- 172.21.15.45:0/1931491665 shutdown_connections 2023-11-28T12:06:55.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:55.923+0000 7fa15e7ff700 1 --2- 172.21.15.45:0/1931491665 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fa1440682f0 0x7fa14406a7a0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:55.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:55.923+0000 7fa15e7ff700 1 --2- 172.21.15.45:0/1931491665 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa158161340 0x7fa1580cb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:55.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:55.923+0000 7fa15e7ff700 1 --2- 172.21.15.45:0/1931491665 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa1580cd7c0 0x7fa1581e6d00 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:55.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:55.923+0000 7fa15e7ff700 1 --2- 172.21.15.45:0/1931491665 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa15815c9b0 0x7fa1581f2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:55.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:55.923+0000 7fa15e7ff700 1 -- 172.21.15.45:0/1931491665 >> 172.21.15.45:0/1931491665 conn(0x7fa158072600 msgr2=0x7fa1580cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:55.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:55.923+0000 7fa15e7ff700 1 -- 172.21.15.45:0/1931491665 shutdown_connections 2023-11-28T12:06:55.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:55.923+0000 7fa15e7ff700 1 -- 172.21.15.45:0/1931491665 wait complete. 2023-11-28T12:06:55.943 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-28T12:06:55.943 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T12:06:55.943 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi152.front.sepia.ceph.com 2023-11-28T12:06:55.943 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-11-28T12:06:55.943 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-11-28T12:06:55.943 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-28T12:06:55.943 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-28T12:06:55.943 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T12:06:55.943 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-11-28T12:06:55.943 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:06:55.944 DEBUG:teuthology.orchestra.run.smithi152:> ip addr 2023-11-28T12:06:55.992 INFO:teuthology.orchestra.run.smithi152.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T12:06:55.992 INFO:teuthology.orchestra.run.smithi152.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T12:06:55.992 INFO:teuthology.orchestra.run.smithi152.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T12:06:55.993 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2023-11-28T12:06:55.993 INFO:teuthology.orchestra.run.smithi152.stdout: inet6 ::1/128 scope host 2023-11-28T12:06:55.993 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2023-11-28T12:06:55.993 INFO:teuthology.orchestra.run.smithi152.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-28T12:06:55.993 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 0c:c4:7a:da:6c:44 brd ff:ff:ff:ff:ff:ff 2023-11-28T12:06:55.993 INFO:teuthology.orchestra.run.smithi152.stdout: altname enp7s0f0 2023-11-28T12:06:55.993 INFO:teuthology.orchestra.run.smithi152.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-28T12:06:55.993 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 0c:c4:7a:da:6c:45 brd ff:ff:ff:ff:ff:ff 2023-11-28T12:06:55.993 INFO:teuthology.orchestra.run.smithi152.stdout: altname enp7s0f1 2023-11-28T12:06:55.993 INFO:teuthology.orchestra.run.smithi152.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-28T12:06:55.993 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 0c:c4:7a:88:6d:e2 brd ff:ff:ff:ff:ff:ff 2023-11-28T12:06:55.993 INFO:teuthology.orchestra.run.smithi152.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T12:06:55.994 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 0c:c4:7a:88:6d:e3 brd ff:ff:ff:ff:ff:ff 2023-11-28T12:06:55.994 INFO:teuthology.orchestra.run.smithi152.stdout: inet 172.21.15.152/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-28T12:06:55.994 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft 42048sec preferred_lft 42048sec 2023-11-28T12:06:55.994 INFO:teuthology.orchestra.run.smithi152.stdout: inet6 fe80::ec4:7aff:fe88:6de3/64 scope link 2023-11-28T12:06:55.994 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2023-11-28T12:06:55.994 INFO:teuthology.orchestra.run.smithi152.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T12:06:55.994 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 4e:20:e4:43:cd:c7 brd ff:ff:ff:ff:ff:ff 2023-11-28T12:06:55.994 INFO:teuthology.orchestra.run.smithi152.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-28T12:06:55.994 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2023-11-28T12:06:55.994 INFO:teuthology.orchestra.run.smithi152.stdout: inet6 fe80::c426:f2ff:fe36:2547/64 scope link 2023-11-28T12:06:55.994 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2023-11-28T12:06:55.994 INFO:teuthology.orchestra.run.smithi152.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T12:06:55.995 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 4e:20:e4:43:cd:c7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-28T12:06:55.995 INFO:teuthology.orchestra.run.smithi152.stdout: inet6 fe80::4c20:e4ff:fe43:cdc7/64 scope link 2023-11-28T12:06:55.995 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2023-11-28T12:06:55.996 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:06:55.996 DEBUG:teuthology.orchestra.run.smithi152:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T12:06:56.064 INFO:teuthology.orchestra.run.smithi152.stdout:1 2023-11-28T12:06:56.067 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:06:56.067 DEBUG:teuthology.orchestra.run.smithi152:> route 2023-11-28T12:06:56.118 INFO:teuthology.orchestra.run.smithi152.stdout:Kernel IP routing table 2023-11-28T12:06:56.118 INFO:teuthology.orchestra.run.smithi152.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T12:06:56.118 INFO:teuthology.orchestra.run.smithi152.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-28T12:06:56.118 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-28T12:06:56.118 INFO:teuthology.orchestra.run.smithi152.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T12:06:56.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:06:56.119 DEBUG:teuthology.orchestra.run.smithi152:> (cd / && exec bash -c ' 2023-11-28T12:06:56.119 DEBUG:teuthology.orchestra.run.smithi152:> set -e 2023-11-28T12:06:56.119 DEBUG:teuthology.orchestra.run.smithi152:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-28T12:06:56.119 DEBUG:teuthology.orchestra.run.smithi152:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-28T12:06:56.119 DEBUG:teuthology.orchestra.run.smithi152:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-28T12:06:56.119 DEBUG:teuthology.orchestra.run.smithi152:> ') 2023-11-28T12:06:56.290 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:06:56.290 DEBUG:teuthology.orchestra.run.smithi152:> ip netns list 2023-11-28T12:06:56.337 INFO:teuthology.orchestra.run.smithi152.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-28T12:06:56.338 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:06:56.338 DEBUG:teuthology.orchestra.run.smithi152:> ip netns list-id 2023-11-28T12:06:56.424 INFO:teuthology.orchestra.run.smithi152.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-11-28T12:06:56.425 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:06:56.425 DEBUG:teuthology.orchestra.run.smithi152:> (cd / && exec bash -c ' 2023-11-28T12:06:56.425 DEBUG:teuthology.orchestra.run.smithi152:> set -e 2023-11-28T12:06:56.425 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-28T12:06:56.425 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-11-28T12:06:56.426 DEBUG:teuthology.orchestra.run.smithi152:> ') 2023-11-28T12:06:56.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:06:56.570 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-11-28T12:06:56.641 INFO:teuthology.orchestra.run.smithi152.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T12:06:56.641 INFO:teuthology.orchestra.run.smithi152.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T12:06:56.641 INFO:teuthology.orchestra.run.smithi152.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T12:06:56.641 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2023-11-28T12:06:56.641 INFO:teuthology.orchestra.run.smithi152.stdout: inet6 ::1/128 scope host 2023-11-28T12:06:56.641 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2023-11-28T12:06:56.641 INFO:teuthology.orchestra.run.smithi152.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T12:06:56.641 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether f2:08:13:4f:eb:c9 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-28T12:06:56.642 INFO:teuthology.orchestra.run.smithi152.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-28T12:06:56.642 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2023-11-28T12:06:56.642 INFO:teuthology.orchestra.run.smithi152.stdout: inet6 fe80::f008:13ff:fe4f:ebc9/64 scope link 2023-11-28T12:06:56.642 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2023-11-28T12:06:56.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:06:56.644 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-11-28T12:06:56.714 INFO:teuthology.orchestra.run.smithi152.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T12:06:56.715 INFO:teuthology.orchestra.run.smithi152.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T12:06:56.715 INFO:teuthology.orchestra.run.smithi152.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T12:06:56.715 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2023-11-28T12:06:56.715 INFO:teuthology.orchestra.run.smithi152.stdout: inet6 ::1/128 scope host 2023-11-28T12:06:56.715 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2023-11-28T12:06:56.715 INFO:teuthology.orchestra.run.smithi152.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T12:06:56.715 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether f2:08:13:4f:eb:c9 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-28T12:06:56.715 INFO:teuthology.orchestra.run.smithi152.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-28T12:06:56.715 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2023-11-28T12:06:56.715 INFO:teuthology.orchestra.run.smithi152.stdout: inet6 fe80::f008:13ff:fe4f:ebc9/64 scope link 2023-11-28T12:06:56.716 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2023-11-28T12:06:56.718 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-11-28T12:06:56.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:06:56.718 DEBUG:teuthology.orchestra.run.smithi152:> (cd / && exec bash -c ' 2023-11-28T12:06:56.718 DEBUG:teuthology.orchestra.run.smithi152:> set -e 2023-11-28T12:06:56.718 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-11-28T12:06:56.718 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-11-28T12:06:56.719 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-11-28T12:06:56.719 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-11-28T12:06:56.719 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-11-28T12:06:56.719 DEBUG:teuthology.orchestra.run.smithi152:> ') 2023-11-28T12:06:56.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:06:56.967 DEBUG:teuthology.orchestra.run.smithi152:> (cd / && exec bash -c ' 2023-11-28T12:06:56.967 DEBUG:teuthology.orchestra.run.smithi152:> set -e 2023-11-28T12:06:56.967 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link set brx.1 up 2023-11-28T12:06:56.967 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link set dev brx.1 master ceph-brx 2023-11-28T12:06:56.967 DEBUG:teuthology.orchestra.run.smithi152:> ') 2023-11-28T12:06:57.142 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T12:06:57.142 DEBUG:teuthology.orchestra.run.smithi152:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-11-28T12:06:57.188 INFO:teuthology.orchestra.run.smithi152.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-11-28T12:06:57.188 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T12:06:57.189 DEBUG:teuthology.orchestra.run.smithi152:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-11-28T12:06:57.234 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-28T12:06:57.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:06:57.234 DEBUG:teuthology.orchestra.run.smithi152:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-11-28T12:06:57.380 INFO:teuthology.orchestra.run.smithi152.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-11-28T12:06:57.380 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-11-28T12:06:57.380 INFO:teuthology.orchestra.run.smithi152.stdout:invalid new device string format 2023-11-28T12:06:57.396 INFO:teuthology.orchestra.run.smithi152.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-11-28T12:06:57.396 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-11-28T12:06:57.397 INFO:teuthology.orchestra.run.smithi152.stdout:invalid new device string format 2023-11-28T12:06:57.397 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: resolved to: "172.21.15.45:3300,172.21.15.152:3300,172.21.15.152:3301" 2023-11-28T12:06:57.397 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-28T12:06:57.417 INFO:teuthology.orchestra.run.smithi152.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-11-28T12:06:57.417 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-11-28T12:06:57.418 INFO:teuthology.orchestra.run.smithi152.stdout:invalid new device string format 2023-11-28T12:06:57.418 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: resolved to: "172.21.15.45:3300,172.21.15.152:3300,172.21.15.152:3301" 2023-11-28T12:06:57.418 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-28T12:06:57.418 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: resolved to: "172.21.15.45:6789,172.21.15.152:6789,172.21.15.152:6790" 2023-11-28T12:06:57.418 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.45:6789,172.21.15.152:6789,172.21.15.152:6790:/ 2023-11-28T12:06:57.418 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=bd7c37f1-f7c6-4778-b845-52cf2aa6e366" will pass to kernel 2023-11-28T12:06:57.422 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-28T12:06:57.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:06:57.422 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-11-28T12:06:57.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:06:57.493 DEBUG:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-28T12:06:57.581 INFO:teuthology.orchestra.run.smithi152.stdout:client4514 2023-11-28T12:06:57.582 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-11-28T12:06:57.582 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T12:06:57.629 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:06:57.629 DEBUG:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-28T12:06:57.757 INFO:teuthology.orchestra.run.smithi152.stdout:client4514 2023-11-28T12:06:57.758 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:06:57.758 DEBUG:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-28T12:06:57.847 INFO:teuthology.orchestra.run.smithi152.stdout:client4514 2023-11-28T12:06:57.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:06:57.847 DEBUG:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/bd7c37f1-f7c6-4778-b845-52cf2aa6e366.client4514/status') 2023-11-28T12:06:57.956 INFO:teuthology.orchestra.run.smithi152.stdout:instance: client.4514 (3)192.168.0.2:0/124043612 2023-11-28T12:06:57.956 INFO:teuthology.orchestra.run.smithi152.stdout:blocklisted: false 2023-11-28T12:06:57.957 INFO:teuthology.orchestra.run.smithi152.stderr:0+1 records in 2023-11-28T12:06:57.957 INFO:teuthology.orchestra.run.smithi152.stderr:0+1 records out 2023-11-28T12:06:57.957 INFO:teuthology.orchestra.run.smithi152.stderr:68 bytes copied, 6.2256e-05 s, 1.1 MB/s 2023-11-28T12:06:57.959 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-11-28T12:06:57.978 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T12:06:58.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.192+0000 7f88633ff700 1 Processor -- start 2023-11-28T12:06:58.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.192+0000 7f88633ff700 1 -- start start 2023-11-28T12:06:58.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.193+0000 7f88633ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f885c0d12f0 0x7f885c0d2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:58.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.193+0000 7f88633ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f885c0cf1f0 con 0x7f885c0b1c40 2023-11-28T12:06:58.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.193+0000 7f88633ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f885c0ce670 con 0x7f885c0b2050 2023-11-28T12:06:58.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.193+0000 7f88633ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f885c15ce80 con 0x7f885c0d12f0 2023-11-28T12:06:58.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.193+0000 7f886119b700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f885c0b1c40 0x7f885c0d0be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:52704/0 (socket says 172.21.15.45:52704) 2023-11-28T12:06:58.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.193+0000 7f886119b700 1 -- 172.21.15.45:0/3698645350 learned_addr learned my addr 172.21.15.45:0/3698645350 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:06:58.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.193+0000 7f886199c700 1 --2- 172.21.15.45:0/3698645350 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f885c0d12f0 0x7f885c0d2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:58.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.194+0000 7f8853fff700 1 -- 172.21.15.45:0/3698645350 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1137337017 0 0) 0x7f885c0cf1f0 con 0x7f885c0b1c40 2023-11-28T12:06:58.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.194+0000 7f8853fff700 1 -- 172.21.15.45:0/3698645350 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88480035b0 con 0x7f885c0b1c40 2023-11-28T12:06:58.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.194+0000 7f8853fff700 1 -- 172.21.15.45:0/3698645350 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1162258355 0 0) 0x7f885c0ce670 con 0x7f885c0b2050 2023-11-28T12:06:58.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.194+0000 7f8853fff700 1 -- 172.21.15.45:0/3698645350 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f885c0cf1f0 con 0x7f885c0b2050 2023-11-28T12:06:58.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.194+0000 7f886199c700 1 -- 172.21.15.45:0/3698645350 >> v1:172.21.15.152:6789/0 conn(0x7f885c0b2050 legacy=0x7f885c0afc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:58.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.194+0000 7f886199c700 1 -- 172.21.15.45:0/3698645350 >> v1:172.21.15.45:6789/0 conn(0x7f885c0b1c40 legacy=0x7f885c0d0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:58.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.194+0000 7f886199c700 1 -- 172.21.15.45:0/3698645350 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f885c0ce8c0 con 0x7f885c0d12f0 2023-11-28T12:06:58.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.194+0000 7f886199c700 1 --2- 172.21.15.45:0/3698645350 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f885c0d12f0 0x7f885c0d2a50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8854009dc0 tx=0x7f885400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=918fa58b153e5c08 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:58.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.195+0000 7f8853fff700 1 -- 172.21.15.45:0/3698645350 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885400e070 con 0x7f885c0d12f0 2023-11-28T12:06:58.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.195+0000 7f8853fff700 1 -- 172.21.15.45:0/3698645350 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f885400bb20 con 0x7f885c0d12f0 2023-11-28T12:06:58.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.195+0000 7f8853fff700 1 -- 172.21.15.45:0/3698645350 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8854012430 con 0x7f885c0d12f0 2023-11-28T12:06:58.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.195+0000 7f88633ff700 1 -- 172.21.15.45:0/3698645350 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f885c0d12f0 msgr2=0x7f885c0d2a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:58.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.195+0000 7f88633ff700 1 --2- 172.21.15.45:0/3698645350 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f885c0d12f0 0x7f885c0d2a50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8854009dc0 tx=0x7f885400b330 comp rx=0 tx=0).stop 2023-11-28T12:06:58.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.195+0000 7f88633ff700 1 -- 172.21.15.45:0/3698645350 shutdown_connections 2023-11-28T12:06:58.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.195+0000 7f88633ff700 1 --2- 172.21.15.45:0/3698645350 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f885c0d12f0 0x7f885c0d2a50 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:58.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.195+0000 7f88633ff700 1 -- 172.21.15.45:0/3698645350 >> 172.21.15.45:0/3698645350 conn(0x7f885c09c390 msgr2=0x7f885c0d3010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:58.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.195+0000 7f88633ff700 1 -- 172.21.15.45:0/3698645350 shutdown_connections 2023-11-28T12:06:58.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.195+0000 7f88633ff700 1 -- 172.21.15.45:0/3698645350 wait complete. 2023-11-28T12:06:58.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.197+0000 7f88633ff700 1 Processor -- start 2023-11-28T12:06:58.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.197+0000 7f88633ff700 1 -- start start 2023-11-28T12:06:58.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.198+0000 7f88633ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f885c0b1c40 0x7f885c0b85c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:58.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.198+0000 7f88633ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f885c0b2050 0x7f885c0b4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:58.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.198+0000 7f88633ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f885c0d12f0 0x7f885c1580b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:58.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.198+0000 7f88633ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f885c0b8ef0 con 0x7f885c0b2050 2023-11-28T12:06:58.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.198+0000 7f88633ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f885c0b76b0 con 0x7f885c0b1c40 2023-11-28T12:06:58.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.198+0000 7f88633ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f885c0b6de0 con 0x7f885c0d12f0 2023-11-28T12:06:58.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.198+0000 7f886099a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f885c0b2050 0x7f885c0b4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:58.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.198+0000 7f886099a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f885c0b2050 0x7f885c0b4410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60142/0 (socket says 172.21.15.45:60142) 2023-11-28T12:06:58.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.198+0000 7f886099a700 1 -- 172.21.15.45:0/81242769 learned_addr learned my addr 172.21.15.45:0/81242769 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:58.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.198+0000 7f886199c700 1 --2- 172.21.15.45:0/81242769 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f885c0d12f0 0x7f885c1580b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:58.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.198+0000 7f886119b700 1 --2- 172.21.15.45:0/81242769 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f885c0b1c40 0x7f885c0b85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:58.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.199+0000 7f886099a700 1 -- 172.21.15.45:0/81242769 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f885c0d12f0 msgr2=0x7f885c1580b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:58.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.199+0000 7f886099a700 1 --2- 172.21.15.45:0/81242769 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f885c0d12f0 0x7f885c1580b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:58.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.199+0000 7f886099a700 1 -- 172.21.15.45:0/81242769 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f885c0b1c40 msgr2=0x7f885c0b85c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:58.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.199+0000 7f886099a700 1 --2- 172.21.15.45:0/81242769 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f885c0b1c40 0x7f885c0b85c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:58.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.199+0000 7f886099a700 1 -- 172.21.15.45:0/81242769 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8854009a70 con 0x7f885c0b2050 2023-11-28T12:06:58.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.199+0000 7f886099a700 1 --2- 172.21.15.45:0/81242769 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f885c0b2050 0x7f885c0b4410 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f884c00c550 tx=0x7f884c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:58.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.199+0000 7f8851ffb700 1 -- 172.21.15.45:0/81242769 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884c0052d0 con 0x7f885c0b2050 2023-11-28T12:06:58.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.199+0000 7f8851ffb700 1 -- 172.21.15.45:0/81242769 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f884c005430 con 0x7f885c0b2050 2023-11-28T12:06:58.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.199+0000 7f8851ffb700 1 -- 172.21.15.45:0/81242769 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884c0038c0 con 0x7f885c0b2050 2023-11-28T12:06:58.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.199+0000 7f88633ff700 1 -- 172.21.15.45:0/81242769 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f885c0cee80 con 0x7f885c0b2050 2023-11-28T12:06:58.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.199+0000 7f88633ff700 1 -- 172.21.15.45:0/81242769 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f885c0ceba0 con 0x7f885c0b2050 2023-11-28T12:06:58.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.200+0000 7f88633ff700 1 -- 172.21.15.45:0/81242769 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f885c0d07d0 con 0x7f885c0b2050 2023-11-28T12:06:58.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.201+0000 7f8851ffb700 1 -- 172.21.15.45:0/81242769 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f884c019030 con 0x7f885c0b2050 2023-11-28T12:06:58.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.203+0000 7f8851ffb700 1 --2- 172.21.15.45:0/81242769 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f88400682f0 0x7f884006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:58.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.203+0000 7f8851ffb700 1 -- 172.21.15.45:0/81242769 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f884c084ff0 con 0x7f885c0b2050 2023-11-28T12:06:58.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.203+0000 7f886119b700 1 --2- 172.21.15.45:0/81242769 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f88400682f0 0x7f884006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:58.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.204+0000 7f886119b700 1 --2- 172.21.15.45:0/81242769 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f88400682f0 0x7f884006a7a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8858007fd0 tx=0x7f8858007dc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:58.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.207+0000 7f8851ffb700 1 -- 172.21.15.45:0/81242769 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f884c0517c0 con 0x7f885c0b2050 2023-11-28T12:06:58.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.412+0000 7f88633ff700 1 -- 172.21.15.45:0/81242769 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f885c0b4950 con 0x7f885c0b2050 2023-11-28T12:06:58.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.413+0000 7f8851ffb700 1 -- 172.21.15.45:0/81242769 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+17849 (secure 0 0 0) 0x7f884c017090 con 0x7f885c0b2050 2023-11-28T12:06:58.415 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:06:58.415 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":20,"fsid":"bd7c37f1-f7c6-4778-b845-52cf2aa6e366","created":"2023-11-28T12:06:09.045075+0000","modified":"2023-11-28T12:06:30.396046+0000","last_up_change":"2023-11-28T12:06:21.282227+0000","last_in_change":"2023-11-28T12:06:12.560924+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T12:06:21.807108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T12:06:22.491009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T12:06:27.684157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T12:06:28.384679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d0cdd8a-87fd-4f2c-91bd-47bdfa661905","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":115843},{"type":"v1","addr":"172.21.15.45:6808","nonce":115843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":115843},{"type":"v1","addr":"172.21.15.45:6811","nonce":115843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":115843},{"type":"v1","addr":"172.21.15.45:6815","nonce":115843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":115843},{"type":"v1","addr":"172.21.15.45:6813","nonce":115843}]},"public_addr":"172.21.15.45:6808/115843","cluster_addr":"172.21.15.45:6811/115843","heartbeat_back_addr":"172.21.15.45:6815/115843","heartbeat_front_addr":"172.21.15.45:6813/115843","state":["exists","up"]},{"osd":1,"uuid":"c5de4ebd-9ec5-40b3-9caa-9b706fab4c76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":115842},{"type":"v1","addr":"172.21.15.45:6801","nonce":115842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":115842},{"type":"v1","addr":"172.21.15.45:6803","nonce":115842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6807","nonce":115842},{"type":"v1","addr":"172.21.15.45:6809","nonce":115842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":115842},{"type":"v1","addr":"172.21.15.45:6805","nonce":115842}]},"public_addr":"172.21.15.45:6801/115842","cluster_addr":"172.21.15.45:6803/115842","heartbeat_back_addr":"172.21.15.45:6809/115842","heartbeat_front_addr":"172.21.15.45:6805/115842","state":["exists","up"]},{"osd":2,"uuid":"9f4b36b2-65d2-40e7-9fe6-a2991afa71c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":115850},{"type":"v1","addr":"172.21.15.45:6819","nonce":115850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":115850},{"type":"v1","addr":"172.21.15.45:6823","nonce":115850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":115850},{"type":"v1","addr":"172.21.15.45:6831","nonce":115850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":115850},{"type":"v1","addr":"172.21.15.45:6828","nonce":115850}]},"public_addr":"172.21.15.45:6819/115850","cluster_addr":"172.21.15.45:6823/115850","heartbeat_back_addr":"172.21.15.45:6831/115850","heartbeat_front_addr":"172.21.15.45:6828/115850","state":["exists","up"]},{"osd":3,"uuid":"6fe7ef05-4e0d-426c-bf94-44b51d4d550b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":115848},{"type":"v1","addr":"172.21.15.45:6818","nonce":115848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":115848},{"type":"v1","addr":"172.21.15.45:6822","nonce":115848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6827","nonce":115848},{"type":"v1","addr":"172.21.15.45:6829","nonce":115848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":115848},{"type":"v1","addr":"172.21.15.45:6825","nonce":115848}]},"public_addr":"172.21.15.45:6818/115848","cluster_addr":"172.21.15.45:6822/115848","heartbeat_back_addr":"172.21.15.45:6829/115848","heartbeat_front_addr":"172.21.15.45:6825/115848","state":["exists","up"]},{"osd":4,"uuid":"fa403c08-d8a1-4a3a-8384-cb465c1a654c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":116092},{"type":"v1","addr":"172.21.15.152:6801","nonce":116092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":116092},{"type":"v1","addr":"172.21.15.152:6803","nonce":116092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":116092},{"type":"v1","addr":"172.21.15.152:6807","nonce":116092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":116092},{"type":"v1","addr":"172.21.15.152:6805","nonce":116092}]},"public_addr":"172.21.15.152:6801/116092","cluster_addr":"172.21.15.152:6803/116092","heartbeat_back_addr":"172.21.15.152:6807/116092","heartbeat_front_addr":"172.21.15.152:6805/116092","state":["exists","up"]},{"osd":5,"uuid":"399fc450-39fa-43a6-bf80-0b8bcb41bd95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6815","nonce":116093},{"type":"v1","addr":"172.21.15.152:6817","nonce":116093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":116093},{"type":"v1","addr":"172.21.15.152:6819","nonce":116093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":116093},{"type":"v1","addr":"172.21.15.152:6823","nonce":116093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":116093},{"type":"v1","addr":"172.21.15.152:6821","nonce":116093}]},"public_addr":"172.21.15.152:6817/116093","cluster_addr":"172.21.15.152:6819/116093","heartbeat_back_addr":"172.21.15.152:6823/116093","heartbeat_front_addr":"172.21.15.152:6821/116093","state":["exists","up"]},{"osd":6,"uuid":"e59a4017-2d23-4627-836b-e25b2d3ddaaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":116094},{"type":"v1","addr":"172.21.15.152:6809","nonce":116094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":116094},{"type":"v1","addr":"172.21.15.152:6811","nonce":116094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":116094},{"type":"v1","addr":"172.21.15.152:6816","nonce":116094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":116094},{"type":"v1","addr":"172.21.15.152:6813","nonce":116094}]},"public_addr":"172.21.15.152:6809/116094","cluster_addr":"172.21.15.152:6811/116094","heartbeat_back_addr":"172.21.15.152:6816/116094","heartbeat_front_addr":"172.21.15.152:6813/116094","state":["exists","up"]},{"osd":7,"uuid":"8d7f9d4b-bf08-4670-8591-388c0f012a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":116097},{"type":"v1","addr":"172.21.15.152:6825","nonce":116097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":116097},{"type":"v1","addr":"172.21.15.152:6827","nonce":116097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":116097},{"type":"v1","addr":"172.21.15.152:6831","nonce":116097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":116097},{"type":"v1","addr":"172.21.15.152:6829","nonce":116097}]},"public_addr":"172.21.15.152:6825/116097","cluster_addr":"172.21.15.152:6827/116097","heartbeat_back_addr":"172.21.15.152:6831/116097","heartbeat_front_addr":"172.21.15.152:6829/116097","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.937710+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.865423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.159434+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.913090+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.131647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.966255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.972583+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.177209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T12:06:58.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.415+0000 7f88633ff700 1 -- 172.21.15.45:0/81242769 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f88400682f0 msgr2=0x7f884006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:58.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.415+0000 7f88633ff700 1 --2- 172.21.15.45:0/81242769 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f88400682f0 0x7f884006a7a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8858007fd0 tx=0x7f8858007dc0 comp rx=0 tx=0).stop 2023-11-28T12:06:58.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.415+0000 7f88633ff700 1 -- 172.21.15.45:0/81242769 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f885c0b2050 msgr2=0x7f885c0b4410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:58.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.415+0000 7f88633ff700 1 --2- 172.21.15.45:0/81242769 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f885c0b2050 0x7f885c0b4410 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f884c00c550 tx=0x7f884c00c860 comp rx=0 tx=0).stop 2023-11-28T12:06:58.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.416+0000 7f88633ff700 1 -- 172.21.15.45:0/81242769 shutdown_connections 2023-11-28T12:06:58.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.416+0000 7f88633ff700 1 --2- 172.21.15.45:0/81242769 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f88400682f0 0x7f884006a7a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:58.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.416+0000 7f88633ff700 1 --2- 172.21.15.45:0/81242769 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f885c0b1c40 0x7f885c0b85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:58.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.416+0000 7f88633ff700 1 --2- 172.21.15.45:0/81242769 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f885c0d12f0 0x7f885c1580b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:58.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.416+0000 7f88633ff700 1 --2- 172.21.15.45:0/81242769 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f885c0b2050 0x7f885c0b4410 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:58.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.416+0000 7f88633ff700 1 -- 172.21.15.45:0/81242769 >> 172.21.15.45:0/81242769 conn(0x7f885c09c390 msgr2=0x7f885c06b350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:58.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.416+0000 7f88633ff700 1 -- 172.21.15.45:0/81242769 shutdown_connections 2023-11-28T12:06:58.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.416+0000 7f88633ff700 1 -- 172.21.15.45:0/81242769 wait complete. 2023-11-28T12:06:58.436 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-28T12:06:21.807108+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-28T12:06:22.491009+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T12:06:27.684157+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T12:06:28.384679+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T12:06:58.436 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T12:06:58.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.641+0000 7faa8b7ff700 1 Processor -- start 2023-11-28T12:06:58.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.641+0000 7faa8b7ff700 1 -- start start 2023-11-28T12:06:58.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.642+0000 7faa8b7ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7faa8415c9b0 0x7faa840b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:58.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.642+0000 7faa8b7ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7faa840cd7c0 0x7faa840cdc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:58.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.642+0000 7faa8b7ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa840ce160 con 0x7faa84161340 2023-11-28T12:06:58.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.642+0000 7faa8b7ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa840b5800 con 0x7faa840cd7c0 2023-11-28T12:06:58.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.642+0000 7faa8b7ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa840d1950 con 0x7faa8415c9b0 2023-11-28T12:06:58.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.642+0000 7faa88d9a700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7faa84161340 0x7faa840d1de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:52714/0 (socket says 172.21.15.45:52714) 2023-11-28T12:06:58.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.642+0000 7faa88d9a700 1 -- 172.21.15.45:0/2261325822 learned_addr learned my addr 172.21.15.45:0/2261325822 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:06:58.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.642+0000 7faa8959b700 1 --2- 172.21.15.45:0/2261325822 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7faa8415c9b0 0x7faa840b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:58.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.642+0000 7faa89d9c700 1 --2- 172.21.15.45:0/2261325822 >> v2:172.21.15.152:3300/0 conn(0x7faa840cd7c0 0x7faa840cdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:58.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.643+0000 7faa7bfff700 1 -- 172.21.15.45:0/2261325822 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1587692399 0 0) 0x7faa840ce160 con 0x7faa84161340 2023-11-28T12:06:58.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.643+0000 7faa7bfff700 1 -- 172.21.15.45:0/2261325822 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa700035b0 con 0x7faa84161340 2023-11-28T12:06:58.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.643+0000 7faa8959b700 1 -- 172.21.15.45:0/2261325822 >> v2:172.21.15.152:3300/0 conn(0x7faa840cd7c0 msgr2=0x7faa840cdc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:06:58.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.643+0000 7faa8959b700 1 --2- 172.21.15.45:0/2261325822 >> v2:172.21.15.152:3300/0 conn(0x7faa840cd7c0 0x7faa840cdc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:58.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.643+0000 7faa8959b700 1 -- 172.21.15.45:0/2261325822 >> v1:172.21.15.45:6789/0 conn(0x7faa84161340 legacy=0x7faa840d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:58.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.643+0000 7faa8959b700 1 -- 172.21.15.45:0/2261325822 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa840d24f0 con 0x7faa8415c9b0 2023-11-28T12:06:58.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.643+0000 7faa89d9c700 1 --2- 172.21.15.45:0/2261325822 >> v2:172.21.15.152:3300/0 conn(0x7faa840cd7c0 0x7faa840cdc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:06:58.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.643+0000 7faa8959b700 1 --2- 172.21.15.45:0/2261325822 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7faa8415c9b0 0x7faa840b4bf0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7faa80009840 tx=0x7faa80009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41e380c4f6a9107b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:58.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.644+0000 7faa7bfff700 1 -- 172.21.15.45:0/2261325822 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa80011830 con 0x7faa8415c9b0 2023-11-28T12:06:58.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.644+0000 7faa7bfff700 1 -- 172.21.15.45:0/2261325822 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa80011990 con 0x7faa8415c9b0 2023-11-28T12:06:58.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.644+0000 7faa7bfff700 1 -- 172.21.15.45:0/2261325822 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa80011d20 con 0x7faa8415c9b0 2023-11-28T12:06:58.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.644+0000 7faa8b7ff700 1 -- 172.21.15.45:0/2261325822 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7faa8415c9b0 msgr2=0x7faa840b4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:58.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.644+0000 7faa8b7ff700 1 --2- 172.21.15.45:0/2261325822 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7faa8415c9b0 0x7faa840b4bf0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7faa80009840 tx=0x7faa80009b50 comp rx=0 tx=0).stop 2023-11-28T12:06:58.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.644+0000 7faa8b7ff700 1 -- 172.21.15.45:0/2261325822 shutdown_connections 2023-11-28T12:06:58.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.644+0000 7faa8b7ff700 1 --2- 172.21.15.45:0/2261325822 >> v2:172.21.15.152:3300/0 conn(0x7faa840cd7c0 0x7faa840cdc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:58.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.644+0000 7faa8b7ff700 1 --2- 172.21.15.45:0/2261325822 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7faa8415c9b0 0x7faa840b4bf0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:58.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.644+0000 7faa8b7ff700 1 -- 172.21.15.45:0/2261325822 >> 172.21.15.45:0/2261325822 conn(0x7faa84072600 msgr2=0x7faa840cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:58.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.644+0000 7faa8b7ff700 1 -- 172.21.15.45:0/2261325822 shutdown_connections 2023-11-28T12:06:58.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.644+0000 7faa8b7ff700 1 -- 172.21.15.45:0/2261325822 wait complete. 2023-11-28T12:06:58.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.646+0000 7faa8b7ff700 1 Processor -- start 2023-11-28T12:06:58.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.646+0000 7faa8b7ff700 1 -- start start 2023-11-28T12:06:58.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.647+0000 7faa8b7ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7faa840cd7c0 0x7faa840c60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:58.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.647+0000 7faa8b7ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faa8415c9b0 0x7faa840c81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:58.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.647+0000 7faa8b7ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faa84161340 0x7faa841e7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:58.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.647+0000 7faa8b7ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa840c6610 con 0x7faa84161340 2023-11-28T12:06:58.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.647+0000 7faa8b7ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa840c8700 con 0x7faa8415c9b0 2023-11-28T12:06:58.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.647+0000 7faa8b7ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa841e7dc0 con 0x7faa840cd7c0 2023-11-28T12:06:58.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.647+0000 7faa89d9c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faa84161340 0x7faa841e7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:58.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.647+0000 7faa89d9c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faa84161340 0x7faa841e7880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60158/0 (socket says 172.21.15.45:60158) 2023-11-28T12:06:58.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.647+0000 7faa8959b700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7faa840cd7c0 0x7faa840c60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:58.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.647+0000 7faa89d9c700 1 -- 172.21.15.45:0/18467962 learned_addr learned my addr 172.21.15.45:0/18467962 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:58.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.647+0000 7faa88d9a700 1 --2- 172.21.15.45:0/18467962 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faa8415c9b0 0x7faa840c81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:58.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.648+0000 7faa89d9c700 1 -- 172.21.15.45:0/18467962 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7faa840cd7c0 msgr2=0x7faa840c60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:58.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.648+0000 7faa89d9c700 1 --2- 172.21.15.45:0/18467962 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7faa840cd7c0 0x7faa840c60d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:58.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.648+0000 7faa89d9c700 1 -- 172.21.15.45:0/18467962 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faa8415c9b0 msgr2=0x7faa840c81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:58.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.648+0000 7faa89d9c700 1 --2- 172.21.15.45:0/18467962 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faa8415c9b0 0x7faa840c81c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:58.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.648+0000 7faa89d9c700 1 -- 172.21.15.45:0/18467962 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa7c009a70 con 0x7faa84161340 2023-11-28T12:06:58.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.648+0000 7faa89d9c700 1 --2- 172.21.15.45:0/18467962 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faa84161340 0x7faa841e7880 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7faa7c00efc0 tx=0x7faa7c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:58.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.648+0000 7faa79ffb700 1 -- 172.21.15.45:0/18467962 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa7c00ca90 con 0x7faa84161340 2023-11-28T12:06:58.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.648+0000 7faa79ffb700 1 -- 172.21.15.45:0/18467962 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa7c00f040 con 0x7faa84161340 2023-11-28T12:06:58.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.648+0000 7faa79ffb700 1 -- 172.21.15.45:0/18467962 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa7c00ce30 con 0x7faa84161340 2023-11-28T12:06:58.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.648+0000 7faa8b7ff700 1 -- 172.21.15.45:0/18467962 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa800094a0 con 0x7faa84161340 2023-11-28T12:06:58.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.649+0000 7faa8b7ff700 1 -- 172.21.15.45:0/18467962 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa840d1300 con 0x7faa84161340 2023-11-28T12:06:58.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.650+0000 7faa8b7ff700 1 -- 172.21.15.45:0/18467962 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa840b5520 con 0x7faa84161340 2023-11-28T12:06:58.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.650+0000 7faa79ffb700 1 -- 172.21.15.45:0/18467962 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7faa7c014480 con 0x7faa84161340 2023-11-28T12:06:58.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.651+0000 7faa79ffb700 1 --2- 172.21.15.45:0/18467962 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7faa680682f0 0x7faa6806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:58.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.651+0000 7faa79ffb700 1 -- 172.21.15.45:0/18467962 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7faa7c0864d0 con 0x7faa84161340 2023-11-28T12:06:58.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.652+0000 7faa8959b700 1 --2- 172.21.15.45:0/18467962 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7faa680682f0 0x7faa6806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:58.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.652+0000 7faa8959b700 1 --2- 172.21.15.45:0/18467962 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7faa680682f0 0x7faa6806a7a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7faa80000c00 tx=0x7faa8001c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:58.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.655+0000 7faa79ffb700 1 -- 172.21.15.45:0/18467962 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7faa7c052be0 con 0x7faa84161340 2023-11-28T12:06:58.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.860+0000 7faa8b7ff700 1 -- 172.21.15.45:0/18467962 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7faa840d15e0 con 0x7faa84161340 2023-11-28T12:06:58.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.860+0000 7faa79ffb700 1 -- 172.21.15.45:0/18467962 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7faa7c009cd0 con 0x7faa84161340 2023-11-28T12:06:58.862 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-11-28T12:06:58.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.863+0000 7faa8b7ff700 1 -- 172.21.15.45:0/18467962 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7faa680682f0 msgr2=0x7faa6806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:58.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.863+0000 7faa8b7ff700 1 --2- 172.21.15.45:0/18467962 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7faa680682f0 0x7faa6806a7a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7faa80000c00 tx=0x7faa8001c040 comp rx=0 tx=0).stop 2023-11-28T12:06:58.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.863+0000 7faa8b7ff700 1 -- 172.21.15.45:0/18467962 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faa84161340 msgr2=0x7faa841e7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:58.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.863+0000 7faa8b7ff700 1 --2- 172.21.15.45:0/18467962 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faa84161340 0x7faa841e7880 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7faa7c00efc0 tx=0x7faa7c00c3a0 comp rx=0 tx=0).stop 2023-11-28T12:06:58.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.863+0000 7faa8b7ff700 1 -- 172.21.15.45:0/18467962 shutdown_connections 2023-11-28T12:06:58.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.863+0000 7faa8b7ff700 1 --2- 172.21.15.45:0/18467962 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7faa680682f0 0x7faa6806a7a0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:58.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.863+0000 7faa8b7ff700 1 --2- 172.21.15.45:0/18467962 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faa84161340 0x7faa841e7880 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:58.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.863+0000 7faa8b7ff700 1 --2- 172.21.15.45:0/18467962 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7faa840cd7c0 0x7faa840c60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:58.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.863+0000 7faa8b7ff700 1 --2- 172.21.15.45:0/18467962 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faa8415c9b0 0x7faa840c81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:58.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.863+0000 7faa8b7ff700 1 -- 172.21.15.45:0/18467962 >> 172.21.15.45:0/18467962 conn(0x7faa84072600 msgr2=0x7faa840d1de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:58.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.863+0000 7faa8b7ff700 1 -- 172.21.15.45:0/18467962 shutdown_connections 2023-11-28T12:06:58.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:58.863+0000 7faa8b7ff700 1 -- 172.21.15.45:0/18467962 wait complete. 2023-11-28T12:06:58.883 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T12:06:59.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.089+0000 7f5fe55ff700 1 Processor -- start 2023-11-28T12:06:59.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.089+0000 7f5fe55ff700 1 -- start start 2023-11-28T12:06:59.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.091+0000 7f5fe55ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5fe00d01b0 0x7f5fe00d0c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:59.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.091+0000 7f5fe55ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fe00b0230 con 0x7f5fe00b16d0 2023-11-28T12:06:59.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.091+0000 7f5fe55ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fe00b37d0 con 0x7f5fe00b20b0 2023-11-28T12:06:59.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.091+0000 7f5fe55ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe015cec0 con 0x7f5fe00d01b0 2023-11-28T12:06:59.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.091+0000 7f5fdf7fe700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f5fe00b16d0 0x7f5fe00b30c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:52726/0 (socket says 172.21.15.45:52726) 2023-11-28T12:06:59.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.091+0000 7f5fdf7fe700 1 -- 172.21.15.45:0/280745342 learned_addr learned my addr 172.21.15.45:0/280745342 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:06:59.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.091+0000 7f5fdeffd700 1 --2- 172.21.15.45:0/280745342 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5fe00d01b0 0x7f5fe00d0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:59.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.091+0000 7f5fde7fc700 1 -- 172.21.15.45:0/280745342 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2132571180 0 0) 0x7f5fe00b0230 con 0x7f5fe00b16d0 2023-11-28T12:06:59.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.091+0000 7f5fde7fc700 1 -- 172.21.15.45:0/280745342 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fcc0035b0 con 0x7f5fe00b16d0 2023-11-28T12:06:59.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.092+0000 7f5fde7fc700 1 -- 172.21.15.45:0/280745342 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3769391152 0 0) 0x7f5fe00b37d0 con 0x7f5fe00b20b0 2023-11-28T12:06:59.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.092+0000 7f5fde7fc700 1 -- 172.21.15.45:0/280745342 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fe00b0230 con 0x7f5fe00b20b0 2023-11-28T12:06:59.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.092+0000 7f5fde7fc700 1 -- 172.21.15.45:0/280745342 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 501586647 0 0) 0x7f5fcc0035b0 con 0x7f5fe00b16d0 2023-11-28T12:06:59.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.092+0000 7f5fde7fc700 1 -- 172.21.15.45:0/280745342 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5fe00d01b0 msgr2=0x7f5fe00d0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:06:59.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.092+0000 7f5fde7fc700 1 --2- 172.21.15.45:0/280745342 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5fe00d01b0 0x7f5fe00d0c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:59.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.092+0000 7f5fde7fc700 1 -- 172.21.15.45:0/280745342 >> v1:172.21.15.152:6789/0 conn(0x7f5fe00b20b0 legacy=0x7f5fe00b29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:59.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.092+0000 7f5fde7fc700 1 -- 172.21.15.45:0/280745342 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fe00b4570 con 0x7f5fe00b16d0 2023-11-28T12:06:59.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.092+0000 7f5fde7fc700 1 -- 172.21.15.45:0/280745342 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3460218165 0 0) 0x7f5fd80019f0 con 0x7f5fe00b16d0 2023-11-28T12:06:59.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.092+0000 7f5fde7fc700 1 -- 172.21.15.45:0/280745342 >> v1:172.21.15.45:6789/0 conn(0x7f5fe00b16d0 legacy=0x7f5fe00b30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:59.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.092+0000 7f5fde7fc700 1 --2- 172.21.15.45:0/280745342 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5fcc003bc0 0x7f5fcc003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:59.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.092+0000 7f5fde7fc700 1 --2- 172.21.15.45:0/280745342 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5fe00d01b0 0x7f5fcc004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:59.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.092+0000 7f5fde7fc700 1 --2- 172.21.15.45:0/280745342 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5fcc004d90 0x7f5fcc005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:59.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.092+0000 7f5fde7fc700 1 -- 172.21.15.45:0/280745342 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe015cec0 con 0x7f5fcc003bc0 2023-11-28T12:06:59.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.092+0000 7f5fde7fc700 1 -- 172.21.15.45:0/280745342 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fcc00bac0 con 0x7f5fcc004d90 2023-11-28T12:06:59.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.092+0000 7f5fde7fc700 1 -- 172.21.15.45:0/280745342 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fcc00bc30 con 0x7f5fe00d01b0 2023-11-28T12:06:59.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.092+0000 7f5fdeffd700 1 --2- 172.21.15.45:0/280745342 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5fcc003bc0 0x7f5fcc003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:59.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.092+0000 7f5fdf7fe700 1 --2- 172.21.15.45:0/280745342 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5fcc004d90 0x7f5fcc005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:59.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.092+0000 7f5fd7fff700 1 --2- 172.21.15.45:0/280745342 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5fe00d01b0 0x7f5fcc004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:59.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.092+0000 7f5fdeffd700 1 -- 172.21.15.45:0/280745342 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5fe00d01b0 msgr2=0x7f5fcc004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:06:59.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.092+0000 7f5fdeffd700 1 --2- 172.21.15.45:0/280745342 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5fe00d01b0 0x7f5fcc004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:59.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.092+0000 7f5fdeffd700 1 -- 172.21.15.45:0/280745342 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5fcc004d90 msgr2=0x7f5fcc005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:06:59.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.092+0000 7f5fdeffd700 1 --2- 172.21.15.45:0/280745342 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5fcc004d90 0x7f5fcc005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:59.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.092+0000 7f5fdeffd700 1 -- 172.21.15.45:0/280745342 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fcc0035b0 con 0x7f5fcc003bc0 2023-11-28T12:06:59.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.093+0000 7f5fdeffd700 1 --2- 172.21.15.45:0/280745342 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5fcc003bc0 0x7f5fcc003fb0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5fd0009b60 tx=0x7f5fcc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9173cc03cce165e6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:59.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.093+0000 7f5fde7fc700 1 -- 172.21.15.45:0/280745342 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd000e660 con 0x7f5fcc003bc0 2023-11-28T12:06:59.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.093+0000 7f5fde7fc700 1 -- 172.21.15.45:0/280745342 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fd000e7c0 con 0x7f5fcc003bc0 2023-11-28T12:06:59.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.093+0000 7f5fde7fc700 1 -- 172.21.15.45:0/280745342 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd000eb30 con 0x7f5fcc003bc0 2023-11-28T12:06:59.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.093+0000 7f5fe55ff700 1 -- 172.21.15.45:0/280745342 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5fcc003bc0 msgr2=0x7f5fcc003fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:59.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.093+0000 7f5fe55ff700 1 --2- 172.21.15.45:0/280745342 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5fcc003bc0 0x7f5fcc003fb0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5fd0009b60 tx=0x7f5fcc005880 comp rx=0 tx=0).stop 2023-11-28T12:06:59.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.093+0000 7f5fdf7fe700 1 -- 172.21.15.45:0/280745342 reap_dead start 2023-11-28T12:06:59.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.094+0000 7f5fe55ff700 1 -- 172.21.15.45:0/280745342 shutdown_connections 2023-11-28T12:06:59.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.094+0000 7f5fe55ff700 1 -- 172.21.15.45:0/280745342 >> 172.21.15.45:0/280745342 conn(0x7f5fe009c3f0 msgr2=0x7f5fe00d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:59.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.094+0000 7f5fe55ff700 1 -- 172.21.15.45:0/280745342 shutdown_connections 2023-11-28T12:06:59.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.094+0000 7f5fe55ff700 1 -- 172.21.15.45:0/280745342 wait complete. 2023-11-28T12:06:59.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.095+0000 7f5fe55ff700 1 Processor -- start 2023-11-28T12:06:59.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.096+0000 7f5fe55ff700 1 -- start start 2023-11-28T12:06:59.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.096+0000 7f5fe55ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5fcc003bc0 0x7f5fe00cea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:59.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.096+0000 7f5fe55ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5fe015f6f0 0x7f5fe00cc5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:59.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.096+0000 7f5fe55ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5fe01524d0 0x7f5fe00ccae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:59.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.096+0000 7f5fe55ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe015e170 con 0x7f5fe01524d0 2023-11-28T12:06:59.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.096+0000 7f5fe55ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe015fe90 con 0x7f5fe015f6f0 2023-11-28T12:06:59.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.096+0000 7f5fe55ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe015fbb0 con 0x7f5fcc003bc0 2023-11-28T12:06:59.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.097+0000 7f5fdf7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5fe01524d0 0x7f5fe00ccae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:59.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.097+0000 7f5fdf7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5fe01524d0 0x7f5fe00ccae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60178/0 (socket says 172.21.15.45:60178) 2023-11-28T12:06:59.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.097+0000 7f5fdf7fe700 1 -- 172.21.15.45:0/183511403 learned_addr learned my addr 172.21.15.45:0/183511403 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:59.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.097+0000 7f5fd7fff700 1 --2- 172.21.15.45:0/183511403 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5fe015f6f0 0x7f5fe00cc5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:59.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.097+0000 7f5fdeffd700 1 --2- 172.21.15.45:0/183511403 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5fcc003bc0 0x7f5fe00cea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:59.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.097+0000 7f5fdf7fe700 1 -- 172.21.15.45:0/183511403 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5fcc003bc0 msgr2=0x7f5fe00cea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:59.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.097+0000 7f5fdf7fe700 1 --2- 172.21.15.45:0/183511403 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5fcc003bc0 0x7f5fe00cea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:59.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.097+0000 7f5fdf7fe700 1 -- 172.21.15.45:0/183511403 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5fe015f6f0 msgr2=0x7f5fe00cc5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:59.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.097+0000 7f5fdf7fe700 1 --2- 172.21.15.45:0/183511403 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5fe015f6f0 0x7f5fe00cc5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:59.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.097+0000 7f5fdf7fe700 1 -- 172.21.15.45:0/183511403 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fe00afbe0 con 0x7f5fe01524d0 2023-11-28T12:06:59.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.097+0000 7f5fdeffd700 1 --2- 172.21.15.45:0/183511403 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5fcc003bc0 0x7f5fe00cea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:06:59.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.097+0000 7f5fdf7fe700 1 --2- 172.21.15.45:0/183511403 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5fe01524d0 0x7f5fe00ccae0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5fd8001330 tx=0x7f5fd8007c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:59.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.098+0000 7f5fd77fe700 1 -- 172.21.15.45:0/183511403 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd8017070 con 0x7f5fe01524d0 2023-11-28T12:06:59.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.098+0000 7f5fd77fe700 1 -- 172.21.15.45:0/183511403 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fd800ed90 con 0x7f5fe01524d0 2023-11-28T12:06:59.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.098+0000 7f5fd77fe700 1 -- 172.21.15.45:0/183511403 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd8013420 con 0x7f5fe01524d0 2023-11-28T12:06:59.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.098+0000 7f5fe55ff700 1 -- 172.21.15.45:0/183511403 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fe00b4850 con 0x7f5fe01524d0 2023-11-28T12:06:59.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.098+0000 7f5fe55ff700 1 -- 172.21.15.45:0/183511403 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fe00afec0 con 0x7f5fe01524d0 2023-11-28T12:06:59.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.099+0000 7f5fe55ff700 1 -- 172.21.15.45:0/183511403 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fe015e2b0 con 0x7f5fe01524d0 2023-11-28T12:06:59.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.100+0000 7f5fd77fe700 1 -- 172.21.15.45:0/183511403 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f5fd8013580 con 0x7f5fe01524d0 2023-11-28T12:06:59.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.101+0000 7f5fd77fe700 1 --2- 172.21.15.45:0/183511403 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5fc00682f0 0x7f5fc006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:59.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.101+0000 7f5fd77fe700 1 -- 172.21.15.45:0/183511403 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5fd8085d70 con 0x7f5fe01524d0 2023-11-28T12:06:59.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.101+0000 7f5fdeffd700 1 --2- 172.21.15.45:0/183511403 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5fc00682f0 0x7f5fc006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:59.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.102+0000 7f5fdeffd700 1 --2- 172.21.15.45:0/183511403 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5fc00682f0 0x7f5fc006a7a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5fd00090b0 tx=0x7f5fd0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:59.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.105+0000 7f5fd77fe700 1 -- 172.21.15.45:0/183511403 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f5fd80524e0 con 0x7f5fe01524d0 2023-11-28T12:06:59.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.309+0000 7f5fe55ff700 1 -- 172.21.15.45:0/183511403 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5fe0068690 con 0x7f5fe01524d0 2023-11-28T12:06:59.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.309+0000 7f5fd77fe700 1 -- 172.21.15.45:0/183511403 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5fd8055b00 con 0x7f5fe01524d0 2023-11-28T12:06:59.311 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-11-28T12:06:59.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.312+0000 7f5fe55ff700 1 -- 172.21.15.45:0/183511403 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5fc00682f0 msgr2=0x7f5fc006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:59.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.312+0000 7f5fe55ff700 1 --2- 172.21.15.45:0/183511403 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5fc00682f0 0x7f5fc006a7a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5fd00090b0 tx=0x7f5fd0008030 comp rx=0 tx=0).stop 2023-11-28T12:06:59.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.312+0000 7f5fe55ff700 1 -- 172.21.15.45:0/183511403 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5fe01524d0 msgr2=0x7f5fe00ccae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:59.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.312+0000 7f5fe55ff700 1 --2- 172.21.15.45:0/183511403 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5fe01524d0 0x7f5fe00ccae0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5fd8001330 tx=0x7f5fd8007c90 comp rx=0 tx=0).stop 2023-11-28T12:06:59.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.312+0000 7f5fe55ff700 1 -- 172.21.15.45:0/183511403 shutdown_connections 2023-11-28T12:06:59.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.312+0000 7f5fe55ff700 1 --2- 172.21.15.45:0/183511403 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5fc00682f0 0x7f5fc006a7a0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:59.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.312+0000 7f5fe55ff700 1 --2- 172.21.15.45:0/183511403 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5fe01524d0 0x7f5fe00ccae0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:59.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.312+0000 7f5fe55ff700 1 --2- 172.21.15.45:0/183511403 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5fcc003bc0 0x7f5fe00cea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:59.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.312+0000 7f5fe55ff700 1 --2- 172.21.15.45:0/183511403 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5fe015f6f0 0x7f5fe00cc5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:59.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.312+0000 7f5fe55ff700 1 -- 172.21.15.45:0/183511403 >> 172.21.15.45:0/183511403 conn(0x7f5fe009c3f0 msgr2=0x7f5fe00d0c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:59.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.312+0000 7f5fe55ff700 1 -- 172.21.15.45:0/183511403 shutdown_connections 2023-11-28T12:06:59.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.312+0000 7f5fe55ff700 1 -- 172.21.15.45:0/183511403 wait complete. 2023-11-28T12:06:59.331 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T12:06:59.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.537+0000 7faeef7ff700 1 Processor -- start 2023-11-28T12:06:59.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.537+0000 7faeef7ff700 1 -- start start 2023-11-28T12:06:59.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.538+0000 7faeef7ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7faee80d01b0 0x7faee80d0c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:59.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.538+0000 7faeef7ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faee80b0230 con 0x7faee80b16d0 2023-11-28T12:06:59.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.538+0000 7faeef7ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faee80b37d0 con 0x7faee80b20b0 2023-11-28T12:06:59.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.538+0000 7faeef7ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faee815cec0 con 0x7faee80d01b0 2023-11-28T12:06:59.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.538+0000 7faeed59b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7faee80d01b0 0x7faee80d0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:59.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.538+0000 7faeedd9c700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7faee80b16d0 0x7faee80b30c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:52734/0 (socket says 172.21.15.45:52734) 2023-11-28T12:06:59.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.538+0000 7faeedd9c700 1 -- 172.21.15.45:0/1327910867 learned_addr learned my addr 172.21.15.45:0/1327910867 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:06:59.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.539+0000 7faeed59b700 1 -- 172.21.15.45:0/1327910867 >> v1:172.21.15.152:6789/0 conn(0x7faee80b20b0 legacy=0x7faee80b29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:59.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.539+0000 7faeed59b700 1 -- 172.21.15.45:0/1327910867 >> v1:172.21.15.45:6789/0 conn(0x7faee80b16d0 legacy=0x7faee80b30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:59.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.539+0000 7faeed59b700 1 -- 172.21.15.45:0/1327910867 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faee80b4570 con 0x7faee80d01b0 2023-11-28T12:06:59.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.539+0000 7faedffff700 1 -- 172.21.15.45:0/1327910867 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 65598587 0 0) 0x7faee80b0230 con 0x7faee80b16d0 2023-11-28T12:06:59.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.539+0000 7faeed59b700 1 --2- 172.21.15.45:0/1327910867 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faee80d01b0 0x7faee80d0c20 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7faee4009840 tx=0x7faee4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddc8a18dc6b0619 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:59.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.539+0000 7faedffff700 1 -- 172.21.15.45:0/1327910867 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee4011830 con 0x7faee80d01b0 2023-11-28T12:06:59.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.539+0000 7faedffff700 1 -- 172.21.15.45:0/1327910867 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faee4011990 con 0x7faee80d01b0 2023-11-28T12:06:59.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.539+0000 7faedffff700 1 -- 172.21.15.45:0/1327910867 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee4011d20 con 0x7faee80d01b0 2023-11-28T12:06:59.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.540+0000 7faeef7ff700 1 -- 172.21.15.45:0/1327910867 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faee80d01b0 msgr2=0x7faee80d0c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:59.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.540+0000 7faeef7ff700 1 --2- 172.21.15.45:0/1327910867 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faee80d01b0 0x7faee80d0c20 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7faee4009840 tx=0x7faee4009b50 comp rx=0 tx=0).stop 2023-11-28T12:06:59.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.540+0000 7faeef7ff700 1 -- 172.21.15.45:0/1327910867 shutdown_connections 2023-11-28T12:06:59.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.540+0000 7faeef7ff700 1 --2- 172.21.15.45:0/1327910867 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faee80d01b0 0x7faee80d0c20 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:59.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.540+0000 7faeef7ff700 1 -- 172.21.15.45:0/1327910867 >> 172.21.15.45:0/1327910867 conn(0x7faee809c3f0 msgr2=0x7faee80d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:59.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.540+0000 7faeef7ff700 1 -- 172.21.15.45:0/1327910867 shutdown_connections 2023-11-28T12:06:59.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.540+0000 7faeef7ff700 1 -- 172.21.15.45:0/1327910867 wait complete. 2023-11-28T12:06:59.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.542+0000 7faeef7ff700 1 Processor -- start 2023-11-28T12:06:59.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.542+0000 7faeef7ff700 1 -- start start 2023-11-28T12:06:59.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.543+0000 7faeef7ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faee80b16d0 0x7faee8157ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:59.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.543+0000 7faeef7ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faee80b20b0 0x7faee81e6940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:59.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.543+0000 7faeef7ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7faee80d01b0 0x7faee81e6e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:59.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.543+0000 7faeef7ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee80b5f20 con 0x7faee80b20b0 2023-11-28T12:06:59.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.543+0000 7faeef7ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee81e5ec0 con 0x7faee80b16d0 2023-11-28T12:06:59.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.543+0000 7faeef7ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faee81e61a0 con 0x7faee80d01b0 2023-11-28T12:06:59.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.543+0000 7faeecd9a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faee80b20b0 0x7faee81e6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:59.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.543+0000 7faeecd9a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faee80b20b0 0x7faee81e6940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60192/0 (socket says 172.21.15.45:60192) 2023-11-28T12:06:59.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.543+0000 7faeecd9a700 1 -- 172.21.15.45:0/2564444172 learned_addr learned my addr 172.21.15.45:0/2564444172 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:06:59.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.543+0000 7faeedd9c700 1 --2- 172.21.15.45:0/2564444172 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7faee80d01b0 0x7faee81e6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:59.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.543+0000 7faeed59b700 1 --2- 172.21.15.45:0/2564444172 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faee80b16d0 0x7faee8157ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:59.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.543+0000 7faeecd9a700 1 -- 172.21.15.45:0/2564444172 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7faee80d01b0 msgr2=0x7faee81e6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:59.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.543+0000 7faeecd9a700 1 --2- 172.21.15.45:0/2564444172 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7faee80d01b0 0x7faee81e6e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:59.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.543+0000 7faeecd9a700 1 -- 172.21.15.45:0/2564444172 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faee80b16d0 msgr2=0x7faee8157ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:59.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.543+0000 7faeecd9a700 1 --2- 172.21.15.45:0/2564444172 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faee80b16d0 0x7faee8157ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:59.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.543+0000 7faeecd9a700 1 -- 172.21.15.45:0/2564444172 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faee40094a0 con 0x7faee80b20b0 2023-11-28T12:06:59.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.544+0000 7faeecd9a700 1 --2- 172.21.15.45:0/2564444172 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faee80b20b0 0x7faee81e6940 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7faed800c4e0 tx=0x7faed800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:59.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.544+0000 7faeddffb700 1 -- 172.21.15.45:0/2564444172 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed80052d0 con 0x7faee80b20b0 2023-11-28T12:06:59.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.544+0000 7faeddffb700 1 -- 172.21.15.45:0/2564444172 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faed8005430 con 0x7faee80b20b0 2023-11-28T12:06:59.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.544+0000 7faeddffb700 1 -- 172.21.15.45:0/2564444172 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed80038c0 con 0x7faee80b20b0 2023-11-28T12:06:59.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.544+0000 7faeef7ff700 1 -- 172.21.15.45:0/2564444172 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faee80afbe0 con 0x7faee80b20b0 2023-11-28T12:06:59.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.544+0000 7faeef7ff700 1 -- 172.21.15.45:0/2564444172 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faee80b4850 con 0x7faee80b20b0 2023-11-28T12:06:59.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.545+0000 7faeef7ff700 1 -- 172.21.15.45:0/2564444172 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faee80afec0 con 0x7faee80b20b0 2023-11-28T12:06:59.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.546+0000 7faeddffb700 1 -- 172.21.15.45:0/2564444172 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7faed8019030 con 0x7faee80b20b0 2023-11-28T12:06:59.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.547+0000 7faeddffb700 1 --2- 172.21.15.45:0/2564444172 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7faecc0682f0 0x7faecc06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:59.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.547+0000 7faeddffb700 1 -- 172.21.15.45:0/2564444172 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7faed8085130 con 0x7faee80b20b0 2023-11-28T12:06:59.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.548+0000 7faeed59b700 1 --2- 172.21.15.45:0/2564444172 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7faecc0682f0 0x7faecc06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:59.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.548+0000 7faeed59b700 1 --2- 172.21.15.45:0/2564444172 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7faecc0682f0 0x7faecc06a7a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7faee4009b90 tx=0x7faee401c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:06:59.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.551+0000 7faeddffb700 1 -- 172.21.15.45:0/2564444172 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7faed80518a0 con 0x7faee80b20b0 2023-11-28T12:06:59.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.752+0000 7faeef7ff700 1 -- 172.21.15.45:0/2564444172 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7faee80b6370 con 0x7faee80b20b0 2023-11-28T12:06:59.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.752+0000 7faeddffb700 1 -- 172.21.15.45:0/2564444172 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7faed8054ec0 con 0x7faee80b20b0 2023-11-28T12:06:59.754 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-11-28T12:06:59.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.754+0000 7faeef7ff700 1 -- 172.21.15.45:0/2564444172 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7faecc0682f0 msgr2=0x7faecc06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:59.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.754+0000 7faeef7ff700 1 --2- 172.21.15.45:0/2564444172 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7faecc0682f0 0x7faecc06a7a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7faee4009b90 tx=0x7faee401c040 comp rx=0 tx=0).stop 2023-11-28T12:06:59.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.754+0000 7faeef7ff700 1 -- 172.21.15.45:0/2564444172 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faee80b20b0 msgr2=0x7faee81e6940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:06:59.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.754+0000 7faeef7ff700 1 --2- 172.21.15.45:0/2564444172 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faee80b20b0 0x7faee81e6940 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7faed800c4e0 tx=0x7faed800c8a0 comp rx=0 tx=0).stop 2023-11-28T12:06:59.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.754+0000 7faeef7ff700 1 -- 172.21.15.45:0/2564444172 shutdown_connections 2023-11-28T12:06:59.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.755+0000 7faeef7ff700 1 --2- 172.21.15.45:0/2564444172 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7faecc0682f0 0x7faecc06a7a0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:59.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.755+0000 7faeef7ff700 1 --2- 172.21.15.45:0/2564444172 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faee80b16d0 0x7faee8157ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:59.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.755+0000 7faeef7ff700 1 --2- 172.21.15.45:0/2564444172 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7faee80d01b0 0x7faee81e6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:59.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.755+0000 7faeef7ff700 1 --2- 172.21.15.45:0/2564444172 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faee80b20b0 0x7faee81e6940 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:59.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.755+0000 7faeef7ff700 1 -- 172.21.15.45:0/2564444172 >> 172.21.15.45:0/2564444172 conn(0x7faee809c3f0 msgr2=0x7faee80d3230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:06:59.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.755+0000 7faeef7ff700 1 -- 172.21.15.45:0/2564444172 shutdown_connections 2023-11-28T12:06:59.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.755+0000 7faeef7ff700 1 -- 172.21.15.45:0/2564444172 wait complete. 2023-11-28T12:06:59.774 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T12:06:59.884 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T12:06:59.891 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T12:06:59.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.990+0000 7fc8dddff700 1 Processor -- start 2023-11-28T12:06:59.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.990+0000 7fc8dddff700 1 -- start start 2023-11-28T12:06:59.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.991+0000 7fc8dddff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc8d80d01b0 0x7fc8d80d0c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:59.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.991+0000 7fc8dddff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fc8d80b20b0 0x7fc8d80d1160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:06:59.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.991+0000 7fc8dddff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8d80b0230 con 0x7fc8d80b29b0 2023-11-28T12:06:59.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.991+0000 7fc8dddff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8d815cec0 con 0x7fc8d80d01b0 2023-11-28T12:06:59.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.991+0000 7fc8dddff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8d80b4570 con 0x7fc8d80b20b0 2023-11-28T12:06:59.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.991+0000 7fc8d77fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc8d80d01b0 0x7fc8d80d0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:59.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.991+0000 7fc8d7fff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fc8d80b29b0 0x7fc8d80b2e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:52746/0 (socket says 172.21.15.45:52746) 2023-11-28T12:06:59.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.991+0000 7fc8d7fff700 1 -- 172.21.15.45:0/87525322 learned_addr learned my addr 172.21.15.45:0/87525322 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:06:59.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.992+0000 7fc8d6ffd700 1 --2- 172.21.15.45:0/87525322 >> v2:172.21.15.152:3300/0 conn(0x7fc8d80b20b0 0x7fc8d80d1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:06:59.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.992+0000 7fc8d67fc700 1 -- 172.21.15.45:0/87525322 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3202923864 0 0) 0x7fc8d80b0230 con 0x7fc8d80b29b0 2023-11-28T12:06:59.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.992+0000 7fc8d67fc700 1 -- 172.21.15.45:0/87525322 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8c00035b0 con 0x7fc8d80b29b0 2023-11-28T12:06:59.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.992+0000 7fc8d77fe700 1 -- 172.21.15.45:0/87525322 >> v2:172.21.15.152:3300/0 conn(0x7fc8d80b20b0 msgr2=0x7fc8d80d1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:06:59.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.992+0000 7fc8d77fe700 1 --2- 172.21.15.45:0/87525322 >> v2:172.21.15.152:3300/0 conn(0x7fc8d80b20b0 0x7fc8d80d1160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:06:59.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.992+0000 7fc8d77fe700 1 -- 172.21.15.45:0/87525322 >> v1:172.21.15.45:6789/0 conn(0x7fc8d80b29b0 legacy=0x7fc8d80b2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:00.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.992+0000 7fc8d77fe700 1 -- 172.21.15.45:0/87525322 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8d80b4850 con 0x7fc8d80d01b0 2023-11-28T12:07:00.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.992+0000 7fc8d77fe700 1 --2- 172.21.15.45:0/87525322 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8d80d01b0 0x7fc8d80d0c20 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc8d80ca0b0 tx=0x7fc8c8009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f308f807d78795be server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:00.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.992+0000 7fc8d67fc700 1 -- 172.21.15.45:0/87525322 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c8011830 con 0x7fc8d80d01b0 2023-11-28T12:07:00.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.992+0000 7fc8d67fc700 1 -- 172.21.15.45:0/87525322 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8c8011990 con 0x7fc8d80d01b0 2023-11-28T12:07:00.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.992+0000 7fc8d67fc700 1 -- 172.21.15.45:0/87525322 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c8011d20 con 0x7fc8d80d01b0 2023-11-28T12:07:00.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.993+0000 7fc8dddff700 1 -- 172.21.15.45:0/87525322 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8d80d01b0 msgr2=0x7fc8d80d0c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:00.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.993+0000 7fc8dddff700 1 --2- 172.21.15.45:0/87525322 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8d80d01b0 0x7fc8d80d0c20 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc8d80ca0b0 tx=0x7fc8c8009b20 comp rx=0 tx=0).stop 2023-11-28T12:07:00.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.993+0000 7fc8dddff700 1 -- 172.21.15.45:0/87525322 shutdown_connections 2023-11-28T12:07:00.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.993+0000 7fc8dddff700 1 --2- 172.21.15.45:0/87525322 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8d80d01b0 0x7fc8d80d0c20 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:00.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.993+0000 7fc8dddff700 1 --2- 172.21.15.45:0/87525322 >> v2:172.21.15.152:3300/0 conn(0x7fc8d80b20b0 0x7fc8d80d1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:00.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.993+0000 7fc8dddff700 1 -- 172.21.15.45:0/87525322 >> 172.21.15.45:0/87525322 conn(0x7fc8d809c3f0 msgr2=0x7fc8d80d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:00.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.993+0000 7fc8dddff700 1 -- 172.21.15.45:0/87525322 shutdown_connections 2023-11-28T12:07:00.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.993+0000 7fc8dddff700 1 -- 172.21.15.45:0/87525322 wait complete. 2023-11-28T12:07:00.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.995+0000 7fc8dddff700 1 Processor -- start 2023-11-28T12:07:00.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.995+0000 7fc8dddff700 1 -- start start 2023-11-28T12:07:00.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.996+0000 7fc8dddff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc8d80b20b0 0x7fc8d80c9170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:00.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.996+0000 7fc8dddff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc8d80b29b0 0x7fc8d81e69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:00.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.996+0000 7fc8dddff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8d80d01b0 0x7fc8d81e3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:00.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.996+0000 7fc8dddff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d8154780 con 0x7fc8d80d01b0 2023-11-28T12:07:00.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.996+0000 7fc8dddff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d80c96b0 con 0x7fc8d80b20b0 2023-11-28T12:07:00.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.996+0000 7fc8dddff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d81549d0 con 0x7fc8d80b29b0 2023-11-28T12:07:00.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.996+0000 7fc8d7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8d80d01b0 0x7fc8d81e3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:00.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.997+0000 7fc8d7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8d80d01b0 0x7fc8d81e3ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60212/0 (socket says 172.21.15.45:60212) 2023-11-28T12:07:00.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.997+0000 7fc8d7fff700 1 -- 172.21.15.45:0/1184465051 learned_addr learned my addr 172.21.15.45:0/1184465051 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:00.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.997+0000 7fc8d77fe700 1 --2- 172.21.15.45:0/1184465051 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc8d80b20b0 0x7fc8d80c9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:00.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.997+0000 7fc8d6ffd700 1 --2- 172.21.15.45:0/1184465051 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc8d80b29b0 0x7fc8d81e69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:00.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.997+0000 7fc8d7fff700 1 -- 172.21.15.45:0/1184465051 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc8d80b29b0 msgr2=0x7fc8d81e69c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:00.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.997+0000 7fc8d7fff700 1 --2- 172.21.15.45:0/1184465051 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc8d80b29b0 0x7fc8d81e69c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:00.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.997+0000 7fc8d7fff700 1 -- 172.21.15.45:0/1184465051 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc8d80b20b0 msgr2=0x7fc8d80c9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:00.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.997+0000 7fc8d7fff700 1 --2- 172.21.15.45:0/1184465051 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc8d80b20b0 0x7fc8d80c9170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:00.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.997+0000 7fc8d7fff700 1 -- 172.21.15.45:0/1184465051 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8c80094a0 con 0x7fc8d80d01b0 2023-11-28T12:07:00.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.997+0000 7fc8d7fff700 1 --2- 172.21.15.45:0/1184465051 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8d80d01b0 0x7fc8d81e3ff0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc8d000cb40 tx=0x7fc8d000ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:00.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.997+0000 7fc8bffff700 1 -- 172.21.15.45:0/1184465051 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d000a9e0 con 0x7fc8d80d01b0 2023-11-28T12:07:00.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.997+0000 7fc8bffff700 1 -- 172.21.15.45:0/1184465051 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8d000ab40 con 0x7fc8d80d01b0 2023-11-28T12:07:00.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.997+0000 7fc8dddff700 1 -- 172.21.15.45:0/1184465051 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8d80afec0 con 0x7fc8d80d01b0 2023-11-28T12:07:00.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.998+0000 7fc8bffff700 1 -- 172.21.15.45:0/1184465051 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d0012400 con 0x7fc8d80d01b0 2023-11-28T12:07:00.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.998+0000 7fc8dddff700 1 -- 172.21.15.45:0/1184465051 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8d80afbe0 con 0x7fc8d80d01b0 2023-11-28T12:07:00.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:06:59.999+0000 7fc8dddff700 1 -- 172.21.15.45:0/1184465051 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8d80b2600 con 0x7fc8d80d01b0 2023-11-28T12:07:00.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.000+0000 7fc8bffff700 1 -- 172.21.15.45:0/1184465051 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fc8d0019030 con 0x7fc8d80d01b0 2023-11-28T12:07:00.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.000+0000 7fc8bffff700 1 --2- 172.21.15.45:0/1184465051 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fc8c40682f0 0x7fc8c406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:00.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.001+0000 7fc8bffff700 1 -- 172.21.15.45:0/1184465051 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc8d0085770 con 0x7fc8d80d01b0 2023-11-28T12:07:00.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.001+0000 7fc8d77fe700 1 --2- 172.21.15.45:0/1184465051 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fc8c40682f0 0x7fc8c406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:00.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.002+0000 7fc8d77fe700 1 --2- 172.21.15.45:0/1184465051 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fc8c40682f0 0x7fc8c406a7a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc8c8000c00 tx=0x7fc8c801c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:00.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.004+0000 7fc8bffff700 1 -- 172.21.15.45:0/1184465051 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fc8d004b5e0 con 0x7fc8d80d01b0 2023-11-28T12:07:00.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.206+0000 7fc8dddff700 1 -- 172.21.15.45:0/1184465051 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc8d8068690 con 0x7fc8d80d01b0 2023-11-28T12:07:00.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.206+0000 7fc8bffff700 1 -- 172.21.15.45:0/1184465051 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc8d0051f90 con 0x7fc8d80d01b0 2023-11-28T12:07:00.208 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-11-28T12:07:00.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.208+0000 7fc8dddff700 1 -- 172.21.15.45:0/1184465051 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fc8c40682f0 msgr2=0x7fc8c406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:00.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.209+0000 7fc8dddff700 1 --2- 172.21.15.45:0/1184465051 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fc8c40682f0 0x7fc8c406a7a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc8c8000c00 tx=0x7fc8c801c040 comp rx=0 tx=0).stop 2023-11-28T12:07:00.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.209+0000 7fc8dddff700 1 -- 172.21.15.45:0/1184465051 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8d80d01b0 msgr2=0x7fc8d81e3ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:00.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.209+0000 7fc8dddff700 1 --2- 172.21.15.45:0/1184465051 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8d80d01b0 0x7fc8d81e3ff0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc8d000cb40 tx=0x7fc8d000ce50 comp rx=0 tx=0).stop 2023-11-28T12:07:00.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.209+0000 7fc8dddff700 1 -- 172.21.15.45:0/1184465051 shutdown_connections 2023-11-28T12:07:00.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.209+0000 7fc8dddff700 1 --2- 172.21.15.45:0/1184465051 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fc8c40682f0 0x7fc8c406a7a0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:00.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.209+0000 7fc8dddff700 1 --2- 172.21.15.45:0/1184465051 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc8d80b20b0 0x7fc8d80c9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:00.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.209+0000 7fc8dddff700 1 --2- 172.21.15.45:0/1184465051 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8d80d01b0 0x7fc8d81e3ff0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:00.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.209+0000 7fc8dddff700 1 --2- 172.21.15.45:0/1184465051 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc8d80b29b0 0x7fc8d81e69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:00.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.209+0000 7fc8dddff700 1 -- 172.21.15.45:0/1184465051 >> 172.21.15.45:0/1184465051 conn(0x7fc8d809c3f0 msgr2=0x7fc8d80d2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:00.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.209+0000 7fc8dddff700 1 -- 172.21.15.45:0/1184465051 shutdown_connections 2023-11-28T12:07:00.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.209+0000 7fc8dddff700 1 -- 172.21.15.45:0/1184465051 wait complete. 2023-11-28T12:07:00.229 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T12:07:00.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.471+0000 7f67403ff700 1 Processor -- start 2023-11-28T12:07:00.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.472+0000 7f67403ff700 1 -- start start 2023-11-28T12:07:00.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.473+0000 7f67403ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6738161340 0x7f67380d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:00.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.473+0000 7f67403ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f67380d2320 0x7f67380cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:00.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.473+0000 7f67403ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67380d1950 con 0x7f673815c9b0 2023-11-28T12:07:00.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.473+0000 7f67403ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67380b5800 con 0x7f67380d2320 2023-11-28T12:07:00.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.473+0000 7f67403ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67380b5300 con 0x7f6738161340 2023-11-28T12:07:00.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.473+0000 7f673e99c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f67380d2320 0x7f67380cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:00.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.473+0000 7f673e99c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f67380d2320 0x7f67380cd7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60224/0 (socket says 172.21.15.45:60224) 2023-11-28T12:07:00.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.473+0000 7f673e99c700 1 -- 172.21.15.45:0/3115800439 learned_addr learned my addr 172.21.15.45:0/3115800439 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:00.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.473+0000 7f673d99a700 1 --2- 172.21.15.45:0/3115800439 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6738161340 0x7f67380d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:00.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.474+0000 7f673e99c700 1 -- 172.21.15.45:0/3115800439 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6738161340 msgr2=0x7f67380d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:00.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.474+0000 7f673e99c700 1 --2- 172.21.15.45:0/3115800439 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6738161340 0x7f67380d1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:00.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.474+0000 7f673e99c700 1 -- 172.21.15.45:0/3115800439 >> v1:172.21.15.152:6789/0 conn(0x7f673815c9b0 legacy=0x7f67380b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:00.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.474+0000 7f673e99c700 1 -- 172.21.15.45:0/3115800439 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67380b5520 con 0x7f67380d2320 2023-11-28T12:07:00.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.474+0000 7f673d99a700 1 --2- 172.21.15.45:0/3115800439 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6738161340 0x7f67380d1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:07:00.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.474+0000 7f673e99c700 1 --2- 172.21.15.45:0/3115800439 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f67380d2320 0x7f67380cd7c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6730009e80 tx=0x7f673000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc10941d18995b40 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:00.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.474+0000 7f673d199700 1 -- 172.21.15.45:0/3115800439 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f673000e070 con 0x7f67380d2320 2023-11-28T12:07:00.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.474+0000 7f673d199700 1 -- 172.21.15.45:0/3115800439 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f673000b980 con 0x7f67380d2320 2023-11-28T12:07:00.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.474+0000 7f673d199700 1 -- 172.21.15.45:0/3115800439 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f673000bd30 con 0x7f67380d2320 2023-11-28T12:07:00.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.475+0000 7f67403ff700 1 -- 172.21.15.45:0/3115800439 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f67380d2320 msgr2=0x7f67380cd7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:00.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.475+0000 7f67403ff700 1 --2- 172.21.15.45:0/3115800439 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f67380d2320 0x7f67380cd7c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6730009e80 tx=0x7f673000b330 comp rx=0 tx=0).stop 2023-11-28T12:07:00.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.475+0000 7f67403ff700 1 -- 172.21.15.45:0/3115800439 shutdown_connections 2023-11-28T12:07:00.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.475+0000 7f67403ff700 1 --2- 172.21.15.45:0/3115800439 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f67380d2320 0x7f67380cd7c0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:00.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.475+0000 7f67403ff700 1 --2- 172.21.15.45:0/3115800439 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6738161340 0x7f67380d1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:00.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.475+0000 7f67403ff700 1 -- 172.21.15.45:0/3115800439 >> 172.21.15.45:0/3115800439 conn(0x7f6738072600 msgr2=0x7f67380cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:00.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.475+0000 7f67403ff700 1 -- 172.21.15.45:0/3115800439 shutdown_connections 2023-11-28T12:07:00.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.475+0000 7f67403ff700 1 -- 172.21.15.45:0/3115800439 wait complete. 2023-11-28T12:07:00.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.477+0000 7f67403ff700 1 Processor -- start 2023-11-28T12:07:00.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.477+0000 7f67403ff700 1 -- start start 2023-11-28T12:07:00.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.478+0000 7f67403ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f67380d2320 0x7f67381e75f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:00.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.478+0000 7f67403ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f673815c9b0 0x7f6738149470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:00.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.478+0000 7f67403ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6738161340 0x7f67380ccc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:00.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.478+0000 7f67403ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67381e88e0 con 0x7f67380d2320 2023-11-28T12:07:00.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.478+0000 7f67403ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67381e7c60 con 0x7f673815c9b0 2023-11-28T12:07:00.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.478+0000 7f67403ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67381e7f40 con 0x7f6738161340 2023-11-28T12:07:00.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.478+0000 7f673e19b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f67380d2320 0x7f67381e75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:00.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.478+0000 7f673e19b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f67380d2320 0x7f67381e75f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60226/0 (socket says 172.21.15.45:60226) 2023-11-28T12:07:00.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.478+0000 7f673e19b700 1 -- 172.21.15.45:0/1902631231 learned_addr learned my addr 172.21.15.45:0/1902631231 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:00.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.478+0000 7f673d99a700 1 --2- 172.21.15.45:0/1902631231 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f673815c9b0 0x7f6738149470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:00.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.478+0000 7f673e99c700 1 --2- 172.21.15.45:0/1902631231 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6738161340 0x7f67380ccc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:00.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.478+0000 7f673e19b700 1 -- 172.21.15.45:0/1902631231 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6738161340 msgr2=0x7f67380ccc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:00.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.478+0000 7f673e19b700 1 --2- 172.21.15.45:0/1902631231 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6738161340 0x7f67380ccc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:00.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.478+0000 7f673e19b700 1 -- 172.21.15.45:0/1902631231 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f673815c9b0 msgr2=0x7f6738149470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:00.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.478+0000 7f673e19b700 1 --2- 172.21.15.45:0/1902631231 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f673815c9b0 0x7f6738149470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:00.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.478+0000 7f673e19b700 1 -- 172.21.15.45:0/1902631231 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6730009b30 con 0x7f67380d2320 2023-11-28T12:07:00.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.478+0000 7f673d99a700 1 --2- 172.21.15.45:0/1902631231 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f673815c9b0 0x7f6738149470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:07:00.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.478+0000 7f673e99c700 1 --2- 172.21.15.45:0/1902631231 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6738161340 0x7f67380ccc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:07:00.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.479+0000 7f673e19b700 1 --2- 172.21.15.45:0/1902631231 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f67380d2320 0x7f67381e75f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f673400c450 tx=0x7f673400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:00.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.479+0000 7f672effd700 1 -- 172.21.15.45:0/1902631231 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67340052d0 con 0x7f67380d2320 2023-11-28T12:07:00.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.479+0000 7f672effd700 1 -- 172.21.15.45:0/1902631231 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6734005430 con 0x7f67380d2320 2023-11-28T12:07:00.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.479+0000 7f672effd700 1 -- 172.21.15.45:0/1902631231 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67340038c0 con 0x7f67380d2320 2023-11-28T12:07:00.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.479+0000 7f67403ff700 1 -- 172.21.15.45:0/1902631231 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67380d15e0 con 0x7f67380d2320 2023-11-28T12:07:00.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.479+0000 7f67403ff700 1 -- 172.21.15.45:0/1902631231 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67380d1300 con 0x7f67380d2320 2023-11-28T12:07:00.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.480+0000 7f67403ff700 1 -- 172.21.15.45:0/1902631231 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f673815cd80 con 0x7f67380d2320 2023-11-28T12:07:00.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.481+0000 7f672effd700 1 -- 172.21.15.45:0/1902631231 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f6734019030 con 0x7f67380d2320 2023-11-28T12:07:00.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.482+0000 7f672effd700 1 --2- 172.21.15.45:0/1902631231 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f671c0682f0 0x7f671c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:00.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.482+0000 7f672effd700 1 -- 172.21.15.45:0/1902631231 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6734084f60 con 0x7f67380d2320 2023-11-28T12:07:00.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.483+0000 7f673d99a700 1 --2- 172.21.15.45:0/1902631231 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f671c0682f0 0x7f671c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:00.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.484+0000 7f673d99a700 1 --2- 172.21.15.45:0/1902631231 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f671c0682f0 0x7f671c06a7a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6738159a60 tx=0x7f6728008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:00.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.486+0000 7f672effd700 1 -- 172.21.15.45:0/1902631231 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f67340516d0 con 0x7f67380d2320 2023-11-28T12:07:00.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.688+0000 7f67403ff700 1 -- 172.21.15.45:0/1902631231 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6738067b10 con 0x7f67380d2320 2023-11-28T12:07:00.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.689+0000 7f672effd700 1 -- 172.21.15.45:0/1902631231 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+17849 (secure 0 0 0) 0x7f6734054cf0 con 0x7f67380d2320 2023-11-28T12:07:00.691 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:07:00.691 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":20,"fsid":"bd7c37f1-f7c6-4778-b845-52cf2aa6e366","created":"2023-11-28T12:06:09.045075+0000","modified":"2023-11-28T12:06:30.396046+0000","last_up_change":"2023-11-28T12:06:21.282227+0000","last_in_change":"2023-11-28T12:06:12.560924+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T12:06:21.807108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T12:06:22.491009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T12:06:27.684157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T12:06:28.384679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d0cdd8a-87fd-4f2c-91bd-47bdfa661905","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":115843},{"type":"v1","addr":"172.21.15.45:6808","nonce":115843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":115843},{"type":"v1","addr":"172.21.15.45:6811","nonce":115843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":115843},{"type":"v1","addr":"172.21.15.45:6815","nonce":115843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":115843},{"type":"v1","addr":"172.21.15.45:6813","nonce":115843}]},"public_addr":"172.21.15.45:6808/115843","cluster_addr":"172.21.15.45:6811/115843","heartbeat_back_addr":"172.21.15.45:6815/115843","heartbeat_front_addr":"172.21.15.45:6813/115843","state":["exists","up"]},{"osd":1,"uuid":"c5de4ebd-9ec5-40b3-9caa-9b706fab4c76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":115842},{"type":"v1","addr":"172.21.15.45:6801","nonce":115842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":115842},{"type":"v1","addr":"172.21.15.45:6803","nonce":115842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6807","nonce":115842},{"type":"v1","addr":"172.21.15.45:6809","nonce":115842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":115842},{"type":"v1","addr":"172.21.15.45:6805","nonce":115842}]},"public_addr":"172.21.15.45:6801/115842","cluster_addr":"172.21.15.45:6803/115842","heartbeat_back_addr":"172.21.15.45:6809/115842","heartbeat_front_addr":"172.21.15.45:6805/115842","state":["exists","up"]},{"osd":2,"uuid":"9f4b36b2-65d2-40e7-9fe6-a2991afa71c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":115850},{"type":"v1","addr":"172.21.15.45:6819","nonce":115850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":115850},{"type":"v1","addr":"172.21.15.45:6823","nonce":115850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":115850},{"type":"v1","addr":"172.21.15.45:6831","nonce":115850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":115850},{"type":"v1","addr":"172.21.15.45:6828","nonce":115850}]},"public_addr":"172.21.15.45:6819/115850","cluster_addr":"172.21.15.45:6823/115850","heartbeat_back_addr":"172.21.15.45:6831/115850","heartbeat_front_addr":"172.21.15.45:6828/115850","state":["exists","up"]},{"osd":3,"uuid":"6fe7ef05-4e0d-426c-bf94-44b51d4d550b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":115848},{"type":"v1","addr":"172.21.15.45:6818","nonce":115848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":115848},{"type":"v1","addr":"172.21.15.45:6822","nonce":115848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6827","nonce":115848},{"type":"v1","addr":"172.21.15.45:6829","nonce":115848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":115848},{"type":"v1","addr":"172.21.15.45:6825","nonce":115848}]},"public_addr":"172.21.15.45:6818/115848","cluster_addr":"172.21.15.45:6822/115848","heartbeat_back_addr":"172.21.15.45:6829/115848","heartbeat_front_addr":"172.21.15.45:6825/115848","state":["exists","up"]},{"osd":4,"uuid":"fa403c08-d8a1-4a3a-8384-cb465c1a654c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":116092},{"type":"v1","addr":"172.21.15.152:6801","nonce":116092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":116092},{"type":"v1","addr":"172.21.15.152:6803","nonce":116092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":116092},{"type":"v1","addr":"172.21.15.152:6807","nonce":116092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":116092},{"type":"v1","addr":"172.21.15.152:6805","nonce":116092}]},"public_addr":"172.21.15.152:6801/116092","cluster_addr":"172.21.15.152:6803/116092","heartbeat_back_addr":"172.21.15.152:6807/116092","heartbeat_front_addr":"172.21.15.152:6805/116092","state":["exists","up"]},{"osd":5,"uuid":"399fc450-39fa-43a6-bf80-0b8bcb41bd95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6815","nonce":116093},{"type":"v1","addr":"172.21.15.152:6817","nonce":116093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":116093},{"type":"v1","addr":"172.21.15.152:6819","nonce":116093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":116093},{"type":"v1","addr":"172.21.15.152:6823","nonce":116093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":116093},{"type":"v1","addr":"172.21.15.152:6821","nonce":116093}]},"public_addr":"172.21.15.152:6817/116093","cluster_addr":"172.21.15.152:6819/116093","heartbeat_back_addr":"172.21.15.152:6823/116093","heartbeat_front_addr":"172.21.15.152:6821/116093","state":["exists","up"]},{"osd":6,"uuid":"e59a4017-2d23-4627-836b-e25b2d3ddaaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":116094},{"type":"v1","addr":"172.21.15.152:6809","nonce":116094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":116094},{"type":"v1","addr":"172.21.15.152:6811","nonce":116094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":116094},{"type":"v1","addr":"172.21.15.152:6816","nonce":116094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":116094},{"type":"v1","addr":"172.21.15.152:6813","nonce":116094}]},"public_addr":"172.21.15.152:6809/116094","cluster_addr":"172.21.15.152:6811/116094","heartbeat_back_addr":"172.21.15.152:6816/116094","heartbeat_front_addr":"172.21.15.152:6813/116094","state":["exists","up"]},{"osd":7,"uuid":"8d7f9d4b-bf08-4670-8591-388c0f012a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":116097},{"type":"v1","addr":"172.21.15.152:6825","nonce":116097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":116097},{"type":"v1","addr":"172.21.15.152:6827","nonce":116097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":116097},{"type":"v1","addr":"172.21.15.152:6831","nonce":116097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":116097},{"type":"v1","addr":"172.21.15.152:6829","nonce":116097}]},"public_addr":"172.21.15.152:6825/116097","cluster_addr":"172.21.15.152:6827/116097","heartbeat_back_addr":"172.21.15.152:6831/116097","heartbeat_front_addr":"172.21.15.152:6829/116097","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.937710+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.865423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.159434+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.913090+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.131647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.966255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.972583+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.177209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T12:07:00.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.691+0000 7f67403ff700 1 -- 172.21.15.45:0/1902631231 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f671c0682f0 msgr2=0x7f671c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:00.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.691+0000 7f67403ff700 1 --2- 172.21.15.45:0/1902631231 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f671c0682f0 0x7f671c06a7a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6738159a60 tx=0x7f6728008040 comp rx=0 tx=0).stop 2023-11-28T12:07:00.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.691+0000 7f67403ff700 1 -- 172.21.15.45:0/1902631231 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f67380d2320 msgr2=0x7f67381e75f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:00.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.691+0000 7f67403ff700 1 --2- 172.21.15.45:0/1902631231 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f67380d2320 0x7f67381e75f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f673400c450 tx=0x7f673400c810 comp rx=0 tx=0).stop 2023-11-28T12:07:00.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.691+0000 7f67403ff700 1 -- 172.21.15.45:0/1902631231 shutdown_connections 2023-11-28T12:07:00.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.691+0000 7f67403ff700 1 --2- 172.21.15.45:0/1902631231 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f671c0682f0 0x7f671c06a7a0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:00.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.691+0000 7f67403ff700 1 --2- 172.21.15.45:0/1902631231 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6738161340 0x7f67380ccc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:00.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.691+0000 7f67403ff700 1 --2- 172.21.15.45:0/1902631231 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f67380d2320 0x7f67381e75f0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:00.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.691+0000 7f67403ff700 1 --2- 172.21.15.45:0/1902631231 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f673815c9b0 0x7f6738149470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:00.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.691+0000 7f67403ff700 1 -- 172.21.15.45:0/1902631231 >> 172.21.15.45:0/1902631231 conn(0x7f6738072600 msgr2=0x7f67380b6e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:00.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.691+0000 7f67403ff700 1 -- 172.21.15.45:0/1902631231 shutdown_connections 2023-11-28T12:07:00.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.691+0000 7f67403ff700 1 -- 172.21.15.45:0/1902631231 wait complete. 2023-11-28T12:07:00.711 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-28T12:06:21.807108+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-28T12:06:22.491009+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T12:06:27.684157+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T12:06:28.384679+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T12:07:00.712 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T12:07:00.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.917+0000 7fb6399ff700 1 Processor -- start 2023-11-28T12:07:00.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.917+0000 7fb6399ff700 1 -- start start 2023-11-28T12:07:00.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.918+0000 7fb6399ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb63415c9b0 0x7fb6340b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:00.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.918+0000 7fb6399ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb6340cd7c0 0x7fb6340cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:00.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.918+0000 7fb6399ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6340d1950 con 0x7fb634161340 2023-11-28T12:07:00.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.918+0000 7fb6399ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6340b5800 con 0x7fb63415c9b0 2023-11-28T12:07:00.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.918+0000 7fb6399ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6340ce140 con 0x7fb6340cd7c0 2023-11-28T12:07:00.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.918+0000 7fb6327fc700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fb634161340 0x7fb6340d1de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:52750/0 (socket says 172.21.15.45:52750) 2023-11-28T12:07:00.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.918+0000 7fb6327fc700 1 -- 172.21.15.45:0/3247014285 learned_addr learned my addr 172.21.15.45:0/3247014285 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:07:00.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.918+0000 7fb632ffd700 1 --2- 172.21.15.45:0/3247014285 >> v2:172.21.15.45:3300/0 conn(0x7fb63415c9b0 0x7fb6340b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:00.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.918+0000 7fb6337fe700 1 --2- 172.21.15.45:0/3247014285 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb6340cd7c0 0x7fb6340cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:00.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.919+0000 7fb632ffd700 1 -- 172.21.15.45:0/3247014285 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb6340cd7c0 msgr2=0x7fb6340cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:00.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.919+0000 7fb632ffd700 1 --2- 172.21.15.45:0/3247014285 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb6340cd7c0 0x7fb6340cdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:00.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.919+0000 7fb632ffd700 1 -- 172.21.15.45:0/3247014285 >> v1:172.21.15.45:6789/0 conn(0x7fb634161340 legacy=0x7fb6340d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:00.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.919+0000 7fb632ffd700 1 -- 172.21.15.45:0/3247014285 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6340d24f0 con 0x7fb63415c9b0 2023-11-28T12:07:00.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.919+0000 7fb631ffb700 1 -- 172.21.15.45:0/3247014285 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1719255243 0 0) 0x7fb6340d1950 con 0x7fb634161340 2023-11-28T12:07:00.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.919+0000 7fb6337fe700 1 --2- 172.21.15.45:0/3247014285 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb6340cd7c0 0x7fb6340cdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:07:00.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.919+0000 7fb632ffd700 1 --2- 172.21.15.45:0/3247014285 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb63415c9b0 0x7fb6340b4bf0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb624009840 tx=0x7fb624009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=173cf0c1e6d13791 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:00.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.919+0000 7fb631ffb700 1 -- 172.21.15.45:0/3247014285 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb624011830 con 0x7fb63415c9b0 2023-11-28T12:07:00.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.919+0000 7fb631ffb700 1 -- 172.21.15.45:0/3247014285 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb624011990 con 0x7fb63415c9b0 2023-11-28T12:07:00.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.919+0000 7fb631ffb700 1 -- 172.21.15.45:0/3247014285 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb624011d20 con 0x7fb63415c9b0 2023-11-28T12:07:00.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.920+0000 7fb6399ff700 1 -- 172.21.15.45:0/3247014285 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb63415c9b0 msgr2=0x7fb6340b4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:00.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.920+0000 7fb6399ff700 1 --2- 172.21.15.45:0/3247014285 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb63415c9b0 0x7fb6340b4bf0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb624009840 tx=0x7fb624009b50 comp rx=0 tx=0).stop 2023-11-28T12:07:00.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.920+0000 7fb6399ff700 1 -- 172.21.15.45:0/3247014285 shutdown_connections 2023-11-28T12:07:00.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.920+0000 7fb6399ff700 1 --2- 172.21.15.45:0/3247014285 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb6340cd7c0 0x7fb6340cdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:00.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.920+0000 7fb6399ff700 1 --2- 172.21.15.45:0/3247014285 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb63415c9b0 0x7fb6340b4bf0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:00.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.920+0000 7fb6399ff700 1 -- 172.21.15.45:0/3247014285 >> 172.21.15.45:0/3247014285 conn(0x7fb634072600 msgr2=0x7fb6340cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:00.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.920+0000 7fb6399ff700 1 -- 172.21.15.45:0/3247014285 shutdown_connections 2023-11-28T12:07:00.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.920+0000 7fb6399ff700 1 -- 172.21.15.45:0/3247014285 wait complete. 2023-11-28T12:07:00.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.922+0000 7fb6399ff700 1 Processor -- start 2023-11-28T12:07:00.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.922+0000 7fb6399ff700 1 -- start start 2023-11-28T12:07:00.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.923+0000 7fb6399ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb6340cd7c0 0x7fb6340cac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:00.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.923+0000 7fb6399ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb63415c9b0 0x7fb6340ccfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:00.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.923+0000 7fb6399ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb634161340 0x7fb63415e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:00.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.923+0000 7fb6399ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6341f6cc0 con 0x7fb634161340 2023-11-28T12:07:00.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.923+0000 7fb6399ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6340cb470 con 0x7fb6340cd7c0 2023-11-28T12:07:00.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.923+0000 7fb6399ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6341f5f00 con 0x7fb63415c9b0 2023-11-28T12:07:00.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.923+0000 7fb6337fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb634161340 0x7fb63415e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:00.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.923+0000 7fb632ffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb6340cd7c0 0x7fb6340cac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:00.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.923+0000 7fb6337fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb634161340 0x7fb63415e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60236/0 (socket says 172.21.15.45:60236) 2023-11-28T12:07:00.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.923+0000 7fb6337fe700 1 -- 172.21.15.45:0/4127542132 learned_addr learned my addr 172.21.15.45:0/4127542132 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:00.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.923+0000 7fb6327fc700 1 --2- 172.21.15.45:0/4127542132 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb63415c9b0 0x7fb6340ccfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:00.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.924+0000 7fb6337fe700 1 -- 172.21.15.45:0/4127542132 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb63415c9b0 msgr2=0x7fb6340ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:00.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.924+0000 7fb6337fe700 1 --2- 172.21.15.45:0/4127542132 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb63415c9b0 0x7fb6340ccfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:00.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.924+0000 7fb6337fe700 1 -- 172.21.15.45:0/4127542132 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb6340cd7c0 msgr2=0x7fb6340cac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:00.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.924+0000 7fb6337fe700 1 --2- 172.21.15.45:0/4127542132 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb6340cd7c0 0x7fb6340cac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:00.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.924+0000 7fb6337fe700 1 -- 172.21.15.45:0/4127542132 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6240094a0 con 0x7fb634161340 2023-11-28T12:07:00.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.924+0000 7fb632ffd700 1 --2- 172.21.15.45:0/4127542132 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb6340cd7c0 0x7fb6340cac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:07:00.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.924+0000 7fb6337fe700 1 --2- 172.21.15.45:0/4127542132 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb634161340 0x7fb63415e350 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb62c007e70 tx=0x7fb62c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:00.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.924+0000 7fb61bfff700 1 -- 172.21.15.45:0/4127542132 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb62c00dd20 con 0x7fb634161340 2023-11-28T12:07:00.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.924+0000 7fb61bfff700 1 -- 172.21.15.45:0/4127542132 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb62c00f040 con 0x7fb634161340 2023-11-28T12:07:00.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.924+0000 7fb6399ff700 1 -- 172.21.15.45:0/4127542132 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6340d1300 con 0x7fb634161340 2023-11-28T12:07:00.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.924+0000 7fb61bfff700 1 -- 172.21.15.45:0/4127542132 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb62c00dea0 con 0x7fb634161340 2023-11-28T12:07:00.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.924+0000 7fb6399ff700 1 -- 172.21.15.45:0/4127542132 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6340b5520 con 0x7fb634161340 2023-11-28T12:07:00.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.925+0000 7fb6399ff700 1 -- 172.21.15.45:0/4127542132 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6340d15e0 con 0x7fb634161340 2023-11-28T12:07:00.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.926+0000 7fb61bfff700 1 -- 172.21.15.45:0/4127542132 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fb62c01c030 con 0x7fb634161340 2023-11-28T12:07:00.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.927+0000 7fb61bfff700 1 --2- 172.21.15.45:0/4127542132 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb6200682f0 0x7fb62006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:00.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.927+0000 7fb61bfff700 1 -- 172.21.15.45:0/4127542132 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb62c085bd0 con 0x7fb634161340 2023-11-28T12:07:00.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.927+0000 7fb632ffd700 1 --2- 172.21.15.45:0/4127542132 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb6200682f0 0x7fb62006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:00.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.928+0000 7fb632ffd700 1 --2- 172.21.15.45:0/4127542132 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb6200682f0 0x7fb62006a7a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb6240090b0 tx=0x7fb62401c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:00.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:00.931+0000 7fb61bfff700 1 -- 172.21.15.45:0/4127542132 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fb62c052340 con 0x7fb634161340 2023-11-28T12:07:01.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.137+0000 7fb6399ff700 1 -- 172.21.15.45:0/4127542132 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb6340745c0 con 0x7fb634161340 2023-11-28T12:07:01.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.137+0000 7fb61bfff700 1 -- 172.21.15.45:0/4127542132 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb62c01a020 con 0x7fb634161340 2023-11-28T12:07:01.139 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-11-28T12:07:01.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.139+0000 7fb6399ff700 1 -- 172.21.15.45:0/4127542132 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb6200682f0 msgr2=0x7fb62006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:01.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.139+0000 7fb6399ff700 1 --2- 172.21.15.45:0/4127542132 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb6200682f0 0x7fb62006a7a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb6240090b0 tx=0x7fb62401c040 comp rx=0 tx=0).stop 2023-11-28T12:07:01.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.139+0000 7fb6399ff700 1 -- 172.21.15.45:0/4127542132 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb634161340 msgr2=0x7fb63415e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:01.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.139+0000 7fb6399ff700 1 --2- 172.21.15.45:0/4127542132 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb634161340 0x7fb63415e350 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb62c007e70 tx=0x7fb62c00d3b0 comp rx=0 tx=0).stop 2023-11-28T12:07:01.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.140+0000 7fb6399ff700 1 -- 172.21.15.45:0/4127542132 shutdown_connections 2023-11-28T12:07:01.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.140+0000 7fb6399ff700 1 --2- 172.21.15.45:0/4127542132 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb6200682f0 0x7fb62006a7a0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:01.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.140+0000 7fb6399ff700 1 --2- 172.21.15.45:0/4127542132 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb6340cd7c0 0x7fb6340cac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:01.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.140+0000 7fb6399ff700 1 --2- 172.21.15.45:0/4127542132 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb634161340 0x7fb63415e350 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:01.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.140+0000 7fb6399ff700 1 --2- 172.21.15.45:0/4127542132 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb63415c9b0 0x7fb6340ccfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:01.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.140+0000 7fb6399ff700 1 -- 172.21.15.45:0/4127542132 >> 172.21.15.45:0/4127542132 conn(0x7fb634072600 msgr2=0x7fb63415bc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:01.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.140+0000 7fb6399ff700 1 -- 172.21.15.45:0/4127542132 shutdown_connections 2023-11-28T12:07:01.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.140+0000 7fb6399ff700 1 -- 172.21.15.45:0/4127542132 wait complete. 2023-11-28T12:07:01.159 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T12:07:01.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.363+0000 7f33a1dff700 1 Processor -- start 2023-11-28T12:07:01.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.364+0000 7f33a1dff700 1 -- start start 2023-11-28T12:07:01.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.365+0000 7f33a1dff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f339c15c9b0 0x7f339c0b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:01.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.365+0000 7f33a1dff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f339c0cd7c0 0x7f339c0cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:01.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.365+0000 7f33a1dff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f339c0d1950 con 0x7f339c161340 2023-11-28T12:07:01.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.365+0000 7f33a1dff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f339c0b5800 con 0x7f339c15c9b0 2023-11-28T12:07:01.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.365+0000 7f33a1dff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f339c0ce140 con 0x7f339c0cd7c0 2023-11-28T12:07:01.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.365+0000 7f339bfff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f339c0cd7c0 0x7f339c0cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:01.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.365+0000 7f339b7fe700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f339c15c9b0 0x7f339c0b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:01.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.366+0000 7f3393fff700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f339c161340 0x7f339c0d1de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.45:60572/0 (socket says 172.21.15.45:60572) 2023-11-28T12:07:01.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.366+0000 7f339b7fe700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f339c15c9b0 0x7f339c0b4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.45:60728/0 (socket says 172.21.15.45:60728) 2023-11-28T12:07:01.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.366+0000 7f339b7fe700 1 -- 172.21.15.45:0/878164194 learned_addr learned my addr 172.21.15.45:0/878164194 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:01.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.366+0000 7f339bfff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f339c0cd7c0 0x7f339c0cdc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.45:34912/0 (socket says 172.21.15.45:34912) 2023-11-28T12:07:01.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.366+0000 7f339b7fe700 1 -- 172.21.15.45:0/878164194 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f339c0cd7c0 msgr2=0x7f339c0cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:01.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.366+0000 7f339b7fe700 1 --2- 172.21.15.45:0/878164194 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f339c0cd7c0 0x7f339c0cdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:01.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.366+0000 7f339affd700 1 -- 172.21.15.45:0/878164194 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1138820912 0 0) 0x7f339c0d1950 con 0x7f339c161340 2023-11-28T12:07:01.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.366+0000 7f339b7fe700 1 -- 172.21.15.45:0/878164194 >> v1:172.21.15.152:6789/0 conn(0x7f339c161340 legacy=0x7f339c0d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:01.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.366+0000 7f339b7fe700 1 -- 172.21.15.45:0/878164194 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f339c0d24f0 con 0x7f339c15c9b0 2023-11-28T12:07:01.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.366+0000 7f339bfff700 1 --2- 172.21.15.45:0/878164194 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f339c0cd7c0 0x7f339c0cdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:07:01.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.366+0000 7f339b7fe700 1 --2- 172.21.15.45:0/878164194 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f339c15c9b0 0x7f339c0b4bf0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f338c0098f0 tx=0x7f338c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9e7bf7b33fc0606 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:01.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.367+0000 7f339affd700 1 -- 172.21.15.45:0/878164194 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338c011830 con 0x7f339c15c9b0 2023-11-28T12:07:01.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.367+0000 7f339affd700 1 -- 172.21.15.45:0/878164194 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f338c011990 con 0x7f339c15c9b0 2023-11-28T12:07:01.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.367+0000 7f339affd700 1 -- 172.21.15.45:0/878164194 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338c011d20 con 0x7f339c15c9b0 2023-11-28T12:07:01.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.367+0000 7f33a1dff700 1 -- 172.21.15.45:0/878164194 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f339c15c9b0 msgr2=0x7f339c0b4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:01.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.367+0000 7f33a1dff700 1 --2- 172.21.15.45:0/878164194 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f339c15c9b0 0x7f339c0b4bf0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f338c0098f0 tx=0x7f338c009c00 comp rx=0 tx=0).stop 2023-11-28T12:07:01.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.367+0000 7f33a1dff700 1 -- 172.21.15.45:0/878164194 shutdown_connections 2023-11-28T12:07:01.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.367+0000 7f33a1dff700 1 --2- 172.21.15.45:0/878164194 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f339c0cd7c0 0x7f339c0cdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:01.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.367+0000 7f33a1dff700 1 --2- 172.21.15.45:0/878164194 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f339c15c9b0 0x7f339c0b4bf0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:01.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.367+0000 7f33a1dff700 1 -- 172.21.15.45:0/878164194 >> 172.21.15.45:0/878164194 conn(0x7f339c072600 msgr2=0x7f339c0cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:01.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.367+0000 7f33a1dff700 1 -- 172.21.15.45:0/878164194 shutdown_connections 2023-11-28T12:07:01.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.367+0000 7f33a1dff700 1 -- 172.21.15.45:0/878164194 wait complete. 2023-11-28T12:07:01.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.369+0000 7f33a1dff700 1 Processor -- start 2023-11-28T12:07:01.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.369+0000 7f33a1dff700 1 -- start start 2023-11-28T12:07:01.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.370+0000 7f33a1dff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f339c0cd7c0 0x7f339c14a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:01.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.370+0000 7f33a1dff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f339c15c9b0 0x7f339c0ca240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:01.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.370+0000 7f33a1dff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f339c161340 0x7f339c0b8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:01.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.370+0000 7f33a1dff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f339c14aa50 con 0x7f339c161340 2023-11-28T12:07:01.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.370+0000 7f33a1dff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f339c0c7c40 con 0x7f339c0cd7c0 2023-11-28T12:07:01.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.370+0000 7f33a1dff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f339c0c8390 con 0x7f339c15c9b0 2023-11-28T12:07:01.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.370+0000 7f339bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f339c161340 0x7f339c0b8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:01.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.370+0000 7f339b7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f339c0cd7c0 0x7f339c14a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:01.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.370+0000 7f3393fff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f339c15c9b0 0x7f339c0ca240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:01.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.370+0000 7f339bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f339c161340 0x7f339c0b8350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60242/0 (socket says 172.21.15.45:60242) 2023-11-28T12:07:01.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.370+0000 7f339bfff700 1 -- 172.21.15.45:0/507452591 learned_addr learned my addr 172.21.15.45:0/507452591 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:01.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.371+0000 7f339b7fe700 1 -- 172.21.15.45:0/507452591 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f339c15c9b0 msgr2=0x7f339c0ca240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:01.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.371+0000 7f339b7fe700 1 --2- 172.21.15.45:0/507452591 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f339c15c9b0 0x7f339c0ca240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:01.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.371+0000 7f339b7fe700 1 -- 172.21.15.45:0/507452591 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f339c161340 msgr2=0x7f339c0b8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:01.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.371+0000 7f339b7fe700 1 --2- 172.21.15.45:0/507452591 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f339c161340 0x7f339c0b8350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:01.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.371+0000 7f339b7fe700 1 -- 172.21.15.45:0/507452591 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3394009a70 con 0x7f339c0cd7c0 2023-11-28T12:07:01.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.371+0000 7f339bfff700 1 --2- 172.21.15.45:0/507452591 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f339c161340 0x7f339c0b8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:07:01.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.371+0000 7f339b7fe700 1 --2- 172.21.15.45:0/507452591 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f339c0cd7c0 0x7f339c14a510 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f338c016000 tx=0x7f338c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:01.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.371+0000 7f3398ff9700 1 -- 172.21.15.45:0/507452591 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338c004510 con 0x7f339c0cd7c0 2023-11-28T12:07:01.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.371+0000 7f3398ff9700 1 -- 172.21.15.45:0/507452591 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f338c01e070 con 0x7f339c0cd7c0 2023-11-28T12:07:01.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.371+0000 7f33a1dff700 1 -- 172.21.15.45:0/507452591 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f338c009550 con 0x7f339c0cd7c0 2023-11-28T12:07:01.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.372+0000 7f3398ff9700 1 -- 172.21.15.45:0/507452591 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338c0038e0 con 0x7f339c0cd7c0 2023-11-28T12:07:01.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.372+0000 7f33a1dff700 1 -- 172.21.15.45:0/507452591 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f339c0d1300 con 0x7f339c0cd7c0 2023-11-28T12:07:01.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.373+0000 7f33a1dff700 1 -- 172.21.15.45:0/507452591 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f339c0b5520 con 0x7f339c0cd7c0 2023-11-28T12:07:01.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.373+0000 7f3398ff9700 1 -- 172.21.15.45:0/507452591 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f338c00f050 con 0x7f339c0cd7c0 2023-11-28T12:07:01.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.374+0000 7f3398ff9700 1 --2- 172.21.15.45:0/507452591 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f337c068340 0x7f337c06a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:01.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.374+0000 7f3398ff9700 1 -- 172.21.15.45:0/507452591 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f338c086bc0 con 0x7f339c0cd7c0 2023-11-28T12:07:01.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.375+0000 7f3393fff700 1 --2- 172.21.15.45:0/507452591 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f337c068340 0x7f337c06a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:01.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.375+0000 7f3393fff700 1 --2- 172.21.15.45:0/507452591 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f337c068340 0x7f337c06a7f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f339c1e9240 tx=0x7f3384007de0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:01.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.379+0000 7f3398ff9700 1 -- 172.21.15.45:0/507452591 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f338c053330 con 0x7f339c0cd7c0 2023-11-28T12:07:01.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.587+0000 7f33a1dff700 1 -- 172.21.15.45:0/507452591 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f339c0d15e0 con 0x7f339c0cd7c0 2023-11-28T12:07:01.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.587+0000 7f3398ff9700 1 -- 172.21.15.45:0/507452591 <== mon.1 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f338c015020 con 0x7f339c0cd7c0 2023-11-28T12:07:01.589 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-11-28T12:07:01.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.590+0000 7f33a1dff700 1 -- 172.21.15.45:0/507452591 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f337c068340 msgr2=0x7f337c06a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:01.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.590+0000 7f33a1dff700 1 --2- 172.21.15.45:0/507452591 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f337c068340 0x7f337c06a7f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f339c1e9240 tx=0x7f3384007de0 comp rx=0 tx=0).stop 2023-11-28T12:07:01.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.590+0000 7f33a1dff700 1 -- 172.21.15.45:0/507452591 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f339c0cd7c0 msgr2=0x7f339c14a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:01.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.590+0000 7f33a1dff700 1 --2- 172.21.15.45:0/507452591 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f339c0cd7c0 0x7f339c14a510 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f338c016000 tx=0x7f338c004750 comp rx=0 tx=0).stop 2023-11-28T12:07:01.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.590+0000 7f33a1dff700 1 -- 172.21.15.45:0/507452591 shutdown_connections 2023-11-28T12:07:01.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.590+0000 7f33a1dff700 1 --2- 172.21.15.45:0/507452591 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f337c068340 0x7f337c06a7f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:01.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.590+0000 7f33a1dff700 1 --2- 172.21.15.45:0/507452591 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f339c0cd7c0 0x7f339c14a510 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:01.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.590+0000 7f33a1dff700 1 --2- 172.21.15.45:0/507452591 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f339c161340 0x7f339c0b8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:01.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.590+0000 7f33a1dff700 1 --2- 172.21.15.45:0/507452591 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f339c15c9b0 0x7f339c0ca240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:01.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.590+0000 7f33a1dff700 1 -- 172.21.15.45:0/507452591 >> 172.21.15.45:0/507452591 conn(0x7f339c072600 msgr2=0x7f339c15a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:01.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.590+0000 7f33a1dff700 1 -- 172.21.15.45:0/507452591 shutdown_connections 2023-11-28T12:07:01.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.590+0000 7f33a1dff700 1 -- 172.21.15.45:0/507452591 wait complete. 2023-11-28T12:07:01.610 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T12:07:01.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.814+0000 7f86ad5ff700 1 Processor -- start 2023-11-28T12:07:01.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.815+0000 7f86ad5ff700 1 -- start start 2023-11-28T12:07:01.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.816+0000 7f86ad5ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f86a815c9b0 0x7f86a80b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:01.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.816+0000 7f86ad5ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f86a8161340 0x7f86a80d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:01.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.816+0000 7f86ad5ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86a80d1950 con 0x7f86a80d2320 2023-11-28T12:07:01.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.816+0000 7f86ad5ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86a80b5800 con 0x7f86a815c9b0 2023-11-28T12:07:01.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.816+0000 7f86ad5ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86a80b5520 con 0x7f86a8161340 2023-11-28T12:07:01.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.816+0000 7f86a6ffd700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f86a815c9b0 0x7f86a80b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:01.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.816+0000 7f869ffff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f86a8161340 0x7f86a80d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:01.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.816+0000 7f86a6ffd700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f86a815c9b0 0x7f86a80b4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.45:60754/0 (socket says 172.21.15.45:60754) 2023-11-28T12:07:01.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.816+0000 7f86a6ffd700 1 -- 172.21.15.45:0/3045628634 learned_addr learned my addr 172.21.15.45:0/3045628634 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:01.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.816+0000 7f86a77fe700 1 --1- 172.21.15.45:0/3045628634 >> v1:172.21.15.152:6789/0 conn(0x7f86a80d2320 0x7f86a80cd7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.45:60584/0 (socket says 172.21.15.45:60584) 2023-11-28T12:07:01.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.817+0000 7f869ffff700 1 -- 172.21.15.45:0/3045628634 >> v2:172.21.15.152:3300/0 conn(0x7f86a815c9b0 msgr2=0x7f86a80b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:01.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.817+0000 7f869ffff700 1 --2- 172.21.15.45:0/3045628634 >> v2:172.21.15.152:3300/0 conn(0x7f86a815c9b0 0x7f86a80b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:01.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.817+0000 7f869ffff700 1 -- 172.21.15.45:0/3045628634 >> v1:172.21.15.152:6789/0 conn(0x7f86a80d2320 legacy=0x7f86a80cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:01.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.817+0000 7f86a67fc700 1 -- 172.21.15.45:0/3045628634 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 211179284 0 0) 0x7f86a80d1950 con 0x7f86a80d2320 2023-11-28T12:07:01.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.817+0000 7f869ffff700 1 -- 172.21.15.45:0/3045628634 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86a80d1300 con 0x7f86a8161340 2023-11-28T12:07:01.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.817+0000 7f869ffff700 1 --2- 172.21.15.45:0/3045628634 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f86a8161340 0x7f86a80d1de0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8690009840 tx=0x7f8690009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a79531e9c9cfbe6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:01.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.817+0000 7f86a67fc700 1 -- 172.21.15.45:0/3045628634 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8690011830 con 0x7f86a8161340 2023-11-28T12:07:01.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.817+0000 7f86a67fc700 1 -- 172.21.15.45:0/3045628634 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8690011990 con 0x7f86a8161340 2023-11-28T12:07:01.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.817+0000 7f86a67fc700 1 -- 172.21.15.45:0/3045628634 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8690011d20 con 0x7f86a8161340 2023-11-28T12:07:01.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.818+0000 7f86ad5ff700 1 -- 172.21.15.45:0/3045628634 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f86a8161340 msgr2=0x7f86a80d1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:01.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.818+0000 7f86ad5ff700 1 --2- 172.21.15.45:0/3045628634 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f86a8161340 0x7f86a80d1de0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8690009840 tx=0x7f8690009b50 comp rx=0 tx=0).stop 2023-11-28T12:07:01.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.818+0000 7f86ad5ff700 1 -- 172.21.15.45:0/3045628634 shutdown_connections 2023-11-28T12:07:01.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.818+0000 7f86ad5ff700 1 --2- 172.21.15.45:0/3045628634 >> v2:172.21.15.152:3300/0 conn(0x7f86a815c9b0 0x7f86a80b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:01.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.818+0000 7f86ad5ff700 1 --2- 172.21.15.45:0/3045628634 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f86a8161340 0x7f86a80d1de0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:01.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.818+0000 7f86ad5ff700 1 -- 172.21.15.45:0/3045628634 >> 172.21.15.45:0/3045628634 conn(0x7f86a8072600 msgr2=0x7f86a80cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:01.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.818+0000 7f86ad5ff700 1 -- 172.21.15.45:0/3045628634 shutdown_connections 2023-11-28T12:07:01.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.818+0000 7f86ad5ff700 1 -- 172.21.15.45:0/3045628634 wait complete. 2023-11-28T12:07:01.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.820+0000 7f86ad5ff700 1 Processor -- start 2023-11-28T12:07:01.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.820+0000 7f86ad5ff700 1 -- start start 2023-11-28T12:07:01.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.821+0000 7f86ad5ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f86a80d2320 0x7f86a80c9b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:01.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.821+0000 7f86ad5ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86a815c9b0 0x7f86a80c6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:01.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.821+0000 7f86ad5ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86a8161340 0x7f86a81f2990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:01.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.821+0000 7f86ad5ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86a80c67a0 con 0x7f86a815c9b0 2023-11-28T12:07:01.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.821+0000 7f86ad5ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86a8155d10 con 0x7f86a8161340 2023-11-28T12:07:01.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.821+0000 7f86ad5ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86a8155f60 con 0x7f86a80d2320 2023-11-28T12:07:01.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.821+0000 7f869ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86a815c9b0 0x7f86a80c6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:01.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.821+0000 7f869ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86a815c9b0 0x7f86a80c6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60256/0 (socket says 172.21.15.45:60256) 2023-11-28T12:07:01.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.821+0000 7f869ffff700 1 -- 172.21.15.45:0/504972959 learned_addr learned my addr 172.21.15.45:0/504972959 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:01.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.821+0000 7f86a6ffd700 1 --2- 172.21.15.45:0/504972959 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f86a80d2320 0x7f86a80c9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:01.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.821+0000 7f86a77fe700 1 --2- 172.21.15.45:0/504972959 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86a8161340 0x7f86a81f2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:01.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.821+0000 7f869ffff700 1 -- 172.21.15.45:0/504972959 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f86a80d2320 msgr2=0x7f86a80c9b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:01.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.821+0000 7f869ffff700 1 --2- 172.21.15.45:0/504972959 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f86a80d2320 0x7f86a80c9b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:01.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.821+0000 7f869ffff700 1 -- 172.21.15.45:0/504972959 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86a8161340 msgr2=0x7f86a81f2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:01.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.821+0000 7f869ffff700 1 --2- 172.21.15.45:0/504972959 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86a8161340 0x7f86a81f2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:01.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.821+0000 7f869ffff700 1 -- 172.21.15.45:0/504972959 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86900094a0 con 0x7f86a815c9b0 2023-11-28T12:07:01.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.822+0000 7f869ffff700 1 --2- 172.21.15.45:0/504972959 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86a815c9b0 0x7f86a80c6260 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8690009fd0 tx=0x7f8690004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:01.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.822+0000 7f869f7fe700 1 -- 172.21.15.45:0/504972959 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86900036a0 con 0x7f86a815c9b0 2023-11-28T12:07:01.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.822+0000 7f869f7fe700 1 -- 172.21.15.45:0/504972959 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f869001f070 con 0x7f86a815c9b0 2023-11-28T12:07:01.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.822+0000 7f869f7fe700 1 -- 172.21.15.45:0/504972959 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8690003a60 con 0x7f86a815c9b0 2023-11-28T12:07:01.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.822+0000 7f86ad5ff700 1 -- 172.21.15.45:0/504972959 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86a80b5130 con 0x7f86a815c9b0 2023-11-28T12:07:01.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.822+0000 7f86ad5ff700 1 -- 172.21.15.45:0/504972959 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86a80d15e0 con 0x7f86a815c9b0 2023-11-28T12:07:01.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.823+0000 7f86ad5ff700 1 -- 172.21.15.45:0/504972959 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86a80b52c0 con 0x7f86a815c9b0 2023-11-28T12:07:01.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.824+0000 7f869f7fe700 1 -- 172.21.15.45:0/504972959 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f869000f050 con 0x7f86a815c9b0 2023-11-28T12:07:01.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.825+0000 7f869f7fe700 1 --2- 172.21.15.45:0/504972959 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f86880682f0 0x7f868806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:01.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.825+0000 7f869f7fe700 1 -- 172.21.15.45:0/504972959 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8690021070 con 0x7f86a815c9b0 2023-11-28T12:07:01.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.825+0000 7f86a6ffd700 1 --2- 172.21.15.45:0/504972959 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f86880682f0 0x7f868806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:01.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.826+0000 7f86a6ffd700 1 --2- 172.21.15.45:0/504972959 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f86880682f0 0x7f868806a7a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8698009bd0 tx=0x7f86980092c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:01.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:01.829+0000 7f869f7fe700 1 -- 172.21.15.45:0/504972959 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f8690053c70 con 0x7f86a815c9b0 2023-11-28T12:07:02.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.029+0000 7f86ad5ff700 1 -- 172.21.15.45:0/504972959 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f86a80745c0 con 0x7f86a815c9b0 2023-11-28T12:07:02.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.029+0000 7f869f7fe700 1 -- 172.21.15.45:0/504972959 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8690057290 con 0x7f86a815c9b0 2023-11-28T12:07:02.031 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-11-28T12:07:02.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.031+0000 7f86ad5ff700 1 -- 172.21.15.45:0/504972959 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f86880682f0 msgr2=0x7f868806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:02.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.031+0000 7f86ad5ff700 1 --2- 172.21.15.45:0/504972959 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f86880682f0 0x7f868806a7a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8698009bd0 tx=0x7f86980092c0 comp rx=0 tx=0).stop 2023-11-28T12:07:02.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.031+0000 7f86ad5ff700 1 -- 172.21.15.45:0/504972959 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86a815c9b0 msgr2=0x7f86a80c6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:02.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.031+0000 7f86ad5ff700 1 --2- 172.21.15.45:0/504972959 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86a815c9b0 0x7f86a80c6260 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8690009fd0 tx=0x7f8690004750 comp rx=0 tx=0).stop 2023-11-28T12:07:02.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.031+0000 7f86ad5ff700 1 -- 172.21.15.45:0/504972959 shutdown_connections 2023-11-28T12:07:02.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.031+0000 7f86ad5ff700 1 --2- 172.21.15.45:0/504972959 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f86880682f0 0x7f868806a7a0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:02.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.031+0000 7f86ad5ff700 1 --2- 172.21.15.45:0/504972959 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86a8161340 0x7f86a81f2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:02.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.031+0000 7f86ad5ff700 1 --2- 172.21.15.45:0/504972959 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f86a80d2320 0x7f86a80c9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:02.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.031+0000 7f86ad5ff700 1 --2- 172.21.15.45:0/504972959 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86a815c9b0 0x7f86a80c6260 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:02.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.031+0000 7f86ad5ff700 1 -- 172.21.15.45:0/504972959 >> 172.21.15.45:0/504972959 conn(0x7f86a8072600 msgr2=0x7f86a8160610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:02.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.032+0000 7f86ad5ff700 1 -- 172.21.15.45:0/504972959 shutdown_connections 2023-11-28T12:07:02.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.032+0000 7f86ad5ff700 1 -- 172.21.15.45:0/504972959 wait complete. 2023-11-28T12:07:02.051 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T12:07:02.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.256+0000 7f65603ff700 1 Processor -- start 2023-11-28T12:07:02.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.256+0000 7f65603ff700 1 -- start start 2023-11-28T12:07:02.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.257+0000 7f65603ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f65580cd7c0 0x7f65580cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:02.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.257+0000 7f65603ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65580d1950 con 0x7f6558161340 2023-11-28T12:07:02.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.257+0000 7f65603ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65580ce140 con 0x7f655815c9b0 2023-11-28T12:07:02.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.257+0000 7f65603ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65580b5800 con 0x7f65580cd7c0 2023-11-28T12:07:02.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.258+0000 7f655d99a700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f6558161340 0x7f65580d1de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33614/0 (socket says 172.21.15.45:33614) 2023-11-28T12:07:02.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.258+0000 7f655e99c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f65580cd7c0 0x7f65580cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:02.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.258+0000 7f655d99a700 1 -- 172.21.15.45:0/2492384083 learned_addr learned my addr 172.21.15.45:0/2492384083 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:07:02.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.258+0000 7f655e99c700 1 -- 172.21.15.45:0/2492384083 >> v1:172.21.15.152:6789/0 conn(0x7f655815c9b0 legacy=0x7f65580b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:02.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.258+0000 7f655e99c700 1 -- 172.21.15.45:0/2492384083 >> v1:172.21.15.45:6789/0 conn(0x7f6558161340 legacy=0x7f65580d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:02.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.258+0000 7f655e99c700 1 -- 172.21.15.45:0/2492384083 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65580d24f0 con 0x7f65580cd7c0 2023-11-28T12:07:02.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.258+0000 7f655d199700 1 -- 172.21.15.45:0/2492384083 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4193979104 0 0) 0x7f65580ce140 con 0x7f655815c9b0 2023-11-28T12:07:02.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.258+0000 7f655e99c700 1 --2- 172.21.15.45:0/2492384083 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f65580cd7c0 0x7f65580cdc00 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6550009d90 tx=0x7f655000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba74ea00398cb218 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:02.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.259+0000 7f655d199700 1 -- 172.21.15.45:0/2492384083 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f655000e070 con 0x7f65580cd7c0 2023-11-28T12:07:02.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.259+0000 7f655d199700 1 -- 172.21.15.45:0/2492384083 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f655000bbd0 con 0x7f65580cd7c0 2023-11-28T12:07:02.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.259+0000 7f655d199700 1 -- 172.21.15.45:0/2492384083 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6550012430 con 0x7f65580cd7c0 2023-11-28T12:07:02.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.259+0000 7f65603ff700 1 -- 172.21.15.45:0/2492384083 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f65580cd7c0 msgr2=0x7f65580cdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:02.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.259+0000 7f65603ff700 1 --2- 172.21.15.45:0/2492384083 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f65580cd7c0 0x7f65580cdc00 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6550009d90 tx=0x7f655000b330 comp rx=0 tx=0).stop 2023-11-28T12:07:02.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.259+0000 7f65603ff700 1 -- 172.21.15.45:0/2492384083 shutdown_connections 2023-11-28T12:07:02.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.259+0000 7f65603ff700 1 --2- 172.21.15.45:0/2492384083 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f65580cd7c0 0x7f65580cdc00 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:02.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.259+0000 7f65603ff700 1 -- 172.21.15.45:0/2492384083 >> 172.21.15.45:0/2492384083 conn(0x7f6558072600 msgr2=0x7f65580cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:02.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.259+0000 7f65603ff700 1 -- 172.21.15.45:0/2492384083 shutdown_connections 2023-11-28T12:07:02.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.259+0000 7f65603ff700 1 -- 172.21.15.45:0/2492384083 wait complete. 2023-11-28T12:07:02.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.261+0000 7f65603ff700 1 Processor -- start 2023-11-28T12:07:02.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.261+0000 7f65603ff700 1 -- start start 2023-11-28T12:07:02.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.262+0000 7f65603ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f65580cd7c0 0x7f65580c7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:02.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.262+0000 7f65603ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f655815c9b0 0x7f6558156fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:02.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.262+0000 7f65603ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6558161340 0x7f65580ca240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:02.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.262+0000 7f65603ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65580cb920 con 0x7f6558161340 2023-11-28T12:07:02.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.262+0000 7f65603ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65580ccf30 con 0x7f65580cd7c0 2023-11-28T12:07:02.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.262+0000 7f65603ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65580cd210 con 0x7f655815c9b0 2023-11-28T12:07:02.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.262+0000 7f655e99c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6558161340 0x7f65580ca240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:02.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.262+0000 7f655e99c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6558161340 0x7f65580ca240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37764/0 (socket says 172.21.15.45:37764) 2023-11-28T12:07:02.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.262+0000 7f655e99c700 1 -- 172.21.15.45:0/1674500766 learned_addr learned my addr 172.21.15.45:0/1674500766 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:02.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.262+0000 7f655e19b700 1 --2- 172.21.15.45:0/1674500766 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f65580cd7c0 0x7f65580c7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:02.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.262+0000 7f655d99a700 1 --2- 172.21.15.45:0/1674500766 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f655815c9b0 0x7f6558156fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:02.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.263+0000 7f655e99c700 1 -- 172.21.15.45:0/1674500766 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f655815c9b0 msgr2=0x7f6558156fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:02.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.263+0000 7f655e99c700 1 --2- 172.21.15.45:0/1674500766 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f655815c9b0 0x7f6558156fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:02.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.263+0000 7f655e99c700 1 -- 172.21.15.45:0/1674500766 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f65580cd7c0 msgr2=0x7f65580c7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:02.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.263+0000 7f655e99c700 1 --2- 172.21.15.45:0/1674500766 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f65580cd7c0 0x7f65580c7540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:02.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.263+0000 7f655e99c700 1 -- 172.21.15.45:0/1674500766 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6550009a70 con 0x7f6558161340 2023-11-28T12:07:02.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.263+0000 7f655e19b700 1 --2- 172.21.15.45:0/1674500766 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f65580cd7c0 0x7f65580c7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:07:02.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.263+0000 7f655e99c700 1 --2- 172.21.15.45:0/1674500766 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6558161340 0x7f65580ca240 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6550014040 tx=0x7f6550004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:02.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.263+0000 7f654effd700 1 -- 172.21.15.45:0/1674500766 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f655001b810 con 0x7f6558161340 2023-11-28T12:07:02.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.263+0000 7f654effd700 1 -- 172.21.15.45:0/1674500766 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6550020070 con 0x7f6558161340 2023-11-28T12:07:02.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.263+0000 7f654effd700 1 -- 172.21.15.45:0/1674500766 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f655001bbb0 con 0x7f6558161340 2023-11-28T12:07:02.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.263+0000 7f65603ff700 1 -- 172.21.15.45:0/1674500766 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65580d1300 con 0x7f6558161340 2023-11-28T12:07:02.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.263+0000 7f65603ff700 1 -- 172.21.15.45:0/1674500766 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65580b5520 con 0x7f6558161340 2023-11-28T12:07:02.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.264+0000 7f65603ff700 1 -- 172.21.15.45:0/1674500766 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65580d15e0 con 0x7f6558161340 2023-11-28T12:07:02.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.265+0000 7f654effd700 1 -- 172.21.15.45:0/1674500766 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f655002e070 con 0x7f6558161340 2023-11-28T12:07:02.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.266+0000 7f654effd700 1 --2- 172.21.15.45:0/1674500766 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f653c0682f0 0x7f653c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:02.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.266+0000 7f654effd700 1 -- 172.21.15.45:0/1674500766 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6550022070 con 0x7f6558161340 2023-11-28T12:07:02.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.266+0000 7f655e19b700 1 --2- 172.21.15.45:0/1674500766 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f653c0682f0 0x7f653c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:02.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.267+0000 7f655e19b700 1 --2- 172.21.15.45:0/1674500766 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f653c0682f0 0x7f653c06a7a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6554000f60 tx=0x7f6554009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:02.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.270+0000 7f654effd700 1 -- 172.21.15.45:0/1674500766 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f65500546b0 con 0x7f6558161340 2023-11-28T12:07:02.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.473+0000 7f65603ff700 1 -- 172.21.15.45:0/1674500766 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f65580745c0 con 0x7f6558161340 2023-11-28T12:07:02.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.474+0000 7f654effd700 1 -- 172.21.15.45:0/1674500766 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f655002c020 con 0x7f6558161340 2023-11-28T12:07:02.476 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-11-28T12:07:02.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.476+0000 7f65603ff700 1 -- 172.21.15.45:0/1674500766 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f653c0682f0 msgr2=0x7f653c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:02.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.476+0000 7f65603ff700 1 --2- 172.21.15.45:0/1674500766 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f653c0682f0 0x7f653c06a7a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6554000f60 tx=0x7f6554009040 comp rx=0 tx=0).stop 2023-11-28T12:07:02.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.476+0000 7f65603ff700 1 -- 172.21.15.45:0/1674500766 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6558161340 msgr2=0x7f65580ca240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:02.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.476+0000 7f65603ff700 1 --2- 172.21.15.45:0/1674500766 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6558161340 0x7f65580ca240 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6550014040 tx=0x7f6550004ad0 comp rx=0 tx=0).stop 2023-11-28T12:07:02.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.476+0000 7f65603ff700 1 -- 172.21.15.45:0/1674500766 shutdown_connections 2023-11-28T12:07:02.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.476+0000 7f65603ff700 1 --2- 172.21.15.45:0/1674500766 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f653c0682f0 0x7f653c06a7a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:02.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.476+0000 7f65603ff700 1 --2- 172.21.15.45:0/1674500766 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f65580cd7c0 0x7f65580c7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:02.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.476+0000 7f65603ff700 1 --2- 172.21.15.45:0/1674500766 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6558161340 0x7f65580ca240 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:02.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.476+0000 7f65603ff700 1 --2- 172.21.15.45:0/1674500766 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f655815c9b0 0x7f6558156fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:02.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.476+0000 7f65603ff700 1 -- 172.21.15.45:0/1674500766 >> 172.21.15.45:0/1674500766 conn(0x7f6558072600 msgr2=0x7f655806a900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:02.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.477+0000 7f65603ff700 1 -- 172.21.15.45:0/1674500766 shutdown_connections 2023-11-28T12:07:02.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.477+0000 7f65603ff700 1 -- 172.21.15.45:0/1674500766 wait complete. 2023-11-28T12:07:02.496 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T12:07:02.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.698+0000 7ff7d49ff700 1 Processor -- start 2023-11-28T12:07:02.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.698+0000 7ff7d49ff700 1 -- start start 2023-11-28T12:07:02.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.699+0000 7ff7d49ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ff7d00d01b0 0x7ff7d00d0c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:02.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.699+0000 7ff7d49ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff7d00b20b0 0x7ff7d00d1160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:02.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.699+0000 7ff7d49ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff7d00b29b0 0x7ff7d00b2e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:02.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.699+0000 7ff7d49ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7d015cec0 con 0x7ff7d00b29b0 2023-11-28T12:07:02.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.699+0000 7ff7d49ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7d00b0230 con 0x7ff7d00d01b0 2023-11-28T12:07:02.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.699+0000 7ff7d49ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d00b4570 con 0x7ff7d00b20b0 2023-11-28T12:07:02.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.699+0000 7ff7ced9d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff7d00b29b0 0x7ff7d00b2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:02.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.699+0000 7ff7ced9d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff7d00b29b0 0x7ff7d00b2e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37772/0 (socket says 172.21.15.45:37772) 2023-11-28T12:07:02.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.699+0000 7ff7ced9d700 1 -- 172.21.15.45:0/410023596 learned_addr learned my addr 172.21.15.45:0/410023596 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:02.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.700+0000 7ff7ced9d700 1 -- 172.21.15.45:0/410023596 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff7d00b20b0 msgr2=0x7ff7d00d1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:02.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.700+0000 7ff7ced9d700 1 --2- 172.21.15.45:0/410023596 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff7d00b20b0 0x7ff7d00d1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:02.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.700+0000 7ff7ced9d700 1 -- 172.21.15.45:0/410023596 >> v2:172.21.15.152:3300/0 conn(0x7ff7d00d01b0 msgr2=0x7ff7d00d0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:02.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.700+0000 7ff7ced9d700 1 --2- 172.21.15.45:0/410023596 >> v2:172.21.15.152:3300/0 conn(0x7ff7d00d01b0 0x7ff7d00d0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:02.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.700+0000 7ff7ced9d700 1 -- 172.21.15.45:0/410023596 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7d00b4850 con 0x7ff7d00b29b0 2023-11-28T12:07:02.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.700+0000 7ff7ced9d700 1 --2- 172.21.15.45:0/410023596 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7d00b29b0 0x7ff7d00b2e30 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff7d00b5bb0 tx=0x7ff7c800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a7c6eb8f4a261f3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:02.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.700+0000 7ff7cdd9b700 1 -- 172.21.15.45:0/410023596 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c800e070 con 0x7ff7d00b29b0 2023-11-28T12:07:02.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.700+0000 7ff7cdd9b700 1 -- 172.21.15.45:0/410023596 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7c800b9c0 con 0x7ff7d00b29b0 2023-11-28T12:07:02.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.700+0000 7ff7cdd9b700 1 -- 172.21.15.45:0/410023596 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c800bd70 con 0x7ff7d00b29b0 2023-11-28T12:07:02.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.701+0000 7ff7d49ff700 1 -- 172.21.15.45:0/410023596 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7d00b29b0 msgr2=0x7ff7d00b2e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:02.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.701+0000 7ff7d49ff700 1 --2- 172.21.15.45:0/410023596 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7d00b29b0 0x7ff7d00b2e30 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff7d00b5bb0 tx=0x7ff7c800b330 comp rx=0 tx=0).stop 2023-11-28T12:07:02.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.701+0000 7ff7d49ff700 1 -- 172.21.15.45:0/410023596 shutdown_connections 2023-11-28T12:07:02.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.701+0000 7ff7d49ff700 1 --2- 172.21.15.45:0/410023596 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7d00b29b0 0x7ff7d00b2e30 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:02.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.701+0000 7ff7d49ff700 1 --2- 172.21.15.45:0/410023596 >> v2:172.21.15.152:3300/0 conn(0x7ff7d00d01b0 0x7ff7d00d0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:02.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.701+0000 7ff7d49ff700 1 --2- 172.21.15.45:0/410023596 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff7d00b20b0 0x7ff7d00d1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:02.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.701+0000 7ff7d49ff700 1 -- 172.21.15.45:0/410023596 >> 172.21.15.45:0/410023596 conn(0x7ff7d009c3f0 msgr2=0x7ff7d00d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:02.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.701+0000 7ff7d49ff700 1 -- 172.21.15.45:0/410023596 shutdown_connections 2023-11-28T12:07:02.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.701+0000 7ff7d49ff700 1 -- 172.21.15.45:0/410023596 wait complete. 2023-11-28T12:07:02.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.703+0000 7ff7d49ff700 1 Processor -- start 2023-11-28T12:07:02.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.703+0000 7ff7d49ff700 1 -- start start 2023-11-28T12:07:02.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.704+0000 7ff7d49ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7d00b20b0 0x7ff7d00b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:02.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.704+0000 7ff7d49ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7d00b29b0 0x7ff7d00c6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:02.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.704+0000 7ff7d49ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff7d00d01b0 0x7ff7d00ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:02.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.704+0000 7ff7d49ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d00b7ce0 con 0x7ff7d00b20b0 2023-11-28T12:07:02.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.704+0000 7ff7d49ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d0147260 con 0x7ff7d00b29b0 2023-11-28T12:07:02.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.704+0000 7ff7d49ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d00b7f10 con 0x7ff7d00d01b0 2023-11-28T12:07:02.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.704+0000 7ff7ce59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7d00b20b0 0x7ff7d00b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:02.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.704+0000 7ff7ce59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7d00b20b0 0x7ff7d00b77a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37780/0 (socket says 172.21.15.45:37780) 2023-11-28T12:07:02.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.704+0000 7ff7ce59c700 1 -- 172.21.15.45:0/1256534621 learned_addr learned my addr 172.21.15.45:0/1256534621 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:02.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.704+0000 7ff7ced9d700 1 --2- 172.21.15.45:0/1256534621 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff7d00d01b0 0x7ff7d00ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:02.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.704+0000 7ff7c7fff700 1 --2- 172.21.15.45:0/1256534621 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7d00b29b0 0x7ff7d00c6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:02.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.704+0000 7ff7ce59c700 1 -- 172.21.15.45:0/1256534621 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff7d00d01b0 msgr2=0x7ff7d00ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:02.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.704+0000 7ff7ce59c700 1 --2- 172.21.15.45:0/1256534621 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff7d00d01b0 0x7ff7d00ccaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:02.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.704+0000 7ff7ce59c700 1 -- 172.21.15.45:0/1256534621 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7d00b29b0 msgr2=0x7ff7d00c6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:02.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.704+0000 7ff7ce59c700 1 --2- 172.21.15.45:0/1256534621 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7d00b29b0 0x7ff7d00c6bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:02.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.704+0000 7ff7ce59c700 1 -- 172.21.15.45:0/1256534621 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c8009b30 con 0x7ff7d00b20b0 2023-11-28T12:07:02.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.704+0000 7ff7ced9d700 1 --2- 172.21.15.45:0/1256534621 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff7d00d01b0 0x7ff7d00ccaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:07:02.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.704+0000 7ff7c7fff700 1 --2- 172.21.15.45:0/1256534621 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7d00b29b0 0x7ff7d00c6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:07:02.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.705+0000 7ff7ce59c700 1 --2- 172.21.15.45:0/1256534621 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7d00b20b0 0x7ff7d00b77a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff7c000b4a0 tx=0x7ff7c000b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:02.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.705+0000 7ff7c6ffd700 1 -- 172.21.15.45:0/1256534621 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c0011830 con 0x7ff7d00b20b0 2023-11-28T12:07:02.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.705+0000 7ff7c6ffd700 1 -- 172.21.15.45:0/1256534621 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7c0011990 con 0x7ff7d00b20b0 2023-11-28T12:07:02.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.705+0000 7ff7d49ff700 1 -- 172.21.15.45:0/1256534621 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7d00afec0 con 0x7ff7d00b20b0 2023-11-28T12:07:02.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.705+0000 7ff7c6ffd700 1 -- 172.21.15.45:0/1256534621 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c0011d40 con 0x7ff7d00b20b0 2023-11-28T12:07:02.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.705+0000 7ff7d49ff700 1 -- 172.21.15.45:0/1256534621 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7d00afbe0 con 0x7ff7d00b20b0 2023-11-28T12:07:02.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.706+0000 7ff7d49ff700 1 -- 172.21.15.45:0/1256534621 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7d00b2600 con 0x7ff7d00b20b0 2023-11-28T12:07:02.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.707+0000 7ff7c6ffd700 1 -- 172.21.15.45:0/1256534621 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7ff7c0021070 con 0x7ff7d00b20b0 2023-11-28T12:07:02.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.708+0000 7ff7c6ffd700 1 --2- 172.21.15.45:0/1256534621 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7ff7b00682f0 0x7ff7b006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:02.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.708+0000 7ff7c6ffd700 1 -- 172.21.15.45:0/1256534621 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff7c0085ce0 con 0x7ff7d00b20b0 2023-11-28T12:07:02.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.709+0000 7ff7c7fff700 1 --2- 172.21.15.45:0/1256534621 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7ff7b00682f0 0x7ff7b006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:02.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.710+0000 7ff7c7fff700 1 --2- 172.21.15.45:0/1256534621 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7ff7b00682f0 0x7ff7b006a7a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff7d01e2480 tx=0x7ff7b8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:02.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.712+0000 7ff7c6ffd700 1 -- 172.21.15.45:0/1256534621 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7ff7c00523d0 con 0x7ff7d00b20b0 2023-11-28T12:07:02.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.919+0000 7ff7d49ff700 1 -- 172.21.15.45:0/1256534621 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff7d0068690 con 0x7ff7d00b20b0 2023-11-28T12:07:02.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.920+0000 7ff7c6ffd700 1 -- 172.21.15.45:0/1256534621 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+17849 (secure 0 0 0) 0x7ff7c0015020 con 0x7ff7d00b20b0 2023-11-28T12:07:02.922 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:07:02.922 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":20,"fsid":"bd7c37f1-f7c6-4778-b845-52cf2aa6e366","created":"2023-11-28T12:06:09.045075+0000","modified":"2023-11-28T12:06:30.396046+0000","last_up_change":"2023-11-28T12:06:21.282227+0000","last_in_change":"2023-11-28T12:06:12.560924+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T12:06:21.807108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T12:06:22.491009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T12:06:27.684157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T12:06:28.384679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d0cdd8a-87fd-4f2c-91bd-47bdfa661905","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":115843},{"type":"v1","addr":"172.21.15.45:6808","nonce":115843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":115843},{"type":"v1","addr":"172.21.15.45:6811","nonce":115843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":115843},{"type":"v1","addr":"172.21.15.45:6815","nonce":115843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":115843},{"type":"v1","addr":"172.21.15.45:6813","nonce":115843}]},"public_addr":"172.21.15.45:6808/115843","cluster_addr":"172.21.15.45:6811/115843","heartbeat_back_addr":"172.21.15.45:6815/115843","heartbeat_front_addr":"172.21.15.45:6813/115843","state":["exists","up"]},{"osd":1,"uuid":"c5de4ebd-9ec5-40b3-9caa-9b706fab4c76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":115842},{"type":"v1","addr":"172.21.15.45:6801","nonce":115842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":115842},{"type":"v1","addr":"172.21.15.45:6803","nonce":115842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6807","nonce":115842},{"type":"v1","addr":"172.21.15.45:6809","nonce":115842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":115842},{"type":"v1","addr":"172.21.15.45:6805","nonce":115842}]},"public_addr":"172.21.15.45:6801/115842","cluster_addr":"172.21.15.45:6803/115842","heartbeat_back_addr":"172.21.15.45:6809/115842","heartbeat_front_addr":"172.21.15.45:6805/115842","state":["exists","up"]},{"osd":2,"uuid":"9f4b36b2-65d2-40e7-9fe6-a2991afa71c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":115850},{"type":"v1","addr":"172.21.15.45:6819","nonce":115850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":115850},{"type":"v1","addr":"172.21.15.45:6823","nonce":115850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":115850},{"type":"v1","addr":"172.21.15.45:6831","nonce":115850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":115850},{"type":"v1","addr":"172.21.15.45:6828","nonce":115850}]},"public_addr":"172.21.15.45:6819/115850","cluster_addr":"172.21.15.45:6823/115850","heartbeat_back_addr":"172.21.15.45:6831/115850","heartbeat_front_addr":"172.21.15.45:6828/115850","state":["exists","up"]},{"osd":3,"uuid":"6fe7ef05-4e0d-426c-bf94-44b51d4d550b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":115848},{"type":"v1","addr":"172.21.15.45:6818","nonce":115848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":115848},{"type":"v1","addr":"172.21.15.45:6822","nonce":115848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6827","nonce":115848},{"type":"v1","addr":"172.21.15.45:6829","nonce":115848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":115848},{"type":"v1","addr":"172.21.15.45:6825","nonce":115848}]},"public_addr":"172.21.15.45:6818/115848","cluster_addr":"172.21.15.45:6822/115848","heartbeat_back_addr":"172.21.15.45:6829/115848","heartbeat_front_addr":"172.21.15.45:6825/115848","state":["exists","up"]},{"osd":4,"uuid":"fa403c08-d8a1-4a3a-8384-cb465c1a654c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":116092},{"type":"v1","addr":"172.21.15.152:6801","nonce":116092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":116092},{"type":"v1","addr":"172.21.15.152:6803","nonce":116092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":116092},{"type":"v1","addr":"172.21.15.152:6807","nonce":116092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":116092},{"type":"v1","addr":"172.21.15.152:6805","nonce":116092}]},"public_addr":"172.21.15.152:6801/116092","cluster_addr":"172.21.15.152:6803/116092","heartbeat_back_addr":"172.21.15.152:6807/116092","heartbeat_front_addr":"172.21.15.152:6805/116092","state":["exists","up"]},{"osd":5,"uuid":"399fc450-39fa-43a6-bf80-0b8bcb41bd95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6815","nonce":116093},{"type":"v1","addr":"172.21.15.152:6817","nonce":116093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":116093},{"type":"v1","addr":"172.21.15.152:6819","nonce":116093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":116093},{"type":"v1","addr":"172.21.15.152:6823","nonce":116093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":116093},{"type":"v1","addr":"172.21.15.152:6821","nonce":116093}]},"public_addr":"172.21.15.152:6817/116093","cluster_addr":"172.21.15.152:6819/116093","heartbeat_back_addr":"172.21.15.152:6823/116093","heartbeat_front_addr":"172.21.15.152:6821/116093","state":["exists","up"]},{"osd":6,"uuid":"e59a4017-2d23-4627-836b-e25b2d3ddaaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":116094},{"type":"v1","addr":"172.21.15.152:6809","nonce":116094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":116094},{"type":"v1","addr":"172.21.15.152:6811","nonce":116094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":116094},{"type":"v1","addr":"172.21.15.152:6816","nonce":116094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":116094},{"type":"v1","addr":"172.21.15.152:6813","nonce":116094}]},"public_addr":"172.21.15.152:6809/116094","cluster_addr":"172.21.15.152:6811/116094","heartbeat_back_addr":"172.21.15.152:6816/116094","heartbeat_front_addr":"172.21.15.152:6813/116094","state":["exists","up"]},{"osd":7,"uuid":"8d7f9d4b-bf08-4670-8591-388c0f012a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":116097},{"type":"v1","addr":"172.21.15.152:6825","nonce":116097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":116097},{"type":"v1","addr":"172.21.15.152:6827","nonce":116097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":116097},{"type":"v1","addr":"172.21.15.152:6831","nonce":116097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":116097},{"type":"v1","addr":"172.21.15.152:6829","nonce":116097}]},"public_addr":"172.21.15.152:6825/116097","cluster_addr":"172.21.15.152:6827/116097","heartbeat_back_addr":"172.21.15.152:6831/116097","heartbeat_front_addr":"172.21.15.152:6829/116097","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.937710+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.865423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.159434+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.913090+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.131647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.966255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.972583+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.177209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T12:07:02.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.922+0000 7ff7d49ff700 1 -- 172.21.15.45:0/1256534621 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7ff7b00682f0 msgr2=0x7ff7b006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:02.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.922+0000 7ff7d49ff700 1 --2- 172.21.15.45:0/1256534621 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7ff7b00682f0 0x7ff7b006a7a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff7d01e2480 tx=0x7ff7b8008040 comp rx=0 tx=0).stop 2023-11-28T12:07:02.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.922+0000 7ff7d49ff700 1 -- 172.21.15.45:0/1256534621 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7d00b20b0 msgr2=0x7ff7d00b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:02.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.922+0000 7ff7d49ff700 1 --2- 172.21.15.45:0/1256534621 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7d00b20b0 0x7ff7d00b77a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff7c000b4a0 tx=0x7ff7c000b860 comp rx=0 tx=0).stop 2023-11-28T12:07:02.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.922+0000 7ff7d49ff700 1 -- 172.21.15.45:0/1256534621 shutdown_connections 2023-11-28T12:07:02.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.922+0000 7ff7d49ff700 1 --2- 172.21.15.45:0/1256534621 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7ff7b00682f0 0x7ff7b006a7a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:02.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.922+0000 7ff7d49ff700 1 --2- 172.21.15.45:0/1256534621 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff7d00d01b0 0x7ff7d00ccaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:02.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.922+0000 7ff7d49ff700 1 --2- 172.21.15.45:0/1256534621 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7d00b20b0 0x7ff7d00b77a0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:02.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.922+0000 7ff7d49ff700 1 --2- 172.21.15.45:0/1256534621 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7d00b29b0 0x7ff7d00c6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:02.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.922+0000 7ff7d49ff700 1 -- 172.21.15.45:0/1256534621 >> 172.21.15.45:0/1256534621 conn(0x7ff7d009c3f0 msgr2=0x7ff7d00b06c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:02.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.923+0000 7ff7d49ff700 1 -- 172.21.15.45:0/1256534621 shutdown_connections 2023-11-28T12:07:02.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:02.923+0000 7ff7d49ff700 1 -- 172.21.15.45:0/1256534621 wait complete. 2023-11-28T12:07:02.943 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-28T12:06:21.807108+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-28T12:06:22.491009+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T12:06:27.684157+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T12:06:28.384679+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T12:07:02.944 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T12:07:03.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.149+0000 7f87f01ff700 1 Processor -- start 2023-11-28T12:07:03.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.149+0000 7f87f01ff700 1 -- start start 2023-11-28T12:07:03.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.150+0000 7f87f01ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f87e8161340 0x7f87e80d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:03.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.150+0000 7f87f01ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f87e80d2320 0x7f87e80cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:03.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.150+0000 7f87f01ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87e80d1950 con 0x7f87e815c9b0 2023-11-28T12:07:03.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.150+0000 7f87f01ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87e80b5800 con 0x7f87e80d2320 2023-11-28T12:07:03.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.150+0000 7f87f01ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87e80b5300 con 0x7f87e8161340 2023-11-28T12:07:03.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.150+0000 7f87ee79c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f87e80d2320 0x7f87e80cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:03.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.150+0000 7f87ee79c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f87e80d2320 0x7f87e80cd7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37786/0 (socket says 172.21.15.45:37786) 2023-11-28T12:07:03.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.151+0000 7f87ee79c700 1 -- 172.21.15.45:0/652492582 learned_addr learned my addr 172.21.15.45:0/652492582 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:03.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.151+0000 7f87ed79a700 1 --2- 172.21.15.45:0/652492582 >> v2:172.21.15.152:3300/0 conn(0x7f87e8161340 0x7f87e80d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:03.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.151+0000 7f87ee79c700 1 -- 172.21.15.45:0/652492582 >> v2:172.21.15.152:3300/0 conn(0x7f87e8161340 msgr2=0x7f87e80d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:03.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.151+0000 7f87ee79c700 1 --2- 172.21.15.45:0/652492582 >> v2:172.21.15.152:3300/0 conn(0x7f87e8161340 0x7f87e80d1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:03.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.151+0000 7f87ee79c700 1 -- 172.21.15.45:0/652492582 >> v1:172.21.15.152:6789/0 conn(0x7f87e815c9b0 legacy=0x7f87e80b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:03.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.151+0000 7f87ee79c700 1 -- 172.21.15.45:0/652492582 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87e80b5520 con 0x7f87e80d2320 2023-11-28T12:07:03.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.151+0000 7f87ee79c700 1 --2- 172.21.15.45:0/652492582 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f87e80d2320 0x7f87e80cd7c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f87e80685c0 tx=0x7f87e000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c31a7056ed24151e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:03.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.151+0000 7f87ecf99700 1 -- 172.21.15.45:0/652492582 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e000e070 con 0x7f87e80d2320 2023-11-28T12:07:03.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.151+0000 7f87ecf99700 1 -- 172.21.15.45:0/652492582 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87e000b8d0 con 0x7f87e80d2320 2023-11-28T12:07:03.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.151+0000 7f87ecf99700 1 -- 172.21.15.45:0/652492582 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e000bc80 con 0x7f87e80d2320 2023-11-28T12:07:03.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.152+0000 7f87f01ff700 1 -- 172.21.15.45:0/652492582 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f87e80d2320 msgr2=0x7f87e80cd7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:03.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.152+0000 7f87f01ff700 1 --2- 172.21.15.45:0/652492582 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f87e80d2320 0x7f87e80cd7c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f87e80685c0 tx=0x7f87e000b330 comp rx=0 tx=0).stop 2023-11-28T12:07:03.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.152+0000 7f87f01ff700 1 -- 172.21.15.45:0/652492582 shutdown_connections 2023-11-28T12:07:03.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.152+0000 7f87f01ff700 1 --2- 172.21.15.45:0/652492582 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f87e80d2320 0x7f87e80cd7c0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:03.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.152+0000 7f87f01ff700 1 --2- 172.21.15.45:0/652492582 >> v2:172.21.15.152:3300/0 conn(0x7f87e8161340 0x7f87e80d1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:03.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.152+0000 7f87f01ff700 1 -- 172.21.15.45:0/652492582 >> 172.21.15.45:0/652492582 conn(0x7f87e8072600 msgr2=0x7f87e80cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:03.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.152+0000 7f87f01ff700 1 -- 172.21.15.45:0/652492582 shutdown_connections 2023-11-28T12:07:03.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.152+0000 7f87f01ff700 1 -- 172.21.15.45:0/652492582 wait complete. 2023-11-28T12:07:03.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.154+0000 7f87f01ff700 1 Processor -- start 2023-11-28T12:07:03.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.154+0000 7f87f01ff700 1 -- start start 2023-11-28T12:07:03.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.155+0000 7f87f01ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f87e80d2320 0x7f87e80c9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:03.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.155+0000 7f87f01ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87e815c9b0 0x7f87e8150750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:03.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.155+0000 7f87f01ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f87e8161340 0x7f87e80b8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:03.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.155+0000 7f87f01ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e81521e0 con 0x7f87e8161340 2023-11-28T12:07:03.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.155+0000 7f87f01ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e8154dd0 con 0x7f87e815c9b0 2023-11-28T12:07:03.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.155+0000 7f87f01ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87e8150c90 con 0x7f87e80d2320 2023-11-28T12:07:03.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.155+0000 7f87ee79c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f87e8161340 0x7f87e80b8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:03.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.155+0000 7f87edf9b700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f87e80d2320 0x7f87e80c9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:03.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.155+0000 7f87ee79c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f87e8161340 0x7f87e80b8570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37798/0 (socket says 172.21.15.45:37798) 2023-11-28T12:07:03.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.155+0000 7f87ee79c700 1 -- 172.21.15.45:0/2401632349 learned_addr learned my addr 172.21.15.45:0/2401632349 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:03.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.155+0000 7f87ed79a700 1 --2- 172.21.15.45:0/2401632349 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87e815c9b0 0x7f87e8150750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:03.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.156+0000 7f87ee79c700 1 -- 172.21.15.45:0/2401632349 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f87e80d2320 msgr2=0x7f87e80c9bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:03.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.156+0000 7f87ee79c700 1 --2- 172.21.15.45:0/2401632349 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f87e80d2320 0x7f87e80c9bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:03.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.156+0000 7f87ee79c700 1 -- 172.21.15.45:0/2401632349 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87e815c9b0 msgr2=0x7f87e8150750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:03.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.156+0000 7f87ee79c700 1 --2- 172.21.15.45:0/2401632349 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87e815c9b0 0x7f87e8150750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:03.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.156+0000 7f87ee79c700 1 -- 172.21.15.45:0/2401632349 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87e0009b30 con 0x7f87e8161340 2023-11-28T12:07:03.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.156+0000 7f87ee79c700 1 --2- 172.21.15.45:0/2401632349 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f87e8161340 0x7f87e80b8570 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f87e0012000 tx=0x7f87e0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:03.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.156+0000 7f87de7fc700 1 -- 172.21.15.45:0/2401632349 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e0004800 con 0x7f87e8161340 2023-11-28T12:07:03.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.156+0000 7f87de7fc700 1 -- 172.21.15.45:0/2401632349 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87e00092e0 con 0x7f87e8161340 2023-11-28T12:07:03.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.156+0000 7f87de7fc700 1 -- 172.21.15.45:0/2401632349 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e001b670 con 0x7f87e8161340 2023-11-28T12:07:03.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.156+0000 7f87f01ff700 1 -- 172.21.15.45:0/2401632349 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87e80d15e0 con 0x7f87e8161340 2023-11-28T12:07:03.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.156+0000 7f87f01ff700 1 -- 172.21.15.45:0/2401632349 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87e80d1300 con 0x7f87e8161340 2023-11-28T12:07:03.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.157+0000 7f87f01ff700 1 -- 172.21.15.45:0/2401632349 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87e815cd80 con 0x7f87e8161340 2023-11-28T12:07:03.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.158+0000 7f87de7fc700 1 -- 172.21.15.45:0/2401632349 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f87e0021030 con 0x7f87e8161340 2023-11-28T12:07:03.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.159+0000 7f87de7fc700 1 --2- 172.21.15.45:0/2401632349 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f87cc0682f0 0x7f87cc06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:03.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.159+0000 7f87de7fc700 1 -- 172.21.15.45:0/2401632349 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f87e0087140 con 0x7f87e8161340 2023-11-28T12:07:03.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.160+0000 7f87edf9b700 1 --2- 172.21.15.45:0/2401632349 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f87cc0682f0 0x7f87cc06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:03.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.160+0000 7f87edf9b700 1 --2- 172.21.15.45:0/2401632349 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f87cc0682f0 0x7f87cc06a7a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f87e4001800 tx=0x7f87e4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:03.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.163+0000 7f87de7fc700 1 -- 172.21.15.45:0/2401632349 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f87e00538b0 con 0x7f87e8161340 2023-11-28T12:07:03.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.365+0000 7f87f01ff700 1 -- 172.21.15.45:0/2401632349 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f87e80745c0 con 0x7f87e8161340 2023-11-28T12:07:03.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.366+0000 7f87de7fc700 1 -- 172.21.15.45:0/2401632349 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7f87e001f0a0 con 0x7f87e8161340 2023-11-28T12:07:03.367 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-11-28T12:07:03.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.368+0000 7f87f01ff700 1 -- 172.21.15.45:0/2401632349 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f87cc0682f0 msgr2=0x7f87cc06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:03.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.368+0000 7f87f01ff700 1 --2- 172.21.15.45:0/2401632349 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f87cc0682f0 0x7f87cc06a7a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f87e4001800 tx=0x7f87e4009040 comp rx=0 tx=0).stop 2023-11-28T12:07:03.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.368+0000 7f87f01ff700 1 -- 172.21.15.45:0/2401632349 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f87e8161340 msgr2=0x7f87e80b8570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:03.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.368+0000 7f87f01ff700 1 --2- 172.21.15.45:0/2401632349 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f87e8161340 0x7f87e80b8570 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f87e0012000 tx=0x7f87e0004ad0 comp rx=0 tx=0).stop 2023-11-28T12:07:03.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.368+0000 7f87f01ff700 1 -- 172.21.15.45:0/2401632349 shutdown_connections 2023-11-28T12:07:03.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.368+0000 7f87f01ff700 1 --2- 172.21.15.45:0/2401632349 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f87cc0682f0 0x7f87cc06a7a0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:03.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.368+0000 7f87f01ff700 1 --2- 172.21.15.45:0/2401632349 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f87e8161340 0x7f87e80b8570 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:03.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.368+0000 7f87f01ff700 1 --2- 172.21.15.45:0/2401632349 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f87e80d2320 0x7f87e80c9bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:03.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.368+0000 7f87f01ff700 1 --2- 172.21.15.45:0/2401632349 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87e815c9b0 0x7f87e8150750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:03.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.368+0000 7f87f01ff700 1 -- 172.21.15.45:0/2401632349 >> 172.21.15.45:0/2401632349 conn(0x7f87e8072600 msgr2=0x7f87e815fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:03.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.368+0000 7f87f01ff700 1 -- 172.21.15.45:0/2401632349 shutdown_connections 2023-11-28T12:07:03.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.368+0000 7f87f01ff700 1 -- 172.21.15.45:0/2401632349 wait complete. 2023-11-28T12:07:03.387 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T12:07:03.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.593+0000 7f20321ff700 1 Processor -- start 2023-11-28T12:07:03.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.593+0000 7f20321ff700 1 -- start start 2023-11-28T12:07:03.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.594+0000 7f20321ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f202c15c9b0 0x7f202c0b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:03.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.594+0000 7f20321ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f202c161340 0x7f202c0d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:03.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.594+0000 7f20321ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f202c0d1950 con 0x7f202c0d2320 2023-11-28T12:07:03.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.594+0000 7f20321ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f202c0b5800 con 0x7f202c161340 2023-11-28T12:07:03.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.594+0000 7f20321ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f202c0b5520 con 0x7f202c15c9b0 2023-11-28T12:07:03.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.594+0000 7f202bfff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f202c0d2320 0x7f202c0cd7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33626/0 (socket says 172.21.15.45:33626) 2023-11-28T12:07:03.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.594+0000 7f202bfff700 1 -- 172.21.15.45:0/3358804200 learned_addr learned my addr 172.21.15.45:0/3358804200 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:07:03.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.595+0000 7f2023fff700 1 --2- 172.21.15.45:0/3358804200 >> v2:172.21.15.152:3300/0 conn(0x7f202c161340 0x7f202c0d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:03.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.595+0000 7f202b7fe700 1 --2- 172.21.15.45:0/3358804200 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f202c15c9b0 0x7f202c0b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:03.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.595+0000 7f202affd700 1 -- 172.21.15.45:0/3358804200 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 954986681 0 0) 0x7f202c0d1950 con 0x7f202c0d2320 2023-11-28T12:07:03.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.595+0000 7f202affd700 1 -- 172.21.15.45:0/3358804200 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20180035b0 con 0x7f202c0d2320 2023-11-28T12:07:03.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.595+0000 7f2023fff700 1 -- 172.21.15.45:0/3358804200 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f202c15c9b0 msgr2=0x7f202c0b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:03.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.595+0000 7f2023fff700 1 --2- 172.21.15.45:0/3358804200 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f202c15c9b0 0x7f202c0b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:03.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.595+0000 7f2023fff700 1 -- 172.21.15.45:0/3358804200 >> v1:172.21.15.45:6789/0 conn(0x7f202c0d2320 legacy=0x7f202c0cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:03.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.595+0000 7f2023fff700 1 -- 172.21.15.45:0/3358804200 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f202c0d1300 con 0x7f202c161340 2023-11-28T12:07:03.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.595+0000 7f202affd700 1 -- 172.21.15.45:0/3358804200 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3242521644 0 0) 0x7f20180035b0 con 0x7f202c0d2320 2023-11-28T12:07:03.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.595+0000 7f202b7fe700 1 --2- 172.21.15.45:0/3358804200 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f202c15c9b0 0x7f202c0b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:07:03.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.595+0000 7f2023fff700 1 --2- 172.21.15.45:0/3358804200 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f202c161340 0x7f202c0d1de0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2014009840 tx=0x7f2014009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=352c634b95a5102a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:03.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.596+0000 7f202affd700 1 -- 172.21.15.45:0/3358804200 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2014011830 con 0x7f202c161340 2023-11-28T12:07:03.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.596+0000 7f202affd700 1 -- 172.21.15.45:0/3358804200 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2014011990 con 0x7f202c161340 2023-11-28T12:07:03.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.596+0000 7f202affd700 1 -- 172.21.15.45:0/3358804200 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2014011d20 con 0x7f202c161340 2023-11-28T12:07:03.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.596+0000 7f20321ff700 1 -- 172.21.15.45:0/3358804200 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f202c161340 msgr2=0x7f202c0d1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:03.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.596+0000 7f20321ff700 1 --2- 172.21.15.45:0/3358804200 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f202c161340 0x7f202c0d1de0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2014009840 tx=0x7f2014009b50 comp rx=0 tx=0).stop 2023-11-28T12:07:03.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.596+0000 7f20321ff700 1 -- 172.21.15.45:0/3358804200 shutdown_connections 2023-11-28T12:07:03.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.596+0000 7f20321ff700 1 --2- 172.21.15.45:0/3358804200 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f202c15c9b0 0x7f202c0b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:03.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.596+0000 7f20321ff700 1 --2- 172.21.15.45:0/3358804200 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f202c161340 0x7f202c0d1de0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:03.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.596+0000 7f20321ff700 1 -- 172.21.15.45:0/3358804200 >> 172.21.15.45:0/3358804200 conn(0x7f202c072600 msgr2=0x7f202c0cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:03.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.596+0000 7f20321ff700 1 -- 172.21.15.45:0/3358804200 shutdown_connections 2023-11-28T12:07:03.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.596+0000 7f20321ff700 1 -- 172.21.15.45:0/3358804200 wait complete. 2023-11-28T12:07:03.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.598+0000 7f20321ff700 1 Processor -- start 2023-11-28T12:07:03.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.598+0000 7f20321ff700 1 -- start start 2023-11-28T12:07:03.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.599+0000 7f20321ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f202c0d2320 0x7f202c14df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:03.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.599+0000 7f20321ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f202c15c9b0 0x7f202c15f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:03.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.599+0000 7f20321ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f202c161340 0x7f202c1596c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:03.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.599+0000 7f20321ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f202c14ea80 con 0x7f202c15c9b0 2023-11-28T12:07:03.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.599+0000 7f20321ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f202c15d9e0 con 0x7f202c161340 2023-11-28T12:07:03.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.599+0000 7f20321ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f202c15dc80 con 0x7f202c0d2320 2023-11-28T12:07:03.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.600+0000 7f2023fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f202c15c9b0 0x7f202c15f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:03.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.600+0000 7f202b7fe700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f202c0d2320 0x7f202c14df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:03.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.600+0000 7f2023fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f202c15c9b0 0x7f202c15f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37808/0 (socket says 172.21.15.45:37808) 2023-11-28T12:07:03.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.600+0000 7f202bfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f202c161340 0x7f202c1596c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:03.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.600+0000 7f2023fff700 1 -- 172.21.15.45:0/996893825 learned_addr learned my addr 172.21.15.45:0/996893825 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:03.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.600+0000 7f2023fff700 1 -- 172.21.15.45:0/996893825 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f202c0d2320 msgr2=0x7f202c14df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:03.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.600+0000 7f2023fff700 1 --2- 172.21.15.45:0/996893825 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f202c0d2320 0x7f202c14df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:03.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.600+0000 7f2023fff700 1 -- 172.21.15.45:0/996893825 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f202c161340 msgr2=0x7f202c1596c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:03.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.600+0000 7f2023fff700 1 --2- 172.21.15.45:0/996893825 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f202c161340 0x7f202c1596c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:03.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.600+0000 7f2023fff700 1 -- 172.21.15.45:0/996893825 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f201c0094a0 con 0x7f202c15c9b0 2023-11-28T12:07:03.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.600+0000 7f2023fff700 1 --2- 172.21.15.45:0/996893825 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f202c15c9b0 0x7f202c15f760 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f20140090b0 tx=0x7f2014004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:03.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.600+0000 7f2028ff9700 1 -- 172.21.15.45:0/996893825 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201401a6e0 con 0x7f202c15c9b0 2023-11-28T12:07:03.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.601+0000 7f2028ff9700 1 -- 172.21.15.45:0/996893825 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f201401a840 con 0x7f202c15c9b0 2023-11-28T12:07:03.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.601+0000 7f20321ff700 1 -- 172.21.15.45:0/996893825 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20140094a0 con 0x7f202c15c9b0 2023-11-28T12:07:03.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.601+0000 7f2028ff9700 1 -- 172.21.15.45:0/996893825 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201401abb0 con 0x7f202c15c9b0 2023-11-28T12:07:03.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.601+0000 7f20321ff700 1 -- 172.21.15.45:0/996893825 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f202c0b5130 con 0x7f202c15c9b0 2023-11-28T12:07:03.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.602+0000 7f20321ff700 1 -- 172.21.15.45:0/996893825 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f202c0d15e0 con 0x7f202c15c9b0 2023-11-28T12:07:03.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.603+0000 7f2028ff9700 1 -- 172.21.15.45:0/996893825 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f201402b030 con 0x7f202c15c9b0 2023-11-28T12:07:03.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.603+0000 7f2028ff9700 1 --2- 172.21.15.45:0/996893825 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f200c0682f0 0x7f200c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:03.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.603+0000 7f2028ff9700 1 -- 172.21.15.45:0/996893825 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2014086e90 con 0x7f202c15c9b0 2023-11-28T12:07:03.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.604+0000 7f202b7fe700 1 --2- 172.21.15.45:0/996893825 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f200c0682f0 0x7f200c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:03.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.605+0000 7f202b7fe700 1 --2- 172.21.15.45:0/996893825 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f200c0682f0 0x7f200c06a7a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f202c14ec30 tx=0x7f201c009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:03.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.608+0000 7f2028ff9700 1 -- 172.21.15.45:0/996893825 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f2014053600 con 0x7f202c15c9b0 2023-11-28T12:07:03.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.810+0000 7f20321ff700 1 -- 172.21.15.45:0/996893825 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f202c0672b0 con 0x7f202c15c9b0 2023-11-28T12:07:03.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.810+0000 7f2028ff9700 1 -- 172.21.15.45:0/996893825 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2014029020 con 0x7f202c15c9b0 2023-11-28T12:07:03.812 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-11-28T12:07:03.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.813+0000 7f20321ff700 1 -- 172.21.15.45:0/996893825 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f200c0682f0 msgr2=0x7f200c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:03.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.813+0000 7f20321ff700 1 --2- 172.21.15.45:0/996893825 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f200c0682f0 0x7f200c06a7a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f202c14ec30 tx=0x7f201c009210 comp rx=0 tx=0).stop 2023-11-28T12:07:03.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.813+0000 7f20321ff700 1 -- 172.21.15.45:0/996893825 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f202c15c9b0 msgr2=0x7f202c15f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:03.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.813+0000 7f20321ff700 1 --2- 172.21.15.45:0/996893825 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f202c15c9b0 0x7f202c15f760 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f20140090b0 tx=0x7f2014004750 comp rx=0 tx=0).stop 2023-11-28T12:07:03.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.813+0000 7f20321ff700 1 -- 172.21.15.45:0/996893825 shutdown_connections 2023-11-28T12:07:03.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.813+0000 7f20321ff700 1 --2- 172.21.15.45:0/996893825 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f200c0682f0 0x7f200c06a7a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:03.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.813+0000 7f20321ff700 1 --2- 172.21.15.45:0/996893825 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f202c161340 0x7f202c1596c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:03.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.813+0000 7f20321ff700 1 --2- 172.21.15.45:0/996893825 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f202c0d2320 0x7f202c14df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:03.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.813+0000 7f20321ff700 1 --2- 172.21.15.45:0/996893825 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f202c15c9b0 0x7f202c15f760 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:03.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.813+0000 7f20321ff700 1 -- 172.21.15.45:0/996893825 >> 172.21.15.45:0/996893825 conn(0x7f202c072600 msgr2=0x7f202c15cd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:03.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.813+0000 7f20321ff700 1 -- 172.21.15.45:0/996893825 shutdown_connections 2023-11-28T12:07:03.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:03.813+0000 7f20321ff700 1 -- 172.21.15.45:0/996893825 wait complete. 2023-11-28T12:07:03.833 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T12:07:04.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.038+0000 7f29c1dff700 1 Processor -- start 2023-11-28T12:07:04.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.038+0000 7f29c1dff700 1 -- start start 2023-11-28T12:07:04.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.039+0000 7f29c1dff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f29bc0d01b0 0x7f29bc0d0c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:04.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.039+0000 7f29c1dff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f29bc0b20b0 0x7f29bc0d1160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:04.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.039+0000 7f29c1dff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29bc0b0230 con 0x7f29bc0b29b0 2023-11-28T12:07:04.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.039+0000 7f29c1dff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29bc15cec0 con 0x7f29bc0b20b0 2023-11-28T12:07:04.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.039+0000 7f29c1dff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29bc0b4570 con 0x7f29bc0d01b0 2023-11-28T12:07:04.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.040+0000 7f29bbfff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f29bc0b29b0 0x7f29bc0b2e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33630/0 (socket says 172.21.15.45:33630) 2023-11-28T12:07:04.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.040+0000 7f29bbfff700 1 -- 172.21.15.45:0/1494772228 learned_addr learned my addr 172.21.15.45:0/1494772228 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:07:04.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.040+0000 7f29bb7fe700 1 --2- 172.21.15.45:0/1494772228 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f29bc0d01b0 0x7f29bc0d0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:04.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.040+0000 7f29baffd700 1 --2- 172.21.15.45:0/1494772228 >> v2:172.21.15.152:3300/0 conn(0x7f29bc0b20b0 0x7f29bc0d1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:04.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.040+0000 7f29ba7fc700 1 -- 172.21.15.45:0/1494772228 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 577474758 0 0) 0x7f29bc0b0230 con 0x7f29bc0b29b0 2023-11-28T12:07:04.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.040+0000 7f29ba7fc700 1 -- 172.21.15.45:0/1494772228 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29a40035b0 con 0x7f29bc0b29b0 2023-11-28T12:07:04.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.040+0000 7f29bb7fe700 1 -- 172.21.15.45:0/1494772228 >> v2:172.21.15.152:3300/0 conn(0x7f29bc0b20b0 msgr2=0x7f29bc0d1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:04.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.040+0000 7f29bb7fe700 1 --2- 172.21.15.45:0/1494772228 >> v2:172.21.15.152:3300/0 conn(0x7f29bc0b20b0 0x7f29bc0d1160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:04.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.040+0000 7f29bb7fe700 1 -- 172.21.15.45:0/1494772228 >> v1:172.21.15.45:6789/0 conn(0x7f29bc0b29b0 legacy=0x7f29bc0b2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:04.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.040+0000 7f29bb7fe700 1 -- 172.21.15.45:0/1494772228 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29bc0b4850 con 0x7f29bc0d01b0 2023-11-28T12:07:04.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.041+0000 7f29baffd700 1 --2- 172.21.15.45:0/1494772228 >> v2:172.21.15.152:3300/0 conn(0x7f29bc0b20b0 0x7f29bc0d1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:07:04.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.041+0000 7f29bb7fe700 1 --2- 172.21.15.45:0/1494772228 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f29bc0d01b0 0x7f29bc0d0c20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f29ac009840 tx=0x7f29ac009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9d89c269087a273 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:04.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.041+0000 7f29ba7fc700 1 -- 172.21.15.45:0/1494772228 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29ac011830 con 0x7f29bc0d01b0 2023-11-28T12:07:04.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.041+0000 7f29ba7fc700 1 -- 172.21.15.45:0/1494772228 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29ac011990 con 0x7f29bc0d01b0 2023-11-28T12:07:04.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.041+0000 7f29ba7fc700 1 -- 172.21.15.45:0/1494772228 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29ac011d20 con 0x7f29bc0d01b0 2023-11-28T12:07:04.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.042+0000 7f29c1dff700 1 -- 172.21.15.45:0/1494772228 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f29bc0d01b0 msgr2=0x7f29bc0d0c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:04.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.042+0000 7f29c1dff700 1 --2- 172.21.15.45:0/1494772228 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f29bc0d01b0 0x7f29bc0d0c20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f29ac009840 tx=0x7f29ac009b50 comp rx=0 tx=0).stop 2023-11-28T12:07:04.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.042+0000 7f29c1dff700 1 -- 172.21.15.45:0/1494772228 shutdown_connections 2023-11-28T12:07:04.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.042+0000 7f29c1dff700 1 --2- 172.21.15.45:0/1494772228 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f29bc0d01b0 0x7f29bc0d0c20 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:04.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.042+0000 7f29c1dff700 1 --2- 172.21.15.45:0/1494772228 >> v2:172.21.15.152:3300/0 conn(0x7f29bc0b20b0 0x7f29bc0d1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:04.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.042+0000 7f29c1dff700 1 -- 172.21.15.45:0/1494772228 >> 172.21.15.45:0/1494772228 conn(0x7f29bc09c3f0 msgr2=0x7f29bc0d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:04.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.042+0000 7f29c1dff700 1 -- 172.21.15.45:0/1494772228 shutdown_connections 2023-11-28T12:07:04.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.042+0000 7f29c1dff700 1 -- 172.21.15.45:0/1494772228 wait complete. 2023-11-28T12:07:04.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.043+0000 7f29c1dff700 1 Processor -- start 2023-11-28T12:07:04.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.044+0000 7f29c1dff700 1 -- start start 2023-11-28T12:07:04.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.044+0000 7f29c1dff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f29bc0b20b0 0x7f29bc0c8d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:04.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.045+0000 7f29c1dff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29bc0b29b0 0x7f29bc0b72a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:04.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.045+0000 7f29c1dff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f29bc0d01b0 0x7f29bc0b77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:04.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.045+0000 7f29c1dff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29bc0b8a00 con 0x7f29bc0b29b0 2023-11-28T12:07:04.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.045+0000 7f29c1dff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29bc0b7df0 con 0x7f29bc0b20b0 2023-11-28T12:07:04.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.045+0000 7f29c1dff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29bc0b80d0 con 0x7f29bc0d01b0 2023-11-28T12:07:04.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.045+0000 7f29baffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29bc0b29b0 0x7f29bc0b72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:04.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.045+0000 7f29baffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29bc0b29b0 0x7f29bc0b72a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37820/0 (socket says 172.21.15.45:37820) 2023-11-28T12:07:04.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.045+0000 7f29baffd700 1 -- 172.21.15.45:0/1314362729 learned_addr learned my addr 172.21.15.45:0/1314362729 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:04.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.045+0000 7f29bbfff700 1 --2- 172.21.15.45:0/1314362729 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f29bc0d01b0 0x7f29bc0b77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:04.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.045+0000 7f29bb7fe700 1 --2- 172.21.15.45:0/1314362729 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f29bc0b20b0 0x7f29bc0c8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:04.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.045+0000 7f29baffd700 1 -- 172.21.15.45:0/1314362729 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f29bc0d01b0 msgr2=0x7f29bc0b77e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:04.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.045+0000 7f29baffd700 1 --2- 172.21.15.45:0/1314362729 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f29bc0d01b0 0x7f29bc0b77e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:04.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.045+0000 7f29baffd700 1 -- 172.21.15.45:0/1314362729 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f29bc0b20b0 msgr2=0x7f29bc0c8d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:04.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.045+0000 7f29baffd700 1 --2- 172.21.15.45:0/1314362729 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f29bc0b20b0 0x7f29bc0c8d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:04.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.045+0000 7f29baffd700 1 -- 172.21.15.45:0/1314362729 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b00094a0 con 0x7f29bc0b29b0 2023-11-28T12:07:04.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.045+0000 7f29bb7fe700 1 --2- 172.21.15.45:0/1314362729 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f29bc0b20b0 0x7f29bc0c8d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:07:04.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.045+0000 7f29bbfff700 1 --2- 172.21.15.45:0/1314362729 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f29bc0d01b0 0x7f29bc0b77e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:07:04.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.046+0000 7f29baffd700 1 --2- 172.21.15.45:0/1314362729 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29bc0b29b0 0x7f29bc0b72a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f29b000ebe0 tx=0x7f29b0009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:04.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.046+0000 7f29a3fff700 1 -- 172.21.15.45:0/1314362729 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b000c910 con 0x7f29bc0b29b0 2023-11-28T12:07:04.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.046+0000 7f29a3fff700 1 -- 172.21.15.45:0/1314362729 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29b000ca70 con 0x7f29bc0b29b0 2023-11-28T12:07:04.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.046+0000 7f29a3fff700 1 -- 172.21.15.45:0/1314362729 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b000cde0 con 0x7f29bc0b29b0 2023-11-28T12:07:04.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.046+0000 7f29c1dff700 1 -- 172.21.15.45:0/1314362729 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29ac0094a0 con 0x7f29bc0b29b0 2023-11-28T12:07:04.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.046+0000 7f29c1dff700 1 -- 172.21.15.45:0/1314362729 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29bc0afec0 con 0x7f29bc0b29b0 2023-11-28T12:07:04.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.047+0000 7f29c1dff700 1 -- 172.21.15.45:0/1314362729 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29bc0afbe0 con 0x7f29bc0b29b0 2023-11-28T12:07:04.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.048+0000 7f29a3fff700 1 -- 172.21.15.45:0/1314362729 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f29b0019030 con 0x7f29bc0b29b0 2023-11-28T12:07:04.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.049+0000 7f29a3fff700 1 --2- 172.21.15.45:0/1314362729 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f29a80682f0 0x7f29a806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:04.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.049+0000 7f29a3fff700 1 -- 172.21.15.45:0/1314362729 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f29b0085de0 con 0x7f29bc0b29b0 2023-11-28T12:07:04.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.049+0000 7f29bb7fe700 1 --2- 172.21.15.45:0/1314362729 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f29a80682f0 0x7f29a806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:04.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.050+0000 7f29bb7fe700 1 --2- 172.21.15.45:0/1314362729 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f29a80682f0 0x7f29a806a7a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f29ac014040 tx=0x7f29ac008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:04.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.053+0000 7f29a3fff700 1 -- 172.21.15.45:0/1314362729 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f29b0052550 con 0x7f29bc0b29b0 2023-11-28T12:07:04.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.256+0000 7f29c1dff700 1 -- 172.21.15.45:0/1314362729 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f29bc15d000 con 0x7f29bc0b29b0 2023-11-28T12:07:04.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.256+0000 7f29a3fff700 1 -- 172.21.15.45:0/1314362729 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f29b0017020 con 0x7f29bc0b29b0 2023-11-28T12:07:04.258 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-11-28T12:07:04.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.259+0000 7f29c1dff700 1 -- 172.21.15.45:0/1314362729 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f29a80682f0 msgr2=0x7f29a806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:04.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.259+0000 7f29c1dff700 1 --2- 172.21.15.45:0/1314362729 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f29a80682f0 0x7f29a806a7a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f29ac014040 tx=0x7f29ac008030 comp rx=0 tx=0).stop 2023-11-28T12:07:04.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.259+0000 7f29c1dff700 1 -- 172.21.15.45:0/1314362729 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29bc0b29b0 msgr2=0x7f29bc0b72a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:04.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.259+0000 7f29c1dff700 1 --2- 172.21.15.45:0/1314362729 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29bc0b29b0 0x7f29bc0b72a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f29b000ebe0 tx=0x7f29b0009ec0 comp rx=0 tx=0).stop 2023-11-28T12:07:04.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.259+0000 7f29c1dff700 1 -- 172.21.15.45:0/1314362729 shutdown_connections 2023-11-28T12:07:04.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.259+0000 7f29c1dff700 1 --2- 172.21.15.45:0/1314362729 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f29a80682f0 0x7f29a806a7a0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:04.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.259+0000 7f29c1dff700 1 --2- 172.21.15.45:0/1314362729 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f29bc0b20b0 0x7f29bc0c8d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:04.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.259+0000 7f29c1dff700 1 --2- 172.21.15.45:0/1314362729 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f29bc0d01b0 0x7f29bc0b77e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:04.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.259+0000 7f29c1dff700 1 --2- 172.21.15.45:0/1314362729 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29bc0b29b0 0x7f29bc0b72a0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:04.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.259+0000 7f29c1dff700 1 -- 172.21.15.45:0/1314362729 >> 172.21.15.45:0/1314362729 conn(0x7f29bc09c3f0 msgr2=0x7f29bc06b030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:04.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.259+0000 7f29c1dff700 1 -- 172.21.15.45:0/1314362729 shutdown_connections 2023-11-28T12:07:04.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.259+0000 7f29c1dff700 1 -- 172.21.15.45:0/1314362729 wait complete. 2023-11-28T12:07:04.278 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T12:07:04.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.483+0000 7fd1281ff700 1 Processor -- start 2023-11-28T12:07:04.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.484+0000 7fd1281ff700 1 -- start start 2023-11-28T12:07:04.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.485+0000 7fd1281ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd120158200 0x7fd120070c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:04.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.485+0000 7fd1281ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd1200b0d80 0x7fd12015add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:04.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.485+0000 7fd1281ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd12015e1a0 con 0x7fd1200caa70 2023-11-28T12:07:04.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.485+0000 7fd1281ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd12015f070 con 0x7fd120158200 2023-11-28T12:07:04.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.485+0000 7fd1281ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd120071190 con 0x7fd1200b0d80 2023-11-28T12:07:04.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.485+0000 7fd125f9b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd120158200 0x7fd120070c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:04.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.485+0000 7fd12579a700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fd1200caa70 0x7fd1200b0670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33636/0 (socket says 172.21.15.45:33636) 2023-11-28T12:07:04.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.485+0000 7fd12579a700 1 -- 172.21.15.45:0/2605662289 learned_addr learned my addr 172.21.15.45:0/2605662289 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:07:04.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.485+0000 7fd12679c700 1 --2- 172.21.15.45:0/2605662289 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd1200b0d80 0x7fd12015add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:04.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.486+0000 7fd125f9b700 1 -- 172.21.15.45:0/2605662289 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd1200b0d80 msgr2=0x7fd12015add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:04.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.486+0000 7fd125f9b700 1 --2- 172.21.15.45:0/2605662289 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd1200b0d80 0x7fd12015add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:04.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.486+0000 7fd125f9b700 1 -- 172.21.15.45:0/2605662289 >> v1:172.21.15.45:6789/0 conn(0x7fd1200caa70 legacy=0x7fd1200b0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:04.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.486+0000 7fd125f9b700 1 -- 172.21.15.45:0/2605662289 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1201585d0 con 0x7fd120158200 2023-11-28T12:07:04.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.486+0000 7fd125f9b700 1 --2- 172.21.15.45:0/2605662289 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd120158200 0x7fd120070c50 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd11c009840 tx=0x7fd11c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e9fad1a6fbfbc0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:04.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.486+0000 7fd124f99700 1 -- 172.21.15.45:0/2605662289 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11c011830 con 0x7fd120158200 2023-11-28T12:07:04.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.486+0000 7fd124f99700 1 -- 172.21.15.45:0/2605662289 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd11c011990 con 0x7fd120158200 2023-11-28T12:07:04.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.486+0000 7fd124f99700 1 -- 172.21.15.45:0/2605662289 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11c011d20 con 0x7fd120158200 2023-11-28T12:07:04.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.487+0000 7fd1281ff700 1 -- 172.21.15.45:0/2605662289 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd120158200 msgr2=0x7fd120070c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:04.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.487+0000 7fd1281ff700 1 --2- 172.21.15.45:0/2605662289 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd120158200 0x7fd120070c50 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd11c009840 tx=0x7fd11c009b50 comp rx=0 tx=0).stop 2023-11-28T12:07:04.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.487+0000 7fd1281ff700 1 -- 172.21.15.45:0/2605662289 shutdown_connections 2023-11-28T12:07:04.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.487+0000 7fd1281ff700 1 --2- 172.21.15.45:0/2605662289 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd1200b0d80 0x7fd12015add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:04.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.487+0000 7fd1281ff700 1 --2- 172.21.15.45:0/2605662289 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd120158200 0x7fd120070c50 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:04.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.487+0000 7fd1281ff700 1 -- 172.21.15.45:0/2605662289 >> 172.21.15.45:0/2605662289 conn(0x7fd1200cb670 msgr2=0x7fd1200cba70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:04.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.487+0000 7fd1281ff700 1 -- 172.21.15.45:0/2605662289 shutdown_connections 2023-11-28T12:07:04.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.487+0000 7fd1281ff700 1 -- 172.21.15.45:0/2605662289 wait complete. 2023-11-28T12:07:04.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.489+0000 7fd1281ff700 1 Processor -- start 2023-11-28T12:07:04.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.489+0000 7fd1281ff700 1 -- start start 2023-11-28T12:07:04.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.490+0000 7fd1281ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd1200b0d80 0x7fd1200b3430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:04.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.490+0000 7fd1281ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1200caa70 0x7fd1201f1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:04.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.490+0000 7fd1281ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd120158200 0x7fd120159d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:04.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.490+0000 7fd1281ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1201f1db0 con 0x7fd1200caa70 2023-11-28T12:07:04.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.490+0000 7fd1281ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd12015a2d0 con 0x7fd1200b0d80 2023-11-28T12:07:04.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.490+0000 7fd1281ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1200b3d40 con 0x7fd120158200 2023-11-28T12:07:04.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.490+0000 7fd12579a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1200caa70 0x7fd1201f1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:04.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.490+0000 7fd12579a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1200caa70 0x7fd1201f1870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37838/0 (socket says 172.21.15.45:37838) 2023-11-28T12:07:04.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.490+0000 7fd12579a700 1 -- 172.21.15.45:0/2457745254 learned_addr learned my addr 172.21.15.45:0/2457745254 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:04.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.490+0000 7fd12679c700 1 --2- 172.21.15.45:0/2457745254 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd120158200 0x7fd120159d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:04.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.490+0000 7fd125f9b700 1 --2- 172.21.15.45:0/2457745254 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd1200b0d80 0x7fd1200b3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:04.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.490+0000 7fd12579a700 1 -- 172.21.15.45:0/2457745254 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd120158200 msgr2=0x7fd120159d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:04.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.490+0000 7fd12579a700 1 --2- 172.21.15.45:0/2457745254 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd120158200 0x7fd120159d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:04.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.490+0000 7fd12579a700 1 -- 172.21.15.45:0/2457745254 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd1200b0d80 msgr2=0x7fd1200b3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:04.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.490+0000 7fd12579a700 1 --2- 172.21.15.45:0/2457745254 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd1200b0d80 0x7fd1200b3430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:04.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.490+0000 7fd12579a700 1 -- 172.21.15.45:0/2457745254 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd11c0094a0 con 0x7fd1200caa70 2023-11-28T12:07:04.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.491+0000 7fd12579a700 1 --2- 172.21.15.45:0/2457745254 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1200caa70 0x7fd1201f1870 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd11000c520 tx=0x7fd11000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:04.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.491+0000 7fd1167fc700 1 -- 172.21.15.45:0/2457745254 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd110005d70 con 0x7fd1200caa70 2023-11-28T12:07:04.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.491+0000 7fd1167fc700 1 -- 172.21.15.45:0/2457745254 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1100070d0 con 0x7fd1200caa70 2023-11-28T12:07:04.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.491+0000 7fd1281ff700 1 -- 172.21.15.45:0/2457745254 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd12015e6d0 con 0x7fd1200caa70 2023-11-28T12:07:04.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.491+0000 7fd1167fc700 1 -- 172.21.15.45:0/2457745254 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd110007440 con 0x7fd1200caa70 2023-11-28T12:07:04.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.491+0000 7fd1281ff700 1 -- 172.21.15.45:0/2457745254 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd12015e3f0 con 0x7fd1200caa70 2023-11-28T12:07:04.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.492+0000 7fd1281ff700 1 -- 172.21.15.45:0/2457745254 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd12015e9b0 con 0x7fd1200caa70 2023-11-28T12:07:04.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.493+0000 7fd1167fc700 1 -- 172.21.15.45:0/2457745254 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fd110019030 con 0x7fd1200caa70 2023-11-28T12:07:04.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.494+0000 7fd1167fc700 1 --2- 172.21.15.45:0/2457745254 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fd104068340 0x7fd10406a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:04.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.494+0000 7fd1167fc700 1 -- 172.21.15.45:0/2457745254 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd110084fc0 con 0x7fd1200caa70 2023-11-28T12:07:04.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.494+0000 7fd125f9b700 1 --2- 172.21.15.45:0/2457745254 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fd104068340 0x7fd10406a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:04.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.495+0000 7fd125f9b700 1 --2- 172.21.15.45:0/2457745254 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fd104068340 0x7fd10406a7f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd11c0090b0 tx=0x7fd11c01c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:04.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.498+0000 7fd1167fc700 1 -- 172.21.15.45:0/2457745254 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fd11004b5e0 con 0x7fd1200caa70 2023-11-28T12:07:04.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.697+0000 7fd1281ff700 1 -- 172.21.15.45:0/2457745254 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd12006fd60 con 0x7fd1200caa70 2023-11-28T12:07:04.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.697+0000 7fd1167fc700 1 -- 172.21.15.45:0/2457745254 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd110017020 con 0x7fd1200caa70 2023-11-28T12:07:04.699 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-11-28T12:07:04.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.700+0000 7fd1281ff700 1 -- 172.21.15.45:0/2457745254 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fd104068340 msgr2=0x7fd10406a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:04.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.700+0000 7fd1281ff700 1 --2- 172.21.15.45:0/2457745254 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fd104068340 0x7fd10406a7f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd11c0090b0 tx=0x7fd11c01c040 comp rx=0 tx=0).stop 2023-11-28T12:07:04.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.700+0000 7fd1281ff700 1 -- 172.21.15.45:0/2457745254 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1200caa70 msgr2=0x7fd1201f1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:04.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.700+0000 7fd1281ff700 1 --2- 172.21.15.45:0/2457745254 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1200caa70 0x7fd1201f1870 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd11000c520 tx=0x7fd11000c830 comp rx=0 tx=0).stop 2023-11-28T12:07:04.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.700+0000 7fd1281ff700 1 -- 172.21.15.45:0/2457745254 shutdown_connections 2023-11-28T12:07:04.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.700+0000 7fd1281ff700 1 --2- 172.21.15.45:0/2457745254 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fd104068340 0x7fd10406a7f0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:04.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.700+0000 7fd1281ff700 1 --2- 172.21.15.45:0/2457745254 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd1200b0d80 0x7fd1200b3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:04.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.700+0000 7fd1281ff700 1 --2- 172.21.15.45:0/2457745254 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd120158200 0x7fd120159d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:04.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.700+0000 7fd1281ff700 1 --2- 172.21.15.45:0/2457745254 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1200caa70 0x7fd1201f1870 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:04.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.700+0000 7fd1281ff700 1 -- 172.21.15.45:0/2457745254 >> 172.21.15.45:0/2457745254 conn(0x7fd1200cb670 msgr2=0x7fd120158760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:04.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.700+0000 7fd1281ff700 1 -- 172.21.15.45:0/2457745254 shutdown_connections 2023-11-28T12:07:04.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.700+0000 7fd1281ff700 1 -- 172.21.15.45:0/2457745254 wait complete. 2023-11-28T12:07:04.720 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T12:07:04.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.920+0000 7fee53fff700 1 Processor -- start 2023-11-28T12:07:04.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.921+0000 7fee53fff700 1 -- start start 2023-11-28T12:07:04.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.922+0000 7fee53fff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fee4c15c9b0 0x7fee4c0b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:04.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.922+0000 7fee53fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fee4c161340 0x7fee4c0d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:04.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.922+0000 7fee53fff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee4c0d1950 con 0x7fee4c0d2320 2023-11-28T12:07:04.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.922+0000 7fee53fff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee4c0b5800 con 0x7fee4c161340 2023-11-28T12:07:04.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.922+0000 7fee53fff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee4c0b5520 con 0x7fee4c15c9b0 2023-11-28T12:07:04.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.922+0000 7fee5159a700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fee4c161340 0x7fee4c0d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:04.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.922+0000 7fee5159a700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fee4c161340 0x7fee4c0d1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37840/0 (socket says 172.21.15.45:37840) 2023-11-28T12:07:04.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.922+0000 7fee5159a700 1 -- 172.21.15.45:0/4024310441 learned_addr learned my addr 172.21.15.45:0/4024310441 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:04.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.922+0000 7fee51d9b700 1 --2- 172.21.15.45:0/4024310441 >> v2:172.21.15.152:3300/0 conn(0x7fee4c15c9b0 0x7fee4c0b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:04.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.922+0000 7fee5159a700 1 -- 172.21.15.45:0/4024310441 >> v2:172.21.15.152:3300/0 conn(0x7fee4c15c9b0 msgr2=0x7fee4c0b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:04.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.922+0000 7fee5159a700 1 --2- 172.21.15.45:0/4024310441 >> v2:172.21.15.152:3300/0 conn(0x7fee4c15c9b0 0x7fee4c0b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:04.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.922+0000 7fee5159a700 1 -- 172.21.15.45:0/4024310441 >> v1:172.21.15.152:6789/0 conn(0x7fee4c0d2320 legacy=0x7fee4c0cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:04.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.923+0000 7fee5159a700 1 -- 172.21.15.45:0/4024310441 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee4c0d1300 con 0x7fee4c161340 2023-11-28T12:07:04.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.923+0000 7fee51d9b700 1 --2- 172.21.15.45:0/4024310441 >> v2:172.21.15.152:3300/0 conn(0x7fee4c15c9b0 0x7fee4c0b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:07:04.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.923+0000 7fee5159a700 1 --2- 172.21.15.45:0/4024310441 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee4c161340 0x7fee4c0d1de0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fee4c067460 tx=0x7fee3c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e44e4a9a0ee8ed9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:04.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.923+0000 7fee50d99700 1 -- 172.21.15.45:0/4024310441 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee3c004230 con 0x7fee4c161340 2023-11-28T12:07:04.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.923+0000 7fee50d99700 1 -- 172.21.15.45:0/4024310441 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee3c004390 con 0x7fee4c161340 2023-11-28T12:07:04.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.923+0000 7fee50d99700 1 -- 172.21.15.45:0/4024310441 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee3c0036a0 con 0x7fee4c161340 2023-11-28T12:07:04.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.924+0000 7fee53fff700 1 -- 172.21.15.45:0/4024310441 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee4c161340 msgr2=0x7fee4c0d1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:04.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.924+0000 7fee53fff700 1 --2- 172.21.15.45:0/4024310441 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee4c161340 0x7fee4c0d1de0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fee4c067460 tx=0x7fee3c009bd0 comp rx=0 tx=0).stop 2023-11-28T12:07:04.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.924+0000 7fee53fff700 1 -- 172.21.15.45:0/4024310441 shutdown_connections 2023-11-28T12:07:04.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.924+0000 7fee53fff700 1 --2- 172.21.15.45:0/4024310441 >> v2:172.21.15.152:3300/0 conn(0x7fee4c15c9b0 0x7fee4c0b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:04.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.924+0000 7fee53fff700 1 --2- 172.21.15.45:0/4024310441 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee4c161340 0x7fee4c0d1de0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:04.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.924+0000 7fee53fff700 1 -- 172.21.15.45:0/4024310441 >> 172.21.15.45:0/4024310441 conn(0x7fee4c072600 msgr2=0x7fee4c0cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:04.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.924+0000 7fee53fff700 1 -- 172.21.15.45:0/4024310441 shutdown_connections 2023-11-28T12:07:04.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.924+0000 7fee53fff700 1 -- 172.21.15.45:0/4024310441 wait complete. 2023-11-28T12:07:04.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.926+0000 7fee53fff700 1 Processor -- start 2023-11-28T12:07:04.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.926+0000 7fee53fff700 1 -- start start 2023-11-28T12:07:04.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.927+0000 7fee53fff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fee4c0d2320 0x7fee4c0c98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:04.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.927+0000 7fee53fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee4c15c9b0 0x7fee4c150830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:04.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.927+0000 7fee53fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fee4c161340 0x7fee4c146210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:04.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.927+0000 7fee53fff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee4c0c8840 con 0x7fee4c15c9b0 2023-11-28T12:07:04.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.927+0000 7fee53fff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee4c0c8b20 con 0x7fee4c161340 2023-11-28T12:07:04.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.927+0000 7fee53fff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee4c0c8e00 con 0x7fee4c0d2320 2023-11-28T12:07:04.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.927+0000 7fee5159a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee4c15c9b0 0x7fee4c150830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:04.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.927+0000 7fee5159a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee4c15c9b0 0x7fee4c150830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37842/0 (socket says 172.21.15.45:37842) 2023-11-28T12:07:04.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.927+0000 7fee5159a700 1 -- 172.21.15.45:0/2304212835 learned_addr learned my addr 172.21.15.45:0/2304212835 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:04.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.927+0000 7fee51d9b700 1 --2- 172.21.15.45:0/2304212835 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fee4c0d2320 0x7fee4c0c98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:04.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.927+0000 7fee5259c700 1 --2- 172.21.15.45:0/2304212835 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fee4c161340 0x7fee4c146210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:04.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.927+0000 7fee5159a700 1 -- 172.21.15.45:0/2304212835 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fee4c0d2320 msgr2=0x7fee4c0c98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:04.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.927+0000 7fee5159a700 1 --2- 172.21.15.45:0/2304212835 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fee4c0d2320 0x7fee4c0c98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:04.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.927+0000 7fee5159a700 1 -- 172.21.15.45:0/2304212835 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fee4c161340 msgr2=0x7fee4c146210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:04.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.927+0000 7fee5159a700 1 --2- 172.21.15.45:0/2304212835 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fee4c161340 0x7fee4c146210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:04.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.927+0000 7fee5159a700 1 -- 172.21.15.45:0/2304212835 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee3c009550 con 0x7fee4c15c9b0 2023-11-28T12:07:04.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.928+0000 7fee5159a700 1 --2- 172.21.15.45:0/2304212835 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee4c15c9b0 0x7fee4c150830 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fee3c009130 tx=0x7fee3c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:04.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.928+0000 7fee427fc700 1 -- 172.21.15.45:0/2304212835 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee3c003dc0 con 0x7fee4c15c9b0 2023-11-28T12:07:04.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.928+0000 7fee427fc700 1 -- 172.21.15.45:0/2304212835 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee3c01f070 con 0x7fee4c15c9b0 2023-11-28T12:07:04.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.928+0000 7fee427fc700 1 -- 172.21.15.45:0/2304212835 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee3c011870 con 0x7fee4c15c9b0 2023-11-28T12:07:04.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.928+0000 7fee53fff700 1 -- 172.21.15.45:0/2304212835 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee4c0b5130 con 0x7fee4c15c9b0 2023-11-28T12:07:04.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.928+0000 7fee53fff700 1 -- 172.21.15.45:0/2304212835 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee4c0d15e0 con 0x7fee4c15c9b0 2023-11-28T12:07:04.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.929+0000 7fee53fff700 1 -- 172.21.15.45:0/2304212835 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee4c0b52c0 con 0x7fee4c15c9b0 2023-11-28T12:07:04.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.930+0000 7fee427fc700 1 -- 172.21.15.45:0/2304212835 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fee3c017020 con 0x7fee4c15c9b0 2023-11-28T12:07:04.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.931+0000 7fee427fc700 1 --2- 172.21.15.45:0/2304212835 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fee300682f0 0x7fee3006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:04.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.931+0000 7fee427fc700 1 -- 172.21.15.45:0/2304212835 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fee3c087620 con 0x7fee4c15c9b0 2023-11-28T12:07:04.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.931+0000 7fee51d9b700 1 --2- 172.21.15.45:0/2304212835 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fee300682f0 0x7fee3006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:04.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.932+0000 7fee51d9b700 1 --2- 172.21.15.45:0/2304212835 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fee300682f0 0x7fee3006a7a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fee48006fd0 tx=0x7fee48008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:04.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:04.935+0000 7fee427fc700 1 -- 172.21.15.45:0/2304212835 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fee3c053d90 con 0x7fee4c15c9b0 2023-11-28T12:07:05.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.136+0000 7fee53fff700 1 -- 172.21.15.45:0/2304212835 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fee4c0745c0 con 0x7fee4c15c9b0 2023-11-28T12:07:05.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.138+0000 7fee427fc700 1 -- 172.21.15.45:0/2304212835 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+17849 (secure 0 0 0) 0x7fee3c0573b0 con 0x7fee4c15c9b0 2023-11-28T12:07:05.140 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:07:05.140 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":20,"fsid":"bd7c37f1-f7c6-4778-b845-52cf2aa6e366","created":"2023-11-28T12:06:09.045075+0000","modified":"2023-11-28T12:06:30.396046+0000","last_up_change":"2023-11-28T12:06:21.282227+0000","last_in_change":"2023-11-28T12:06:12.560924+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T12:06:21.807108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T12:06:22.491009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T12:06:27.684157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T12:06:28.384679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d0cdd8a-87fd-4f2c-91bd-47bdfa661905","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":115843},{"type":"v1","addr":"172.21.15.45:6808","nonce":115843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":115843},{"type":"v1","addr":"172.21.15.45:6811","nonce":115843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":115843},{"type":"v1","addr":"172.21.15.45:6815","nonce":115843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":115843},{"type":"v1","addr":"172.21.15.45:6813","nonce":115843}]},"public_addr":"172.21.15.45:6808/115843","cluster_addr":"172.21.15.45:6811/115843","heartbeat_back_addr":"172.21.15.45:6815/115843","heartbeat_front_addr":"172.21.15.45:6813/115843","state":["exists","up"]},{"osd":1,"uuid":"c5de4ebd-9ec5-40b3-9caa-9b706fab4c76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":115842},{"type":"v1","addr":"172.21.15.45:6801","nonce":115842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":115842},{"type":"v1","addr":"172.21.15.45:6803","nonce":115842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6807","nonce":115842},{"type":"v1","addr":"172.21.15.45:6809","nonce":115842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":115842},{"type":"v1","addr":"172.21.15.45:6805","nonce":115842}]},"public_addr":"172.21.15.45:6801/115842","cluster_addr":"172.21.15.45:6803/115842","heartbeat_back_addr":"172.21.15.45:6809/115842","heartbeat_front_addr":"172.21.15.45:6805/115842","state":["exists","up"]},{"osd":2,"uuid":"9f4b36b2-65d2-40e7-9fe6-a2991afa71c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":115850},{"type":"v1","addr":"172.21.15.45:6819","nonce":115850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":115850},{"type":"v1","addr":"172.21.15.45:6823","nonce":115850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":115850},{"type":"v1","addr":"172.21.15.45:6831","nonce":115850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":115850},{"type":"v1","addr":"172.21.15.45:6828","nonce":115850}]},"public_addr":"172.21.15.45:6819/115850","cluster_addr":"172.21.15.45:6823/115850","heartbeat_back_addr":"172.21.15.45:6831/115850","heartbeat_front_addr":"172.21.15.45:6828/115850","state":["exists","up"]},{"osd":3,"uuid":"6fe7ef05-4e0d-426c-bf94-44b51d4d550b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":115848},{"type":"v1","addr":"172.21.15.45:6818","nonce":115848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":115848},{"type":"v1","addr":"172.21.15.45:6822","nonce":115848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6827","nonce":115848},{"type":"v1","addr":"172.21.15.45:6829","nonce":115848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":115848},{"type":"v1","addr":"172.21.15.45:6825","nonce":115848}]},"public_addr":"172.21.15.45:6818/115848","cluster_addr":"172.21.15.45:6822/115848","heartbeat_back_addr":"172.21.15.45:6829/115848","heartbeat_front_addr":"172.21.15.45:6825/115848","state":["exists","up"]},{"osd":4,"uuid":"fa403c08-d8a1-4a3a-8384-cb465c1a654c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":116092},{"type":"v1","addr":"172.21.15.152:6801","nonce":116092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":116092},{"type":"v1","addr":"172.21.15.152:6803","nonce":116092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":116092},{"type":"v1","addr":"172.21.15.152:6807","nonce":116092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":116092},{"type":"v1","addr":"172.21.15.152:6805","nonce":116092}]},"public_addr":"172.21.15.152:6801/116092","cluster_addr":"172.21.15.152:6803/116092","heartbeat_back_addr":"172.21.15.152:6807/116092","heartbeat_front_addr":"172.21.15.152:6805/116092","state":["exists","up"]},{"osd":5,"uuid":"399fc450-39fa-43a6-bf80-0b8bcb41bd95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6815","nonce":116093},{"type":"v1","addr":"172.21.15.152:6817","nonce":116093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":116093},{"type":"v1","addr":"172.21.15.152:6819","nonce":116093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":116093},{"type":"v1","addr":"172.21.15.152:6823","nonce":116093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":116093},{"type":"v1","addr":"172.21.15.152:6821","nonce":116093}]},"public_addr":"172.21.15.152:6817/116093","cluster_addr":"172.21.15.152:6819/116093","heartbeat_back_addr":"172.21.15.152:6823/116093","heartbeat_front_addr":"172.21.15.152:6821/116093","state":["exists","up"]},{"osd":6,"uuid":"e59a4017-2d23-4627-836b-e25b2d3ddaaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":116094},{"type":"v1","addr":"172.21.15.152:6809","nonce":116094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":116094},{"type":"v1","addr":"172.21.15.152:6811","nonce":116094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":116094},{"type":"v1","addr":"172.21.15.152:6816","nonce":116094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":116094},{"type":"v1","addr":"172.21.15.152:6813","nonce":116094}]},"public_addr":"172.21.15.152:6809/116094","cluster_addr":"172.21.15.152:6811/116094","heartbeat_back_addr":"172.21.15.152:6816/116094","heartbeat_front_addr":"172.21.15.152:6813/116094","state":["exists","up"]},{"osd":7,"uuid":"8d7f9d4b-bf08-4670-8591-388c0f012a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":116097},{"type":"v1","addr":"172.21.15.152:6825","nonce":116097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":116097},{"type":"v1","addr":"172.21.15.152:6827","nonce":116097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":116097},{"type":"v1","addr":"172.21.15.152:6831","nonce":116097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":116097},{"type":"v1","addr":"172.21.15.152:6829","nonce":116097}]},"public_addr":"172.21.15.152:6825/116097","cluster_addr":"172.21.15.152:6827/116097","heartbeat_back_addr":"172.21.15.152:6831/116097","heartbeat_front_addr":"172.21.15.152:6829/116097","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.937710+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.865423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.159434+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.913090+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.131647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.966255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.972583+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.177209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T12:07:05.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.140+0000 7fee53fff700 1 -- 172.21.15.45:0/2304212835 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fee300682f0 msgr2=0x7fee3006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:05.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.140+0000 7fee53fff700 1 --2- 172.21.15.45:0/2304212835 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fee300682f0 0x7fee3006a7a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fee48006fd0 tx=0x7fee48008040 comp rx=0 tx=0).stop 2023-11-28T12:07:05.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.140+0000 7fee53fff700 1 -- 172.21.15.45:0/2304212835 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee4c15c9b0 msgr2=0x7fee4c150830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:05.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.140+0000 7fee53fff700 1 --2- 172.21.15.45:0/2304212835 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee4c15c9b0 0x7fee4c150830 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fee3c009130 tx=0x7fee3c004750 comp rx=0 tx=0).stop 2023-11-28T12:07:05.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.140+0000 7fee53fff700 1 -- 172.21.15.45:0/2304212835 shutdown_connections 2023-11-28T12:07:05.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.140+0000 7fee53fff700 1 --2- 172.21.15.45:0/2304212835 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fee300682f0 0x7fee3006a7a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:05.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.140+0000 7fee53fff700 1 --2- 172.21.15.45:0/2304212835 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fee4c161340 0x7fee4c146210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:05.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.140+0000 7fee53fff700 1 --2- 172.21.15.45:0/2304212835 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fee4c0d2320 0x7fee4c0c98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:05.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.140+0000 7fee53fff700 1 --2- 172.21.15.45:0/2304212835 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee4c15c9b0 0x7fee4c150830 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:05.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.140+0000 7fee53fff700 1 -- 172.21.15.45:0/2304212835 >> 172.21.15.45:0/2304212835 conn(0x7fee4c072600 msgr2=0x7fee4c15cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:05.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.140+0000 7fee53fff700 1 -- 172.21.15.45:0/2304212835 shutdown_connections 2023-11-28T12:07:05.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.140+0000 7fee53fff700 1 -- 172.21.15.45:0/2304212835 wait complete. 2023-11-28T12:07:05.160 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-28T12:06:21.807108+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-28T12:06:22.491009+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T12:06:27.684157+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T12:06:28.384679+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T12:07:05.161 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T12:07:05.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.365+0000 7f4c675ff700 1 Processor -- start 2023-11-28T12:07:05.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.366+0000 7f4c675ff700 1 -- start start 2023-11-28T12:07:05.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.367+0000 7f4c675ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4c6015c9b0 0x7f4c600b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:05.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.367+0000 7f4c675ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f4c60161340 0x7f4c600d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:05.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.367+0000 7f4c675ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4c600d2320 0x7f4c600cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:05.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.367+0000 7f4c675ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c600b5800 con 0x7f4c600d2320 2023-11-28T12:07:05.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.367+0000 7f4c675ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c600d1950 con 0x7f4c60161340 2023-11-28T12:07:05.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.367+0000 7f4c675ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c600b5520 con 0x7f4c6015c9b0 2023-11-28T12:07:05.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.367+0000 7f4c65b9c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4c600d2320 0x7f4c600cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:05.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.367+0000 7f4c65b9c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4c600d2320 0x7f4c600cd7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37850/0 (socket says 172.21.15.45:37850) 2023-11-28T12:07:05.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.367+0000 7f4c65b9c700 1 -- 172.21.15.45:0/2428881793 learned_addr learned my addr 172.21.15.45:0/2428881793 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:05.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.367+0000 7f4c64b9a700 1 --2- 172.21.15.45:0/2428881793 >> v2:172.21.15.152:3300/0 conn(0x7f4c60161340 0x7f4c600d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:05.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.367+0000 7f4c6539b700 1 --2- 172.21.15.45:0/2428881793 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4c6015c9b0 0x7f4c600b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:05.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.368+0000 7f4c65b9c700 1 -- 172.21.15.45:0/2428881793 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4c6015c9b0 msgr2=0x7f4c600b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:05.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.368+0000 7f4c65b9c700 1 --2- 172.21.15.45:0/2428881793 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4c6015c9b0 0x7f4c600b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:05.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.368+0000 7f4c65b9c700 1 -- 172.21.15.45:0/2428881793 >> v2:172.21.15.152:3300/0 conn(0x7f4c60161340 msgr2=0x7f4c600d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:05.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.368+0000 7f4c65b9c700 1 --2- 172.21.15.45:0/2428881793 >> v2:172.21.15.152:3300/0 conn(0x7f4c60161340 0x7f4c600d1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:05.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.368+0000 7f4c65b9c700 1 -- 172.21.15.45:0/2428881793 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c600d1300 con 0x7f4c600d2320 2023-11-28T12:07:05.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.368+0000 7f4c64b9a700 1 --2- 172.21.15.45:0/2428881793 >> v2:172.21.15.152:3300/0 conn(0x7f4c60161340 0x7f4c600d1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:07:05.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.368+0000 7f4c65b9c700 1 --2- 172.21.15.45:0/2428881793 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c600d2320 0x7f4c600cd7c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4c6006bc00 tx=0x7f4c5800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c49edb84205e891 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:05.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.368+0000 7f4c57fff700 1 -- 172.21.15.45:0/2428881793 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c5800e070 con 0x7f4c600d2320 2023-11-28T12:07:05.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.368+0000 7f4c57fff700 1 -- 172.21.15.45:0/2428881793 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c5800b9c0 con 0x7f4c600d2320 2023-11-28T12:07:05.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.368+0000 7f4c57fff700 1 -- 172.21.15.45:0/2428881793 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c5800bd70 con 0x7f4c600d2320 2023-11-28T12:07:05.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.369+0000 7f4c675ff700 1 -- 172.21.15.45:0/2428881793 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c600d2320 msgr2=0x7f4c600cd7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:05.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.369+0000 7f4c675ff700 1 --2- 172.21.15.45:0/2428881793 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c600d2320 0x7f4c600cd7c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4c6006bc00 tx=0x7f4c5800b330 comp rx=0 tx=0).stop 2023-11-28T12:07:05.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.369+0000 7f4c675ff700 1 -- 172.21.15.45:0/2428881793 shutdown_connections 2023-11-28T12:07:05.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.369+0000 7f4c675ff700 1 --2- 172.21.15.45:0/2428881793 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4c6015c9b0 0x7f4c600b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:05.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.369+0000 7f4c675ff700 1 --2- 172.21.15.45:0/2428881793 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c600d2320 0x7f4c600cd7c0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:05.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.369+0000 7f4c675ff700 1 --2- 172.21.15.45:0/2428881793 >> v2:172.21.15.152:3300/0 conn(0x7f4c60161340 0x7f4c600d1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:05.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.369+0000 7f4c675ff700 1 -- 172.21.15.45:0/2428881793 >> 172.21.15.45:0/2428881793 conn(0x7f4c60072600 msgr2=0x7f4c600cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:05.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.369+0000 7f4c675ff700 1 -- 172.21.15.45:0/2428881793 shutdown_connections 2023-11-28T12:07:05.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.369+0000 7f4c675ff700 1 -- 172.21.15.45:0/2428881793 wait complete. 2023-11-28T12:07:05.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.371+0000 7f4c675ff700 1 Processor -- start 2023-11-28T12:07:05.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.372+0000 7f4c675ff700 1 -- start start 2023-11-28T12:07:05.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.373+0000 7f4c675ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4c600d2320 0x7f4c6014e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:05.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.373+0000 7f4c675ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c6015c9b0 0x7f4c601501e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:05.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.373+0000 7f4c675ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c60161340 0x7f4c60150720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:05.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.373+0000 7f4c675ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c60159440 con 0x7f4c6015c9b0 2023-11-28T12:07:05.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.373+0000 7f4c675ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c6015df20 con 0x7f4c60161340 2023-11-28T12:07:05.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.373+0000 7f4c675ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c60153c00 con 0x7f4c600d2320 2023-11-28T12:07:05.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.373+0000 7f4c64b9a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c6015c9b0 0x7f4c601501e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:05.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.373+0000 7f4c64b9a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c6015c9b0 0x7f4c601501e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37854/0 (socket says 172.21.15.45:37854) 2023-11-28T12:07:05.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.373+0000 7f4c64b9a700 1 -- 172.21.15.45:0/2710563217 learned_addr learned my addr 172.21.15.45:0/2710563217 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:05.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.373+0000 7f4c6539b700 1 --2- 172.21.15.45:0/2710563217 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4c600d2320 0x7f4c6014e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:05.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.373+0000 7f4c65b9c700 1 --2- 172.21.15.45:0/2710563217 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c60161340 0x7f4c60150720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:05.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.374+0000 7f4c64b9a700 1 -- 172.21.15.45:0/2710563217 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4c600d2320 msgr2=0x7f4c6014e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:05.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.374+0000 7f4c64b9a700 1 --2- 172.21.15.45:0/2710563217 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4c600d2320 0x7f4c6014e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:05.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.374+0000 7f4c64b9a700 1 -- 172.21.15.45:0/2710563217 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c60161340 msgr2=0x7f4c60150720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:05.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.374+0000 7f4c64b9a700 1 --2- 172.21.15.45:0/2710563217 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c60161340 0x7f4c60150720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:05.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.374+0000 7f4c64b9a700 1 -- 172.21.15.45:0/2710563217 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c58009b30 con 0x7f4c6015c9b0 2023-11-28T12:07:05.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.374+0000 7f4c6539b700 1 --2- 172.21.15.45:0/2710563217 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4c600d2320 0x7f4c6014e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:07:05.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.374+0000 7f4c65b9c700 1 --2- 172.21.15.45:0/2710563217 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c60161340 0x7f4c60150720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:07:05.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.374+0000 7f4c64b9a700 1 --2- 172.21.15.45:0/2710563217 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c6015c9b0 0x7f4c601501e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4c5000e810 tx=0x7f4c5000ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:05.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.374+0000 7f4c55ffb700 1 -- 172.21.15.45:0/2710563217 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c50013610 con 0x7f4c6015c9b0 2023-11-28T12:07:05.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.374+0000 7f4c55ffb700 1 -- 172.21.15.45:0/2710563217 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c50013770 con 0x7f4c6015c9b0 2023-11-28T12:07:05.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.374+0000 7f4c55ffb700 1 -- 172.21.15.45:0/2710563217 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c50013b20 con 0x7f4c6015c9b0 2023-11-28T12:07:05.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.374+0000 7f4c675ff700 1 -- 172.21.15.45:0/2710563217 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c600b5130 con 0x7f4c6015c9b0 2023-11-28T12:07:05.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.374+0000 7f4c675ff700 1 -- 172.21.15.45:0/2710563217 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c600d15e0 con 0x7f4c6015c9b0 2023-11-28T12:07:05.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.375+0000 7f4c675ff700 1 -- 172.21.15.45:0/2710563217 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c600b52c0 con 0x7f4c6015c9b0 2023-11-28T12:07:05.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.376+0000 7f4c55ffb700 1 -- 172.21.15.45:0/2710563217 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f4c50023070 con 0x7f4c6015c9b0 2023-11-28T12:07:05.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.378+0000 7f4c55ffb700 1 --2- 172.21.15.45:0/2710563217 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f4c44068320 0x7f4c4406a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:05.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.378+0000 7f4c55ffb700 1 -- 172.21.15.45:0/2710563217 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4c50085a00 con 0x7f4c6015c9b0 2023-11-28T12:07:05.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.378+0000 7f4c6539b700 1 --2- 172.21.15.45:0/2710563217 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f4c44068320 0x7f4c4406a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:05.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.379+0000 7f4c6539b700 1 --2- 172.21.15.45:0/2710563217 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f4c44068320 0x7f4c4406a7d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c007a50 tx=0x7f4c5c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:05.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.382+0000 7f4c55ffb700 1 -- 172.21.15.45:0/2710563217 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f4c500520e0 con 0x7f4c6015c9b0 2023-11-28T12:07:05.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.581+0000 7f4c675ff700 1 -- 172.21.15.45:0/2710563217 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4c60066260 con 0x7f4c6015c9b0 2023-11-28T12:07:05.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.581+0000 7f4c55ffb700 1 -- 172.21.15.45:0/2710563217 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4c500210a0 con 0x7f4c6015c9b0 2023-11-28T12:07:05.583 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-11-28T12:07:05.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.583+0000 7f4c675ff700 1 -- 172.21.15.45:0/2710563217 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f4c44068320 msgr2=0x7f4c4406a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:05.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.583+0000 7f4c675ff700 1 --2- 172.21.15.45:0/2710563217 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f4c44068320 0x7f4c4406a7d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c007a50 tx=0x7f4c5c008040 comp rx=0 tx=0).stop 2023-11-28T12:07:05.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.583+0000 7f4c675ff700 1 -- 172.21.15.45:0/2710563217 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c6015c9b0 msgr2=0x7f4c601501e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:05.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.583+0000 7f4c675ff700 1 --2- 172.21.15.45:0/2710563217 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c6015c9b0 0x7f4c601501e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4c5000e810 tx=0x7f4c5000ebd0 comp rx=0 tx=0).stop 2023-11-28T12:07:05.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.583+0000 7f4c675ff700 1 -- 172.21.15.45:0/2710563217 shutdown_connections 2023-11-28T12:07:05.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.583+0000 7f4c675ff700 1 --2- 172.21.15.45:0/2710563217 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f4c44068320 0x7f4c4406a7d0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:05.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.583+0000 7f4c675ff700 1 --2- 172.21.15.45:0/2710563217 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4c60161340 0x7f4c60150720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:05.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.583+0000 7f4c675ff700 1 --2- 172.21.15.45:0/2710563217 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4c600d2320 0x7f4c6014e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:05.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.583+0000 7f4c675ff700 1 --2- 172.21.15.45:0/2710563217 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c6015c9b0 0x7f4c601501e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:05.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.583+0000 7f4c675ff700 1 -- 172.21.15.45:0/2710563217 >> 172.21.15.45:0/2710563217 conn(0x7f4c60072600 msgr2=0x7f4c600b5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:05.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.583+0000 7f4c675ff700 1 -- 172.21.15.45:0/2710563217 shutdown_connections 2023-11-28T12:07:05.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.583+0000 7f4c675ff700 1 -- 172.21.15.45:0/2710563217 wait complete. 2023-11-28T12:07:05.603 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T12:07:05.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.808+0000 7fb95efff700 1 Processor -- start 2023-11-28T12:07:05.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.808+0000 7fb95efff700 1 -- start start 2023-11-28T12:07:05.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.809+0000 7fb95efff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb95815c9b0 0x7fb9580b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:05.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.809+0000 7fb95efff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9580d1950 con 0x7fb9580cd7c0 2023-11-28T12:07:05.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.809+0000 7fb95efff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9580d24f0 con 0x7fb958161340 2023-11-28T12:07:05.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.809+0000 7fb95efff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9580b5800 con 0x7fb95815c9b0 2023-11-28T12:07:05.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.810+0000 7fb95cd9b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb95815c9b0 0x7fb9580b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:05.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.810+0000 7fb95d59c700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fb9580cd7c0 0x7fb9580b5fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33648/0 (socket says 172.21.15.45:33648) 2023-11-28T12:07:05.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.810+0000 7fb95d59c700 1 -- 172.21.15.45:0/266513638 learned_addr learned my addr 172.21.15.45:0/266513638 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:07:05.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.810+0000 7fb9577fe700 1 -- 172.21.15.45:0/266513638 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3165039128 0 0) 0x7fb9580d1950 con 0x7fb9580cd7c0 2023-11-28T12:07:05.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.810+0000 7fb95cd9b700 1 -- 172.21.15.45:0/266513638 >> v1:172.21.15.152:6789/0 conn(0x7fb958161340 legacy=0x7fb9580d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:05.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.810+0000 7fb95cd9b700 1 -- 172.21.15.45:0/266513638 >> v1:172.21.15.45:6789/0 conn(0x7fb9580cd7c0 legacy=0x7fb9580b5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:05.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.810+0000 7fb95cd9b700 1 -- 172.21.15.45:0/266513638 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9580b5520 con 0x7fb95815c9b0 2023-11-28T12:07:05.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.810+0000 7fb95cd9b700 1 --2- 172.21.15.45:0/266513638 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb95815c9b0 0x7fb9580b4bf0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb94c009840 tx=0x7fb94c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6487c96c0b542c95 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:05.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.811+0000 7fb9577fe700 1 -- 172.21.15.45:0/266513638 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb94c011830 con 0x7fb95815c9b0 2023-11-28T12:07:05.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.811+0000 7fb9577fe700 1 -- 172.21.15.45:0/266513638 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb94c011990 con 0x7fb95815c9b0 2023-11-28T12:07:05.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.811+0000 7fb9577fe700 1 -- 172.21.15.45:0/266513638 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb94c011d20 con 0x7fb95815c9b0 2023-11-28T12:07:05.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.811+0000 7fb95efff700 1 -- 172.21.15.45:0/266513638 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb95815c9b0 msgr2=0x7fb9580b4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:05.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.811+0000 7fb95efff700 1 --2- 172.21.15.45:0/266513638 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb95815c9b0 0x7fb9580b4bf0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb94c009840 tx=0x7fb94c009b50 comp rx=0 tx=0).stop 2023-11-28T12:07:05.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.811+0000 7fb95efff700 1 -- 172.21.15.45:0/266513638 shutdown_connections 2023-11-28T12:07:05.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.811+0000 7fb95efff700 1 --2- 172.21.15.45:0/266513638 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb95815c9b0 0x7fb9580b4bf0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:05.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.811+0000 7fb95efff700 1 -- 172.21.15.45:0/266513638 >> 172.21.15.45:0/266513638 conn(0x7fb958072600 msgr2=0x7fb9580cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:05.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.811+0000 7fb95efff700 1 -- 172.21.15.45:0/266513638 shutdown_connections 2023-11-28T12:07:05.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.811+0000 7fb95efff700 1 -- 172.21.15.45:0/266513638 wait complete. 2023-11-28T12:07:05.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.814+0000 7fb95efff700 1 Processor -- start 2023-11-28T12:07:05.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.814+0000 7fb95efff700 1 -- start start 2023-11-28T12:07:05.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.815+0000 7fb95efff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb9580cd7c0 0x7fb9581f2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:05.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.815+0000 7fb95efff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb95815c9b0 0x7fb9580c92b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:05.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.815+0000 7fb95efff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb958161340 0x7fb9580c78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:05.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.815+0000 7fb95efff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9581f2eb0 con 0x7fb9580cd7c0 2023-11-28T12:07:05.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.815+0000 7fb95efff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9580ca050 con 0x7fb958161340 2023-11-28T12:07:05.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.815+0000 7fb95efff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9580c97f0 con 0x7fb95815c9b0 2023-11-28T12:07:05.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.815+0000 7fb95cd9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb9580cd7c0 0x7fb9581f2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:05.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.816+0000 7fb95cd9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb9580cd7c0 0x7fb9581f2970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37874/0 (socket says 172.21.15.45:37874) 2023-11-28T12:07:05.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.816+0000 7fb95cd9b700 1 -- 172.21.15.45:0/3842894749 learned_addr learned my addr 172.21.15.45:0/3842894749 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:05.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.816+0000 7fb957fff700 1 --2- 172.21.15.45:0/3842894749 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb95815c9b0 0x7fb9580c92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:05.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.816+0000 7fb95d59c700 1 --2- 172.21.15.45:0/3842894749 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb958161340 0x7fb9580c78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:05.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.816+0000 7fb95cd9b700 1 -- 172.21.15.45:0/3842894749 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb95815c9b0 msgr2=0x7fb9580c92b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:05.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.816+0000 7fb95cd9b700 1 --2- 172.21.15.45:0/3842894749 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb95815c9b0 0x7fb9580c92b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:05.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.816+0000 7fb95cd9b700 1 -- 172.21.15.45:0/3842894749 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb958161340 msgr2=0x7fb9580c78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:05.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.816+0000 7fb95cd9b700 1 --2- 172.21.15.45:0/3842894749 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb958161340 0x7fb9580c78d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:05.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.816+0000 7fb95cd9b700 1 -- 172.21.15.45:0/3842894749 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb94c0094a0 con 0x7fb9580cd7c0 2023-11-28T12:07:05.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.816+0000 7fb95cd9b700 1 --2- 172.21.15.45:0/3842894749 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb9580cd7c0 0x7fb9581f2970 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb94c014040 tx=0x7fb94c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:05.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.817+0000 7fb9557fa700 1 -- 172.21.15.45:0/3842894749 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb94c01a7e0 con 0x7fb9580cd7c0 2023-11-28T12:07:05.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.817+0000 7fb9557fa700 1 -- 172.21.15.45:0/3842894749 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb94c01a940 con 0x7fb9580cd7c0 2023-11-28T12:07:05.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.817+0000 7fb95efff700 1 -- 172.21.15.45:0/3842894749 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9580d15e0 con 0x7fb9580cd7c0 2023-11-28T12:07:05.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.817+0000 7fb9557fa700 1 -- 172.21.15.45:0/3842894749 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb94c01acb0 con 0x7fb9580cd7c0 2023-11-28T12:07:05.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.817+0000 7fb95efff700 1 -- 172.21.15.45:0/3842894749 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9580d1300 con 0x7fb9580cd7c0 2023-11-28T12:07:05.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.818+0000 7fb95efff700 1 -- 172.21.15.45:0/3842894749 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9580b5130 con 0x7fb9580cd7c0 2023-11-28T12:07:05.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.819+0000 7fb9557fa700 1 -- 172.21.15.45:0/3842894749 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fb94c02b030 con 0x7fb9580cd7c0 2023-11-28T12:07:05.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.820+0000 7fb9557fa700 1 --2- 172.21.15.45:0/3842894749 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb93c0682f0 0x7fb93c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:05.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.820+0000 7fb9557fa700 1 -- 172.21.15.45:0/3842894749 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb94c086f90 con 0x7fb9580cd7c0 2023-11-28T12:07:05.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.820+0000 7fb957fff700 1 --2- 172.21.15.45:0/3842894749 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb93c0682f0 0x7fb93c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:05.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.821+0000 7fb957fff700 1 --2- 172.21.15.45:0/3842894749 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb93c0682f0 0x7fb93c06a7a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb958157db0 tx=0x7fb944009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:05.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:05.824+0000 7fb9557fa700 1 -- 172.21.15.45:0/3842894749 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fb94c0537f0 con 0x7fb9580cd7c0 2023-11-28T12:07:06.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.024+0000 7fb95efff700 1 -- 172.21.15.45:0/3842894749 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb9580c9af0 con 0x7fb9580cd7c0 2023-11-28T12:07:06.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.024+0000 7fb9557fa700 1 -- 172.21.15.45:0/3842894749 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb94c029020 con 0x7fb9580cd7c0 2023-11-28T12:07:06.026 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-11-28T12:07:06.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.026+0000 7fb95efff700 1 -- 172.21.15.45:0/3842894749 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb93c0682f0 msgr2=0x7fb93c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:06.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.027+0000 7fb95efff700 1 --2- 172.21.15.45:0/3842894749 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb93c0682f0 0x7fb93c06a7a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb958157db0 tx=0x7fb944009040 comp rx=0 tx=0).stop 2023-11-28T12:07:06.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.027+0000 7fb95efff700 1 -- 172.21.15.45:0/3842894749 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb9580cd7c0 msgr2=0x7fb9581f2970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:06.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.027+0000 7fb95efff700 1 --2- 172.21.15.45:0/3842894749 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb9580cd7c0 0x7fb9581f2970 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb94c014040 tx=0x7fb94c004750 comp rx=0 tx=0).stop 2023-11-28T12:07:06.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.027+0000 7fb95efff700 1 -- 172.21.15.45:0/3842894749 shutdown_connections 2023-11-28T12:07:06.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.027+0000 7fb95efff700 1 --2- 172.21.15.45:0/3842894749 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb93c0682f0 0x7fb93c06a7a0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:06.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.027+0000 7fb95efff700 1 --2- 172.21.15.45:0/3842894749 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb958161340 0x7fb9580c78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:06.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.027+0000 7fb95efff700 1 --2- 172.21.15.45:0/3842894749 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb9580cd7c0 0x7fb9581f2970 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:06.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.027+0000 7fb95efff700 1 --2- 172.21.15.45:0/3842894749 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb95815c9b0 0x7fb9580c92b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:06.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.027+0000 7fb95efff700 1 -- 172.21.15.45:0/3842894749 >> 172.21.15.45:0/3842894749 conn(0x7fb958072600 msgr2=0x7fb95815ab70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:06.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.027+0000 7fb95efff700 1 -- 172.21.15.45:0/3842894749 shutdown_connections 2023-11-28T12:07:06.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.027+0000 7fb95efff700 1 -- 172.21.15.45:0/3842894749 wait complete. 2023-11-28T12:07:06.046 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T12:07:06.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.252+0000 7fca19dff700 1 Processor -- start 2023-11-28T12:07:06.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.252+0000 7fca19dff700 1 -- start start 2023-11-28T12:07:06.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.253+0000 7fca19dff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fca1415c9b0 0x7fca140b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:06.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.253+0000 7fca19dff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca140d1950 con 0x7fca140cd7c0 2023-11-28T12:07:06.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.253+0000 7fca19dff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca140d24f0 con 0x7fca14161340 2023-11-28T12:07:06.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.253+0000 7fca19dff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca140b5800 con 0x7fca1415c9b0 2023-11-28T12:07:06.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.253+0000 7fca13fff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fca140cd7c0 0x7fca140b5fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33658/0 (socket says 172.21.15.45:33658) 2023-11-28T12:07:06.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.253+0000 7fca13fff700 1 -- 172.21.15.45:0/1288599757 learned_addr learned my addr 172.21.15.45:0/1288599757 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:07:06.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.254+0000 7fca137fe700 1 --2- 172.21.15.45:0/1288599757 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fca1415c9b0 0x7fca140b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:06.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.254+0000 7fca127fc700 1 -- 172.21.15.45:0/1288599757 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 970759712 0 0) 0x7fca140d1950 con 0x7fca140cd7c0 2023-11-28T12:07:06.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.254+0000 7fca127fc700 1 -- 172.21.15.45:0/1288599757 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9fc0035b0 con 0x7fca140cd7c0 2023-11-28T12:07:06.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.254+0000 7fca127fc700 1 -- 172.21.15.45:0/1288599757 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1507697511 0 0) 0x7fca140d24f0 con 0x7fca14161340 2023-11-28T12:07:06.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.254+0000 7fca127fc700 1 -- 172.21.15.45:0/1288599757 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca140d1950 con 0x7fca14161340 2023-11-28T12:07:06.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.254+0000 7fca137fe700 1 -- 172.21.15.45:0/1288599757 >> v1:172.21.15.152:6789/0 conn(0x7fca14161340 legacy=0x7fca140d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:06.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.254+0000 7fca137fe700 1 -- 172.21.15.45:0/1288599757 >> v1:172.21.15.45:6789/0 conn(0x7fca140cd7c0 legacy=0x7fca140b5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:06.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.254+0000 7fca137fe700 1 -- 172.21.15.45:0/1288599757 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca140b5520 con 0x7fca1415c9b0 2023-11-28T12:07:06.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.255+0000 7fca137fe700 1 --2- 172.21.15.45:0/1288599757 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fca1415c9b0 0x7fca140b4bf0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fca04009870 tx=0x7fca04009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9498a5ba10f079bb server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:06.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.255+0000 7fca127fc700 1 -- 172.21.15.45:0/1288599757 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca04011830 con 0x7fca1415c9b0 2023-11-28T12:07:06.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.255+0000 7fca127fc700 1 -- 172.21.15.45:0/1288599757 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca04011990 con 0x7fca1415c9b0 2023-11-28T12:07:06.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.255+0000 7fca127fc700 1 -- 172.21.15.45:0/1288599757 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca04011d20 con 0x7fca1415c9b0 2023-11-28T12:07:06.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.255+0000 7fca19dff700 1 -- 172.21.15.45:0/1288599757 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fca1415c9b0 msgr2=0x7fca140b4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:06.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.255+0000 7fca19dff700 1 --2- 172.21.15.45:0/1288599757 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fca1415c9b0 0x7fca140b4bf0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fca04009870 tx=0x7fca04009b80 comp rx=0 tx=0).stop 2023-11-28T12:07:06.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.255+0000 7fca19dff700 1 -- 172.21.15.45:0/1288599757 shutdown_connections 2023-11-28T12:07:06.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.255+0000 7fca19dff700 1 --2- 172.21.15.45:0/1288599757 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fca1415c9b0 0x7fca140b4bf0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:06.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.255+0000 7fca19dff700 1 -- 172.21.15.45:0/1288599757 >> 172.21.15.45:0/1288599757 conn(0x7fca14072600 msgr2=0x7fca140cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:06.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.256+0000 7fca19dff700 1 -- 172.21.15.45:0/1288599757 shutdown_connections 2023-11-28T12:07:06.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.256+0000 7fca19dff700 1 -- 172.21.15.45:0/1288599757 wait complete. 2023-11-28T12:07:06.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.257+0000 7fca19dff700 1 Processor -- start 2023-11-28T12:07:06.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.257+0000 7fca19dff700 1 -- start start 2023-11-28T12:07:06.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.258+0000 7fca19dff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca140cd7c0 0x7fca140c8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:06.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.258+0000 7fca19dff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca1415c9b0 0x7fca140c6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:06.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.258+0000 7fca19dff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fca14161340 0x7fca140c71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:06.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.258+0000 7fca19dff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca140c9e80 con 0x7fca140cd7c0 2023-11-28T12:07:06.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.258+0000 7fca19dff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca140c95e0 con 0x7fca1415c9b0 2023-11-28T12:07:06.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.258+0000 7fca19dff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca140c98c0 con 0x7fca14161340 2023-11-28T12:07:06.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.259+0000 7fca137fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca140cd7c0 0x7fca140c8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:06.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.259+0000 7fca137fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca140cd7c0 0x7fca140c8c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37882/0 (socket says 172.21.15.45:37882) 2023-11-28T12:07:06.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.259+0000 7fca137fe700 1 -- 172.21.15.45:0/4273389408 learned_addr learned my addr 172.21.15.45:0/4273389408 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:06.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.259+0000 7fca12ffd700 1 --2- 172.21.15.45:0/4273389408 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca1415c9b0 0x7fca140c6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:06.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.259+0000 7fca13fff700 1 --2- 172.21.15.45:0/4273389408 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fca14161340 0x7fca140c71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:06.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.259+0000 7fca137fe700 1 -- 172.21.15.45:0/4273389408 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fca14161340 msgr2=0x7fca140c71e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:06.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.259+0000 7fca137fe700 1 --2- 172.21.15.45:0/4273389408 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fca14161340 0x7fca140c71e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:06.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.259+0000 7fca137fe700 1 -- 172.21.15.45:0/4273389408 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca1415c9b0 msgr2=0x7fca140c6ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:06.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.259+0000 7fca137fe700 1 --2- 172.21.15.45:0/4273389408 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca1415c9b0 0x7fca140c6ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:06.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.259+0000 7fca137fe700 1 -- 172.21.15.45:0/4273389408 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca040094a0 con 0x7fca140cd7c0 2023-11-28T12:07:06.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.259+0000 7fca137fe700 1 --2- 172.21.15.45:0/4273389408 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca140cd7c0 0x7fca140c8c90 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fca04009bc0 tx=0x7fca04004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:06.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.260+0000 7fc9fbfff700 1 -- 172.21.15.45:0/4273389408 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca04004450 con 0x7fca140cd7c0 2023-11-28T12:07:06.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.260+0000 7fc9fbfff700 1 -- 172.21.15.45:0/4273389408 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca0401e070 con 0x7fca140cd7c0 2023-11-28T12:07:06.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.260+0000 7fc9fbfff700 1 -- 172.21.15.45:0/4273389408 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca040038e0 con 0x7fca140cd7c0 2023-11-28T12:07:06.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.260+0000 7fca19dff700 1 -- 172.21.15.45:0/4273389408 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca140d15e0 con 0x7fca140cd7c0 2023-11-28T12:07:06.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.260+0000 7fca19dff700 1 -- 172.21.15.45:0/4273389408 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca140d1300 con 0x7fca140cd7c0 2023-11-28T12:07:06.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.261+0000 7fca19dff700 1 -- 172.21.15.45:0/4273389408 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca140b5130 con 0x7fca140cd7c0 2023-11-28T12:07:06.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.262+0000 7fc9fbfff700 1 -- 172.21.15.45:0/4273389408 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fca0400f050 con 0x7fca140cd7c0 2023-11-28T12:07:06.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.262+0000 7fc9fbfff700 1 --2- 172.21.15.45:0/4273389408 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fca000682f0 0x7fca0006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:06.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.263+0000 7fc9fbfff700 1 -- 172.21.15.45:0/4273389408 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fca04086b20 con 0x7fca140cd7c0 2023-11-28T12:07:06.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.263+0000 7fca12ffd700 1 --2- 172.21.15.45:0/4273389408 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fca000682f0 0x7fca0006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:06.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.264+0000 7fca12ffd700 1 --2- 172.21.15.45:0/4273389408 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fca000682f0 0x7fca0006a7a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fca080011e0 tx=0x7fca08009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:06.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.267+0000 7fc9fbfff700 1 -- 172.21.15.45:0/4273389408 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fca04053300 con 0x7fca140cd7c0 2023-11-28T12:07:06.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.468+0000 7fca19dff700 1 -- 172.21.15.45:0/4273389408 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fca140745c0 con 0x7fca140cd7c0 2023-11-28T12:07:06.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.468+0000 7fc9fbfff700 1 -- 172.21.15.45:0/4273389408 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fca04020020 con 0x7fca140cd7c0 2023-11-28T12:07:06.470 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-11-28T12:07:06.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.471+0000 7fca19dff700 1 -- 172.21.15.45:0/4273389408 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fca000682f0 msgr2=0x7fca0006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:06.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.471+0000 7fca19dff700 1 --2- 172.21.15.45:0/4273389408 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fca000682f0 0x7fca0006a7a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fca080011e0 tx=0x7fca08009040 comp rx=0 tx=0).stop 2023-11-28T12:07:06.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.471+0000 7fca19dff700 1 -- 172.21.15.45:0/4273389408 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca140cd7c0 msgr2=0x7fca140c8c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:06.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.471+0000 7fca19dff700 1 --2- 172.21.15.45:0/4273389408 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca140cd7c0 0x7fca140c8c90 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fca04009bc0 tx=0x7fca04004750 comp rx=0 tx=0).stop 2023-11-28T12:07:06.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.471+0000 7fca19dff700 1 -- 172.21.15.45:0/4273389408 shutdown_connections 2023-11-28T12:07:06.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.471+0000 7fca19dff700 1 --2- 172.21.15.45:0/4273389408 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fca000682f0 0x7fca0006a7a0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:06.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.471+0000 7fca19dff700 1 --2- 172.21.15.45:0/4273389408 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fca14161340 0x7fca140c71e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:06.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.471+0000 7fca19dff700 1 --2- 172.21.15.45:0/4273389408 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca140cd7c0 0x7fca140c8c90 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:06.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.471+0000 7fca19dff700 1 --2- 172.21.15.45:0/4273389408 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca1415c9b0 0x7fca140c6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:06.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.471+0000 7fca19dff700 1 -- 172.21.15.45:0/4273389408 >> 172.21.15.45:0/4273389408 conn(0x7fca14072600 msgr2=0x7fca14160460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:06.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.471+0000 7fca19dff700 1 -- 172.21.15.45:0/4273389408 shutdown_connections 2023-11-28T12:07:06.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.471+0000 7fca19dff700 1 -- 172.21.15.45:0/4273389408 wait complete. 2023-11-28T12:07:06.491 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T12:07:06.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.695+0000 7fa80c3ff700 1 Processor -- start 2023-11-28T12:07:06.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.696+0000 7fa80c3ff700 1 -- start start 2023-11-28T12:07:06.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.697+0000 7fa80c3ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa8040cd7c0 0x7fa8040cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:06.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.697+0000 7fa80c3ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8040d1950 con 0x7fa804161340 2023-11-28T12:07:06.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.697+0000 7fa80c3ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8040ce140 con 0x7fa80415c9b0 2023-11-28T12:07:06.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.697+0000 7fa80c3ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8040b5800 con 0x7fa8040cd7c0 2023-11-28T12:07:06.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.697+0000 7fa80999a700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fa804161340 0x7fa8040d1de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33662/0 (socket says 172.21.15.45:33662) 2023-11-28T12:07:06.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.697+0000 7fa80999a700 1 -- 172.21.15.45:0/2802501428 learned_addr learned my addr 172.21.15.45:0/2802501428 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:07:06.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.697+0000 7fa80a99c700 1 --2- 172.21.15.45:0/2802501428 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa8040cd7c0 0x7fa8040cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:06.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.698+0000 7fa809199700 1 -- 172.21.15.45:0/2802501428 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 645416549 0 0) 0x7fa8040d1950 con 0x7fa804161340 2023-11-28T12:07:06.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.698+0000 7fa809199700 1 -- 172.21.15.45:0/2802501428 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7f00035b0 con 0x7fa804161340 2023-11-28T12:07:06.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.698+0000 7fa809199700 1 -- 172.21.15.45:0/2802501428 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3834619127 0 0) 0x7fa8040ce140 con 0x7fa80415c9b0 2023-11-28T12:07:06.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.698+0000 7fa809199700 1 -- 172.21.15.45:0/2802501428 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8040d1950 con 0x7fa80415c9b0 2023-11-28T12:07:06.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.698+0000 7fa80a99c700 1 -- 172.21.15.45:0/2802501428 >> v1:172.21.15.152:6789/0 conn(0x7fa80415c9b0 legacy=0x7fa8040b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:06.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.698+0000 7fa80a99c700 1 -- 172.21.15.45:0/2802501428 >> v1:172.21.15.45:6789/0 conn(0x7fa804161340 legacy=0x7fa8040d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:06.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.698+0000 7fa80a99c700 1 -- 172.21.15.45:0/2802501428 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8040d24f0 con 0x7fa8040cd7c0 2023-11-28T12:07:06.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.698+0000 7fa80a99c700 1 --2- 172.21.15.45:0/2802501428 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa8040cd7c0 0x7fa8040cdc00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc009dc0 tx=0x7fa7fc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d973b6e11223074 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:06.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.699+0000 7fa809199700 1 -- 172.21.15.45:0/2802501428 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7fc00e070 con 0x7fa8040cd7c0 2023-11-28T12:07:06.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.699+0000 7fa809199700 1 -- 172.21.15.45:0/2802501428 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7fc00bb20 con 0x7fa8040cd7c0 2023-11-28T12:07:06.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.699+0000 7fa809199700 1 -- 172.21.15.45:0/2802501428 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7fc012430 con 0x7fa8040cd7c0 2023-11-28T12:07:06.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.699+0000 7fa80c3ff700 1 -- 172.21.15.45:0/2802501428 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa8040cd7c0 msgr2=0x7fa8040cdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:06.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.699+0000 7fa80c3ff700 1 --2- 172.21.15.45:0/2802501428 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa8040cd7c0 0x7fa8040cdc00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc009dc0 tx=0x7fa7fc00b330 comp rx=0 tx=0).stop 2023-11-28T12:07:06.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.699+0000 7fa80c3ff700 1 -- 172.21.15.45:0/2802501428 shutdown_connections 2023-11-28T12:07:06.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.699+0000 7fa80c3ff700 1 --2- 172.21.15.45:0/2802501428 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa8040cd7c0 0x7fa8040cdc00 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:06.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.699+0000 7fa80c3ff700 1 -- 172.21.15.45:0/2802501428 >> 172.21.15.45:0/2802501428 conn(0x7fa804072600 msgr2=0x7fa8040cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:06.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.699+0000 7fa80c3ff700 1 -- 172.21.15.45:0/2802501428 shutdown_connections 2023-11-28T12:07:06.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.699+0000 7fa80c3ff700 1 -- 172.21.15.45:0/2802501428 wait complete. 2023-11-28T12:07:06.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.701+0000 7fa80c3ff700 1 Processor -- start 2023-11-28T12:07:06.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.701+0000 7fa80c3ff700 1 -- start start 2023-11-28T12:07:06.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.702+0000 7fa80c3ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8040cd7c0 0x7fa8041f2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:06.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.702+0000 7fa80c3ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa80415c9b0 0x7fa8040cc970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:06.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.702+0000 7fa80c3ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa804161340 0x7fa804157630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:06.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.702+0000 7fa80c3ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8041f2fe0 con 0x7fa8040cd7c0 2023-11-28T12:07:06.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.702+0000 7fa80c3ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8040ca240 con 0x7fa804161340 2023-11-28T12:07:06.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.702+0000 7fa80c3ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8040caa50 con 0x7fa80415c9b0 2023-11-28T12:07:06.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.703+0000 7fa80a19b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8040cd7c0 0x7fa8041f2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:06.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.703+0000 7fa80a19b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8040cd7c0 0x7fa8041f2aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37888/0 (socket says 172.21.15.45:37888) 2023-11-28T12:07:06.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.703+0000 7fa80a19b700 1 -- 172.21.15.45:0/309929504 learned_addr learned my addr 172.21.15.45:0/309929504 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:06.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.703+0000 7fa80a99c700 1 --2- 172.21.15.45:0/309929504 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa804161340 0x7fa804157630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:06.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.703+0000 7fa80999a700 1 --2- 172.21.15.45:0/309929504 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa80415c9b0 0x7fa8040cc970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:06.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.703+0000 7fa80a19b700 1 -- 172.21.15.45:0/309929504 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa80415c9b0 msgr2=0x7fa8040cc970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:06.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.703+0000 7fa80a19b700 1 --2- 172.21.15.45:0/309929504 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa80415c9b0 0x7fa8040cc970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:06.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.703+0000 7fa80a19b700 1 -- 172.21.15.45:0/309929504 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa804161340 msgr2=0x7fa804157630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:06.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.703+0000 7fa80a19b700 1 --2- 172.21.15.45:0/309929504 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa804161340 0x7fa804157630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:06.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.703+0000 7fa80a19b700 1 -- 172.21.15.45:0/309929504 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7fc009a70 con 0x7fa8040cd7c0 2023-11-28T12:07:06.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.703+0000 7fa80a99c700 1 --2- 172.21.15.45:0/309929504 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa804161340 0x7fa804157630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:07:06.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.703+0000 7fa80a19b700 1 --2- 172.21.15.45:0/309929504 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8040cd7c0 0x7fa8041f2aa0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa80000c500 tx=0x7fa80000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:06.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.704+0000 7fa7faffd700 1 -- 172.21.15.45:0/309929504 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8000052d0 con 0x7fa8040cd7c0 2023-11-28T12:07:06.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.704+0000 7fa80c3ff700 1 -- 172.21.15.45:0/309929504 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8040d1300 con 0x7fa8040cd7c0 2023-11-28T12:07:06.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.704+0000 7fa7faffd700 1 -- 172.21.15.45:0/309929504 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa800005450 con 0x7fa8040cd7c0 2023-11-28T12:07:06.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.704+0000 7fa7faffd700 1 -- 172.21.15.45:0/309929504 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8000038c0 con 0x7fa8040cd7c0 2023-11-28T12:07:06.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.704+0000 7fa80c3ff700 1 -- 172.21.15.45:0/309929504 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8040b5520 con 0x7fa8040cd7c0 2023-11-28T12:07:06.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.705+0000 7fa80c3ff700 1 -- 172.21.15.45:0/309929504 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8040d15e0 con 0x7fa8040cd7c0 2023-11-28T12:07:06.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.706+0000 7fa7faffd700 1 -- 172.21.15.45:0/309929504 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fa800019030 con 0x7fa8040cd7c0 2023-11-28T12:07:06.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.707+0000 7fa7faffd700 1 --2- 172.21.15.45:0/309929504 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fa7e80682f0 0x7fa7e806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:06.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.707+0000 7fa7faffd700 1 -- 172.21.15.45:0/309929504 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa8000850f0 con 0x7fa8040cd7c0 2023-11-28T12:07:06.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.707+0000 7fa80999a700 1 --2- 172.21.15.45:0/309929504 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fa7e80682f0 0x7fa7e806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:06.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.708+0000 7fa80999a700 1 --2- 172.21.15.45:0/309929504 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fa7e80682f0 0x7fa7e806a7a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa804159ff0 tx=0x7fa7f4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:06.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.711+0000 7fa7faffd700 1 -- 172.21.15.45:0/309929504 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fa800051860 con 0x7fa8040cd7c0 2023-11-28T12:07:06.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.913+0000 7fa80c3ff700 1 -- 172.21.15.45:0/309929504 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa8040745c0 con 0x7fa8040cd7c0 2023-11-28T12:07:08.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.913+0000 7fa7faffd700 1 -- 172.21.15.45:0/309929504 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa800054e80 con 0x7fa8040cd7c0 2023-11-28T12:07:08.583 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-11-28T12:07:08.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.916+0000 7fa80c3ff700 1 -- 172.21.15.45:0/309929504 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fa7e80682f0 msgr2=0x7fa7e806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:08.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.916+0000 7fa80c3ff700 1 --2- 172.21.15.45:0/309929504 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fa7e80682f0 0x7fa7e806a7a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa804159ff0 tx=0x7fa7f4009040 comp rx=0 tx=0).stop 2023-11-28T12:07:08.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.916+0000 7fa80c3ff700 1 -- 172.21.15.45:0/309929504 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8040cd7c0 msgr2=0x7fa8041f2aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:08.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.916+0000 7fa80c3ff700 1 --2- 172.21.15.45:0/309929504 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8040cd7c0 0x7fa8041f2aa0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa80000c500 tx=0x7fa80000c8c0 comp rx=0 tx=0).stop 2023-11-28T12:07:08.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.916+0000 7fa80c3ff700 1 -- 172.21.15.45:0/309929504 shutdown_connections 2023-11-28T12:07:08.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.916+0000 7fa80c3ff700 1 --2- 172.21.15.45:0/309929504 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fa7e80682f0 0x7fa7e806a7a0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:08.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.916+0000 7fa80c3ff700 1 --2- 172.21.15.45:0/309929504 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa804161340 0x7fa804157630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:08.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.916+0000 7fa80c3ff700 1 --2- 172.21.15.45:0/309929504 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8040cd7c0 0x7fa8041f2aa0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:08.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.916+0000 7fa80c3ff700 1 --2- 172.21.15.45:0/309929504 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa80415c9b0 0x7fa8040cc970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:08.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.916+0000 7fa80c3ff700 1 -- 172.21.15.45:0/309929504 >> 172.21.15.45:0/309929504 conn(0x7fa804072600 msgr2=0x7fa8040d1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:08.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.916+0000 7fa80c3ff700 1 -- 172.21.15.45:0/309929504 shutdown_connections 2023-11-28T12:07:08.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:06.916+0000 7fa80c3ff700 1 -- 172.21.15.45:0/309929504 wait complete. 2023-11-28T12:07:08.595 INFO:tasks.cephfs_test_runner:Starting test: test_apply_tag (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2023-11-28T12:07:08.595 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag' 2023-11-28T12:07:08.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:08.810+0000 7fba315ff700 1 Processor -- start 2023-11-28T12:07:08.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:08.810+0000 7fba315ff700 1 -- start start 2023-11-28T12:07:08.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:08.811+0000 7fba315ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fba2c0b0d80 0x7fba2c15add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:08.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:08.811+0000 7fba315ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba2c15e1a0 con 0x7fba2c070c50 2023-11-28T12:07:08.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:08.811+0000 7fba315ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba2c0cb180 con 0x7fba2c158200 2023-11-28T12:07:08.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:08.811+0000 7fba315ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba2c15f070 con 0x7fba2c0b0d80 2023-11-28T12:07:08.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:08.811+0000 7fba2a7fc700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fba2c070c50 0x7fba2c0b0670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33670/0 (socket says 172.21.15.45:33670) 2023-11-28T12:07:08.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:08.811+0000 7fba2a7fc700 1 -- 172.21.15.45:0/3164485773 learned_addr learned my addr 172.21.15.45:0/3164485773 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:07:08.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:08.812+0000 7fba2b7fe700 1 --2- 172.21.15.45:0/3164485773 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fba2c0b0d80 0x7fba2c15add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:08.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:08.812+0000 7fba29ffb700 1 -- 172.21.15.45:0/3164485773 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 950239185 0 0) 0x7fba2c15e1a0 con 0x7fba2c070c50 2023-11-28T12:07:08.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:08.812+0000 7fba29ffb700 1 -- 172.21.15.45:0/3164485773 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba140035b0 con 0x7fba2c070c50 2023-11-28T12:07:08.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:08.812+0000 7fba29ffb700 1 -- 172.21.15.45:0/3164485773 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3423365476 0 0) 0x7fba140035b0 con 0x7fba2c070c50 2023-11-28T12:07:08.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:08.812+0000 7fba29ffb700 1 -- 172.21.15.45:0/3164485773 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fba2c0b0d80 msgr2=0x7fba2c15add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:08.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:08.812+0000 7fba29ffb700 1 --2- 172.21.15.45:0/3164485773 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fba2c0b0d80 0x7fba2c15add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:08.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:08.812+0000 7fba29ffb700 1 -- 172.21.15.45:0/3164485773 >> v1:172.21.15.152:6789/0 conn(0x7fba2c158200 legacy=0x7fba2c0caa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:08.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:08.812+0000 7fba29ffb700 1 -- 172.21.15.45:0/3164485773 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba2c0710f0 con 0x7fba2c070c50 2023-11-28T12:07:08.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:08.812+0000 7fba29ffb700 1 -- 172.21.15.45:0/3164485773 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3460218165 0 0) 0x7fba20001670 con 0x7fba2c070c50 2023-11-28T12:07:08.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:08.812+0000 7fba29ffb700 1 -- 172.21.15.45:0/3164485773 >> v1:172.21.15.45:6789/0 conn(0x7fba2c070c50 legacy=0x7fba2c0b0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:08.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:08.812+0000 7fba29ffb700 1 --2- 172.21.15.45:0/3164485773 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fba14003a30 0x7fba14003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:08.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:08.812+0000 7fba29ffb700 1 --2- 172.21.15.45:0/3164485773 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba14004850 0x7fba14004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:08.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:08.812+0000 7fba29ffb700 1 --2- 172.21.15.45:0/3164485773 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fba2c0b0d80 0x7fba14005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:08.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:08.812+0000 7fba29ffb700 1 -- 172.21.15.45:0/3164485773 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba2c15f070 con 0x7fba14004850 2023-11-28T12:07:08.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:08.812+0000 7fba29ffb700 1 -- 172.21.15.45:0/3164485773 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba1400bac0 con 0x7fba14003a30 2023-11-28T12:07:08.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:08.812+0000 7fba29ffb700 1 -- 172.21.15.45:0/3164485773 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba1400bc80 con 0x7fba2c0b0d80 2023-11-28T12:07:08.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:08.813+0000 7fba2a7fc700 1 --2- 172.21.15.45:0/3164485773 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba14004850 0x7fba14004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:08.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:08.813+0000 7fba2affd700 1 --2- 172.21.15.45:0/3164485773 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fba14003a30 0x7fba14003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:08.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:08.813+0000 7fba2b7fe700 1 --2- 172.21.15.45:0/3164485773 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fba2c0b0d80 0x7fba14005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:08.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:08.813+0000 7fba2a7fc700 1 -- 172.21.15.45:0/3164485773 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fba2c0b0d80 msgr2=0x7fba14005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:08.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:08.813+0000 7fba2a7fc700 1 --2- 172.21.15.45:0/3164485773 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fba2c0b0d80 0x7fba14005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:08.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:08.813+0000 7fba2a7fc700 1 -- 172.21.15.45:0/3164485773 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fba14003a30 msgr2=0x7fba14003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:08.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:08.813+0000 7fba2a7fc700 1 --2- 172.21.15.45:0/3164485773 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fba14003a30 0x7fba14003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:08.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:08.813+0000 7fba2a7fc700 1 -- 172.21.15.45:0/3164485773 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba140035b0 con 0x7fba14004850 2023-11-28T12:07:08.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:08.813+0000 7fba2a7fc700 1 --2- 172.21.15.45:0/3164485773 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba14004850 0x7fba14004cc0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fba2000c240 tx=0x7fba14005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eff9939b94b105bd server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:08.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:08.813+0000 7fba29ffb700 1 -- 172.21.15.45:0/3164485773 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba20007c10 con 0x7fba14004850 2023-11-28T12:07:08.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:08.813+0000 7fba29ffb700 1 -- 172.21.15.45:0/3164485773 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba2000cde0 con 0x7fba14004850 2023-11-28T12:07:08.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:08.813+0000 7fba29ffb700 1 -- 172.21.15.45:0/3164485773 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba20005ba0 con 0x7fba14004850 2023-11-28T12:07:08.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:08.814+0000 7fba315ff700 1 -- 172.21.15.45:0/3164485773 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba14004850 msgr2=0x7fba14004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:08.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:08.814+0000 7fba315ff700 1 --2- 172.21.15.45:0/3164485773 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba14004850 0x7fba14004cc0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fba2000c240 tx=0x7fba14005880 comp rx=0 tx=0).stop 2023-11-28T12:07:08.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:08.814+0000 7fba2b7fe700 1 -- 172.21.15.45:0/3164485773 reap_dead start 2023-11-28T12:07:08.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:08.814+0000 7fba315ff700 1 -- 172.21.15.45:0/3164485773 shutdown_connections 2023-11-28T12:07:08.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:08.814+0000 7fba315ff700 1 -- 172.21.15.45:0/3164485773 >> 172.21.15.45:0/3164485773 conn(0x7fba2c0cb670 msgr2=0x7fba2c0cba70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:08.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:08.814+0000 7fba315ff700 1 -- 172.21.15.45:0/3164485773 shutdown_connections 2023-11-28T12:07:08.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:08.814+0000 7fba315ff700 1 -- 172.21.15.45:0/3164485773 wait complete. 2023-11-28T12:07:08.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:08.816+0000 7fba315ff700 1 Processor -- start 2023-11-28T12:07:08.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:08.816+0000 7fba315ff700 1 -- start start 2023-11-28T12:07:08.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:08.817+0000 7fba315ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba14004850 0x7fba2c1e5660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:08.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:08.817+0000 7fba315ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fba2c152970 0x7fba2c0c4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:08.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:08.817+0000 7fba315ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fba2c0c2d90 0x7fba2c0c3230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:08.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:08.817+0000 7fba315ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba2c1e6200 con 0x7fba14004850 2023-11-28T12:07:08.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:08.817+0000 7fba315ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba2c1e44f0 con 0x7fba2c0c2d90 2023-11-28T12:07:08.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:08.817+0000 7fba315ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba2c1e5c40 con 0x7fba2c152970 2023-11-28T12:07:08.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:08.817+0000 7fba2affd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba14004850 0x7fba2c1e5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:08.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:08.817+0000 7fba2affd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba14004850 0x7fba2c1e5660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37904/0 (socket says 172.21.15.45:37904) 2023-11-28T12:07:08.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:08.817+0000 7fba2affd700 1 -- 172.21.15.45:0/95393804 learned_addr learned my addr 172.21.15.45:0/95393804 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:08.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:08.817+0000 7fba2a7fc700 1 --2- 172.21.15.45:0/95393804 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fba2c152970 0x7fba2c0c4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:08.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:08.817+0000 7fba2b7fe700 1 --2- 172.21.15.45:0/95393804 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fba2c0c2d90 0x7fba2c0c3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:08.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:08.818+0000 7fba2affd700 1 -- 172.21.15.45:0/95393804 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fba2c152970 msgr2=0x7fba2c0c4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:08.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:08.818+0000 7fba2affd700 1 --2- 172.21.15.45:0/95393804 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fba2c152970 0x7fba2c0c4de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:08.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:08.818+0000 7fba2affd700 1 -- 172.21.15.45:0/95393804 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fba2c0c2d90 msgr2=0x7fba2c0c3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:08.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:08.818+0000 7fba2affd700 1 --2- 172.21.15.45:0/95393804 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fba2c0c2d90 0x7fba2c0c3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:08.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:08.818+0000 7fba2affd700 1 -- 172.21.15.45:0/95393804 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba2c15e3f0 con 0x7fba14004850 2023-11-28T12:07:08.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:08.818+0000 7fba2affd700 1 --2- 172.21.15.45:0/95393804 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba14004850 0x7fba2c1e5660 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fba1c00f7f0 tx=0x7fba1c00fb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:08.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:08.818+0000 7fba137fe700 1 -- 172.21.15.45:0/95393804 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba1c0052e0 con 0x7fba14004850 2023-11-28T12:07:08.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:08.818+0000 7fba137fe700 1 -- 172.21.15.45:0/95393804 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba1c005440 con 0x7fba14004850 2023-11-28T12:07:08.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:08.818+0000 7fba315ff700 1 -- 172.21.15.45:0/95393804 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba2c1585d0 con 0x7fba14004850 2023-11-28T12:07:08.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:08.818+0000 7fba137fe700 1 -- 172.21.15.45:0/95393804 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba1c0038a0 con 0x7fba14004850 2023-11-28T12:07:08.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:08.818+0000 7fba315ff700 1 -- 172.21.15.45:0/95393804 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba2c15e6d0 con 0x7fba14004850 2023-11-28T12:07:08.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:08.819+0000 7fba315ff700 1 -- 172.21.15.45:0/95393804 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba2c06fd60 con 0x7fba14004850 2023-11-28T12:07:08.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:08.820+0000 7fba137fe700 1 -- 172.21.15.45:0/95393804 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fba1c003a00 con 0x7fba14004850 2023-11-28T12:07:08.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:08.821+0000 7fba137fe700 1 --2- 172.21.15.45:0/95393804 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fba180682f0 0x7fba1806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:08.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:08.821+0000 7fba137fe700 1 -- 172.21.15.45:0/95393804 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fba1c085b40 con 0x7fba14004850 2023-11-28T12:07:08.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:08.821+0000 7fba2a7fc700 1 --2- 172.21.15.45:0/95393804 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fba180682f0 0x7fba1806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:08.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:08.822+0000 7fba2a7fc700 1 --2- 172.21.15.45:0/95393804 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fba180682f0 0x7fba1806a7a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fba2c0b0730 tx=0x7fba20007000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:08.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:08.825+0000 7fba137fe700 1 -- 172.21.15.45:0/95393804 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fba1c0522b0 con 0x7fba14004850 2023-11-28T12:07:09.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:09.114+0000 7fba315ff700 1 -- 172.21.15.45:0/95393804 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]} v 0) v1 -- 0x7fba2c0745c0 con 0x7fba14004850 2023-11-28T12:07:10.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:09.999+0000 7fba137fe700 1 -- 172.21.15.45:0/95393804 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]}]=0 v51) v1 ==== 145+0+0 (secure 0 0 0) 0x7fba1c0558d0 con 0x7fba14004850 2023-11-28T12:07:10.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:10.002+0000 7fba315ff700 1 -- 172.21.15.45:0/95393804 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fba180682f0 msgr2=0x7fba1806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:10.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:10.002+0000 7fba315ff700 1 --2- 172.21.15.45:0/95393804 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fba180682f0 0x7fba1806a7a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fba2c0b0730 tx=0x7fba20007000 comp rx=0 tx=0).stop 2023-11-28T12:07:10.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:10.002+0000 7fba315ff700 1 -- 172.21.15.45:0/95393804 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba14004850 msgr2=0x7fba2c1e5660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:10.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:10.002+0000 7fba315ff700 1 --2- 172.21.15.45:0/95393804 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba14004850 0x7fba2c1e5660 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fba1c00f7f0 tx=0x7fba1c00fb00 comp rx=0 tx=0).stop 2023-11-28T12:07:10.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:10.003+0000 7fba315ff700 1 -- 172.21.15.45:0/95393804 shutdown_connections 2023-11-28T12:07:10.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:10.003+0000 7fba315ff700 1 --2- 172.21.15.45:0/95393804 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fba180682f0 0x7fba1806a7a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:10.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:10.003+0000 7fba315ff700 1 --2- 172.21.15.45:0/95393804 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fba2c0c2d90 0x7fba2c0c3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:10.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:10.003+0000 7fba315ff700 1 --2- 172.21.15.45:0/95393804 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba14004850 0x7fba2c1e5660 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:10.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:10.003+0000 7fba315ff700 1 --2- 172.21.15.45:0/95393804 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fba2c152970 0x7fba2c0c4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:10.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:10.003+0000 7fba315ff700 1 -- 172.21.15.45:0/95393804 >> 172.21.15.45:0/95393804 conn(0x7fba2c0cb670 msgr2=0x7fba2c06c690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:10.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:10.003+0000 7fba315ff700 1 -- 172.21.15.45:0/95393804 shutdown_connections 2023-11-28T12:07:10.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:10.003+0000 7fba315ff700 1 -- 172.21.15.45:0/95393804 wait complete. 2023-11-28T12:07:10.026 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-28T12:07:10.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:10.235+0000 7f6c29fff700 1 Processor -- start 2023-11-28T12:07:10.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:10.236+0000 7f6c29fff700 1 -- start start 2023-11-28T12:07:10.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:10.237+0000 7f6c29fff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f6c240cd7c0 0x7f6c240cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:10.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:10.237+0000 7f6c29fff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c240d1950 con 0x7f6c2415c9b0 2023-11-28T12:07:10.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:10.237+0000 7f6c29fff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c240ce140 con 0x7f6c24161340 2023-11-28T12:07:10.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:10.237+0000 7f6c29fff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c240b5800 con 0x7f6c240cd7c0 2023-11-28T12:07:10.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:10.237+0000 7f6c237fe700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f6c2415c9b0 0x7f6c240b4bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33686/0 (socket says 172.21.15.45:33686) 2023-11-28T12:07:10.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:10.237+0000 7f6c237fe700 1 -- 172.21.15.45:0/2240825612 learned_addr learned my addr 172.21.15.45:0/2240825612 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:07:10.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:10.237+0000 7f6c23fff700 1 --2- 172.21.15.45:0/2240825612 >> v2:172.21.15.152:3300/0 conn(0x7f6c240cd7c0 0x7f6c240cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:10.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:10.237+0000 7f6c227fc700 1 -- 172.21.15.45:0/2240825612 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2611137238 0 0) 0x7f6c240d1950 con 0x7f6c2415c9b0 2023-11-28T12:07:10.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:10.238+0000 7f6c227fc700 1 -- 172.21.15.45:0/2240825612 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c0c0035b0 con 0x7f6c2415c9b0 2023-11-28T12:07:10.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:10.238+0000 7f6c23fff700 1 -- 172.21.15.45:0/2240825612 >> v1:172.21.15.152:6789/0 conn(0x7f6c24161340 legacy=0x7f6c240d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:10.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:10.238+0000 7f6c23fff700 1 -- 172.21.15.45:0/2240825612 >> v1:172.21.15.45:6789/0 conn(0x7f6c2415c9b0 legacy=0x7f6c240b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:10.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:10.238+0000 7f6c23fff700 1 -- 172.21.15.45:0/2240825612 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c240d24f0 con 0x7f6c240cd7c0 2023-11-28T12:07:10.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:10.238+0000 7f6c23fff700 1 --2- 172.21.15.45:0/2240825612 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c240cd7c0 0x7f6c240cdc00 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c009d90 tx=0x7f6c1c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11f7436738f7c680 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:10.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:10.238+0000 7f6c227fc700 1 -- 172.21.15.45:0/2240825612 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c1c00e070 con 0x7f6c240cd7c0 2023-11-28T12:07:10.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:10.238+0000 7f6c227fc700 1 -- 172.21.15.45:0/2240825612 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c1c00bb20 con 0x7f6c240cd7c0 2023-11-28T12:07:10.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:10.238+0000 7f6c227fc700 1 -- 172.21.15.45:0/2240825612 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c1c012430 con 0x7f6c240cd7c0 2023-11-28T12:07:10.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:10.239+0000 7f6c29fff700 1 -- 172.21.15.45:0/2240825612 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c240cd7c0 msgr2=0x7f6c240cdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:10.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:10.239+0000 7f6c29fff700 1 --2- 172.21.15.45:0/2240825612 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c240cd7c0 0x7f6c240cdc00 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c009d90 tx=0x7f6c1c00b330 comp rx=0 tx=0).stop 2023-11-28T12:07:10.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:10.239+0000 7f6c29fff700 1 -- 172.21.15.45:0/2240825612 shutdown_connections 2023-11-28T12:07:10.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:10.239+0000 7f6c29fff700 1 --2- 172.21.15.45:0/2240825612 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c240cd7c0 0x7f6c240cdc00 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:10.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:10.239+0000 7f6c29fff700 1 -- 172.21.15.45:0/2240825612 >> 172.21.15.45:0/2240825612 conn(0x7f6c24072600 msgr2=0x7f6c240cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:10.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:10.239+0000 7f6c29fff700 1 -- 172.21.15.45:0/2240825612 shutdown_connections 2023-11-28T12:07:10.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:10.239+0000 7f6c29fff700 1 -- 172.21.15.45:0/2240825612 wait complete. 2023-11-28T12:07:10.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:10.241+0000 7f6c29fff700 1 Processor -- start 2023-11-28T12:07:10.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:10.241+0000 7f6c29fff700 1 -- start start 2023-11-28T12:07:10.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:10.242+0000 7f6c29fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c240cd7c0 0x7f6c24156860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:10.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:10.242+0000 7f6c29fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c2415c9b0 0x7f6c240b8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:10.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:10.242+0000 7f6c29fff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6c24161340 0x7f6c240b8890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:10.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:10.242+0000 7f6c29fff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c240c75b0 con 0x7f6c2415c9b0 2023-11-28T12:07:10.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:10.242+0000 7f6c29fff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c240c7890 con 0x7f6c240cd7c0 2023-11-28T12:07:10.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:10.242+0000 7f6c29fff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c240c7b70 con 0x7f6c24161340 2023-11-28T12:07:10.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:10.242+0000 7f6c22ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c2415c9b0 0x7f6c240b8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:10.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:10.242+0000 7f6c22ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c2415c9b0 0x7f6c240b8350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37920/0 (socket says 172.21.15.45:37920) 2023-11-28T12:07:10.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:10.242+0000 7f6c22ffd700 1 -- 172.21.15.45:0/2939759238 learned_addr learned my addr 172.21.15.45:0/2939759238 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:10.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:10.242+0000 7f6c237fe700 1 --2- 172.21.15.45:0/2939759238 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c240cd7c0 0x7f6c24156860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:10.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:10.242+0000 7f6c23fff700 1 --2- 172.21.15.45:0/2939759238 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6c24161340 0x7f6c240b8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:10.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:10.243+0000 7f6c22ffd700 1 -- 172.21.15.45:0/2939759238 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6c24161340 msgr2=0x7f6c240b8890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:10.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:10.243+0000 7f6c22ffd700 1 --2- 172.21.15.45:0/2939759238 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6c24161340 0x7f6c240b8890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:10.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:10.243+0000 7f6c22ffd700 1 -- 172.21.15.45:0/2939759238 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c240cd7c0 msgr2=0x7f6c24156860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:10.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:10.243+0000 7f6c22ffd700 1 --2- 172.21.15.45:0/2939759238 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c240cd7c0 0x7f6c24156860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:10.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:10.243+0000 7f6c22ffd700 1 -- 172.21.15.45:0/2939759238 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c1c009a70 con 0x7f6c2415c9b0 2023-11-28T12:07:10.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:10.243+0000 7f6c22ffd700 1 --2- 172.21.15.45:0/2939759238 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c2415c9b0 0x7f6c240b8350 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6c1800c4e0 tx=0x7f6c1800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:10.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:10.243+0000 7f6c0bfff700 1 -- 172.21.15.45:0/2939759238 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c180052d0 con 0x7f6c2415c9b0 2023-11-28T12:07:10.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:10.243+0000 7f6c0bfff700 1 -- 172.21.15.45:0/2939759238 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c18005430 con 0x7f6c2415c9b0 2023-11-28T12:07:10.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:10.243+0000 7f6c0bfff700 1 -- 172.21.15.45:0/2939759238 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c180038c0 con 0x7f6c2415c9b0 2023-11-28T12:07:10.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:10.243+0000 7f6c29fff700 1 -- 172.21.15.45:0/2939759238 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c240d1300 con 0x7f6c2415c9b0 2023-11-28T12:07:10.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:10.243+0000 7f6c29fff700 1 -- 172.21.15.45:0/2939759238 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c240b5520 con 0x7f6c2415c9b0 2023-11-28T12:07:10.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:10.244+0000 7f6c29fff700 1 -- 172.21.15.45:0/2939759238 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c240d15e0 con 0x7f6c2415c9b0 2023-11-28T12:07:10.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:10.245+0000 7f6c0bfff700 1 -- 172.21.15.45:0/2939759238 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f6c18019030 con 0x7f6c2415c9b0 2023-11-28T12:07:10.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:10.246+0000 7f6c0bfff700 1 --2- 172.21.15.45:0/2939759238 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f6c100682f0 0x7f6c1006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:10.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:10.246+0000 7f6c0bfff700 1 -- 172.21.15.45:0/2939759238 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6c18084fe0 con 0x7f6c2415c9b0 2023-11-28T12:07:10.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:10.247+0000 7f6c237fe700 1 --2- 172.21.15.45:0/2939759238 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f6c100682f0 0x7f6c1006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:10.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:10.247+0000 7f6c237fe700 1 --2- 172.21.15.45:0/2939759238 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f6c100682f0 0x7f6c1006a7a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6c14007fd0 tx=0x7f6c14007dc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:10.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:10.251+0000 7f6c0bfff700 1 -- 172.21.15.45:0/2939759238 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f6c18051750 con 0x7f6c2415c9b0 2023-11-28T12:07:10.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:10.455+0000 7f6c29fff700 1 -- 172.21.15.45:0/2939759238 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f6c240cb840 con 0x7f6c2415c9b0 2023-11-28T12:07:10.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:10.459+0000 7f6c0bfff700 1 -- 172.21.15.45:0/2939759238 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6c240cb840 con 0x7f6c2415c9b0 2023-11-28T12:07:10.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:10.461+0000 7f6c29fff700 1 -- 172.21.15.45:0/2939759238 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f6c100682f0 msgr2=0x7f6c1006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:10.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:10.461+0000 7f6c29fff700 1 --2- 172.21.15.45:0/2939759238 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f6c100682f0 0x7f6c1006a7a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6c14007fd0 tx=0x7f6c14007dc0 comp rx=0 tx=0).stop 2023-11-28T12:07:10.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:10.461+0000 7f6c29fff700 1 -- 172.21.15.45:0/2939759238 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c2415c9b0 msgr2=0x7f6c240b8350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:10.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:10.461+0000 7f6c29fff700 1 --2- 172.21.15.45:0/2939759238 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c2415c9b0 0x7f6c240b8350 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6c1800c4e0 tx=0x7f6c1800c7f0 comp rx=0 tx=0).stop 2023-11-28T12:07:10.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:10.461+0000 7f6c29fff700 1 -- 172.21.15.45:0/2939759238 shutdown_connections 2023-11-28T12:07:10.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:10.461+0000 7f6c29fff700 1 --2- 172.21.15.45:0/2939759238 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f6c100682f0 0x7f6c1006a7a0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:10.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:10.461+0000 7f6c29fff700 1 --2- 172.21.15.45:0/2939759238 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6c240cd7c0 0x7f6c24156860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:10.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:10.461+0000 7f6c29fff700 1 --2- 172.21.15.45:0/2939759238 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6c24161340 0x7f6c240b8890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:10.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:10.461+0000 7f6c29fff700 1 --2- 172.21.15.45:0/2939759238 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c2415c9b0 0x7f6c240b8350 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:10.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:10.461+0000 7f6c29fff700 1 -- 172.21.15.45:0/2939759238 >> 172.21.15.45:0/2939759238 conn(0x7f6c24072600 msgr2=0x7f6c24160610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:10.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:10.461+0000 7f6c29fff700 1 -- 172.21.15.45:0/2939759238 shutdown_connections 2023-11-28T12:07:10.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:10.461+0000 7f6c29fff700 1 -- 172.21.15.45:0/2939759238 wait complete. 2023-11-28T12:07:10.481 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-28T12:07:10.481 DEBUG:teuthology.orchestra.run.smithi045:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T12:07:10.572 DEBUG:teuthology.orchestra.run.smithi152:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T12:07:10.689 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-28T12:07:10.690 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T12:07:10.690 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T12:07:10.737 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T12:07:10.737 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T12:07:10.824 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T12:07:10.824 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T12:07:10.911 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T12:07:11.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.154+0000 7fa93b1ff700 1 Processor -- start 2023-11-28T12:07:11.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.154+0000 7fa93b1ff700 1 -- start start 2023-11-28T12:07:11.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.155+0000 7fa93b1ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fa93415c9b0 0x7fa9340b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:11.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.155+0000 7fa93b1ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa934161340 0x7fa9340d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:11.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.155+0000 7fa93b1ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa9340d2320 0x7fa9340cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:11.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.155+0000 7fa93b1ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9340b5800 con 0x7fa934161340 2023-11-28T12:07:11.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.155+0000 7fa93b1ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9340d1950 con 0x7fa93415c9b0 2023-11-28T12:07:11.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.155+0000 7fa93b1ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9340b5520 con 0x7fa9340d2320 2023-11-28T12:07:11.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.155+0000 7fa933fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa934161340 0x7fa9340d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:11.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.155+0000 7fa933fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa934161340 0x7fa9340d1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37924/0 (socket says 172.21.15.45:37924) 2023-11-28T12:07:11.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.155+0000 7fa933fff700 1 -- 172.21.15.45:0/3454089157 learned_addr learned my addr 172.21.15.45:0/3454089157 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:11.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.156+0000 7fa938f9b700 1 --2- 172.21.15.45:0/3454089157 >> v2:172.21.15.152:3300/0 conn(0x7fa93415c9b0 0x7fa9340b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:11.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.156+0000 7fa93979c700 1 --2- 172.21.15.45:0/3454089157 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa9340d2320 0x7fa9340cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:11.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.156+0000 7fa933fff700 1 -- 172.21.15.45:0/3454089157 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa9340d2320 msgr2=0x7fa9340cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:11.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.156+0000 7fa933fff700 1 --2- 172.21.15.45:0/3454089157 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa9340d2320 0x7fa9340cd7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:11.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.156+0000 7fa933fff700 1 -- 172.21.15.45:0/3454089157 >> v2:172.21.15.152:3300/0 conn(0x7fa93415c9b0 msgr2=0x7fa9340b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:11.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.156+0000 7fa933fff700 1 --2- 172.21.15.45:0/3454089157 >> v2:172.21.15.152:3300/0 conn(0x7fa93415c9b0 0x7fa9340b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:11.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.156+0000 7fa933fff700 1 -- 172.21.15.45:0/3454089157 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9340d1300 con 0x7fa934161340 2023-11-28T12:07:11.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.156+0000 7fa933fff700 1 --2- 172.21.15.45:0/3454089157 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa934161340 0x7fa9340d1de0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa934067460 tx=0x7fa920009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46a4192d64529d10 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:11.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.156+0000 7fa9337fe700 1 -- 172.21.15.45:0/3454089157 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa92000b870 con 0x7fa934161340 2023-11-28T12:07:11.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.156+0000 7fa9337fe700 1 -- 172.21.15.45:0/3454089157 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa92000b9d0 con 0x7fa934161340 2023-11-28T12:07:11.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.156+0000 7fa9337fe700 1 -- 172.21.15.45:0/3454089157 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa92000bd60 con 0x7fa934161340 2023-11-28T12:07:11.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.157+0000 7fa93b1ff700 1 -- 172.21.15.45:0/3454089157 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa934161340 msgr2=0x7fa9340d1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:11.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.157+0000 7fa93b1ff700 1 --2- 172.21.15.45:0/3454089157 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa934161340 0x7fa9340d1de0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa934067460 tx=0x7fa920009bd0 comp rx=0 tx=0).stop 2023-11-28T12:07:11.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.157+0000 7fa93b1ff700 1 -- 172.21.15.45:0/3454089157 shutdown_connections 2023-11-28T12:07:11.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.157+0000 7fa93b1ff700 1 --2- 172.21.15.45:0/3454089157 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa9340d2320 0x7fa9340cd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:11.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.157+0000 7fa93b1ff700 1 --2- 172.21.15.45:0/3454089157 >> v2:172.21.15.152:3300/0 conn(0x7fa93415c9b0 0x7fa9340b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:11.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.157+0000 7fa93b1ff700 1 --2- 172.21.15.45:0/3454089157 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa934161340 0x7fa9340d1de0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:11.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.157+0000 7fa93b1ff700 1 -- 172.21.15.45:0/3454089157 >> 172.21.15.45:0/3454089157 conn(0x7fa934072600 msgr2=0x7fa9340cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:11.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.157+0000 7fa93b1ff700 1 -- 172.21.15.45:0/3454089157 shutdown_connections 2023-11-28T12:07:11.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.157+0000 7fa93b1ff700 1 -- 172.21.15.45:0/3454089157 wait complete. 2023-11-28T12:07:11.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.159+0000 7fa93b1ff700 1 Processor -- start 2023-11-28T12:07:11.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.159+0000 7fa93b1ff700 1 -- start start 2023-11-28T12:07:11.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.160+0000 7fa93b1ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9340d2320 0x7fa9341f61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:11.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.160+0000 7fa93b1ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa93415c9b0 0x7fa9341f19b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:11.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.160+0000 7fa93b1ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa934161340 0x7fa93415ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:11.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.160+0000 7fa93b1ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9341437d0 con 0x7fa9340d2320 2023-11-28T12:07:11.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.160+0000 7fa93b1ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9341f6720 con 0x7fa934161340 2023-11-28T12:07:11.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.160+0000 7fa93b1ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa934151990 con 0x7fa93415c9b0 2023-11-28T12:07:11.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.160+0000 7fa938f9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9340d2320 0x7fa9341f61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:11.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.160+0000 7fa938f9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9340d2320 0x7fa9341f61e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37930/0 (socket says 172.21.15.45:37930) 2023-11-28T12:07:11.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.160+0000 7fa938f9b700 1 -- 172.21.15.45:0/591998012 learned_addr learned my addr 172.21.15.45:0/591998012 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:11.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.161+0000 7fa933fff700 1 --2- 172.21.15.45:0/591998012 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa93415c9b0 0x7fa9341f19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:11.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.161+0000 7fa93979c700 1 --2- 172.21.15.45:0/591998012 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa934161340 0x7fa93415ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:11.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.161+0000 7fa938f9b700 1 -- 172.21.15.45:0/591998012 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa93415c9b0 msgr2=0x7fa9341f19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:11.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.161+0000 7fa938f9b700 1 --2- 172.21.15.45:0/591998012 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa93415c9b0 0x7fa9341f19b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:11.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.161+0000 7fa938f9b700 1 -- 172.21.15.45:0/591998012 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa934161340 msgr2=0x7fa93415ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:11.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.161+0000 7fa938f9b700 1 --2- 172.21.15.45:0/591998012 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa934161340 0x7fa93415ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:11.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.161+0000 7fa938f9b700 1 -- 172.21.15.45:0/591998012 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa920009550 con 0x7fa9340d2320 2023-11-28T12:07:11.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.161+0000 7fa93979c700 1 --2- 172.21.15.45:0/591998012 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa934161340 0x7fa93415ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:07:11.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.161+0000 7fa938f9b700 1 --2- 172.21.15.45:0/591998012 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9340d2320 0x7fa9341f61e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa92800e810 tx=0x7fa92800eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:11.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.161+0000 7fa9317fa700 1 -- 172.21.15.45:0/591998012 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa928013610 con 0x7fa9340d2320 2023-11-28T12:07:11.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.161+0000 7fa9317fa700 1 -- 172.21.15.45:0/591998012 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa928013770 con 0x7fa9340d2320 2023-11-28T12:07:11.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.161+0000 7fa93b1ff700 1 -- 172.21.15.45:0/591998012 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9340b5130 con 0x7fa9340d2320 2023-11-28T12:07:11.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.161+0000 7fa9317fa700 1 -- 172.21.15.45:0/591998012 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa928013b20 con 0x7fa9340d2320 2023-11-28T12:07:11.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.162+0000 7fa93b1ff700 1 -- 172.21.15.45:0/591998012 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9340d15e0 con 0x7fa9340d2320 2023-11-28T12:07:11.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.163+0000 7fa93b1ff700 1 -- 172.21.15.45:0/591998012 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9340b52c0 con 0x7fa9340d2320 2023-11-28T12:07:11.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.163+0000 7fa9317fa700 1 -- 172.21.15.45:0/591998012 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fa928023070 con 0x7fa9340d2320 2023-11-28T12:07:11.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.165+0000 7fa9317fa700 1 --2- 172.21.15.45:0/591998012 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fa9180682f0 0x7fa91806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:11.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.165+0000 7fa9317fa700 1 -- 172.21.15.45:0/591998012 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa9280859c0 con 0x7fa9340d2320 2023-11-28T12:07:11.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.165+0000 7fa933fff700 1 --2- 172.21.15.45:0/591998012 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fa9180682f0 0x7fa91806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:11.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.166+0000 7fa933fff700 1 --2- 172.21.15.45:0/591998012 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fa9180682f0 0x7fa91806a7a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa920000c00 tx=0x7fa920008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:11.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.168+0000 7fa9317fa700 1 -- 172.21.15.45:0/591998012 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fa9280520b0 con 0x7fa9340d2320 2023-11-28T12:07:11.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.373+0000 7fa93b1ff700 1 -- 172.21.15.45:0/591998012 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa9340745c0 con 0x7fa9340d2320 2023-11-28T12:07:11.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.374+0000 7fa9317fa700 1 -- 172.21.15.45:0/591998012 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+17849 (secure 0 0 0) 0x7fa9280556d0 con 0x7fa9340d2320 2023-11-28T12:07:11.376 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:07:11.376 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":20,"fsid":"bd7c37f1-f7c6-4778-b845-52cf2aa6e366","created":"2023-11-28T12:06:09.045075+0000","modified":"2023-11-28T12:06:30.396046+0000","last_up_change":"2023-11-28T12:06:21.282227+0000","last_in_change":"2023-11-28T12:06:12.560924+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T12:06:21.807108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T12:06:22.491009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T12:06:27.684157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T12:06:28.384679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d0cdd8a-87fd-4f2c-91bd-47bdfa661905","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":115843},{"type":"v1","addr":"172.21.15.45:6808","nonce":115843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":115843},{"type":"v1","addr":"172.21.15.45:6811","nonce":115843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":115843},{"type":"v1","addr":"172.21.15.45:6815","nonce":115843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":115843},{"type":"v1","addr":"172.21.15.45:6813","nonce":115843}]},"public_addr":"172.21.15.45:6808/115843","cluster_addr":"172.21.15.45:6811/115843","heartbeat_back_addr":"172.21.15.45:6815/115843","heartbeat_front_addr":"172.21.15.45:6813/115843","state":["exists","up"]},{"osd":1,"uuid":"c5de4ebd-9ec5-40b3-9caa-9b706fab4c76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":115842},{"type":"v1","addr":"172.21.15.45:6801","nonce":115842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":115842},{"type":"v1","addr":"172.21.15.45:6803","nonce":115842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6807","nonce":115842},{"type":"v1","addr":"172.21.15.45:6809","nonce":115842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":115842},{"type":"v1","addr":"172.21.15.45:6805","nonce":115842}]},"public_addr":"172.21.15.45:6801/115842","cluster_addr":"172.21.15.45:6803/115842","heartbeat_back_addr":"172.21.15.45:6809/115842","heartbeat_front_addr":"172.21.15.45:6805/115842","state":["exists","up"]},{"osd":2,"uuid":"9f4b36b2-65d2-40e7-9fe6-a2991afa71c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":115850},{"type":"v1","addr":"172.21.15.45:6819","nonce":115850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":115850},{"type":"v1","addr":"172.21.15.45:6823","nonce":115850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":115850},{"type":"v1","addr":"172.21.15.45:6831","nonce":115850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":115850},{"type":"v1","addr":"172.21.15.45:6828","nonce":115850}]},"public_addr":"172.21.15.45:6819/115850","cluster_addr":"172.21.15.45:6823/115850","heartbeat_back_addr":"172.21.15.45:6831/115850","heartbeat_front_addr":"172.21.15.45:6828/115850","state":["exists","up"]},{"osd":3,"uuid":"6fe7ef05-4e0d-426c-bf94-44b51d4d550b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":115848},{"type":"v1","addr":"172.21.15.45:6818","nonce":115848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":115848},{"type":"v1","addr":"172.21.15.45:6822","nonce":115848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6827","nonce":115848},{"type":"v1","addr":"172.21.15.45:6829","nonce":115848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":115848},{"type":"v1","addr":"172.21.15.45:6825","nonce":115848}]},"public_addr":"172.21.15.45:6818/115848","cluster_addr":"172.21.15.45:6822/115848","heartbeat_back_addr":"172.21.15.45:6829/115848","heartbeat_front_addr":"172.21.15.45:6825/115848","state":["exists","up"]},{"osd":4,"uuid":"fa403c08-d8a1-4a3a-8384-cb465c1a654c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":116092},{"type":"v1","addr":"172.21.15.152:6801","nonce":116092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":116092},{"type":"v1","addr":"172.21.15.152:6803","nonce":116092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":116092},{"type":"v1","addr":"172.21.15.152:6807","nonce":116092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":116092},{"type":"v1","addr":"172.21.15.152:6805","nonce":116092}]},"public_addr":"172.21.15.152:6801/116092","cluster_addr":"172.21.15.152:6803/116092","heartbeat_back_addr":"172.21.15.152:6807/116092","heartbeat_front_addr":"172.21.15.152:6805/116092","state":["exists","up"]},{"osd":5,"uuid":"399fc450-39fa-43a6-bf80-0b8bcb41bd95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6815","nonce":116093},{"type":"v1","addr":"172.21.15.152:6817","nonce":116093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":116093},{"type":"v1","addr":"172.21.15.152:6819","nonce":116093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":116093},{"type":"v1","addr":"172.21.15.152:6823","nonce":116093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":116093},{"type":"v1","addr":"172.21.15.152:6821","nonce":116093}]},"public_addr":"172.21.15.152:6817/116093","cluster_addr":"172.21.15.152:6819/116093","heartbeat_back_addr":"172.21.15.152:6823/116093","heartbeat_front_addr":"172.21.15.152:6821/116093","state":["exists","up"]},{"osd":6,"uuid":"e59a4017-2d23-4627-836b-e25b2d3ddaaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":116094},{"type":"v1","addr":"172.21.15.152:6809","nonce":116094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":116094},{"type":"v1","addr":"172.21.15.152:6811","nonce":116094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":116094},{"type":"v1","addr":"172.21.15.152:6816","nonce":116094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":116094},{"type":"v1","addr":"172.21.15.152:6813","nonce":116094}]},"public_addr":"172.21.15.152:6809/116094","cluster_addr":"172.21.15.152:6811/116094","heartbeat_back_addr":"172.21.15.152:6816/116094","heartbeat_front_addr":"172.21.15.152:6813/116094","state":["exists","up"]},{"osd":7,"uuid":"8d7f9d4b-bf08-4670-8591-388c0f012a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":116097},{"type":"v1","addr":"172.21.15.152:6825","nonce":116097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":116097},{"type":"v1","addr":"172.21.15.152:6827","nonce":116097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":116097},{"type":"v1","addr":"172.21.15.152:6831","nonce":116097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":116097},{"type":"v1","addr":"172.21.15.152:6829","nonce":116097}]},"public_addr":"172.21.15.152:6825/116097","cluster_addr":"172.21.15.152:6827/116097","heartbeat_back_addr":"172.21.15.152:6831/116097","heartbeat_front_addr":"172.21.15.152:6829/116097","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.937710+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.865423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.159434+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.913090+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.131647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.966255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.972583+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.177209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T12:07:11.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.377+0000 7fa93b1ff700 1 -- 172.21.15.45:0/591998012 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fa9180682f0 msgr2=0x7fa91806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:11.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.377+0000 7fa93b1ff700 1 --2- 172.21.15.45:0/591998012 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fa9180682f0 0x7fa91806a7a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa920000c00 tx=0x7fa920008030 comp rx=0 tx=0).stop 2023-11-28T12:07:11.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.377+0000 7fa93b1ff700 1 -- 172.21.15.45:0/591998012 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9340d2320 msgr2=0x7fa9341f61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:11.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.377+0000 7fa93b1ff700 1 --2- 172.21.15.45:0/591998012 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9340d2320 0x7fa9341f61e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa92800e810 tx=0x7fa92800eb20 comp rx=0 tx=0).stop 2023-11-28T12:07:11.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.377+0000 7fa93b1ff700 1 -- 172.21.15.45:0/591998012 shutdown_connections 2023-11-28T12:07:11.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.377+0000 7fa93b1ff700 1 --2- 172.21.15.45:0/591998012 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fa9180682f0 0x7fa91806a7a0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:11.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.377+0000 7fa93b1ff700 1 --2- 172.21.15.45:0/591998012 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa934161340 0x7fa93415ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:11.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.377+0000 7fa93b1ff700 1 --2- 172.21.15.45:0/591998012 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9340d2320 0x7fa9341f61e0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:11.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.377+0000 7fa93b1ff700 1 --2- 172.21.15.45:0/591998012 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa93415c9b0 0x7fa9341f19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:11.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.377+0000 7fa93b1ff700 1 -- 172.21.15.45:0/591998012 >> 172.21.15.45:0/591998012 conn(0x7fa934072600 msgr2=0x7fa93415d020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:11.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.377+0000 7fa93b1ff700 1 -- 172.21.15.45:0/591998012 shutdown_connections 2023-11-28T12:07:11.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.377+0000 7fa93b1ff700 1 -- 172.21.15.45:0/591998012 wait complete. 2023-11-28T12:07:11.396 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-28T12:06:21.807108+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-28T12:06:22.491009+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T12:06:27.684157+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T12:06:28.384679+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T12:07:11.397 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T12:07:11.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.602+0000 7f3be97ff700 1 Processor -- start 2023-11-28T12:07:11.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.603+0000 7f3be97ff700 1 -- start start 2023-11-28T12:07:11.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.604+0000 7f3be97ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3be415c9b0 0x7f3be40b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:11.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.604+0000 7f3be97ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3be40d1950 con 0x7f3be40cd7c0 2023-11-28T12:07:11.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.604+0000 7f3be97ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3be40d24f0 con 0x7f3be4161340 2023-11-28T12:07:11.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.604+0000 7f3be97ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3be40b5800 con 0x7f3be415c9b0 2023-11-28T12:07:11.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.604+0000 7f3be2ffd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3be415c9b0 0x7f3be40b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:11.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.604+0000 7f3be37fe700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f3be40cd7c0 0x7f3be40b5fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33696/0 (socket says 172.21.15.45:33696) 2023-11-28T12:07:11.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.604+0000 7f3be37fe700 1 -- 172.21.15.45:0/2120133652 learned_addr learned my addr 172.21.15.45:0/2120133652 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:07:11.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.605+0000 7f3be2ffd700 1 -- 172.21.15.45:0/2120133652 >> v1:172.21.15.152:6789/0 conn(0x7f3be4161340 legacy=0x7f3be40d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:11.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.605+0000 7f3be2ffd700 1 -- 172.21.15.45:0/2120133652 >> v1:172.21.15.45:6789/0 conn(0x7f3be40cd7c0 legacy=0x7f3be40b5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:11.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.605+0000 7f3be2ffd700 1 -- 172.21.15.45:0/2120133652 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3be40b5520 con 0x7f3be415c9b0 2023-11-28T12:07:11.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.605+0000 7f3be27fc700 1 -- 172.21.15.45:0/2120133652 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1622302703 0 0) 0x7f3be40d1950 con 0x7f3be40cd7c0 2023-11-28T12:07:11.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.605+0000 7f3be2ffd700 1 --2- 172.21.15.45:0/2120133652 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3be415c9b0 0x7f3be40b4bf0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3bd4009840 tx=0x7f3bd4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f762c27f0c17059a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:11.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.605+0000 7f3be27fc700 1 -- 172.21.15.45:0/2120133652 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd4011830 con 0x7f3be415c9b0 2023-11-28T12:07:11.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.605+0000 7f3be27fc700 1 -- 172.21.15.45:0/2120133652 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bd4011990 con 0x7f3be415c9b0 2023-11-28T12:07:11.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.605+0000 7f3be27fc700 1 -- 172.21.15.45:0/2120133652 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd4011d20 con 0x7f3be415c9b0 2023-11-28T12:07:11.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.606+0000 7f3be97ff700 1 -- 172.21.15.45:0/2120133652 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3be415c9b0 msgr2=0x7f3be40b4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:11.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.606+0000 7f3be97ff700 1 --2- 172.21.15.45:0/2120133652 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3be415c9b0 0x7f3be40b4bf0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3bd4009840 tx=0x7f3bd4009b50 comp rx=0 tx=0).stop 2023-11-28T12:07:11.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.606+0000 7f3be97ff700 1 -- 172.21.15.45:0/2120133652 shutdown_connections 2023-11-28T12:07:11.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.606+0000 7f3be97ff700 1 --2- 172.21.15.45:0/2120133652 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3be415c9b0 0x7f3be40b4bf0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:11.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.606+0000 7f3be97ff700 1 -- 172.21.15.45:0/2120133652 >> 172.21.15.45:0/2120133652 conn(0x7f3be4072600 msgr2=0x7f3be40cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:11.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.606+0000 7f3be97ff700 1 -- 172.21.15.45:0/2120133652 shutdown_connections 2023-11-28T12:07:11.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.606+0000 7f3be97ff700 1 -- 172.21.15.45:0/2120133652 wait complete. 2023-11-28T12:07:11.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.608+0000 7f3be97ff700 1 Processor -- start 2023-11-28T12:07:11.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.608+0000 7f3be97ff700 1 -- start start 2023-11-28T12:07:11.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.609+0000 7f3be97ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3be40cd7c0 0x7f3be414ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:11.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.609+0000 7f3be97ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3be415c9b0 0x7f3be41e83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:11.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.609+0000 7f3be97ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3be4161340 0x7f3be4156d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:11.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.609+0000 7f3be97ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3be40c8200 con 0x7f3be415c9b0 2023-11-28T12:07:11.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.609+0000 7f3be97ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3be40c9020 con 0x7f3be40cd7c0 2023-11-28T12:07:11.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.609+0000 7f3be97ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3be40c7160 con 0x7f3be4161340 2023-11-28T12:07:11.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.609+0000 7f3bdbfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3be415c9b0 0x7f3be41e83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:11.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.609+0000 7f3bdbfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3be415c9b0 0x7f3be41e83e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37958/0 (socket says 172.21.15.45:37958) 2023-11-28T12:07:11.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.609+0000 7f3bdbfff700 1 -- 172.21.15.45:0/3660991057 learned_addr learned my addr 172.21.15.45:0/3660991057 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:11.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.609+0000 7f3be2ffd700 1 --2- 172.21.15.45:0/3660991057 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3be40cd7c0 0x7f3be414ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:11.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.609+0000 7f3be37fe700 1 --2- 172.21.15.45:0/3660991057 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3be4161340 0x7f3be4156d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:11.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.609+0000 7f3bdbfff700 1 -- 172.21.15.45:0/3660991057 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3be4161340 msgr2=0x7f3be4156d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:11.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.609+0000 7f3bdbfff700 1 --2- 172.21.15.45:0/3660991057 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3be4161340 0x7f3be4156d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:11.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.609+0000 7f3bdbfff700 1 -- 172.21.15.45:0/3660991057 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3be40cd7c0 msgr2=0x7f3be414ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:11.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.609+0000 7f3bdbfff700 1 --2- 172.21.15.45:0/3660991057 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3be40cd7c0 0x7f3be414ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:11.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.609+0000 7f3bdbfff700 1 -- 172.21.15.45:0/3660991057 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bd40094a0 con 0x7f3be415c9b0 2023-11-28T12:07:11.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.610+0000 7f3bdbfff700 1 --2- 172.21.15.45:0/3660991057 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3be415c9b0 0x7f3be41e83e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc00c4e0 tx=0x7f3bcc00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:11.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.610+0000 7f3bdb7fe700 1 -- 172.21.15.45:0/3660991057 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bcc0052d0 con 0x7f3be415c9b0 2023-11-28T12:07:11.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.610+0000 7f3bdb7fe700 1 -- 172.21.15.45:0/3660991057 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bcc005430 con 0x7f3be415c9b0 2023-11-28T12:07:11.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.610+0000 7f3bdb7fe700 1 -- 172.21.15.45:0/3660991057 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bcc0038c0 con 0x7f3be415c9b0 2023-11-28T12:07:11.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.610+0000 7f3be97ff700 1 -- 172.21.15.45:0/3660991057 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3be40d15e0 con 0x7f3be415c9b0 2023-11-28T12:07:11.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.610+0000 7f3be97ff700 1 -- 172.21.15.45:0/3660991057 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3be40d1300 con 0x7f3be415c9b0 2023-11-28T12:07:11.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.611+0000 7f3be97ff700 1 -- 172.21.15.45:0/3660991057 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3be40b5130 con 0x7f3be415c9b0 2023-11-28T12:07:11.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.612+0000 7f3bdb7fe700 1 -- 172.21.15.45:0/3660991057 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f3bcc019030 con 0x7f3be415c9b0 2023-11-28T12:07:11.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.613+0000 7f3bdb7fe700 1 --2- 172.21.15.45:0/3660991057 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f3bc40682f0 0x7f3bc406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:11.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.613+0000 7f3bdb7fe700 1 -- 172.21.15.45:0/3660991057 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3bcc084fc0 con 0x7f3be415c9b0 2023-11-28T12:07:11.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.614+0000 7f3be2ffd700 1 --2- 172.21.15.45:0/3660991057 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f3bc40682f0 0x7f3bc406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:11.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.614+0000 7f3be2ffd700 1 --2- 172.21.15.45:0/3660991057 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f3bc40682f0 0x7f3bc406a7a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3bd40090b0 tx=0x7f3bd401c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:11.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.617+0000 7f3bdb7fe700 1 -- 172.21.15.45:0/3660991057 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f3bcc051820 con 0x7f3be415c9b0 2023-11-28T12:07:11.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.822+0000 7f3be97ff700 1 -- 172.21.15.45:0/3660991057 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3be40745c0 con 0x7f3be415c9b0 2023-11-28T12:07:11.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.822+0000 7f3bdb7fe700 1 -- 172.21.15.45:0/3660991057 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3bcc054e40 con 0x7f3be415c9b0 2023-11-28T12:07:11.824 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-11-28T12:07:11.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.824+0000 7f3be97ff700 1 -- 172.21.15.45:0/3660991057 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f3bc40682f0 msgr2=0x7f3bc406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:11.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.824+0000 7f3be97ff700 1 --2- 172.21.15.45:0/3660991057 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f3bc40682f0 0x7f3bc406a7a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3bd40090b0 tx=0x7f3bd401c040 comp rx=0 tx=0).stop 2023-11-28T12:07:11.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.824+0000 7f3be97ff700 1 -- 172.21.15.45:0/3660991057 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3be415c9b0 msgr2=0x7f3be41e83e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:11.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.824+0000 7f3be97ff700 1 --2- 172.21.15.45:0/3660991057 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3be415c9b0 0x7f3be41e83e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc00c4e0 tx=0x7f3bcc00c7f0 comp rx=0 tx=0).stop 2023-11-28T12:07:11.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.824+0000 7f3be97ff700 1 -- 172.21.15.45:0/3660991057 shutdown_connections 2023-11-28T12:07:11.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.824+0000 7f3be97ff700 1 --2- 172.21.15.45:0/3660991057 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f3bc40682f0 0x7f3bc406a7a0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:11.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.824+0000 7f3be97ff700 1 --2- 172.21.15.45:0/3660991057 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3be40cd7c0 0x7f3be414ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:11.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.824+0000 7f3be97ff700 1 --2- 172.21.15.45:0/3660991057 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3be4161340 0x7f3be4156d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:11.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.824+0000 7f3be97ff700 1 --2- 172.21.15.45:0/3660991057 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3be415c9b0 0x7f3be41e83e0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:11.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.824+0000 7f3be97ff700 1 -- 172.21.15.45:0/3660991057 >> 172.21.15.45:0/3660991057 conn(0x7f3be4072600 msgr2=0x7f3be4160460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:11.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.824+0000 7f3be97ff700 1 -- 172.21.15.45:0/3660991057 shutdown_connections 2023-11-28T12:07:11.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:11.825+0000 7f3be97ff700 1 -- 172.21.15.45:0/3660991057 wait complete. 2023-11-28T12:07:11.844 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T12:07:12.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.050+0000 7fb4743ff700 1 Processor -- start 2023-11-28T12:07:12.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.050+0000 7fb4743ff700 1 -- start start 2023-11-28T12:07:12.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.052+0000 7fb4743ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb46c0b20b0 0x7fb46c0b0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:12.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.052+0000 7fb4743ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb46c0b0230 con 0x7fb46c0d01b0 2023-11-28T12:07:12.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.052+0000 7fb4743ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb46c0b4570 con 0x7fb46c0d1330 2023-11-28T12:07:12.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.052+0000 7fb4743ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb46c15cec0 con 0x7fb46c0b20b0 2023-11-28T12:07:12.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.052+0000 7fb47219b700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fb46c0d01b0 0x7fb46c0d0c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59664/0 (socket says 172.21.15.45:59664) 2023-11-28T12:07:12.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.052+0000 7fb47219b700 1 -- 172.21.15.45:0/2555296231 learned_addr learned my addr 172.21.15.45:0/2555296231 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:07:12.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.052+0000 7fb47299c700 1 --2- 172.21.15.45:0/2555296231 >> v2:172.21.15.45:3300/0 conn(0x7fb46c0b20b0 0x7fb46c0b0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:12.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.053+0000 7fb471199700 1 -- 172.21.15.45:0/2555296231 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 475001741 0 0) 0x7fb46c0b0230 con 0x7fb46c0d01b0 2023-11-28T12:07:12.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.053+0000 7fb471199700 1 -- 172.21.15.45:0/2555296231 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4580035b0 con 0x7fb46c0d01b0 2023-11-28T12:07:12.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.053+0000 7fb47299c700 1 -- 172.21.15.45:0/2555296231 >> v1:172.21.15.152:6789/0 conn(0x7fb46c0d1330 legacy=0x7fb46c0b06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:12.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.053+0000 7fb47299c700 1 -- 172.21.15.45:0/2555296231 >> v1:172.21.15.45:6789/0 conn(0x7fb46c0d01b0 legacy=0x7fb46c0d0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:12.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.053+0000 7fb47299c700 1 -- 172.21.15.45:0/2555296231 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb46c0b4850 con 0x7fb46c0b20b0 2023-11-28T12:07:12.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.053+0000 7fb47299c700 1 --2- 172.21.15.45:0/2555296231 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb46c0b20b0 0x7fb46c0b0dd0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb464009d90 tx=0x7fb46400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0e60b18ba2f70d0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:12.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.053+0000 7fb471199700 1 -- 172.21.15.45:0/2555296231 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46400e070 con 0x7fb46c0b20b0 2023-11-28T12:07:12.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.053+0000 7fb471199700 1 -- 172.21.15.45:0/2555296231 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb46400bb20 con 0x7fb46c0b20b0 2023-11-28T12:07:12.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.053+0000 7fb471199700 1 -- 172.21.15.45:0/2555296231 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb464012430 con 0x7fb46c0b20b0 2023-11-28T12:07:12.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.054+0000 7fb4743ff700 1 -- 172.21.15.45:0/2555296231 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb46c0b20b0 msgr2=0x7fb46c0b0dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:12.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.054+0000 7fb4743ff700 1 --2- 172.21.15.45:0/2555296231 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb46c0b20b0 0x7fb46c0b0dd0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb464009d90 tx=0x7fb46400b330 comp rx=0 tx=0).stop 2023-11-28T12:07:12.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.054+0000 7fb4743ff700 1 -- 172.21.15.45:0/2555296231 shutdown_connections 2023-11-28T12:07:12.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.054+0000 7fb4743ff700 1 --2- 172.21.15.45:0/2555296231 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb46c0b20b0 0x7fb46c0b0dd0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:12.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.054+0000 7fb4743ff700 1 -- 172.21.15.45:0/2555296231 >> 172.21.15.45:0/2555296231 conn(0x7fb46c09c3f0 msgr2=0x7fb46c0d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:12.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.054+0000 7fb4743ff700 1 -- 172.21.15.45:0/2555296231 shutdown_connections 2023-11-28T12:07:12.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.054+0000 7fb4743ff700 1 -- 172.21.15.45:0/2555296231 wait complete. 2023-11-28T12:07:12.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.056+0000 7fb4743ff700 1 Processor -- start 2023-11-28T12:07:12.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.056+0000 7fb4743ff700 1 -- start start 2023-11-28T12:07:12.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.057+0000 7fb4743ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb46c0b20b0 0x7fb46c0c99a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:12.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.057+0000 7fb4743ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb46c0d01b0 0x7fb46c15eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:12.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.057+0000 7fb4743ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb46c0d1330 0x7fb46c1e5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:12.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.057+0000 7fb4743ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb46c15f030 con 0x7fb46c0b20b0 2023-11-28T12:07:12.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.057+0000 7fb4743ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb46c1e73c0 con 0x7fb46c0d1330 2023-11-28T12:07:12.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.057+0000 7fb4743ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb46c1e67b0 con 0x7fb46c0d01b0 2023-11-28T12:07:12.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.057+0000 7fb47219b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb46c0b20b0 0x7fb46c0c99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:12.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.057+0000 7fb47219b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb46c0b20b0 0x7fb46c0c99a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60730/0 (socket says 172.21.15.45:60730) 2023-11-28T12:07:12.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.057+0000 7fb47219b700 1 -- 172.21.15.45:0/3796943596 learned_addr learned my addr 172.21.15.45:0/3796943596 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:12.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.057+0000 7fb47219b700 1 -- 172.21.15.45:0/3796943596 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb46c0d01b0 msgr2=0x7fb46c15eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:12.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.057+0000 7fb47219b700 1 --2- 172.21.15.45:0/3796943596 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb46c0d01b0 0x7fb46c15eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:12.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.057+0000 7fb47299c700 1 --2- 172.21.15.45:0/3796943596 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb46c0d1330 0x7fb46c1e5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:12.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.057+0000 7fb47219b700 1 -- 172.21.15.45:0/3796943596 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb46c0d1330 msgr2=0x7fb46c1e5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:12.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.058+0000 7fb47219b700 1 --2- 172.21.15.45:0/3796943596 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb46c0d1330 0x7fb46c1e5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:12.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.058+0000 7fb47219b700 1 -- 172.21.15.45:0/3796943596 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb464009a70 con 0x7fb46c0b20b0 2023-11-28T12:07:12.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.058+0000 7fb47299c700 1 --2- 172.21.15.45:0/3796943596 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb46c0d1330 0x7fb46c1e5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:07:12.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.058+0000 7fb47219b700 1 --2- 172.21.15.45:0/3796943596 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb46c0b20b0 0x7fb46c0c99a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb46800c700 tx=0x7fb46800cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:12.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.058+0000 7fb462ffd700 1 -- 172.21.15.45:0/3796943596 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb468005d70 con 0x7fb46c0b20b0 2023-11-28T12:07:12.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.058+0000 7fb462ffd700 1 -- 172.21.15.45:0/3796943596 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4680070d0 con 0x7fb46c0b20b0 2023-11-28T12:07:12.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.058+0000 7fb462ffd700 1 -- 172.21.15.45:0/3796943596 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb468007460 con 0x7fb46c0b20b0 2023-11-28T12:07:12.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.058+0000 7fb4743ff700 1 -- 172.21.15.45:0/3796943596 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb46c0afec0 con 0x7fb46c0b20b0 2023-11-28T12:07:12.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.058+0000 7fb4743ff700 1 -- 172.21.15.45:0/3796943596 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb46c0afbe0 con 0x7fb46c0b20b0 2023-11-28T12:07:12.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.059+0000 7fb4743ff700 1 -- 172.21.15.45:0/3796943596 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb46c0b2600 con 0x7fb46c0b20b0 2023-11-28T12:07:12.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.060+0000 7fb462ffd700 1 -- 172.21.15.45:0/3796943596 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fb468019030 con 0x7fb46c0b20b0 2023-11-28T12:07:12.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.061+0000 7fb462ffd700 1 --2- 172.21.15.45:0/3796943596 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb4500682f0 0x7fb45006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:12.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.061+0000 7fb462ffd700 1 -- 172.21.15.45:0/3796943596 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb468085240 con 0x7fb46c0b20b0 2023-11-28T12:07:12.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.061+0000 7fb47199a700 1 --2- 172.21.15.45:0/3796943596 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb4500682f0 0x7fb45006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:12.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.062+0000 7fb47199a700 1 --2- 172.21.15.45:0/3796943596 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb4500682f0 0x7fb45006a7a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb45c000f60 tx=0x7fb45c007a40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:12.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.065+0000 7fb462ffd700 1 -- 172.21.15.45:0/3796943596 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fb468051930 con 0x7fb46c0b20b0 2023-11-28T12:07:12.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.266+0000 7fb4743ff700 1 -- 172.21.15.45:0/3796943596 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb46c068690 con 0x7fb46c0b20b0 2023-11-28T12:07:12.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.267+0000 7fb462ffd700 1 -- 172.21.15.45:0/3796943596 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb468054f50 con 0x7fb46c0b20b0 2023-11-28T12:07:12.269 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-11-28T12:07:12.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.269+0000 7fb4743ff700 1 -- 172.21.15.45:0/3796943596 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb4500682f0 msgr2=0x7fb45006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:12.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.269+0000 7fb4743ff700 1 --2- 172.21.15.45:0/3796943596 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb4500682f0 0x7fb45006a7a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb45c000f60 tx=0x7fb45c007a40 comp rx=0 tx=0).stop 2023-11-28T12:07:12.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.269+0000 7fb4743ff700 1 -- 172.21.15.45:0/3796943596 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb46c0b20b0 msgr2=0x7fb46c0c99a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:12.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.269+0000 7fb4743ff700 1 --2- 172.21.15.45:0/3796943596 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb46c0b20b0 0x7fb46c0c99a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb46800c700 tx=0x7fb46800cac0 comp rx=0 tx=0).stop 2023-11-28T12:07:12.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.269+0000 7fb4743ff700 1 -- 172.21.15.45:0/3796943596 shutdown_connections 2023-11-28T12:07:12.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.269+0000 7fb4743ff700 1 --2- 172.21.15.45:0/3796943596 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb4500682f0 0x7fb45006a7a0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:12.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.269+0000 7fb4743ff700 1 --2- 172.21.15.45:0/3796943596 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb46c0d1330 0x7fb46c1e5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:12.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.269+0000 7fb4743ff700 1 --2- 172.21.15.45:0/3796943596 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb46c0b20b0 0x7fb46c0c99a0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:12.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.269+0000 7fb4743ff700 1 --2- 172.21.15.45:0/3796943596 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb46c0d01b0 0x7fb46c15eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:12.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.269+0000 7fb4743ff700 1 -- 172.21.15.45:0/3796943596 >> 172.21.15.45:0/3796943596 conn(0x7fb46c09c3f0 msgr2=0x7fb46c15c590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:12.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.269+0000 7fb4743ff700 1 -- 172.21.15.45:0/3796943596 shutdown_connections 2023-11-28T12:07:12.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.270+0000 7fb4743ff700 1 -- 172.21.15.45:0/3796943596 wait complete. 2023-11-28T12:07:12.289 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T12:07:12.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.496+0000 7f96d79ff700 1 Processor -- start 2023-11-28T12:07:12.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.496+0000 7f96d79ff700 1 -- start start 2023-11-28T12:07:12.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.497+0000 7f96d79ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f96d0161340 0x7f96d00d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:12.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.497+0000 7f96d79ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96d00d1950 con 0x7f96d015c9b0 2023-11-28T12:07:12.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.497+0000 7f96d79ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96d00b5520 con 0x7f96d00d2320 2023-11-28T12:07:12.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.497+0000 7f96d79ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96d00b5800 con 0x7f96d0161340 2023-11-28T12:07:12.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.498+0000 7f96d579b700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f96d015c9b0 0x7f96d00b4bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59680/0 (socket says 172.21.15.45:59680) 2023-11-28T12:07:12.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.498+0000 7f96d579b700 1 -- 172.21.15.45:0/1615656941 learned_addr learned my addr 172.21.15.45:0/1615656941 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:07:12.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.498+0000 7f96d4f9a700 1 --2- 172.21.15.45:0/1615656941 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f96d0161340 0x7f96d00d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:12.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.498+0000 7f96c7fff700 1 -- 172.21.15.45:0/1615656941 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3224733517 0 0) 0x7f96d00d1950 con 0x7f96d015c9b0 2023-11-28T12:07:12.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.498+0000 7f96c7fff700 1 -- 172.21.15.45:0/1615656941 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96bc0035b0 con 0x7f96d015c9b0 2023-11-28T12:07:12.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.498+0000 7f96c7fff700 1 -- 172.21.15.45:0/1615656941 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 244359781 0 0) 0x7f96d00b5520 con 0x7f96d00d2320 2023-11-28T12:07:12.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.498+0000 7f96c7fff700 1 -- 172.21.15.45:0/1615656941 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96d00d1950 con 0x7f96d00d2320 2023-11-28T12:07:12.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.498+0000 7f96c7fff700 1 -- 172.21.15.45:0/1615656941 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 454281674 0 0) 0x7f96bc0035b0 con 0x7f96d015c9b0 2023-11-28T12:07:12.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.498+0000 7f96c7fff700 1 -- 172.21.15.45:0/1615656941 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f96d0161340 msgr2=0x7f96d00d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:12.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.498+0000 7f96c7fff700 1 --2- 172.21.15.45:0/1615656941 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f96d0161340 0x7f96d00d1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:12.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.498+0000 7f96c7fff700 1 -- 172.21.15.45:0/1615656941 >> v1:172.21.15.152:6789/0 conn(0x7f96d00d2320 legacy=0x7f96d00cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:12.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.498+0000 7f96c7fff700 1 -- 172.21.15.45:0/1615656941 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96d00d1300 con 0x7f96d015c9b0 2023-11-28T12:07:12.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.498+0000 7f96c7fff700 1 -- 172.21.15.45:0/1615656941 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3460218165 0 0) 0x7f96cc001670 con 0x7f96d015c9b0 2023-11-28T12:07:12.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.499+0000 7f96c7fff700 1 -- 172.21.15.45:0/1615656941 >> v1:172.21.15.45:6789/0 conn(0x7f96d015c9b0 legacy=0x7f96d00b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:12.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.499+0000 7f96c7fff700 1 --2- 172.21.15.45:0/1615656941 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f96bc003bc0 0x7f96bc003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:12.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.499+0000 7f96c7fff700 1 --2- 172.21.15.45:0/1615656941 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f96d0161340 0x7f96bc004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:12.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.499+0000 7f96c7fff700 1 --2- 172.21.15.45:0/1615656941 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96bc004d90 0x7f96bc005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:12.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.499+0000 7f96c7fff700 1 -- 172.21.15.45:0/1615656941 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96d00b5800 con 0x7f96bc004d90 2023-11-28T12:07:12.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.499+0000 7f96c7fff700 1 -- 172.21.15.45:0/1615656941 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96bc00bb10 con 0x7f96bc003bc0 2023-11-28T12:07:12.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.499+0000 7f96c7fff700 1 -- 172.21.15.45:0/1615656941 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96bc00bcd0 con 0x7f96d0161340 2023-11-28T12:07:12.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.499+0000 7f96d579b700 1 --2- 172.21.15.45:0/1615656941 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f96bc003bc0 0x7f96bc003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:12.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.499+0000 7f96d5f9c700 1 --2- 172.21.15.45:0/1615656941 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96bc004d90 0x7f96bc005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:12.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.499+0000 7f96d4f9a700 1 --2- 172.21.15.45:0/1615656941 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f96d0161340 0x7f96bc004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:12.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.499+0000 7f96d5f9c700 1 -- 172.21.15.45:0/1615656941 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f96d0161340 msgr2=0x7f96bc004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:12.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.499+0000 7f96d5f9c700 1 --2- 172.21.15.45:0/1615656941 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f96d0161340 0x7f96bc004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:12.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.499+0000 7f96d5f9c700 1 -- 172.21.15.45:0/1615656941 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f96bc003bc0 msgr2=0x7f96bc003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:12.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.499+0000 7f96d5f9c700 1 --2- 172.21.15.45:0/1615656941 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f96bc003bc0 0x7f96bc003fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:12.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.499+0000 7f96d5f9c700 1 -- 172.21.15.45:0/1615656941 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96bc0035b0 con 0x7f96bc004d90 2023-11-28T12:07:12.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.500+0000 7f96d5f9c700 1 --2- 172.21.15.45:0/1615656941 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96bc004d90 0x7f96bc005200 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f96c800c320 tx=0x7f96bc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=339724c0c1801b02 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:12.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.500+0000 7f96c7fff700 1 -- 172.21.15.45:0/1615656941 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c8001f50 con 0x7f96bc004d90 2023-11-28T12:07:12.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.500+0000 7f96c7fff700 1 -- 172.21.15.45:0/1615656941 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96c8003a00 con 0x7f96bc004d90 2023-11-28T12:07:12.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.500+0000 7f96c7fff700 1 -- 172.21.15.45:0/1615656941 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c8003db0 con 0x7f96bc004d90 2023-11-28T12:07:12.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.500+0000 7f96d79ff700 1 -- 172.21.15.45:0/1615656941 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96bc004d90 msgr2=0x7f96bc005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:12.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.500+0000 7f96d79ff700 1 --2- 172.21.15.45:0/1615656941 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96bc004d90 0x7f96bc005200 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f96c800c320 tx=0x7f96bc005880 comp rx=0 tx=0).stop 2023-11-28T12:07:12.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.500+0000 7f96d5f9c700 1 -- 172.21.15.45:0/1615656941 reap_dead start 2023-11-28T12:07:12.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.501+0000 7f96d79ff700 1 -- 172.21.15.45:0/1615656941 shutdown_connections 2023-11-28T12:07:12.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.501+0000 7f96d79ff700 1 -- 172.21.15.45:0/1615656941 >> 172.21.15.45:0/1615656941 conn(0x7f96d0072600 msgr2=0x7f96d00cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:12.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.501+0000 7f96d79ff700 1 -- 172.21.15.45:0/1615656941 shutdown_connections 2023-11-28T12:07:12.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.501+0000 7f96d79ff700 1 -- 172.21.15.45:0/1615656941 wait complete. 2023-11-28T12:07:12.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.502+0000 7f96d79ff700 1 Processor -- start 2023-11-28T12:07:12.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.502+0000 7f96d79ff700 1 -- start start 2023-11-28T12:07:12.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.503+0000 7f96d79ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f96bc004d90 0x7f96d00b7e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:12.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.503+0000 7f96d79ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96d0156f20 0x7f96d00b8370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:12.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.503+0000 7f96d79ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f96d01e7890 0x7f96d01e7d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:12.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.504+0000 7f96d79ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96d01e7520 con 0x7f96d0156f20 2023-11-28T12:07:12.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.504+0000 7f96d79ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96d01e64c0 con 0x7f96bc004d90 2023-11-28T12:07:12.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.504+0000 7f96d79ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96d01e6760 con 0x7f96d01e7890 2023-11-28T12:07:12.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.504+0000 7f96d4f9a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96d0156f20 0x7f96d00b8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:12.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.504+0000 7f96d4f9a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96d0156f20 0x7f96d00b8370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60750/0 (socket says 172.21.15.45:60750) 2023-11-28T12:07:12.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.504+0000 7f96d4f9a700 1 -- 172.21.15.45:0/3517744867 learned_addr learned my addr 172.21.15.45:0/3517744867 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:12.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.504+0000 7f96d579b700 1 --2- 172.21.15.45:0/3517744867 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f96bc004d90 0x7f96d00b7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:12.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.504+0000 7f96d5f9c700 1 --2- 172.21.15.45:0/3517744867 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f96d01e7890 0x7f96d01e7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:12.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.504+0000 7f96d4f9a700 1 -- 172.21.15.45:0/3517744867 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f96d01e7890 msgr2=0x7f96d01e7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:12.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.504+0000 7f96d4f9a700 1 --2- 172.21.15.45:0/3517744867 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f96d01e7890 0x7f96d01e7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:12.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.504+0000 7f96d4f9a700 1 -- 172.21.15.45:0/3517744867 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f96bc004d90 msgr2=0x7f96d00b7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:12.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.504+0000 7f96d4f9a700 1 --2- 172.21.15.45:0/3517744867 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f96bc004d90 0x7f96d00b7e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:12.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.504+0000 7f96d4f9a700 1 -- 172.21.15.45:0/3517744867 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96d015cd80 con 0x7f96d0156f20 2023-11-28T12:07:12.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.504+0000 7f96d4f9a700 1 --2- 172.21.15.45:0/3517744867 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96d0156f20 0x7f96d00b8370 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f96c0011aa0 tx=0x7f96c0011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:12.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.505+0000 7f96c5ffb700 1 -- 172.21.15.45:0/3517744867 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c000f980 con 0x7f96d0156f20 2023-11-28T12:07:12.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.505+0000 7f96c5ffb700 1 -- 172.21.15.45:0/3517744867 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96c000fae0 con 0x7f96d0156f20 2023-11-28T12:07:12.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.505+0000 7f96c5ffb700 1 -- 172.21.15.45:0/3517744867 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c000fe90 con 0x7f96d0156f20 2023-11-28T12:07:12.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.505+0000 7f96d79ff700 1 -- 172.21.15.45:0/3517744867 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96d00d15e0 con 0x7f96d0156f20 2023-11-28T12:07:12.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.505+0000 7f96d79ff700 1 -- 172.21.15.45:0/3517744867 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96d015cf10 con 0x7f96d0156f20 2023-11-28T12:07:12.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.506+0000 7f96d79ff700 1 -- 172.21.15.45:0/3517744867 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96d00745c0 con 0x7f96d0156f20 2023-11-28T12:07:12.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.507+0000 7f96c5ffb700 1 -- 172.21.15.45:0/3517744867 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f96c0014440 con 0x7f96d0156f20 2023-11-28T12:07:12.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.508+0000 7f96c5ffb700 1 --2- 172.21.15.45:0/3517744867 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f96b40682f0 0x7f96b406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:12.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.508+0000 7f96c5ffb700 1 -- 172.21.15.45:0/3517744867 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f96c0086660 con 0x7f96d0156f20 2023-11-28T12:07:12.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.508+0000 7f96d579b700 1 --2- 172.21.15.45:0/3517744867 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f96b40682f0 0x7f96b406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:12.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.509+0000 7f96d579b700 1 --2- 172.21.15.45:0/3517744867 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f96b40682f0 0x7f96b406a7a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f96cc001200 tx=0x7f96cc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:12.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.512+0000 7f96c5ffb700 1 -- 172.21.15.45:0/3517744867 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f96c0052e30 con 0x7f96d0156f20 2023-11-28T12:07:12.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.712+0000 7f96d79ff700 1 -- 172.21.15.45:0/3517744867 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f96d01e7370 con 0x7f96d0156f20 2023-11-28T12:07:12.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.712+0000 7f96c5ffb700 1 -- 172.21.15.45:0/3517744867 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f96c0056450 con 0x7f96d0156f20 2023-11-28T12:07:12.714 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-11-28T12:07:12.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.715+0000 7f96d79ff700 1 -- 172.21.15.45:0/3517744867 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f96b40682f0 msgr2=0x7f96b406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:12.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.715+0000 7f96d79ff700 1 --2- 172.21.15.45:0/3517744867 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f96b40682f0 0x7f96b406a7a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f96cc001200 tx=0x7f96cc009040 comp rx=0 tx=0).stop 2023-11-28T12:07:12.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.715+0000 7f96d79ff700 1 -- 172.21.15.45:0/3517744867 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96d0156f20 msgr2=0x7f96d00b8370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:12.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.715+0000 7f96d79ff700 1 --2- 172.21.15.45:0/3517744867 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96d0156f20 0x7f96d00b8370 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f96c0011aa0 tx=0x7f96c0011e60 comp rx=0 tx=0).stop 2023-11-28T12:07:12.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.715+0000 7f96d79ff700 1 -- 172.21.15.45:0/3517744867 shutdown_connections 2023-11-28T12:07:12.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.715+0000 7f96d79ff700 1 --2- 172.21.15.45:0/3517744867 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f96b40682f0 0x7f96b406a7a0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:12.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.715+0000 7f96d79ff700 1 --2- 172.21.15.45:0/3517744867 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f96bc004d90 0x7f96d00b7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:12.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.715+0000 7f96d79ff700 1 --2- 172.21.15.45:0/3517744867 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f96d01e7890 0x7f96d01e7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:12.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.715+0000 7f96d79ff700 1 --2- 172.21.15.45:0/3517744867 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96d0156f20 0x7f96d00b8370 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:12.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.715+0000 7f96d79ff700 1 -- 172.21.15.45:0/3517744867 >> 172.21.15.45:0/3517744867 conn(0x7f96d0072600 msgr2=0x7f96d0160460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:12.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.715+0000 7f96d79ff700 1 -- 172.21.15.45:0/3517744867 shutdown_connections 2023-11-28T12:07:12.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.715+0000 7f96d79ff700 1 -- 172.21.15.45:0/3517744867 wait complete. 2023-11-28T12:07:12.735 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T12:07:12.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.938+0000 7f39225ff700 1 Processor -- start 2023-11-28T12:07:12.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.938+0000 7f39225ff700 1 -- start start 2023-11-28T12:07:12.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.939+0000 7f39225ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f391c15c9b0 0x7f391c0b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:12.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.939+0000 7f39225ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f391c0cd7c0 0x7f391c0cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:12.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.939+0000 7f39225ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f391c0d1950 con 0x7f391c161340 2023-11-28T12:07:12.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.939+0000 7f39225ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f391c0b5800 con 0x7f391c15c9b0 2023-11-28T12:07:12.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.939+0000 7f39225ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f391c0ce140 con 0x7f391c0cd7c0 2023-11-28T12:07:12.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.940+0000 7f391b7fe700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f391c161340 0x7f391c0d1de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59694/0 (socket says 172.21.15.45:59694) 2023-11-28T12:07:12.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.940+0000 7f391b7fe700 1 -- 172.21.15.45:0/2332921711 learned_addr learned my addr 172.21.15.45:0/2332921711 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:07:12.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.940+0000 7f391bfff700 1 --2- 172.21.15.45:0/2332921711 >> v2:172.21.15.45:3300/0 conn(0x7f391c15c9b0 0x7f391c0b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:12.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.940+0000 7f3920b9c700 1 --2- 172.21.15.45:0/2332921711 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f391c0cd7c0 0x7f391c0cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:12.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.940+0000 7f391affd700 1 -- 172.21.15.45:0/2332921711 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2423177868 0 0) 0x7f391c0d1950 con 0x7f391c161340 2023-11-28T12:07:12.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.940+0000 7f391affd700 1 -- 172.21.15.45:0/2332921711 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39040035b0 con 0x7f391c161340 2023-11-28T12:07:12.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.940+0000 7f391bfff700 1 -- 172.21.15.45:0/2332921711 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f391c0cd7c0 msgr2=0x7f391c0cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:12.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.940+0000 7f391bfff700 1 --2- 172.21.15.45:0/2332921711 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f391c0cd7c0 0x7f391c0cdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:12.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.940+0000 7f391bfff700 1 -- 172.21.15.45:0/2332921711 >> v1:172.21.15.45:6789/0 conn(0x7f391c161340 legacy=0x7f391c0d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:12.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.940+0000 7f391bfff700 1 -- 172.21.15.45:0/2332921711 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f391c0d24f0 con 0x7f391c15c9b0 2023-11-28T12:07:12.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.940+0000 7f391bfff700 1 --2- 172.21.15.45:0/2332921711 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f391c15c9b0 0x7f391c0b4bf0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f390c009840 tx=0x7f390c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36351d0459346bb4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:12.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.941+0000 7f391affd700 1 -- 172.21.15.45:0/2332921711 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f390c011830 con 0x7f391c15c9b0 2023-11-28T12:07:12.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.941+0000 7f391affd700 1 -- 172.21.15.45:0/2332921711 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f390c011990 con 0x7f391c15c9b0 2023-11-28T12:07:12.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.941+0000 7f391affd700 1 -- 172.21.15.45:0/2332921711 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f390c011d00 con 0x7f391c15c9b0 2023-11-28T12:07:12.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.941+0000 7f39225ff700 1 -- 172.21.15.45:0/2332921711 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f391c15c9b0 msgr2=0x7f391c0b4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:12.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.941+0000 7f39225ff700 1 --2- 172.21.15.45:0/2332921711 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f391c15c9b0 0x7f391c0b4bf0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f390c009840 tx=0x7f390c009b50 comp rx=0 tx=0).stop 2023-11-28T12:07:12.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.941+0000 7f39225ff700 1 -- 172.21.15.45:0/2332921711 shutdown_connections 2023-11-28T12:07:12.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.941+0000 7f39225ff700 1 --2- 172.21.15.45:0/2332921711 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f391c0cd7c0 0x7f391c0cdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:12.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.941+0000 7f39225ff700 1 --2- 172.21.15.45:0/2332921711 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f391c15c9b0 0x7f391c0b4bf0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:12.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.941+0000 7f39225ff700 1 -- 172.21.15.45:0/2332921711 >> 172.21.15.45:0/2332921711 conn(0x7f391c072600 msgr2=0x7f391c0cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:12.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.941+0000 7f39225ff700 1 -- 172.21.15.45:0/2332921711 shutdown_connections 2023-11-28T12:07:12.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.942+0000 7f39225ff700 1 -- 172.21.15.45:0/2332921711 wait complete. 2023-11-28T12:07:12.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.943+0000 7f39225ff700 1 Processor -- start 2023-11-28T12:07:12.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.943+0000 7f39225ff700 1 -- start start 2023-11-28T12:07:12.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.944+0000 7f39225ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f391c0cd7c0 0x7f391c14a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:12.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.944+0000 7f39225ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f391c15c9b0 0x7f391c0cbbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:12.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.944+0000 7f39225ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f391c161340 0x7f391c0ca240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:12.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.944+0000 7f39225ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f391c0cd050 con 0x7f391c0cd7c0 2023-11-28T12:07:12.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.944+0000 7f39225ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f391c0cb730 con 0x7f391c15c9b0 2023-11-28T12:07:12.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.944+0000 7f39225ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f391c0cc100 con 0x7f391c161340 2023-11-28T12:07:12.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.945+0000 7f391bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f391c0cd7c0 0x7f391c14a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:12.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.945+0000 7f391bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f391c0cd7c0 0x7f391c14a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60772/0 (socket says 172.21.15.45:60772) 2023-11-28T12:07:12.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.945+0000 7f391bfff700 1 -- 172.21.15.45:0/1111255545 learned_addr learned my addr 172.21.15.45:0/1111255545 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:12.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.945+0000 7f3920b9c700 1 --2- 172.21.15.45:0/1111255545 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f391c161340 0x7f391c0ca240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:12.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.945+0000 7f391b7fe700 1 --2- 172.21.15.45:0/1111255545 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f391c15c9b0 0x7f391c0cbbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:12.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.945+0000 7f391bfff700 1 -- 172.21.15.45:0/1111255545 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f391c161340 msgr2=0x7f391c0ca240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:12.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.945+0000 7f391bfff700 1 --2- 172.21.15.45:0/1111255545 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f391c161340 0x7f391c0ca240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:12.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.945+0000 7f391bfff700 1 -- 172.21.15.45:0/1111255545 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f391c15c9b0 msgr2=0x7f391c0cbbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:12.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.945+0000 7f391bfff700 1 --2- 172.21.15.45:0/1111255545 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f391c15c9b0 0x7f391c0cbbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:12.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.945+0000 7f391bfff700 1 -- 172.21.15.45:0/1111255545 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f390c0094a0 con 0x7f391c0cd7c0 2023-11-28T12:07:12.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.945+0000 7f391b7fe700 1 --2- 172.21.15.45:0/1111255545 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f391c15c9b0 0x7f391c0cbbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:07:12.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.945+0000 7f391bfff700 1 --2- 172.21.15.45:0/1111255545 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f391c0cd7c0 0x7f391c14a680 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f390c0090b0 tx=0x7f390c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:12.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.946+0000 7f3918ff9700 1 -- 172.21.15.45:0/1111255545 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f390c004550 con 0x7f391c0cd7c0 2023-11-28T12:07:12.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.946+0000 7f3918ff9700 1 -- 172.21.15.45:0/1111255545 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f390c01e070 con 0x7f391c0cd7c0 2023-11-28T12:07:12.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.946+0000 7f3918ff9700 1 -- 172.21.15.45:0/1111255545 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f390c0038e0 con 0x7f391c0cd7c0 2023-11-28T12:07:12.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.946+0000 7f39225ff700 1 -- 172.21.15.45:0/1111255545 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f391c0d1300 con 0x7f391c0cd7c0 2023-11-28T12:07:12.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.946+0000 7f39225ff700 1 -- 172.21.15.45:0/1111255545 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f391c0b5520 con 0x7f391c0cd7c0 2023-11-28T12:07:12.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.947+0000 7f39225ff700 1 -- 172.21.15.45:0/1111255545 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f391c0d15e0 con 0x7f391c0cd7c0 2023-11-28T12:07:12.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.948+0000 7f3918ff9700 1 -- 172.21.15.45:0/1111255545 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f390c00f050 con 0x7f391c0cd7c0 2023-11-28T12:07:12.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.949+0000 7f3918ff9700 1 --2- 172.21.15.45:0/1111255545 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f39080682f0 0x7f390806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:12.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.949+0000 7f3918ff9700 1 -- 172.21.15.45:0/1111255545 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f390c086be0 con 0x7f391c0cd7c0 2023-11-28T12:07:12.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.949+0000 7f391b7fe700 1 --2- 172.21.15.45:0/1111255545 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f39080682f0 0x7f390806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:12.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.950+0000 7f391b7fe700 1 --2- 172.21.15.45:0/1111255545 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f39080682f0 0x7f390806a7a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f391c15f7d0 tx=0x7f3910009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:12.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:12.953+0000 7f3918ff9700 1 -- 172.21.15.45:0/1111255545 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f390c053350 con 0x7f391c0cd7c0 2023-11-28T12:07:13.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:13.156+0000 7f39225ff700 1 -- 172.21.15.45:0/1111255545 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f391c15a450 con 0x7f391c0cd7c0 2023-11-28T12:07:13.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:13.156+0000 7f3918ff9700 1 -- 172.21.15.45:0/1111255545 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f390c0200a0 con 0x7f391c0cd7c0 2023-11-28T12:07:13.158 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-11-28T12:07:13.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:13.158+0000 7f39225ff700 1 -- 172.21.15.45:0/1111255545 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f39080682f0 msgr2=0x7f390806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:13.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:13.158+0000 7f39225ff700 1 --2- 172.21.15.45:0/1111255545 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f39080682f0 0x7f390806a7a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f391c15f7d0 tx=0x7f3910009040 comp rx=0 tx=0).stop 2023-11-28T12:07:13.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:13.158+0000 7f39225ff700 1 -- 172.21.15.45:0/1111255545 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f391c0cd7c0 msgr2=0x7f391c14a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:13.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:13.158+0000 7f39225ff700 1 --2- 172.21.15.45:0/1111255545 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f391c0cd7c0 0x7f391c14a680 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f390c0090b0 tx=0x7f390c004750 comp rx=0 tx=0).stop 2023-11-28T12:07:13.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:13.159+0000 7f39225ff700 1 -- 172.21.15.45:0/1111255545 shutdown_connections 2023-11-28T12:07:13.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:13.159+0000 7f39225ff700 1 --2- 172.21.15.45:0/1111255545 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f39080682f0 0x7f390806a7a0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:13.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:13.159+0000 7f39225ff700 1 --2- 172.21.15.45:0/1111255545 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f391c161340 0x7f391c0ca240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:13.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:13.159+0000 7f39225ff700 1 --2- 172.21.15.45:0/1111255545 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f391c0cd7c0 0x7f391c14a680 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:13.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:13.159+0000 7f39225ff700 1 --2- 172.21.15.45:0/1111255545 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f391c15c9b0 0x7f391c0cbbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:13.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:13.159+0000 7f39225ff700 1 -- 172.21.15.45:0/1111255545 >> 172.21.15.45:0/1111255545 conn(0x7f391c072600 msgr2=0x7f391c0b5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:13.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:13.159+0000 7f39225ff700 1 -- 172.21.15.45:0/1111255545 shutdown_connections 2023-11-28T12:07:13.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:13.159+0000 7f39225ff700 1 -- 172.21.15.45:0/1111255545 wait complete. 2023-11-28T12:07:13.178 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T12:07:13.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:13.381+0000 7f21fc5ff700 1 Processor -- start 2023-11-28T12:07:13.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:13.381+0000 7f21fc5ff700 1 -- start start 2023-11-28T12:07:13.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:13.382+0000 7f21fc5ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f21f415c9b0 0x7f21f40b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:13.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:13.382+0000 7f21fc5ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21f40d1950 con 0x7f21f40cd7c0 2023-11-28T12:07:13.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:13.382+0000 7f21fc5ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21f40d24f0 con 0x7f21f4161340 2023-11-28T12:07:13.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:13.382+0000 7f21fc5ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21f40b5800 con 0x7f21f415c9b0 2023-11-28T12:07:13.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:13.383+0000 7f21fab9c700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f21f40cd7c0 0x7f21f40b5fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59700/0 (socket says 172.21.15.45:59700) 2023-11-28T12:07:13.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:13.383+0000 7f21fab9c700 1 -- 172.21.15.45:0/2097688184 learned_addr learned my addr 172.21.15.45:0/2097688184 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:07:13.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:13.383+0000 7f21fa39b700 1 --2- 172.21.15.45:0/2097688184 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f21f415c9b0 0x7f21f40b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:13.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:13.383+0000 7f21f9399700 1 -- 172.21.15.45:0/2097688184 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2933304110 0 0) 0x7f21f40d1950 con 0x7f21f40cd7c0 2023-11-28T12:07:13.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:13.383+0000 7f21f9399700 1 -- 172.21.15.45:0/2097688184 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21e00035b0 con 0x7f21f40cd7c0 2023-11-28T12:07:13.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:13.383+0000 7f21f9399700 1 -- 172.21.15.45:0/2097688184 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2117514202 0 0) 0x7f21f40d24f0 con 0x7f21f4161340 2023-11-28T12:07:13.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:13.383+0000 7f21f9399700 1 -- 172.21.15.45:0/2097688184 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21f40d1950 con 0x7f21f4161340 2023-11-28T12:07:13.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:13.383+0000 7f21fa39b700 1 -- 172.21.15.45:0/2097688184 >> v1:172.21.15.152:6789/0 conn(0x7f21f4161340 legacy=0x7f21f40d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:13.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:13.383+0000 7f21fa39b700 1 -- 172.21.15.45:0/2097688184 >> v1:172.21.15.45:6789/0 conn(0x7f21f40cd7c0 legacy=0x7f21f40b5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:13.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:13.383+0000 7f21fa39b700 1 -- 172.21.15.45:0/2097688184 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21f40b5520 con 0x7f21f415c9b0 2023-11-28T12:07:13.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:13.384+0000 7f21fa39b700 1 --2- 172.21.15.45:0/2097688184 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f21f415c9b0 0x7f21f40b4bf0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f21f0009870 tx=0x7f21f0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c3432975cfb8b78 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:13.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:13.384+0000 7f21f9399700 1 -- 172.21.15.45:0/2097688184 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f0011830 con 0x7f21f415c9b0 2023-11-28T12:07:13.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:13.384+0000 7f21f9399700 1 -- 172.21.15.45:0/2097688184 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21f0011990 con 0x7f21f415c9b0 2023-11-28T12:07:13.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:13.384+0000 7f21f9399700 1 -- 172.21.15.45:0/2097688184 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f0011d20 con 0x7f21f415c9b0 2023-11-28T12:07:13.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:13.385+0000 7f21fc5ff700 1 -- 172.21.15.45:0/2097688184 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f21f415c9b0 msgr2=0x7f21f40b4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:13.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:13.385+0000 7f21fc5ff700 1 --2- 172.21.15.45:0/2097688184 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f21f415c9b0 0x7f21f40b4bf0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f21f0009870 tx=0x7f21f0009b80 comp rx=0 tx=0).stop 2023-11-28T12:07:13.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:13.385+0000 7f21fc5ff700 1 -- 172.21.15.45:0/2097688184 shutdown_connections 2023-11-28T12:07:13.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:13.385+0000 7f21fc5ff700 1 --2- 172.21.15.45:0/2097688184 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f21f415c9b0 0x7f21f40b4bf0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:13.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:13.385+0000 7f21fc5ff700 1 -- 172.21.15.45:0/2097688184 >> 172.21.15.45:0/2097688184 conn(0x7f21f4072600 msgr2=0x7f21f40cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:13.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:13.385+0000 7f21fc5ff700 1 -- 172.21.15.45:0/2097688184 shutdown_connections 2023-11-28T12:07:13.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:13.385+0000 7f21fc5ff700 1 -- 172.21.15.45:0/2097688184 wait complete. 2023-11-28T12:07:13.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:13.386+0000 7f21fc5ff700 1 Processor -- start 2023-11-28T12:07:13.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:13.387+0000 7f21fc5ff700 1 -- start start 2023-11-28T12:07:13.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:13.387+0000 7f21fc5ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21f40cd7c0 0x7f21f40c8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:13.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:13.387+0000 7f21fc5ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f21f415c9b0 0x7f21f41576c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:13.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:13.388+0000 7f21fc5ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f21f4161340 0x7f21f41e7620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:13.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:13.388+0000 7f21fc5ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f40c9af0 con 0x7f21f40cd7c0 2023-11-28T12:07:13.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:13.388+0000 7f21fc5ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f4157c00 con 0x7f21f4161340 2023-11-28T12:07:13.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:13.388+0000 7f21fc5ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21f40c8f70 con 0x7f21f415c9b0 2023-11-28T12:07:13.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:13.388+0000 7f21fa39b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21f40cd7c0 0x7f21f40c8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:13.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:13.388+0000 7f21fa39b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21f40cd7c0 0x7f21f40c8990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60788/0 (socket says 172.21.15.45:60788) 2023-11-28T12:07:13.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:13.388+0000 7f21fa39b700 1 -- 172.21.15.45:0/1245499561 learned_addr learned my addr 172.21.15.45:0/1245499561 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:13.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:13.388+0000 7f21fab9c700 1 --2- 172.21.15.45:0/1245499561 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f21f4161340 0x7f21f41e7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:13.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:13.388+0000 7f21f9b9a700 1 --2- 172.21.15.45:0/1245499561 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f21f415c9b0 0x7f21f41576c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:13.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:13.388+0000 7f21fa39b700 1 -- 172.21.15.45:0/1245499561 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f21f415c9b0 msgr2=0x7f21f41576c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:13.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:13.388+0000 7f21fa39b700 1 --2- 172.21.15.45:0/1245499561 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f21f415c9b0 0x7f21f41576c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:13.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:13.388+0000 7f21fa39b700 1 -- 172.21.15.45:0/1245499561 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f21f4161340 msgr2=0x7f21f41e7620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:13.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:13.388+0000 7f21fa39b700 1 --2- 172.21.15.45:0/1245499561 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f21f4161340 0x7f21f41e7620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:13.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:13.388+0000 7f21fa39b700 1 -- 172.21.15.45:0/1245499561 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21f00094a0 con 0x7f21f40cd7c0 2023-11-28T12:07:13.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:13.389+0000 7f21fa39b700 1 --2- 172.21.15.45:0/1245499561 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21f40cd7c0 0x7f21f40c8990 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f21f00090b0 tx=0x7f21f0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:13.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:13.389+0000 7f21eaffd700 1 -- 172.21.15.45:0/1245499561 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f001a8f0 con 0x7f21f40cd7c0 2023-11-28T12:07:13.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:13.389+0000 7f21eaffd700 1 -- 172.21.15.45:0/1245499561 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21f001aa50 con 0x7f21f40cd7c0 2023-11-28T12:07:13.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:13.389+0000 7f21fc5ff700 1 -- 172.21.15.45:0/1245499561 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21f40d15e0 con 0x7f21f40cd7c0 2023-11-28T12:07:13.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:13.389+0000 7f21eaffd700 1 -- 172.21.15.45:0/1245499561 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f001adc0 con 0x7f21f40cd7c0 2023-11-28T12:07:13.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:13.389+0000 7f21fc5ff700 1 -- 172.21.15.45:0/1245499561 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21f40d1300 con 0x7f21f40cd7c0 2023-11-28T12:07:13.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:13.390+0000 7f21fc5ff700 1 -- 172.21.15.45:0/1245499561 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21f40b5130 con 0x7f21f40cd7c0 2023-11-28T12:07:13.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:13.391+0000 7f21eaffd700 1 -- 172.21.15.45:0/1245499561 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f21f000f050 con 0x7f21f40cd7c0 2023-11-28T12:07:13.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:13.392+0000 7f21eaffd700 1 --2- 172.21.15.45:0/1245499561 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f21d80682f0 0x7f21d806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:13.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:13.392+0000 7f21eaffd700 1 -- 172.21.15.45:0/1245499561 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f21f0086db0 con 0x7f21f40cd7c0 2023-11-28T12:07:13.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:13.392+0000 7f21f9b9a700 1 --2- 172.21.15.45:0/1245499561 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f21d80682f0 0x7f21d806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:13.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:13.393+0000 7f21f9b9a700 1 --2- 172.21.15.45:0/1245499561 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f21d80682f0 0x7f21d806a7a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f21f415ff90 tx=0x7f21e4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:13.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:13.396+0000 7f21eaffd700 1 -- 172.21.15.45:0/1245499561 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f21f0053610 con 0x7f21f40cd7c0 2023-11-28T12:07:13.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:13.611+0000 7f21fc5ff700 1 -- 172.21.15.45:0/1245499561 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f21f40745c0 con 0x7f21f40cd7c0 2023-11-28T12:07:13.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:13.612+0000 7f21eaffd700 1 -- 172.21.15.45:0/1245499561 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7f21f0015020 con 0x7f21f40cd7c0 2023-11-28T12:07:13.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:13.614+0000 7f21fc5ff700 1 -- 172.21.15.45:0/1245499561 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f21d80682f0 msgr2=0x7f21d806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:13.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:13.614+0000 7f21fc5ff700 1 --2- 172.21.15.45:0/1245499561 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f21d80682f0 0x7f21d806a7a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f21f415ff90 tx=0x7f21e4009040 comp rx=0 tx=0).stop 2023-11-28T12:07:13.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:13.614+0000 7f21fc5ff700 1 -- 172.21.15.45:0/1245499561 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21f40cd7c0 msgr2=0x7f21f40c8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:13.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:13.614+0000 7f21fc5ff700 1 --2- 172.21.15.45:0/1245499561 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21f40cd7c0 0x7f21f40c8990 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f21f00090b0 tx=0x7f21f0004750 comp rx=0 tx=0).stop 2023-11-28T12:07:13.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:13.614+0000 7f21fc5ff700 1 -- 172.21.15.45:0/1245499561 shutdown_connections 2023-11-28T12:07:13.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:13.614+0000 7f21fc5ff700 1 --2- 172.21.15.45:0/1245499561 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f21d80682f0 0x7f21d806a7a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:13.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:13.614+0000 7f21fc5ff700 1 --2- 172.21.15.45:0/1245499561 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f21f4161340 0x7f21f41e7620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:13.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:13.614+0000 7f21fc5ff700 1 --2- 172.21.15.45:0/1245499561 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21f40cd7c0 0x7f21f40c8990 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:13.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:13.614+0000 7f21fc5ff700 1 --2- 172.21.15.45:0/1245499561 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f21f415c9b0 0x7f21f41576c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:13.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:13.614+0000 7f21fc5ff700 1 -- 172.21.15.45:0/1245499561 >> 172.21.15.45:0/1245499561 conn(0x7f21f4072600 msgr2=0x7f21f40b7160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:13.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:13.614+0000 7f21fc5ff700 1 -- 172.21.15.45:0/1245499561 shutdown_connections 2023-11-28T12:07:13.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:13.614+0000 7f21fc5ff700 1 -- 172.21.15.45:0/1245499561 wait complete. 2023-11-28T12:07:13.617 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-11-28T12:07:13.634 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-28T12:07:13.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:07:13.634 DEBUG:teuthology.orchestra.run.smithi045:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-11-28T12:07:13.711 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi045.front.sepia.ceph.com 2023-11-28T12:07:13.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:07:13.711 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-28T12:07:13.764 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-11-28T12:07:13.764 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T12:07:13.817 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-11-28T12:07:13.817 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T12:07:13.866 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-11-28T12:07:13.866 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T12:07:13.954 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T12:07:14.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.159+0000 7fc8c4bff700 1 Processor -- start 2023-11-28T12:07:14.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.159+0000 7fc8c4bff700 1 -- start start 2023-11-28T12:07:14.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.160+0000 7fc8c4bff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc8c0161340 0x7fc8c00d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:14.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.160+0000 7fc8c4bff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc8c00d2320 0x7fc8c00cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:14.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.160+0000 7fc8c4bff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8c00d1950 con 0x7fc8c015c9b0 2023-11-28T12:07:14.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.160+0000 7fc8c4bff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8c00b5800 con 0x7fc8c00d2320 2023-11-28T12:07:14.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.160+0000 7fc8c4bff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c00b5300 con 0x7fc8c0161340 2023-11-28T12:07:14.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.160+0000 7fc8bed9d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc8c00d2320 0x7fc8c00cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:14.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.160+0000 7fc8bed9d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc8c00d2320 0x7fc8c00cd7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60794/0 (socket says 172.21.15.45:60794) 2023-11-28T12:07:14.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.160+0000 7fc8bed9d700 1 -- 172.21.15.45:0/3343211839 learned_addr learned my addr 172.21.15.45:0/3343211839 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:14.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.160+0000 7fc8bdd9b700 1 --2- 172.21.15.45:0/3343211839 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc8c0161340 0x7fc8c00d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:14.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.160+0000 7fc8bed9d700 1 -- 172.21.15.45:0/3343211839 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc8c0161340 msgr2=0x7fc8c00d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:14.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.160+0000 7fc8bed9d700 1 --2- 172.21.15.45:0/3343211839 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc8c0161340 0x7fc8c00d1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:14.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.160+0000 7fc8bed9d700 1 -- 172.21.15.45:0/3343211839 >> v1:172.21.15.45:6789/0 conn(0x7fc8c015c9b0 legacy=0x7fc8c00b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:14.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.160+0000 7fc8bed9d700 1 -- 172.21.15.45:0/3343211839 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8c00b5520 con 0x7fc8c00d2320 2023-11-28T12:07:14.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.161+0000 7fc8bed9d700 1 --2- 172.21.15.45:0/3343211839 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8c00d2320 0x7fc8c00cd7c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc8b8009e80 tx=0x7fc8b800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bad39b3a49c3543 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:14.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.161+0000 7fc8bd59a700 1 -- 172.21.15.45:0/3343211839 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b800e070 con 0x7fc8c00d2320 2023-11-28T12:07:14.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.161+0000 7fc8bd59a700 1 -- 172.21.15.45:0/3343211839 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8b800b8d0 con 0x7fc8c00d2320 2023-11-28T12:07:14.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.161+0000 7fc8bd59a700 1 -- 172.21.15.45:0/3343211839 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b800bc80 con 0x7fc8c00d2320 2023-11-28T12:07:14.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.161+0000 7fc8c4bff700 1 -- 172.21.15.45:0/3343211839 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8c00d2320 msgr2=0x7fc8c00cd7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:14.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.161+0000 7fc8c4bff700 1 --2- 172.21.15.45:0/3343211839 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8c00d2320 0x7fc8c00cd7c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc8b8009e80 tx=0x7fc8b800b330 comp rx=0 tx=0).stop 2023-11-28T12:07:14.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.161+0000 7fc8c4bff700 1 -- 172.21.15.45:0/3343211839 shutdown_connections 2023-11-28T12:07:14.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.161+0000 7fc8c4bff700 1 --2- 172.21.15.45:0/3343211839 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8c00d2320 0x7fc8c00cd7c0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:14.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.161+0000 7fc8c4bff700 1 --2- 172.21.15.45:0/3343211839 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc8c0161340 0x7fc8c00d1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:14.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.161+0000 7fc8c4bff700 1 -- 172.21.15.45:0/3343211839 >> 172.21.15.45:0/3343211839 conn(0x7fc8c0072600 msgr2=0x7fc8c00cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:14.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.162+0000 7fc8c4bff700 1 -- 172.21.15.45:0/3343211839 shutdown_connections 2023-11-28T12:07:14.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.162+0000 7fc8c4bff700 1 -- 172.21.15.45:0/3343211839 wait complete. 2023-11-28T12:07:14.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.163+0000 7fc8c4bff700 1 Processor -- start 2023-11-28T12:07:14.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.163+0000 7fc8c4bff700 1 -- start start 2023-11-28T12:07:14.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.164+0000 7fc8c4bff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc8c00d2320 0x7fc8c01e8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:14.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.164+0000 7fc8c4bff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8c015c9b0 0x7fc8c01e65e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:14.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.164+0000 7fc8c4bff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc8c0161340 0x7fc8c00c5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:14.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.164+0000 7fc8c4bff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c00c8110 con 0x7fc8c015c9b0 2023-11-28T12:07:14.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.164+0000 7fc8c4bff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c00c7490 con 0x7fc8c00d2320 2023-11-28T12:07:14.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.164+0000 7fc8c4bff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c00c7770 con 0x7fc8c0161340 2023-11-28T12:07:14.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.165+0000 7fc8bdd9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8c015c9b0 0x7fc8c01e65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:14.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.165+0000 7fc8be59c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc8c00d2320 0x7fc8c01e8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:14.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.165+0000 7fc8bed9d700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc8c0161340 0x7fc8c00c5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:14.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.165+0000 7fc8be59c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc8c00d2320 0x7fc8c01e8530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.45:36266/0 (socket says 172.21.15.45:36266) 2023-11-28T12:07:14.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.165+0000 7fc8bdd9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8c015c9b0 0x7fc8c01e65e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60804/0 (socket says 172.21.15.45:60804) 2023-11-28T12:07:14.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.165+0000 7fc8be59c700 1 -- 172.21.15.45:0/1194385960 learned_addr learned my addr 172.21.15.45:0/1194385960 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:14.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.165+0000 7fc8bed9d700 1 -- 172.21.15.45:0/1194385960 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc8c00d2320 msgr2=0x7fc8c01e8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:14.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.165+0000 7fc8bed9d700 1 --2- 172.21.15.45:0/1194385960 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc8c00d2320 0x7fc8c01e8530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:14.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.165+0000 7fc8bed9d700 1 -- 172.21.15.45:0/1194385960 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8c015c9b0 msgr2=0x7fc8c01e65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:14.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.165+0000 7fc8bed9d700 1 --2- 172.21.15.45:0/1194385960 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8c015c9b0 0x7fc8c01e65e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:14.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.165+0000 7fc8bed9d700 1 -- 172.21.15.45:0/1194385960 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8b8009b30 con 0x7fc8c0161340 2023-11-28T12:07:14.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.165+0000 7fc8be59c700 1 --2- 172.21.15.45:0/1194385960 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc8c00d2320 0x7fc8c01e8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:07:14.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.165+0000 7fc8bdd9b700 1 --2- 172.21.15.45:0/1194385960 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8c015c9b0 0x7fc8c01e65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:07:14.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.166+0000 7fc8bed9d700 1 --2- 172.21.15.45:0/1194385960 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc8c0161340 0x7fc8c00c5e80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc8b8015000 tx=0x7fc8b8004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:14.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.166+0000 7fc8aeffd700 1 -- 172.21.15.45:0/1194385960 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b8004800 con 0x7fc8c0161340 2023-11-28T12:07:14.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.166+0000 7fc8aeffd700 1 -- 172.21.15.45:0/1194385960 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8b80099b0 con 0x7fc8c0161340 2023-11-28T12:07:14.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.166+0000 7fc8aeffd700 1 -- 172.21.15.45:0/1194385960 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b801b670 con 0x7fc8c0161340 2023-11-28T12:07:14.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.166+0000 7fc8c4bff700 1 -- 172.21.15.45:0/1194385960 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8c00d15e0 con 0x7fc8c0161340 2023-11-28T12:07:14.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.166+0000 7fc8c4bff700 1 -- 172.21.15.45:0/1194385960 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8c00d1300 con 0x7fc8c0161340 2023-11-28T12:07:14.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.167+0000 7fc8c4bff700 1 -- 172.21.15.45:0/1194385960 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8c015cd80 con 0x7fc8c0161340 2023-11-28T12:07:14.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.168+0000 7fc8aeffd700 1 -- 172.21.15.45:0/1194385960 <== mon.2 v2:172.21.15.152:3301/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fc8b8021030 con 0x7fc8c0161340 2023-11-28T12:07:14.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.169+0000 7fc8aeffd700 1 --2- 172.21.15.45:0/1194385960 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fc8a00682f0 0x7fc8a006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:14.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.169+0000 7fc8aeffd700 1 -- 172.21.15.45:0/1194385960 <== mon.2 v2:172.21.15.152:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc8b8087180 con 0x7fc8c0161340 2023-11-28T12:07:14.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.169+0000 7fc8be59c700 1 --2- 172.21.15.45:0/1194385960 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fc8a00682f0 0x7fc8a006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:14.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.170+0000 7fc8be59c700 1 --2- 172.21.15.45:0/1194385960 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fc8a00682f0 0x7fc8a006a7a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc8b0001c70 tx=0x7fc8b0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:14.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.174+0000 7fc8aeffd700 1 -- 172.21.15.45:0/1194385960 <== mon.2 v2:172.21.15.152:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fc8b80538f0 con 0x7fc8c0161340 2023-11-28T12:07:14.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.375+0000 7fc8c4bff700 1 -- 172.21.15.45:0/1194385960 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc8c00c8250 con 0x7fc8c0161340 2023-11-28T12:07:14.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.377+0000 7fc8aeffd700 1 -- 172.21.15.45:0/1194385960 <== mon.2 v2:172.21.15.152:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+17849 (secure 0 0 0) 0x7fc8c00c8250 con 0x7fc8c0161340 2023-11-28T12:07:14.378 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:07:14.378 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":20,"fsid":"bd7c37f1-f7c6-4778-b845-52cf2aa6e366","created":"2023-11-28T12:06:09.045075+0000","modified":"2023-11-28T12:06:30.396046+0000","last_up_change":"2023-11-28T12:06:21.282227+0000","last_in_change":"2023-11-28T12:06:12.560924+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T12:06:21.807108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T12:06:22.491009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T12:06:27.684157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T12:06:28.384679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d0cdd8a-87fd-4f2c-91bd-47bdfa661905","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":115843},{"type":"v1","addr":"172.21.15.45:6808","nonce":115843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":115843},{"type":"v1","addr":"172.21.15.45:6811","nonce":115843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":115843},{"type":"v1","addr":"172.21.15.45:6815","nonce":115843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":115843},{"type":"v1","addr":"172.21.15.45:6813","nonce":115843}]},"public_addr":"172.21.15.45:6808/115843","cluster_addr":"172.21.15.45:6811/115843","heartbeat_back_addr":"172.21.15.45:6815/115843","heartbeat_front_addr":"172.21.15.45:6813/115843","state":["exists","up"]},{"osd":1,"uuid":"c5de4ebd-9ec5-40b3-9caa-9b706fab4c76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":115842},{"type":"v1","addr":"172.21.15.45:6801","nonce":115842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":115842},{"type":"v1","addr":"172.21.15.45:6803","nonce":115842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6807","nonce":115842},{"type":"v1","addr":"172.21.15.45:6809","nonce":115842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":115842},{"type":"v1","addr":"172.21.15.45:6805","nonce":115842}]},"public_addr":"172.21.15.45:6801/115842","cluster_addr":"172.21.15.45:6803/115842","heartbeat_back_addr":"172.21.15.45:6809/115842","heartbeat_front_addr":"172.21.15.45:6805/115842","state":["exists","up"]},{"osd":2,"uuid":"9f4b36b2-65d2-40e7-9fe6-a2991afa71c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":115850},{"type":"v1","addr":"172.21.15.45:6819","nonce":115850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":115850},{"type":"v1","addr":"172.21.15.45:6823","nonce":115850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":115850},{"type":"v1","addr":"172.21.15.45:6831","nonce":115850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":115850},{"type":"v1","addr":"172.21.15.45:6828","nonce":115850}]},"public_addr":"172.21.15.45:6819/115850","cluster_addr":"172.21.15.45:6823/115850","heartbeat_back_addr":"172.21.15.45:6831/115850","heartbeat_front_addr":"172.21.15.45:6828/115850","state":["exists","up"]},{"osd":3,"uuid":"6fe7ef05-4e0d-426c-bf94-44b51d4d550b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":115848},{"type":"v1","addr":"172.21.15.45:6818","nonce":115848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":115848},{"type":"v1","addr":"172.21.15.45:6822","nonce":115848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6827","nonce":115848},{"type":"v1","addr":"172.21.15.45:6829","nonce":115848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":115848},{"type":"v1","addr":"172.21.15.45:6825","nonce":115848}]},"public_addr":"172.21.15.45:6818/115848","cluster_addr":"172.21.15.45:6822/115848","heartbeat_back_addr":"172.21.15.45:6829/115848","heartbeat_front_addr":"172.21.15.45:6825/115848","state":["exists","up"]},{"osd":4,"uuid":"fa403c08-d8a1-4a3a-8384-cb465c1a654c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":116092},{"type":"v1","addr":"172.21.15.152:6801","nonce":116092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":116092},{"type":"v1","addr":"172.21.15.152:6803","nonce":116092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":116092},{"type":"v1","addr":"172.21.15.152:6807","nonce":116092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":116092},{"type":"v1","addr":"172.21.15.152:6805","nonce":116092}]},"public_addr":"172.21.15.152:6801/116092","cluster_addr":"172.21.15.152:6803/116092","heartbeat_back_addr":"172.21.15.152:6807/116092","heartbeat_front_addr":"172.21.15.152:6805/116092","state":["exists","up"]},{"osd":5,"uuid":"399fc450-39fa-43a6-bf80-0b8bcb41bd95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6815","nonce":116093},{"type":"v1","addr":"172.21.15.152:6817","nonce":116093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":116093},{"type":"v1","addr":"172.21.15.152:6819","nonce":116093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":116093},{"type":"v1","addr":"172.21.15.152:6823","nonce":116093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":116093},{"type":"v1","addr":"172.21.15.152:6821","nonce":116093}]},"public_addr":"172.21.15.152:6817/116093","cluster_addr":"172.21.15.152:6819/116093","heartbeat_back_addr":"172.21.15.152:6823/116093","heartbeat_front_addr":"172.21.15.152:6821/116093","state":["exists","up"]},{"osd":6,"uuid":"e59a4017-2d23-4627-836b-e25b2d3ddaaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":116094},{"type":"v1","addr":"172.21.15.152:6809","nonce":116094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":116094},{"type":"v1","addr":"172.21.15.152:6811","nonce":116094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":116094},{"type":"v1","addr":"172.21.15.152:6816","nonce":116094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":116094},{"type":"v1","addr":"172.21.15.152:6813","nonce":116094}]},"public_addr":"172.21.15.152:6809/116094","cluster_addr":"172.21.15.152:6811/116094","heartbeat_back_addr":"172.21.15.152:6816/116094","heartbeat_front_addr":"172.21.15.152:6813/116094","state":["exists","up"]},{"osd":7,"uuid":"8d7f9d4b-bf08-4670-8591-388c0f012a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":116097},{"type":"v1","addr":"172.21.15.152:6825","nonce":116097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":116097},{"type":"v1","addr":"172.21.15.152:6827","nonce":116097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":116097},{"type":"v1","addr":"172.21.15.152:6831","nonce":116097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":116097},{"type":"v1","addr":"172.21.15.152:6829","nonce":116097}]},"public_addr":"172.21.15.152:6825/116097","cluster_addr":"172.21.15.152:6827/116097","heartbeat_back_addr":"172.21.15.152:6831/116097","heartbeat_front_addr":"172.21.15.152:6829/116097","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.937710+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.865423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.159434+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.913090+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.131647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.966255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.972583+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.177209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T12:07:14.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.379+0000 7fc8c4bff700 1 -- 172.21.15.45:0/1194385960 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fc8a00682f0 msgr2=0x7fc8a006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:14.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.379+0000 7fc8c4bff700 1 --2- 172.21.15.45:0/1194385960 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fc8a00682f0 0x7fc8a006a7a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc8b0001c70 tx=0x7fc8b0009040 comp rx=0 tx=0).stop 2023-11-28T12:07:14.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.379+0000 7fc8c4bff700 1 -- 172.21.15.45:0/1194385960 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc8c0161340 msgr2=0x7fc8c00c5e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:14.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.379+0000 7fc8c4bff700 1 --2- 172.21.15.45:0/1194385960 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc8c0161340 0x7fc8c00c5e80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc8b8015000 tx=0x7fc8b8004ad0 comp rx=0 tx=0).stop 2023-11-28T12:07:14.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.379+0000 7fc8c4bff700 1 -- 172.21.15.45:0/1194385960 shutdown_connections 2023-11-28T12:07:14.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.379+0000 7fc8c4bff700 1 --2- 172.21.15.45:0/1194385960 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fc8a00682f0 0x7fc8a006a7a0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:14.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.379+0000 7fc8c4bff700 1 --2- 172.21.15.45:0/1194385960 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc8c00d2320 0x7fc8c01e8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:14.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.379+0000 7fc8c4bff700 1 --2- 172.21.15.45:0/1194385960 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc8c0161340 0x7fc8c00c5e80 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:14.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.379+0000 7fc8c4bff700 1 --2- 172.21.15.45:0/1194385960 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8c015c9b0 0x7fc8c01e65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:14.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.379+0000 7fc8c4bff700 1 -- 172.21.15.45:0/1194385960 >> 172.21.15.45:0/1194385960 conn(0x7fc8c0072600 msgr2=0x7fc8c015bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:14.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.379+0000 7fc8c4bff700 1 -- 172.21.15.45:0/1194385960 shutdown_connections 2023-11-28T12:07:14.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.379+0000 7fc8c4bff700 1 -- 172.21.15.45:0/1194385960 wait complete. 2023-11-28T12:07:14.399 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-28T12:06:21.807108+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-28T12:06:22.491009+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T12:06:27.684157+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T12:06:28.384679+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T12:07:14.400 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T12:07:14.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.605+0000 7f3d0dfff700 1 Processor -- start 2023-11-28T12:07:14.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.605+0000 7f3d0dfff700 1 -- start start 2023-11-28T12:07:14.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.606+0000 7f3d0dfff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3d0815c9b0 0x7f3d080b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:14.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.606+0000 7f3d0dfff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f3d080cd7c0 0x7f3d080cdc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:14.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.606+0000 7f3d0dfff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d080ce160 con 0x7f3d08161340 2023-11-28T12:07:14.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.606+0000 7f3d0dfff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d080b5800 con 0x7f3d080cd7c0 2023-11-28T12:07:14.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.606+0000 7f3d0dfff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d080d1950 con 0x7f3d0815c9b0 2023-11-28T12:07:14.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.606+0000 7f3d06ffd700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f3d08161340 0x7f3d080d1de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59712/0 (socket says 172.21.15.45:59712) 2023-11-28T12:07:14.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.606+0000 7f3d06ffd700 1 -- 172.21.15.45:0/48017146 learned_addr learned my addr 172.21.15.45:0/48017146 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:07:14.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.606+0000 7f3d07fff700 1 --2- 172.21.15.45:0/48017146 >> v2:172.21.15.152:3300/0 conn(0x7f3d080cd7c0 0x7f3d080cdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:14.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.606+0000 7f3d077fe700 1 --2- 172.21.15.45:0/48017146 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3d0815c9b0 0x7f3d080b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:14.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.606+0000 7f3d067fc700 1 -- 172.21.15.45:0/48017146 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3826560271 0 0) 0x7f3d080ce160 con 0x7f3d08161340 2023-11-28T12:07:14.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.606+0000 7f3d067fc700 1 -- 172.21.15.45:0/48017146 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3cf00035b0 con 0x7f3d08161340 2023-11-28T12:07:14.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.607+0000 7f3d067fc700 1 -- 172.21.15.45:0/48017146 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 240275207 0 0) 0x7f3cf00035b0 con 0x7f3d08161340 2023-11-28T12:07:14.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.607+0000 7f3d067fc700 1 -- 172.21.15.45:0/48017146 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3d0815c9b0 msgr2=0x7f3d080b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:14.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.607+0000 7f3d067fc700 1 --2- 172.21.15.45:0/48017146 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3d0815c9b0 0x7f3d080b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:14.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.607+0000 7f3d067fc700 1 -- 172.21.15.45:0/48017146 >> v2:172.21.15.152:3300/0 conn(0x7f3d080cd7c0 msgr2=0x7f3d080cdc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:14.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.607+0000 7f3d067fc700 1 --2- 172.21.15.45:0/48017146 >> v2:172.21.15.152:3300/0 conn(0x7f3d080cd7c0 0x7f3d080cdc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:14.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.607+0000 7f3d067fc700 1 -- 172.21.15.45:0/48017146 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d080d24f0 con 0x7f3d08161340 2023-11-28T12:07:14.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.607+0000 7f3d067fc700 1 -- 172.21.15.45:0/48017146 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3460218165 0 0) 0x7f3cfc001670 con 0x7f3d08161340 2023-11-28T12:07:14.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.607+0000 7f3d067fc700 1 -- 172.21.15.45:0/48017146 >> v1:172.21.15.45:6789/0 conn(0x7f3d08161340 legacy=0x7f3d080d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:14.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.607+0000 7f3d067fc700 1 --2- 172.21.15.45:0/48017146 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3d0815c9b0 0x7f3cf0003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:14.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.607+0000 7f3d067fc700 1 --2- 172.21.15.45:0/48017146 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3cf0003f80 0x7f3cf0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:14.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.607+0000 7f3d067fc700 1 --2- 172.21.15.45:0/48017146 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3cf0004d90 0x7f3cf0005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:14.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.607+0000 7f3d067fc700 1 -- 172.21.15.45:0/48017146 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d080b5800 con 0x7f3cf0003f80 2023-11-28T12:07:14.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.607+0000 7f3d067fc700 1 -- 172.21.15.45:0/48017146 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d080d1950 con 0x7f3cf0004d90 2023-11-28T12:07:14.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.607+0000 7f3d067fc700 1 -- 172.21.15.45:0/48017146 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf000ba40 con 0x7f3d0815c9b0 2023-11-28T12:07:14.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.607+0000 7f3d06ffd700 1 --2- 172.21.15.45:0/48017146 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3cf0003f80 0x7f3cf0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:14.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.607+0000 7f3d077fe700 1 --2- 172.21.15.45:0/48017146 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3d0815c9b0 0x7f3cf0003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:14.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.607+0000 7f3d07fff700 1 --2- 172.21.15.45:0/48017146 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3cf0004d90 0x7f3cf0005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:14.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.609+0000 7f3d06ffd700 1 -- 172.21.15.45:0/48017146 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3d0815c9b0 msgr2=0x7f3cf0003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:14.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.609+0000 7f3d06ffd700 1 --2- 172.21.15.45:0/48017146 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3d0815c9b0 0x7f3cf0003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:14.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.609+0000 7f3d06ffd700 1 -- 172.21.15.45:0/48017146 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3cf0004d90 msgr2=0x7f3cf0005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:14.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.609+0000 7f3d06ffd700 1 --2- 172.21.15.45:0/48017146 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3cf0004d90 0x7f3cf0005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:14.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.609+0000 7f3d06ffd700 1 -- 172.21.15.45:0/48017146 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cf00035b0 con 0x7f3cf0003f80 2023-11-28T12:07:14.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.609+0000 7f3d06ffd700 1 --2- 172.21.15.45:0/48017146 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3cf0003f80 0x7f3cf0004850 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc00c320 tx=0x7f3cf0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd585032ac94bb47 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:14.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.609+0000 7f3d067fc700 1 -- 172.21.15.45:0/48017146 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cfc00ce00 con 0x7f3cf0003f80 2023-11-28T12:07:14.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.609+0000 7f3d067fc700 1 -- 172.21.15.45:0/48017146 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cfc005960 con 0x7f3cf0003f80 2023-11-28T12:07:14.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.609+0000 7f3d067fc700 1 -- 172.21.15.45:0/48017146 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cfc005d10 con 0x7f3cf0003f80 2023-11-28T12:07:14.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.609+0000 7f3d0dfff700 1 -- 172.21.15.45:0/48017146 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3cf0003f80 msgr2=0x7f3cf0004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:14.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.609+0000 7f3d0dfff700 1 --2- 172.21.15.45:0/48017146 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3cf0003f80 0x7f3cf0004850 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc00c320 tx=0x7f3cf0005880 comp rx=0 tx=0).stop 2023-11-28T12:07:14.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.609+0000 7f3d07fff700 1 -- 172.21.15.45:0/48017146 reap_dead start 2023-11-28T12:07:14.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.609+0000 7f3d0dfff700 1 -- 172.21.15.45:0/48017146 shutdown_connections 2023-11-28T12:07:14.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.609+0000 7f3d0dfff700 1 -- 172.21.15.45:0/48017146 >> 172.21.15.45:0/48017146 conn(0x7f3d08072600 msgr2=0x7f3d080cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:14.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.609+0000 7f3d0dfff700 1 -- 172.21.15.45:0/48017146 shutdown_connections 2023-11-28T12:07:14.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.609+0000 7f3d0dfff700 1 -- 172.21.15.45:0/48017146 wait complete. 2023-11-28T12:07:14.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.610+0000 7f3d0dfff700 1 Processor -- start 2023-11-28T12:07:14.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.612+0000 7f3d0dfff700 1 -- start start 2023-11-28T12:07:14.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.613+0000 7f3d0dfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3cf0003f80 0x7f3d080cb800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:14.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.613+0000 7f3d0dfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3d080c83d0 0x7f3d08157770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:14.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.613+0000 7f3d0dfff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3d0815e2c0 0x7f3d0815e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:14.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.613+0000 7f3d0dfff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0815ec70 con 0x7f3cf0003f80 2023-11-28T12:07:14.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.613+0000 7f3d0dfff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d080c9890 con 0x7f3d080c83d0 2023-11-28T12:07:14.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.613+0000 7f3d0dfff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d080c8840 con 0x7f3d0815e2c0 2023-11-28T12:07:14.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.613+0000 7f3d077fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3cf0003f80 0x7f3d080cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:14.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.613+0000 7f3d077fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3cf0003f80 0x7f3d080cb800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60834/0 (socket says 172.21.15.45:60834) 2023-11-28T12:07:14.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.613+0000 7f3d077fe700 1 -- 172.21.15.45:0/1112745993 learned_addr learned my addr 172.21.15.45:0/1112745993 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:14.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.613+0000 7f3d06ffd700 1 --2- 172.21.15.45:0/1112745993 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3d080c83d0 0x7f3d08157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:14.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.613+0000 7f3d07fff700 1 --2- 172.21.15.45:0/1112745993 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3d0815e2c0 0x7f3d0815e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:14.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.613+0000 7f3d077fe700 1 -- 172.21.15.45:0/1112745993 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3d0815e2c0 msgr2=0x7f3d0815e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:14.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.613+0000 7f3d077fe700 1 --2- 172.21.15.45:0/1112745993 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3d0815e2c0 0x7f3d0815e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:14.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.613+0000 7f3d077fe700 1 -- 172.21.15.45:0/1112745993 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3d080c83d0 msgr2=0x7f3d08157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:14.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.613+0000 7f3d077fe700 1 --2- 172.21.15.45:0/1112745993 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3d080c83d0 0x7f3d08157770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:14.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.613+0000 7f3d077fe700 1 -- 172.21.15.45:0/1112745993 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d080d1300 con 0x7f3cf0003f80 2023-11-28T12:07:14.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.614+0000 7f3d077fe700 1 --2- 172.21.15.45:0/1112745993 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3cf0003f80 0x7f3d080cb800 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3cf8011ad0 tx=0x7f3cf8011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:14.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.614+0000 7f3ceffff700 1 -- 172.21.15.45:0/1112745993 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf800fa00 con 0x7f3cf0003f80 2023-11-28T12:07:14.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.614+0000 7f3ceffff700 1 -- 172.21.15.45:0/1112745993 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cf800fb60 con 0x7f3cf0003f80 2023-11-28T12:07:14.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.614+0000 7f3ceffff700 1 -- 172.21.15.45:0/1112745993 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf8014440 con 0x7f3cf0003f80 2023-11-28T12:07:14.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.614+0000 7f3d0dfff700 1 -- 172.21.15.45:0/1112745993 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d080b5520 con 0x7f3cf0003f80 2023-11-28T12:07:14.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.614+0000 7f3d0dfff700 1 -- 172.21.15.45:0/1112745993 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d080d15e0 con 0x7f3cf0003f80 2023-11-28T12:07:14.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.615+0000 7f3d0dfff700 1 -- 172.21.15.45:0/1112745993 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d080c9b70 con 0x7f3cf0003f80 2023-11-28T12:07:14.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.615+0000 7f3ceffff700 1 -- 172.21.15.45:0/1112745993 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f3cf80145a0 con 0x7f3cf0003f80 2023-11-28T12:07:14.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.617+0000 7f3ceffff700 1 --2- 172.21.15.45:0/1112745993 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f3cf40682f0 0x7f3cf406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:14.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.617+0000 7f3ceffff700 1 -- 172.21.15.45:0/1112745993 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3cf80865e0 con 0x7f3cf0003f80 2023-11-28T12:07:14.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.617+0000 7f3d06ffd700 1 --2- 172.21.15.45:0/1112745993 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f3cf40682f0 0x7f3cf406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:14.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.618+0000 7f3d06ffd700 1 --2- 172.21.15.45:0/1112745993 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f3cf40682f0 0x7f3cf406a7a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc000c00 tx=0x7f3cfc00a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:14.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.620+0000 7f3ceffff700 1 -- 172.21.15.45:0/1112745993 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f3cf8052db0 con 0x7f3cf0003f80 2023-11-28T12:07:14.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.824+0000 7f3d0dfff700 1 -- 172.21.15.45:0/1112745993 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3d080745c0 con 0x7f3cf0003f80 2023-11-28T12:07:14.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.824+0000 7f3ceffff700 1 -- 172.21.15.45:0/1112745993 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3cf80563d0 con 0x7f3cf0003f80 2023-11-28T12:07:14.825 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-11-28T12:07:14.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.826+0000 7f3d0dfff700 1 -- 172.21.15.45:0/1112745993 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f3cf40682f0 msgr2=0x7f3cf406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:14.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.826+0000 7f3d0dfff700 1 --2- 172.21.15.45:0/1112745993 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f3cf40682f0 0x7f3cf406a7a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc000c00 tx=0x7f3cfc00a000 comp rx=0 tx=0).stop 2023-11-28T12:07:14.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.826+0000 7f3d0dfff700 1 -- 172.21.15.45:0/1112745993 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3cf0003f80 msgr2=0x7f3d080cb800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:14.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.826+0000 7f3d0dfff700 1 --2- 172.21.15.45:0/1112745993 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3cf0003f80 0x7f3d080cb800 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3cf8011ad0 tx=0x7f3cf8011e90 comp rx=0 tx=0).stop 2023-11-28T12:07:14.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.826+0000 7f3d0dfff700 1 -- 172.21.15.45:0/1112745993 shutdown_connections 2023-11-28T12:07:14.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.826+0000 7f3d0dfff700 1 --2- 172.21.15.45:0/1112745993 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f3cf40682f0 0x7f3cf406a7a0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:14.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.826+0000 7f3d0dfff700 1 --2- 172.21.15.45:0/1112745993 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3d0815e2c0 0x7f3d0815e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:14.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.826+0000 7f3d0dfff700 1 --2- 172.21.15.45:0/1112745993 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3cf0003f80 0x7f3d080cb800 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:14.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.826+0000 7f3d0dfff700 1 --2- 172.21.15.45:0/1112745993 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3d080c83d0 0x7f3d08157770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:14.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.826+0000 7f3d0dfff700 1 -- 172.21.15.45:0/1112745993 >> 172.21.15.45:0/1112745993 conn(0x7f3d08072600 msgr2=0x7f3d0815ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:14.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.826+0000 7f3d0dfff700 1 -- 172.21.15.45:0/1112745993 shutdown_connections 2023-11-28T12:07:14.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:14.826+0000 7f3d0dfff700 1 -- 172.21.15.45:0/1112745993 wait complete. 2023-11-28T12:07:14.845 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T12:07:15.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.054+0000 7f64d33ff700 1 Processor -- start 2023-11-28T12:07:15.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.054+0000 7f64d33ff700 1 -- start start 2023-11-28T12:07:15.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.055+0000 7f64d33ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f64cc0d01b0 0x7f64cc0d0c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:15.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.055+0000 7f64d33ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f64cc0b16d0 0x7f64cc0d1160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:15.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.055+0000 7f64d33ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64cc0b0230 con 0x7f64cc0b20b0 2023-11-28T12:07:15.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.055+0000 7f64d33ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64cc15cec0 con 0x7f64cc0d01b0 2023-11-28T12:07:15.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.055+0000 7f64d33ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64cc0b4570 con 0x7f64cc0b16d0 2023-11-28T12:07:15.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.055+0000 7f64d119b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f64cc0d01b0 0x7f64cc0d0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:15.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.055+0000 7f64d119b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f64cc0d01b0 0x7f64cc0d0c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60836/0 (socket says 172.21.15.45:60836) 2023-11-28T12:07:15.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.055+0000 7f64d119b700 1 -- 172.21.15.45:0/3473958649 learned_addr learned my addr 172.21.15.45:0/3473958649 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:15.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.056+0000 7f64d199c700 1 --2- 172.21.15.45:0/3473958649 >> v2:172.21.15.152:3300/0 conn(0x7f64cc0b16d0 0x7f64cc0d1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:15.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.056+0000 7f64d119b700 1 -- 172.21.15.45:0/3473958649 >> v2:172.21.15.152:3300/0 conn(0x7f64cc0b16d0 msgr2=0x7f64cc0d1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:15.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.056+0000 7f64d119b700 1 --2- 172.21.15.45:0/3473958649 >> v2:172.21.15.152:3300/0 conn(0x7f64cc0b16d0 0x7f64cc0d1160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:15.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.056+0000 7f64d119b700 1 -- 172.21.15.45:0/3473958649 >> v1:172.21.15.152:6789/0 conn(0x7f64cc0b20b0 legacy=0x7f64cc0b29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:15.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.056+0000 7f64d119b700 1 -- 172.21.15.45:0/3473958649 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64cc0b4850 con 0x7f64cc0d01b0 2023-11-28T12:07:15.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.056+0000 7f64d119b700 1 --2- 172.21.15.45:0/3473958649 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64cc0d01b0 0x7f64cc0d0c20 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f64cc0cd630 tx=0x7f64c8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3686f867d421c14b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:15.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.056+0000 7f64c3fff700 1 -- 172.21.15.45:0/3473958649 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c8004230 con 0x7f64cc0d01b0 2023-11-28T12:07:15.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.056+0000 7f64c3fff700 1 -- 172.21.15.45:0/3473958649 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64c8004390 con 0x7f64cc0d01b0 2023-11-28T12:07:15.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.056+0000 7f64c3fff700 1 -- 172.21.15.45:0/3473958649 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c80036a0 con 0x7f64cc0d01b0 2023-11-28T12:07:15.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.057+0000 7f64d33ff700 1 -- 172.21.15.45:0/3473958649 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64cc0d01b0 msgr2=0x7f64cc0d0c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:15.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.057+0000 7f64d33ff700 1 --2- 172.21.15.45:0/3473958649 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64cc0d01b0 0x7f64cc0d0c20 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f64cc0cd630 tx=0x7f64c8009bd0 comp rx=0 tx=0).stop 2023-11-28T12:07:15.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.057+0000 7f64d33ff700 1 -- 172.21.15.45:0/3473958649 shutdown_connections 2023-11-28T12:07:15.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.057+0000 7f64d33ff700 1 --2- 172.21.15.45:0/3473958649 >> v2:172.21.15.152:3300/0 conn(0x7f64cc0b16d0 0x7f64cc0d1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:15.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.057+0000 7f64d33ff700 1 --2- 172.21.15.45:0/3473958649 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64cc0d01b0 0x7f64cc0d0c20 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:15.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.057+0000 7f64d33ff700 1 -- 172.21.15.45:0/3473958649 >> 172.21.15.45:0/3473958649 conn(0x7f64cc09c3f0 msgr2=0x7f64cc0d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:15.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.057+0000 7f64d33ff700 1 -- 172.21.15.45:0/3473958649 shutdown_connections 2023-11-28T12:07:15.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.057+0000 7f64d33ff700 1 -- 172.21.15.45:0/3473958649 wait complete. 2023-11-28T12:07:15.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.059+0000 7f64d33ff700 1 Processor -- start 2023-11-28T12:07:15.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.059+0000 7f64d33ff700 1 -- start start 2023-11-28T12:07:15.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.060+0000 7f64d33ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f64cc0b16d0 0x7f64cc1585d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:15.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.060+0000 7f64d33ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f64cc0b20b0 0x7f64cc0ce7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:15.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.060+0000 7f64d33ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64cc0d01b0 0x7f64cc0ced20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:15.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.060+0000 7f64d33ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64cc158b10 con 0x7f64cc0d01b0 2023-11-28T12:07:15.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.060+0000 7f64d33ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64cc0b6cc0 con 0x7f64cc0b16d0 2023-11-28T12:07:15.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.060+0000 7f64d33ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64cc0b6fa0 con 0x7f64cc0b20b0 2023-11-28T12:07:15.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.060+0000 7f64d199c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64cc0d01b0 0x7f64cc0ced20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:15.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.060+0000 7f64d199c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64cc0d01b0 0x7f64cc0ced20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60838/0 (socket says 172.21.15.45:60838) 2023-11-28T12:07:15.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.060+0000 7f64d199c700 1 -- 172.21.15.45:0/435087665 learned_addr learned my addr 172.21.15.45:0/435087665 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:15.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.060+0000 7f64d119b700 1 --2- 172.21.15.45:0/435087665 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f64cc0b16d0 0x7f64cc1585d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:15.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.060+0000 7f64d099a700 1 --2- 172.21.15.45:0/435087665 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f64cc0b20b0 0x7f64cc0ce7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:15.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.061+0000 7f64d199c700 1 -- 172.21.15.45:0/435087665 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f64cc0b20b0 msgr2=0x7f64cc0ce7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:15.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.061+0000 7f64d199c700 1 --2- 172.21.15.45:0/435087665 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f64cc0b20b0 0x7f64cc0ce7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:15.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.061+0000 7f64d199c700 1 -- 172.21.15.45:0/435087665 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f64cc0b16d0 msgr2=0x7f64cc1585d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:15.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.061+0000 7f64d199c700 1 --2- 172.21.15.45:0/435087665 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f64cc0b16d0 0x7f64cc1585d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:15.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.061+0000 7f64d199c700 1 -- 172.21.15.45:0/435087665 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64c8009550 con 0x7f64cc0d01b0 2023-11-28T12:07:15.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.061+0000 7f64d199c700 1 --2- 172.21.15.45:0/435087665 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64cc0d01b0 0x7f64cc0ced20 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f64c4007e40 tx=0x7f64c400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:15.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.061+0000 7f64c1ffb700 1 -- 172.21.15.45:0/435087665 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c400ed30 con 0x7f64cc0d01b0 2023-11-28T12:07:15.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.061+0000 7f64c1ffb700 1 -- 172.21.15.45:0/435087665 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64c4014420 con 0x7f64cc0d01b0 2023-11-28T12:07:15.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.061+0000 7f64d33ff700 1 -- 172.21.15.45:0/435087665 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64cc0afec0 con 0x7f64cc0d01b0 2023-11-28T12:07:15.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.061+0000 7f64c1ffb700 1 -- 172.21.15.45:0/435087665 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c40147d0 con 0x7f64cc0d01b0 2023-11-28T12:07:15.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.062+0000 7f64d33ff700 1 -- 172.21.15.45:0/435087665 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64cc0afbe0 con 0x7f64cc0d01b0 2023-11-28T12:07:15.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.062+0000 7f64d33ff700 1 -- 172.21.15.45:0/435087665 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64cc0b2600 con 0x7f64cc0d01b0 2023-11-28T12:07:15.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.063+0000 7f64c1ffb700 1 -- 172.21.15.45:0/435087665 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f64c4012050 con 0x7f64cc0d01b0 2023-11-28T12:07:15.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.064+0000 7f64c1ffb700 1 --2- 172.21.15.45:0/435087665 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f64b00682f0 0x7f64b006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:15.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.064+0000 7f64c1ffb700 1 -- 172.21.15.45:0/435087665 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f64c4086300 con 0x7f64cc0d01b0 2023-11-28T12:07:15.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.065+0000 7f64d119b700 1 --2- 172.21.15.45:0/435087665 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f64b00682f0 0x7f64b006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:15.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.066+0000 7f64d119b700 1 --2- 172.21.15.45:0/435087665 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f64b00682f0 0x7f64b006a7a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f64c8009130 tx=0x7f64c8008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:15.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.068+0000 7f64c1ffb700 1 -- 172.21.15.45:0/435087665 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f64c4052a70 con 0x7f64cc0d01b0 2023-11-28T12:07:15.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.268+0000 7f64d33ff700 1 -- 172.21.15.45:0/435087665 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f64cc068690 con 0x7f64cc0d01b0 2023-11-28T12:07:15.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.269+0000 7f64c1ffb700 1 -- 172.21.15.45:0/435087665 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f64c4056090 con 0x7f64cc0d01b0 2023-11-28T12:07:15.270 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-11-28T12:07:15.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.271+0000 7f64d33ff700 1 -- 172.21.15.45:0/435087665 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f64b00682f0 msgr2=0x7f64b006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:15.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.271+0000 7f64d33ff700 1 --2- 172.21.15.45:0/435087665 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f64b00682f0 0x7f64b006a7a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f64c8009130 tx=0x7f64c8008030 comp rx=0 tx=0).stop 2023-11-28T12:07:15.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.271+0000 7f64d33ff700 1 -- 172.21.15.45:0/435087665 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64cc0d01b0 msgr2=0x7f64cc0ced20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:15.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.271+0000 7f64d33ff700 1 --2- 172.21.15.45:0/435087665 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64cc0d01b0 0x7f64cc0ced20 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f64c4007e40 tx=0x7f64c400e3c0 comp rx=0 tx=0).stop 2023-11-28T12:07:15.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.271+0000 7f64d33ff700 1 -- 172.21.15.45:0/435087665 shutdown_connections 2023-11-28T12:07:15.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.271+0000 7f64d33ff700 1 --2- 172.21.15.45:0/435087665 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f64b00682f0 0x7f64b006a7a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:15.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.271+0000 7f64d33ff700 1 --2- 172.21.15.45:0/435087665 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f64cc0b16d0 0x7f64cc1585d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:15.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.271+0000 7f64d33ff700 1 --2- 172.21.15.45:0/435087665 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64cc0d01b0 0x7f64cc0ced20 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:15.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.271+0000 7f64d33ff700 1 --2- 172.21.15.45:0/435087665 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f64cc0b20b0 0x7f64cc0ce7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:15.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.271+0000 7f64d33ff700 1 -- 172.21.15.45:0/435087665 >> 172.21.15.45:0/435087665 conn(0x7f64cc09c3f0 msgr2=0x7f64cc0b0f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:15.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.271+0000 7f64d33ff700 1 -- 172.21.15.45:0/435087665 shutdown_connections 2023-11-28T12:07:15.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.271+0000 7f64d33ff700 1 -- 172.21.15.45:0/435087665 wait complete. 2023-11-28T12:07:15.290 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T12:07:15.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.496+0000 7fafc2dff700 1 Processor -- start 2023-11-28T12:07:15.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.496+0000 7fafc2dff700 1 -- start start 2023-11-28T12:07:15.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.497+0000 7fafc2dff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fafbc0b20b0 0x7fafbc0b0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:15.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.497+0000 7fafc2dff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafbc0b0230 con 0x7fafbc0d1330 2023-11-28T12:07:15.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.497+0000 7fafc2dff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafbc0b4570 con 0x7fafbc0d01b0 2023-11-28T12:07:15.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.497+0000 7fafc2dff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafbc15cec0 con 0x7fafbc0b20b0 2023-11-28T12:07:15.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.497+0000 7fafbbfff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fafbc0d1330 0x7fafbc0b06c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59724/0 (socket says 172.21.15.45:59724) 2023-11-28T12:07:15.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.497+0000 7fafbbfff700 1 -- 172.21.15.45:0/3252387945 learned_addr learned my addr 172.21.15.45:0/3252387945 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:07:15.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.498+0000 7fafc139c700 1 --2- 172.21.15.45:0/3252387945 >> v2:172.21.15.152:3300/0 conn(0x7fafbc0b20b0 0x7fafbc0b0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:15.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.498+0000 7fafbb7fe700 1 -- 172.21.15.45:0/3252387945 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 865299187 0 0) 0x7fafbc0b0230 con 0x7fafbc0d1330 2023-11-28T12:07:15.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.498+0000 7fafbb7fe700 1 -- 172.21.15.45:0/3252387945 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafac0035b0 con 0x7fafbc0d1330 2023-11-28T12:07:15.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.498+0000 7fafc139c700 1 -- 172.21.15.45:0/3252387945 >> v1:172.21.15.152:6789/0 conn(0x7fafbc0d01b0 legacy=0x7fafbc0d0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:15.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.498+0000 7fafc139c700 1 -- 172.21.15.45:0/3252387945 >> v1:172.21.15.45:6789/0 conn(0x7fafbc0d1330 legacy=0x7fafbc0b06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:15.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.498+0000 7fafc139c700 1 -- 172.21.15.45:0/3252387945 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafbc0b4850 con 0x7fafbc0b20b0 2023-11-28T12:07:15.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.498+0000 7fafc139c700 1 --2- 172.21.15.45:0/3252387945 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fafbc0b20b0 0x7fafbc0b0dd0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fafb4009d90 tx=0x7fafb400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4612405f183886ef server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:15.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.499+0000 7fafbb7fe700 1 -- 172.21.15.45:0/3252387945 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb400e070 con 0x7fafbc0b20b0 2023-11-28T12:07:15.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.499+0000 7fafbb7fe700 1 -- 172.21.15.45:0/3252387945 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafb400bb20 con 0x7fafbc0b20b0 2023-11-28T12:07:15.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.499+0000 7fafbb7fe700 1 -- 172.21.15.45:0/3252387945 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb4012430 con 0x7fafbc0b20b0 2023-11-28T12:07:15.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.499+0000 7fafc2dff700 1 -- 172.21.15.45:0/3252387945 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fafbc0b20b0 msgr2=0x7fafbc0b0dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:15.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.499+0000 7fafc2dff700 1 --2- 172.21.15.45:0/3252387945 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fafbc0b20b0 0x7fafbc0b0dd0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fafb4009d90 tx=0x7fafb400b330 comp rx=0 tx=0).stop 2023-11-28T12:07:15.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.499+0000 7fafc2dff700 1 -- 172.21.15.45:0/3252387945 shutdown_connections 2023-11-28T12:07:15.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.499+0000 7fafc2dff700 1 --2- 172.21.15.45:0/3252387945 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fafbc0b20b0 0x7fafbc0b0dd0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:15.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.499+0000 7fafc2dff700 1 -- 172.21.15.45:0/3252387945 >> 172.21.15.45:0/3252387945 conn(0x7fafbc09c3f0 msgr2=0x7fafbc0d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:15.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.499+0000 7fafc2dff700 1 -- 172.21.15.45:0/3252387945 shutdown_connections 2023-11-28T12:07:15.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.499+0000 7fafc2dff700 1 -- 172.21.15.45:0/3252387945 wait complete. 2023-11-28T12:07:15.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.501+0000 7fafc2dff700 1 Processor -- start 2023-11-28T12:07:15.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.501+0000 7fafc2dff700 1 -- start start 2023-11-28T12:07:15.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.502+0000 7fafc2dff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafbc0b20b0 0x7fafbc159130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:15.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.502+0000 7fafc2dff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fafbc0d01b0 0x7fafbc156590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:15.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.502+0000 7fafc2dff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fafbc0d1330 0x7fafbc15f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:15.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.502+0000 7fafc2dff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafbc158440 con 0x7fafbc0b20b0 2023-11-28T12:07:15.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.502+0000 7fafc2dff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafbc158ca0 con 0x7fafbc0d1330 2023-11-28T12:07:15.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.502+0000 7fafc2dff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafbc1f2c60 con 0x7fafbc0d01b0 2023-11-28T12:07:15.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.502+0000 7fafc0b9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafbc0b20b0 0x7fafbc159130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:15.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.502+0000 7fafc0b9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafbc0b20b0 0x7fafbc159130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60850/0 (socket says 172.21.15.45:60850) 2023-11-28T12:07:15.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.502+0000 7fafc0b9b700 1 -- 172.21.15.45:0/1548167162 learned_addr learned my addr 172.21.15.45:0/1548167162 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:15.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.503+0000 7fafc139c700 1 --2- 172.21.15.45:0/1548167162 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fafbc0d1330 0x7fafbc15f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:15.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.503+0000 7fafbbfff700 1 --2- 172.21.15.45:0/1548167162 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fafbc0d01b0 0x7fafbc156590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:15.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.503+0000 7fafc0b9b700 1 -- 172.21.15.45:0/1548167162 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fafbc0d01b0 msgr2=0x7fafbc156590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:15.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.503+0000 7fafc0b9b700 1 --2- 172.21.15.45:0/1548167162 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fafbc0d01b0 0x7fafbc156590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:15.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.503+0000 7fafc0b9b700 1 -- 172.21.15.45:0/1548167162 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fafbc0d1330 msgr2=0x7fafbc15f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:15.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.503+0000 7fafc0b9b700 1 --2- 172.21.15.45:0/1548167162 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fafbc0d1330 0x7fafbc15f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:15.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.503+0000 7fafc0b9b700 1 -- 172.21.15.45:0/1548167162 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafb4009a70 con 0x7fafbc0b20b0 2023-11-28T12:07:15.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.503+0000 7fafc0b9b700 1 --2- 172.21.15.45:0/1548167162 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafbc0b20b0 0x7fafbc159130 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fafb000c4e0 tx=0x7fafb000c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:15.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.503+0000 7fafb97fa700 1 -- 172.21.15.45:0/1548167162 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb00052d0 con 0x7fafbc0b20b0 2023-11-28T12:07:15.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.503+0000 7fafb97fa700 1 -- 172.21.15.45:0/1548167162 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafb0005430 con 0x7fafbc0b20b0 2023-11-28T12:07:15.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.503+0000 7fafc2dff700 1 -- 172.21.15.45:0/1548167162 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafbc0afec0 con 0x7fafbc0b20b0 2023-11-28T12:07:15.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.504+0000 7fafb97fa700 1 -- 172.21.15.45:0/1548167162 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb00038c0 con 0x7fafbc0b20b0 2023-11-28T12:07:15.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.504+0000 7fafc2dff700 1 -- 172.21.15.45:0/1548167162 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafbc0afbe0 con 0x7fafbc0b20b0 2023-11-28T12:07:15.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.505+0000 7fafc2dff700 1 -- 172.21.15.45:0/1548167162 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafbc0b2600 con 0x7fafbc0b20b0 2023-11-28T12:07:15.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.505+0000 7fafb97fa700 1 -- 172.21.15.45:0/1548167162 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fafb0019030 con 0x7fafbc0b20b0 2023-11-28T12:07:15.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.507+0000 7fafb97fa700 1 --2- 172.21.15.45:0/1548167162 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fafa00682f0 0x7fafa006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:15.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.507+0000 7fafb97fa700 1 -- 172.21.15.45:0/1548167162 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fafb0084fa0 con 0x7fafbc0b20b0 2023-11-28T12:07:15.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.507+0000 7fafbbfff700 1 --2- 172.21.15.45:0/1548167162 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fafa00682f0 0x7fafa006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:15.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.508+0000 7fafbbfff700 1 --2- 172.21.15.45:0/1548167162 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fafa00682f0 0x7fafa006a7a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fafbc06c260 tx=0x7fafa8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:15.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.510+0000 7fafb97fa700 1 -- 172.21.15.45:0/1548167162 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fafb0051800 con 0x7fafbc0b20b0 2023-11-28T12:07:15.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.710+0000 7fafc2dff700 1 -- 172.21.15.45:0/1548167162 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fafbc068690 con 0x7fafbc0b20b0 2023-11-28T12:07:15.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.710+0000 7fafb97fa700 1 -- 172.21.15.45:0/1548167162 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fafb0054e20 con 0x7fafbc0b20b0 2023-11-28T12:07:15.711 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-11-28T12:07:15.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.713+0000 7fafc2dff700 1 -- 172.21.15.45:0/1548167162 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fafa00682f0 msgr2=0x7fafa006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:15.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.713+0000 7fafc2dff700 1 --2- 172.21.15.45:0/1548167162 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fafa00682f0 0x7fafa006a7a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fafbc06c260 tx=0x7fafa8009040 comp rx=0 tx=0).stop 2023-11-28T12:07:15.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.713+0000 7fafc2dff700 1 -- 172.21.15.45:0/1548167162 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafbc0b20b0 msgr2=0x7fafbc159130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:15.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.713+0000 7fafc2dff700 1 --2- 172.21.15.45:0/1548167162 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafbc0b20b0 0x7fafbc159130 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fafb000c4e0 tx=0x7fafb000c7f0 comp rx=0 tx=0).stop 2023-11-28T12:07:15.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.713+0000 7fafc2dff700 1 -- 172.21.15.45:0/1548167162 shutdown_connections 2023-11-28T12:07:15.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.713+0000 7fafc2dff700 1 --2- 172.21.15.45:0/1548167162 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fafa00682f0 0x7fafa006a7a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:15.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.713+0000 7fafc2dff700 1 --2- 172.21.15.45:0/1548167162 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fafbc0d1330 0x7fafbc15f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:15.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.713+0000 7fafc2dff700 1 --2- 172.21.15.45:0/1548167162 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafbc0b20b0 0x7fafbc159130 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:15.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.713+0000 7fafc2dff700 1 --2- 172.21.15.45:0/1548167162 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fafbc0d01b0 0x7fafbc156590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:15.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.713+0000 7fafc2dff700 1 -- 172.21.15.45:0/1548167162 >> 172.21.15.45:0/1548167162 conn(0x7fafbc09c3f0 msgr2=0x7fafbc06ac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:15.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.713+0000 7fafc2dff700 1 -- 172.21.15.45:0/1548167162 shutdown_connections 2023-11-28T12:07:15.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.713+0000 7fafc2dff700 1 -- 172.21.15.45:0/1548167162 wait complete. 2023-11-28T12:07:15.732 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T12:07:15.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.938+0000 7f29dd7ff700 1 Processor -- start 2023-11-28T12:07:15.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.938+0000 7f29dd7ff700 1 -- start start 2023-11-28T12:07:15.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.939+0000 7f29dd7ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f29d8161340 0x7f29d80d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:15.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.939+0000 7f29dd7ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29d80d1950 con 0x7f29d80d2320 2023-11-28T12:07:15.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.939+0000 7f29dd7ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29d80b5520 con 0x7f29d815c9b0 2023-11-28T12:07:15.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.939+0000 7f29dd7ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29d80b5800 con 0x7f29d8161340 2023-11-28T12:07:15.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.940+0000 7f29d67fc700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f29d8161340 0x7f29d80d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:15.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.940+0000 7f29d67fc700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f29d8161340 0x7f29d80d1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60856/0 (socket says 172.21.15.45:60856) 2023-11-28T12:07:15.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.940+0000 7f29d67fc700 1 -- 172.21.15.45:0/1444687123 learned_addr learned my addr 172.21.15.45:0/1444687123 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:15.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.940+0000 7f29d67fc700 1 -- 172.21.15.45:0/1444687123 >> v1:172.21.15.152:6789/0 conn(0x7f29d815c9b0 legacy=0x7f29d80b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:15.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.940+0000 7f29d67fc700 1 -- 172.21.15.45:0/1444687123 >> v1:172.21.15.45:6789/0 conn(0x7f29d80d2320 legacy=0x7f29d80cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:15.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.940+0000 7f29d67fc700 1 -- 172.21.15.45:0/1444687123 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29d80d1300 con 0x7f29d8161340 2023-11-28T12:07:15.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.940+0000 7f29d67fc700 1 --2- 172.21.15.45:0/1444687123 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29d8161340 0x7f29d80d1de0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f29cc0098f0 tx=0x7f29cc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1ab88a70286aee4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:15.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.941+0000 7f29d5ffb700 1 -- 172.21.15.45:0/1444687123 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29cc00b8a0 con 0x7f29d8161340 2023-11-28T12:07:15.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.941+0000 7f29d5ffb700 1 -- 172.21.15.45:0/1444687123 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29cc00ba00 con 0x7f29d8161340 2023-11-28T12:07:15.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.941+0000 7f29d5ffb700 1 -- 172.21.15.45:0/1444687123 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29cc00bd90 con 0x7f29d8161340 2023-11-28T12:07:15.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.941+0000 7f29dd7ff700 1 -- 172.21.15.45:0/1444687123 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29d8161340 msgr2=0x7f29d80d1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:15.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.941+0000 7f29dd7ff700 1 --2- 172.21.15.45:0/1444687123 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29d8161340 0x7f29d80d1de0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f29cc0098f0 tx=0x7f29cc009c00 comp rx=0 tx=0).stop 2023-11-28T12:07:15.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.941+0000 7f29dd7ff700 1 -- 172.21.15.45:0/1444687123 shutdown_connections 2023-11-28T12:07:15.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.941+0000 7f29dd7ff700 1 --2- 172.21.15.45:0/1444687123 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29d8161340 0x7f29d80d1de0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:15.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.941+0000 7f29dd7ff700 1 -- 172.21.15.45:0/1444687123 >> 172.21.15.45:0/1444687123 conn(0x7f29d8072600 msgr2=0x7f29d80cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:15.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.941+0000 7f29dd7ff700 1 -- 172.21.15.45:0/1444687123 shutdown_connections 2023-11-28T12:07:15.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.941+0000 7f29dd7ff700 1 -- 172.21.15.45:0/1444687123 wait complete. 2023-11-28T12:07:15.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.943+0000 7f29dd7ff700 1 Processor -- start 2023-11-28T12:07:15.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.943+0000 7f29dd7ff700 1 -- start start 2023-11-28T12:07:15.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.944+0000 7f29dd7ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f29d80d2320 0x7f29d8156a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:15.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.944+0000 7f29dd7ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f29d815c9b0 0x7f29d81e8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:15.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.944+0000 7f29dd7ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29d8161340 0x7f29d80b85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:15.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.944+0000 7f29dd7ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29d80c6ca0 con 0x7f29d8161340 2023-11-28T12:07:15.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.944+0000 7f29dd7ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29d80c6f80 con 0x7f29d80d2320 2023-11-28T12:07:15.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.944+0000 7f29dd7ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29d80c7260 con 0x7f29d815c9b0 2023-11-28T12:07:15.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.945+0000 7f29d77fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29d8161340 0x7f29d80b85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:15.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.945+0000 7f29d77fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29d8161340 0x7f29d80b85a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60858/0 (socket says 172.21.15.45:60858) 2023-11-28T12:07:15.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.945+0000 7f29d77fe700 1 -- 172.21.15.45:0/3294712277 learned_addr learned my addr 172.21.15.45:0/3294712277 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:15.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.945+0000 7f29d67fc700 1 --2- 172.21.15.45:0/3294712277 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f29d815c9b0 0x7f29d81e8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:15.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.945+0000 7f29d6ffd700 1 --2- 172.21.15.45:0/3294712277 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f29d80d2320 0x7f29d8156a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:15.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.945+0000 7f29d77fe700 1 -- 172.21.15.45:0/3294712277 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f29d815c9b0 msgr2=0x7f29d81e8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:15.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.945+0000 7f29d77fe700 1 --2- 172.21.15.45:0/3294712277 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f29d815c9b0 0x7f29d81e8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:15.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.945+0000 7f29d77fe700 1 -- 172.21.15.45:0/3294712277 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f29d80d2320 msgr2=0x7f29d8156a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:15.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.945+0000 7f29d77fe700 1 --2- 172.21.15.45:0/3294712277 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f29d80d2320 0x7f29d8156a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:15.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.945+0000 7f29d77fe700 1 -- 172.21.15.45:0/3294712277 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29cc009550 con 0x7f29d8161340 2023-11-28T12:07:15.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.945+0000 7f29d67fc700 1 --2- 172.21.15.45:0/3294712277 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f29d815c9b0 0x7f29d81e8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:07:15.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.945+0000 7f29d6ffd700 1 --2- 172.21.15.45:0/3294712277 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f29d80d2320 0x7f29d8156a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:07:15.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.945+0000 7f29d77fe700 1 --2- 172.21.15.45:0/3294712277 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29d8161340 0x7f29d80b85a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f29d000cbc0 tx=0x7f29d000cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:15.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.946+0000 7f29bf7fe700 1 -- 172.21.15.45:0/3294712277 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d0003c00 con 0x7f29d8161340 2023-11-28T12:07:15.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.946+0000 7f29bf7fe700 1 -- 172.21.15.45:0/3294712277 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29d0003d60 con 0x7f29d8161340 2023-11-28T12:07:15.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.946+0000 7f29bf7fe700 1 -- 172.21.15.45:0/3294712277 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d000abf0 con 0x7f29d8161340 2023-11-28T12:07:15.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.946+0000 7f29dd7ff700 1 -- 172.21.15.45:0/3294712277 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29d815cd80 con 0x7f29d8161340 2023-11-28T12:07:15.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.946+0000 7f29dd7ff700 1 -- 172.21.15.45:0/3294712277 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29d80d15e0 con 0x7f29d8161340 2023-11-28T12:07:15.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.947+0000 7f29dd7ff700 1 -- 172.21.15.45:0/3294712277 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29d815cf10 con 0x7f29d8161340 2023-11-28T12:07:15.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.948+0000 7f29bf7fe700 1 -- 172.21.15.45:0/3294712277 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f29d0010050 con 0x7f29d8161340 2023-11-28T12:07:15.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.949+0000 7f29bf7fe700 1 --2- 172.21.15.45:0/3294712277 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f29c40682f0 0x7f29c406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:15.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.949+0000 7f29bf7fe700 1 -- 172.21.15.45:0/3294712277 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f29d0085c10 con 0x7f29d8161340 2023-11-28T12:07:15.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.949+0000 7f29d6ffd700 1 --2- 172.21.15.45:0/3294712277 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f29c40682f0 0x7f29c406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:15.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.950+0000 7f29d6ffd700 1 --2- 172.21.15.45:0/3294712277 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f29c40682f0 0x7f29c406a7a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f29c8000f60 tx=0x7f29c8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:15.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:15.953+0000 7f29bf7fe700 1 -- 172.21.15.45:0/3294712277 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f29d0052470 con 0x7f29d8161340 2023-11-28T12:07:16.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:16.154+0000 7f29dd7ff700 1 -- 172.21.15.45:0/3294712277 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f29d80745c0 con 0x7f29d8161340 2023-11-28T12:07:16.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:16.154+0000 7f29bf7fe700 1 -- 172.21.15.45:0/3294712277 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f29d0055a90 con 0x7f29d8161340 2023-11-28T12:07:16.156 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-11-28T12:07:16.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:16.157+0000 7f29dd7ff700 1 -- 172.21.15.45:0/3294712277 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f29c40682f0 msgr2=0x7f29c406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:16.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:16.157+0000 7f29dd7ff700 1 --2- 172.21.15.45:0/3294712277 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f29c40682f0 0x7f29c406a7a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f29c8000f60 tx=0x7f29c8009040 comp rx=0 tx=0).stop 2023-11-28T12:07:16.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:16.157+0000 7f29dd7ff700 1 -- 172.21.15.45:0/3294712277 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29d8161340 msgr2=0x7f29d80b85a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:16.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:16.157+0000 7f29dd7ff700 1 --2- 172.21.15.45:0/3294712277 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29d8161340 0x7f29d80b85a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f29d000cbc0 tx=0x7f29d000cf80 comp rx=0 tx=0).stop 2023-11-28T12:07:16.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:16.157+0000 7f29dd7ff700 1 -- 172.21.15.45:0/3294712277 shutdown_connections 2023-11-28T12:07:16.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:16.157+0000 7f29dd7ff700 1 --2- 172.21.15.45:0/3294712277 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f29c40682f0 0x7f29c406a7a0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:16.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:16.157+0000 7f29dd7ff700 1 --2- 172.21.15.45:0/3294712277 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f29d80d2320 0x7f29d8156a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:16.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:16.157+0000 7f29dd7ff700 1 --2- 172.21.15.45:0/3294712277 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29d8161340 0x7f29d80b85a0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:16.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:16.157+0000 7f29dd7ff700 1 --2- 172.21.15.45:0/3294712277 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f29d815c9b0 0x7f29d81e8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:16.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:16.157+0000 7f29dd7ff700 1 -- 172.21.15.45:0/3294712277 >> 172.21.15.45:0/3294712277 conn(0x7f29d8072600 msgr2=0x7f29d815f250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:16.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:16.157+0000 7f29dd7ff700 1 -- 172.21.15.45:0/3294712277 shutdown_connections 2023-11-28T12:07:16.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:16.157+0000 7f29dd7ff700 1 -- 172.21.15.45:0/3294712277 wait complete. 2023-11-28T12:07:16.177 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T12:07:16.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:16.381+0000 7fd5df1ff700 1 Processor -- start 2023-11-28T12:07:16.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:16.381+0000 7fd5df1ff700 1 -- start start 2023-11-28T12:07:16.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:16.382+0000 7fd5df1ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd5d815c9b0 0x7fd5d80b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:16.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:16.382+0000 7fd5df1ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5d80d1950 con 0x7fd5d8161340 2023-11-28T12:07:16.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:16.382+0000 7fd5df1ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5d80d24f0 con 0x7fd5d80cd7c0 2023-11-28T12:07:16.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:16.382+0000 7fd5df1ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5d80b5800 con 0x7fd5d815c9b0 2023-11-28T12:07:16.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:16.383+0000 7fd5dcf9b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd5d815c9b0 0x7fd5d80b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:16.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:16.383+0000 7fd5dcf9b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd5d815c9b0 0x7fd5d80b4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60866/0 (socket says 172.21.15.45:60866) 2023-11-28T12:07:16.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:16.383+0000 7fd5dcf9b700 1 -- 172.21.15.45:0/1175873360 learned_addr learned my addr 172.21.15.45:0/1175873360 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:16.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:16.383+0000 7fd5dcf9b700 1 -- 172.21.15.45:0/1175873360 >> v1:172.21.15.152:6789/0 conn(0x7fd5d80cd7c0 legacy=0x7fd5d80b5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:16.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:16.383+0000 7fd5dcf9b700 1 -- 172.21.15.45:0/1175873360 >> v1:172.21.15.45:6789/0 conn(0x7fd5d8161340 legacy=0x7fd5d80d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:16.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:16.383+0000 7fd5dcf9b700 1 -- 172.21.15.45:0/1175873360 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5d80b5520 con 0x7fd5d815c9b0 2023-11-28T12:07:16.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:16.383+0000 7fd5dcf9b700 1 --2- 172.21.15.45:0/1175873360 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5d815c9b0 0x7fd5d80b4bf0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc0098f0 tx=0x7fd5cc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=631350a385daa7a2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:16.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:16.384+0000 7fd5d77fe700 1 -- 172.21.15.45:0/1175873360 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5cc004230 con 0x7fd5d815c9b0 2023-11-28T12:07:16.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:16.384+0000 7fd5d77fe700 1 -- 172.21.15.45:0/1175873360 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5cc004390 con 0x7fd5d815c9b0 2023-11-28T12:07:16.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:16.384+0000 7fd5d77fe700 1 -- 172.21.15.45:0/1175873360 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5cc0036a0 con 0x7fd5d815c9b0 2023-11-28T12:07:16.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:16.384+0000 7fd5df1ff700 1 -- 172.21.15.45:0/1175873360 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5d815c9b0 msgr2=0x7fd5d80b4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:16.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:16.384+0000 7fd5df1ff700 1 --2- 172.21.15.45:0/1175873360 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5d815c9b0 0x7fd5d80b4bf0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc0098f0 tx=0x7fd5cc009c00 comp rx=0 tx=0).stop 2023-11-28T12:07:16.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:16.384+0000 7fd5df1ff700 1 -- 172.21.15.45:0/1175873360 shutdown_connections 2023-11-28T12:07:16.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:16.384+0000 7fd5df1ff700 1 --2- 172.21.15.45:0/1175873360 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5d815c9b0 0x7fd5d80b4bf0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:16.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:16.384+0000 7fd5df1ff700 1 -- 172.21.15.45:0/1175873360 >> 172.21.15.45:0/1175873360 conn(0x7fd5d8072600 msgr2=0x7fd5d80cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:16.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:16.384+0000 7fd5df1ff700 1 -- 172.21.15.45:0/1175873360 shutdown_connections 2023-11-28T12:07:16.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:16.384+0000 7fd5df1ff700 1 -- 172.21.15.45:0/1175873360 wait complete. 2023-11-28T12:07:16.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:16.386+0000 7fd5df1ff700 1 Processor -- start 2023-11-28T12:07:16.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:16.386+0000 7fd5df1ff700 1 -- start start 2023-11-28T12:07:16.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:16.387+0000 7fd5df1ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5d80cd7c0 0x7fd5d80c93f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:16.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:16.387+0000 7fd5df1ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5d815c9b0 0x7fd5d80c7390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:16.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:16.387+0000 7fd5df1ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd5d8161340 0x7fd5d8153530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:16.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:16.387+0000 7fd5df1ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d80cb8c0 con 0x7fd5d80cd7c0 2023-11-28T12:07:16.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:16.387+0000 7fd5df1ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d80cacb0 con 0x7fd5d815c9b0 2023-11-28T12:07:16.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:16.387+0000 7fd5df1ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d80caf90 con 0x7fd5d8161340 2023-11-28T12:07:16.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:16.387+0000 7fd5dcf9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5d80cd7c0 0x7fd5d80c93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:16.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:16.387+0000 7fd5dcf9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5d80cd7c0 0x7fd5d80c93f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60872/0 (socket says 172.21.15.45:60872) 2023-11-28T12:07:16.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:16.387+0000 7fd5dcf9b700 1 -- 172.21.15.45:0/1571308972 learned_addr learned my addr 172.21.15.45:0/1571308972 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:16.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:16.387+0000 7fd5d7fff700 1 --2- 172.21.15.45:0/1571308972 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5d815c9b0 0x7fd5d80c7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:16.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:16.388+0000 7fd5dd79c700 1 --2- 172.21.15.45:0/1571308972 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd5d8161340 0x7fd5d8153530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:16.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:16.388+0000 7fd5dcf9b700 1 -- 172.21.15.45:0/1571308972 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd5d8161340 msgr2=0x7fd5d8153530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:16.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:16.388+0000 7fd5dcf9b700 1 --2- 172.21.15.45:0/1571308972 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd5d8161340 0x7fd5d8153530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:16.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:16.388+0000 7fd5dcf9b700 1 -- 172.21.15.45:0/1571308972 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5d815c9b0 msgr2=0x7fd5d80c7390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:16.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:16.388+0000 7fd5dcf9b700 1 --2- 172.21.15.45:0/1571308972 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5d815c9b0 0x7fd5d80c7390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:16.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:16.388+0000 7fd5dcf9b700 1 -- 172.21.15.45:0/1571308972 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5cc009550 con 0x7fd5d80cd7c0 2023-11-28T12:07:16.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:16.388+0000 7fd5dd79c700 1 --2- 172.21.15.45:0/1571308972 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd5d8161340 0x7fd5d8153530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:07:16.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:16.388+0000 7fd5dcf9b700 1 --2- 172.21.15.45:0/1571308972 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5d80cd7c0 0x7fd5d80c93f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd5d80675d0 tx=0x7fd5cc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:16.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:16.388+0000 7fd5d57fa700 1 -- 172.21.15.45:0/1571308972 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5cc00b660 con 0x7fd5d80cd7c0 2023-11-28T12:07:16.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:16.388+0000 7fd5d57fa700 1 -- 172.21.15.45:0/1571308972 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5cc00b7e0 con 0x7fd5d80cd7c0 2023-11-28T12:07:16.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:16.388+0000 7fd5d57fa700 1 -- 172.21.15.45:0/1571308972 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5cc00bb90 con 0x7fd5d80cd7c0 2023-11-28T12:07:16.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:16.388+0000 7fd5df1ff700 1 -- 172.21.15.45:0/1571308972 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5d80d15e0 con 0x7fd5d80cd7c0 2023-11-28T12:07:16.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:16.388+0000 7fd5df1ff700 1 -- 172.21.15.45:0/1571308972 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5d80d1300 con 0x7fd5d80cd7c0 2023-11-28T12:07:16.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:16.389+0000 7fd5df1ff700 1 -- 172.21.15.45:0/1571308972 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5d80b5130 con 0x7fd5d80cd7c0 2023-11-28T12:07:16.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:16.390+0000 7fd5d57fa700 1 -- 172.21.15.45:0/1571308972 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fd5cc017020 con 0x7fd5d80cd7c0 2023-11-28T12:07:16.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:16.391+0000 7fd5d57fa700 1 --2- 172.21.15.45:0/1571308972 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fd5bc0682f0 0x7fd5bc06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:16.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:16.392+0000 7fd5d57fa700 1 -- 172.21.15.45:0/1571308972 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd5cc087640 con 0x7fd5d80cd7c0 2023-11-28T12:07:16.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:16.392+0000 7fd5d7fff700 1 --2- 172.21.15.45:0/1571308972 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fd5bc0682f0 0x7fd5bc06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:16.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:16.393+0000 7fd5d7fff700 1 --2- 172.21.15.45:0/1571308972 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fd5bc0682f0 0x7fd5bc06a7a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd5d80c70f0 tx=0x7fd5c4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:16.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:16.395+0000 7fd5d57fa700 1 -- 172.21.15.45:0/1571308972 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fd5cc053d50 con 0x7fd5d80cd7c0 2023-11-28T12:07:16.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:16.613+0000 7fd5df1ff700 1 -- 172.21.15.45:0/1571308972 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd5d80745c0 con 0x7fd5d80cd7c0 2023-11-28T12:07:16.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:16.613+0000 7fd5d57fa700 1 -- 172.21.15.45:0/1571308972 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd5cc00bcf0 con 0x7fd5d80cd7c0 2023-11-28T12:07:16.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:16.616+0000 7fd5df1ff700 1 -- 172.21.15.45:0/1571308972 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fd5bc0682f0 msgr2=0x7fd5bc06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:16.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:16.616+0000 7fd5df1ff700 1 --2- 172.21.15.45:0/1571308972 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fd5bc0682f0 0x7fd5bc06a7a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd5d80c70f0 tx=0x7fd5c4009040 comp rx=0 tx=0).stop 2023-11-28T12:07:16.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:16.616+0000 7fd5df1ff700 1 -- 172.21.15.45:0/1571308972 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5d80cd7c0 msgr2=0x7fd5d80c93f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:16.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:16.616+0000 7fd5df1ff700 1 --2- 172.21.15.45:0/1571308972 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5d80cd7c0 0x7fd5d80c93f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd5d80675d0 tx=0x7fd5cc004750 comp rx=0 tx=0).stop 2023-11-28T12:07:16.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:16.616+0000 7fd5df1ff700 1 -- 172.21.15.45:0/1571308972 shutdown_connections 2023-11-28T12:07:16.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:16.616+0000 7fd5df1ff700 1 --2- 172.21.15.45:0/1571308972 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fd5bc0682f0 0x7fd5bc06a7a0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:16.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:16.616+0000 7fd5df1ff700 1 --2- 172.21.15.45:0/1571308972 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd5d8161340 0x7fd5d8153530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:16.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:16.616+0000 7fd5df1ff700 1 --2- 172.21.15.45:0/1571308972 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5d80cd7c0 0x7fd5d80c93f0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:16.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:16.616+0000 7fd5df1ff700 1 --2- 172.21.15.45:0/1571308972 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5d815c9b0 0x7fd5d80c7390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:16.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:16.616+0000 7fd5df1ff700 1 -- 172.21.15.45:0/1571308972 >> 172.21.15.45:0/1571308972 conn(0x7fd5d8072600 msgr2=0x7fd5d80b8880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:16.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:16.616+0000 7fd5df1ff700 1 -- 172.21.15.45:0/1571308972 shutdown_connections 2023-11-28T12:07:16.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:16.616+0000 7fd5df1ff700 1 -- 172.21.15.45:0/1571308972 wait complete. 2023-11-28T12:07:16.618 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-11-28T12:07:16.634 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-11-28T12:07:16.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:07:16.635 DEBUG:teuthology.orchestra.run.smithi152:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-11-28T12:07:16.718 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi152.front.sepia.ceph.com 2023-11-28T12:07:16.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:07:16.718 DEBUG:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-28T12:07:16.777 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T12:07:16.777 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T12:07:16.824 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T12:07:16.825 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T12:07:16.911 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T12:07:16.912 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T12:07:16.999 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T12:07:17.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.244+0000 7f23703ff700 1 Processor -- start 2023-11-28T12:07:17.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.244+0000 7f23703ff700 1 -- start start 2023-11-28T12:07:17.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.245+0000 7f23703ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2368159860 0x7f23680c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:17.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.245+0000 7f23703ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f23680b0d80 0x7f23680c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:17.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.245+0000 7f23703ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23680ccc00 con 0x7f2368159490 2023-11-28T12:07:17.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.246+0000 7f23703ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23680ccec0 con 0x7f23680b0d80 2023-11-28T12:07:17.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.246+0000 7f23703ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23680cd1a0 con 0x7f2368159860 2023-11-28T12:07:17.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.246+0000 7f236d99a700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2368159860 0x7f23680c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:17.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.246+0000 7f236d99a700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2368159860 0x7f23680c94c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.45:40344/0 (socket says 172.21.15.45:40344) 2023-11-28T12:07:17.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.246+0000 7f236e99c700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f23680b0d80 0x7f23680c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:17.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.246+0000 7f236d99a700 1 -- 172.21.15.45:0/1502452488 learned_addr learned my addr 172.21.15.45:0/1502452488 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:17.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.247+0000 7f236d99a700 1 -- 172.21.15.45:0/1502452488 >> v2:172.21.15.152:3300/0 conn(0x7f23680b0d80 msgr2=0x7f23680c9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:17.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.247+0000 7f236d99a700 1 --2- 172.21.15.45:0/1502452488 >> v2:172.21.15.152:3300/0 conn(0x7f23680b0d80 0x7f23680c9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:17.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.247+0000 7f236d99a700 1 -- 172.21.15.45:0/1502452488 >> v1:172.21.15.152:6789/0 conn(0x7f2368159490 legacy=0x7f23680b0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:17.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.247+0000 7f236d199700 1 -- 172.21.15.45:0/1502452488 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 677293333 0 0) 0x7f23680ccc00 con 0x7f2368159490 2023-11-28T12:07:17.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.247+0000 7f236d99a700 1 -- 172.21.15.45:0/1502452488 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23680cd480 con 0x7f2368159860 2023-11-28T12:07:17.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.247+0000 7f236e99c700 1 --2- 172.21.15.45:0/1502452488 >> v2:172.21.15.152:3300/0 conn(0x7f23680b0d80 0x7f23680c9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:07:17.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.247+0000 7f236d99a700 1 --2- 172.21.15.45:0/1502452488 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2368159860 0x7f23680c94c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f23580098f0 tx=0x7f2358009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=abb139fdd1ea7aba server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:17.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.247+0000 7f236d199700 1 -- 172.21.15.45:0/1502452488 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2358011830 con 0x7f2368159860 2023-11-28T12:07:17.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.247+0000 7f236d199700 1 -- 172.21.15.45:0/1502452488 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2358011990 con 0x7f2368159860 2023-11-28T12:07:17.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.247+0000 7f236d199700 1 -- 172.21.15.45:0/1502452488 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2358011d20 con 0x7f2368159860 2023-11-28T12:07:17.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.248+0000 7f23703ff700 1 -- 172.21.15.45:0/1502452488 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2368159860 msgr2=0x7f23680c94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:17.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.248+0000 7f23703ff700 1 --2- 172.21.15.45:0/1502452488 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2368159860 0x7f23680c94c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f23580098f0 tx=0x7f2358009c00 comp rx=0 tx=0).stop 2023-11-28T12:07:17.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.248+0000 7f23703ff700 1 -- 172.21.15.45:0/1502452488 shutdown_connections 2023-11-28T12:07:17.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.248+0000 7f23703ff700 1 --2- 172.21.15.45:0/1502452488 >> v2:172.21.15.152:3300/0 conn(0x7f23680b0d80 0x7f23680c9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:17.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.248+0000 7f23703ff700 1 --2- 172.21.15.45:0/1502452488 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2368159860 0x7f23680c94c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:17.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.248+0000 7f23703ff700 1 -- 172.21.15.45:0/1502452488 >> 172.21.15.45:0/1502452488 conn(0x7f23680cb670 msgr2=0x7f23680cba70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:17.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.248+0000 7f23703ff700 1 -- 172.21.15.45:0/1502452488 shutdown_connections 2023-11-28T12:07:17.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.248+0000 7f23703ff700 1 -- 172.21.15.45:0/1502452488 wait complete. 2023-11-28T12:07:17.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.250+0000 7f23703ff700 1 Processor -- start 2023-11-28T12:07:17.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.250+0000 7f23703ff700 1 -- start start 2023-11-28T12:07:17.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.251+0000 7f23703ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f23680b0d80 0x7f2368159c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:17.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.251+0000 7f23703ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2368159490 0x7f2368153620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:17.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.251+0000 7f23703ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2368153d70 0x7f23680b4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:17.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.251+0000 7f23703ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23680b33f0 con 0x7f2368159490 2023-11-28T12:07:17.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.251+0000 7f23703ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23680b3c90 con 0x7f2368153d70 2023-11-28T12:07:17.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.251+0000 7f23703ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2368153b60 con 0x7f23680b0d80 2023-11-28T12:07:17.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.251+0000 7f236d99a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2368159490 0x7f2368153620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:17.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.251+0000 7f236d99a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2368159490 0x7f2368153620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60884/0 (socket says 172.21.15.45:60884) 2023-11-28T12:07:17.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.251+0000 7f236d99a700 1 -- 172.21.15.45:0/2123285890 learned_addr learned my addr 172.21.15.45:0/2123285890 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:17.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.251+0000 7f236e99c700 1 --2- 172.21.15.45:0/2123285890 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2368153d70 0x7f23680b4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:17.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.251+0000 7f236e19b700 1 --2- 172.21.15.45:0/2123285890 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f23680b0d80 0x7f2368159c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:17.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.251+0000 7f236d99a700 1 -- 172.21.15.45:0/2123285890 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f23680b0d80 msgr2=0x7f2368159c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:17.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.251+0000 7f236d99a700 1 --2- 172.21.15.45:0/2123285890 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f23680b0d80 0x7f2368159c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:17.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.251+0000 7f236d99a700 1 -- 172.21.15.45:0/2123285890 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2368153d70 msgr2=0x7f23680b4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:17.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.251+0000 7f236d99a700 1 --2- 172.21.15.45:0/2123285890 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2368153d70 0x7f23680b4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:17.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.251+0000 7f236d99a700 1 -- 172.21.15.45:0/2123285890 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2360009a70 con 0x7f2368159490 2023-11-28T12:07:17.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.251+0000 7f236e19b700 1 --2- 172.21.15.45:0/2123285890 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f23680b0d80 0x7f2368159c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:07:17.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.252+0000 7f236d99a700 1 --2- 172.21.15.45:0/2123285890 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2368159490 0x7f2368153620 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2358009130 tx=0x7f2358004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:17.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.252+0000 7f235effd700 1 -- 172.21.15.45:0/2123285890 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23580045d0 con 0x7f2368159490 2023-11-28T12:07:17.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.252+0000 7f235effd700 1 -- 172.21.15.45:0/2123285890 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f235801e070 con 0x7f2368159490 2023-11-28T12:07:17.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.252+0000 7f23703ff700 1 -- 172.21.15.45:0/2123285890 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2358009550 con 0x7f2368159490 2023-11-28T12:07:17.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.252+0000 7f235effd700 1 -- 172.21.15.45:0/2123285890 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23580038a0 con 0x7f2368159490 2023-11-28T12:07:17.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.252+0000 7f23703ff700 1 -- 172.21.15.45:0/2123285890 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23680c9f40 con 0x7f2368159490 2023-11-28T12:07:17.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.253+0000 7f23703ff700 1 -- 172.21.15.45:0/2123285890 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23680cd760 con 0x7f2368159490 2023-11-28T12:07:17.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.254+0000 7f235effd700 1 -- 172.21.15.45:0/2123285890 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f235800f050 con 0x7f2368159490 2023-11-28T12:07:17.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.255+0000 7f235effd700 1 --2- 172.21.15.45:0/2123285890 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f234c068320 0x7f234c06a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:17.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.255+0000 7f235effd700 1 -- 172.21.15.45:0/2123285890 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f2358086d10 con 0x7f2368159490 2023-11-28T12:07:17.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.255+0000 7f236e19b700 1 --2- 172.21.15.45:0/2123285890 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f234c068320 0x7f234c06a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:17.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.256+0000 7f236e19b700 1 --2- 172.21.15.45:0/2123285890 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f234c068320 0x7f234c06a7d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2364000f60 tx=0x7f2364009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:17.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.259+0000 7f235effd700 1 -- 172.21.15.45:0/2123285890 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f235808c020 con 0x7f2368159490 2023-11-28T12:07:17.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.468+0000 7f23703ff700 1 -- 172.21.15.45:0/2123285890 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f23680cdc80 con 0x7f2368159490 2023-11-28T12:07:17.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.469+0000 7f235effd700 1 -- 172.21.15.45:0/2123285890 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+17944 (secure 0 0 0) 0x7f2358015090 con 0x7f2368159490 2023-11-28T12:07:17.470 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:07:17.470 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":21,"fsid":"bd7c37f1-f7c6-4778-b845-52cf2aa6e366","created":"2023-11-28T12:06:09.045075+0000","modified":"2023-11-28T12:07:17.020702+0000","last_up_change":"2023-11-28T12:06:21.282227+0000","last_in_change":"2023-11-28T12:06:12.560924+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T12:06:21.807108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T12:06:22.491009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T12:06:27.684157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T12:06:28.384679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d0cdd8a-87fd-4f2c-91bd-47bdfa661905","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":115843},{"type":"v1","addr":"172.21.15.45:6808","nonce":115843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":115843},{"type":"v1","addr":"172.21.15.45:6811","nonce":115843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":115843},{"type":"v1","addr":"172.21.15.45:6815","nonce":115843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":115843},{"type":"v1","addr":"172.21.15.45:6813","nonce":115843}]},"public_addr":"172.21.15.45:6808/115843","cluster_addr":"172.21.15.45:6811/115843","heartbeat_back_addr":"172.21.15.45:6815/115843","heartbeat_front_addr":"172.21.15.45:6813/115843","state":["exists","up"]},{"osd":1,"uuid":"c5de4ebd-9ec5-40b3-9caa-9b706fab4c76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":115842},{"type":"v1","addr":"172.21.15.45:6801","nonce":115842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":115842},{"type":"v1","addr":"172.21.15.45:6803","nonce":115842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6807","nonce":115842},{"type":"v1","addr":"172.21.15.45:6809","nonce":115842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":115842},{"type":"v1","addr":"172.21.15.45:6805","nonce":115842}]},"public_addr":"172.21.15.45:6801/115842","cluster_addr":"172.21.15.45:6803/115842","heartbeat_back_addr":"172.21.15.45:6809/115842","heartbeat_front_addr":"172.21.15.45:6805/115842","state":["exists","up"]},{"osd":2,"uuid":"9f4b36b2-65d2-40e7-9fe6-a2991afa71c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":115850},{"type":"v1","addr":"172.21.15.45:6819","nonce":115850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":115850},{"type":"v1","addr":"172.21.15.45:6823","nonce":115850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":115850},{"type":"v1","addr":"172.21.15.45:6831","nonce":115850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":115850},{"type":"v1","addr":"172.21.15.45:6828","nonce":115850}]},"public_addr":"172.21.15.45:6819/115850","cluster_addr":"172.21.15.45:6823/115850","heartbeat_back_addr":"172.21.15.45:6831/115850","heartbeat_front_addr":"172.21.15.45:6828/115850","state":["exists","up"]},{"osd":3,"uuid":"6fe7ef05-4e0d-426c-bf94-44b51d4d550b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":115848},{"type":"v1","addr":"172.21.15.45:6818","nonce":115848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":115848},{"type":"v1","addr":"172.21.15.45:6822","nonce":115848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6827","nonce":115848},{"type":"v1","addr":"172.21.15.45:6829","nonce":115848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":115848},{"type":"v1","addr":"172.21.15.45:6825","nonce":115848}]},"public_addr":"172.21.15.45:6818/115848","cluster_addr":"172.21.15.45:6822/115848","heartbeat_back_addr":"172.21.15.45:6829/115848","heartbeat_front_addr":"172.21.15.45:6825/115848","state":["exists","up"]},{"osd":4,"uuid":"fa403c08-d8a1-4a3a-8384-cb465c1a654c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":116092},{"type":"v1","addr":"172.21.15.152:6801","nonce":116092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":116092},{"type":"v1","addr":"172.21.15.152:6803","nonce":116092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":116092},{"type":"v1","addr":"172.21.15.152:6807","nonce":116092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":116092},{"type":"v1","addr":"172.21.15.152:6805","nonce":116092}]},"public_addr":"172.21.15.152:6801/116092","cluster_addr":"172.21.15.152:6803/116092","heartbeat_back_addr":"172.21.15.152:6807/116092","heartbeat_front_addr":"172.21.15.152:6805/116092","state":["exists","up"]},{"osd":5,"uuid":"399fc450-39fa-43a6-bf80-0b8bcb41bd95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6815","nonce":116093},{"type":"v1","addr":"172.21.15.152:6817","nonce":116093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":116093},{"type":"v1","addr":"172.21.15.152:6819","nonce":116093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":116093},{"type":"v1","addr":"172.21.15.152:6823","nonce":116093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":116093},{"type":"v1","addr":"172.21.15.152:6821","nonce":116093}]},"public_addr":"172.21.15.152:6817/116093","cluster_addr":"172.21.15.152:6819/116093","heartbeat_back_addr":"172.21.15.152:6823/116093","heartbeat_front_addr":"172.21.15.152:6821/116093","state":["exists","up"]},{"osd":6,"uuid":"e59a4017-2d23-4627-836b-e25b2d3ddaaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":116094},{"type":"v1","addr":"172.21.15.152:6809","nonce":116094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":116094},{"type":"v1","addr":"172.21.15.152:6811","nonce":116094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":116094},{"type":"v1","addr":"172.21.15.152:6816","nonce":116094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":116094},{"type":"v1","addr":"172.21.15.152:6813","nonce":116094}]},"public_addr":"172.21.15.152:6809/116094","cluster_addr":"172.21.15.152:6811/116094","heartbeat_back_addr":"172.21.15.152:6816/116094","heartbeat_front_addr":"172.21.15.152:6813/116094","state":["exists","up"]},{"osd":7,"uuid":"8d7f9d4b-bf08-4670-8591-388c0f012a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":116097},{"type":"v1","addr":"172.21.15.152:6825","nonce":116097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":116097},{"type":"v1","addr":"172.21.15.152:6827","nonce":116097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":116097},{"type":"v1","addr":"172.21.15.152:6831","nonce":116097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":116097},{"type":"v1","addr":"172.21.15.152:6829","nonce":116097}]},"public_addr":"172.21.15.152:6825/116097","cluster_addr":"172.21.15.152:6827/116097","heartbeat_back_addr":"172.21.15.152:6831/116097","heartbeat_front_addr":"172.21.15.152:6829/116097","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.937710+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.865423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.159434+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.913090+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.131647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.966255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.972583+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.177209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.29","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T12:07:17.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.472+0000 7f23703ff700 1 -- 172.21.15.45:0/2123285890 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f234c068320 msgr2=0x7f234c06a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:17.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.472+0000 7f23703ff700 1 --2- 172.21.15.45:0/2123285890 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f234c068320 0x7f234c06a7d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2364000f60 tx=0x7f2364009040 comp rx=0 tx=0).stop 2023-11-28T12:07:17.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.472+0000 7f23703ff700 1 -- 172.21.15.45:0/2123285890 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2368159490 msgr2=0x7f2368153620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:17.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.472+0000 7f23703ff700 1 --2- 172.21.15.45:0/2123285890 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2368159490 0x7f2368153620 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2358009130 tx=0x7f2358004750 comp rx=0 tx=0).stop 2023-11-28T12:07:17.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.472+0000 7f23703ff700 1 -- 172.21.15.45:0/2123285890 shutdown_connections 2023-11-28T12:07:17.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.472+0000 7f23703ff700 1 --2- 172.21.15.45:0/2123285890 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f234c068320 0x7f234c06a7d0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:17.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.472+0000 7f23703ff700 1 --2- 172.21.15.45:0/2123285890 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2368153d70 0x7f23680b4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:17.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.472+0000 7f23703ff700 1 --2- 172.21.15.45:0/2123285890 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f23680b0d80 0x7f2368159c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:17.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.472+0000 7f23703ff700 1 --2- 172.21.15.45:0/2123285890 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2368159490 0x7f2368153620 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:17.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.472+0000 7f23703ff700 1 -- 172.21.15.45:0/2123285890 >> 172.21.15.45:0/2123285890 conn(0x7f23680cb670 msgr2=0x7f23680ac8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:17.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.472+0000 7f23703ff700 1 -- 172.21.15.45:0/2123285890 shutdown_connections 2023-11-28T12:07:17.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.472+0000 7f23703ff700 1 -- 172.21.15.45:0/2123285890 wait complete. 2023-11-28T12:07:17.491 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-28T12:06:21.807108+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-28T12:06:22.491009+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T12:06:27.684157+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T12:06:28.384679+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T12:07:17.491 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T12:07:17.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.698+0000 7f87f2dff700 1 Processor -- start 2023-11-28T12:07:17.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.698+0000 7f87f2dff700 1 -- start start 2023-11-28T12:07:17.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.699+0000 7f87f2dff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f87ec161340 0x7f87ec0d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:17.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.699+0000 7f87f2dff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f87ec0d2320 0x7f87ec0cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:17.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.699+0000 7f87f2dff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87ec0d1950 con 0x7f87ec15c9b0 2023-11-28T12:07:17.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.699+0000 7f87f2dff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87ec0b5800 con 0x7f87ec161340 2023-11-28T12:07:17.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.699+0000 7f87f2dff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87ec0b5300 con 0x7f87ec0d2320 2023-11-28T12:07:17.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.700+0000 7f87ebfff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f87ec161340 0x7f87ec0d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:17.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.700+0000 7f87f139c700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f87ec0d2320 0x7f87ec0cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:17.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.700+0000 7f87f0b9b700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f87ec15c9b0 0x7f87ec0b4bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.45:37044/0 (socket says 172.21.15.45:37044) 2023-11-28T12:07:17.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.700+0000 7f87f0b9b700 1 -- 172.21.15.45:0/228781324 learned_addr learned my addr 172.21.15.45:0/228781324 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:07:17.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.700+0000 7f87eb7fe700 1 -- 172.21.15.45:0/228781324 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1717703905 0 0) 0x7f87ec0d1950 con 0x7f87ec15c9b0 2023-11-28T12:07:17.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.700+0000 7f87ebfff700 1 -- 172.21.15.45:0/228781324 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f87ec0d2320 msgr2=0x7f87ec0cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:17.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.700+0000 7f87ebfff700 1 --2- 172.21.15.45:0/228781324 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f87ec0d2320 0x7f87ec0cd7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:17.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.700+0000 7f87ebfff700 1 -- 172.21.15.45:0/228781324 >> v1:172.21.15.152:6789/0 conn(0x7f87ec15c9b0 legacy=0x7f87ec0b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:17.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.700+0000 7f87ebfff700 1 -- 172.21.15.45:0/228781324 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87ec0b5520 con 0x7f87ec161340 2023-11-28T12:07:17.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.700+0000 7f87f139c700 1 --2- 172.21.15.45:0/228781324 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f87ec0d2320 0x7f87ec0cd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:07:17.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.701+0000 7f87ebfff700 1 --2- 172.21.15.45:0/228781324 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87ec161340 0x7f87ec0d1de0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f87d8009840 tx=0x7f87d8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36cb7451f3565135 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:17.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.701+0000 7f87eb7fe700 1 -- 172.21.15.45:0/228781324 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d8011830 con 0x7f87ec161340 2023-11-28T12:07:17.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.701+0000 7f87eb7fe700 1 -- 172.21.15.45:0/228781324 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87d8011990 con 0x7f87ec161340 2023-11-28T12:07:17.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.701+0000 7f87eb7fe700 1 -- 172.21.15.45:0/228781324 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d8011d20 con 0x7f87ec161340 2023-11-28T12:07:17.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.701+0000 7f87f2dff700 1 -- 172.21.15.45:0/228781324 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87ec161340 msgr2=0x7f87ec0d1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:17.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.701+0000 7f87f2dff700 1 --2- 172.21.15.45:0/228781324 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87ec161340 0x7f87ec0d1de0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f87d8009840 tx=0x7f87d8009b50 comp rx=0 tx=0).stop 2023-11-28T12:07:17.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.702+0000 7f87f2dff700 1 -- 172.21.15.45:0/228781324 shutdown_connections 2023-11-28T12:07:17.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.702+0000 7f87f2dff700 1 --2- 172.21.15.45:0/228781324 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f87ec0d2320 0x7f87ec0cd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:17.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.702+0000 7f87f2dff700 1 --2- 172.21.15.45:0/228781324 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87ec161340 0x7f87ec0d1de0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:17.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.702+0000 7f87f2dff700 1 -- 172.21.15.45:0/228781324 >> 172.21.15.45:0/228781324 conn(0x7f87ec072600 msgr2=0x7f87ec0cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:17.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.702+0000 7f87f2dff700 1 -- 172.21.15.45:0/228781324 shutdown_connections 2023-11-28T12:07:17.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.702+0000 7f87f2dff700 1 -- 172.21.15.45:0/228781324 wait complete. 2023-11-28T12:07:17.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.703+0000 7f87f2dff700 1 Processor -- start 2023-11-28T12:07:17.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.704+0000 7f87f2dff700 1 -- start start 2023-11-28T12:07:17.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.704+0000 7f87f2dff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f87ec0d2320 0x7f87ec157530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:17.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.704+0000 7f87f2dff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f87ec15c9b0 0x7f87ec0c7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:17.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.705+0000 7f87f2dff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87ec161340 0x7f87ec14d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:17.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.705+0000 7f87f2dff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87ec0c90c0 con 0x7f87ec15c9b0 2023-11-28T12:07:17.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.705+0000 7f87f2dff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87ec0c8230 con 0x7f87ec161340 2023-11-28T12:07:17.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.705+0000 7f87f2dff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87ec0c84b0 con 0x7f87ec0d2320 2023-11-28T12:07:17.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.705+0000 7f87ebfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f87ec15c9b0 0x7f87ec0c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:17.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.705+0000 7f87ebfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f87ec15c9b0 0x7f87ec0c7cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60890/0 (socket says 172.21.15.45:60890) 2023-11-28T12:07:17.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.705+0000 7f87ebfff700 1 -- 172.21.15.45:0/3172205018 learned_addr learned my addr 172.21.15.45:0/3172205018 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:17.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.705+0000 7f87f0b9b700 1 --2- 172.21.15.45:0/3172205018 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f87ec0d2320 0x7f87ec157530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:17.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.705+0000 7f87f139c700 1 --2- 172.21.15.45:0/3172205018 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87ec161340 0x7f87ec14d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:17.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.705+0000 7f87ebfff700 1 -- 172.21.15.45:0/3172205018 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f87ec0d2320 msgr2=0x7f87ec157530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:17.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.705+0000 7f87ebfff700 1 --2- 172.21.15.45:0/3172205018 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f87ec0d2320 0x7f87ec157530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:17.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.705+0000 7f87ebfff700 1 -- 172.21.15.45:0/3172205018 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87ec161340 msgr2=0x7f87ec14d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:17.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.705+0000 7f87ebfff700 1 --2- 172.21.15.45:0/3172205018 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87ec161340 0x7f87ec14d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:17.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.705+0000 7f87ebfff700 1 -- 172.21.15.45:0/3172205018 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87e4009a70 con 0x7f87ec15c9b0 2023-11-28T12:07:17.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.706+0000 7f87ebfff700 1 --2- 172.21.15.45:0/3172205018 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f87ec15c9b0 0x7f87ec0c7cf0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f87d80090b0 tx=0x7f87d8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:17.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.706+0000 7f87e97fa700 1 -- 172.21.15.45:0/3172205018 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d80045d0 con 0x7f87ec15c9b0 2023-11-28T12:07:17.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.706+0000 7f87e97fa700 1 -- 172.21.15.45:0/3172205018 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87d801f070 con 0x7f87ec15c9b0 2023-11-28T12:07:17.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.706+0000 7f87e97fa700 1 -- 172.21.15.45:0/3172205018 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d80038c0 con 0x7f87ec15c9b0 2023-11-28T12:07:17.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.706+0000 7f87f2dff700 1 -- 172.21.15.45:0/3172205018 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87d80094a0 con 0x7f87ec15c9b0 2023-11-28T12:07:17.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.706+0000 7f87f2dff700 1 -- 172.21.15.45:0/3172205018 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87ec0d15e0 con 0x7f87ec15c9b0 2023-11-28T12:07:17.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.707+0000 7f87f2dff700 1 -- 172.21.15.45:0/3172205018 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87ec0d1300 con 0x7f87ec15c9b0 2023-11-28T12:07:17.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.708+0000 7f87e97fa700 1 -- 172.21.15.45:0/3172205018 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f87d800f050 con 0x7f87ec15c9b0 2023-11-28T12:07:17.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.709+0000 7f87e97fa700 1 --2- 172.21.15.45:0/3172205018 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f87d00682f0 0x7f87d006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:17.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.709+0000 7f87e97fa700 1 -- 172.21.15.45:0/3172205018 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f87d8021070 con 0x7f87ec15c9b0 2023-11-28T12:07:17.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.710+0000 7f87f0b9b700 1 --2- 172.21.15.45:0/3172205018 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f87d00682f0 0x7f87d006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:17.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.710+0000 7f87f0b9b700 1 --2- 172.21.15.45:0/3172205018 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f87d00682f0 0x7f87d006a7a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f87e0000f60 tx=0x7f87e0007e70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:17.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.713+0000 7f87e97fa700 1 -- 172.21.15.45:0/3172205018 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f87d8053d70 con 0x7f87ec15c9b0 2023-11-28T12:07:17.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.912+0000 7f87f2dff700 1 -- 172.21.15.45:0/3172205018 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f87ec15cd80 con 0x7f87ec15c9b0 2023-11-28T12:07:17.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.913+0000 7f87e97fa700 1 -- 172.21.15.45:0/3172205018 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7f87d8057390 con 0x7f87ec15c9b0 2023-11-28T12:07:17.913 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-11-28T12:07:17.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.915+0000 7f87f2dff700 1 -- 172.21.15.45:0/3172205018 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f87d00682f0 msgr2=0x7f87d006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:17.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.915+0000 7f87f2dff700 1 --2- 172.21.15.45:0/3172205018 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f87d00682f0 0x7f87d006a7a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f87e0000f60 tx=0x7f87e0007e70 comp rx=0 tx=0).stop 2023-11-28T12:07:17.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.915+0000 7f87f2dff700 1 -- 172.21.15.45:0/3172205018 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f87ec15c9b0 msgr2=0x7f87ec0c7cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:17.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.915+0000 7f87f2dff700 1 --2- 172.21.15.45:0/3172205018 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f87ec15c9b0 0x7f87ec0c7cf0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f87d80090b0 tx=0x7f87d8004750 comp rx=0 tx=0).stop 2023-11-28T12:07:17.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.915+0000 7f87f2dff700 1 -- 172.21.15.45:0/3172205018 shutdown_connections 2023-11-28T12:07:17.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.915+0000 7f87f2dff700 1 --2- 172.21.15.45:0/3172205018 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f87d00682f0 0x7f87d006a7a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:17.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.915+0000 7f87f2dff700 1 --2- 172.21.15.45:0/3172205018 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87ec161340 0x7f87ec14d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:17.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.915+0000 7f87f2dff700 1 --2- 172.21.15.45:0/3172205018 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f87ec0d2320 0x7f87ec157530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:17.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.915+0000 7f87f2dff700 1 --2- 172.21.15.45:0/3172205018 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f87ec15c9b0 0x7f87ec0c7cf0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:17.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.915+0000 7f87f2dff700 1 -- 172.21.15.45:0/3172205018 >> 172.21.15.45:0/3172205018 conn(0x7f87ec072600 msgr2=0x7f87ec159a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:17.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.915+0000 7f87f2dff700 1 -- 172.21.15.45:0/3172205018 shutdown_connections 2023-11-28T12:07:17.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:17.915+0000 7f87f2dff700 1 -- 172.21.15.45:0/3172205018 wait complete. 2023-11-28T12:07:17.934 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T12:07:18.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.145+0000 7f335b59d700 1 Processor -- start 2023-11-28T12:07:18.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.145+0000 7f335b59d700 1 -- start start 2023-11-28T12:07:18.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.146+0000 7f335b59d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3354160af0 0x7f33540cf170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:18.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.146+0000 7f335b59d700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33540d0d20 con 0x7f335415c450 2023-11-28T12:07:18.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.147+0000 7f335b59d700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33540cf6b0 con 0x7f33540cffa0 2023-11-28T12:07:18.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.147+0000 7f335b59d700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33540cdd80 con 0x7f3354160af0 2023-11-28T12:07:18.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.147+0000 7f335a59b700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f335415c450 0x7f33540cf890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59748/0 (socket says 172.21.15.45:59748) 2023-11-28T12:07:18.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.147+0000 7f335a59b700 1 -- 172.21.15.45:0/3378933299 learned_addr learned my addr 172.21.15.45:0/3378933299 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:07:18.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.147+0000 7f335ad9c700 1 --2- 172.21.15.45:0/3378933299 >> v2:172.21.15.45:3300/0 conn(0x7f3354160af0 0x7f33540cf170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:18.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.147+0000 7f3359599700 1 -- 172.21.15.45:0/3378933299 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 163895357 0 0) 0x7f33540d0d20 con 0x7f335415c450 2023-11-28T12:07:18.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.147+0000 7f3359599700 1 -- 172.21.15.45:0/3378933299 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33400035b0 con 0x7f335415c450 2023-11-28T12:07:18.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.147+0000 7f335ad9c700 1 -- 172.21.15.45:0/3378933299 >> v1:172.21.15.152:6789/0 conn(0x7f33540cffa0 legacy=0x7f33540d11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:18.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.147+0000 7f335ad9c700 1 -- 172.21.15.45:0/3378933299 >> v1:172.21.15.45:6789/0 conn(0x7f335415c450 legacy=0x7f33540cf890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:18.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.147+0000 7f335ad9c700 1 -- 172.21.15.45:0/3378933299 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33540cd500 con 0x7f3354160af0 2023-11-28T12:07:18.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.148+0000 7f335ad9c700 1 --2- 172.21.15.45:0/3378933299 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3354160af0 0x7f33540cf170 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f334c009d90 tx=0x7f334c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3957ba08778ede13 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:18.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.148+0000 7f3359599700 1 -- 172.21.15.45:0/3378933299 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334c00e070 con 0x7f3354160af0 2023-11-28T12:07:18.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.148+0000 7f3359599700 1 -- 172.21.15.45:0/3378933299 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f334c00bae0 con 0x7f3354160af0 2023-11-28T12:07:18.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.148+0000 7f3359599700 1 -- 172.21.15.45:0/3378933299 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334c00be90 con 0x7f3354160af0 2023-11-28T12:07:18.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.148+0000 7f335b59d700 1 -- 172.21.15.45:0/3378933299 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3354160af0 msgr2=0x7f33540cf170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:18.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.148+0000 7f335b59d700 1 --2- 172.21.15.45:0/3378933299 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3354160af0 0x7f33540cf170 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f334c009d90 tx=0x7f334c00b330 comp rx=0 tx=0).stop 2023-11-28T12:07:18.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.148+0000 7f335b59d700 1 -- 172.21.15.45:0/3378933299 shutdown_connections 2023-11-28T12:07:18.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.148+0000 7f335b59d700 1 --2- 172.21.15.45:0/3378933299 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3354160af0 0x7f33540cf170 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:18.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.148+0000 7f335b59d700 1 -- 172.21.15.45:0/3378933299 >> 172.21.15.45:0/3378933299 conn(0x7f3354072630 msgr2=0x7f335406a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:18.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.149+0000 7f335b59d700 1 -- 172.21.15.45:0/3378933299 shutdown_connections 2023-11-28T12:07:18.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.149+0000 7f335b59d700 1 -- 172.21.15.45:0/3378933299 wait complete. 2023-11-28T12:07:18.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.150+0000 7f335b59d700 1 Processor -- start 2023-11-28T12:07:18.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.150+0000 7f335b59d700 1 -- start start 2023-11-28T12:07:18.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.151+0000 7f335b59d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33540cffa0 0x7f3354157ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:18.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.151+0000 7f335b59d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f335415c450 0x7f33540cbf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:18.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.151+0000 7f335b59d700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3354160af0 0x7f33540cc440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:18.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.151+0000 7f335b59d700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33541f2220 con 0x7f33540cffa0 2023-11-28T12:07:18.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.151+0000 7f335b59d700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33541f2d40 con 0x7f335415c450 2023-11-28T12:07:18.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.151+0000 7f335b59d700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33541f6790 con 0x7f3354160af0 2023-11-28T12:07:18.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.152+0000 7f335a59b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33540cffa0 0x7f3354157ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:18.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.152+0000 7f335a59b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33540cffa0 0x7f3354157ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60906/0 (socket says 172.21.15.45:60906) 2023-11-28T12:07:18.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.152+0000 7f335a59b700 1 -- 172.21.15.45:0/2241973486 learned_addr learned my addr 172.21.15.45:0/2241973486 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:18.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.152+0000 7f3359d9a700 1 --2- 172.21.15.45:0/2241973486 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f335415c450 0x7f33540cbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:18.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.152+0000 7f335ad9c700 1 --2- 172.21.15.45:0/2241973486 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3354160af0 0x7f33540cc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:18.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.152+0000 7f335a59b700 1 -- 172.21.15.45:0/2241973486 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3354160af0 msgr2=0x7f33540cc440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:18.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.152+0000 7f335a59b700 1 --2- 172.21.15.45:0/2241973486 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3354160af0 0x7f33540cc440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:18.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.152+0000 7f335a59b700 1 -- 172.21.15.45:0/2241973486 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f335415c450 msgr2=0x7f33540cbf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:18.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.152+0000 7f335a59b700 1 --2- 172.21.15.45:0/2241973486 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f335415c450 0x7f33540cbf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:18.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.152+0000 7f335a59b700 1 -- 172.21.15.45:0/2241973486 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f334c009a70 con 0x7f33540cffa0 2023-11-28T12:07:18.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.152+0000 7f3359d9a700 1 --2- 172.21.15.45:0/2241973486 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f335415c450 0x7f33540cbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:07:18.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.152+0000 7f335a59b700 1 --2- 172.21.15.45:0/2241973486 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33540cffa0 0x7f3354157ce0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f335000c4d0 tx=0x7f335000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:18.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.152+0000 7f334affd700 1 -- 172.21.15.45:0/2241973486 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3350005d70 con 0x7f33540cffa0 2023-11-28T12:07:18.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.153+0000 7f334affd700 1 -- 172.21.15.45:0/2241973486 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33500070d0 con 0x7f33540cffa0 2023-11-28T12:07:18.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.153+0000 7f335b59d700 1 -- 172.21.15.45:0/2241973486 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33540cd7c0 con 0x7f33540cffa0 2023-11-28T12:07:18.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.153+0000 7f334affd700 1 -- 172.21.15.45:0/2241973486 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3350007440 con 0x7f33540cffa0 2023-11-28T12:07:18.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.153+0000 7f335b59d700 1 -- 172.21.15.45:0/2241973486 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3354160f70 con 0x7f33540cffa0 2023-11-28T12:07:18.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.154+0000 7f335b59d700 1 -- 172.21.15.45:0/2241973486 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33540cdaa0 con 0x7f33540cffa0 2023-11-28T12:07:18.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.155+0000 7f334affd700 1 -- 172.21.15.45:0/2241973486 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f3350019030 con 0x7f33540cffa0 2023-11-28T12:07:18.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.155+0000 7f334affd700 1 --2- 172.21.15.45:0/2241973486 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f33380682f0 0x7f333806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:18.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.156+0000 7f334affd700 1 -- 172.21.15.45:0/2241973486 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f3350084ff0 con 0x7f33540cffa0 2023-11-28T12:07:18.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.156+0000 7f3359d9a700 1 --2- 172.21.15.45:0/2241973486 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f33380682f0 0x7f333806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:18.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.157+0000 7f3359d9a700 1 --2- 172.21.15.45:0/2241973486 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f33380682f0 0x7f333806a7a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3344006fd0 tx=0x7f3344008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:18.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.160+0000 7f334affd700 1 -- 172.21.15.45:0/2241973486 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f335004b5e0 con 0x7f33540cffa0 2023-11-28T12:07:18.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.359+0000 7f335b59d700 1 -- 172.21.15.45:0/2241973486 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3354061e80 con 0x7f33540cffa0 2023-11-28T12:07:18.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.360+0000 7f334affd700 1 -- 172.21.15.45:0/2241973486 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3350017020 con 0x7f33540cffa0 2023-11-28T12:07:18.360 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-11-28T12:07:18.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.362+0000 7f335b59d700 1 -- 172.21.15.45:0/2241973486 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f33380682f0 msgr2=0x7f333806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:18.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.362+0000 7f335b59d700 1 --2- 172.21.15.45:0/2241973486 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f33380682f0 0x7f333806a7a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3344006fd0 tx=0x7f3344008040 comp rx=0 tx=0).stop 2023-11-28T12:07:18.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.362+0000 7f335b59d700 1 -- 172.21.15.45:0/2241973486 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33540cffa0 msgr2=0x7f3354157ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:18.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.362+0000 7f335b59d700 1 --2- 172.21.15.45:0/2241973486 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33540cffa0 0x7f3354157ce0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f335000c4d0 tx=0x7f335000c890 comp rx=0 tx=0).stop 2023-11-28T12:07:18.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.362+0000 7f335b59d700 1 -- 172.21.15.45:0/2241973486 shutdown_connections 2023-11-28T12:07:18.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.362+0000 7f335b59d700 1 --2- 172.21.15.45:0/2241973486 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f33380682f0 0x7f333806a7a0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:18.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.362+0000 7f335b59d700 1 --2- 172.21.15.45:0/2241973486 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3354160af0 0x7f33540cc440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:18.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.362+0000 7f335b59d700 1 --2- 172.21.15.45:0/2241973486 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33540cffa0 0x7f3354157ce0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:18.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.362+0000 7f335b59d700 1 --2- 172.21.15.45:0/2241973486 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f335415c450 0x7f33540cbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:18.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.362+0000 7f335b59d700 1 -- 172.21.15.45:0/2241973486 >> 172.21.15.45:0/2241973486 conn(0x7f3354072630 msgr2=0x7f335415fea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:18.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.362+0000 7f335b59d700 1 -- 172.21.15.45:0/2241973486 shutdown_connections 2023-11-28T12:07:18.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.362+0000 7f335b59d700 1 -- 172.21.15.45:0/2241973486 wait complete. 2023-11-28T12:07:18.381 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T12:07:18.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.587+0000 7feb24bff700 1 Processor -- start 2023-11-28T12:07:18.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.587+0000 7feb24bff700 1 -- start start 2023-11-28T12:07:18.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.588+0000 7feb24bff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7feb200ce4b0 0x7feb2006c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:18.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.588+0000 7feb24bff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb2006bf10 con 0x7feb2006fb30 2023-11-28T12:07:18.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.588+0000 7feb24bff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb201590b0 con 0x7feb20158ce0 2023-11-28T12:07:18.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.588+0000 7feb24bff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb200cb0d0 con 0x7feb200ce4b0 2023-11-28T12:07:18.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.588+0000 7feb17fff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7feb2006fb30 0x7feb200cdda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59754/0 (socket says 172.21.15.45:59754) 2023-11-28T12:07:18.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.588+0000 7feb17fff700 1 -- 172.21.15.45:0/1183384117 learned_addr learned my addr 172.21.15.45:0/1183384117 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:07:18.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.589+0000 7feb1ed9d700 1 --2- 172.21.15.45:0/1183384117 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7feb200ce4b0 0x7feb2006c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:18.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.589+0000 7feb1dd9b700 1 -- 172.21.15.45:0/1183384117 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1972935866 0 0) 0x7feb2006bf10 con 0x7feb2006fb30 2023-11-28T12:07:18.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.589+0000 7feb1dd9b700 1 -- 172.21.15.45:0/1183384117 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb0c0035b0 con 0x7feb2006fb30 2023-11-28T12:07:18.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.589+0000 7feb1dd9b700 1 -- 172.21.15.45:0/1183384117 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2275435702 0 0) 0x7feb201590b0 con 0x7feb20158ce0 2023-11-28T12:07:18.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.589+0000 7feb1dd9b700 1 -- 172.21.15.45:0/1183384117 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb2006bf10 con 0x7feb20158ce0 2023-11-28T12:07:18.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.589+0000 7feb1dd9b700 1 -- 172.21.15.45:0/1183384117 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3323816352 0 0) 0x7feb0c0035b0 con 0x7feb2006fb30 2023-11-28T12:07:18.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.589+0000 7feb1dd9b700 1 -- 172.21.15.45:0/1183384117 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7feb200ce4b0 msgr2=0x7feb2006c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:18.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.589+0000 7feb1dd9b700 1 --2- 172.21.15.45:0/1183384117 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7feb200ce4b0 0x7feb2006c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:18.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.589+0000 7feb1dd9b700 1 -- 172.21.15.45:0/1183384117 >> v1:172.21.15.152:6789/0 conn(0x7feb20158ce0 legacy=0x7feb2015d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:18.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.589+0000 7feb1dd9b700 1 -- 172.21.15.45:0/1183384117 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb200cb3b0 con 0x7feb2006fb30 2023-11-28T12:07:18.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.589+0000 7feb1dd9b700 1 -- 172.21.15.45:0/1183384117 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3460218165 0 0) 0x7feb08001670 con 0x7feb2006fb30 2023-11-28T12:07:18.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.589+0000 7feb1dd9b700 1 -- 172.21.15.45:0/1183384117 >> v1:172.21.15.45:6789/0 conn(0x7feb2006fb30 legacy=0x7feb200cdda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:18.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.589+0000 7feb1dd9b700 1 --2- 172.21.15.45:0/1183384117 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7feb200ce4b0 0x7feb0c003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:18.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.589+0000 7feb1dd9b700 1 --2- 172.21.15.45:0/1183384117 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb0c004170 0x7feb0c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:18.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.589+0000 7feb1dd9b700 1 --2- 172.21.15.45:0/1183384117 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feb0c004d90 0x7feb0c005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:18.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.589+0000 7feb1dd9b700 1 -- 172.21.15.45:0/1183384117 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb200cb0d0 con 0x7feb0c004170 2023-11-28T12:07:18.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.589+0000 7feb1dd9b700 1 -- 172.21.15.45:0/1183384117 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb0c00dd30 con 0x7feb0c004d90 2023-11-28T12:07:18.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.589+0000 7feb1dd9b700 1 -- 172.21.15.45:0/1183384117 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb0c00def0 con 0x7feb200ce4b0 2023-11-28T12:07:18.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.590+0000 7feb17fff700 1 --2- 172.21.15.45:0/1183384117 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb0c004170 0x7feb0c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:18.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.590+0000 7feb1e59c700 1 --2- 172.21.15.45:0/1183384117 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7feb200ce4b0 0x7feb0c003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:18.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.590+0000 7feb1ed9d700 1 --2- 172.21.15.45:0/1183384117 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feb0c004d90 0x7feb0c005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:18.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.590+0000 7feb17fff700 1 -- 172.21.15.45:0/1183384117 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7feb200ce4b0 msgr2=0x7feb0c003bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:18.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.590+0000 7feb17fff700 1 --2- 172.21.15.45:0/1183384117 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7feb200ce4b0 0x7feb0c003bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:18.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.590+0000 7feb17fff700 1 -- 172.21.15.45:0/1183384117 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feb0c004d90 msgr2=0x7feb0c005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:18.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.590+0000 7feb17fff700 1 --2- 172.21.15.45:0/1183384117 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feb0c004d90 0x7feb0c005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:18.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.590+0000 7feb17fff700 1 -- 172.21.15.45:0/1183384117 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb0c0035b0 con 0x7feb0c004170 2023-11-28T12:07:18.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.590+0000 7feb17fff700 1 --2- 172.21.15.45:0/1183384117 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb0c004170 0x7feb0c004850 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7feb0800c160 tx=0x7feb0c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=612aa4fa68c14a2d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:18.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.591+0000 7feb1dd9b700 1 -- 172.21.15.45:0/1183384117 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb0800cc40 con 0x7feb0c004170 2023-11-28T12:07:18.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.591+0000 7feb1dd9b700 1 -- 172.21.15.45:0/1183384117 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb0800cda0 con 0x7feb0c004170 2023-11-28T12:07:18.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.591+0000 7feb1dd9b700 1 -- 172.21.15.45:0/1183384117 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb08005ba0 con 0x7feb0c004170 2023-11-28T12:07:18.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.591+0000 7feb24bff700 1 -- 172.21.15.45:0/1183384117 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb0c004170 msgr2=0x7feb0c004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:18.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.591+0000 7feb24bff700 1 --2- 172.21.15.45:0/1183384117 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb0c004170 0x7feb0c004850 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7feb0800c160 tx=0x7feb0c005880 comp rx=0 tx=0).stop 2023-11-28T12:07:18.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.591+0000 7feb1ed9d700 1 -- 172.21.15.45:0/1183384117 reap_dead start 2023-11-28T12:07:18.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.591+0000 7feb24bff700 1 -- 172.21.15.45:0/1183384117 shutdown_connections 2023-11-28T12:07:18.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.591+0000 7feb24bff700 1 -- 172.21.15.45:0/1183384117 >> 172.21.15.45:0/1183384117 conn(0x7feb200cb670 msgr2=0x7feb200cba70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:18.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.591+0000 7feb24bff700 1 -- 172.21.15.45:0/1183384117 shutdown_connections 2023-11-28T12:07:18.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.591+0000 7feb24bff700 1 -- 172.21.15.45:0/1183384117 wait complete. 2023-11-28T12:07:18.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.593+0000 7feb24bff700 1 Processor -- start 2023-11-28T12:07:18.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.593+0000 7feb24bff700 1 -- start start 2023-11-28T12:07:18.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.594+0000 7feb24bff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb0c004170 0x7feb20154390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:18.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.594+0000 7feb24bff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feb201e2040 0x7feb201e2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:18.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.594+0000 7feb24bff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7feb200b2a70 0x7feb200b2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:18.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.594+0000 7feb24bff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb200c7650 con 0x7feb0c004170 2023-11-28T12:07:18.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.594+0000 7feb24bff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb200b3420 con 0x7feb201e2040 2023-11-28T12:07:18.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.594+0000 7feb24bff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb200c8440 con 0x7feb200b2a70 2023-11-28T12:07:18.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.594+0000 7feb1e59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb0c004170 0x7feb20154390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:18.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.594+0000 7feb1e59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb0c004170 0x7feb20154390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60924/0 (socket says 172.21.15.45:60924) 2023-11-28T12:07:18.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.594+0000 7feb1e59c700 1 -- 172.21.15.45:0/2061496097 learned_addr learned my addr 172.21.15.45:0/2061496097 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:18.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.594+0000 7feb17fff700 1 --2- 172.21.15.45:0/2061496097 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feb201e2040 0x7feb201e2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:18.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.594+0000 7feb1ed9d700 1 --2- 172.21.15.45:0/2061496097 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7feb200b2a70 0x7feb200b2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:18.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.595+0000 7feb1e59c700 1 -- 172.21.15.45:0/2061496097 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7feb200b2a70 msgr2=0x7feb200b2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:18.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.595+0000 7feb1e59c700 1 --2- 172.21.15.45:0/2061496097 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7feb200b2a70 0x7feb200b2ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:18.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.595+0000 7feb1e59c700 1 -- 172.21.15.45:0/2061496097 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feb201e2040 msgr2=0x7feb201e2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:18.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.595+0000 7feb1e59c700 1 --2- 172.21.15.45:0/2061496097 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feb201e2040 0x7feb201e2490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:18.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.595+0000 7feb1e59c700 1 -- 172.21.15.45:0/2061496097 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb2006bba0 con 0x7feb0c004170 2023-11-28T12:07:18.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.595+0000 7feb17fff700 1 --2- 172.21.15.45:0/2061496097 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feb201e2040 0x7feb201e2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:07:18.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.595+0000 7feb1e59c700 1 --2- 172.21.15.45:0/2061496097 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb0c004170 0x7feb20154390 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7feb1000f840 tx=0x7feb1000fc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:18.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.595+0000 7feb16ffd700 1 -- 172.21.15.45:0/2061496097 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb100052e0 con 0x7feb0c004170 2023-11-28T12:07:18.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.595+0000 7feb16ffd700 1 -- 172.21.15.45:0/2061496097 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb10005480 con 0x7feb0c004170 2023-11-28T12:07:18.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.595+0000 7feb16ffd700 1 -- 172.21.15.45:0/2061496097 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb100038c0 con 0x7feb0c004170 2023-11-28T12:07:18.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.595+0000 7feb24bff700 1 -- 172.21.15.45:0/2061496097 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb2006b8c0 con 0x7feb0c004170 2023-11-28T12:07:18.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.596+0000 7feb24bff700 1 -- 172.21.15.45:0/2061496097 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb200c9370 con 0x7feb0c004170 2023-11-28T12:07:18.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.597+0000 7feb24bff700 1 -- 172.21.15.45:0/2061496097 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb200c8ba0 con 0x7feb0c004170 2023-11-28T12:07:18.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.597+0000 7feb16ffd700 1 -- 172.21.15.45:0/2061496097 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7feb10003a20 con 0x7feb0c004170 2023-11-28T12:07:18.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.598+0000 7feb16ffd700 1 --2- 172.21.15.45:0/2061496097 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7feb00068320 0x7feb0006a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:18.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.598+0000 7feb16ffd700 1 -- 172.21.15.45:0/2061496097 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6120+0+0 (secure 0 0 0) 0x7feb10085c80 con 0x7feb0c004170 2023-11-28T12:07:18.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.599+0000 7feb17fff700 1 --2- 172.21.15.45:0/2061496097 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7feb00068320 0x7feb0006a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:18.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.599+0000 7feb17fff700 1 --2- 172.21.15.45:0/2061496097 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7feb00068320 0x7feb0006a7d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7feb08015040 tx=0x7feb08007000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:18.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.602+0000 7feb16ffd700 1 -- 172.21.15.45:0/2061496097 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7feb10052410 con 0x7feb0c004170 2023-11-28T12:07:18.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.802+0000 7feb24bff700 1 -- 172.21.15.45:0/2061496097 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7feb200745c0 con 0x7feb0c004170 2023-11-28T12:07:18.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.802+0000 7feb16ffd700 1 -- 172.21.15.45:0/2061496097 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7feb10003cb0 con 0x7feb0c004170 2023-11-28T12:07:18.803 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-11-28T12:07:18.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.804+0000 7feb24bff700 1 -- 172.21.15.45:0/2061496097 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7feb00068320 msgr2=0x7feb0006a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:18.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.804+0000 7feb24bff700 1 --2- 172.21.15.45:0/2061496097 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7feb00068320 0x7feb0006a7d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7feb08015040 tx=0x7feb08007000 comp rx=0 tx=0).stop 2023-11-28T12:07:18.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.804+0000 7feb24bff700 1 -- 172.21.15.45:0/2061496097 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb0c004170 msgr2=0x7feb20154390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:18.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.804+0000 7feb24bff700 1 --2- 172.21.15.45:0/2061496097 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb0c004170 0x7feb20154390 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7feb1000f840 tx=0x7feb1000fc00 comp rx=0 tx=0).stop 2023-11-28T12:07:18.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.804+0000 7feb24bff700 1 -- 172.21.15.45:0/2061496097 shutdown_connections 2023-11-28T12:07:18.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.804+0000 7feb24bff700 1 --2- 172.21.15.45:0/2061496097 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7feb00068320 0x7feb0006a7d0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:18.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.804+0000 7feb24bff700 1 --2- 172.21.15.45:0/2061496097 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7feb200b2a70 0x7feb200b2ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:18.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.804+0000 7feb24bff700 1 --2- 172.21.15.45:0/2061496097 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb0c004170 0x7feb20154390 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:18.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.804+0000 7feb24bff700 1 --2- 172.21.15.45:0/2061496097 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feb201e2040 0x7feb201e2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:18.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.804+0000 7feb24bff700 1 -- 172.21.15.45:0/2061496097 >> 172.21.15.45:0/2061496097 conn(0x7feb200cb670 msgr2=0x7feb20157b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:18.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.805+0000 7feb24bff700 1 -- 172.21.15.45:0/2061496097 shutdown_connections 2023-11-28T12:07:18.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:18.805+0000 7feb24bff700 1 -- 172.21.15.45:0/2061496097 wait complete. 2023-11-28T12:07:18.823 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T12:07:19.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.029+0000 7f4cc57ff700 1 Processor -- start 2023-11-28T12:07:19.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.030+0000 7f4cc57ff700 1 -- start start 2023-11-28T12:07:19.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.031+0000 7f4cc57ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4cc00cd7c0 0x7f4cc00cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:19.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.031+0000 7f4cc57ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cc00d1950 con 0x7f4cc0161340 2023-11-28T12:07:19.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.031+0000 7f4cc57ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cc00ce140 con 0x7f4cc015c9b0 2023-11-28T12:07:19.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.031+0000 7f4cc57ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cc00b5800 con 0x7f4cc00cd7c0 2023-11-28T12:07:19.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.031+0000 7f4cbe7fc700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f4cc0161340 0x7f4cc00d1de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59760/0 (socket says 172.21.15.45:59760) 2023-11-28T12:07:19.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.031+0000 7f4cbe7fc700 1 -- 172.21.15.45:0/771785764 learned_addr learned my addr 172.21.15.45:0/771785764 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:07:19.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.031+0000 7f4cbf7fe700 1 --2- 172.21.15.45:0/771785764 >> v2:172.21.15.45:3300/0 conn(0x7f4cc00cd7c0 0x7f4cc00cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:19.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.032+0000 7f4cbdffb700 1 -- 172.21.15.45:0/771785764 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2228369128 0 0) 0x7f4cc00d1950 con 0x7f4cc0161340 2023-11-28T12:07:19.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.032+0000 7f4cbdffb700 1 -- 172.21.15.45:0/771785764 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ca80035b0 con 0x7f4cc0161340 2023-11-28T12:07:19.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.032+0000 7f4cbf7fe700 1 -- 172.21.15.45:0/771785764 >> v1:172.21.15.152:6789/0 conn(0x7f4cc015c9b0 legacy=0x7f4cc00b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:19.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.032+0000 7f4cbf7fe700 1 -- 172.21.15.45:0/771785764 >> v1:172.21.15.45:6789/0 conn(0x7f4cc0161340 legacy=0x7f4cc00d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:19.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.032+0000 7f4cbf7fe700 1 -- 172.21.15.45:0/771785764 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cc00d24f0 con 0x7f4cc00cd7c0 2023-11-28T12:07:19.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.032+0000 7f4cbf7fe700 1 --2- 172.21.15.45:0/771785764 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4cc00cd7c0 0x7f4cc00cdc00 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4cb8009d90 tx=0x7f4cb800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14afb26063114844 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:19.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.032+0000 7f4cbdffb700 1 -- 172.21.15.45:0/771785764 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cb800e070 con 0x7f4cc00cd7c0 2023-11-28T12:07:19.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.032+0000 7f4cbdffb700 1 -- 172.21.15.45:0/771785764 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cb800bb20 con 0x7f4cc00cd7c0 2023-11-28T12:07:19.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.032+0000 7f4cbdffb700 1 -- 172.21.15.45:0/771785764 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cb8012430 con 0x7f4cc00cd7c0 2023-11-28T12:07:19.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.033+0000 7f4cc57ff700 1 -- 172.21.15.45:0/771785764 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4cc00cd7c0 msgr2=0x7f4cc00cdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:19.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.033+0000 7f4cc57ff700 1 --2- 172.21.15.45:0/771785764 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4cc00cd7c0 0x7f4cc00cdc00 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4cb8009d90 tx=0x7f4cb800b330 comp rx=0 tx=0).stop 2023-11-28T12:07:19.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.033+0000 7f4cc57ff700 1 -- 172.21.15.45:0/771785764 shutdown_connections 2023-11-28T12:07:19.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.033+0000 7f4cc57ff700 1 --2- 172.21.15.45:0/771785764 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4cc00cd7c0 0x7f4cc00cdc00 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:19.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.033+0000 7f4cc57ff700 1 -- 172.21.15.45:0/771785764 >> 172.21.15.45:0/771785764 conn(0x7f4cc0072600 msgr2=0x7f4cc00cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:19.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.033+0000 7f4cc57ff700 1 -- 172.21.15.45:0/771785764 shutdown_connections 2023-11-28T12:07:19.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.033+0000 7f4cc57ff700 1 -- 172.21.15.45:0/771785764 wait complete. 2023-11-28T12:07:19.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.035+0000 7f4cc57ff700 1 Processor -- start 2023-11-28T12:07:19.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.036+0000 7f4cc57ff700 1 -- start start 2023-11-28T12:07:19.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.037+0000 7f4cc57ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4cc00cd7c0 0x7f4cc01f2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:19.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.037+0000 7f4cc57ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4cc015c9b0 0x7f4cc01f2a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:19.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.037+0000 7f4cc57ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4cc0161340 0x7f4cc00b8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:19.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.037+0000 7f4cc57ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cc015ddd0 con 0x7f4cc015c9b0 2023-11-28T12:07:19.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.037+0000 7f4cc57ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cc01f3040 con 0x7f4cc00cd7c0 2023-11-28T12:07:19.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.037+0000 7f4cc57ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cc01f3320 con 0x7f4cc0161340 2023-11-28T12:07:19.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.037+0000 7f4cbe7fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4cc015c9b0 0x7f4cc01f2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:19.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.037+0000 7f4cbe7fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4cc015c9b0 0x7f4cc01f2a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60936/0 (socket says 172.21.15.45:60936) 2023-11-28T12:07:19.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.037+0000 7f4cbe7fc700 1 -- 172.21.15.45:0/631973012 learned_addr learned my addr 172.21.15.45:0/631973012 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:19.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.037+0000 7f4cbeffd700 1 --2- 172.21.15.45:0/631973012 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4cc00cd7c0 0x7f4cc01f2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:19.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.037+0000 7f4cbf7fe700 1 --2- 172.21.15.45:0/631973012 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4cc0161340 0x7f4cc00b8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:19.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.038+0000 7f4cbe7fc700 1 -- 172.21.15.45:0/631973012 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4cc0161340 msgr2=0x7f4cc00b8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:19.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.038+0000 7f4cbe7fc700 1 --2- 172.21.15.45:0/631973012 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4cc0161340 0x7f4cc00b8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:19.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.038+0000 7f4cbe7fc700 1 -- 172.21.15.45:0/631973012 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4cc00cd7c0 msgr2=0x7f4cc01f2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:19.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.038+0000 7f4cbe7fc700 1 --2- 172.21.15.45:0/631973012 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4cc00cd7c0 0x7f4cc01f2510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:19.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.038+0000 7f4cbe7fc700 1 -- 172.21.15.45:0/631973012 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cb8009a70 con 0x7f4cc015c9b0 2023-11-28T12:07:19.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.038+0000 7f4cbe7fc700 1 --2- 172.21.15.45:0/631973012 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4cc015c9b0 0x7f4cc01f2a50 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4cb400c700 tx=0x7f4cb400ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:19.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.038+0000 7f4ca77fe700 1 -- 172.21.15.45:0/631973012 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cb4005d70 con 0x7f4cc015c9b0 2023-11-28T12:07:19.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.039+0000 7f4ca77fe700 1 -- 172.21.15.45:0/631973012 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cb40070d0 con 0x7f4cc015c9b0 2023-11-28T12:07:19.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.039+0000 7f4cc57ff700 1 -- 172.21.15.45:0/631973012 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cc00d1300 con 0x7f4cc015c9b0 2023-11-28T12:07:19.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.039+0000 7f4ca77fe700 1 -- 172.21.15.45:0/631973012 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cb4007460 con 0x7f4cc015c9b0 2023-11-28T12:07:19.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.039+0000 7f4cc57ff700 1 -- 172.21.15.45:0/631973012 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cc00b5520 con 0x7f4cc015c9b0 2023-11-28T12:07:19.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.040+0000 7f4cc57ff700 1 -- 172.21.15.45:0/631973012 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cc00d15e0 con 0x7f4cc015c9b0 2023-11-28T12:07:19.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.041+0000 7f4ca77fe700 1 -- 172.21.15.45:0/631973012 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f4cb4019030 con 0x7f4cc015c9b0 2023-11-28T12:07:19.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.041+0000 7f4ca77fe700 1 --2- 172.21.15.45:0/631973012 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f4cac0682f0 0x7f4cac06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:19.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.042+0000 7f4ca77fe700 1 -- 172.21.15.45:0/631973012 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f4cb4085110 con 0x7f4cc015c9b0 2023-11-28T12:07:19.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.042+0000 7f4cbeffd700 1 --2- 172.21.15.45:0/631973012 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f4cac0682f0 0x7f4cac06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:19.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.043+0000 7f4cbeffd700 1 --2- 172.21.15.45:0/631973012 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f4cac0682f0 0x7f4cac06a7a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4cc01f0100 tx=0x7f4cb0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:19.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.046+0000 7f4ca77fe700 1 -- 172.21.15.45:0/631973012 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f4cb4051760 con 0x7f4cc015c9b0 2023-11-28T12:07:19.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.250+0000 7f4cc57ff700 1 -- 172.21.15.45:0/631973012 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4cc00745c0 con 0x7f4cc015c9b0 2023-11-28T12:07:19.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.250+0000 7f4ca77fe700 1 -- 172.21.15.45:0/631973012 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4cb40170a0 con 0x7f4cc015c9b0 2023-11-28T12:07:19.251 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-11-28T12:07:19.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.253+0000 7f4cc57ff700 1 -- 172.21.15.45:0/631973012 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f4cac0682f0 msgr2=0x7f4cac06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:19.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.253+0000 7f4cc57ff700 1 --2- 172.21.15.45:0/631973012 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f4cac0682f0 0x7f4cac06a7a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4cc01f0100 tx=0x7f4cb0009040 comp rx=0 tx=0).stop 2023-11-28T12:07:19.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.253+0000 7f4cc57ff700 1 -- 172.21.15.45:0/631973012 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4cc015c9b0 msgr2=0x7f4cc01f2a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:19.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.253+0000 7f4cc57ff700 1 --2- 172.21.15.45:0/631973012 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4cc015c9b0 0x7f4cc01f2a50 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4cb400c700 tx=0x7f4cb400ca10 comp rx=0 tx=0).stop 2023-11-28T12:07:19.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.253+0000 7f4cc57ff700 1 -- 172.21.15.45:0/631973012 shutdown_connections 2023-11-28T12:07:19.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.253+0000 7f4cc57ff700 1 --2- 172.21.15.45:0/631973012 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f4cac0682f0 0x7f4cac06a7a0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:19.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.253+0000 7f4cc57ff700 1 --2- 172.21.15.45:0/631973012 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4cc00cd7c0 0x7f4cc01f2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:19.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.253+0000 7f4cc57ff700 1 --2- 172.21.15.45:0/631973012 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4cc0161340 0x7f4cc00b8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:19.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.253+0000 7f4cc57ff700 1 --2- 172.21.15.45:0/631973012 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4cc015c9b0 0x7f4cc01f2a50 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:19.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.253+0000 7f4cc57ff700 1 -- 172.21.15.45:0/631973012 >> 172.21.15.45:0/631973012 conn(0x7f4cc0072600 msgr2=0x7f4cc0160610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:19.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.253+0000 7f4cc57ff700 1 -- 172.21.15.45:0/631973012 shutdown_connections 2023-11-28T12:07:19.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.253+0000 7f4cc57ff700 1 -- 172.21.15.45:0/631973012 wait complete. 2023-11-28T12:07:19.272 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T12:07:19.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.476+0000 7f0146fff700 1 Processor -- start 2023-11-28T12:07:19.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.477+0000 7f0146fff700 1 -- start start 2023-11-28T12:07:19.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.478+0000 7f0146fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f014015c9b0 0x7f01400b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:19.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.478+0000 7f0146fff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0140161340 0x7f01400d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:19.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.478+0000 7f0146fff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01400d1950 con 0x7f01400d2320 2023-11-28T12:07:19.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.478+0000 7f0146fff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01400b5800 con 0x7f014015c9b0 2023-11-28T12:07:19.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.478+0000 7f0146fff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01400b5520 con 0x7f0140161340 2023-11-28T12:07:19.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.478+0000 7f0144d9b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f014015c9b0 0x7f01400b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:19.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.478+0000 7f014559c700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f01400d2320 0x7f01400cd7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59774/0 (socket says 172.21.15.45:59774) 2023-11-28T12:07:19.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.478+0000 7f014559c700 1 -- 172.21.15.45:0/900435100 learned_addr learned my addr 172.21.15.45:0/900435100 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:07:19.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.478+0000 7f013ffff700 1 --2- 172.21.15.45:0/900435100 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0140161340 0x7f01400d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:19.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.478+0000 7f0144d9b700 1 -- 172.21.15.45:0/900435100 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0140161340 msgr2=0x7f01400d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:19.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.478+0000 7f013f7fe700 1 -- 172.21.15.45:0/900435100 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 127234424 0 0) 0x7f01400d1950 con 0x7f01400d2320 2023-11-28T12:07:19.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.478+0000 7f0144d9b700 1 --2- 172.21.15.45:0/900435100 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0140161340 0x7f01400d1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:19.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.478+0000 7f0144d9b700 1 -- 172.21.15.45:0/900435100 >> v1:172.21.15.45:6789/0 conn(0x7f01400d2320 legacy=0x7f01400cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:19.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.478+0000 7f0144d9b700 1 -- 172.21.15.45:0/900435100 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01400d1300 con 0x7f014015c9b0 2023-11-28T12:07:19.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.479+0000 7f0144d9b700 1 --2- 172.21.15.45:0/900435100 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f014015c9b0 0x7f01400b4bf0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0134009840 tx=0x7f0134009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c8f796b2c9d87b6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:19.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.479+0000 7f013f7fe700 1 -- 172.21.15.45:0/900435100 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0134011830 con 0x7f014015c9b0 2023-11-28T12:07:19.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.479+0000 7f013f7fe700 1 -- 172.21.15.45:0/900435100 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0134011990 con 0x7f014015c9b0 2023-11-28T12:07:19.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.479+0000 7f013f7fe700 1 -- 172.21.15.45:0/900435100 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0134011d20 con 0x7f014015c9b0 2023-11-28T12:07:19.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.479+0000 7f0146fff700 1 -- 172.21.15.45:0/900435100 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f014015c9b0 msgr2=0x7f01400b4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:19.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.479+0000 7f0146fff700 1 --2- 172.21.15.45:0/900435100 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f014015c9b0 0x7f01400b4bf0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0134009840 tx=0x7f0134009b50 comp rx=0 tx=0).stop 2023-11-28T12:07:19.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.480+0000 7f0146fff700 1 -- 172.21.15.45:0/900435100 shutdown_connections 2023-11-28T12:07:19.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.480+0000 7f0146fff700 1 --2- 172.21.15.45:0/900435100 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f014015c9b0 0x7f01400b4bf0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:19.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.480+0000 7f0146fff700 1 --2- 172.21.15.45:0/900435100 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0140161340 0x7f01400d1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:19.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.480+0000 7f0146fff700 1 -- 172.21.15.45:0/900435100 >> 172.21.15.45:0/900435100 conn(0x7f0140072600 msgr2=0x7f01400cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:19.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.480+0000 7f0146fff700 1 -- 172.21.15.45:0/900435100 shutdown_connections 2023-11-28T12:07:19.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.480+0000 7f0146fff700 1 -- 172.21.15.45:0/900435100 wait complete. 2023-11-28T12:07:19.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.481+0000 7f0146fff700 1 Processor -- start 2023-11-28T12:07:19.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.481+0000 7f0146fff700 1 -- start start 2023-11-28T12:07:19.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.482+0000 7f0146fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01400d2320 0x7f01400c5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:19.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.482+0000 7f0146fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f014015c9b0 0x7f0140157860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:19.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.482+0000 7f0146fff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0140161340 0x7f0140154200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:19.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.482+0000 7f0146fff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01400c6410 con 0x7f01400d2320 2023-11-28T12:07:19.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.482+0000 7f0146fff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0140153160 con 0x7f014015c9b0 2023-11-28T12:07:19.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.482+0000 7f0146fff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0140153440 con 0x7f0140161340 2023-11-28T12:07:19.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.483+0000 7f0144d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01400d2320 0x7f01400c5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:19.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.483+0000 7f0144d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01400d2320 0x7f01400c5ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60948/0 (socket says 172.21.15.45:60948) 2023-11-28T12:07:19.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.483+0000 7f0144d9b700 1 -- 172.21.15.45:0/60876388 learned_addr learned my addr 172.21.15.45:0/60876388 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:19.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.483+0000 7f013ffff700 1 --2- 172.21.15.45:0/60876388 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f014015c9b0 0x7f0140157860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:19.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.483+0000 7f014559c700 1 --2- 172.21.15.45:0/60876388 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0140161340 0x7f0140154200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:19.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.483+0000 7f0144d9b700 1 -- 172.21.15.45:0/60876388 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0140161340 msgr2=0x7f0140154200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:19.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.483+0000 7f0144d9b700 1 --2- 172.21.15.45:0/60876388 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0140161340 0x7f0140154200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:19.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.483+0000 7f0144d9b700 1 -- 172.21.15.45:0/60876388 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f014015c9b0 msgr2=0x7f0140157860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:19.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.483+0000 7f0144d9b700 1 --2- 172.21.15.45:0/60876388 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f014015c9b0 0x7f0140157860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:19.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.483+0000 7f0144d9b700 1 -- 172.21.15.45:0/60876388 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01340094a0 con 0x7f01400d2320 2023-11-28T12:07:19.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.483+0000 7f014559c700 1 --2- 172.21.15.45:0/60876388 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0140161340 0x7f0140154200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:07:19.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.483+0000 7f0144d9b700 1 --2- 172.21.15.45:0/60876388 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01400d2320 0x7f01400c5ed0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f0134009fd0 tx=0x7f0134004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:19.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.484+0000 7f013d7fa700 1 -- 172.21.15.45:0/60876388 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01340038a0 con 0x7f01400d2320 2023-11-28T12:07:19.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.484+0000 7f013d7fa700 1 -- 172.21.15.45:0/60876388 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f013401f070 con 0x7f01400d2320 2023-11-28T12:07:19.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.484+0000 7f013d7fa700 1 -- 172.21.15.45:0/60876388 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0134003c40 con 0x7f01400d2320 2023-11-28T12:07:19.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.484+0000 7f0146fff700 1 -- 172.21.15.45:0/60876388 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01400b5130 con 0x7f01400d2320 2023-11-28T12:07:19.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.484+0000 7f0146fff700 1 -- 172.21.15.45:0/60876388 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01400d15e0 con 0x7f01400d2320 2023-11-28T12:07:19.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.485+0000 7f0146fff700 1 -- 172.21.15.45:0/60876388 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01400b52c0 con 0x7f01400d2320 2023-11-28T12:07:19.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.486+0000 7f013d7fa700 1 -- 172.21.15.45:0/60876388 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f013400f050 con 0x7f01400d2320 2023-11-28T12:07:19.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.487+0000 7f013d7fa700 1 --2- 172.21.15.45:0/60876388 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f0124068320 0x7f012406a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:19.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.487+0000 7f013d7fa700 1 -- 172.21.15.45:0/60876388 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f0134021070 con 0x7f01400d2320 2023-11-28T12:07:19.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.487+0000 7f013ffff700 1 --2- 172.21.15.45:0/60876388 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f0124068320 0x7f012406a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:19.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.488+0000 7f013ffff700 1 --2- 172.21.15.45:0/60876388 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f0124068320 0x7f012406a7d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f014015fcc0 tx=0x7f012c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:19.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.491+0000 7f013d7fa700 1 -- 172.21.15.45:0/60876388 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f0134053e20 con 0x7f01400d2320 2023-11-28T12:07:19.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.707+0000 7f0146fff700 1 -- 172.21.15.45:0/60876388 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f01400b9150 con 0x7f01400d2320 2023-11-28T12:07:19.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.707+0000 7f013d7fa700 1 -- 172.21.15.45:0/60876388 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7f0134057440 con 0x7f01400d2320 2023-11-28T12:07:19.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.709+0000 7f0146fff700 1 -- 172.21.15.45:0/60876388 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f0124068320 msgr2=0x7f012406a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:19.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.709+0000 7f0146fff700 1 --2- 172.21.15.45:0/60876388 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f0124068320 0x7f012406a7d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f014015fcc0 tx=0x7f012c008040 comp rx=0 tx=0).stop 2023-11-28T12:07:19.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.709+0000 7f0146fff700 1 -- 172.21.15.45:0/60876388 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01400d2320 msgr2=0x7f01400c5ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:19.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.709+0000 7f0146fff700 1 --2- 172.21.15.45:0/60876388 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01400d2320 0x7f01400c5ed0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f0134009fd0 tx=0x7f0134004750 comp rx=0 tx=0).stop 2023-11-28T12:07:19.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.709+0000 7f0146fff700 1 -- 172.21.15.45:0/60876388 shutdown_connections 2023-11-28T12:07:19.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.709+0000 7f0146fff700 1 --2- 172.21.15.45:0/60876388 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f0124068320 0x7f012406a7d0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:19.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.709+0000 7f0146fff700 1 --2- 172.21.15.45:0/60876388 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0140161340 0x7f0140154200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:19.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.709+0000 7f0146fff700 1 --2- 172.21.15.45:0/60876388 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01400d2320 0x7f01400c5ed0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:19.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.709+0000 7f0146fff700 1 --2- 172.21.15.45:0/60876388 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f014015c9b0 0x7f0140157860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:19.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.709+0000 7f0146fff700 1 -- 172.21.15.45:0/60876388 >> 172.21.15.45:0/60876388 conn(0x7f0140072600 msgr2=0x7f01400b8380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:19.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.710+0000 7f0146fff700 1 -- 172.21.15.45:0/60876388 shutdown_connections 2023-11-28T12:07:19.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:19.710+0000 7f0146fff700 1 -- 172.21.15.45:0/60876388 wait complete. 2023-11-28T12:07:19.712 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-11-28T12:07:19.729 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-11-28T12:07:19.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:07:19.729 DEBUG:teuthology.orchestra.run.smithi045:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-11-28T12:07:19.805 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi045.front.sepia.ceph.com 2023-11-28T12:07:19.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:07:19.805 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-28T12:07:19.852 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-11-28T12:07:19.853 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T12:07:19.905 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-11-28T12:07:19.905 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T12:07:19.954 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-11-28T12:07:19.954 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T12:07:20.041 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T12:07:20.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.246+0000 7febcffff700 1 Processor -- start 2023-11-28T12:07:20.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.246+0000 7febcffff700 1 -- start start 2023-11-28T12:07:20.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.247+0000 7febcffff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7febc8161340 0x7febc80d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:20.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.247+0000 7febcffff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7febc80d2320 0x7febc80cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:20.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.247+0000 7febcffff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febc80d1950 con 0x7febc815c9b0 2023-11-28T12:07:20.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.247+0000 7febcffff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febc80b5800 con 0x7febc8161340 2023-11-28T12:07:20.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.247+0000 7febcffff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febc80b5300 con 0x7febc80d2320 2023-11-28T12:07:20.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.248+0000 7febcdd9b700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7febc815c9b0 0x7febc80b4bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59788/0 (socket says 172.21.15.45:59788) 2023-11-28T12:07:20.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.248+0000 7febcdd9b700 1 -- 172.21.15.45:0/2246621142 learned_addr learned my addr 172.21.15.45:0/2246621142 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:07:20.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.248+0000 7febcd59a700 1 --2- 172.21.15.45:0/2246621142 >> v2:172.21.15.152:3300/0 conn(0x7febc8161340 0x7febc80d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:20.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.248+0000 7febce59c700 1 --2- 172.21.15.45:0/2246621142 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7febc80d2320 0x7febc80cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:20.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.248+0000 7febccd99700 1 -- 172.21.15.45:0/2246621142 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1342501347 0 0) 0x7febc80d1950 con 0x7febc815c9b0 2023-11-28T12:07:20.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.248+0000 7febccd99700 1 -- 172.21.15.45:0/2246621142 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7febb40035b0 con 0x7febc815c9b0 2023-11-28T12:07:20.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.248+0000 7febcd59a700 1 -- 172.21.15.45:0/2246621142 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7febc80d2320 msgr2=0x7febc80cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:20.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.248+0000 7febcd59a700 1 --2- 172.21.15.45:0/2246621142 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7febc80d2320 0x7febc80cd7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:20.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.248+0000 7febcd59a700 1 -- 172.21.15.45:0/2246621142 >> v1:172.21.15.45:6789/0 conn(0x7febc815c9b0 legacy=0x7febc80b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:20.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.248+0000 7febcd59a700 1 -- 172.21.15.45:0/2246621142 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febc80b5520 con 0x7febc8161340 2023-11-28T12:07:20.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.249+0000 7febcd59a700 1 --2- 172.21.15.45:0/2246621142 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7febc8161340 0x7febc80d1de0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7febb8009840 tx=0x7febb8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2d6e97b0b9d295f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:20.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.249+0000 7febccd99700 1 -- 172.21.15.45:0/2246621142 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb8011830 con 0x7febc8161340 2023-11-28T12:07:20.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.249+0000 7febccd99700 1 -- 172.21.15.45:0/2246621142 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febb8011990 con 0x7febc8161340 2023-11-28T12:07:20.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.249+0000 7febccd99700 1 -- 172.21.15.45:0/2246621142 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb8011d20 con 0x7febc8161340 2023-11-28T12:07:20.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.249+0000 7febcffff700 1 -- 172.21.15.45:0/2246621142 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7febc8161340 msgr2=0x7febc80d1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:20.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.249+0000 7febcffff700 1 --2- 172.21.15.45:0/2246621142 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7febc8161340 0x7febc80d1de0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7febb8009840 tx=0x7febb8009b50 comp rx=0 tx=0).stop 2023-11-28T12:07:20.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.249+0000 7febcffff700 1 -- 172.21.15.45:0/2246621142 shutdown_connections 2023-11-28T12:07:20.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.250+0000 7febcffff700 1 --2- 172.21.15.45:0/2246621142 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7febc80d2320 0x7febc80cd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:20.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.250+0000 7febcffff700 1 --2- 172.21.15.45:0/2246621142 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7febc8161340 0x7febc80d1de0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:20.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.250+0000 7febcffff700 1 -- 172.21.15.45:0/2246621142 >> 172.21.15.45:0/2246621142 conn(0x7febc8072600 msgr2=0x7febc80cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:20.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.250+0000 7febcffff700 1 -- 172.21.15.45:0/2246621142 shutdown_connections 2023-11-28T12:07:20.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.250+0000 7febcffff700 1 -- 172.21.15.45:0/2246621142 wait complete. 2023-11-28T12:07:20.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.251+0000 7febcffff700 1 Processor -- start 2023-11-28T12:07:20.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.251+0000 7febcffff700 1 -- start start 2023-11-28T12:07:20.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.252+0000 7febcffff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7febc80d2320 0x7febc81579c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:20.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.252+0000 7febcffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7febc815c9b0 0x7febc8159660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:20.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.252+0000 7febcffff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7febc8161340 0x7febc8159ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:20.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.252+0000 7febcffff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc8157f00 con 0x7febc815c9b0 2023-11-28T12:07:20.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.252+0000 7febcffff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc8158090 con 0x7febc8161340 2023-11-28T12:07:20.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.252+0000 7febcffff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febc8158350 con 0x7febc80d2320 2023-11-28T12:07:20.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.253+0000 7febcd59a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7febc815c9b0 0x7febc8159660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:20.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.253+0000 7febcd59a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7febc815c9b0 0x7febc8159660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60952/0 (socket says 172.21.15.45:60952) 2023-11-28T12:07:20.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.253+0000 7febcd59a700 1 -- 172.21.15.45:0/3354039275 learned_addr learned my addr 172.21.15.45:0/3354039275 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:20.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.253+0000 7febcdd9b700 1 --2- 172.21.15.45:0/3354039275 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7febc80d2320 0x7febc81579c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:20.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.253+0000 7febce59c700 1 --2- 172.21.15.45:0/3354039275 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7febc8161340 0x7febc8159ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:20.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.253+0000 7febcd59a700 1 -- 172.21.15.45:0/3354039275 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7febc80d2320 msgr2=0x7febc81579c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:20.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.253+0000 7febcd59a700 1 --2- 172.21.15.45:0/3354039275 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7febc80d2320 0x7febc81579c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:20.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.253+0000 7febcd59a700 1 -- 172.21.15.45:0/3354039275 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7febc8161340 msgr2=0x7febc8159ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:20.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.253+0000 7febcd59a700 1 --2- 172.21.15.45:0/3354039275 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7febc8161340 0x7febc8159ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:20.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.253+0000 7febcd59a700 1 -- 172.21.15.45:0/3354039275 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febb80094a0 con 0x7febc815c9b0 2023-11-28T12:07:20.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.254+0000 7febcd59a700 1 --2- 172.21.15.45:0/3354039275 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7febc815c9b0 0x7febc8159660 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7febb80090b0 tx=0x7febb8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:20.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.254+0000 7febbe7fc700 1 -- 172.21.15.45:0/3354039275 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb8004590 con 0x7febc815c9b0 2023-11-28T12:07:20.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.254+0000 7febbe7fc700 1 -- 172.21.15.45:0/3354039275 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febb801f070 con 0x7febc815c9b0 2023-11-28T12:07:20.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.254+0000 7febcffff700 1 -- 172.21.15.45:0/3354039275 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febc80d15e0 con 0x7febc815c9b0 2023-11-28T12:07:20.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.254+0000 7febbe7fc700 1 -- 172.21.15.45:0/3354039275 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb80038e0 con 0x7febc815c9b0 2023-11-28T12:07:20.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.254+0000 7febcffff700 1 -- 172.21.15.45:0/3354039275 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febc80d1300 con 0x7febc815c9b0 2023-11-28T12:07:20.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.255+0000 7febcffff700 1 -- 172.21.15.45:0/3354039275 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febc815cd80 con 0x7febc815c9b0 2023-11-28T12:07:20.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.256+0000 7febbe7fc700 1 -- 172.21.15.45:0/3354039275 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7febb800f050 con 0x7febc815c9b0 2023-11-28T12:07:20.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.257+0000 7febbe7fc700 1 --2- 172.21.15.45:0/3354039275 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7febac0682f0 0x7febac06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:20.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.257+0000 7febbe7fc700 1 -- 172.21.15.45:0/3354039275 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6120+0+0 (secure 0 0 0) 0x7febb8021070 con 0x7febc815c9b0 2023-11-28T12:07:20.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.257+0000 7febcdd9b700 1 --2- 172.21.15.45:0/3354039275 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7febac0682f0 0x7febac06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:20.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.258+0000 7febcdd9b700 1 --2- 172.21.15.45:0/3354039275 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7febac0682f0 0x7febac06a7a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7febc4007fd0 tx=0x7febc4007dc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:20.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.261+0000 7febbe7fc700 1 -- 172.21.15.45:0/3354039275 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7febb8053c60 con 0x7febc815c9b0 2023-11-28T12:07:20.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.465+0000 7febcffff700 1 -- 172.21.15.45:0/3354039275 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7febc80745c0 con 0x7febc815c9b0 2023-11-28T12:07:20.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.466+0000 7febbe7fc700 1 -- 172.21.15.45:0/3354039275 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+17944 (secure 0 0 0) 0x7febb8057280 con 0x7febc815c9b0 2023-11-28T12:07:20.467 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:07:20.467 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":22,"fsid":"bd7c37f1-f7c6-4778-b845-52cf2aa6e366","created":"2023-11-28T12:06:09.045075+0000","modified":"2023-11-28T12:07:18.025970+0000","last_up_change":"2023-11-28T12:06:21.282227+0000","last_in_change":"2023-11-28T12:06:12.560924+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T12:06:21.807108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T12:06:22.491009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T12:06:27.684157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T12:06:28.384679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d0cdd8a-87fd-4f2c-91bd-47bdfa661905","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":115843},{"type":"v1","addr":"172.21.15.45:6808","nonce":115843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":115843},{"type":"v1","addr":"172.21.15.45:6811","nonce":115843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":115843},{"type":"v1","addr":"172.21.15.45:6815","nonce":115843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":115843},{"type":"v1","addr":"172.21.15.45:6813","nonce":115843}]},"public_addr":"172.21.15.45:6808/115843","cluster_addr":"172.21.15.45:6811/115843","heartbeat_back_addr":"172.21.15.45:6815/115843","heartbeat_front_addr":"172.21.15.45:6813/115843","state":["exists","up"]},{"osd":1,"uuid":"c5de4ebd-9ec5-40b3-9caa-9b706fab4c76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":115842},{"type":"v1","addr":"172.21.15.45:6801","nonce":115842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":115842},{"type":"v1","addr":"172.21.15.45:6803","nonce":115842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6807","nonce":115842},{"type":"v1","addr":"172.21.15.45:6809","nonce":115842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":115842},{"type":"v1","addr":"172.21.15.45:6805","nonce":115842}]},"public_addr":"172.21.15.45:6801/115842","cluster_addr":"172.21.15.45:6803/115842","heartbeat_back_addr":"172.21.15.45:6809/115842","heartbeat_front_addr":"172.21.15.45:6805/115842","state":["exists","up"]},{"osd":2,"uuid":"9f4b36b2-65d2-40e7-9fe6-a2991afa71c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":115850},{"type":"v1","addr":"172.21.15.45:6819","nonce":115850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":115850},{"type":"v1","addr":"172.21.15.45:6823","nonce":115850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":115850},{"type":"v1","addr":"172.21.15.45:6831","nonce":115850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":115850},{"type":"v1","addr":"172.21.15.45:6828","nonce":115850}]},"public_addr":"172.21.15.45:6819/115850","cluster_addr":"172.21.15.45:6823/115850","heartbeat_back_addr":"172.21.15.45:6831/115850","heartbeat_front_addr":"172.21.15.45:6828/115850","state":["exists","up"]},{"osd":3,"uuid":"6fe7ef05-4e0d-426c-bf94-44b51d4d550b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":115848},{"type":"v1","addr":"172.21.15.45:6818","nonce":115848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":115848},{"type":"v1","addr":"172.21.15.45:6822","nonce":115848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6827","nonce":115848},{"type":"v1","addr":"172.21.15.45:6829","nonce":115848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":115848},{"type":"v1","addr":"172.21.15.45:6825","nonce":115848}]},"public_addr":"172.21.15.45:6818/115848","cluster_addr":"172.21.15.45:6822/115848","heartbeat_back_addr":"172.21.15.45:6829/115848","heartbeat_front_addr":"172.21.15.45:6825/115848","state":["exists","up"]},{"osd":4,"uuid":"fa403c08-d8a1-4a3a-8384-cb465c1a654c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":116092},{"type":"v1","addr":"172.21.15.152:6801","nonce":116092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":116092},{"type":"v1","addr":"172.21.15.152:6803","nonce":116092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":116092},{"type":"v1","addr":"172.21.15.152:6807","nonce":116092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":116092},{"type":"v1","addr":"172.21.15.152:6805","nonce":116092}]},"public_addr":"172.21.15.152:6801/116092","cluster_addr":"172.21.15.152:6803/116092","heartbeat_back_addr":"172.21.15.152:6807/116092","heartbeat_front_addr":"172.21.15.152:6805/116092","state":["exists","up"]},{"osd":5,"uuid":"399fc450-39fa-43a6-bf80-0b8bcb41bd95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6815","nonce":116093},{"type":"v1","addr":"172.21.15.152:6817","nonce":116093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":116093},{"type":"v1","addr":"172.21.15.152:6819","nonce":116093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":116093},{"type":"v1","addr":"172.21.15.152:6823","nonce":116093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":116093},{"type":"v1","addr":"172.21.15.152:6821","nonce":116093}]},"public_addr":"172.21.15.152:6817/116093","cluster_addr":"172.21.15.152:6819/116093","heartbeat_back_addr":"172.21.15.152:6823/116093","heartbeat_front_addr":"172.21.15.152:6821/116093","state":["exists","up"]},{"osd":6,"uuid":"e59a4017-2d23-4627-836b-e25b2d3ddaaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":116094},{"type":"v1","addr":"172.21.15.152:6809","nonce":116094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":116094},{"type":"v1","addr":"172.21.15.152:6811","nonce":116094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":116094},{"type":"v1","addr":"172.21.15.152:6816","nonce":116094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":116094},{"type":"v1","addr":"172.21.15.152:6813","nonce":116094}]},"public_addr":"172.21.15.152:6809/116094","cluster_addr":"172.21.15.152:6811/116094","heartbeat_back_addr":"172.21.15.152:6816/116094","heartbeat_front_addr":"172.21.15.152:6813/116094","state":["exists","up"]},{"osd":7,"uuid":"8d7f9d4b-bf08-4670-8591-388c0f012a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":116097},{"type":"v1","addr":"172.21.15.152:6825","nonce":116097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":116097},{"type":"v1","addr":"172.21.15.152:6827","nonce":116097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":116097},{"type":"v1","addr":"172.21.15.152:6831","nonce":116097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":116097},{"type":"v1","addr":"172.21.15.152:6829","nonce":116097}]},"public_addr":"172.21.15.152:6825/116097","cluster_addr":"172.21.15.152:6827/116097","heartbeat_back_addr":"172.21.15.152:6831/116097","heartbeat_front_addr":"172.21.15.152:6829/116097","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.937710+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.865423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.159434+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.913090+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.131647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.966255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.972583+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.177209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.29","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T12:07:20.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.468+0000 7febcffff700 1 -- 172.21.15.45:0/3354039275 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7febac0682f0 msgr2=0x7febac06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:20.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.468+0000 7febcffff700 1 --2- 172.21.15.45:0/3354039275 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7febac0682f0 0x7febac06a7a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7febc4007fd0 tx=0x7febc4007dc0 comp rx=0 tx=0).stop 2023-11-28T12:07:20.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.468+0000 7febcffff700 1 -- 172.21.15.45:0/3354039275 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7febc815c9b0 msgr2=0x7febc8159660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:20.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.468+0000 7febcffff700 1 --2- 172.21.15.45:0/3354039275 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7febc815c9b0 0x7febc8159660 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7febb80090b0 tx=0x7febb8004750 comp rx=0 tx=0).stop 2023-11-28T12:07:20.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.469+0000 7febcffff700 1 -- 172.21.15.45:0/3354039275 shutdown_connections 2023-11-28T12:07:20.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.469+0000 7febcffff700 1 --2- 172.21.15.45:0/3354039275 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7febac0682f0 0x7febac06a7a0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:20.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.469+0000 7febcffff700 1 --2- 172.21.15.45:0/3354039275 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7febc8161340 0x7febc8159ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:20.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.469+0000 7febcffff700 1 --2- 172.21.15.45:0/3354039275 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7febc80d2320 0x7febc81579c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:20.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.469+0000 7febcffff700 1 --2- 172.21.15.45:0/3354039275 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7febc815c9b0 0x7febc8159660 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:20.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.469+0000 7febcffff700 1 -- 172.21.15.45:0/3354039275 >> 172.21.15.45:0/3354039275 conn(0x7febc8072600 msgr2=0x7febc80b5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:20.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.469+0000 7febcffff700 1 -- 172.21.15.45:0/3354039275 shutdown_connections 2023-11-28T12:07:20.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.469+0000 7febcffff700 1 -- 172.21.15.45:0/3354039275 wait complete. 2023-11-28T12:07:20.489 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-28T12:06:21.807108+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-28T12:06:22.491009+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T12:06:27.684157+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T12:06:28.384679+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T12:07:20.489 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T12:07:20.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.694+0000 7f5c2c1ff700 1 Processor -- start 2023-11-28T12:07:20.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.694+0000 7f5c2c1ff700 1 -- start start 2023-11-28T12:07:20.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.695+0000 7f5c2c1ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f5c2415c9b0 0x7f5c240b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:20.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.695+0000 7f5c2c1ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c240d1950 con 0x7f5c24161340 2023-11-28T12:07:20.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.695+0000 7f5c2c1ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c240d24f0 con 0x7f5c240cd7c0 2023-11-28T12:07:20.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.695+0000 7f5c2c1ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c240b5800 con 0x7f5c2415c9b0 2023-11-28T12:07:20.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.695+0000 7f5c2979a700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f5c24161340 0x7f5c240d1de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59798/0 (socket says 172.21.15.45:59798) 2023-11-28T12:07:20.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.695+0000 7f5c2979a700 1 -- 172.21.15.45:0/3985443582 learned_addr learned my addr 172.21.15.45:0/3985443582 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:07:20.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.696+0000 7f5c29f9b700 1 --2- 172.21.15.45:0/3985443582 >> v2:172.21.15.152:3300/0 conn(0x7f5c2415c9b0 0x7f5c240b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:20.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.696+0000 7f5c28f99700 1 -- 172.21.15.45:0/3985443582 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 938498889 0 0) 0x7f5c240d1950 con 0x7f5c24161340 2023-11-28T12:07:20.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.696+0000 7f5c28f99700 1 -- 172.21.15.45:0/3985443582 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c100035b0 con 0x7f5c24161340 2023-11-28T12:07:20.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.696+0000 7f5c29f9b700 1 -- 172.21.15.45:0/3985443582 >> v1:172.21.15.152:6789/0 conn(0x7f5c240cd7c0 legacy=0x7f5c240b5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:20.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.696+0000 7f5c29f9b700 1 -- 172.21.15.45:0/3985443582 >> v1:172.21.15.45:6789/0 conn(0x7f5c24161340 legacy=0x7f5c240d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:20.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.696+0000 7f5c28f99700 1 -- 172.21.15.45:0/3985443582 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1138077006 0 0) 0x7f5c100035b0 con 0x7f5c24161340 2023-11-28T12:07:20.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.696+0000 7f5c29f9b700 1 -- 172.21.15.45:0/3985443582 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c240b5520 con 0x7f5c2415c9b0 2023-11-28T12:07:20.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.696+0000 7f5c29f9b700 1 --2- 172.21.15.45:0/3985443582 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c2415c9b0 0x7f5c240b4bf0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5c20009840 tx=0x7f5c20009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=594d6f1bf03ed44b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:20.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.697+0000 7f5c28f99700 1 -- 172.21.15.45:0/3985443582 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c14001670 con 0x7f5c2415c9b0 2023-11-28T12:07:20.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.697+0000 7f5c28f99700 1 -- 172.21.15.45:0/3985443582 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c20004030 con 0x7f5c2415c9b0 2023-11-28T12:07:20.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.697+0000 7f5c28f99700 1 -- 172.21.15.45:0/3985443582 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c200043c0 con 0x7f5c2415c9b0 2023-11-28T12:07:20.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.697+0000 7f5c2c1ff700 1 -- 172.21.15.45:0/3985443582 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c2415c9b0 msgr2=0x7f5c240b4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:20.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.697+0000 7f5c2c1ff700 1 --2- 172.21.15.45:0/3985443582 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c2415c9b0 0x7f5c240b4bf0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5c20009840 tx=0x7f5c20009b50 comp rx=0 tx=0).stop 2023-11-28T12:07:20.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.697+0000 7f5c2c1ff700 1 -- 172.21.15.45:0/3985443582 shutdown_connections 2023-11-28T12:07:20.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.697+0000 7f5c2c1ff700 1 --2- 172.21.15.45:0/3985443582 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c2415c9b0 0x7f5c240b4bf0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:20.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.697+0000 7f5c2c1ff700 1 -- 172.21.15.45:0/3985443582 >> 172.21.15.45:0/3985443582 conn(0x7f5c24072600 msgr2=0x7f5c240cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:20.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.697+0000 7f5c2c1ff700 1 -- 172.21.15.45:0/3985443582 shutdown_connections 2023-11-28T12:07:20.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.697+0000 7f5c2c1ff700 1 -- 172.21.15.45:0/3985443582 wait complete. 2023-11-28T12:07:20.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.699+0000 7f5c2c1ff700 1 Processor -- start 2023-11-28T12:07:20.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.699+0000 7f5c2c1ff700 1 -- start start 2023-11-28T12:07:20.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.700+0000 7f5c2c1ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5c240cd7c0 0x7f5c240cabb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:20.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.700+0000 7f5c2c1ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c2415c9b0 0x7f5c240c77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:20.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.700+0000 7f5c2c1ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c24161340 0x7f5c240cc740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:20.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.700+0000 7f5c2c1ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c240ca570 con 0x7f5c2415c9b0 2023-11-28T12:07:20.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.700+0000 7f5c2c1ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c240cb190 con 0x7f5c24161340 2023-11-28T12:07:20.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.700+0000 7f5c2c1ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c2415e880 con 0x7f5c240cd7c0 2023-11-28T12:07:20.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.701+0000 7f5c2979a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c2415c9b0 0x7f5c240c77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:20.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.701+0000 7f5c2979a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c2415c9b0 0x7f5c240c77e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60954/0 (socket says 172.21.15.45:60954) 2023-11-28T12:07:20.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.701+0000 7f5c2979a700 1 -- 172.21.15.45:0/3436878716 learned_addr learned my addr 172.21.15.45:0/3436878716 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:20.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.701+0000 7f5c29f9b700 1 --2- 172.21.15.45:0/3436878716 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5c240cd7c0 0x7f5c240cabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:20.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.701+0000 7f5c2a79c700 1 --2- 172.21.15.45:0/3436878716 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c24161340 0x7f5c240cc740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:20.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.701+0000 7f5c2979a700 1 -- 172.21.15.45:0/3436878716 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5c240cd7c0 msgr2=0x7f5c240cabb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:20.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.701+0000 7f5c2979a700 1 --2- 172.21.15.45:0/3436878716 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5c240cd7c0 0x7f5c240cabb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:20.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.701+0000 7f5c2979a700 1 -- 172.21.15.45:0/3436878716 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c24161340 msgr2=0x7f5c240cc740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:20.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.701+0000 7f5c2979a700 1 --2- 172.21.15.45:0/3436878716 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c24161340 0x7f5c240cc740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:20.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.701+0000 7f5c2979a700 1 -- 172.21.15.45:0/3436878716 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c200094a0 con 0x7f5c2415c9b0 2023-11-28T12:07:20.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.701+0000 7f5c2979a700 1 --2- 172.21.15.45:0/3436878716 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c2415c9b0 0x7f5c240c77e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f5c140011e0 tx=0x7f5c1400cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:20.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.701+0000 7f5c1a7fc700 1 -- 172.21.15.45:0/3436878716 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c14007560 con 0x7f5c2415c9b0 2023-11-28T12:07:20.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.702+0000 7f5c1a7fc700 1 -- 172.21.15.45:0/3436878716 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c140076c0 con 0x7f5c2415c9b0 2023-11-28T12:07:20.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.702+0000 7f5c2c1ff700 1 -- 172.21.15.45:0/3436878716 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c240d15e0 con 0x7f5c2415c9b0 2023-11-28T12:07:20.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.702+0000 7f5c1a7fc700 1 -- 172.21.15.45:0/3436878716 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c14004a90 con 0x7f5c2415c9b0 2023-11-28T12:07:20.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.702+0000 7f5c2c1ff700 1 -- 172.21.15.45:0/3436878716 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c240d1300 con 0x7f5c2415c9b0 2023-11-28T12:07:20.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.703+0000 7f5c2c1ff700 1 -- 172.21.15.45:0/3436878716 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c240745c0 con 0x7f5c2415c9b0 2023-11-28T12:07:20.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.704+0000 7f5c1a7fc700 1 -- 172.21.15.45:0/3436878716 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f5c14010070 con 0x7f5c2415c9b0 2023-11-28T12:07:20.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.704+0000 7f5c1a7fc700 1 --2- 172.21.15.45:0/3436878716 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5c080682f0 0x7f5c0806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:20.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.704+0000 7f5c1a7fc700 1 -- 172.21.15.45:0/3436878716 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f5c14084f80 con 0x7f5c2415c9b0 2023-11-28T12:07:20.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.705+0000 7f5c29f9b700 1 --2- 172.21.15.45:0/3436878716 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5c080682f0 0x7f5c0806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:20.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.706+0000 7f5c29f9b700 1 --2- 172.21.15.45:0/3436878716 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5c080682f0 0x7f5c0806a7a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5c200090b0 tx=0x7f5c20013040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:20.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.708+0000 7f5c1a7fc700 1 -- 172.21.15.45:0/3436878716 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f5c140515d0 con 0x7f5c2415c9b0 2023-11-28T12:07:20.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.907+0000 7f5c2c1ff700 1 -- 172.21.15.45:0/3436878716 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5c240d2090 con 0x7f5c2415c9b0 2023-11-28T12:07:20.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.907+0000 7f5c1a7fc700 1 -- 172.21.15.45:0/3436878716 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5c14018020 con 0x7f5c2415c9b0 2023-11-28T12:07:20.908 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-11-28T12:07:20.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.910+0000 7f5c2c1ff700 1 -- 172.21.15.45:0/3436878716 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5c080682f0 msgr2=0x7f5c0806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:20.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.910+0000 7f5c2c1ff700 1 --2- 172.21.15.45:0/3436878716 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5c080682f0 0x7f5c0806a7a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5c200090b0 tx=0x7f5c20013040 comp rx=0 tx=0).stop 2023-11-28T12:07:20.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.910+0000 7f5c2c1ff700 1 -- 172.21.15.45:0/3436878716 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c2415c9b0 msgr2=0x7f5c240c77e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:20.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.910+0000 7f5c2c1ff700 1 --2- 172.21.15.45:0/3436878716 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c2415c9b0 0x7f5c240c77e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f5c140011e0 tx=0x7f5c1400cb00 comp rx=0 tx=0).stop 2023-11-28T12:07:20.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.910+0000 7f5c2c1ff700 1 -- 172.21.15.45:0/3436878716 shutdown_connections 2023-11-28T12:07:20.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.910+0000 7f5c2c1ff700 1 --2- 172.21.15.45:0/3436878716 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5c080682f0 0x7f5c0806a7a0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:20.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.910+0000 7f5c2c1ff700 1 --2- 172.21.15.45:0/3436878716 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c24161340 0x7f5c240cc740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:20.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.910+0000 7f5c2c1ff700 1 --2- 172.21.15.45:0/3436878716 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5c240cd7c0 0x7f5c240cabb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:20.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.910+0000 7f5c2c1ff700 1 --2- 172.21.15.45:0/3436878716 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c2415c9b0 0x7f5c240c77e0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:20.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.910+0000 7f5c2c1ff700 1 -- 172.21.15.45:0/3436878716 >> 172.21.15.45:0/3436878716 conn(0x7f5c24072600 msgr2=0x7f5c240b8780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:20.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.910+0000 7f5c2c1ff700 1 -- 172.21.15.45:0/3436878716 shutdown_connections 2023-11-28T12:07:20.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:20.910+0000 7f5c2c1ff700 1 -- 172.21.15.45:0/3436878716 wait complete. 2023-11-28T12:07:20.928 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T12:07:21.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.137+0000 7fda24fff700 1 Processor -- start 2023-11-28T12:07:21.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.137+0000 7fda24fff700 1 -- start start 2023-11-28T12:07:21.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.138+0000 7fda24fff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fda2015c9b0 0x7fda200b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:21.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.138+0000 7fda24fff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fda200cd7c0 0x7fda200cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:21.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.138+0000 7fda24fff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda200d1950 con 0x7fda20161340 2023-11-28T12:07:21.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.138+0000 7fda24fff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda200b5800 con 0x7fda2015c9b0 2023-11-28T12:07:21.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.138+0000 7fda24fff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda200ce140 con 0x7fda200cd7c0 2023-11-28T12:07:21.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.138+0000 7fda1dd9b700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fda20161340 0x7fda200d1de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59808/0 (socket says 172.21.15.45:59808) 2023-11-28T12:07:21.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.138+0000 7fda1dd9b700 1 -- 172.21.15.45:0/471092653 learned_addr learned my addr 172.21.15.45:0/471092653 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:07:21.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.139+0000 7fda1ed9d700 1 --2- 172.21.15.45:0/471092653 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fda200cd7c0 0x7fda200cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:21.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.139+0000 7fda1e59c700 1 --2- 172.21.15.45:0/471092653 >> v2:172.21.15.152:3300/0 conn(0x7fda2015c9b0 0x7fda200b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:21.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.139+0000 7fda1d59a700 1 -- 172.21.15.45:0/471092653 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1231457082 0 0) 0x7fda200d1950 con 0x7fda20161340 2023-11-28T12:07:21.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.139+0000 7fda1d59a700 1 -- 172.21.15.45:0/471092653 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda080035b0 con 0x7fda20161340 2023-11-28T12:07:21.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.139+0000 7fda1d59a700 1 -- 172.21.15.45:0/471092653 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1609541886 0 0) 0x7fda080035b0 con 0x7fda20161340 2023-11-28T12:07:21.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.139+0000 7fda1d59a700 1 -- 172.21.15.45:0/471092653 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fda200cd7c0 msgr2=0x7fda200cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:21.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.139+0000 7fda1d59a700 1 --2- 172.21.15.45:0/471092653 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fda200cd7c0 0x7fda200cdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:21.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.139+0000 7fda1d59a700 1 -- 172.21.15.45:0/471092653 >> v2:172.21.15.152:3300/0 conn(0x7fda2015c9b0 msgr2=0x7fda200b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:21.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.139+0000 7fda1d59a700 1 --2- 172.21.15.45:0/471092653 >> v2:172.21.15.152:3300/0 conn(0x7fda2015c9b0 0x7fda200b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:21.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.139+0000 7fda1d59a700 1 -- 172.21.15.45:0/471092653 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda200d24f0 con 0x7fda20161340 2023-11-28T12:07:21.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.139+0000 7fda1d59a700 1 -- 172.21.15.45:0/471092653 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3460218165 0 0) 0x7fda14001670 con 0x7fda20161340 2023-11-28T12:07:21.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.139+0000 7fda1d59a700 1 -- 172.21.15.45:0/471092653 >> v1:172.21.15.45:6789/0 conn(0x7fda20161340 legacy=0x7fda200d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:21.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.139+0000 7fda1d59a700 1 --2- 172.21.15.45:0/471092653 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda08003a00 0x7fda08003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:21.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.139+0000 7fda1d59a700 1 --2- 172.21.15.45:0/471092653 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda08004430 0x7fda080048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:21.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.139+0000 7fda1d59a700 1 --2- 172.21.15.45:0/471092653 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fda200cd7c0 0x7fda08005060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:21.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.139+0000 7fda1d59a700 1 -- 172.21.15.45:0/471092653 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda200b5800 con 0x7fda08004430 2023-11-28T12:07:21.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.139+0000 7fda1d59a700 1 -- 172.21.15.45:0/471092653 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda200ce140 con 0x7fda08003a00 2023-11-28T12:07:21.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.140+0000 7fda1d59a700 1 -- 172.21.15.45:0/471092653 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda0800ba10 con 0x7fda200cd7c0 2023-11-28T12:07:21.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.140+0000 7fda1dd9b700 1 --2- 172.21.15.45:0/471092653 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda08004430 0x7fda080048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:21.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.140+0000 7fda1e59c700 1 --2- 172.21.15.45:0/471092653 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda08003a00 0x7fda08003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:21.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.140+0000 7fda1ed9d700 1 --2- 172.21.15.45:0/471092653 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fda200cd7c0 0x7fda08005060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:21.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.140+0000 7fda1dd9b700 1 -- 172.21.15.45:0/471092653 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fda200cd7c0 msgr2=0x7fda08005060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:21.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.140+0000 7fda1dd9b700 1 --2- 172.21.15.45:0/471092653 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fda200cd7c0 0x7fda08005060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:21.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.140+0000 7fda1dd9b700 1 -- 172.21.15.45:0/471092653 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda08003a00 msgr2=0x7fda08003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:21.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.140+0000 7fda1dd9b700 1 --2- 172.21.15.45:0/471092653 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda08003a00 0x7fda08003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:21.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.140+0000 7fda1dd9b700 1 -- 172.21.15.45:0/471092653 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda080035b0 con 0x7fda08004430 2023-11-28T12:07:21.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.140+0000 7fda1dd9b700 1 --2- 172.21.15.45:0/471092653 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda08004430 0x7fda080048f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fda1400c350 tx=0x7fda08005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24bc4e757a957772 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:21.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.141+0000 7fda1d59a700 1 -- 172.21.15.45:0/471092653 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1400ce50 con 0x7fda08004430 2023-11-28T12:07:21.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.141+0000 7fda1d59a700 1 -- 172.21.15.45:0/471092653 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda14005960 con 0x7fda08004430 2023-11-28T12:07:21.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.141+0000 7fda1d59a700 1 -- 172.21.15.45:0/471092653 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda14005d10 con 0x7fda08004430 2023-11-28T12:07:21.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.141+0000 7fda24fff700 1 -- 172.21.15.45:0/471092653 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda08004430 msgr2=0x7fda080048f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:21.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.141+0000 7fda24fff700 1 --2- 172.21.15.45:0/471092653 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda08004430 0x7fda080048f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fda1400c350 tx=0x7fda08005880 comp rx=0 tx=0).stop 2023-11-28T12:07:21.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.141+0000 7fda1ed9d700 1 -- 172.21.15.45:0/471092653 reap_dead start 2023-11-28T12:07:21.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.141+0000 7fda24fff700 1 -- 172.21.15.45:0/471092653 shutdown_connections 2023-11-28T12:07:21.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.141+0000 7fda24fff700 1 -- 172.21.15.45:0/471092653 >> 172.21.15.45:0/471092653 conn(0x7fda20072600 msgr2=0x7fda200cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:21.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.141+0000 7fda24fff700 1 -- 172.21.15.45:0/471092653 shutdown_connections 2023-11-28T12:07:21.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.141+0000 7fda24fff700 1 -- 172.21.15.45:0/471092653 wait complete. 2023-11-28T12:07:21.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.143+0000 7fda24fff700 1 Processor -- start 2023-11-28T12:07:21.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.143+0000 7fda24fff700 1 -- start start 2023-11-28T12:07:21.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.144+0000 7fda24fff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fda08004430 0x7fda200cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:21.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.144+0000 7fda24fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda200cc390 0x7fda201e6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:21.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.144+0000 7fda24fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda20156b90 0x7fda2015e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:21.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.144+0000 7fda24fff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda200cbf00 con 0x7fda200cc390 2023-11-28T12:07:21.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.144+0000 7fda24fff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda20157740 con 0x7fda20156b90 2023-11-28T12:07:21.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.144+0000 7fda24fff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda200cb2f0 con 0x7fda08004430 2023-11-28T12:07:21.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.144+0000 7fda1dd9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda200cc390 0x7fda201e6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:21.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.144+0000 7fda1dd9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda200cc390 0x7fda201e6440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60960/0 (socket says 172.21.15.45:60960) 2023-11-28T12:07:21.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.144+0000 7fda1dd9b700 1 -- 172.21.15.45:0/1093229212 learned_addr learned my addr 172.21.15.45:0/1093229212 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:21.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.145+0000 7fda1e59c700 1 --2- 172.21.15.45:0/1093229212 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fda08004430 0x7fda200cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:21.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.145+0000 7fda1ed9d700 1 --2- 172.21.15.45:0/1093229212 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda20156b90 0x7fda2015e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:21.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.145+0000 7fda1dd9b700 1 -- 172.21.15.45:0/1093229212 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fda08004430 msgr2=0x7fda200cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:21.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.145+0000 7fda1dd9b700 1 --2- 172.21.15.45:0/1093229212 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fda08004430 0x7fda200cccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:21.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.145+0000 7fda1dd9b700 1 -- 172.21.15.45:0/1093229212 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda20156b90 msgr2=0x7fda2015e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:21.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.145+0000 7fda1dd9b700 1 --2- 172.21.15.45:0/1093229212 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda20156b90 0x7fda2015e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:21.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.145+0000 7fda1dd9b700 1 -- 172.21.15.45:0/1093229212 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda200d1300 con 0x7fda200cc390 2023-11-28T12:07:21.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.145+0000 7fda1dd9b700 1 --2- 172.21.15.45:0/1093229212 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda200cc390 0x7fda201e6440 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fda14015040 tx=0x7fda14001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:21.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.145+0000 7fda0effd700 1 -- 172.21.15.45:0/1093229212 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda14001680 con 0x7fda200cc390 2023-11-28T12:07:21.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.145+0000 7fda0effd700 1 -- 172.21.15.45:0/1093229212 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda14004a80 con 0x7fda200cc390 2023-11-28T12:07:21.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.145+0000 7fda0effd700 1 -- 172.21.15.45:0/1093229212 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda14004e30 con 0x7fda200cc390 2023-11-28T12:07:21.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.145+0000 7fda24fff700 1 -- 172.21.15.45:0/1093229212 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda200b5520 con 0x7fda200cc390 2023-11-28T12:07:21.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.145+0000 7fda24fff700 1 -- 172.21.15.45:0/1093229212 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda200d15e0 con 0x7fda200cc390 2023-11-28T12:07:21.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.146+0000 7fda24fff700 1 -- 172.21.15.45:0/1093229212 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda200745c0 con 0x7fda200cc390 2023-11-28T12:07:21.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.147+0000 7fda0effd700 1 -- 172.21.15.45:0/1093229212 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fda14024030 con 0x7fda200cc390 2023-11-28T12:07:21.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.148+0000 7fda0effd700 1 --2- 172.21.15.45:0/1093229212 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fda000682f0 0x7fda0006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:21.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.148+0000 7fda0effd700 1 -- 172.21.15.45:0/1093229212 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fda14087150 con 0x7fda200cc390 2023-11-28T12:07:21.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.149+0000 7fda1e59c700 1 --2- 172.21.15.45:0/1093229212 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fda000682f0 0x7fda0006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:21.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.150+0000 7fda1e59c700 1 --2- 172.21.15.45:0/1093229212 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fda000682f0 0x7fda0006a7a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fda201e6c40 tx=0x7fda10009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:21.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.153+0000 7fda0effd700 1 -- 172.21.15.45:0/1093229212 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fda14053940 con 0x7fda200cc390 2023-11-28T12:07:21.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.356+0000 7fda24fff700 1 -- 172.21.15.45:0/1093229212 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fda200d08a0 con 0x7fda200cc390 2023-11-28T12:07:21.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.357+0000 7fda0effd700 1 -- 172.21.15.45:0/1093229212 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fda14007da0 con 0x7fda200cc390 2023-11-28T12:07:21.358 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-11-28T12:07:21.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.359+0000 7fda24fff700 1 -- 172.21.15.45:0/1093229212 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fda000682f0 msgr2=0x7fda0006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:21.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.359+0000 7fda24fff700 1 --2- 172.21.15.45:0/1093229212 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fda000682f0 0x7fda0006a7a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fda201e6c40 tx=0x7fda10009210 comp rx=0 tx=0).stop 2023-11-28T12:07:21.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.359+0000 7fda24fff700 1 -- 172.21.15.45:0/1093229212 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda200cc390 msgr2=0x7fda201e6440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:21.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.359+0000 7fda24fff700 1 --2- 172.21.15.45:0/1093229212 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda200cc390 0x7fda201e6440 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fda14015040 tx=0x7fda14001a00 comp rx=0 tx=0).stop 2023-11-28T12:07:21.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.360+0000 7fda24fff700 1 -- 172.21.15.45:0/1093229212 shutdown_connections 2023-11-28T12:07:21.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.360+0000 7fda24fff700 1 --2- 172.21.15.45:0/1093229212 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fda000682f0 0x7fda0006a7a0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:21.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.360+0000 7fda24fff700 1 --2- 172.21.15.45:0/1093229212 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda20156b90 0x7fda2015e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:21.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.360+0000 7fda24fff700 1 --2- 172.21.15.45:0/1093229212 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fda08004430 0x7fda200cccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:21.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.360+0000 7fda24fff700 1 --2- 172.21.15.45:0/1093229212 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda200cc390 0x7fda201e6440 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:21.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.360+0000 7fda24fff700 1 -- 172.21.15.45:0/1093229212 >> 172.21.15.45:0/1093229212 conn(0x7fda20072600 msgr2=0x7fda2006a900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:21.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.360+0000 7fda24fff700 1 -- 172.21.15.45:0/1093229212 shutdown_connections 2023-11-28T12:07:21.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.360+0000 7fda24fff700 1 -- 172.21.15.45:0/1093229212 wait complete. 2023-11-28T12:07:21.378 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T12:07:21.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.585+0000 7f949efff700 1 Processor -- start 2023-11-28T12:07:21.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.585+0000 7f949efff700 1 -- start start 2023-11-28T12:07:21.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.586+0000 7f949efff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f9498161340 0x7f94980d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:21.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.586+0000 7f949efff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f94980d2320 0x7f94980cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:21.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.586+0000 7f949efff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94980d1950 con 0x7f949815c9b0 2023-11-28T12:07:21.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.586+0000 7f949efff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94980b5800 con 0x7f94980d2320 2023-11-28T12:07:21.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.586+0000 7f949efff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94980b5300 con 0x7f9498161340 2023-11-28T12:07:21.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.587+0000 7f949cd9b700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f949815c9b0 0x7f94980b4bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59818/0 (socket says 172.21.15.45:59818) 2023-11-28T12:07:21.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.587+0000 7f949cd9b700 1 -- 172.21.15.45:0/3787952439 learned_addr learned my addr 172.21.15.45:0/3787952439 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:07:21.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.587+0000 7f949d59c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f94980d2320 0x7f94980cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:21.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.587+0000 7f9497fff700 1 --2- 172.21.15.45:0/3787952439 >> v2:172.21.15.152:3300/0 conn(0x7f9498161340 0x7f94980d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:21.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.587+0000 7f94977fe700 1 -- 172.21.15.45:0/3787952439 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 286176335 0 0) 0x7f94980d1950 con 0x7f949815c9b0 2023-11-28T12:07:21.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.587+0000 7f94977fe700 1 -- 172.21.15.45:0/3787952439 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94880035b0 con 0x7f949815c9b0 2023-11-28T12:07:21.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.587+0000 7f949d59c700 1 -- 172.21.15.45:0/3787952439 >> v2:172.21.15.152:3300/0 conn(0x7f9498161340 msgr2=0x7f94980d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:21.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.587+0000 7f949d59c700 1 --2- 172.21.15.45:0/3787952439 >> v2:172.21.15.152:3300/0 conn(0x7f9498161340 0x7f94980d1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:21.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.587+0000 7f949d59c700 1 -- 172.21.15.45:0/3787952439 >> v1:172.21.15.45:6789/0 conn(0x7f949815c9b0 legacy=0x7f94980b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:21.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.587+0000 7f949d59c700 1 -- 172.21.15.45:0/3787952439 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94980b5520 con 0x7f94980d2320 2023-11-28T12:07:21.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.588+0000 7f949d59c700 1 --2- 172.21.15.45:0/3787952439 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94980d2320 0x7f94980cd7c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f94980685c0 tx=0x7f949000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d33f07ae513ca58 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:21.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.588+0000 7f94977fe700 1 -- 172.21.15.45:0/3787952439 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f949000e070 con 0x7f94980d2320 2023-11-28T12:07:21.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.588+0000 7f94977fe700 1 -- 172.21.15.45:0/3787952439 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f949000bae0 con 0x7f94980d2320 2023-11-28T12:07:21.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.588+0000 7f94977fe700 1 -- 172.21.15.45:0/3787952439 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f949000be50 con 0x7f94980d2320 2023-11-28T12:07:21.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.588+0000 7f949efff700 1 -- 172.21.15.45:0/3787952439 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94980d2320 msgr2=0x7f94980cd7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:21.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.588+0000 7f949efff700 1 --2- 172.21.15.45:0/3787952439 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94980d2320 0x7f94980cd7c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f94980685c0 tx=0x7f949000b330 comp rx=0 tx=0).stop 2023-11-28T12:07:21.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.588+0000 7f949efff700 1 -- 172.21.15.45:0/3787952439 shutdown_connections 2023-11-28T12:07:21.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.588+0000 7f949efff700 1 --2- 172.21.15.45:0/3787952439 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94980d2320 0x7f94980cd7c0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:21.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.588+0000 7f949efff700 1 --2- 172.21.15.45:0/3787952439 >> v2:172.21.15.152:3300/0 conn(0x7f9498161340 0x7f94980d1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:21.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.588+0000 7f949efff700 1 -- 172.21.15.45:0/3787952439 >> 172.21.15.45:0/3787952439 conn(0x7f9498072600 msgr2=0x7f94980cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:21.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.589+0000 7f949efff700 1 -- 172.21.15.45:0/3787952439 shutdown_connections 2023-11-28T12:07:21.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.589+0000 7f949efff700 1 -- 172.21.15.45:0/3787952439 wait complete. 2023-11-28T12:07:21.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.590+0000 7f949efff700 1 Processor -- start 2023-11-28T12:07:21.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.591+0000 7f949efff700 1 -- start start 2023-11-28T12:07:21.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.591+0000 7f949efff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94980d2320 0x7f94980c7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:21.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.591+0000 7f949efff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f949815c9b0 0x7f949815f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:21.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.591+0000 7f949efff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9498161340 0x7f94981e8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:21.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.591+0000 7f949efff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94981e91f0 con 0x7f94980d2320 2023-11-28T12:07:21.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.591+0000 7f949efff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94981e8f10 con 0x7f9498161340 2023-11-28T12:07:21.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.591+0000 7f949efff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94980c6e40 con 0x7f949815c9b0 2023-11-28T12:07:21.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.592+0000 7f949cd9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94980d2320 0x7f94980c7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:21.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.592+0000 7f949cd9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94980d2320 0x7f94980c7920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60980/0 (socket says 172.21.15.45:60980) 2023-11-28T12:07:21.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.592+0000 7f949cd9b700 1 -- 172.21.15.45:0/2282330771 learned_addr learned my addr 172.21.15.45:0/2282330771 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:21.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.592+0000 7f949d59c700 1 --2- 172.21.15.45:0/2282330771 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9498161340 0x7f94981e8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:21.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.592+0000 7f9497fff700 1 --2- 172.21.15.45:0/2282330771 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f949815c9b0 0x7f949815f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:21.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.592+0000 7f949cd9b700 1 -- 172.21.15.45:0/2282330771 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f949815c9b0 msgr2=0x7f949815f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:21.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.592+0000 7f949cd9b700 1 --2- 172.21.15.45:0/2282330771 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f949815c9b0 0x7f949815f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:21.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.592+0000 7f949cd9b700 1 -- 172.21.15.45:0/2282330771 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9498161340 msgr2=0x7f94981e8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:21.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.592+0000 7f949cd9b700 1 --2- 172.21.15.45:0/2282330771 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9498161340 0x7f94981e8530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:21.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.592+0000 7f949cd9b700 1 -- 172.21.15.45:0/2282330771 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9490009a70 con 0x7f94980d2320 2023-11-28T12:07:21.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.592+0000 7f9497fff700 1 --2- 172.21.15.45:0/2282330771 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f949815c9b0 0x7f949815f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:07:21.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.592+0000 7f949cd9b700 1 --2- 172.21.15.45:0/2282330771 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94980d2320 0x7f94980c7920 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f948c00c420 tx=0x7f948c00c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:21.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.593+0000 7f94957fa700 1 -- 172.21.15.45:0/2282330771 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f948c005d70 con 0x7f94980d2320 2023-11-28T12:07:21.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.593+0000 7f94957fa700 1 -- 172.21.15.45:0/2282330771 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f948c0070d0 con 0x7f94980d2320 2023-11-28T12:07:21.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.593+0000 7f94957fa700 1 -- 172.21.15.45:0/2282330771 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f948c007440 con 0x7f94980d2320 2023-11-28T12:07:21.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.593+0000 7f949efff700 1 -- 172.21.15.45:0/2282330771 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94980d15e0 con 0x7f94980d2320 2023-11-28T12:07:21.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.593+0000 7f949efff700 1 -- 172.21.15.45:0/2282330771 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94980d1300 con 0x7f94980d2320 2023-11-28T12:07:21.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.594+0000 7f949efff700 1 -- 172.21.15.45:0/2282330771 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f949815cd80 con 0x7f94980d2320 2023-11-28T12:07:21.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.595+0000 7f94957fa700 1 -- 172.21.15.45:0/2282330771 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f948c019030 con 0x7f94980d2320 2023-11-28T12:07:21.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.597+0000 7f94957fa700 1 --2- 172.21.15.45:0/2282330771 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f947c0682f0 0x7f947c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:21.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.597+0000 7f94957fa700 1 -- 172.21.15.45:0/2282330771 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f948c084e50 con 0x7f94980d2320 2023-11-28T12:07:21.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.597+0000 7f9497fff700 1 --2- 172.21.15.45:0/2282330771 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f947c0682f0 0x7f947c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:21.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.598+0000 7f9497fff700 1 --2- 172.21.15.45:0/2282330771 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f947c0682f0 0x7f947c06a7a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f94980c9c80 tx=0x7f9484008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:21.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.601+0000 7f94957fa700 1 -- 172.21.15.45:0/2282330771 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f948c04b5e0 con 0x7f94980d2320 2023-11-28T12:07:21.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.799+0000 7f949efff700 1 -- 172.21.15.45:0/2282330771 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f94980c6ca0 con 0x7f94980d2320 2023-11-28T12:07:21.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.800+0000 7f94957fa700 1 -- 172.21.15.45:0/2282330771 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f94980c6ca0 con 0x7f94980d2320 2023-11-28T12:07:21.801 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-11-28T12:07:21.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.802+0000 7f949efff700 1 -- 172.21.15.45:0/2282330771 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f947c0682f0 msgr2=0x7f947c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:21.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.802+0000 7f949efff700 1 --2- 172.21.15.45:0/2282330771 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f947c0682f0 0x7f947c06a7a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f94980c9c80 tx=0x7f9484008040 comp rx=0 tx=0).stop 2023-11-28T12:07:21.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.802+0000 7f949efff700 1 -- 172.21.15.45:0/2282330771 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94980d2320 msgr2=0x7f94980c7920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:21.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.802+0000 7f949efff700 1 --2- 172.21.15.45:0/2282330771 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94980d2320 0x7f94980c7920 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f948c00c420 tx=0x7f948c00c730 comp rx=0 tx=0).stop 2023-11-28T12:07:21.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.802+0000 7f949efff700 1 -- 172.21.15.45:0/2282330771 shutdown_connections 2023-11-28T12:07:21.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.802+0000 7f949efff700 1 --2- 172.21.15.45:0/2282330771 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f947c0682f0 0x7f947c06a7a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:21.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.802+0000 7f949efff700 1 --2- 172.21.15.45:0/2282330771 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9498161340 0x7f94981e8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:21.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.802+0000 7f949efff700 1 --2- 172.21.15.45:0/2282330771 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94980d2320 0x7f94980c7920 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:21.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.802+0000 7f949efff700 1 --2- 172.21.15.45:0/2282330771 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f949815c9b0 0x7f949815f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:21.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.803+0000 7f949efff700 1 -- 172.21.15.45:0/2282330771 >> 172.21.15.45:0/2282330771 conn(0x7f9498072600 msgr2=0x7f94980b5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:21.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.803+0000 7f949efff700 1 -- 172.21.15.45:0/2282330771 shutdown_connections 2023-11-28T12:07:21.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:21.803+0000 7f949efff700 1 -- 172.21.15.45:0/2282330771 wait complete. 2023-11-28T12:07:21.821 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T12:07:22.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.027+0000 7fd64d9ff700 1 Processor -- start 2023-11-28T12:07:22.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.027+0000 7fd64d9ff700 1 -- start start 2023-11-28T12:07:22.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.028+0000 7fd64d9ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd64815c9b0 0x7fd6480b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:22.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.028+0000 7fd64d9ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd6480cd7c0 0x7fd6480cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:22.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.028+0000 7fd64d9ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6480d1950 con 0x7fd648161340 2023-11-28T12:07:22.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.028+0000 7fd64d9ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6480b5800 con 0x7fd64815c9b0 2023-11-28T12:07:22.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.028+0000 7fd64d9ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6480ce140 con 0x7fd6480cd7c0 2023-11-28T12:07:22.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.028+0000 7fd646ffd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd64815c9b0 0x7fd6480b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:22.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.028+0000 7fd646ffd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd64815c9b0 0x7fd6480b4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46256/0 (socket says 172.21.15.45:46256) 2023-11-28T12:07:22.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.028+0000 7fd646ffd700 1 -- 172.21.15.45:0/567572299 learned_addr learned my addr 172.21.15.45:0/567572299 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:22.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.029+0000 7fd6477fe700 1 --2- 172.21.15.45:0/567572299 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd6480cd7c0 0x7fd6480cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:22.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.029+0000 7fd646ffd700 1 -- 172.21.15.45:0/567572299 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd6480cd7c0 msgr2=0x7fd6480cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:22.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.029+0000 7fd646ffd700 1 --2- 172.21.15.45:0/567572299 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd6480cd7c0 0x7fd6480cdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:22.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.029+0000 7fd646ffd700 1 -- 172.21.15.45:0/567572299 >> v1:172.21.15.152:6789/0 conn(0x7fd648161340 legacy=0x7fd6480d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:22.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.029+0000 7fd646ffd700 1 -- 172.21.15.45:0/567572299 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6480d24f0 con 0x7fd64815c9b0 2023-11-28T12:07:22.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.029+0000 7fd6477fe700 1 --2- 172.21.15.45:0/567572299 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd6480cd7c0 0x7fd6480cdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:07:22.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.029+0000 7fd646ffd700 1 --2- 172.21.15.45:0/567572299 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd64815c9b0 0x7fd6480b4bf0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd6380098f0 tx=0x7fd638009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53630958486a5937 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:22.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.029+0000 7fd645ffb700 1 -- 172.21.15.45:0/567572299 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd638004230 con 0x7fd64815c9b0 2023-11-28T12:07:22.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.029+0000 7fd645ffb700 1 -- 172.21.15.45:0/567572299 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd638004390 con 0x7fd64815c9b0 2023-11-28T12:07:22.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.029+0000 7fd645ffb700 1 -- 172.21.15.45:0/567572299 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6380036a0 con 0x7fd64815c9b0 2023-11-28T12:07:22.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.030+0000 7fd64d9ff700 1 -- 172.21.15.45:0/567572299 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd64815c9b0 msgr2=0x7fd6480b4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:22.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.030+0000 7fd64d9ff700 1 --2- 172.21.15.45:0/567572299 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd64815c9b0 0x7fd6480b4bf0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd6380098f0 tx=0x7fd638009c00 comp rx=0 tx=0).stop 2023-11-28T12:07:22.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.030+0000 7fd64d9ff700 1 -- 172.21.15.45:0/567572299 shutdown_connections 2023-11-28T12:07:22.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.030+0000 7fd64d9ff700 1 --2- 172.21.15.45:0/567572299 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd6480cd7c0 0x7fd6480cdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:22.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.030+0000 7fd64d9ff700 1 --2- 172.21.15.45:0/567572299 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd64815c9b0 0x7fd6480b4bf0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:22.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.030+0000 7fd64d9ff700 1 -- 172.21.15.45:0/567572299 >> 172.21.15.45:0/567572299 conn(0x7fd648072600 msgr2=0x7fd6480cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:22.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.030+0000 7fd64d9ff700 1 -- 172.21.15.45:0/567572299 shutdown_connections 2023-11-28T12:07:22.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.030+0000 7fd64d9ff700 1 -- 172.21.15.45:0/567572299 wait complete. 2023-11-28T12:07:22.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.032+0000 7fd64d9ff700 1 Processor -- start 2023-11-28T12:07:22.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.032+0000 7fd64d9ff700 1 -- start start 2023-11-28T12:07:22.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.033+0000 7fd64d9ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd6480cd7c0 0x7fd648154690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:22.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.033+0000 7fd64d9ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd64815c9b0 0x7fd6481f3020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:22.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.033+0000 7fd64d9ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd648161340 0x7fd64815ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:22.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.033+0000 7fd64d9ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd648158030 con 0x7fd64815c9b0 2023-11-28T12:07:22.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.033+0000 7fd64d9ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd648154bd0 con 0x7fd6480cd7c0 2023-11-28T12:07:22.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.033+0000 7fd64d9ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd648156770 con 0x7fd648161340 2023-11-28T12:07:22.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.033+0000 7fd6467fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd64815c9b0 0x7fd6481f3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:22.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.033+0000 7fd646ffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd6480cd7c0 0x7fd648154690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:22.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.033+0000 7fd6467fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd64815c9b0 0x7fd6481f3020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46258/0 (socket says 172.21.15.45:46258) 2023-11-28T12:07:22.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.033+0000 7fd6467fc700 1 -- 172.21.15.45:0/3097168180 learned_addr learned my addr 172.21.15.45:0/3097168180 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:22.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.033+0000 7fd6477fe700 1 --2- 172.21.15.45:0/3097168180 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd648161340 0x7fd64815ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:22.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.033+0000 7fd6467fc700 1 -- 172.21.15.45:0/3097168180 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd648161340 msgr2=0x7fd64815ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:22.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.033+0000 7fd6467fc700 1 --2- 172.21.15.45:0/3097168180 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd648161340 0x7fd64815ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:22.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.033+0000 7fd6467fc700 1 -- 172.21.15.45:0/3097168180 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd6480cd7c0 msgr2=0x7fd648154690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:22.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.033+0000 7fd6467fc700 1 --2- 172.21.15.45:0/3097168180 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd6480cd7c0 0x7fd648154690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:22.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.033+0000 7fd6467fc700 1 -- 172.21.15.45:0/3097168180 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd638009550 con 0x7fd64815c9b0 2023-11-28T12:07:22.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.034+0000 7fd6467fc700 1 --2- 172.21.15.45:0/3097168180 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd64815c9b0 0x7fd6481f3020 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd63c00c4d0 tx=0x7fd63c00c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:22.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.034+0000 7fd62ffff700 1 -- 172.21.15.45:0/3097168180 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd63c011790 con 0x7fd64815c9b0 2023-11-28T12:07:22.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.034+0000 7fd62ffff700 1 -- 172.21.15.45:0/3097168180 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd63c0118f0 con 0x7fd64815c9b0 2023-11-28T12:07:22.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.034+0000 7fd62ffff700 1 -- 172.21.15.45:0/3097168180 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd63c011ca0 con 0x7fd64815c9b0 2023-11-28T12:07:22.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.034+0000 7fd64d9ff700 1 -- 172.21.15.45:0/3097168180 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6480d1300 con 0x7fd64815c9b0 2023-11-28T12:07:22.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.034+0000 7fd64d9ff700 1 -- 172.21.15.45:0/3097168180 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6480b5520 con 0x7fd64815c9b0 2023-11-28T12:07:22.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.035+0000 7fd64d9ff700 1 -- 172.21.15.45:0/3097168180 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6480d15e0 con 0x7fd64815c9b0 2023-11-28T12:07:22.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.036+0000 7fd62ffff700 1 -- 172.21.15.45:0/3097168180 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fd63c010050 con 0x7fd64815c9b0 2023-11-28T12:07:22.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.037+0000 7fd62ffff700 1 --2- 172.21.15.45:0/3097168180 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fd6340682f0 0x7fd63406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:22.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.038+0000 7fd62ffff700 1 -- 172.21.15.45:0/3097168180 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fd63c085910 con 0x7fd64815c9b0 2023-11-28T12:07:22.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.038+0000 7fd646ffd700 1 --2- 172.21.15.45:0/3097168180 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fd6340682f0 0x7fd63406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:22.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.039+0000 7fd646ffd700 1 --2- 172.21.15.45:0/3097168180 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fd6340682f0 0x7fd63406a7a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd638009130 tx=0x7fd638008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:22.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.042+0000 7fd62ffff700 1 -- 172.21.15.45:0/3097168180 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fd63c052040 con 0x7fd64815c9b0 2023-11-28T12:07:22.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.247+0000 7fd64d9ff700 1 -- 172.21.15.45:0/3097168180 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd6480cedf0 con 0x7fd64815c9b0 2023-11-28T12:07:22.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.247+0000 7fd62ffff700 1 -- 172.21.15.45:0/3097168180 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd63c055660 con 0x7fd64815c9b0 2023-11-28T12:07:22.248 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-11-28T12:07:22.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.249+0000 7fd64d9ff700 1 -- 172.21.15.45:0/3097168180 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fd6340682f0 msgr2=0x7fd63406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:22.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.249+0000 7fd64d9ff700 1 --2- 172.21.15.45:0/3097168180 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fd6340682f0 0x7fd63406a7a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd638009130 tx=0x7fd638008030 comp rx=0 tx=0).stop 2023-11-28T12:07:22.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.249+0000 7fd64d9ff700 1 -- 172.21.15.45:0/3097168180 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd64815c9b0 msgr2=0x7fd6481f3020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:22.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.249+0000 7fd64d9ff700 1 --2- 172.21.15.45:0/3097168180 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd64815c9b0 0x7fd6481f3020 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd63c00c4d0 tx=0x7fd63c00c7e0 comp rx=0 tx=0).stop 2023-11-28T12:07:22.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.249+0000 7fd64d9ff700 1 -- 172.21.15.45:0/3097168180 shutdown_connections 2023-11-28T12:07:22.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.249+0000 7fd64d9ff700 1 --2- 172.21.15.45:0/3097168180 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fd6340682f0 0x7fd63406a7a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:22.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.249+0000 7fd64d9ff700 1 --2- 172.21.15.45:0/3097168180 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd6480cd7c0 0x7fd648154690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:22.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.249+0000 7fd64d9ff700 1 --2- 172.21.15.45:0/3097168180 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd648161340 0x7fd64815ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:22.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.249+0000 7fd64d9ff700 1 --2- 172.21.15.45:0/3097168180 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd64815c9b0 0x7fd6481f3020 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:22.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.249+0000 7fd64d9ff700 1 -- 172.21.15.45:0/3097168180 >> 172.21.15.45:0/3097168180 conn(0x7fd648072600 msgr2=0x7fd6480b5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:22.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.249+0000 7fd64d9ff700 1 -- 172.21.15.45:0/3097168180 shutdown_connections 2023-11-28T12:07:22.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.250+0000 7fd64d9ff700 1 -- 172.21.15.45:0/3097168180 wait complete. 2023-11-28T12:07:22.268 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T12:07:22.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.473+0000 7f77c3dff700 1 Processor -- start 2023-11-28T12:07:22.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.473+0000 7f77c3dff700 1 -- start start 2023-11-28T12:07:22.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.474+0000 7f77c3dff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f77bc0d01b0 0x7f77bc0d0c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:22.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.474+0000 7f77c3dff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f77bc0b20b0 0x7f77bc0d1160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:22.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.474+0000 7f77c3dff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f77bc0b29b0 0x7f77bc0b2e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:22.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.474+0000 7f77c3dff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77bc15cec0 con 0x7f77bc0d01b0 2023-11-28T12:07:22.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.474+0000 7f77c3dff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77bc0b0230 con 0x7f77bc0b29b0 2023-11-28T12:07:22.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.474+0000 7f77c3dff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77bc0b4570 con 0x7f77bc0b20b0 2023-11-28T12:07:22.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.474+0000 7f77c1b9b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f77bc0d01b0 0x7f77bc0d0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:22.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.474+0000 7f77c1b9b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f77bc0d01b0 0x7f77bc0d0c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46262/0 (socket says 172.21.15.45:46262) 2023-11-28T12:07:22.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.474+0000 7f77c1b9b700 1 -- 172.21.15.45:0/974675764 learned_addr learned my addr 172.21.15.45:0/974675764 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:22.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.475+0000 7f77c139a700 1 --2- 172.21.15.45:0/974675764 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f77bc0b20b0 0x7f77bc0d1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:22.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.475+0000 7f77c239c700 1 --2- 172.21.15.45:0/974675764 >> v2:172.21.15.152:3300/0 conn(0x7f77bc0b29b0 0x7f77bc0b2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:22.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.475+0000 7f77c1b9b700 1 -- 172.21.15.45:0/974675764 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f77bc0b20b0 msgr2=0x7f77bc0d1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:22.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.475+0000 7f77c1b9b700 1 --2- 172.21.15.45:0/974675764 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f77bc0b20b0 0x7f77bc0d1160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:22.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.475+0000 7f77c1b9b700 1 -- 172.21.15.45:0/974675764 >> v2:172.21.15.152:3300/0 conn(0x7f77bc0b29b0 msgr2=0x7f77bc0b2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:22.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.475+0000 7f77c1b9b700 1 --2- 172.21.15.45:0/974675764 >> v2:172.21.15.152:3300/0 conn(0x7f77bc0b29b0 0x7f77bc0b2e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:22.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.475+0000 7f77c1b9b700 1 -- 172.21.15.45:0/974675764 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77bc0b4850 con 0x7f77bc0d01b0 2023-11-28T12:07:22.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.475+0000 7f77c139a700 1 --2- 172.21.15.45:0/974675764 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f77bc0b20b0 0x7f77bc0d1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:07:22.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.475+0000 7f77c1b9b700 1 --2- 172.21.15.45:0/974675764 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77bc0d01b0 0x7f77bc0d0c20 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f77bc066e80 tx=0x7f77b8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=358c97b46c45f1e7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:22.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.475+0000 7f77c0b99700 1 -- 172.21.15.45:0/974675764 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b800b870 con 0x7f77bc0d01b0 2023-11-28T12:07:22.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.475+0000 7f77c0b99700 1 -- 172.21.15.45:0/974675764 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77b800b9d0 con 0x7f77bc0d01b0 2023-11-28T12:07:22.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.475+0000 7f77c0b99700 1 -- 172.21.15.45:0/974675764 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b800bd60 con 0x7f77bc0d01b0 2023-11-28T12:07:22.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.476+0000 7f77c3dff700 1 -- 172.21.15.45:0/974675764 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77bc0d01b0 msgr2=0x7f77bc0d0c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:22.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.476+0000 7f77c3dff700 1 --2- 172.21.15.45:0/974675764 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77bc0d01b0 0x7f77bc0d0c20 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f77bc066e80 tx=0x7f77b8009bd0 comp rx=0 tx=0).stop 2023-11-28T12:07:22.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.476+0000 7f77c3dff700 1 -- 172.21.15.45:0/974675764 shutdown_connections 2023-11-28T12:07:22.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.476+0000 7f77c3dff700 1 --2- 172.21.15.45:0/974675764 >> v2:172.21.15.152:3300/0 conn(0x7f77bc0b29b0 0x7f77bc0b2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:22.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.476+0000 7f77c3dff700 1 --2- 172.21.15.45:0/974675764 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77bc0d01b0 0x7f77bc0d0c20 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:22.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.476+0000 7f77c3dff700 1 --2- 172.21.15.45:0/974675764 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f77bc0b20b0 0x7f77bc0d1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:22.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.476+0000 7f77c3dff700 1 -- 172.21.15.45:0/974675764 >> 172.21.15.45:0/974675764 conn(0x7f77bc09c3f0 msgr2=0x7f77bc0d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:22.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.476+0000 7f77c3dff700 1 -- 172.21.15.45:0/974675764 shutdown_connections 2023-11-28T12:07:22.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.476+0000 7f77c3dff700 1 -- 172.21.15.45:0/974675764 wait complete. 2023-11-28T12:07:22.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.478+0000 7f77c3dff700 1 Processor -- start 2023-11-28T12:07:22.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.478+0000 7f77c3dff700 1 -- start start 2023-11-28T12:07:22.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.479+0000 7f77c3dff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77bc0b20b0 0x7f77bc156c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:22.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.479+0000 7f77c3dff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77bc0b29b0 0x7f77bc157420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:22.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.479+0000 7f77c3dff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f77bc0d01b0 0x7f77bc157960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:22.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.479+0000 7f77c3dff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77bc0b6300 con 0x7f77bc0b29b0 2023-11-28T12:07:22.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.479+0000 7f77c3dff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77bc0cbf40 con 0x7f77bc0b20b0 2023-11-28T12:07:22.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.479+0000 7f77c3dff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77bc0cb980 con 0x7f77bc0d01b0 2023-11-28T12:07:22.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.479+0000 7f77c139a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77bc0b29b0 0x7f77bc157420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:22.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.479+0000 7f77c139a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77bc0b29b0 0x7f77bc157420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46266/0 (socket says 172.21.15.45:46266) 2023-11-28T12:07:22.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.479+0000 7f77c139a700 1 -- 172.21.15.45:0/640886019 learned_addr learned my addr 172.21.15.45:0/640886019 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:22.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.480+0000 7f77c1b9b700 1 --2- 172.21.15.45:0/640886019 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77bc0b20b0 0x7f77bc156c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:22.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.480+0000 7f77c239c700 1 --2- 172.21.15.45:0/640886019 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f77bc0d01b0 0x7f77bc157960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:22.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.480+0000 7f77c139a700 1 -- 172.21.15.45:0/640886019 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f77bc0d01b0 msgr2=0x7f77bc157960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:22.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.480+0000 7f77c139a700 1 --2- 172.21.15.45:0/640886019 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f77bc0d01b0 0x7f77bc157960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:22.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.480+0000 7f77c139a700 1 -- 172.21.15.45:0/640886019 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77bc0b20b0 msgr2=0x7f77bc156c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:22.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.480+0000 7f77c139a700 1 --2- 172.21.15.45:0/640886019 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77bc0b20b0 0x7f77bc156c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:22.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.480+0000 7f77c139a700 1 -- 172.21.15.45:0/640886019 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77b8009550 con 0x7f77bc0b29b0 2023-11-28T12:07:22.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.480+0000 7f77c139a700 1 --2- 172.21.15.45:0/640886019 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77bc0b29b0 0x7f77bc157420 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f77ac00d800 tx=0x7f77ac00db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:22.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.480+0000 7f77b27fc700 1 -- 172.21.15.45:0/640886019 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77ac004030 con 0x7f77bc0b29b0 2023-11-28T12:07:22.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.480+0000 7f77b27fc700 1 -- 172.21.15.45:0/640886019 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77ac004190 con 0x7f77bc0b29b0 2023-11-28T12:07:22.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.480+0000 7f77b27fc700 1 -- 172.21.15.45:0/640886019 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77ac004520 con 0x7f77bc0b29b0 2023-11-28T12:07:22.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.480+0000 7f77c3dff700 1 -- 172.21.15.45:0/640886019 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77bc0afec0 con 0x7f77bc0b29b0 2023-11-28T12:07:22.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.481+0000 7f77c3dff700 1 -- 172.21.15.45:0/640886019 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77bc0afbe0 con 0x7f77bc0b29b0 2023-11-28T12:07:22.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.482+0000 7f77c3dff700 1 -- 172.21.15.45:0/640886019 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77bc0b2600 con 0x7f77bc0b29b0 2023-11-28T12:07:22.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.482+0000 7f77b27fc700 1 -- 172.21.15.45:0/640886019 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f77ac01a020 con 0x7f77bc0b29b0 2023-11-28T12:07:22.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.483+0000 7f77b27fc700 1 --2- 172.21.15.45:0/640886019 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f77a00682f0 0x7f77a006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:22.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.483+0000 7f77b27fc700 1 -- 172.21.15.45:0/640886019 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f77ac086160 con 0x7f77bc0b29b0 2023-11-28T12:07:22.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.484+0000 7f77c1b9b700 1 --2- 172.21.15.45:0/640886019 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f77a00682f0 0x7f77a006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:22.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.485+0000 7f77c1b9b700 1 --2- 172.21.15.45:0/640886019 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f77a00682f0 0x7f77a006a7a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f77b8014040 tx=0x7f77b8008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:22.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.487+0000 7f77b27fc700 1 -- 172.21.15.45:0/640886019 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f77ac052890 con 0x7f77bc0b29b0 2023-11-28T12:07:22.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.704+0000 7f77c3dff700 1 -- 172.21.15.45:0/640886019 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f77bc068690 con 0x7f77bc0b29b0 2023-11-28T12:07:22.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.704+0000 7f77b27fc700 1 -- 172.21.15.45:0/640886019 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7f77ac055eb0 con 0x7f77bc0b29b0 2023-11-28T12:07:22.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.706+0000 7f77c3dff700 1 -- 172.21.15.45:0/640886019 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f77a00682f0 msgr2=0x7f77a006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:22.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.706+0000 7f77c3dff700 1 --2- 172.21.15.45:0/640886019 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f77a00682f0 0x7f77a006a7a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f77b8014040 tx=0x7f77b8008030 comp rx=0 tx=0).stop 2023-11-28T12:07:22.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.706+0000 7f77c3dff700 1 -- 172.21.15.45:0/640886019 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77bc0b29b0 msgr2=0x7f77bc157420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:22.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.706+0000 7f77c3dff700 1 --2- 172.21.15.45:0/640886019 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77bc0b29b0 0x7f77bc157420 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f77ac00d800 tx=0x7f77ac00db10 comp rx=0 tx=0).stop 2023-11-28T12:07:22.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.706+0000 7f77c3dff700 1 -- 172.21.15.45:0/640886019 shutdown_connections 2023-11-28T12:07:22.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.706+0000 7f77c3dff700 1 --2- 172.21.15.45:0/640886019 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f77a00682f0 0x7f77a006a7a0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:22.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.706+0000 7f77c3dff700 1 --2- 172.21.15.45:0/640886019 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f77bc0b20b0 0x7f77bc156c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:22.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.706+0000 7f77c3dff700 1 --2- 172.21.15.45:0/640886019 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f77bc0d01b0 0x7f77bc157960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:22.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.706+0000 7f77c3dff700 1 --2- 172.21.15.45:0/640886019 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77bc0b29b0 0x7f77bc157420 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:22.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.706+0000 7f77c3dff700 1 -- 172.21.15.45:0/640886019 >> 172.21.15.45:0/640886019 conn(0x7f77bc09c3f0 msgr2=0x7f77bc06b540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:22.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.707+0000 7f77c3dff700 1 -- 172.21.15.45:0/640886019 shutdown_connections 2023-11-28T12:07:22.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:22.707+0000 7f77c3dff700 1 -- 172.21.15.45:0/640886019 wait complete. 2023-11-28T12:07:22.709 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-11-28T12:07:22.725 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-11-28T12:07:22.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:07:22.725 DEBUG:teuthology.orchestra.run.smithi152:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-11-28T12:07:22.809 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi152.front.sepia.ceph.com 2023-11-28T12:07:22.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:07:22.809 DEBUG:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-28T12:07:22.857 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-28T12:07:22.858 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T12:07:23.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.062+0000 7f2a3dfff700 1 Processor -- start 2023-11-28T12:07:23.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.063+0000 7f2a3dfff700 1 -- start start 2023-11-28T12:07:23.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.064+0000 7f2a3dfff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2a38161340 0x7f2a380d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:23.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.064+0000 7f2a3dfff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a380d1950 con 0x7f2a380d2320 2023-11-28T12:07:23.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.064+0000 7f2a3dfff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a380b5520 con 0x7f2a3815c9b0 2023-11-28T12:07:23.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.064+0000 7f2a3dfff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a380b5800 con 0x7f2a38161340 2023-11-28T12:07:23.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.064+0000 7f2a37fff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f2a380d2320 0x7f2a380cd7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:52246/0 (socket says 172.21.15.45:52246) 2023-11-28T12:07:23.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.064+0000 7f2a37fff700 1 -- 172.21.15.45:0/2562920427 learned_addr learned my addr 172.21.15.45:0/2562920427 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:07:23.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.064+0000 7f2a36ffd700 1 --2- 172.21.15.45:0/2562920427 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2a38161340 0x7f2a380d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:23.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.064+0000 7f2a367fc700 1 -- 172.21.15.45:0/2562920427 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2419386536 0 0) 0x7f2a380d1950 con 0x7f2a380d2320 2023-11-28T12:07:23.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.065+0000 7f2a367fc700 1 -- 172.21.15.45:0/2562920427 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a200035b0 con 0x7f2a380d2320 2023-11-28T12:07:23.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.065+0000 7f2a36ffd700 1 -- 172.21.15.45:0/2562920427 >> v1:172.21.15.152:6789/0 conn(0x7f2a3815c9b0 legacy=0x7f2a380b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:23.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.065+0000 7f2a36ffd700 1 -- 172.21.15.45:0/2562920427 >> v1:172.21.15.45:6789/0 conn(0x7f2a380d2320 legacy=0x7f2a380cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:23.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.065+0000 7f2a36ffd700 1 -- 172.21.15.45:0/2562920427 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a380d1300 con 0x7f2a38161340 2023-11-28T12:07:23.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.065+0000 7f2a36ffd700 1 --2- 172.21.15.45:0/2562920427 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2a38161340 0x7f2a380d1de0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c009870 tx=0x7f2a2c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54295a2d7d1ab694 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:23.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.065+0000 7f2a367fc700 1 -- 172.21.15.45:0/2562920427 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a2c011830 con 0x7f2a38161340 2023-11-28T12:07:23.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.065+0000 7f2a367fc700 1 -- 172.21.15.45:0/2562920427 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a2c011990 con 0x7f2a38161340 2023-11-28T12:07:23.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.065+0000 7f2a367fc700 1 -- 172.21.15.45:0/2562920427 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a2c011d20 con 0x7f2a38161340 2023-11-28T12:07:23.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.066+0000 7f2a3dfff700 1 -- 172.21.15.45:0/2562920427 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2a38161340 msgr2=0x7f2a380d1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:23.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.066+0000 7f2a3dfff700 1 --2- 172.21.15.45:0/2562920427 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2a38161340 0x7f2a380d1de0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c009870 tx=0x7f2a2c009b80 comp rx=0 tx=0).stop 2023-11-28T12:07:23.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.066+0000 7f2a3dfff700 1 -- 172.21.15.45:0/2562920427 shutdown_connections 2023-11-28T12:07:23.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.066+0000 7f2a3dfff700 1 --2- 172.21.15.45:0/2562920427 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2a38161340 0x7f2a380d1de0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:23.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.066+0000 7f2a3dfff700 1 -- 172.21.15.45:0/2562920427 >> 172.21.15.45:0/2562920427 conn(0x7f2a38072600 msgr2=0x7f2a380cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:23.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.066+0000 7f2a3dfff700 1 -- 172.21.15.45:0/2562920427 shutdown_connections 2023-11-28T12:07:23.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.066+0000 7f2a3dfff700 1 -- 172.21.15.45:0/2562920427 wait complete. 2023-11-28T12:07:23.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.068+0000 7f2a3dfff700 1 Processor -- start 2023-11-28T12:07:23.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.068+0000 7f2a3dfff700 1 -- start start 2023-11-28T12:07:23.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.069+0000 7f2a3dfff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2a380d2320 0x7f2a3814d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:23.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.069+0000 7f2a3dfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a3815c9b0 0x7f2a3815a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:23.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.069+0000 7f2a3dfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2a38161340 0x7f2a3815ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:23.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.069+0000 7f2a3dfff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a380cad80 con 0x7f2a38161340 2023-11-28T12:07:23.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.069+0000 7f2a3dfff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a380c9400 con 0x7f2a3815c9b0 2023-11-28T12:07:23.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.069+0000 7f2a3dfff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a380b8720 con 0x7f2a380d2320 2023-11-28T12:07:23.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.069+0000 7f2a36ffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a3815c9b0 0x7f2a3815a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:23.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.069+0000 7f2a377fe700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2a380d2320 0x7f2a3814d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:23.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.069+0000 7f2a36ffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a3815c9b0 0x7f2a3815a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.45:43906/0 (socket says 172.21.15.45:43906) 2023-11-28T12:07:23.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.069+0000 7f2a37fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2a38161340 0x7f2a3815ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:23.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.069+0000 7f2a36ffd700 1 -- 172.21.15.45:0/1057327528 learned_addr learned my addr 172.21.15.45:0/1057327528 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:23.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.070+0000 7f2a36ffd700 1 -- 172.21.15.45:0/1057327528 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2a380d2320 msgr2=0x7f2a3814d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:23.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.070+0000 7f2a36ffd700 1 --2- 172.21.15.45:0/1057327528 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2a380d2320 0x7f2a3814d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:23.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.070+0000 7f2a36ffd700 1 -- 172.21.15.45:0/1057327528 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2a38161340 msgr2=0x7f2a3815ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:23.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.070+0000 7f2a36ffd700 1 --2- 172.21.15.45:0/1057327528 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2a38161340 0x7f2a3815ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:23.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.070+0000 7f2a36ffd700 1 -- 172.21.15.45:0/1057327528 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a2c0094a0 con 0x7f2a3815c9b0 2023-11-28T12:07:23.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.070+0000 7f2a37fff700 1 --2- 172.21.15.45:0/1057327528 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2a38161340 0x7f2a3815ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:07:23.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.070+0000 7f2a36ffd700 1 --2- 172.21.15.45:0/1057327528 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a3815c9b0 0x7f2a3815a610 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c0097c0 tx=0x7f2a2c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:23.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.070+0000 7f2a1ffff700 1 -- 172.21.15.45:0/1057327528 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a2c0036a0 con 0x7f2a3815c9b0 2023-11-28T12:07:23.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.070+0000 7f2a1ffff700 1 -- 172.21.15.45:0/1057327528 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a2c01f070 con 0x7f2a3815c9b0 2023-11-28T12:07:23.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.070+0000 7f2a3dfff700 1 -- 172.21.15.45:0/1057327528 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a3815cd80 con 0x7f2a3815c9b0 2023-11-28T12:07:23.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.070+0000 7f2a1ffff700 1 -- 172.21.15.45:0/1057327528 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a2c003a60 con 0x7f2a3815c9b0 2023-11-28T12:07:23.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.070+0000 7f2a3dfff700 1 -- 172.21.15.45:0/1057327528 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a380d15e0 con 0x7f2a3815c9b0 2023-11-28T12:07:23.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.071+0000 7f2a3dfff700 1 -- 172.21.15.45:0/1057327528 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a3815cf10 con 0x7f2a3815c9b0 2023-11-28T12:07:23.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.072+0000 7f2a1ffff700 1 -- 172.21.15.45:0/1057327528 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f2a2c00f050 con 0x7f2a3815c9b0 2023-11-28T12:07:23.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.073+0000 7f2a1ffff700 1 --2- 172.21.15.45:0/1057327528 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f2a240682f0 0x7f2a2406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:23.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.073+0000 7f2a1ffff700 1 -- 172.21.15.45:0/1057327528 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f2a2c021070 con 0x7f2a3815c9b0 2023-11-28T12:07:23.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.073+0000 7f2a377fe700 1 --2- 172.21.15.45:0/1057327528 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f2a240682f0 0x7f2a2406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:23.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.074+0000 7f2a377fe700 1 --2- 172.21.15.45:0/1057327528 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f2a240682f0 0x7f2a2406a7a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2a28007fd0 tx=0x7f2a28009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:23.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.078+0000 7f2a1ffff700 1 -- 172.21.15.45:0/1057327528 <== mon.1 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f2a2c053d10 con 0x7f2a3815c9b0 2023-11-28T12:07:23.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.327+0000 7f2a3dfff700 1 -- 172.21.15.45:0/1057327528 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2a380caec0 con 0x7f2a3815c9b0 2023-11-28T12:07:23.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.328+0000 7f2a1ffff700 1 -- 172.21.15.45:0/1057327528 <== mon.1 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4648 (secure 0 0 0) 0x7f2a380caec0 con 0x7f2a3815c9b0 2023-11-28T12:07:23.330 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:07:23.330 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1163718907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6835","nonce":1163718907},{"type":"v1","addr":"172.21.15.152:6837","nonce":1163718907}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4282,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/2292614522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":2292614522},{"type":"v1","addr":"172.21.15.45:6834","nonce":2292614522}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4285,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/3920917053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":3920917053},{"type":"v1","addr":"172.21.15.45:6835","nonce":3920917053}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T12:06:29.394171+0000","modified":"2023-11-28T12:06:32.886491+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.152:6836/3624153928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":3624153928},{"type":"v1","addr":"172.21.15.152:6836","nonce":3624153928}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T12:07:23.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.330+0000 7f2a3dfff700 1 -- 172.21.15.45:0/1057327528 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f2a240682f0 msgr2=0x7f2a2406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:23.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.330+0000 7f2a3dfff700 1 --2- 172.21.15.45:0/1057327528 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f2a240682f0 0x7f2a2406a7a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2a28007fd0 tx=0x7f2a28009040 comp rx=0 tx=0).stop 2023-11-28T12:07:23.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.330+0000 7f2a3dfff700 1 -- 172.21.15.45:0/1057327528 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a3815c9b0 msgr2=0x7f2a3815a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:23.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.330+0000 7f2a3dfff700 1 --2- 172.21.15.45:0/1057327528 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a3815c9b0 0x7f2a3815a610 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c0097c0 tx=0x7f2a2c004750 comp rx=0 tx=0).stop 2023-11-28T12:07:23.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.330+0000 7f2a3dfff700 1 -- 172.21.15.45:0/1057327528 shutdown_connections 2023-11-28T12:07:23.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.330+0000 7f2a3dfff700 1 --2- 172.21.15.45:0/1057327528 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f2a240682f0 0x7f2a2406a7a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:23.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.330+0000 7f2a3dfff700 1 --2- 172.21.15.45:0/1057327528 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2a38161340 0x7f2a3815ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:23.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.330+0000 7f2a3dfff700 1 --2- 172.21.15.45:0/1057327528 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2a380d2320 0x7f2a3814d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:23.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.330+0000 7f2a3dfff700 1 --2- 172.21.15.45:0/1057327528 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a3815c9b0 0x7f2a3815a610 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:23.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.330+0000 7f2a3dfff700 1 -- 172.21.15.45:0/1057327528 >> 172.21.15.45:0/1057327528 conn(0x7f2a38072600 msgr2=0x7f2a3815f110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:23.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.330+0000 7f2a3dfff700 1 -- 172.21.15.45:0/1057327528 shutdown_connections 2023-11-28T12:07:23.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.330+0000 7f2a3dfff700 1 -- 172.21.15.45:0/1057327528 wait complete. 2023-11-28T12:07:23.335 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 8 2023-11-28T12:07:23.349 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T12:07:23.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.553+0000 7f1c035ff700 1 Processor -- start 2023-11-28T12:07:23.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.553+0000 7f1c035ff700 1 -- start start 2023-11-28T12:07:23.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.554+0000 7f1c035ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f1bfc15c9b0 0x7f1bfc0b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:23.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.554+0000 7f1c035ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1bfc161340 0x7f1bfc0d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:23.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.554+0000 7f1c035ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1bfc0d2320 0x7f1bfc0cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:23.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.554+0000 7f1c035ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bfc0b5800 con 0x7f1bfc0d2320 2023-11-28T12:07:23.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.554+0000 7f1c035ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bfc0d1950 con 0x7f1bfc15c9b0 2023-11-28T12:07:23.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.554+0000 7f1c035ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bfc0b5520 con 0x7f1bfc161340 2023-11-28T12:07:23.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.554+0000 7f1c01b9c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1bfc0d2320 0x7f1bfc0cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:23.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.554+0000 7f1c01b9c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1bfc0d2320 0x7f1bfc0cd7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46272/0 (socket says 172.21.15.45:46272) 2023-11-28T12:07:23.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.554+0000 7f1c01b9c700 1 -- 172.21.15.45:0/780896851 learned_addr learned my addr 172.21.15.45:0/780896851 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:23.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.554+0000 7f1c00b9a700 1 --2- 172.21.15.45:0/780896851 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1bfc161340 0x7f1bfc0d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:23.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.554+0000 7f1c0139b700 1 --2- 172.21.15.45:0/780896851 >> v2:172.21.15.152:3300/0 conn(0x7f1bfc15c9b0 0x7f1bfc0b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:23.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.555+0000 7f1c01b9c700 1 -- 172.21.15.45:0/780896851 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1bfc161340 msgr2=0x7f1bfc0d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:23.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.555+0000 7f1c01b9c700 1 --2- 172.21.15.45:0/780896851 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1bfc161340 0x7f1bfc0d1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:23.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.555+0000 7f1c01b9c700 1 -- 172.21.15.45:0/780896851 >> v2:172.21.15.152:3300/0 conn(0x7f1bfc15c9b0 msgr2=0x7f1bfc0b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:23.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.555+0000 7f1c01b9c700 1 --2- 172.21.15.45:0/780896851 >> v2:172.21.15.152:3300/0 conn(0x7f1bfc15c9b0 0x7f1bfc0b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:23.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.555+0000 7f1c01b9c700 1 -- 172.21.15.45:0/780896851 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bfc0d1300 con 0x7f1bfc0d2320 2023-11-28T12:07:23.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.555+0000 7f1c01b9c700 1 --2- 172.21.15.45:0/780896851 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1bfc0d2320 0x7f1bfc0cd7c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc067460 tx=0x7f1bf400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c055b561f49aa875 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:23.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.555+0000 7f1bf3fff700 1 -- 172.21.15.45:0/780896851 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf400e070 con 0x7f1bfc0d2320 2023-11-28T12:07:23.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.555+0000 7f1bf3fff700 1 -- 172.21.15.45:0/780896851 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bf400b9c0 con 0x7f1bfc0d2320 2023-11-28T12:07:23.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.555+0000 7f1bf3fff700 1 -- 172.21.15.45:0/780896851 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf400bd70 con 0x7f1bfc0d2320 2023-11-28T12:07:23.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.556+0000 7f1c035ff700 1 -- 172.21.15.45:0/780896851 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1bfc0d2320 msgr2=0x7f1bfc0cd7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:23.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.556+0000 7f1c035ff700 1 --2- 172.21.15.45:0/780896851 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1bfc0d2320 0x7f1bfc0cd7c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc067460 tx=0x7f1bf400b330 comp rx=0 tx=0).stop 2023-11-28T12:07:23.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.556+0000 7f1c035ff700 1 -- 172.21.15.45:0/780896851 shutdown_connections 2023-11-28T12:07:23.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.556+0000 7f1c035ff700 1 --2- 172.21.15.45:0/780896851 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1bfc0d2320 0x7f1bfc0cd7c0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:23.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.556+0000 7f1c035ff700 1 --2- 172.21.15.45:0/780896851 >> v2:172.21.15.152:3300/0 conn(0x7f1bfc15c9b0 0x7f1bfc0b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:23.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.556+0000 7f1c035ff700 1 --2- 172.21.15.45:0/780896851 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1bfc161340 0x7f1bfc0d1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:23.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.556+0000 7f1c035ff700 1 -- 172.21.15.45:0/780896851 >> 172.21.15.45:0/780896851 conn(0x7f1bfc072600 msgr2=0x7f1bfc0cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:23.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.556+0000 7f1c035ff700 1 -- 172.21.15.45:0/780896851 shutdown_connections 2023-11-28T12:07:23.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.556+0000 7f1c035ff700 1 -- 172.21.15.45:0/780896851 wait complete. 2023-11-28T12:07:23.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.558+0000 7f1c035ff700 1 Processor -- start 2023-11-28T12:07:23.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.558+0000 7f1c035ff700 1 -- start start 2023-11-28T12:07:23.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.559+0000 7f1c035ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1bfc0d2320 0x7f1bfc1e6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:23.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.559+0000 7f1c035ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1bfc15c9b0 0x7f1bfc156440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:23.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.559+0000 7f1c035ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1bfc161340 0x7f1bfc154c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:23.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.559+0000 7f1c035ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bfc156980 con 0x7f1bfc161340 2023-11-28T12:07:23.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.559+0000 7f1c035ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bfc155fb0 con 0x7f1bfc0d2320 2023-11-28T12:07:23.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.559+0000 7f1c035ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bfc155140 con 0x7f1bfc15c9b0 2023-11-28T12:07:23.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.559+0000 7f1c01b9c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1bfc161340 0x7f1bfc154c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:23.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.559+0000 7f1c01b9c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1bfc161340 0x7f1bfc154c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46284/0 (socket says 172.21.15.45:46284) 2023-11-28T12:07:23.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.559+0000 7f1c01b9c700 1 -- 172.21.15.45:0/2611828022 learned_addr learned my addr 172.21.15.45:0/2611828022 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:23.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.559+0000 7f1c0139b700 1 --2- 172.21.15.45:0/2611828022 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1bfc0d2320 0x7f1bfc1e6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:23.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.559+0000 7f1c00b9a700 1 --2- 172.21.15.45:0/2611828022 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1bfc15c9b0 0x7f1bfc156440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:23.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.560+0000 7f1c01b9c700 1 -- 172.21.15.45:0/2611828022 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1bfc15c9b0 msgr2=0x7f1bfc156440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:23.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.560+0000 7f1c01b9c700 1 --2- 172.21.15.45:0/2611828022 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1bfc15c9b0 0x7f1bfc156440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:23.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.560+0000 7f1c01b9c700 1 -- 172.21.15.45:0/2611828022 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1bfc0d2320 msgr2=0x7f1bfc1e6fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:23.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.560+0000 7f1c01b9c700 1 --2- 172.21.15.45:0/2611828022 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1bfc0d2320 0x7f1bfc1e6fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:23.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.560+0000 7f1c01b9c700 1 -- 172.21.15.45:0/2611828022 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bf4009b30 con 0x7f1bfc161340 2023-11-28T12:07:23.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.560+0000 7f1c01b9c700 1 --2- 172.21.15.45:0/2611828022 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1bfc161340 0x7f1bfc154c00 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc0675d0 tx=0x7f1bf4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:23.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.560+0000 7f1bf1ffb700 1 -- 172.21.15.45:0/2611828022 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf40099b0 con 0x7f1bfc161340 2023-11-28T12:07:23.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.560+0000 7f1bf1ffb700 1 -- 172.21.15.45:0/2611828022 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bf4004250 con 0x7f1bfc161340 2023-11-28T12:07:23.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.560+0000 7f1c035ff700 1 -- 172.21.15.45:0/2611828022 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bfc0b5130 con 0x7f1bfc161340 2023-11-28T12:07:23.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.560+0000 7f1bf1ffb700 1 -- 172.21.15.45:0/2611828022 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf4004600 con 0x7f1bfc161340 2023-11-28T12:07:23.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.560+0000 7f1c035ff700 1 -- 172.21.15.45:0/2611828022 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bfc0d15e0 con 0x7f1bfc161340 2023-11-28T12:07:23.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.561+0000 7f1c035ff700 1 -- 172.21.15.45:0/2611828022 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bfc0b52c0 con 0x7f1bfc161340 2023-11-28T12:07:23.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.562+0000 7f1bf1ffb700 1 -- 172.21.15.45:0/2611828022 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f1bf402b070 con 0x7f1bfc161340 2023-11-28T12:07:23.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.563+0000 7f1bf1ffb700 1 --2- 172.21.15.45:0/2611828022 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f1be00682f0 0x7f1be006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:23.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.563+0000 7f1bf1ffb700 1 -- 172.21.15.45:0/2611828022 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f1bf4086f20 con 0x7f1bfc161340 2023-11-28T12:07:23.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.564+0000 7f1c0139b700 1 --2- 172.21.15.45:0/2611828022 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f1be00682f0 0x7f1be006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:23.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.564+0000 7f1c0139b700 1 --2- 172.21.15.45:0/2611828022 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f1be00682f0 0x7f1be006a7a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1bf8006b20 tx=0x7f1bf8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:23.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.567+0000 7f1bf1ffb700 1 -- 172.21.15.45:0/2611828022 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f1bf40b85e0 con 0x7f1bfc161340 2023-11-28T12:07:23.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.773+0000 7f1c035ff700 1 -- 172.21.15.45:0/2611828022 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1bfc0672b0 con 0x7f1bfc161340 2023-11-28T12:07:23.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.774+0000 7f1bf1ffb700 1 -- 172.21.15.45:0/2611828022 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+17944 (secure 0 0 0) 0x7f1bf401f020 con 0x7f1bfc161340 2023-11-28T12:07:23.775 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:07:23.775 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":22,"fsid":"bd7c37f1-f7c6-4778-b845-52cf2aa6e366","created":"2023-11-28T12:06:09.045075+0000","modified":"2023-11-28T12:07:18.025970+0000","last_up_change":"2023-11-28T12:06:21.282227+0000","last_in_change":"2023-11-28T12:06:12.560924+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T12:06:21.807108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T12:06:22.491009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T12:06:27.684157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T12:06:28.384679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d0cdd8a-87fd-4f2c-91bd-47bdfa661905","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":115843},{"type":"v1","addr":"172.21.15.45:6808","nonce":115843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":115843},{"type":"v1","addr":"172.21.15.45:6811","nonce":115843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":115843},{"type":"v1","addr":"172.21.15.45:6815","nonce":115843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":115843},{"type":"v1","addr":"172.21.15.45:6813","nonce":115843}]},"public_addr":"172.21.15.45:6808/115843","cluster_addr":"172.21.15.45:6811/115843","heartbeat_back_addr":"172.21.15.45:6815/115843","heartbeat_front_addr":"172.21.15.45:6813/115843","state":["exists","up"]},{"osd":1,"uuid":"c5de4ebd-9ec5-40b3-9caa-9b706fab4c76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":115842},{"type":"v1","addr":"172.21.15.45:6801","nonce":115842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":115842},{"type":"v1","addr":"172.21.15.45:6803","nonce":115842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6807","nonce":115842},{"type":"v1","addr":"172.21.15.45:6809","nonce":115842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":115842},{"type":"v1","addr":"172.21.15.45:6805","nonce":115842}]},"public_addr":"172.21.15.45:6801/115842","cluster_addr":"172.21.15.45:6803/115842","heartbeat_back_addr":"172.21.15.45:6809/115842","heartbeat_front_addr":"172.21.15.45:6805/115842","state":["exists","up"]},{"osd":2,"uuid":"9f4b36b2-65d2-40e7-9fe6-a2991afa71c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":115850},{"type":"v1","addr":"172.21.15.45:6819","nonce":115850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":115850},{"type":"v1","addr":"172.21.15.45:6823","nonce":115850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":115850},{"type":"v1","addr":"172.21.15.45:6831","nonce":115850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":115850},{"type":"v1","addr":"172.21.15.45:6828","nonce":115850}]},"public_addr":"172.21.15.45:6819/115850","cluster_addr":"172.21.15.45:6823/115850","heartbeat_back_addr":"172.21.15.45:6831/115850","heartbeat_front_addr":"172.21.15.45:6828/115850","state":["exists","up"]},{"osd":3,"uuid":"6fe7ef05-4e0d-426c-bf94-44b51d4d550b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":115848},{"type":"v1","addr":"172.21.15.45:6818","nonce":115848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":115848},{"type":"v1","addr":"172.21.15.45:6822","nonce":115848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6827","nonce":115848},{"type":"v1","addr":"172.21.15.45:6829","nonce":115848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":115848},{"type":"v1","addr":"172.21.15.45:6825","nonce":115848}]},"public_addr":"172.21.15.45:6818/115848","cluster_addr":"172.21.15.45:6822/115848","heartbeat_back_addr":"172.21.15.45:6829/115848","heartbeat_front_addr":"172.21.15.45:6825/115848","state":["exists","up"]},{"osd":4,"uuid":"fa403c08-d8a1-4a3a-8384-cb465c1a654c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":116092},{"type":"v1","addr":"172.21.15.152:6801","nonce":116092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":116092},{"type":"v1","addr":"172.21.15.152:6803","nonce":116092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":116092},{"type":"v1","addr":"172.21.15.152:6807","nonce":116092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":116092},{"type":"v1","addr":"172.21.15.152:6805","nonce":116092}]},"public_addr":"172.21.15.152:6801/116092","cluster_addr":"172.21.15.152:6803/116092","heartbeat_back_addr":"172.21.15.152:6807/116092","heartbeat_front_addr":"172.21.15.152:6805/116092","state":["exists","up"]},{"osd":5,"uuid":"399fc450-39fa-43a6-bf80-0b8bcb41bd95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6815","nonce":116093},{"type":"v1","addr":"172.21.15.152:6817","nonce":116093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":116093},{"type":"v1","addr":"172.21.15.152:6819","nonce":116093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":116093},{"type":"v1","addr":"172.21.15.152:6823","nonce":116093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":116093},{"type":"v1","addr":"172.21.15.152:6821","nonce":116093}]},"public_addr":"172.21.15.152:6817/116093","cluster_addr":"172.21.15.152:6819/116093","heartbeat_back_addr":"172.21.15.152:6823/116093","heartbeat_front_addr":"172.21.15.152:6821/116093","state":["exists","up"]},{"osd":6,"uuid":"e59a4017-2d23-4627-836b-e25b2d3ddaaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":116094},{"type":"v1","addr":"172.21.15.152:6809","nonce":116094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":116094},{"type":"v1","addr":"172.21.15.152:6811","nonce":116094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":116094},{"type":"v1","addr":"172.21.15.152:6816","nonce":116094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":116094},{"type":"v1","addr":"172.21.15.152:6813","nonce":116094}]},"public_addr":"172.21.15.152:6809/116094","cluster_addr":"172.21.15.152:6811/116094","heartbeat_back_addr":"172.21.15.152:6816/116094","heartbeat_front_addr":"172.21.15.152:6813/116094","state":["exists","up"]},{"osd":7,"uuid":"8d7f9d4b-bf08-4670-8591-388c0f012a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":116097},{"type":"v1","addr":"172.21.15.152:6825","nonce":116097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":116097},{"type":"v1","addr":"172.21.15.152:6827","nonce":116097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":116097},{"type":"v1","addr":"172.21.15.152:6831","nonce":116097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":116097},{"type":"v1","addr":"172.21.15.152:6829","nonce":116097}]},"public_addr":"172.21.15.152:6825/116097","cluster_addr":"172.21.15.152:6827/116097","heartbeat_back_addr":"172.21.15.152:6831/116097","heartbeat_front_addr":"172.21.15.152:6829/116097","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.937710+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.865423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.159434+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.913090+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.131647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.966255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.972583+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.177209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.29","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T12:07:23.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.776+0000 7f1c035ff700 1 -- 172.21.15.45:0/2611828022 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f1be00682f0 msgr2=0x7f1be006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:23.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.776+0000 7f1c035ff700 1 --2- 172.21.15.45:0/2611828022 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f1be00682f0 0x7f1be006a7a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1bf8006b20 tx=0x7f1bf8008040 comp rx=0 tx=0).stop 2023-11-28T12:07:23.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.776+0000 7f1c035ff700 1 -- 172.21.15.45:0/2611828022 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1bfc161340 msgr2=0x7f1bfc154c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:23.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.776+0000 7f1c035ff700 1 --2- 172.21.15.45:0/2611828022 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1bfc161340 0x7f1bfc154c00 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc0675d0 tx=0x7f1bf4004ad0 comp rx=0 tx=0).stop 2023-11-28T12:07:23.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.776+0000 7f1c035ff700 1 -- 172.21.15.45:0/2611828022 shutdown_connections 2023-11-28T12:07:23.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.776+0000 7f1c035ff700 1 --2- 172.21.15.45:0/2611828022 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f1be00682f0 0x7f1be006a7a0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:23.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.776+0000 7f1c035ff700 1 --2- 172.21.15.45:0/2611828022 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1bfc0d2320 0x7f1bfc1e6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:23.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.776+0000 7f1c035ff700 1 --2- 172.21.15.45:0/2611828022 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1bfc161340 0x7f1bfc154c00 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:23.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.776+0000 7f1c035ff700 1 --2- 172.21.15.45:0/2611828022 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1bfc15c9b0 0x7f1bfc156440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:23.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.777+0000 7f1c035ff700 1 -- 172.21.15.45:0/2611828022 >> 172.21.15.45:0/2611828022 conn(0x7f1bfc072600 msgr2=0x7f1bfc06a900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:23.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.777+0000 7f1c035ff700 1 -- 172.21.15.45:0/2611828022 shutdown_connections 2023-11-28T12:07:23.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:23.777+0000 7f1c035ff700 1 -- 172.21.15.45:0/2611828022 wait complete. 2023-11-28T12:07:23.795 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-28T12:06:21.807108+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-28T12:06:22.491009+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T12:06:27.684157+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T12:06:28.384679+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T12:07:23.796 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T12:07:24.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.002+0000 7f8611fff700 1 Processor -- start 2023-11-28T12:07:24.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.002+0000 7f8611fff700 1 -- start start 2023-11-28T12:07:24.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.003+0000 7f8611fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f860c161340 0x7f860c0d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:24.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.003+0000 7f8611fff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f860c0d2320 0x7f860c0cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:24.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.003+0000 7f8611fff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f860c0d1950 con 0x7f860c15c9b0 2023-11-28T12:07:24.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.003+0000 7f8611fff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f860c0b5800 con 0x7f860c161340 2023-11-28T12:07:24.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.003+0000 7f8611fff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f860c0b5300 con 0x7f860c0d2320 2023-11-28T12:07:24.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.004+0000 7f860affd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f860c161340 0x7f860c0d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:24.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.004+0000 7f860bfff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f860c0d2320 0x7f860c0cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:24.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.004+0000 7f860affd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f860c161340 0x7f860c0d1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46302/0 (socket says 172.21.15.45:46302) 2023-11-28T12:07:24.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.004+0000 7f860affd700 1 -- 172.21.15.45:0/3919105247 learned_addr learned my addr 172.21.15.45:0/3919105247 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:24.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.004+0000 7f860b7fe700 1 --1- 172.21.15.45:0/3919105247 >> v1:172.21.15.152:6789/0 conn(0x7f860c15c9b0 0x7f860c0b4bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.45:58436/0 (socket says 172.21.15.45:58436) 2023-11-28T12:07:24.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.004+0000 7f860affd700 1 -- 172.21.15.45:0/3919105247 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f860c0d2320 msgr2=0x7f860c0cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:24.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.004+0000 7f860affd700 1 --2- 172.21.15.45:0/3919105247 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f860c0d2320 0x7f860c0cd7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:24.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.004+0000 7f860affd700 1 -- 172.21.15.45:0/3919105247 >> v1:172.21.15.152:6789/0 conn(0x7f860c15c9b0 legacy=0x7f860c0b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:24.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.004+0000 7f860affd700 1 -- 172.21.15.45:0/3919105247 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f860c0b5520 con 0x7f860c161340 2023-11-28T12:07:24.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.004+0000 7f860affd700 1 --2- 172.21.15.45:0/3919105247 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f860c161340 0x7f860c0d1de0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f86000098f0 tx=0x7f8600009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2033b76ac5cf289d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:24.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.005+0000 7f860a7fc700 1 -- 172.21.15.45:0/3919105247 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8600011830 con 0x7f860c161340 2023-11-28T12:07:24.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.005+0000 7f860a7fc700 1 -- 172.21.15.45:0/3919105247 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8600011990 con 0x7f860c161340 2023-11-28T12:07:24.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.005+0000 7f860a7fc700 1 -- 172.21.15.45:0/3919105247 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8600011d20 con 0x7f860c161340 2023-11-28T12:07:24.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.005+0000 7f8611fff700 1 -- 172.21.15.45:0/3919105247 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f860c161340 msgr2=0x7f860c0d1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:24.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.005+0000 7f8611fff700 1 --2- 172.21.15.45:0/3919105247 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f860c161340 0x7f860c0d1de0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f86000098f0 tx=0x7f8600009c00 comp rx=0 tx=0).stop 2023-11-28T12:07:24.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.005+0000 7f8611fff700 1 -- 172.21.15.45:0/3919105247 shutdown_connections 2023-11-28T12:07:24.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.005+0000 7f8611fff700 1 --2- 172.21.15.45:0/3919105247 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f860c0d2320 0x7f860c0cd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:24.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.005+0000 7f8611fff700 1 --2- 172.21.15.45:0/3919105247 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f860c161340 0x7f860c0d1de0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:24.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.005+0000 7f8611fff700 1 -- 172.21.15.45:0/3919105247 >> 172.21.15.45:0/3919105247 conn(0x7f860c072600 msgr2=0x7f860c0cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:24.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.005+0000 7f8611fff700 1 -- 172.21.15.45:0/3919105247 shutdown_connections 2023-11-28T12:07:24.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.005+0000 7f8611fff700 1 -- 172.21.15.45:0/3919105247 wait complete. 2023-11-28T12:07:24.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.007+0000 7f8611fff700 1 Processor -- start 2023-11-28T12:07:24.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.007+0000 7f8611fff700 1 -- start start 2023-11-28T12:07:24.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.008+0000 7f8611fff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f860c0d2320 0x7f860c14a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:24.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.008+0000 7f8611fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f860c15c9b0 0x7f860c1e7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:24.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.008+0000 7f8611fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f860c161340 0x7f860c0c89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:24.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.008+0000 7f8611fff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f860c14ab30 con 0x7f860c161340 2023-11-28T12:07:24.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.008+0000 7f8611fff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f860c1e84f0 con 0x7f860c15c9b0 2023-11-28T12:07:24.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.008+0000 7f8611fff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f860c1e6f10 con 0x7f860c0d2320 2023-11-28T12:07:24.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.008+0000 7f860bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f860c161340 0x7f860c0c89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:24.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.008+0000 7f860bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f860c161340 0x7f860c0c89b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46310/0 (socket says 172.21.15.45:46310) 2023-11-28T12:07:24.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.008+0000 7f860bfff700 1 -- 172.21.15.45:0/3455009815 learned_addr learned my addr 172.21.15.45:0/3455009815 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:24.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.008+0000 7f860b7fe700 1 --2- 172.21.15.45:0/3455009815 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f860c0d2320 0x7f860c14a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:24.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.008+0000 7f860affd700 1 --2- 172.21.15.45:0/3455009815 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f860c15c9b0 0x7f860c1e7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:24.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.009+0000 7f860bfff700 1 -- 172.21.15.45:0/3455009815 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f860c0d2320 msgr2=0x7f860c14a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:24.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.009+0000 7f860bfff700 1 --2- 172.21.15.45:0/3455009815 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f860c0d2320 0x7f860c14a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:24.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.009+0000 7f860bfff700 1 -- 172.21.15.45:0/3455009815 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f860c15c9b0 msgr2=0x7f860c1e7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:24.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.009+0000 7f860bfff700 1 --2- 172.21.15.45:0/3455009815 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f860c15c9b0 0x7f860c1e7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:24.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.009+0000 7f860bfff700 1 -- 172.21.15.45:0/3455009815 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8600009550 con 0x7f860c161340 2023-11-28T12:07:24.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.009+0000 7f860bfff700 1 --2- 172.21.15.45:0/3455009815 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f860c161340 0x7f860c0c89b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f860400efc0 tx=0x7f860400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:24.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.009+0000 7f85f3fff700 1 -- 172.21.15.45:0/3455009815 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8604009b20 con 0x7f860c161340 2023-11-28T12:07:24.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.009+0000 7f85f3fff700 1 -- 172.21.15.45:0/3455009815 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f860400f040 con 0x7f860c161340 2023-11-28T12:07:24.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.009+0000 7f85f3fff700 1 -- 172.21.15.45:0/3455009815 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8604009e50 con 0x7f860c161340 2023-11-28T12:07:24.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.009+0000 7f8611fff700 1 -- 172.21.15.45:0/3455009815 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f860c0d15e0 con 0x7f860c161340 2023-11-28T12:07:24.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.009+0000 7f8611fff700 1 -- 172.21.15.45:0/3455009815 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f860c0d1300 con 0x7f860c161340 2023-11-28T12:07:24.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.011+0000 7f8611fff700 1 -- 172.21.15.45:0/3455009815 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f860c15cd80 con 0x7f860c161340 2023-11-28T12:07:24.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.011+0000 7f85f3fff700 1 -- 172.21.15.45:0/3455009815 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f8604014480 con 0x7f860c161340 2023-11-28T12:07:24.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.012+0000 7f85f3fff700 1 --2- 172.21.15.45:0/3455009815 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f85f80682f0 0x7f85f806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:24.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.012+0000 7f85f3fff700 1 -- 172.21.15.45:0/3455009815 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f8604086aa0 con 0x7f860c161340 2023-11-28T12:07:24.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.013+0000 7f860b7fe700 1 --2- 172.21.15.45:0/3455009815 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f85f80682f0 0x7f85f806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:24.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.014+0000 7f860b7fe700 1 --2- 172.21.15.45:0/3455009815 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f85f80682f0 0x7f85f806a7a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f85fc000f60 tx=0x7f85fc007d10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:24.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.017+0000 7f85f3fff700 1 -- 172.21.15.45:0/3455009815 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f8604053170 con 0x7f860c161340 2023-11-28T12:07:24.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.220+0000 7f8611fff700 1 -- 172.21.15.45:0/3455009815 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f860c0745c0 con 0x7f860c161340 2023-11-28T12:07:24.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.221+0000 7f85f3fff700 1 -- 172.21.15.45:0/3455009815 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f86040180a0 con 0x7f860c161340 2023-11-28T12:07:24.222 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-11-28T12:07:24.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.223+0000 7f8611fff700 1 -- 172.21.15.45:0/3455009815 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f85f80682f0 msgr2=0x7f85f806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:24.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.223+0000 7f8611fff700 1 --2- 172.21.15.45:0/3455009815 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f85f80682f0 0x7f85f806a7a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f85fc000f60 tx=0x7f85fc007d10 comp rx=0 tx=0).stop 2023-11-28T12:07:24.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.223+0000 7f8611fff700 1 -- 172.21.15.45:0/3455009815 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f860c161340 msgr2=0x7f860c0c89b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:24.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.223+0000 7f8611fff700 1 --2- 172.21.15.45:0/3455009815 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f860c161340 0x7f860c0c89b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f860400efc0 tx=0x7f860400c3a0 comp rx=0 tx=0).stop 2023-11-28T12:07:24.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.223+0000 7f8611fff700 1 -- 172.21.15.45:0/3455009815 shutdown_connections 2023-11-28T12:07:24.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.223+0000 7f8611fff700 1 --2- 172.21.15.45:0/3455009815 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f85f80682f0 0x7f85f806a7a0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:24.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.223+0000 7f8611fff700 1 --2- 172.21.15.45:0/3455009815 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f860c161340 0x7f860c0c89b0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:24.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.223+0000 7f8611fff700 1 --2- 172.21.15.45:0/3455009815 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f860c0d2320 0x7f860c14a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:24.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.223+0000 7f8611fff700 1 --2- 172.21.15.45:0/3455009815 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f860c15c9b0 0x7f860c1e7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:24.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.223+0000 7f8611fff700 1 -- 172.21.15.45:0/3455009815 >> 172.21.15.45:0/3455009815 conn(0x7f860c072600 msgr2=0x7f860c0b6240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:24.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.223+0000 7f8611fff700 1 -- 172.21.15.45:0/3455009815 shutdown_connections 2023-11-28T12:07:24.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.223+0000 7f8611fff700 1 -- 172.21.15.45:0/3455009815 wait complete. 2023-11-28T12:07:24.242 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T12:07:24.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.447+0000 7f3ba97ff700 1 Processor -- start 2023-11-28T12:07:24.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.447+0000 7f3ba97ff700 1 -- start start 2023-11-28T12:07:24.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.448+0000 7f3ba97ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3ba415c9b0 0x7f3ba40b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:24.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.448+0000 7f3ba97ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3ba40cd7c0 0x7f3ba40cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:24.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.449+0000 7f3ba97ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ba40d1950 con 0x7f3ba4161340 2023-11-28T12:07:24.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.449+0000 7f3ba97ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ba40b5800 con 0x7f3ba415c9b0 2023-11-28T12:07:24.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.449+0000 7f3ba97ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba40ce140 con 0x7f3ba40cd7c0 2023-11-28T12:07:24.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.449+0000 7f3ba2ffd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3ba415c9b0 0x7f3ba40b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:24.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.449+0000 7f3ba2ffd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3ba415c9b0 0x7f3ba40b4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46320/0 (socket says 172.21.15.45:46320) 2023-11-28T12:07:24.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.449+0000 7f3ba2ffd700 1 -- 172.21.15.45:0/1050384637 learned_addr learned my addr 172.21.15.45:0/1050384637 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:24.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.449+0000 7f3ba37fe700 1 --2- 172.21.15.45:0/1050384637 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3ba40cd7c0 0x7f3ba40cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:24.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.449+0000 7f3ba2ffd700 1 -- 172.21.15.45:0/1050384637 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3ba40cd7c0 msgr2=0x7f3ba40cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:24.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.449+0000 7f3ba2ffd700 1 --2- 172.21.15.45:0/1050384637 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3ba40cd7c0 0x7f3ba40cdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:24.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.449+0000 7f3ba2ffd700 1 -- 172.21.15.45:0/1050384637 >> v1:172.21.15.152:6789/0 conn(0x7f3ba4161340 legacy=0x7f3ba40d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:24.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.449+0000 7f3ba2ffd700 1 -- 172.21.15.45:0/1050384637 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ba40d24f0 con 0x7f3ba415c9b0 2023-11-28T12:07:24.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.449+0000 7f3ba37fe700 1 --2- 172.21.15.45:0/1050384637 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3ba40cd7c0 0x7f3ba40cdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:07:24.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.450+0000 7f3ba2ffd700 1 --2- 172.21.15.45:0/1050384637 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ba415c9b0 0x7f3ba40b4bf0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f3b940098f0 tx=0x7f3b94009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95a9c7f3a467cbf2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:24.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.450+0000 7f3ba1ffb700 1 -- 172.21.15.45:0/1050384637 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b94004230 con 0x7f3ba415c9b0 2023-11-28T12:07:24.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.450+0000 7f3ba1ffb700 1 -- 172.21.15.45:0/1050384637 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b94004390 con 0x7f3ba415c9b0 2023-11-28T12:07:24.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.450+0000 7f3ba1ffb700 1 -- 172.21.15.45:0/1050384637 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b940036a0 con 0x7f3ba415c9b0 2023-11-28T12:07:24.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.450+0000 7f3ba97ff700 1 -- 172.21.15.45:0/1050384637 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ba415c9b0 msgr2=0x7f3ba40b4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:24.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.450+0000 7f3ba97ff700 1 --2- 172.21.15.45:0/1050384637 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ba415c9b0 0x7f3ba40b4bf0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f3b940098f0 tx=0x7f3b94009c00 comp rx=0 tx=0).stop 2023-11-28T12:07:24.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.450+0000 7f3ba97ff700 1 -- 172.21.15.45:0/1050384637 shutdown_connections 2023-11-28T12:07:24.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.450+0000 7f3ba97ff700 1 --2- 172.21.15.45:0/1050384637 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3ba40cd7c0 0x7f3ba40cdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:24.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.450+0000 7f3ba97ff700 1 --2- 172.21.15.45:0/1050384637 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ba415c9b0 0x7f3ba40b4bf0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:24.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.450+0000 7f3ba97ff700 1 -- 172.21.15.45:0/1050384637 >> 172.21.15.45:0/1050384637 conn(0x7f3ba4072600 msgr2=0x7f3ba40cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:24.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.451+0000 7f3ba97ff700 1 -- 172.21.15.45:0/1050384637 shutdown_connections 2023-11-28T12:07:24.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.451+0000 7f3ba97ff700 1 -- 172.21.15.45:0/1050384637 wait complete. 2023-11-28T12:07:24.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.452+0000 7f3ba97ff700 1 Processor -- start 2023-11-28T12:07:24.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.453+0000 7f3ba97ff700 1 -- start start 2023-11-28T12:07:24.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.453+0000 7f3ba97ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3ba40cd7c0 0x7f3ba415e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:24.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.453+0000 7f3ba97ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ba415c9b0 0x7f3ba40c7f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:24.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.454+0000 7f3ba97ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3ba4161340 0x7f3ba4153ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:24.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.454+0000 7f3ba97ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba40c9a50 con 0x7f3ba415c9b0 2023-11-28T12:07:24.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.454+0000 7f3ba97ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba40c89b0 con 0x7f3ba4161340 2023-11-28T12:07:24.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.454+0000 7f3ba97ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba40c8c90 con 0x7f3ba40cd7c0 2023-11-28T12:07:24.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.454+0000 7f3ba27fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ba415c9b0 0x7f3ba40c7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:24.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.454+0000 7f3ba27fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ba415c9b0 0x7f3ba40c7f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46326/0 (socket says 172.21.15.45:46326) 2023-11-28T12:07:24.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.454+0000 7f3ba27fc700 1 -- 172.21.15.45:0/2724405397 learned_addr learned my addr 172.21.15.45:0/2724405397 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:24.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.454+0000 7f3ba2ffd700 1 --2- 172.21.15.45:0/2724405397 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3ba40cd7c0 0x7f3ba415e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:24.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.454+0000 7f3ba37fe700 1 --2- 172.21.15.45:0/2724405397 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3ba4161340 0x7f3ba4153ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:24.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.454+0000 7f3ba27fc700 1 -- 172.21.15.45:0/2724405397 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3ba40cd7c0 msgr2=0x7f3ba415e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:24.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.454+0000 7f3ba27fc700 1 --2- 172.21.15.45:0/2724405397 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3ba40cd7c0 0x7f3ba415e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:24.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.454+0000 7f3ba27fc700 1 -- 172.21.15.45:0/2724405397 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3ba4161340 msgr2=0x7f3ba4153ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:24.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.454+0000 7f3ba27fc700 1 --2- 172.21.15.45:0/2724405397 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3ba4161340 0x7f3ba4153ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:24.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.454+0000 7f3ba27fc700 1 -- 172.21.15.45:0/2724405397 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b94009550 con 0x7f3ba415c9b0 2023-11-28T12:07:24.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.454+0000 7f3ba27fc700 1 --2- 172.21.15.45:0/2724405397 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ba415c9b0 0x7f3ba40c7f50 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f3b9800c4d0 tx=0x7f3b9800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:24.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.455+0000 7f3b8b7fe700 1 -- 172.21.15.45:0/2724405397 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b98011790 con 0x7f3ba415c9b0 2023-11-28T12:07:24.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.455+0000 7f3b8b7fe700 1 -- 172.21.15.45:0/2724405397 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b980118f0 con 0x7f3ba415c9b0 2023-11-28T12:07:24.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.455+0000 7f3b8b7fe700 1 -- 172.21.15.45:0/2724405397 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b98011ca0 con 0x7f3ba415c9b0 2023-11-28T12:07:24.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.455+0000 7f3ba97ff700 1 -- 172.21.15.45:0/2724405397 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ba40d1300 con 0x7f3ba415c9b0 2023-11-28T12:07:24.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.455+0000 7f3ba97ff700 1 -- 172.21.15.45:0/2724405397 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ba40b5520 con 0x7f3ba415c9b0 2023-11-28T12:07:24.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.456+0000 7f3ba97ff700 1 -- 172.21.15.45:0/2724405397 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ba40d15e0 con 0x7f3ba415c9b0 2023-11-28T12:07:24.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.457+0000 7f3b8b7fe700 1 -- 172.21.15.45:0/2724405397 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f3b98010050 con 0x7f3ba415c9b0 2023-11-28T12:07:24.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.458+0000 7f3b8b7fe700 1 --2- 172.21.15.45:0/2724405397 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f3b900682f0 0x7f3b9006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:24.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.458+0000 7f3b8b7fe700 1 -- 172.21.15.45:0/2724405397 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f3b98085b40 con 0x7f3ba415c9b0 2023-11-28T12:07:24.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.458+0000 7f3ba2ffd700 1 --2- 172.21.15.45:0/2724405397 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f3b900682f0 0x7f3b9006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:24.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.459+0000 7f3ba2ffd700 1 --2- 172.21.15.45:0/2724405397 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f3b900682f0 0x7f3b9006a7a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3b94009130 tx=0x7f3b94008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:24.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.462+0000 7f3b8b7fe700 1 -- 172.21.15.45:0/2724405397 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f3b98052270 con 0x7f3ba415c9b0 2023-11-28T12:07:24.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.666+0000 7f3ba97ff700 1 -- 172.21.15.45:0/2724405397 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3ba40745c0 con 0x7f3ba415c9b0 2023-11-28T12:07:24.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.666+0000 7f3b8b7fe700 1 -- 172.21.15.45:0/2724405397 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3b98055890 con 0x7f3ba415c9b0 2023-11-28T12:07:24.667 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-11-28T12:07:24.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.669+0000 7f3ba97ff700 1 -- 172.21.15.45:0/2724405397 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f3b900682f0 msgr2=0x7f3b9006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:24.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.669+0000 7f3ba97ff700 1 --2- 172.21.15.45:0/2724405397 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f3b900682f0 0x7f3b9006a7a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3b94009130 tx=0x7f3b94008030 comp rx=0 tx=0).stop 2023-11-28T12:07:24.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.669+0000 7f3ba97ff700 1 -- 172.21.15.45:0/2724405397 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ba415c9b0 msgr2=0x7f3ba40c7f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:24.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.669+0000 7f3ba97ff700 1 --2- 172.21.15.45:0/2724405397 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ba415c9b0 0x7f3ba40c7f50 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f3b9800c4d0 tx=0x7f3b9800c890 comp rx=0 tx=0).stop 2023-11-28T12:07:24.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.669+0000 7f3ba97ff700 1 -- 172.21.15.45:0/2724405397 shutdown_connections 2023-11-28T12:07:24.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.669+0000 7f3ba97ff700 1 --2- 172.21.15.45:0/2724405397 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f3b900682f0 0x7f3b9006a7a0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:24.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.669+0000 7f3ba97ff700 1 --2- 172.21.15.45:0/2724405397 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3ba4161340 0x7f3ba4153ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:24.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.669+0000 7f3ba97ff700 1 --2- 172.21.15.45:0/2724405397 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3ba40cd7c0 0x7f3ba415e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:24.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.669+0000 7f3ba97ff700 1 --2- 172.21.15.45:0/2724405397 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ba415c9b0 0x7f3ba40c7f50 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:24.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.669+0000 7f3ba97ff700 1 -- 172.21.15.45:0/2724405397 >> 172.21.15.45:0/2724405397 conn(0x7f3ba4072600 msgr2=0x7f3ba40b5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:24.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.669+0000 7f3ba97ff700 1 -- 172.21.15.45:0/2724405397 shutdown_connections 2023-11-28T12:07:24.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.669+0000 7f3ba97ff700 1 -- 172.21.15.45:0/2724405397 wait complete. 2023-11-28T12:07:24.690 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T12:07:24.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.895+0000 7fb2667ff700 1 Processor -- start 2023-11-28T12:07:24.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.895+0000 7fb2667ff700 1 -- start start 2023-11-28T12:07:24.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.897+0000 7fb2667ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb2600d01b0 0x7fb2600d0c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:24.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.897+0000 7fb2667ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb2600b20b0 0x7fb2600d1160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:24.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.897+0000 7fb2667ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb2600b29b0 0x7fb2600b2e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:24.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.897+0000 7fb2667ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb26015cec0 con 0x7fb2600b29b0 2023-11-28T12:07:24.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.897+0000 7fb2667ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2600b0230 con 0x7fb2600b20b0 2023-11-28T12:07:24.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.897+0000 7fb2667ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2600b4570 con 0x7fb2600d01b0 2023-11-28T12:07:24.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.897+0000 7fb264d9c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb2600b29b0 0x7fb2600b2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:24.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.897+0000 7fb264d9c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb2600b29b0 0x7fb2600b2e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46330/0 (socket says 172.21.15.45:46330) 2023-11-28T12:07:24.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.897+0000 7fb264d9c700 1 -- 172.21.15.45:0/3709735776 learned_addr learned my addr 172.21.15.45:0/3709735776 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:24.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.897+0000 7fb25ffff700 1 --2- 172.21.15.45:0/3709735776 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb2600d01b0 0x7fb2600d0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:24.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.897+0000 7fb25f7fe700 1 --2- 172.21.15.45:0/3709735776 >> v2:172.21.15.152:3300/0 conn(0x7fb2600b20b0 0x7fb2600d1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:24.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.897+0000 7fb264d9c700 1 -- 172.21.15.45:0/3709735776 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb2600d01b0 msgr2=0x7fb2600d0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:24.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.897+0000 7fb264d9c700 1 --2- 172.21.15.45:0/3709735776 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb2600d01b0 0x7fb2600d0c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:24.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.897+0000 7fb264d9c700 1 -- 172.21.15.45:0/3709735776 >> v2:172.21.15.152:3300/0 conn(0x7fb2600b20b0 msgr2=0x7fb2600d1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:24.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.897+0000 7fb264d9c700 1 --2- 172.21.15.45:0/3709735776 >> v2:172.21.15.152:3300/0 conn(0x7fb2600b20b0 0x7fb2600d1160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:24.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.897+0000 7fb264d9c700 1 -- 172.21.15.45:0/3709735776 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2600b4850 con 0x7fb2600b29b0 2023-11-28T12:07:24.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.898+0000 7fb264d9c700 1 --2- 172.21.15.45:0/3709735776 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2600b29b0 0x7fb2600b2e30 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb2600b5c10 tx=0x7fb25800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=242c25790bf06861 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:24.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.898+0000 7fb25effd700 1 -- 172.21.15.45:0/3709735776 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb25800e070 con 0x7fb2600b29b0 2023-11-28T12:07:24.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.898+0000 7fb25effd700 1 -- 172.21.15.45:0/3709735776 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb25800b9c0 con 0x7fb2600b29b0 2023-11-28T12:07:24.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.898+0000 7fb25effd700 1 -- 172.21.15.45:0/3709735776 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb25800bd70 con 0x7fb2600b29b0 2023-11-28T12:07:24.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.898+0000 7fb2667ff700 1 -- 172.21.15.45:0/3709735776 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2600b29b0 msgr2=0x7fb2600b2e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:24.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.898+0000 7fb2667ff700 1 --2- 172.21.15.45:0/3709735776 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2600b29b0 0x7fb2600b2e30 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb2600b5c10 tx=0x7fb25800b330 comp rx=0 tx=0).stop 2023-11-28T12:07:24.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.899+0000 7fb2667ff700 1 -- 172.21.15.45:0/3709735776 shutdown_connections 2023-11-28T12:07:24.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.899+0000 7fb2667ff700 1 --2- 172.21.15.45:0/3709735776 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb2600d01b0 0x7fb2600d0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:24.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.899+0000 7fb2667ff700 1 --2- 172.21.15.45:0/3709735776 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2600b29b0 0x7fb2600b2e30 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:24.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.899+0000 7fb2667ff700 1 --2- 172.21.15.45:0/3709735776 >> v2:172.21.15.152:3300/0 conn(0x7fb2600b20b0 0x7fb2600d1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:24.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.899+0000 7fb2667ff700 1 -- 172.21.15.45:0/3709735776 >> 172.21.15.45:0/3709735776 conn(0x7fb26009c3f0 msgr2=0x7fb2600d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:24.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.899+0000 7fb2667ff700 1 -- 172.21.15.45:0/3709735776 shutdown_connections 2023-11-28T12:07:24.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.899+0000 7fb2667ff700 1 -- 172.21.15.45:0/3709735776 wait complete. 2023-11-28T12:07:24.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.901+0000 7fb2667ff700 1 Processor -- start 2023-11-28T12:07:24.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.901+0000 7fb2667ff700 1 -- start start 2023-11-28T12:07:24.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.902+0000 7fb2667ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb2600b20b0 0x7fb26015eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:24.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.902+0000 7fb2667ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2600b29b0 0x7fb26015f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:24.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.902+0000 7fb2667ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb2600d01b0 0x7fb26015d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:24.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.902+0000 7fb2667ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2601f3390 con 0x7fb2600b29b0 2023-11-28T12:07:24.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.902+0000 7fb2667ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb26015fb40 con 0x7fb2600d01b0 2023-11-28T12:07:24.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.902+0000 7fb2667ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb26015fe20 con 0x7fb2600b20b0 2023-11-28T12:07:24.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.902+0000 7fb25f7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2600b29b0 0x7fb26015f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:24.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.902+0000 7fb25f7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2600b29b0 0x7fb26015f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46338/0 (socket says 172.21.15.45:46338) 2023-11-28T12:07:24.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.902+0000 7fb25f7fe700 1 -- 172.21.15.45:0/3756570992 learned_addr learned my addr 172.21.15.45:0/3756570992 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:24.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.902+0000 7fb25ffff700 1 --2- 172.21.15.45:0/3756570992 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb2600b20b0 0x7fb26015eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:24.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.902+0000 7fb264d9c700 1 --2- 172.21.15.45:0/3756570992 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb2600d01b0 0x7fb26015d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:24.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.903+0000 7fb25f7fe700 1 -- 172.21.15.45:0/3756570992 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb2600b20b0 msgr2=0x7fb26015eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:24.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.903+0000 7fb25f7fe700 1 --2- 172.21.15.45:0/3756570992 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb2600b20b0 0x7fb26015eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:24.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.903+0000 7fb25f7fe700 1 -- 172.21.15.45:0/3756570992 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb2600d01b0 msgr2=0x7fb26015d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:24.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.903+0000 7fb25f7fe700 1 --2- 172.21.15.45:0/3756570992 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb2600d01b0 0x7fb26015d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:24.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.903+0000 7fb25f7fe700 1 -- 172.21.15.45:0/3756570992 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb258009b30 con 0x7fb2600b29b0 2023-11-28T12:07:24.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.903+0000 7fb25ffff700 1 --2- 172.21.15.45:0/3756570992 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb2600b20b0 0x7fb26015eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:07:24.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.903+0000 7fb25f7fe700 1 --2- 172.21.15.45:0/3756570992 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2600b29b0 0x7fb26015f530 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb25400e810 tx=0x7fb25400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:24.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.903+0000 7fb25cff9700 1 -- 172.21.15.45:0/3756570992 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb25400c070 con 0x7fb2600b29b0 2023-11-28T12:07:24.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.903+0000 7fb25cff9700 1 -- 172.21.15.45:0/3756570992 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb254013610 con 0x7fb2600b29b0 2023-11-28T12:07:24.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.903+0000 7fb2667ff700 1 -- 172.21.15.45:0/3756570992 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2600afec0 con 0x7fb2600b29b0 2023-11-28T12:07:24.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.903+0000 7fb25cff9700 1 -- 172.21.15.45:0/3756570992 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2540139a0 con 0x7fb2600b29b0 2023-11-28T12:07:24.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.903+0000 7fb2667ff700 1 -- 172.21.15.45:0/3756570992 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2600afbe0 con 0x7fb2600b29b0 2023-11-28T12:07:24.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.905+0000 7fb2667ff700 1 -- 172.21.15.45:0/3756570992 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2600b2600 con 0x7fb2600b29b0 2023-11-28T12:07:24.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.905+0000 7fb25cff9700 1 -- 172.21.15.45:0/3756570992 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fb254023070 con 0x7fb2600b29b0 2023-11-28T12:07:24.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.907+0000 7fb25cff9700 1 --2- 172.21.15.45:0/3756570992 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb24c0682f0 0x7fb24c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:24.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.907+0000 7fb25cff9700 1 -- 172.21.15.45:0/3756570992 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fb2540859d0 con 0x7fb2600b29b0 2023-11-28T12:07:24.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.907+0000 7fb25ffff700 1 --2- 172.21.15.45:0/3756570992 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb24c0682f0 0x7fb24c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:24.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.908+0000 7fb25ffff700 1 --2- 172.21.15.45:0/3756570992 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb24c0682f0 0x7fb24c06a7a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb250006b20 tx=0x7fb250008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:24.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:24.911+0000 7fb25cff9700 1 -- 172.21.15.45:0/3756570992 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fb254052100 con 0x7fb2600b29b0 2023-11-28T12:07:25.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.113+0000 7fb2667ff700 1 -- 172.21.15.45:0/3756570992 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb26006ca60 con 0x7fb2600b29b0 2023-11-28T12:07:25.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.114+0000 7fb25cff9700 1 -- 172.21.15.45:0/3756570992 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb254055720 con 0x7fb2600b29b0 2023-11-28T12:07:25.115 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-11-28T12:07:25.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.116+0000 7fb2667ff700 1 -- 172.21.15.45:0/3756570992 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb24c0682f0 msgr2=0x7fb24c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:25.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.116+0000 7fb2667ff700 1 --2- 172.21.15.45:0/3756570992 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb24c0682f0 0x7fb24c06a7a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb250006b20 tx=0x7fb250008040 comp rx=0 tx=0).stop 2023-11-28T12:07:25.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.116+0000 7fb2667ff700 1 -- 172.21.15.45:0/3756570992 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2600b29b0 msgr2=0x7fb26015f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:25.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.116+0000 7fb2667ff700 1 --2- 172.21.15.45:0/3756570992 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2600b29b0 0x7fb26015f530 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb25400e810 tx=0x7fb25400eb20 comp rx=0 tx=0).stop 2023-11-28T12:07:25.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.116+0000 7fb2667ff700 1 -- 172.21.15.45:0/3756570992 shutdown_connections 2023-11-28T12:07:25.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.116+0000 7fb2667ff700 1 --2- 172.21.15.45:0/3756570992 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb24c0682f0 0x7fb24c06a7a0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:25.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.116+0000 7fb2667ff700 1 --2- 172.21.15.45:0/3756570992 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb2600d01b0 0x7fb26015d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:25.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.116+0000 7fb2667ff700 1 --2- 172.21.15.45:0/3756570992 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb2600b20b0 0x7fb26015eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:25.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.116+0000 7fb2667ff700 1 --2- 172.21.15.45:0/3756570992 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2600b29b0 0x7fb26015f530 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:25.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.116+0000 7fb2667ff700 1 -- 172.21.15.45:0/3756570992 >> 172.21.15.45:0/3756570992 conn(0x7fb26009c3f0 msgr2=0x7fb26006c350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:25.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.116+0000 7fb2667ff700 1 -- 172.21.15.45:0/3756570992 shutdown_connections 2023-11-28T12:07:25.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.116+0000 7fb2667ff700 1 -- 172.21.15.45:0/3756570992 wait complete. 2023-11-28T12:07:25.134 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T12:07:25.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.340+0000 7f7dd6fff700 1 Processor -- start 2023-11-28T12:07:25.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.340+0000 7f7dd6fff700 1 -- start start 2023-11-28T12:07:25.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.341+0000 7f7dd6fff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f7dd0161340 0x7f7dd00d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:25.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.341+0000 7f7dd6fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7dd00d2320 0x7f7dd00cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:25.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.341+0000 7f7dd6fff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dd00d1950 con 0x7f7dd015c9b0 2023-11-28T12:07:25.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.341+0000 7f7dd6fff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dd00b5800 con 0x7f7dd00d2320 2023-11-28T12:07:25.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.341+0000 7f7dd6fff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dd00b5300 con 0x7f7dd0161340 2023-11-28T12:07:25.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.342+0000 7f7dd559c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7dd00d2320 0x7f7dd00cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:25.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.342+0000 7f7dd559c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7dd00d2320 0x7f7dd00cd7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46352/0 (socket says 172.21.15.45:46352) 2023-11-28T12:07:25.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.342+0000 7f7dd559c700 1 -- 172.21.15.45:0/1077085658 learned_addr learned my addr 172.21.15.45:0/1077085658 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:25.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.342+0000 7f7dcffff700 1 --2- 172.21.15.45:0/1077085658 >> v2:172.21.15.152:3300/0 conn(0x7f7dd0161340 0x7f7dd00d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:25.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.342+0000 7f7dd559c700 1 -- 172.21.15.45:0/1077085658 >> v2:172.21.15.152:3300/0 conn(0x7f7dd0161340 msgr2=0x7f7dd00d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:25.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.342+0000 7f7dd559c700 1 --2- 172.21.15.45:0/1077085658 >> v2:172.21.15.152:3300/0 conn(0x7f7dd0161340 0x7f7dd00d1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:25.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.342+0000 7f7dd559c700 1 -- 172.21.15.45:0/1077085658 >> v1:172.21.15.152:6789/0 conn(0x7f7dd015c9b0 legacy=0x7f7dd00b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:25.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.342+0000 7f7dd559c700 1 -- 172.21.15.45:0/1077085658 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dd00b5520 con 0x7f7dd00d2320 2023-11-28T12:07:25.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.342+0000 7f7dd559c700 1 --2- 172.21.15.45:0/1077085658 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7dd00d2320 0x7f7dd00cd7c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f7dd00685c0 tx=0x7f7dc800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=779f93e03cce6358 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:25.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.343+0000 7f7dcf7fe700 1 -- 172.21.15.45:0/1077085658 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc800e070 con 0x7f7dd00d2320 2023-11-28T12:07:25.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.343+0000 7f7dcf7fe700 1 -- 172.21.15.45:0/1077085658 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dc8003a20 con 0x7f7dd00d2320 2023-11-28T12:07:25.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.343+0000 7f7dcf7fe700 1 -- 172.21.15.45:0/1077085658 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc8003dd0 con 0x7f7dd00d2320 2023-11-28T12:07:25.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.343+0000 7f7dd6fff700 1 -- 172.21.15.45:0/1077085658 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7dd00d2320 msgr2=0x7f7dd00cd7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:25.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.343+0000 7f7dd6fff700 1 --2- 172.21.15.45:0/1077085658 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7dd00d2320 0x7f7dd00cd7c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f7dd00685c0 tx=0x7f7dc800b330 comp rx=0 tx=0).stop 2023-11-28T12:07:25.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.343+0000 7f7dd6fff700 1 -- 172.21.15.45:0/1077085658 shutdown_connections 2023-11-28T12:07:25.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.343+0000 7f7dd6fff700 1 --2- 172.21.15.45:0/1077085658 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7dd00d2320 0x7f7dd00cd7c0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:25.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.343+0000 7f7dd6fff700 1 --2- 172.21.15.45:0/1077085658 >> v2:172.21.15.152:3300/0 conn(0x7f7dd0161340 0x7f7dd00d1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:25.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.343+0000 7f7dd6fff700 1 -- 172.21.15.45:0/1077085658 >> 172.21.15.45:0/1077085658 conn(0x7f7dd0072600 msgr2=0x7f7dd00cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:25.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.343+0000 7f7dd6fff700 1 -- 172.21.15.45:0/1077085658 shutdown_connections 2023-11-28T12:07:25.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.343+0000 7f7dd6fff700 1 -- 172.21.15.45:0/1077085658 wait complete. 2023-11-28T12:07:25.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.346+0000 7f7dd6fff700 1 Processor -- start 2023-11-28T12:07:25.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.346+0000 7f7dd6fff700 1 -- start start 2023-11-28T12:07:25.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.347+0000 7f7dd6fff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7dd00d2320 0x7f7dd0150570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:25.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.347+0000 7f7dd6fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7dd015c9b0 0x7f7dd0151730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:25.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.347+0000 7f7dd6fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7dd0161340 0x7f7dd0152140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:25.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.347+0000 7f7dd6fff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd00b81b0 con 0x7f7dd015c9b0 2023-11-28T12:07:25.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.347+0000 7f7dd6fff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd00b8490 con 0x7f7dd0161340 2023-11-28T12:07:25.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.347+0000 7f7dd6fff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd00b8770 con 0x7f7dd00d2320 2023-11-28T12:07:25.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.348+0000 7f7dcffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7dd015c9b0 0x7f7dd0151730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:25.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.348+0000 7f7dcffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7dd015c9b0 0x7f7dd0151730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46354/0 (socket says 172.21.15.45:46354) 2023-11-28T12:07:25.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.348+0000 7f7dcffff700 1 -- 172.21.15.45:0/238601405 learned_addr learned my addr 172.21.15.45:0/238601405 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:25.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.348+0000 7f7dd4d9b700 1 --2- 172.21.15.45:0/238601405 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7dd00d2320 0x7f7dd0150570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:25.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.348+0000 7f7dd559c700 1 --2- 172.21.15.45:0/238601405 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7dd0161340 0x7f7dd0152140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:25.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.348+0000 7f7dcffff700 1 -- 172.21.15.45:0/238601405 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7dd00d2320 msgr2=0x7f7dd0150570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:25.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.348+0000 7f7dcffff700 1 --2- 172.21.15.45:0/238601405 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7dd00d2320 0x7f7dd0150570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:25.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.348+0000 7f7dcffff700 1 -- 172.21.15.45:0/238601405 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7dd0161340 msgr2=0x7f7dd0152140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:25.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.348+0000 7f7dcffff700 1 --2- 172.21.15.45:0/238601405 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7dd0161340 0x7f7dd0152140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:25.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.348+0000 7f7dcffff700 1 -- 172.21.15.45:0/238601405 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dc8009b30 con 0x7f7dd015c9b0 2023-11-28T12:07:25.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.348+0000 7f7dcffff700 1 --2- 172.21.15.45:0/238601405 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7dd015c9b0 0x7f7dd0151730 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc00e810 tx=0x7f7dbc00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:25.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.349+0000 7f7dcd7fa700 1 -- 172.21.15.45:0/238601405 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dbc00c070 con 0x7f7dd015c9b0 2023-11-28T12:07:25.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.349+0000 7f7dcd7fa700 1 -- 172.21.15.45:0/238601405 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dbc013610 con 0x7f7dd015c9b0 2023-11-28T12:07:25.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.349+0000 7f7dcd7fa700 1 -- 172.21.15.45:0/238601405 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dbc0139c0 con 0x7f7dd015c9b0 2023-11-28T12:07:25.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.349+0000 7f7dd6fff700 1 -- 172.21.15.45:0/238601405 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dd00d15e0 con 0x7f7dd015c9b0 2023-11-28T12:07:25.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.349+0000 7f7dd6fff700 1 -- 172.21.15.45:0/238601405 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dd00d1300 con 0x7f7dd015c9b0 2023-11-28T12:07:25.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.350+0000 7f7dd6fff700 1 -- 172.21.15.45:0/238601405 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dd015cd80 con 0x7f7dd015c9b0 2023-11-28T12:07:25.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.351+0000 7f7dcd7fa700 1 -- 172.21.15.45:0/238601405 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f7dbc023070 con 0x7f7dd015c9b0 2023-11-28T12:07:25.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.352+0000 7f7dcd7fa700 1 --2- 172.21.15.45:0/238601405 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f7db40682f0 0x7f7db406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:25.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.352+0000 7f7dcd7fa700 1 -- 172.21.15.45:0/238601405 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f7dbc085b60 con 0x7f7dd015c9b0 2023-11-28T12:07:25.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.353+0000 7f7dd4d9b700 1 --2- 172.21.15.45:0/238601405 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f7db40682f0 0x7f7db406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:25.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.353+0000 7f7dd4d9b700 1 --2- 172.21.15.45:0/238601405 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f7db40682f0 0x7f7db406a7a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7dc4009960 tx=0x7f7dc40090e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:25.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.356+0000 7f7dcd7fa700 1 -- 172.21.15.45:0/238601405 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f7dbc052210 con 0x7f7dd015c9b0 2023-11-28T12:07:25.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.559+0000 7f7dd6fff700 1 -- 172.21.15.45:0/238601405 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7dd00745c0 con 0x7f7dd015c9b0 2023-11-28T12:07:25.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.559+0000 7f7dcd7fa700 1 -- 172.21.15.45:0/238601405 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7dbc00f040 con 0x7f7dd015c9b0 2023-11-28T12:07:25.560 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-11-28T12:07:25.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.562+0000 7f7dd6fff700 1 -- 172.21.15.45:0/238601405 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f7db40682f0 msgr2=0x7f7db406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:25.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.562+0000 7f7dd6fff700 1 --2- 172.21.15.45:0/238601405 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f7db40682f0 0x7f7db406a7a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7dc4009960 tx=0x7f7dc40090e0 comp rx=0 tx=0).stop 2023-11-28T12:07:25.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.562+0000 7f7dd6fff700 1 -- 172.21.15.45:0/238601405 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7dd015c9b0 msgr2=0x7f7dd0151730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:25.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.562+0000 7f7dd6fff700 1 --2- 172.21.15.45:0/238601405 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7dd015c9b0 0x7f7dd0151730 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc00e810 tx=0x7f7dbc00eb20 comp rx=0 tx=0).stop 2023-11-28T12:07:25.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.562+0000 7f7dd6fff700 1 -- 172.21.15.45:0/238601405 shutdown_connections 2023-11-28T12:07:25.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.562+0000 7f7dd6fff700 1 --2- 172.21.15.45:0/238601405 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f7db40682f0 0x7f7db406a7a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:25.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.562+0000 7f7dd6fff700 1 --2- 172.21.15.45:0/238601405 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7dd0161340 0x7f7dd0152140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:25.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.562+0000 7f7dd6fff700 1 --2- 172.21.15.45:0/238601405 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7dd00d2320 0x7f7dd0150570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:25.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.562+0000 7f7dd6fff700 1 --2- 172.21.15.45:0/238601405 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7dd015c9b0 0x7f7dd0151730 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:25.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.562+0000 7f7dd6fff700 1 -- 172.21.15.45:0/238601405 >> 172.21.15.45:0/238601405 conn(0x7f7dd0072600 msgr2=0x7f7dd00b5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:25.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.562+0000 7f7dd6fff700 1 -- 172.21.15.45:0/238601405 shutdown_connections 2023-11-28T12:07:25.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.562+0000 7f7dd6fff700 1 -- 172.21.15.45:0/238601405 wait complete. 2023-11-28T12:07:25.582 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T12:07:25.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.785+0000 7ff6073ff700 1 Processor -- start 2023-11-28T12:07:25.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.785+0000 7ff6073ff700 1 -- start start 2023-11-28T12:07:25.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.786+0000 7ff6073ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff6000cd7c0 0x7ff6000cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:25.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.786+0000 7ff6073ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6000d1950 con 0x7ff60015c9b0 2023-11-28T12:07:25.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.786+0000 7ff6073ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6000ce140 con 0x7ff600161340 2023-11-28T12:07:25.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.786+0000 7ff6073ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6000b5800 con 0x7ff6000cd7c0 2023-11-28T12:07:25.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.786+0000 7ff60519b700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ff60015c9b0 0x7ff6000b4bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:52260/0 (socket says 172.21.15.45:52260) 2023-11-28T12:07:25.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.786+0000 7ff60519b700 1 -- 172.21.15.45:0/3072621626 learned_addr learned my addr 172.21.15.45:0/3072621626 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:07:25.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.786+0000 7ff60599c700 1 --2- 172.21.15.45:0/3072621626 >> v2:172.21.15.45:3300/0 conn(0x7ff6000cd7c0 0x7ff6000cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:25.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.787+0000 7ff5f7fff700 1 -- 172.21.15.45:0/3072621626 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1958717472 0 0) 0x7ff6000d1950 con 0x7ff60015c9b0 2023-11-28T12:07:25.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.787+0000 7ff5f7fff700 1 -- 172.21.15.45:0/3072621626 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5ec0035b0 con 0x7ff60015c9b0 2023-11-28T12:07:25.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.787+0000 7ff60599c700 1 -- 172.21.15.45:0/3072621626 >> v1:172.21.15.152:6789/0 conn(0x7ff600161340 legacy=0x7ff6000d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:25.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.787+0000 7ff60599c700 1 -- 172.21.15.45:0/3072621626 >> v1:172.21.15.45:6789/0 conn(0x7ff60015c9b0 legacy=0x7ff6000b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:25.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.787+0000 7ff60599c700 1 -- 172.21.15.45:0/3072621626 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6000d24f0 con 0x7ff6000cd7c0 2023-11-28T12:07:25.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.787+0000 7ff60599c700 1 --2- 172.21.15.45:0/3072621626 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6000cd7c0 0x7ff6000cdc00 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff5f8009d90 tx=0x7ff5f800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e65959b94ec158e4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:25.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.787+0000 7ff5f7fff700 1 -- 172.21.15.45:0/3072621626 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f800e070 con 0x7ff6000cd7c0 2023-11-28T12:07:25.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.787+0000 7ff5f7fff700 1 -- 172.21.15.45:0/3072621626 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5f800bb20 con 0x7ff6000cd7c0 2023-11-28T12:07:25.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.787+0000 7ff5f7fff700 1 -- 172.21.15.45:0/3072621626 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f8012430 con 0x7ff6000cd7c0 2023-11-28T12:07:25.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.788+0000 7ff6073ff700 1 -- 172.21.15.45:0/3072621626 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6000cd7c0 msgr2=0x7ff6000cdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:25.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.788+0000 7ff6073ff700 1 --2- 172.21.15.45:0/3072621626 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6000cd7c0 0x7ff6000cdc00 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff5f8009d90 tx=0x7ff5f800b330 comp rx=0 tx=0).stop 2023-11-28T12:07:25.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.788+0000 7ff6073ff700 1 -- 172.21.15.45:0/3072621626 shutdown_connections 2023-11-28T12:07:25.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.788+0000 7ff6073ff700 1 --2- 172.21.15.45:0/3072621626 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6000cd7c0 0x7ff6000cdc00 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:25.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.788+0000 7ff6073ff700 1 -- 172.21.15.45:0/3072621626 >> 172.21.15.45:0/3072621626 conn(0x7ff600072600 msgr2=0x7ff6000cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:25.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.788+0000 7ff6073ff700 1 -- 172.21.15.45:0/3072621626 shutdown_connections 2023-11-28T12:07:25.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.788+0000 7ff6073ff700 1 -- 172.21.15.45:0/3072621626 wait complete. 2023-11-28T12:07:25.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.790+0000 7ff6073ff700 1 Processor -- start 2023-11-28T12:07:25.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.790+0000 7ff6073ff700 1 -- start start 2023-11-28T12:07:25.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.791+0000 7ff6073ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff6000cd7c0 0x7ff6000c9a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:25.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.791+0000 7ff6073ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff60015c9b0 0x7ff6000ccf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:25.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.791+0000 7ff6073ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff600161340 0x7ff60015e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:25.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.791+0000 7ff6073ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6001f2c40 con 0x7ff60015c9b0 2023-11-28T12:07:25.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.791+0000 7ff6073ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6001f2330 con 0x7ff600161340 2023-11-28T12:07:25.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.791+0000 7ff6073ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6000c7260 con 0x7ff6000cd7c0 2023-11-28T12:07:25.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.791+0000 7ff60499a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff60015c9b0 0x7ff6000ccf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:25.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.791+0000 7ff60499a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff60015c9b0 0x7ff6000ccf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46366/0 (socket says 172.21.15.45:46366) 2023-11-28T12:07:25.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.791+0000 7ff60499a700 1 -- 172.21.15.45:0/2927185682 learned_addr learned my addr 172.21.15.45:0/2927185682 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:25.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.791+0000 7ff60599c700 1 --2- 172.21.15.45:0/2927185682 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff600161340 0x7ff60015e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:25.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.791+0000 7ff60519b700 1 --2- 172.21.15.45:0/2927185682 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff6000cd7c0 0x7ff6000c9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:25.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.792+0000 7ff60499a700 1 -- 172.21.15.45:0/2927185682 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff6000cd7c0 msgr2=0x7ff6000c9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:25.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.792+0000 7ff60499a700 1 --2- 172.21.15.45:0/2927185682 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff6000cd7c0 0x7ff6000c9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:25.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.792+0000 7ff60499a700 1 -- 172.21.15.45:0/2927185682 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff600161340 msgr2=0x7ff60015e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:25.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.792+0000 7ff60499a700 1 --2- 172.21.15.45:0/2927185682 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff600161340 0x7ff60015e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:25.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.792+0000 7ff60499a700 1 -- 172.21.15.45:0/2927185682 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5f8009a70 con 0x7ff60015c9b0 2023-11-28T12:07:25.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.792+0000 7ff60599c700 1 --2- 172.21.15.45:0/2927185682 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff600161340 0x7ff60015e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:07:25.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.792+0000 7ff60499a700 1 --2- 172.21.15.45:0/2927185682 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff60015c9b0 0x7ff6000ccf10 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff5f000c4e0 tx=0x7ff5f000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:25.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.792+0000 7ff5f5ffb700 1 -- 172.21.15.45:0/2927185682 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f00052d0 con 0x7ff60015c9b0 2023-11-28T12:07:25.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.792+0000 7ff5f5ffb700 1 -- 172.21.15.45:0/2927185682 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5f0005430 con 0x7ff60015c9b0 2023-11-28T12:07:25.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.792+0000 7ff5f5ffb700 1 -- 172.21.15.45:0/2927185682 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f00038c0 con 0x7ff60015c9b0 2023-11-28T12:07:25.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.792+0000 7ff6073ff700 1 -- 172.21.15.45:0/2927185682 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6000d1300 con 0x7ff60015c9b0 2023-11-28T12:07:25.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.792+0000 7ff6073ff700 1 -- 172.21.15.45:0/2927185682 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6000b5520 con 0x7ff60015c9b0 2023-11-28T12:07:25.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.793+0000 7ff6073ff700 1 -- 172.21.15.45:0/2927185682 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6000d15e0 con 0x7ff60015c9b0 2023-11-28T12:07:25.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.794+0000 7ff5f5ffb700 1 -- 172.21.15.45:0/2927185682 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7ff5f0019030 con 0x7ff60015c9b0 2023-11-28T12:07:25.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.795+0000 7ff5f5ffb700 1 --2- 172.21.15.45:0/2927185682 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7ff5e40682f0 0x7ff5e406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:25.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.795+0000 7ff5f5ffb700 1 -- 172.21.15.45:0/2927185682 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6120+0+0 (secure 0 0 0) 0x7ff5f0085130 con 0x7ff60015c9b0 2023-11-28T12:07:25.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.796+0000 7ff60519b700 1 --2- 172.21.15.45:0/2927185682 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7ff5e40682f0 0x7ff5e406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:25.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.796+0000 7ff60519b700 1 --2- 172.21.15.45:0/2927185682 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7ff5e40682f0 0x7ff5e406a7a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc0011e0 tx=0x7ff5fc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:25.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:25.799+0000 7ff5f5ffb700 1 -- 172.21.15.45:0/2927185682 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7ff5f0051860 con 0x7ff60015c9b0 2023-11-28T12:07:26.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.041+0000 7ff6073ff700 1 -- 172.21.15.45:0/2927185682 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff6000745c0 con 0x7ff60015c9b0 2023-11-28T12:07:26.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.042+0000 7ff5f5ffb700 1 -- 172.21.15.45:0/2927185682 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4648 (secure 0 0 0) 0x7ff5f0054e80 con 0x7ff60015c9b0 2023-11-28T12:07:26.043 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:07:26.043 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1163718907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6835","nonce":1163718907},{"type":"v1","addr":"172.21.15.152:6837","nonce":1163718907}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4282,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/2292614522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":2292614522},{"type":"v1","addr":"172.21.15.45:6834","nonce":2292614522}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4285,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/3920917053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":3920917053},{"type":"v1","addr":"172.21.15.45:6835","nonce":3920917053}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T12:06:29.394171+0000","modified":"2023-11-28T12:06:32.886491+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.152:6836/3624153928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":3624153928},{"type":"v1","addr":"172.21.15.152:6836","nonce":3624153928}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T12:07:26.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.044+0000 7ff6073ff700 1 -- 172.21.15.45:0/2927185682 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7ff5e40682f0 msgr2=0x7ff5e406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:26.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.044+0000 7ff6073ff700 1 --2- 172.21.15.45:0/2927185682 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7ff5e40682f0 0x7ff5e406a7a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc0011e0 tx=0x7ff5fc009040 comp rx=0 tx=0).stop 2023-11-28T12:07:26.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.044+0000 7ff6073ff700 1 -- 172.21.15.45:0/2927185682 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff60015c9b0 msgr2=0x7ff6000ccf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:26.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.044+0000 7ff6073ff700 1 --2- 172.21.15.45:0/2927185682 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff60015c9b0 0x7ff6000ccf10 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff5f000c4e0 tx=0x7ff5f000c8a0 comp rx=0 tx=0).stop 2023-11-28T12:07:26.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.044+0000 7ff6073ff700 1 -- 172.21.15.45:0/2927185682 shutdown_connections 2023-11-28T12:07:26.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.044+0000 7ff6073ff700 1 --2- 172.21.15.45:0/2927185682 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7ff5e40682f0 0x7ff5e406a7a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:26.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.044+0000 7ff6073ff700 1 --2- 172.21.15.45:0/2927185682 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff600161340 0x7ff60015e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:26.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.044+0000 7ff6073ff700 1 --2- 172.21.15.45:0/2927185682 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff6000cd7c0 0x7ff6000c9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:26.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.044+0000 7ff6073ff700 1 --2- 172.21.15.45:0/2927185682 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff60015c9b0 0x7ff6000ccf10 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:26.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.044+0000 7ff6073ff700 1 -- 172.21.15.45:0/2927185682 >> 172.21.15.45:0/2927185682 conn(0x7ff600072600 msgr2=0x7ff600160610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:26.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.044+0000 7ff6073ff700 1 -- 172.21.15.45:0/2927185682 shutdown_connections 2023-11-28T12:07:26.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.045+0000 7ff6073ff700 1 -- 172.21.15.45:0/2927185682 wait complete. 2023-11-28T12:07:26.046 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 8 2023-11-28T12:07:26.063 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T12:07:26.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.267+0000 7f42bf5ff700 1 Processor -- start 2023-11-28T12:07:26.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.267+0000 7f42bf5ff700 1 -- start start 2023-11-28T12:07:26.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.268+0000 7f42bf5ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f42b815c9b0 0x7f42b80b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:26.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.268+0000 7f42bf5ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f42b8161340 0x7f42b80d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:26.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.268+0000 7f42bf5ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42b80d1950 con 0x7f42b80d2320 2023-11-28T12:07:26.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.268+0000 7f42bf5ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42b80b5800 con 0x7f42b815c9b0 2023-11-28T12:07:26.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.268+0000 7f42bf5ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42b80b5520 con 0x7f42b8161340 2023-11-28T12:07:26.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.269+0000 7f42bd39b700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f42b815c9b0 0x7f42b80b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:26.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.269+0000 7f42bcb9a700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f42b8161340 0x7f42b80d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:26.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.269+0000 7f42bd39b700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f42b815c9b0 0x7f42b80b4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.45:43982/0 (socket says 172.21.15.45:43982) 2023-11-28T12:07:26.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.269+0000 7f42bd39b700 1 -- 172.21.15.45:0/3050533990 learned_addr learned my addr 172.21.15.45:0/3050533990 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:26.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.269+0000 7f42bcb9a700 1 -- 172.21.15.45:0/3050533990 >> v2:172.21.15.152:3300/0 conn(0x7f42b815c9b0 msgr2=0x7f42b80b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:26.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.269+0000 7f42bcb9a700 1 --2- 172.21.15.45:0/3050533990 >> v2:172.21.15.152:3300/0 conn(0x7f42b815c9b0 0x7f42b80b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:26.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.269+0000 7f42bcb9a700 1 -- 172.21.15.45:0/3050533990 >> v1:172.21.15.152:6789/0 conn(0x7f42b80d2320 legacy=0x7f42b80cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:26.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.269+0000 7f42bcb9a700 1 -- 172.21.15.45:0/3050533990 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42b80d1300 con 0x7f42b8161340 2023-11-28T12:07:26.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.269+0000 7f42bd39b700 1 --2- 172.21.15.45:0/3050533990 >> v2:172.21.15.152:3300/0 conn(0x7f42b815c9b0 0x7f42b80b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:07:26.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.270+0000 7f42bcb9a700 1 --2- 172.21.15.45:0/3050533990 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f42b8161340 0x7f42b80d1de0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f42a8009840 tx=0x7f42a8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=755ab27fd590d99f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:26.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.270+0000 7f42affff700 1 -- 172.21.15.45:0/3050533990 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42a8011830 con 0x7f42b8161340 2023-11-28T12:07:26.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.270+0000 7f42affff700 1 -- 172.21.15.45:0/3050533990 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42a8011990 con 0x7f42b8161340 2023-11-28T12:07:26.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.270+0000 7f42affff700 1 -- 172.21.15.45:0/3050533990 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42a8011d20 con 0x7f42b8161340 2023-11-28T12:07:26.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.270+0000 7f42bf5ff700 1 -- 172.21.15.45:0/3050533990 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f42b8161340 msgr2=0x7f42b80d1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:26.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.270+0000 7f42bf5ff700 1 --2- 172.21.15.45:0/3050533990 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f42b8161340 0x7f42b80d1de0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f42a8009840 tx=0x7f42a8009b50 comp rx=0 tx=0).stop 2023-11-28T12:07:26.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.271+0000 7f42bf5ff700 1 -- 172.21.15.45:0/3050533990 shutdown_connections 2023-11-28T12:07:26.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.271+0000 7f42bf5ff700 1 --2- 172.21.15.45:0/3050533990 >> v2:172.21.15.152:3300/0 conn(0x7f42b815c9b0 0x7f42b80b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:26.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.271+0000 7f42bf5ff700 1 --2- 172.21.15.45:0/3050533990 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f42b8161340 0x7f42b80d1de0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:26.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.271+0000 7f42bf5ff700 1 -- 172.21.15.45:0/3050533990 >> 172.21.15.45:0/3050533990 conn(0x7f42b8072600 msgr2=0x7f42b80cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:26.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.271+0000 7f42bf5ff700 1 -- 172.21.15.45:0/3050533990 shutdown_connections 2023-11-28T12:07:26.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.271+0000 7f42bf5ff700 1 -- 172.21.15.45:0/3050533990 wait complete. 2023-11-28T12:07:26.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.272+0000 7f42bf5ff700 1 Processor -- start 2023-11-28T12:07:26.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.273+0000 7f42bf5ff700 1 -- start start 2023-11-28T12:07:26.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.273+0000 7f42bf5ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f42b80d2320 0x7f42b815f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:26.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.273+0000 7f42bf5ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42b815c9b0 0x7f42b80c6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:26.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.274+0000 7f42bf5ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f42b8161340 0x7f42b815a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:26.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.274+0000 7f42bf5ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42b80c8300 con 0x7f42b8161340 2023-11-28T12:07:26.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.274+0000 7f42bf5ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42b80c76f0 con 0x7f42b815c9b0 2023-11-28T12:07:26.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.274+0000 7f42bf5ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42b80c79d0 con 0x7f42b80d2320 2023-11-28T12:07:26.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.274+0000 7f42bdb9c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f42b8161340 0x7f42b815a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:26.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.274+0000 7f42bdb9c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f42b8161340 0x7f42b815a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46368/0 (socket says 172.21.15.45:46368) 2023-11-28T12:07:26.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.274+0000 7f42bdb9c700 1 -- 172.21.15.45:0/2820905333 learned_addr learned my addr 172.21.15.45:0/2820905333 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:26.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.274+0000 7f42bd39b700 1 --2- 172.21.15.45:0/2820905333 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f42b80d2320 0x7f42b815f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:26.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.274+0000 7f42bcb9a700 1 --2- 172.21.15.45:0/2820905333 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42b815c9b0 0x7f42b80c6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:26.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.274+0000 7f42bdb9c700 1 -- 172.21.15.45:0/2820905333 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f42b80d2320 msgr2=0x7f42b815f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:26.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.274+0000 7f42bdb9c700 1 --2- 172.21.15.45:0/2820905333 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f42b80d2320 0x7f42b815f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:26.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.274+0000 7f42bdb9c700 1 -- 172.21.15.45:0/2820905333 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42b815c9b0 msgr2=0x7f42b80c6ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:26.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.274+0000 7f42bdb9c700 1 --2- 172.21.15.45:0/2820905333 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42b815c9b0 0x7f42b80c6ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:26.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.274+0000 7f42bdb9c700 1 -- 172.21.15.45:0/2820905333 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42b4009550 con 0x7f42b8161340 2023-11-28T12:07:26.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.274+0000 7f42bcb9a700 1 --2- 172.21.15.45:0/2820905333 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42b815c9b0 0x7f42b80c6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:07:26.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.275+0000 7f42bdb9c700 1 --2- 172.21.15.45:0/2820905333 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f42b8161340 0x7f42b815a960 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f42b000cb50 tx=0x7f42b000cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:26.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.275+0000 7f42adffb700 1 -- 172.21.15.45:0/2820905333 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b0003c00 con 0x7f42b8161340 2023-11-28T12:07:26.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.275+0000 7f42adffb700 1 -- 172.21.15.45:0/2820905333 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42b0003d60 con 0x7f42b8161340 2023-11-28T12:07:26.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.275+0000 7f42adffb700 1 -- 172.21.15.45:0/2820905333 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b000ab70 con 0x7f42b8161340 2023-11-28T12:07:26.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.275+0000 7f42bf5ff700 1 -- 172.21.15.45:0/2820905333 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42a80094a0 con 0x7f42b8161340 2023-11-28T12:07:26.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.275+0000 7f42bf5ff700 1 -- 172.21.15.45:0/2820905333 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42b80b5130 con 0x7f42b8161340 2023-11-28T12:07:26.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.276+0000 7f42bf5ff700 1 -- 172.21.15.45:0/2820905333 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42b80d15e0 con 0x7f42b8161340 2023-11-28T12:07:26.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.277+0000 7f42adffb700 1 -- 172.21.15.45:0/2820905333 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f42b0010050 con 0x7f42b8161340 2023-11-28T12:07:26.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.278+0000 7f42adffb700 1 --2- 172.21.15.45:0/2820905333 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f429c0682f0 0x7f429c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:26.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.278+0000 7f42adffb700 1 -- 172.21.15.45:0/2820905333 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f42b0085ca0 con 0x7f42b8161340 2023-11-28T12:07:26.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.278+0000 7f42bd39b700 1 --2- 172.21.15.45:0/2820905333 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f429c0682f0 0x7f429c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:26.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.279+0000 7f42bd39b700 1 --2- 172.21.15.45:0/2820905333 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f429c0682f0 0x7f429c06a7a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f42b4009c50 tx=0x7f42b4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:26.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.282+0000 7f42adffb700 1 -- 172.21.15.45:0/2820905333 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f42b00523d0 con 0x7f42b8161340 2023-11-28T12:07:26.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.484+0000 7f42bf5ff700 1 -- 172.21.15.45:0/2820905333 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f42b80b52c0 con 0x7f42b8161340 2023-11-28T12:07:26.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.485+0000 7f42adffb700 1 -- 172.21.15.45:0/2820905333 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+17944 (secure 0 0 0) 0x7f42b00559f0 con 0x7f42b8161340 2023-11-28T12:07:26.486 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:07:26.486 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":22,"fsid":"bd7c37f1-f7c6-4778-b845-52cf2aa6e366","created":"2023-11-28T12:06:09.045075+0000","modified":"2023-11-28T12:07:18.025970+0000","last_up_change":"2023-11-28T12:06:21.282227+0000","last_in_change":"2023-11-28T12:06:12.560924+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T12:06:21.807108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T12:06:22.491009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T12:06:27.684157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T12:06:28.384679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d0cdd8a-87fd-4f2c-91bd-47bdfa661905","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":115843},{"type":"v1","addr":"172.21.15.45:6808","nonce":115843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":115843},{"type":"v1","addr":"172.21.15.45:6811","nonce":115843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":115843},{"type":"v1","addr":"172.21.15.45:6815","nonce":115843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":115843},{"type":"v1","addr":"172.21.15.45:6813","nonce":115843}]},"public_addr":"172.21.15.45:6808/115843","cluster_addr":"172.21.15.45:6811/115843","heartbeat_back_addr":"172.21.15.45:6815/115843","heartbeat_front_addr":"172.21.15.45:6813/115843","state":["exists","up"]},{"osd":1,"uuid":"c5de4ebd-9ec5-40b3-9caa-9b706fab4c76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":115842},{"type":"v1","addr":"172.21.15.45:6801","nonce":115842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":115842},{"type":"v1","addr":"172.21.15.45:6803","nonce":115842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6807","nonce":115842},{"type":"v1","addr":"172.21.15.45:6809","nonce":115842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":115842},{"type":"v1","addr":"172.21.15.45:6805","nonce":115842}]},"public_addr":"172.21.15.45:6801/115842","cluster_addr":"172.21.15.45:6803/115842","heartbeat_back_addr":"172.21.15.45:6809/115842","heartbeat_front_addr":"172.21.15.45:6805/115842","state":["exists","up"]},{"osd":2,"uuid":"9f4b36b2-65d2-40e7-9fe6-a2991afa71c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":115850},{"type":"v1","addr":"172.21.15.45:6819","nonce":115850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":115850},{"type":"v1","addr":"172.21.15.45:6823","nonce":115850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":115850},{"type":"v1","addr":"172.21.15.45:6831","nonce":115850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":115850},{"type":"v1","addr":"172.21.15.45:6828","nonce":115850}]},"public_addr":"172.21.15.45:6819/115850","cluster_addr":"172.21.15.45:6823/115850","heartbeat_back_addr":"172.21.15.45:6831/115850","heartbeat_front_addr":"172.21.15.45:6828/115850","state":["exists","up"]},{"osd":3,"uuid":"6fe7ef05-4e0d-426c-bf94-44b51d4d550b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":115848},{"type":"v1","addr":"172.21.15.45:6818","nonce":115848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":115848},{"type":"v1","addr":"172.21.15.45:6822","nonce":115848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6827","nonce":115848},{"type":"v1","addr":"172.21.15.45:6829","nonce":115848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":115848},{"type":"v1","addr":"172.21.15.45:6825","nonce":115848}]},"public_addr":"172.21.15.45:6818/115848","cluster_addr":"172.21.15.45:6822/115848","heartbeat_back_addr":"172.21.15.45:6829/115848","heartbeat_front_addr":"172.21.15.45:6825/115848","state":["exists","up"]},{"osd":4,"uuid":"fa403c08-d8a1-4a3a-8384-cb465c1a654c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":116092},{"type":"v1","addr":"172.21.15.152:6801","nonce":116092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":116092},{"type":"v1","addr":"172.21.15.152:6803","nonce":116092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":116092},{"type":"v1","addr":"172.21.15.152:6807","nonce":116092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":116092},{"type":"v1","addr":"172.21.15.152:6805","nonce":116092}]},"public_addr":"172.21.15.152:6801/116092","cluster_addr":"172.21.15.152:6803/116092","heartbeat_back_addr":"172.21.15.152:6807/116092","heartbeat_front_addr":"172.21.15.152:6805/116092","state":["exists","up"]},{"osd":5,"uuid":"399fc450-39fa-43a6-bf80-0b8bcb41bd95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6815","nonce":116093},{"type":"v1","addr":"172.21.15.152:6817","nonce":116093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":116093},{"type":"v1","addr":"172.21.15.152:6819","nonce":116093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":116093},{"type":"v1","addr":"172.21.15.152:6823","nonce":116093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":116093},{"type":"v1","addr":"172.21.15.152:6821","nonce":116093}]},"public_addr":"172.21.15.152:6817/116093","cluster_addr":"172.21.15.152:6819/116093","heartbeat_back_addr":"172.21.15.152:6823/116093","heartbeat_front_addr":"172.21.15.152:6821/116093","state":["exists","up"]},{"osd":6,"uuid":"e59a4017-2d23-4627-836b-e25b2d3ddaaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":116094},{"type":"v1","addr":"172.21.15.152:6809","nonce":116094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":116094},{"type":"v1","addr":"172.21.15.152:6811","nonce":116094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":116094},{"type":"v1","addr":"172.21.15.152:6816","nonce":116094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":116094},{"type":"v1","addr":"172.21.15.152:6813","nonce":116094}]},"public_addr":"172.21.15.152:6809/116094","cluster_addr":"172.21.15.152:6811/116094","heartbeat_back_addr":"172.21.15.152:6816/116094","heartbeat_front_addr":"172.21.15.152:6813/116094","state":["exists","up"]},{"osd":7,"uuid":"8d7f9d4b-bf08-4670-8591-388c0f012a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":116097},{"type":"v1","addr":"172.21.15.152:6825","nonce":116097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":116097},{"type":"v1","addr":"172.21.15.152:6827","nonce":116097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":116097},{"type":"v1","addr":"172.21.15.152:6831","nonce":116097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":116097},{"type":"v1","addr":"172.21.15.152:6829","nonce":116097}]},"public_addr":"172.21.15.152:6825/116097","cluster_addr":"172.21.15.152:6827/116097","heartbeat_back_addr":"172.21.15.152:6831/116097","heartbeat_front_addr":"172.21.15.152:6829/116097","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.937710+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.865423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.159434+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.913090+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.131647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.966255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.972583+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.177209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.29","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T12:07:26.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.487+0000 7f42bf5ff700 1 -- 172.21.15.45:0/2820905333 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f429c0682f0 msgr2=0x7f429c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:26.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.487+0000 7f42bf5ff700 1 --2- 172.21.15.45:0/2820905333 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f429c0682f0 0x7f429c06a7a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f42b4009c50 tx=0x7f42b4008040 comp rx=0 tx=0).stop 2023-11-28T12:07:26.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.487+0000 7f42bf5ff700 1 -- 172.21.15.45:0/2820905333 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f42b8161340 msgr2=0x7f42b815a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:26.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.487+0000 7f42bf5ff700 1 --2- 172.21.15.45:0/2820905333 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f42b8161340 0x7f42b815a960 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f42b000cb50 tx=0x7f42b000cf10 comp rx=0 tx=0).stop 2023-11-28T12:07:26.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.487+0000 7f42bf5ff700 1 -- 172.21.15.45:0/2820905333 shutdown_connections 2023-11-28T12:07:26.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.487+0000 7f42bf5ff700 1 --2- 172.21.15.45:0/2820905333 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f429c0682f0 0x7f429c06a7a0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:26.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.487+0000 7f42bf5ff700 1 --2- 172.21.15.45:0/2820905333 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f42b8161340 0x7f42b815a960 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:26.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.487+0000 7f42bf5ff700 1 --2- 172.21.15.45:0/2820905333 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f42b80d2320 0x7f42b815f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:26.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.487+0000 7f42bf5ff700 1 --2- 172.21.15.45:0/2820905333 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f42b815c9b0 0x7f42b80c6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:26.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.487+0000 7f42bf5ff700 1 -- 172.21.15.45:0/2820905333 >> 172.21.15.45:0/2820905333 conn(0x7f42b8072600 msgr2=0x7f42b80b5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:26.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.487+0000 7f42bf5ff700 1 -- 172.21.15.45:0/2820905333 shutdown_connections 2023-11-28T12:07:26.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.487+0000 7f42bf5ff700 1 -- 172.21.15.45:0/2820905333 wait complete. 2023-11-28T12:07:26.507 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-28T12:07:26.507 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T12:07:26.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.710+0000 7f31537ff700 1 Processor -- start 2023-11-28T12:07:26.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.710+0000 7f31537ff700 1 -- start start 2023-11-28T12:07:26.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.711+0000 7f31537ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f314c161340 0x7f314c0d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:26.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.711+0000 7f31537ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f314c0d2320 0x7f314c0cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:26.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.711+0000 7f31537ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f314c0d1950 con 0x7f314c15c9b0 2023-11-28T12:07:26.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.711+0000 7f31537ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f314c0b5800 con 0x7f314c0d2320 2023-11-28T12:07:26.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.711+0000 7f31537ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f314c0b5300 con 0x7f314c161340 2023-11-28T12:07:26.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.711+0000 7f3151d9c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f314c0d2320 0x7f314c0cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:26.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.711+0000 7f3151d9c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f314c0d2320 0x7f314c0cd7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46374/0 (socket says 172.21.15.45:46374) 2023-11-28T12:07:26.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.711+0000 7f3151d9c700 1 -- 172.21.15.45:0/2521089297 learned_addr learned my addr 172.21.15.45:0/2521089297 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:26.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.711+0000 7f3150d9a700 1 --2- 172.21.15.45:0/2521089297 >> v2:172.21.15.152:3300/0 conn(0x7f314c161340 0x7f314c0d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:26.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.712+0000 7f3151d9c700 1 -- 172.21.15.45:0/2521089297 >> v2:172.21.15.152:3300/0 conn(0x7f314c161340 msgr2=0x7f314c0d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:26.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.712+0000 7f3151d9c700 1 --2- 172.21.15.45:0/2521089297 >> v2:172.21.15.152:3300/0 conn(0x7f314c161340 0x7f314c0d1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:26.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.712+0000 7f3151d9c700 1 -- 172.21.15.45:0/2521089297 >> v1:172.21.15.152:6789/0 conn(0x7f314c15c9b0 legacy=0x7f314c0b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:26.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.712+0000 7f3151d9c700 1 -- 172.21.15.45:0/2521089297 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f314c0b5520 con 0x7f314c0d2320 2023-11-28T12:07:26.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.712+0000 7f3151d9c700 1 --2- 172.21.15.45:0/2521089297 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f314c0d2320 0x7f314c0cd7c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f314c0685c0 tx=0x7f314400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fb3a586d7a2b2aa server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:26.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.712+0000 7f3143fff700 1 -- 172.21.15.45:0/2521089297 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f314400e070 con 0x7f314c0d2320 2023-11-28T12:07:26.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.712+0000 7f3143fff700 1 -- 172.21.15.45:0/2521089297 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3144003a20 con 0x7f314c0d2320 2023-11-28T12:07:26.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.712+0000 7f3143fff700 1 -- 172.21.15.45:0/2521089297 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3144003dd0 con 0x7f314c0d2320 2023-11-28T12:07:26.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.713+0000 7f31537ff700 1 -- 172.21.15.45:0/2521089297 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f314c0d2320 msgr2=0x7f314c0cd7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:26.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.713+0000 7f31537ff700 1 --2- 172.21.15.45:0/2521089297 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f314c0d2320 0x7f314c0cd7c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f314c0685c0 tx=0x7f314400b330 comp rx=0 tx=0).stop 2023-11-28T12:07:26.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.713+0000 7f31537ff700 1 -- 172.21.15.45:0/2521089297 shutdown_connections 2023-11-28T12:07:26.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.713+0000 7f31537ff700 1 --2- 172.21.15.45:0/2521089297 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f314c0d2320 0x7f314c0cd7c0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:26.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.713+0000 7f31537ff700 1 --2- 172.21.15.45:0/2521089297 >> v2:172.21.15.152:3300/0 conn(0x7f314c161340 0x7f314c0d1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:26.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.713+0000 7f31537ff700 1 -- 172.21.15.45:0/2521089297 >> 172.21.15.45:0/2521089297 conn(0x7f314c072600 msgr2=0x7f314c0cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:26.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.713+0000 7f31537ff700 1 -- 172.21.15.45:0/2521089297 shutdown_connections 2023-11-28T12:07:26.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.713+0000 7f31537ff700 1 -- 172.21.15.45:0/2521089297 wait complete. 2023-11-28T12:07:26.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.715+0000 7f31537ff700 1 Processor -- start 2023-11-28T12:07:26.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.716+0000 7f31537ff700 1 -- start start 2023-11-28T12:07:26.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.717+0000 7f31537ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f314c0d2320 0x7f314c153340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:26.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.717+0000 7f31537ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f314c15c9b0 0x7f314c1505e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:26.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.717+0000 7f31537ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f314c161340 0x7f314c0c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:26.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.717+0000 7f31537ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f314c152eb0 con 0x7f314c15c9b0 2023-11-28T12:07:26.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.717+0000 7f31537ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f314c153880 con 0x7f314c161340 2023-11-28T12:07:26.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.717+0000 7f31537ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f314c1522a0 con 0x7f314c0d2320 2023-11-28T12:07:26.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.717+0000 7f3150d9a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f314c15c9b0 0x7f314c1505e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:26.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.717+0000 7f3150d9a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f314c15c9b0 0x7f314c1505e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46376/0 (socket says 172.21.15.45:46376) 2023-11-28T12:07:26.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.717+0000 7f3150d9a700 1 -- 172.21.15.45:0/66409161 learned_addr learned my addr 172.21.15.45:0/66409161 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:26.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.717+0000 7f315159b700 1 --2- 172.21.15.45:0/66409161 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f314c0d2320 0x7f314c153340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:26.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.717+0000 7f3151d9c700 1 --2- 172.21.15.45:0/66409161 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f314c161340 0x7f314c0c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:26.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.718+0000 7f3150d9a700 1 -- 172.21.15.45:0/66409161 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f314c0d2320 msgr2=0x7f314c153340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:26.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.718+0000 7f3150d9a700 1 --2- 172.21.15.45:0/66409161 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f314c0d2320 0x7f314c153340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:26.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.718+0000 7f3150d9a700 1 -- 172.21.15.45:0/66409161 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f314c161340 msgr2=0x7f314c0c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:26.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.718+0000 7f3150d9a700 1 --2- 172.21.15.45:0/66409161 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f314c161340 0x7f314c0c8e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:26.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.718+0000 7f3150d9a700 1 -- 172.21.15.45:0/66409161 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3144009b30 con 0x7f314c15c9b0 2023-11-28T12:07:26.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.718+0000 7f3150d9a700 1 --2- 172.21.15.45:0/66409161 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f314c15c9b0 0x7f314c1505e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f313c00e810 tx=0x7f313c00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:26.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.718+0000 7f3141ffb700 1 -- 172.21.15.45:0/66409161 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313c00c070 con 0x7f314c15c9b0 2023-11-28T12:07:26.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.718+0000 7f3141ffb700 1 -- 172.21.15.45:0/66409161 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f313c013610 con 0x7f314c15c9b0 2023-11-28T12:07:26.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.718+0000 7f31537ff700 1 -- 172.21.15.45:0/66409161 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f314c0d15e0 con 0x7f314c15c9b0 2023-11-28T12:07:26.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.718+0000 7f3141ffb700 1 -- 172.21.15.45:0/66409161 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313c0139c0 con 0x7f314c15c9b0 2023-11-28T12:07:26.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.718+0000 7f31537ff700 1 -- 172.21.15.45:0/66409161 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f314c0d1300 con 0x7f314c15c9b0 2023-11-28T12:07:26.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.719+0000 7f31537ff700 1 -- 172.21.15.45:0/66409161 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f314c15cd80 con 0x7f314c15c9b0 2023-11-28T12:07:26.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.720+0000 7f3141ffb700 1 -- 172.21.15.45:0/66409161 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f313c023070 con 0x7f314c15c9b0 2023-11-28T12:07:26.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.721+0000 7f3141ffb700 1 --2- 172.21.15.45:0/66409161 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f31300682f0 0x7f313006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:26.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.721+0000 7f3141ffb700 1 -- 172.21.15.45:0/66409161 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f313c085b60 con 0x7f314c15c9b0 2023-11-28T12:07:26.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.721+0000 7f315159b700 1 --2- 172.21.15.45:0/66409161 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f31300682f0 0x7f313006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:26.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.722+0000 7f315159b700 1 --2- 172.21.15.45:0/66409161 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f31300682f0 0x7f313006a7a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3148009960 tx=0x7f31480090e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:26.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.726+0000 7f3141ffb700 1 -- 172.21.15.45:0/66409161 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f313c052210 con 0x7f314c15c9b0 2023-11-28T12:07:26.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.978+0000 7f31537ff700 1 -- 172.21.15.45:0/66409161 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f314c0ca070 con 0x7f314c15c9b0 2023-11-28T12:07:26.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.979+0000 7f3141ffb700 1 -- 172.21.15.45:0/66409161 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4648 (secure 0 0 0) 0x7f313c00f040 con 0x7f314c15c9b0 2023-11-28T12:07:26.980 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:07:26.980 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1163718907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6835","nonce":1163718907},{"type":"v1","addr":"172.21.15.152:6837","nonce":1163718907}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4282,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/2292614522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":2292614522},{"type":"v1","addr":"172.21.15.45:6834","nonce":2292614522}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4285,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/3920917053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":3920917053},{"type":"v1","addr":"172.21.15.45:6835","nonce":3920917053}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T12:06:29.394171+0000","modified":"2023-11-28T12:06:32.886491+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.152:6836/3624153928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":3624153928},{"type":"v1","addr":"172.21.15.152:6836","nonce":3624153928}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T12:07:26.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.981+0000 7f31537ff700 1 -- 172.21.15.45:0/66409161 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f31300682f0 msgr2=0x7f313006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:26.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.981+0000 7f31537ff700 1 --2- 172.21.15.45:0/66409161 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f31300682f0 0x7f313006a7a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3148009960 tx=0x7f31480090e0 comp rx=0 tx=0).stop 2023-11-28T12:07:26.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.981+0000 7f31537ff700 1 -- 172.21.15.45:0/66409161 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f314c15c9b0 msgr2=0x7f314c1505e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:26.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.981+0000 7f31537ff700 1 --2- 172.21.15.45:0/66409161 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f314c15c9b0 0x7f314c1505e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f313c00e810 tx=0x7f313c00eb20 comp rx=0 tx=0).stop 2023-11-28T12:07:26.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.981+0000 7f31537ff700 1 -- 172.21.15.45:0/66409161 shutdown_connections 2023-11-28T12:07:26.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.981+0000 7f31537ff700 1 --2- 172.21.15.45:0/66409161 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f31300682f0 0x7f313006a7a0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:26.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.981+0000 7f31537ff700 1 --2- 172.21.15.45:0/66409161 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f314c161340 0x7f314c0c8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:26.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.981+0000 7f31537ff700 1 --2- 172.21.15.45:0/66409161 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f314c0d2320 0x7f314c153340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:26.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.981+0000 7f31537ff700 1 --2- 172.21.15.45:0/66409161 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f314c15c9b0 0x7f314c1505e0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:26.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.981+0000 7f31537ff700 1 -- 172.21.15.45:0/66409161 >> 172.21.15.45:0/66409161 conn(0x7f314c072600 msgr2=0x7f314c06b070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:26.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.981+0000 7f31537ff700 1 -- 172.21.15.45:0/66409161 shutdown_connections 2023-11-28T12:07:26.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:26.981+0000 7f31537ff700 1 -- 172.21.15.45:0/66409161 wait complete. 2023-11-28T12:07:26.984 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 8 2023-11-28T12:07:27.001 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T12:07:27.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.205+0000 7f6e9f9ff700 1 Processor -- start 2023-11-28T12:07:27.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.206+0000 7f6e9f9ff700 1 -- start start 2023-11-28T12:07:27.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.207+0000 7f6e9f9ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f6e9815c9b0 0x7f6e980b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:27.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.207+0000 7f6e9f9ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6e980cd7c0 0x7f6e980cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:27.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.207+0000 7f6e9f9ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e980d1950 con 0x7f6e98161340 2023-11-28T12:07:27.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.207+0000 7f6e9f9ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e980b5800 con 0x7f6e980cd7c0 2023-11-28T12:07:27.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.207+0000 7f6e9f9ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e980ce140 con 0x7f6e9815c9b0 2023-11-28T12:07:27.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.207+0000 7f6e9cf9a700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f6e98161340 0x7f6e980d1de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:52268/0 (socket says 172.21.15.45:52268) 2023-11-28T12:07:27.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.207+0000 7f6e9cf9a700 1 -- 172.21.15.45:0/4210281902 learned_addr learned my addr 172.21.15.45:0/4210281902 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:07:27.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.207+0000 7f6e9df9c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6e980cd7c0 0x7f6e980cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:27.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.207+0000 7f6e9d79b700 1 --2- 172.21.15.45:0/4210281902 >> v2:172.21.15.152:3300/0 conn(0x7f6e9815c9b0 0x7f6e980b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:27.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.208+0000 7f6e9df9c700 1 -- 172.21.15.45:0/4210281902 >> v2:172.21.15.152:3300/0 conn(0x7f6e9815c9b0 msgr2=0x7f6e980b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:27.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.208+0000 7f6e9df9c700 1 --2- 172.21.15.45:0/4210281902 >> v2:172.21.15.152:3300/0 conn(0x7f6e9815c9b0 0x7f6e980b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:27.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.208+0000 7f6e9df9c700 1 -- 172.21.15.45:0/4210281902 >> v1:172.21.15.45:6789/0 conn(0x7f6e98161340 legacy=0x7f6e980d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:27.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.208+0000 7f6e9df9c700 1 -- 172.21.15.45:0/4210281902 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e980d24f0 con 0x7f6e980cd7c0 2023-11-28T12:07:27.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.208+0000 7f6e9df9c700 1 --2- 172.21.15.45:0/4210281902 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e980cd7c0 0x7f6e980cdc00 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f6e98067460 tx=0x7f6e9000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcc0225d61239cec server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:27.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.208+0000 7f6e8ffff700 1 -- 172.21.15.45:0/4210281902 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e9000e070 con 0x7f6e980cd7c0 2023-11-28T12:07:27.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.208+0000 7f6e8ffff700 1 -- 172.21.15.45:0/4210281902 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e9000bbd0 con 0x7f6e980cd7c0 2023-11-28T12:07:27.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.208+0000 7f6e8ffff700 1 -- 172.21.15.45:0/4210281902 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e90012430 con 0x7f6e980cd7c0 2023-11-28T12:07:27.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.209+0000 7f6e9f9ff700 1 -- 172.21.15.45:0/4210281902 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e980cd7c0 msgr2=0x7f6e980cdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:27.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.209+0000 7f6e9f9ff700 1 --2- 172.21.15.45:0/4210281902 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e980cd7c0 0x7f6e980cdc00 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f6e98067460 tx=0x7f6e9000b330 comp rx=0 tx=0).stop 2023-11-28T12:07:27.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.209+0000 7f6e9f9ff700 1 -- 172.21.15.45:0/4210281902 shutdown_connections 2023-11-28T12:07:27.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.209+0000 7f6e9f9ff700 1 --2- 172.21.15.45:0/4210281902 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e980cd7c0 0x7f6e980cdc00 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:27.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.209+0000 7f6e9f9ff700 1 --2- 172.21.15.45:0/4210281902 >> v2:172.21.15.152:3300/0 conn(0x7f6e9815c9b0 0x7f6e980b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:27.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.209+0000 7f6e9f9ff700 1 -- 172.21.15.45:0/4210281902 >> 172.21.15.45:0/4210281902 conn(0x7f6e98072600 msgr2=0x7f6e980cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:27.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.209+0000 7f6e9f9ff700 1 -- 172.21.15.45:0/4210281902 shutdown_connections 2023-11-28T12:07:27.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.209+0000 7f6e9f9ff700 1 -- 172.21.15.45:0/4210281902 wait complete. 2023-11-28T12:07:27.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.210+0000 7f6e9f9ff700 1 Processor -- start 2023-11-28T12:07:27.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.211+0000 7f6e9f9ff700 1 -- start start 2023-11-28T12:07:27.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.211+0000 7f6e9f9ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e980cd7c0 0x7f6e9814a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:27.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.211+0000 7f6e9f9ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6e9815c9b0 0x7f6e981557e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:27.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.211+0000 7f6e9f9ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e98161340 0x7f6e9815acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:27.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.211+0000 7f6e9f9ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e98156b80 con 0x7f6e980cd7c0 2023-11-28T12:07:27.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.211+0000 7f6e9f9ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e981f2a10 con 0x7f6e98161340 2023-11-28T12:07:27.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.211+0000 7f6e9f9ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e980c9c60 con 0x7f6e9815c9b0 2023-11-28T12:07:27.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.212+0000 7f6e9d79b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e980cd7c0 0x7f6e9814a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:27.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.212+0000 7f6e9d79b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e980cd7c0 0x7f6e9814a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46400/0 (socket says 172.21.15.45:46400) 2023-11-28T12:07:27.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.212+0000 7f6e9d79b700 1 -- 172.21.15.45:0/3251618380 learned_addr learned my addr 172.21.15.45:0/3251618380 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:27.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.212+0000 7f6e9df9c700 1 --2- 172.21.15.45:0/3251618380 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e98161340 0x7f6e9815acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:27.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.212+0000 7f6e9cf9a700 1 --2- 172.21.15.45:0/3251618380 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6e9815c9b0 0x7f6e981557e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:27.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.212+0000 7f6e9d79b700 1 -- 172.21.15.45:0/3251618380 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6e9815c9b0 msgr2=0x7f6e981557e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:27.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.212+0000 7f6e9d79b700 1 --2- 172.21.15.45:0/3251618380 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6e9815c9b0 0x7f6e981557e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:27.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.212+0000 7f6e9d79b700 1 -- 172.21.15.45:0/3251618380 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e98161340 msgr2=0x7f6e9815acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:27.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.212+0000 7f6e9d79b700 1 --2- 172.21.15.45:0/3251618380 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e98161340 0x7f6e9815acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:27.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.212+0000 7f6e9d79b700 1 -- 172.21.15.45:0/3251618380 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e90009a70 con 0x7f6e980cd7c0 2023-11-28T12:07:27.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.212+0000 7f6e9cf9a700 1 --2- 172.21.15.45:0/3251618380 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6e9815c9b0 0x7f6e981557e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:07:27.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.213+0000 7f6e9d79b700 1 --2- 172.21.15.45:0/3251618380 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e980cd7c0 0x7f6e9814a510 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f6e9400d800 tx=0x7f6e9400db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:27.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.213+0000 7f6e8dffb700 1 -- 172.21.15.45:0/3251618380 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e940125f0 con 0x7f6e980cd7c0 2023-11-28T12:07:27.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.213+0000 7f6e8dffb700 1 -- 172.21.15.45:0/3251618380 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e94012750 con 0x7f6e980cd7c0 2023-11-28T12:07:27.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.213+0000 7f6e9f9ff700 1 -- 172.21.15.45:0/3251618380 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e980d1300 con 0x7f6e980cd7c0 2023-11-28T12:07:27.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.213+0000 7f6e8dffb700 1 -- 172.21.15.45:0/3251618380 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e94012b00 con 0x7f6e980cd7c0 2023-11-28T12:07:27.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.213+0000 7f6e9f9ff700 1 -- 172.21.15.45:0/3251618380 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e980b5520 con 0x7f6e980cd7c0 2023-11-28T12:07:27.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.214+0000 7f6e9f9ff700 1 -- 172.21.15.45:0/3251618380 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e980d15e0 con 0x7f6e980cd7c0 2023-11-28T12:07:27.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.215+0000 7f6e8dffb700 1 -- 172.21.15.45:0/3251618380 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f6e94012c60 con 0x7f6e980cd7c0 2023-11-28T12:07:27.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.216+0000 7f6e8dffb700 1 --2- 172.21.15.45:0/3251618380 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f6e7c0682f0 0x7f6e7c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:27.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.216+0000 7f6e8dffb700 1 -- 172.21.15.45:0/3251618380 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f6e940861b0 con 0x7f6e980cd7c0 2023-11-28T12:07:27.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.216+0000 7f6e9cf9a700 1 --2- 172.21.15.45:0/3251618380 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f6e7c0682f0 0x7f6e7c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:27.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.217+0000 7f6e9cf9a700 1 --2- 172.21.15.45:0/3251618380 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f6e7c0682f0 0x7f6e7c06a7a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6e88007fd0 tx=0x7f6e88009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:27.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.220+0000 7f6e8dffb700 1 -- 172.21.15.45:0/3251618380 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f6e940528e0 con 0x7f6e980cd7c0 2023-11-28T12:07:27.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.467+0000 7f6e9f9ff700 1 -- 172.21.15.45:0/3251618380 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6e98156e60 con 0x7f6e980cd7c0 2023-11-28T12:07:27.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.468+0000 7f6e8dffb700 1 -- 172.21.15.45:0/3251618380 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4648 (secure 0 0 0) 0x7f6e94055f00 con 0x7f6e980cd7c0 2023-11-28T12:07:27.468 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:07:27.469 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1163718907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6835","nonce":1163718907},{"type":"v1","addr":"172.21.15.152:6837","nonce":1163718907}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4282,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/2292614522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":2292614522},{"type":"v1","addr":"172.21.15.45:6834","nonce":2292614522}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4285,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/3920917053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":3920917053},{"type":"v1","addr":"172.21.15.45:6835","nonce":3920917053}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T12:06:29.394171+0000","modified":"2023-11-28T12:06:32.886491+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.152:6836/3624153928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":3624153928},{"type":"v1","addr":"172.21.15.152:6836","nonce":3624153928}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T12:07:27.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.470+0000 7f6e9f9ff700 1 -- 172.21.15.45:0/3251618380 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f6e7c0682f0 msgr2=0x7f6e7c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:27.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.470+0000 7f6e9f9ff700 1 --2- 172.21.15.45:0/3251618380 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f6e7c0682f0 0x7f6e7c06a7a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6e88007fd0 tx=0x7f6e88009040 comp rx=0 tx=0).stop 2023-11-28T12:07:27.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.470+0000 7f6e9f9ff700 1 -- 172.21.15.45:0/3251618380 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e980cd7c0 msgr2=0x7f6e9814a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:27.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.470+0000 7f6e9f9ff700 1 --2- 172.21.15.45:0/3251618380 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e980cd7c0 0x7f6e9814a510 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f6e9400d800 tx=0x7f6e9400db10 comp rx=0 tx=0).stop 2023-11-28T12:07:27.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.470+0000 7f6e9f9ff700 1 -- 172.21.15.45:0/3251618380 shutdown_connections 2023-11-28T12:07:27.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.470+0000 7f6e9f9ff700 1 --2- 172.21.15.45:0/3251618380 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f6e7c0682f0 0x7f6e7c06a7a0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:27.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.470+0000 7f6e9f9ff700 1 --2- 172.21.15.45:0/3251618380 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e98161340 0x7f6e9815acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:27.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.470+0000 7f6e9f9ff700 1 --2- 172.21.15.45:0/3251618380 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e980cd7c0 0x7f6e9814a510 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:27.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.470+0000 7f6e9f9ff700 1 --2- 172.21.15.45:0/3251618380 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6e9815c9b0 0x7f6e981557e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:27.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.470+0000 7f6e9f9ff700 1 -- 172.21.15.45:0/3251618380 >> 172.21.15.45:0/3251618380 conn(0x7f6e98072600 msgr2=0x7f6e9815f430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:27.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.470+0000 7f6e9f9ff700 1 -- 172.21.15.45:0/3251618380 shutdown_connections 2023-11-28T12:07:27.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.470+0000 7f6e9f9ff700 1 -- 172.21.15.45:0/3251618380 wait complete. 2023-11-28T12:07:27.472 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 8 2023-11-28T12:07:27.490 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T12:07:27.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.696+0000 7f7dab5ff700 1 Processor -- start 2023-11-28T12:07:27.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.696+0000 7f7dab5ff700 1 -- start start 2023-11-28T12:07:27.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.697+0000 7f7dab5ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7da40cd7c0 0x7f7da40cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:27.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.697+0000 7f7dab5ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7da40d1950 con 0x7f7da4161340 2023-11-28T12:07:27.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.697+0000 7f7dab5ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7da40ce140 con 0x7f7da415c9b0 2023-11-28T12:07:27.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.697+0000 7f7dab5ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7da40b5800 con 0x7f7da40cd7c0 2023-11-28T12:07:27.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.697+0000 7f7da9b9c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7da40cd7c0 0x7f7da40cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:27.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.697+0000 7f7da8b9a700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f7da4161340 0x7f7da40d1de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:52282/0 (socket says 172.21.15.45:52282) 2023-11-28T12:07:27.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.697+0000 7f7da8b9a700 1 -- 172.21.15.45:0/2266014522 learned_addr learned my addr 172.21.15.45:0/2266014522 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:07:27.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.698+0000 7f7da9b9c700 1 -- 172.21.15.45:0/2266014522 >> v1:172.21.15.152:6789/0 conn(0x7f7da415c9b0 legacy=0x7f7da40b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:27.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.698+0000 7f7d9bfff700 1 -- 172.21.15.45:0/2266014522 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 642619994 0 0) 0x7f7da40d1950 con 0x7f7da4161340 2023-11-28T12:07:27.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.698+0000 7f7da9b9c700 1 -- 172.21.15.45:0/2266014522 >> v1:172.21.15.45:6789/0 conn(0x7f7da4161340 legacy=0x7f7da40d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:27.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.698+0000 7f7da9b9c700 1 -- 172.21.15.45:0/2266014522 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7da40d24f0 con 0x7f7da40cd7c0 2023-11-28T12:07:27.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.698+0000 7f7da9b9c700 1 --2- 172.21.15.45:0/2266014522 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7da40cd7c0 0x7f7da40cdc00 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c009d90 tx=0x7f7d9c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52d2f269e309b97 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:27.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.698+0000 7f7d9bfff700 1 -- 172.21.15.45:0/2266014522 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d9c00e070 con 0x7f7da40cd7c0 2023-11-28T12:07:27.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.698+0000 7f7d9bfff700 1 -- 172.21.15.45:0/2266014522 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d9c00bbd0 con 0x7f7da40cd7c0 2023-11-28T12:07:27.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.698+0000 7f7d9bfff700 1 -- 172.21.15.45:0/2266014522 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d9c012430 con 0x7f7da40cd7c0 2023-11-28T12:07:27.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.699+0000 7f7dab5ff700 1 -- 172.21.15.45:0/2266014522 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7da40cd7c0 msgr2=0x7f7da40cdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:27.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.699+0000 7f7dab5ff700 1 --2- 172.21.15.45:0/2266014522 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7da40cd7c0 0x7f7da40cdc00 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c009d90 tx=0x7f7d9c00b330 comp rx=0 tx=0).stop 2023-11-28T12:07:27.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.699+0000 7f7dab5ff700 1 -- 172.21.15.45:0/2266014522 shutdown_connections 2023-11-28T12:07:27.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.699+0000 7f7dab5ff700 1 --2- 172.21.15.45:0/2266014522 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7da40cd7c0 0x7f7da40cdc00 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:27.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.699+0000 7f7dab5ff700 1 -- 172.21.15.45:0/2266014522 >> 172.21.15.45:0/2266014522 conn(0x7f7da4072600 msgr2=0x7f7da40cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:27.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.699+0000 7f7dab5ff700 1 -- 172.21.15.45:0/2266014522 shutdown_connections 2023-11-28T12:07:27.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.699+0000 7f7dab5ff700 1 -- 172.21.15.45:0/2266014522 wait complete. 2023-11-28T12:07:27.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.701+0000 7f7dab5ff700 1 Processor -- start 2023-11-28T12:07:27.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.701+0000 7f7dab5ff700 1 -- start start 2023-11-28T12:07:27.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.702+0000 7f7dab5ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7da40cd7c0 0x7f7da41e75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:27.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.702+0000 7f7dab5ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7da415c9b0 0x7f7da40c9690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:27.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.702+0000 7f7dab5ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7da4161340 0x7f7da41577c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:27.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.702+0000 7f7dab5ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7da40c9270 con 0x7f7da415c9b0 2023-11-28T12:07:27.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.702+0000 7f7dab5ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7da4157d00 con 0x7f7da4161340 2023-11-28T12:07:27.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.702+0000 7f7dab5ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7da40c8680 con 0x7f7da40cd7c0 2023-11-28T12:07:27.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.702+0000 7f7da8b9a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7da415c9b0 0x7f7da40c9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:27.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.702+0000 7f7da8b9a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7da415c9b0 0x7f7da40c9690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46410/0 (socket says 172.21.15.45:46410) 2023-11-28T12:07:27.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.702+0000 7f7da8b9a700 1 -- 172.21.15.45:0/3490076963 learned_addr learned my addr 172.21.15.45:0/3490076963 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:27.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.702+0000 7f7da939b700 1 --2- 172.21.15.45:0/3490076963 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7da40cd7c0 0x7f7da41e75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:27.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.702+0000 7f7da9b9c700 1 --2- 172.21.15.45:0/3490076963 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7da4161340 0x7f7da41577c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:27.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.702+0000 7f7da8b9a700 1 -- 172.21.15.45:0/3490076963 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7da40cd7c0 msgr2=0x7f7da41e75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:27.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.702+0000 7f7da8b9a700 1 --2- 172.21.15.45:0/3490076963 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7da40cd7c0 0x7f7da41e75d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:27.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.702+0000 7f7da8b9a700 1 -- 172.21.15.45:0/3490076963 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7da4161340 msgr2=0x7f7da41577c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:27.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.702+0000 7f7da8b9a700 1 --2- 172.21.15.45:0/3490076963 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7da4161340 0x7f7da41577c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:27.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.702+0000 7f7da8b9a700 1 -- 172.21.15.45:0/3490076963 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d9c009a70 con 0x7f7da415c9b0 2023-11-28T12:07:27.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.702+0000 7f7da939b700 1 --2- 172.21.15.45:0/3490076963 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7da40cd7c0 0x7f7da41e75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:07:27.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.703+0000 7f7da8b9a700 1 --2- 172.21.15.45:0/3490076963 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7da415c9b0 0x7f7da40c9690 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f7d9400c520 tx=0x7f7d9400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:27.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.703+0000 7f7d99ffb700 1 -- 172.21.15.45:0/3490076963 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d94004c80 con 0x7f7da415c9b0 2023-11-28T12:07:27.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.703+0000 7f7d99ffb700 1 -- 172.21.15.45:0/3490076963 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d94004e00 con 0x7f7da415c9b0 2023-11-28T12:07:27.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.703+0000 7f7dab5ff700 1 -- 172.21.15.45:0/3490076963 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7da40d1300 con 0x7f7da415c9b0 2023-11-28T12:07:27.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.703+0000 7f7d99ffb700 1 -- 172.21.15.45:0/3490076963 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d94007310 con 0x7f7da415c9b0 2023-11-28T12:07:27.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.703+0000 7f7dab5ff700 1 -- 172.21.15.45:0/3490076963 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7da40b5520 con 0x7f7da415c9b0 2023-11-28T12:07:27.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.704+0000 7f7dab5ff700 1 -- 172.21.15.45:0/3490076963 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7da40d15e0 con 0x7f7da415c9b0 2023-11-28T12:07:27.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.705+0000 7f7d99ffb700 1 -- 172.21.15.45:0/3490076963 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f7d9401a020 con 0x7f7da415c9b0 2023-11-28T12:07:27.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.706+0000 7f7d99ffb700 1 --2- 172.21.15.45:0/3490076963 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f7d880682f0 0x7f7d8806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:27.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.706+0000 7f7d99ffb700 1 -- 172.21.15.45:0/3490076963 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f7d940859c0 con 0x7f7da415c9b0 2023-11-28T12:07:27.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.706+0000 7f7da939b700 1 --2- 172.21.15.45:0/3490076963 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f7d880682f0 0x7f7d8806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:27.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.707+0000 7f7da939b700 1 --2- 172.21.15.45:0/3490076963 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f7d880682f0 0x7f7d8806a7a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7da0001780 tx=0x7f7da0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:27.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.710+0000 7f7d99ffb700 1 -- 172.21.15.45:0/3490076963 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f7d940520f0 con 0x7f7da415c9b0 2023-11-28T12:07:27.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.909+0000 7f7dab5ff700 1 -- 172.21.15.45:0/3490076963 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7da40b9180 con 0x7f7da415c9b0 2023-11-28T12:07:27.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.911+0000 7f7d99ffb700 1 -- 172.21.15.45:0/3490076963 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+17944 (secure 0 0 0) 0x7f7d94055710 con 0x7f7da415c9b0 2023-11-28T12:07:27.912 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:07:27.912 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":22,"fsid":"bd7c37f1-f7c6-4778-b845-52cf2aa6e366","created":"2023-11-28T12:06:09.045075+0000","modified":"2023-11-28T12:07:18.025970+0000","last_up_change":"2023-11-28T12:06:21.282227+0000","last_in_change":"2023-11-28T12:06:12.560924+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T12:06:21.807108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T12:06:22.491009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-11-28T12:06:27.684157+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-11-28T12:06:28.384679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d0cdd8a-87fd-4f2c-91bd-47bdfa661905","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":115843},{"type":"v1","addr":"172.21.15.45:6808","nonce":115843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":115843},{"type":"v1","addr":"172.21.15.45:6811","nonce":115843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":115843},{"type":"v1","addr":"172.21.15.45:6815","nonce":115843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":115843},{"type":"v1","addr":"172.21.15.45:6813","nonce":115843}]},"public_addr":"172.21.15.45:6808/115843","cluster_addr":"172.21.15.45:6811/115843","heartbeat_back_addr":"172.21.15.45:6815/115843","heartbeat_front_addr":"172.21.15.45:6813/115843","state":["exists","up"]},{"osd":1,"uuid":"c5de4ebd-9ec5-40b3-9caa-9b706fab4c76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":115842},{"type":"v1","addr":"172.21.15.45:6801","nonce":115842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":115842},{"type":"v1","addr":"172.21.15.45:6803","nonce":115842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6807","nonce":115842},{"type":"v1","addr":"172.21.15.45:6809","nonce":115842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":115842},{"type":"v1","addr":"172.21.15.45:6805","nonce":115842}]},"public_addr":"172.21.15.45:6801/115842","cluster_addr":"172.21.15.45:6803/115842","heartbeat_back_addr":"172.21.15.45:6809/115842","heartbeat_front_addr":"172.21.15.45:6805/115842","state":["exists","up"]},{"osd":2,"uuid":"9f4b36b2-65d2-40e7-9fe6-a2991afa71c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":115850},{"type":"v1","addr":"172.21.15.45:6819","nonce":115850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":115850},{"type":"v1","addr":"172.21.15.45:6823","nonce":115850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":115850},{"type":"v1","addr":"172.21.15.45:6831","nonce":115850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":115850},{"type":"v1","addr":"172.21.15.45:6828","nonce":115850}]},"public_addr":"172.21.15.45:6819/115850","cluster_addr":"172.21.15.45:6823/115850","heartbeat_back_addr":"172.21.15.45:6831/115850","heartbeat_front_addr":"172.21.15.45:6828/115850","state":["exists","up"]},{"osd":3,"uuid":"6fe7ef05-4e0d-426c-bf94-44b51d4d550b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":115848},{"type":"v1","addr":"172.21.15.45:6818","nonce":115848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":115848},{"type":"v1","addr":"172.21.15.45:6822","nonce":115848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6827","nonce":115848},{"type":"v1","addr":"172.21.15.45:6829","nonce":115848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":115848},{"type":"v1","addr":"172.21.15.45:6825","nonce":115848}]},"public_addr":"172.21.15.45:6818/115848","cluster_addr":"172.21.15.45:6822/115848","heartbeat_back_addr":"172.21.15.45:6829/115848","heartbeat_front_addr":"172.21.15.45:6825/115848","state":["exists","up"]},{"osd":4,"uuid":"fa403c08-d8a1-4a3a-8384-cb465c1a654c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":116092},{"type":"v1","addr":"172.21.15.152:6801","nonce":116092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":116092},{"type":"v1","addr":"172.21.15.152:6803","nonce":116092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":116092},{"type":"v1","addr":"172.21.15.152:6807","nonce":116092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":116092},{"type":"v1","addr":"172.21.15.152:6805","nonce":116092}]},"public_addr":"172.21.15.152:6801/116092","cluster_addr":"172.21.15.152:6803/116092","heartbeat_back_addr":"172.21.15.152:6807/116092","heartbeat_front_addr":"172.21.15.152:6805/116092","state":["exists","up"]},{"osd":5,"uuid":"399fc450-39fa-43a6-bf80-0b8bcb41bd95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6815","nonce":116093},{"type":"v1","addr":"172.21.15.152:6817","nonce":116093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":116093},{"type":"v1","addr":"172.21.15.152:6819","nonce":116093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":116093},{"type":"v1","addr":"172.21.15.152:6823","nonce":116093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":116093},{"type":"v1","addr":"172.21.15.152:6821","nonce":116093}]},"public_addr":"172.21.15.152:6817/116093","cluster_addr":"172.21.15.152:6819/116093","heartbeat_back_addr":"172.21.15.152:6823/116093","heartbeat_front_addr":"172.21.15.152:6821/116093","state":["exists","up"]},{"osd":6,"uuid":"e59a4017-2d23-4627-836b-e25b2d3ddaaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":116094},{"type":"v1","addr":"172.21.15.152:6809","nonce":116094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":116094},{"type":"v1","addr":"172.21.15.152:6811","nonce":116094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":116094},{"type":"v1","addr":"172.21.15.152:6816","nonce":116094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":116094},{"type":"v1","addr":"172.21.15.152:6813","nonce":116094}]},"public_addr":"172.21.15.152:6809/116094","cluster_addr":"172.21.15.152:6811/116094","heartbeat_back_addr":"172.21.15.152:6816/116094","heartbeat_front_addr":"172.21.15.152:6813/116094","state":["exists","up"]},{"osd":7,"uuid":"8d7f9d4b-bf08-4670-8591-388c0f012a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":116097},{"type":"v1","addr":"172.21.15.152:6825","nonce":116097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":116097},{"type":"v1","addr":"172.21.15.152:6827","nonce":116097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":116097},{"type":"v1","addr":"172.21.15.152:6831","nonce":116097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":116097},{"type":"v1","addr":"172.21.15.152:6829","nonce":116097}]},"public_addr":"172.21.15.152:6825/116097","cluster_addr":"172.21.15.152:6827/116097","heartbeat_back_addr":"172.21.15.152:6831/116097","heartbeat_front_addr":"172.21.15.152:6829/116097","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.937710+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.865423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.159434+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.913090+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.131647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.966255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.972583+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.177209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.29","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T12:07:27.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.913+0000 7f7dab5ff700 1 -- 172.21.15.45:0/3490076963 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f7d880682f0 msgr2=0x7f7d8806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:27.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.913+0000 7f7dab5ff700 1 --2- 172.21.15.45:0/3490076963 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f7d880682f0 0x7f7d8806a7a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7da0001780 tx=0x7f7da0009040 comp rx=0 tx=0).stop 2023-11-28T12:07:27.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.913+0000 7f7dab5ff700 1 -- 172.21.15.45:0/3490076963 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7da415c9b0 msgr2=0x7f7da40c9690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:27.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.913+0000 7f7dab5ff700 1 --2- 172.21.15.45:0/3490076963 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7da415c9b0 0x7f7da40c9690 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f7d9400c520 tx=0x7f7d9400c8e0 comp rx=0 tx=0).stop 2023-11-28T12:07:27.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.913+0000 7f7dab5ff700 1 -- 172.21.15.45:0/3490076963 shutdown_connections 2023-11-28T12:07:27.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.913+0000 7f7dab5ff700 1 --2- 172.21.15.45:0/3490076963 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f7d880682f0 0x7f7d8806a7a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:27.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.913+0000 7f7dab5ff700 1 --2- 172.21.15.45:0/3490076963 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7da4161340 0x7f7da41577c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:27.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.913+0000 7f7dab5ff700 1 --2- 172.21.15.45:0/3490076963 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7da40cd7c0 0x7f7da41e75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:27.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.913+0000 7f7dab5ff700 1 --2- 172.21.15.45:0/3490076963 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7da415c9b0 0x7f7da40c9690 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:27.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.913+0000 7f7dab5ff700 1 -- 172.21.15.45:0/3490076963 >> 172.21.15.45:0/3490076963 conn(0x7f7da4072600 msgr2=0x7f7da4160610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:27.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.913+0000 7f7dab5ff700 1 -- 172.21.15.45:0/3490076963 shutdown_connections 2023-11-28T12:07:27.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:27.913+0000 7f7dab5ff700 1 -- 172.21.15.45:0/3490076963 wait complete. 2023-11-28T12:07:27.932 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-28T12:07:28.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:28.137+0000 7fbfc4bff700 1 Processor -- start 2023-11-28T12:07:28.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:28.137+0000 7fbfc4bff700 1 -- start start 2023-11-28T12:07:28.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:28.138+0000 7fbfc4bff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbfc00d1330 0x7fbfc00b06c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:28.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:28.138+0000 7fbfc4bff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fbfc00b20b0 0x7fbfc00b0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:28.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:28.138+0000 7fbfc4bff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfc00b0230 con 0x7fbfc00d01b0 2023-11-28T12:07:28.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:28.138+0000 7fbfc4bff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfc015cec0 con 0x7fbfc00d1330 2023-11-28T12:07:28.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:28.138+0000 7fbfc4bff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfc00b4570 con 0x7fbfc00b20b0 2023-11-28T12:07:28.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:28.138+0000 7fbfb7fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbfc00d1330 0x7fbfc00b06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:28.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:28.138+0000 7fbfb7fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbfc00d1330 0x7fbfc00b06c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46426/0 (socket says 172.21.15.45:46426) 2023-11-28T12:07:28.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:28.138+0000 7fbfb7fff700 1 -- 172.21.15.45:0/807357564 learned_addr learned my addr 172.21.15.45:0/807357564 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:28.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:28.139+0000 7fbfbed9d700 1 --2- 172.21.15.45:0/807357564 >> v2:172.21.15.152:3300/0 conn(0x7fbfc00b20b0 0x7fbfc00b0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:28.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:28.139+0000 7fbfb7fff700 1 -- 172.21.15.45:0/807357564 >> v2:172.21.15.152:3300/0 conn(0x7fbfc00b20b0 msgr2=0x7fbfc00b0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:28.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:28.139+0000 7fbfb7fff700 1 --2- 172.21.15.45:0/807357564 >> v2:172.21.15.152:3300/0 conn(0x7fbfc00b20b0 0x7fbfc00b0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:28.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:28.139+0000 7fbfb7fff700 1 -- 172.21.15.45:0/807357564 >> v1:172.21.15.152:6789/0 conn(0x7fbfc00d01b0 legacy=0x7fbfc00d0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:28.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:28.139+0000 7fbfb7fff700 1 -- 172.21.15.45:0/807357564 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfc00b4850 con 0x7fbfc00d1330 2023-11-28T12:07:28.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:28.139+0000 7fbfb7fff700 1 --2- 172.21.15.45:0/807357564 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfc00d1330 0x7fbfc00b06c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fbfc0066e80 tx=0x7fbfa8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db5e7146bd478508 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:28.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:28.139+0000 7fbfbdd9b700 1 -- 172.21.15.45:0/807357564 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa8004230 con 0x7fbfc00d1330 2023-11-28T12:07:28.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:28.139+0000 7fbfbdd9b700 1 -- 172.21.15.45:0/807357564 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfa8004390 con 0x7fbfc00d1330 2023-11-28T12:07:28.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:28.139+0000 7fbfbdd9b700 1 -- 172.21.15.45:0/807357564 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa80036a0 con 0x7fbfc00d1330 2023-11-28T12:07:28.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:28.140+0000 7fbfc4bff700 1 -- 172.21.15.45:0/807357564 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfc00d1330 msgr2=0x7fbfc00b06c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:28.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:28.140+0000 7fbfc4bff700 1 --2- 172.21.15.45:0/807357564 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfc00d1330 0x7fbfc00b06c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fbfc0066e80 tx=0x7fbfa8009bd0 comp rx=0 tx=0).stop 2023-11-28T12:07:28.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:28.140+0000 7fbfc4bff700 1 -- 172.21.15.45:0/807357564 shutdown_connections 2023-11-28T12:07:28.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:28.140+0000 7fbfc4bff700 1 --2- 172.21.15.45:0/807357564 >> v2:172.21.15.152:3300/0 conn(0x7fbfc00b20b0 0x7fbfc00b0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:28.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:28.140+0000 7fbfc4bff700 1 --2- 172.21.15.45:0/807357564 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfc00d1330 0x7fbfc00b06c0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:28.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:28.140+0000 7fbfc4bff700 1 -- 172.21.15.45:0/807357564 >> 172.21.15.45:0/807357564 conn(0x7fbfc009c3f0 msgr2=0x7fbfc00d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:28.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:28.140+0000 7fbfc4bff700 1 -- 172.21.15.45:0/807357564 shutdown_connections 2023-11-28T12:07:28.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:28.140+0000 7fbfc4bff700 1 -- 172.21.15.45:0/807357564 wait complete. 2023-11-28T12:07:28.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:28.142+0000 7fbfc4bff700 1 Processor -- start 2023-11-28T12:07:28.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:28.142+0000 7fbfc4bff700 1 -- start start 2023-11-28T12:07:28.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:28.143+0000 7fbfc4bff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbfc00b20b0 0x7fbfc00a0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:28.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:28.143+0000 7fbfc4bff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbfc00d01b0 0x7fbfc00ca120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:28.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:28.143+0000 7fbfc4bff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfc00d1330 0x7fbfc015ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:28.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:28.143+0000 7fbfc4bff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc009ea90 con 0x7fbfc00d1330 2023-11-28T12:07:28.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:28.143+0000 7fbfc4bff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc009f610 con 0x7fbfc00d01b0 2023-11-28T12:07:28.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:28.143+0000 7fbfc4bff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc009ece0 con 0x7fbfc00b20b0 2023-11-28T12:07:28.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:28.143+0000 7fbfbed9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfc00d1330 0x7fbfc015ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:28.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:28.143+0000 7fbfbed9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfc00d1330 0x7fbfc015ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46440/0 (socket says 172.21.15.45:46440) 2023-11-28T12:07:28.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:28.143+0000 7fbfbed9d700 1 -- 172.21.15.45:0/3258187619 learned_addr learned my addr 172.21.15.45:0/3258187619 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:28.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:28.143+0000 7fbfb7fff700 1 --2- 172.21.15.45:0/3258187619 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbfc00d01b0 0x7fbfc00ca120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:28.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:28.143+0000 7fbfbe59c700 1 --2- 172.21.15.45:0/3258187619 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbfc00b20b0 0x7fbfc00a0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:28.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:28.144+0000 7fbfbed9d700 1 -- 172.21.15.45:0/3258187619 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbfc00b20b0 msgr2=0x7fbfc00a0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:28.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:28.144+0000 7fbfbed9d700 1 --2- 172.21.15.45:0/3258187619 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbfc00b20b0 0x7fbfc00a0930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:28.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:28.144+0000 7fbfbed9d700 1 -- 172.21.15.45:0/3258187619 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbfc00d01b0 msgr2=0x7fbfc00ca120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:28.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:28.144+0000 7fbfbed9d700 1 --2- 172.21.15.45:0/3258187619 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbfc00d01b0 0x7fbfc00ca120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:28.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:28.144+0000 7fbfbed9d700 1 -- 172.21.15.45:0/3258187619 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfa8009550 con 0x7fbfc00d1330 2023-11-28T12:07:28.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:28.144+0000 7fbfb7fff700 1 --2- 172.21.15.45:0/3258187619 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbfc00d01b0 0x7fbfc00ca120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:07:28.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:28.144+0000 7fbfbed9d700 1 --2- 172.21.15.45:0/3258187619 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfc00d1330 0x7fbfc015ab40 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fbfb8009fd0 tx=0x7fbfb800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:28.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:28.144+0000 7fbfb6ffd700 1 -- 172.21.15.45:0/3258187619 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb8007ea0 con 0x7fbfc00d1330 2023-11-28T12:07:28.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:28.144+0000 7fbfb6ffd700 1 -- 172.21.15.45:0/3258187619 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfb800ed30 con 0x7fbfc00d1330 2023-11-28T12:07:28.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:28.144+0000 7fbfb6ffd700 1 -- 172.21.15.45:0/3258187619 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb800eea0 con 0x7fbfc00d1330 2023-11-28T12:07:28.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:28.144+0000 7fbfc4bff700 1 -- 172.21.15.45:0/3258187619 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfc00afec0 con 0x7fbfc00d1330 2023-11-28T12:07:28.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:28.144+0000 7fbfc4bff700 1 -- 172.21.15.45:0/3258187619 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfc00afbe0 con 0x7fbfc00d1330 2023-11-28T12:07:28.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:28.145+0000 7fbfc4bff700 1 -- 172.21.15.45:0/3258187619 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfc00b2600 con 0x7fbfc00d1330 2023-11-28T12:07:28.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:28.146+0000 7fbfb6ffd700 1 -- 172.21.15.45:0/3258187619 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fbfb8012050 con 0x7fbfc00d1330 2023-11-28T12:07:28.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:28.148+0000 7fbfb6ffd700 1 --2- 172.21.15.45:0/3258187619 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fbfa00682f0 0x7fbfa006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:28.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:28.148+0000 7fbfb6ffd700 1 -- 172.21.15.45:0/3258187619 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fbfb8086240 con 0x7fbfc00d1330 2023-11-28T12:07:28.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:28.148+0000 7fbfbe59c700 1 --2- 172.21.15.45:0/3258187619 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fbfa00682f0 0x7fbfa006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:28.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:28.149+0000 7fbfbe59c700 1 --2- 172.21.15.45:0/3258187619 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fbfa00682f0 0x7fbfa006a7a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fbfc00a0160 tx=0x7fbfb0007ec0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:28.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:28.152+0000 7fbfb6ffd700 1 -- 172.21.15.45:0/3258187619 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fbfb8052970 con 0x7fbfc00d1330 2023-11-28T12:07:28.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:28.405+0000 7fbfc4bff700 1 -- 172.21.15.45:0/3258187619 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fbfc009f780 con 0x7fbfc00d1330 2023-11-28T12:07:29.078 INFO:tasks.ceph.mon.a.smithi045.stderr:2023-11-28T12:07:29.077+0000 7fe5533f9700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-28T12:07:29.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:29.084+0000 7fbfb6ffd700 1 -- 172.21.15.45:0/3258187619 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7fbfb8055f90 con 0x7fbfc00d1330 2023-11-28T12:07:29.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:29.087+0000 7fbfc4bff700 1 -- 172.21.15.45:0/3258187619 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fbfa00682f0 msgr2=0x7fbfa006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:29.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:29.087+0000 7fbfc4bff700 1 --2- 172.21.15.45:0/3258187619 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fbfa00682f0 0x7fbfa006a7a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fbfc00a0160 tx=0x7fbfb0007ec0 comp rx=0 tx=0).stop 2023-11-28T12:07:29.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:29.087+0000 7fbfc4bff700 1 -- 172.21.15.45:0/3258187619 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfc00d1330 msgr2=0x7fbfc015ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:29.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:29.087+0000 7fbfc4bff700 1 --2- 172.21.15.45:0/3258187619 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfc00d1330 0x7fbfc015ab40 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fbfb8009fd0 tx=0x7fbfb800e3c0 comp rx=0 tx=0).stop 2023-11-28T12:07:29.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:29.087+0000 7fbfc4bff700 1 -- 172.21.15.45:0/3258187619 shutdown_connections 2023-11-28T12:07:29.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:29.087+0000 7fbfc4bff700 1 --2- 172.21.15.45:0/3258187619 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fbfa00682f0 0x7fbfa006a7a0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:29.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:29.087+0000 7fbfc4bff700 1 --2- 172.21.15.45:0/3258187619 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfc00d1330 0x7fbfc015ab40 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:29.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:29.087+0000 7fbfc4bff700 1 --2- 172.21.15.45:0/3258187619 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbfc00b20b0 0x7fbfc00a0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:29.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:29.087+0000 7fbfc4bff700 1 --2- 172.21.15.45:0/3258187619 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbfc00d01b0 0x7fbfc00ca120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:29.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:29.087+0000 7fbfc4bff700 1 -- 172.21.15.45:0/3258187619 >> 172.21.15.45:0/3258187619 conn(0x7fbfc009c3f0 msgr2=0x7fbfc015c630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:29.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:29.087+0000 7fbfc4bff700 1 -- 172.21.15.45:0/3258187619 shutdown_connections 2023-11-28T12:07:29.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:29.087+0000 7fbfc4bff700 1 -- 172.21.15.45:0/3258187619 wait complete. 2023-11-28T12:07:29.089 INFO:teuthology.orchestra.run.smithi045.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-28T12:07:29.097 INFO:tasks.ceph.mds.b.smithi152.stderr: -5936> 2023-11-28T12:06:34.738+0000 7f6b741f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-28T12:07:29.110 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-28T12:07:29.151 INFO:tasks.ceph.mds.b.smithi152.stdout:starting mds.b at 2023-11-28T12:07:29.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:29.320+0000 7fe6709ff700 1 Processor -- start 2023-11-28T12:07:29.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:29.320+0000 7fe6709ff700 1 -- start start 2023-11-28T12:07:29.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:29.321+0000 7fe6709ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe66c15c9b0 0x7fe66c0b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:29.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:29.321+0000 7fe6709ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fe66c161340 0x7fe66c0d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:29.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:29.321+0000 7fe6709ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe66c0d2320 0x7fe66c0cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:29.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:29.321+0000 7fe6709ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe66c0b5800 con 0x7fe66c0d2320 2023-11-28T12:07:29.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:29.321+0000 7fe6709ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe66c0d1950 con 0x7fe66c161340 2023-11-28T12:07:29.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:29.321+0000 7fe6709ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe66c0b5520 con 0x7fe66c15c9b0 2023-11-28T12:07:29.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:29.321+0000 7fe66ad9d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe66c0d2320 0x7fe66c0cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:29.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:29.322+0000 7fe669d9b700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fe66c161340 0x7fe66c0d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:29.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:29.322+0000 7fe66ad9d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe66c0d2320 0x7fe66c0cd7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46450/0 (socket says 172.21.15.45:46450) 2023-11-28T12:07:29.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:29.322+0000 7fe66ad9d700 1 -- 172.21.15.45:0/2141380427 learned_addr learned my addr 172.21.15.45:0/2141380427 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:29.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:29.322+0000 7fe66a59c700 1 --2- 172.21.15.45:0/2141380427 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe66c15c9b0 0x7fe66c0b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:29.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:29.322+0000 7fe66ad9d700 1 -- 172.21.15.45:0/2141380427 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe66c15c9b0 msgr2=0x7fe66c0b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:29.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:29.322+0000 7fe66ad9d700 1 --2- 172.21.15.45:0/2141380427 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe66c15c9b0 0x7fe66c0b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:29.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:29.322+0000 7fe66ad9d700 1 -- 172.21.15.45:0/2141380427 >> v2:172.21.15.152:3300/0 conn(0x7fe66c161340 msgr2=0x7fe66c0d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:29.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:29.322+0000 7fe66ad9d700 1 --2- 172.21.15.45:0/2141380427 >> v2:172.21.15.152:3300/0 conn(0x7fe66c161340 0x7fe66c0d1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:29.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:29.322+0000 7fe66ad9d700 1 -- 172.21.15.45:0/2141380427 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe66c0d1300 con 0x7fe66c0d2320 2023-11-28T12:07:29.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:29.322+0000 7fe66ad9d700 1 --2- 172.21.15.45:0/2141380427 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe66c0d2320 0x7fe66c0cd7c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe66c06bc00 tx=0x7fe66400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=155d84e388092bd4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:29.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:29.323+0000 7fe66959a700 1 -- 172.21.15.45:0/2141380427 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe66400e070 con 0x7fe66c0d2320 2023-11-28T12:07:29.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:29.323+0000 7fe66959a700 1 -- 172.21.15.45:0/2141380427 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe66400b910 con 0x7fe66c0d2320 2023-11-28T12:07:29.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:29.323+0000 7fe66959a700 1 -- 172.21.15.45:0/2141380427 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe66400bcc0 con 0x7fe66c0d2320 2023-11-28T12:07:29.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:29.323+0000 7fe6709ff700 1 -- 172.21.15.45:0/2141380427 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe66c0d2320 msgr2=0x7fe66c0cd7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:29.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:29.323+0000 7fe6709ff700 1 --2- 172.21.15.45:0/2141380427 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe66c0d2320 0x7fe66c0cd7c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe66c06bc00 tx=0x7fe66400b330 comp rx=0 tx=0).stop 2023-11-28T12:07:29.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:29.323+0000 7fe6709ff700 1 -- 172.21.15.45:0/2141380427 shutdown_connections 2023-11-28T12:07:29.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:29.323+0000 7fe6709ff700 1 --2- 172.21.15.45:0/2141380427 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe66c15c9b0 0x7fe66c0b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:29.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:29.323+0000 7fe6709ff700 1 --2- 172.21.15.45:0/2141380427 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe66c0d2320 0x7fe66c0cd7c0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:29.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:29.323+0000 7fe6709ff700 1 --2- 172.21.15.45:0/2141380427 >> v2:172.21.15.152:3300/0 conn(0x7fe66c161340 0x7fe66c0d1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:29.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:29.323+0000 7fe6709ff700 1 -- 172.21.15.45:0/2141380427 >> 172.21.15.45:0/2141380427 conn(0x7fe66c072600 msgr2=0x7fe66c0cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:29.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:29.323+0000 7fe6709ff700 1 -- 172.21.15.45:0/2141380427 shutdown_connections 2023-11-28T12:07:29.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:29.323+0000 7fe6709ff700 1 -- 172.21.15.45:0/2141380427 wait complete. 2023-11-28T12:07:29.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:29.325+0000 7fe6709ff700 1 Processor -- start 2023-11-28T12:07:29.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:29.325+0000 7fe6709ff700 1 -- start start 2023-11-28T12:07:29.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:29.326+0000 7fe6709ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe66c0d2320 0x7fe66c15fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:29.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:29.326+0000 7fe6709ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe66c15c9b0 0x7fe66c1e7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:29.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:29.326+0000 7fe6709ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe66c161340 0x7fe66c14e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:29.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:29.326+0000 7fe6709ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe66c151940 con 0x7fe66c161340 2023-11-28T12:07:29.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:29.326+0000 7fe6709ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe66c1e83e0 con 0x7fe66c15c9b0 2023-11-28T12:07:29.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:29.326+0000 7fe6709ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe66c1e8c20 con 0x7fe66c0d2320 2023-11-28T12:07:29.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:29.326+0000 7fe66ad9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe66c161340 0x7fe66c14e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:29.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:29.327+0000 7fe66ad9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe66c161340 0x7fe66c14e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46452/0 (socket says 172.21.15.45:46452) 2023-11-28T12:07:29.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:29.327+0000 7fe66ad9d700 1 -- 172.21.15.45:0/592161801 learned_addr learned my addr 172.21.15.45:0/592161801 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:29.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:29.327+0000 7fe669d9b700 1 --2- 172.21.15.45:0/592161801 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe66c15c9b0 0x7fe66c1e7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:29.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:29.327+0000 7fe66a59c700 1 --2- 172.21.15.45:0/592161801 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe66c0d2320 0x7fe66c15fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:29.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:29.327+0000 7fe66ad9d700 1 -- 172.21.15.45:0/592161801 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe66c0d2320 msgr2=0x7fe66c15fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:29.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:29.327+0000 7fe66ad9d700 1 --2- 172.21.15.45:0/592161801 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe66c0d2320 0x7fe66c15fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:29.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:29.327+0000 7fe66ad9d700 1 -- 172.21.15.45:0/592161801 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe66c15c9b0 msgr2=0x7fe66c1e7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:29.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:29.327+0000 7fe66ad9d700 1 --2- 172.21.15.45:0/592161801 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe66c15c9b0 0x7fe66c1e7ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:29.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:29.327+0000 7fe66ad9d700 1 -- 172.21.15.45:0/592161801 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe664009b30 con 0x7fe66c161340 2023-11-28T12:07:29.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:29.327+0000 7fe66ad9d700 1 --2- 172.21.15.45:0/592161801 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe66c161340 0x7fe66c14e170 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe66400b680 tx=0x7fe664004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:29.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:29.327+0000 7fe65affd700 1 -- 172.21.15.45:0/592161801 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6640099b0 con 0x7fe66c161340 2023-11-28T12:07:29.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:29.328+0000 7fe65affd700 1 -- 172.21.15.45:0/592161801 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe66400ce80 con 0x7fe66c161340 2023-11-28T12:07:29.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:29.328+0000 7fe65affd700 1 -- 172.21.15.45:0/592161801 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe664004490 con 0x7fe66c161340 2023-11-28T12:07:29.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:29.328+0000 7fe6709ff700 1 -- 172.21.15.45:0/592161801 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe66c0b5130 con 0x7fe66c161340 2023-11-28T12:07:29.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:29.328+0000 7fe6709ff700 1 -- 172.21.15.45:0/592161801 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe66c0d15e0 con 0x7fe66c161340 2023-11-28T12:07:29.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:29.329+0000 7fe6709ff700 1 -- 172.21.15.45:0/592161801 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe66c0b52c0 con 0x7fe66c161340 2023-11-28T12:07:29.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:29.330+0000 7fe65affd700 1 -- 172.21.15.45:0/592161801 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fe6640045f0 con 0x7fe66c161340 2023-11-28T12:07:29.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:29.330+0000 7fe65affd700 1 --2- 172.21.15.45:0/592161801 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fe64c068320 0x7fe64c06a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:29.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:29.330+0000 7fe65affd700 1 -- 172.21.15.45:0/592161801 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6206+0+0 (secure 0 0 0) 0x7fe664086e60 con 0x7fe66c161340 2023-11-28T12:07:29.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:29.331+0000 7fe66a59c700 1 --2- 172.21.15.45:0/592161801 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fe64c068320 0x7fe64c06a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:29.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:29.331+0000 7fe66a59c700 1 --2- 172.21.15.45:0/592161801 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fe64c068320 0x7fe64c06a7d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe65c009b40 tx=0x7fe65c009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:29.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:29.335+0000 7fe65affd700 1 -- 172.21.15.45:0/592161801 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fe664053540 con 0x7fe66c161340 2023-11-28T12:07:29.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:29.579+0000 7fe6709ff700 1 -- 172.21.15.45:0/592161801 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe66c0745c0 con 0x7fe66c161340 2023-11-28T12:07:30.006 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T12:07:30.012 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T12:07:30.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:30.086+0000 7fe65affd700 1 -- 172.21.15.45:0/592161801 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe66401f0a0 con 0x7fe66c161340 2023-11-28T12:07:30.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:30.089+0000 7fe6709ff700 1 -- 172.21.15.45:0/592161801 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fe64c068320 msgr2=0x7fe64c06a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:30.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:30.089+0000 7fe6709ff700 1 --2- 172.21.15.45:0/592161801 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fe64c068320 0x7fe64c06a7d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe65c009b40 tx=0x7fe65c009210 comp rx=0 tx=0).stop 2023-11-28T12:07:30.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:30.089+0000 7fe6709ff700 1 -- 172.21.15.45:0/592161801 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe66c161340 msgr2=0x7fe66c14e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:30.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:30.089+0000 7fe6709ff700 1 --2- 172.21.15.45:0/592161801 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe66c161340 0x7fe66c14e170 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe66400b680 tx=0x7fe664004ad0 comp rx=0 tx=0).stop 2023-11-28T12:07:30.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:30.089+0000 7fe6709ff700 1 -- 172.21.15.45:0/592161801 shutdown_connections 2023-11-28T12:07:30.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:30.089+0000 7fe6709ff700 1 --2- 172.21.15.45:0/592161801 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fe64c068320 0x7fe64c06a7d0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:30.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:30.089+0000 7fe6709ff700 1 --2- 172.21.15.45:0/592161801 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe66c161340 0x7fe66c14e170 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:30.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:30.089+0000 7fe6709ff700 1 --2- 172.21.15.45:0/592161801 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe66c0d2320 0x7fe66c15fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:30.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:30.089+0000 7fe6709ff700 1 --2- 172.21.15.45:0/592161801 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe66c15c9b0 0x7fe66c1e7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:30.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:30.089+0000 7fe6709ff700 1 -- 172.21.15.45:0/592161801 >> 172.21.15.45:0/592161801 conn(0x7fe66c072600 msgr2=0x7fe66c0b7f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:30.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:30.089+0000 7fe6709ff700 1 -- 172.21.15.45:0/592161801 shutdown_connections 2023-11-28T12:07:30.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:30.089+0000 7fe6709ff700 1 -- 172.21.15.45:0/592161801 wait complete. 2023-11-28T12:07:30.108 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-28T12:07:30.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:30.315+0000 7f06247ff700 1 Processor -- start 2023-11-28T12:07:30.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:30.315+0000 7f06247ff700 1 -- start start 2023-11-28T12:07:30.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:30.316+0000 7f06247ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f061c15a760 0x7f061c161200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:30.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:30.316+0000 7f06247ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f061c15dc30 0x7f061c0b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:30.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:30.316+0000 7f06247ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f061c0cd7c0 0x7f061c0cdc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:30.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:30.316+0000 7f06247ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f061c0ce180 con 0x7f061c15dc30 2023-11-28T12:07:30.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:30.316+0000 7f06247ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f061c15ab30 con 0x7f061c15a760 2023-11-28T12:07:30.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:30.316+0000 7f06247ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f061c15e0a0 con 0x7f061c0cd7c0 2023-11-28T12:07:30.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:30.316+0000 7f0621d9a700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f061c15dc30 0x7f061c0b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:30.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:30.317+0000 7f0621d9a700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f061c15dc30 0x7f061c0b4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46460/0 (socket says 172.21.15.45:46460) 2023-11-28T12:07:30.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:30.317+0000 7f0621d9a700 1 -- 172.21.15.45:0/1266744877 learned_addr learned my addr 172.21.15.45:0/1266744877 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:30.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:30.317+0000 7f0622d9c700 1 --2- 172.21.15.45:0/1266744877 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f061c0cd7c0 0x7f061c0cdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:30.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:30.317+0000 7f062259b700 1 --2- 172.21.15.45:0/1266744877 >> v2:172.21.15.152:3300/0 conn(0x7f061c15a760 0x7f061c161200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:30.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:30.317+0000 7f0621d9a700 1 -- 172.21.15.45:0/1266744877 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f061c0cd7c0 msgr2=0x7f061c0cdc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:30.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:30.317+0000 7f0621d9a700 1 --2- 172.21.15.45:0/1266744877 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f061c0cd7c0 0x7f061c0cdc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:30.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:30.317+0000 7f0621d9a700 1 -- 172.21.15.45:0/1266744877 >> v2:172.21.15.152:3300/0 conn(0x7f061c15a760 msgr2=0x7f061c161200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:30.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:30.317+0000 7f0621d9a700 1 --2- 172.21.15.45:0/1266744877 >> v2:172.21.15.152:3300/0 conn(0x7f061c15a760 0x7f061c161200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:30.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:30.317+0000 7f0621d9a700 1 -- 172.21.15.45:0/1266744877 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f061c160d70 con 0x7f061c15dc30 2023-11-28T12:07:30.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:30.317+0000 7f0621d9a700 1 --2- 172.21.15.45:0/1266744877 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f061c15dc30 0x7f061c0b4bf0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f061c08bff0 tx=0x7f060c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6ecc4c4a92405f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:30.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:30.317+0000 7f0621599700 1 -- 172.21.15.45:0/1266744877 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f060c011830 con 0x7f061c15dc30 2023-11-28T12:07:30.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:30.318+0000 7f0621599700 1 -- 172.21.15.45:0/1266744877 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f060c011990 con 0x7f061c15dc30 2023-11-28T12:07:30.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:30.318+0000 7f0621599700 1 -- 172.21.15.45:0/1266744877 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f060c011d20 con 0x7f061c15dc30 2023-11-28T12:07:30.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:30.318+0000 7f06247ff700 1 -- 172.21.15.45:0/1266744877 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f061c15dc30 msgr2=0x7f061c0b4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:30.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:30.318+0000 7f06247ff700 1 --2- 172.21.15.45:0/1266744877 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f061c15dc30 0x7f061c0b4bf0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f061c08bff0 tx=0x7f060c009c00 comp rx=0 tx=0).stop 2023-11-28T12:07:30.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:30.318+0000 7f06247ff700 1 -- 172.21.15.45:0/1266744877 shutdown_connections 2023-11-28T12:07:30.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:30.318+0000 7f06247ff700 1 --2- 172.21.15.45:0/1266744877 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f061c0cd7c0 0x7f061c0cdc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:30.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:30.318+0000 7f06247ff700 1 --2- 172.21.15.45:0/1266744877 >> v2:172.21.15.152:3300/0 conn(0x7f061c15a760 0x7f061c161200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:30.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:30.318+0000 7f06247ff700 1 --2- 172.21.15.45:0/1266744877 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f061c15dc30 0x7f061c0b4bf0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:30.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:30.318+0000 7f06247ff700 1 -- 172.21.15.45:0/1266744877 >> 172.21.15.45:0/1266744877 conn(0x7f061c072620 msgr2=0x7f061c0cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:30.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:30.318+0000 7f06247ff700 1 -- 172.21.15.45:0/1266744877 shutdown_connections 2023-11-28T12:07:30.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:30.318+0000 7f06247ff700 1 -- 172.21.15.45:0/1266744877 wait complete. 2023-11-28T12:07:30.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:30.320+0000 7f06247ff700 1 Processor -- start 2023-11-28T12:07:30.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:30.320+0000 7f06247ff700 1 -- start start 2023-11-28T12:07:30.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:30.321+0000 7f06247ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f061c0cd7c0 0x7f061c154750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:30.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:30.321+0000 7f06247ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f061c15a760 0x7f061c156ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:30.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:30.321+0000 7f06247ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f061c15dc30 0x7f061c158930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:30.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:30.321+0000 7f06247ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f061c155010 con 0x7f061c0cd7c0 2023-11-28T12:07:30.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:30.321+0000 7f06247ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f061c1f2e00 con 0x7f061c15a760 2023-11-28T12:07:30.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:30.321+0000 7f06247ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f061c154d30 con 0x7f061c15dc30 2023-11-28T12:07:30.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:30.321+0000 7f062259b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f061c0cd7c0 0x7f061c154750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:30.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:30.321+0000 7f062259b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f061c0cd7c0 0x7f061c154750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46464/0 (socket says 172.21.15.45:46464) 2023-11-28T12:07:30.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:30.321+0000 7f062259b700 1 -- 172.21.15.45:0/362682972 learned_addr learned my addr 172.21.15.45:0/362682972 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:30.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:30.322+0000 7f0622d9c700 1 --2- 172.21.15.45:0/362682972 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f061c15dc30 0x7f061c158930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:30.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:30.322+0000 7f0621d9a700 1 --2- 172.21.15.45:0/362682972 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f061c15a760 0x7f061c156ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:30.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:30.322+0000 7f062259b700 1 -- 172.21.15.45:0/362682972 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f061c15dc30 msgr2=0x7f061c158930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:30.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:30.322+0000 7f062259b700 1 --2- 172.21.15.45:0/362682972 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f061c15dc30 0x7f061c158930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:30.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:30.322+0000 7f062259b700 1 -- 172.21.15.45:0/362682972 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f061c15a760 msgr2=0x7f061c156ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:30.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:30.322+0000 7f062259b700 1 --2- 172.21.15.45:0/362682972 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f061c15a760 0x7f061c156ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:30.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:30.322+0000 7f062259b700 1 -- 172.21.15.45:0/362682972 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f060c009550 con 0x7f061c0cd7c0 2023-11-28T12:07:30.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:30.322+0000 7f062259b700 1 --2- 172.21.15.45:0/362682972 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f061c0cd7c0 0x7f061c154750 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f061800e9b0 tx=0x7f061800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:30.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:30.322+0000 7f0612ffd700 1 -- 172.21.15.45:0/362682972 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0618009710 con 0x7f061c0cd7c0 2023-11-28T12:07:30.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:30.322+0000 7f0612ffd700 1 -- 172.21.15.45:0/362682972 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f061800c850 con 0x7f061c0cd7c0 2023-11-28T12:07:30.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:30.322+0000 7f0612ffd700 1 -- 172.21.15.45:0/362682972 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f061800cbc0 con 0x7f061c0cd7c0 2023-11-28T12:07:30.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:30.322+0000 7f06247ff700 1 -- 172.21.15.45:0/362682972 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f061c0b5390 con 0x7f061c0cd7c0 2023-11-28T12:07:30.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:30.322+0000 7f06247ff700 1 -- 172.21.15.45:0/362682972 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f061c0b5130 con 0x7f061c0cd7c0 2023-11-28T12:07:30.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:30.323+0000 7f06247ff700 1 -- 172.21.15.45:0/362682972 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f061c0b5670 con 0x7f061c0cd7c0 2023-11-28T12:07:30.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:30.324+0000 7f0612ffd700 1 -- 172.21.15.45:0/362682972 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f0618019030 con 0x7f061c0cd7c0 2023-11-28T12:07:30.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:30.325+0000 7f0612ffd700 1 --2- 172.21.15.45:0/362682972 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f06000682f0 0x7f060006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:30.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:30.325+0000 7f0612ffd700 1 -- 172.21.15.45:0/362682972 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6206+0+0 (secure 0 0 0) 0x7f0618085dd0 con 0x7f061c0cd7c0 2023-11-28T12:07:30.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:30.326+0000 7f0621d9a700 1 --2- 172.21.15.45:0/362682972 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f06000682f0 0x7f060006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:30.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:30.326+0000 7f0621d9a700 1 --2- 172.21.15.45:0/362682972 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f06000682f0 0x7f060006a7a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f060c009870 tx=0x7f060c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:30.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:30.329+0000 7f0612ffd700 1 -- 172.21.15.45:0/362682972 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f06180524b0 con 0x7f061c0cd7c0 2023-11-28T12:07:30.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:30.532+0000 7f06247ff700 1 -- 172.21.15.45:0/362682972 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f061c1f30e0 con 0x7f061c0cd7c0 2023-11-28T12:07:31.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:31.092+0000 7f0612ffd700 1 -- 172.21.15.45:0/362682972 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v24) v1 ==== 181+0+0 (secure 0 0 0) 0x7f06180210d0 con 0x7f061c0cd7c0 2023-11-28T12:07:31.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:31.095+0000 7f06247ff700 1 -- 172.21.15.45:0/362682972 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f06000682f0 msgr2=0x7f060006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:31.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:31.095+0000 7f06247ff700 1 --2- 172.21.15.45:0/362682972 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f06000682f0 0x7f060006a7a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f060c009870 tx=0x7f060c008030 comp rx=0 tx=0).stop 2023-11-28T12:07:31.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:31.095+0000 7f06247ff700 1 -- 172.21.15.45:0/362682972 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f061c0cd7c0 msgr2=0x7f061c154750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:31.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:31.095+0000 7f06247ff700 1 --2- 172.21.15.45:0/362682972 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f061c0cd7c0 0x7f061c154750 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f061800e9b0 tx=0x7f061800ed70 comp rx=0 tx=0).stop 2023-11-28T12:07:31.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:31.095+0000 7f06247ff700 1 -- 172.21.15.45:0/362682972 shutdown_connections 2023-11-28T12:07:31.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:31.095+0000 7f06247ff700 1 --2- 172.21.15.45:0/362682972 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f06000682f0 0x7f060006a7a0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:31.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:31.095+0000 7f06247ff700 1 --2- 172.21.15.45:0/362682972 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f061c15dc30 0x7f061c158930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:31.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:31.095+0000 7f06247ff700 1 --2- 172.21.15.45:0/362682972 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f061c0cd7c0 0x7f061c154750 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:31.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:31.095+0000 7f06247ff700 1 --2- 172.21.15.45:0/362682972 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f061c15a760 0x7f061c156ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:31.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:31.095+0000 7f06247ff700 1 -- 172.21.15.45:0/362682972 >> 172.21.15.45:0/362682972 conn(0x7f061c072620 msgr2=0x7f061c15e230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:31.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:31.095+0000 7f06247ff700 1 -- 172.21.15.45:0/362682972 shutdown_connections 2023-11-28T12:07:31.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:31.095+0000 7f06247ff700 1 -- 172.21.15.45:0/362682972 wait complete. 2023-11-28T12:07:31.097 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' removed 2023-11-28T12:07:31.116 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-28T12:07:31.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:31.326+0000 7f4abb5ff700 1 Processor -- start 2023-11-28T12:07:31.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:31.327+0000 7f4abb5ff700 1 -- start start 2023-11-28T12:07:31.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:31.328+0000 7f4abb5ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4ab415a760 0x7f4ab4161200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:31.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:31.328+0000 7f4abb5ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f4ab40cded0 0x7f4ab40b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:31.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:31.328+0000 7f4abb5ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ab415e0a0 con 0x7f4ab415dc30 2023-11-28T12:07:31.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:31.328+0000 7f4abb5ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ab415ab30 con 0x7f4ab415a760 2023-11-28T12:07:31.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:31.328+0000 7f4abb5ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ab4160d70 con 0x7f4ab40cded0 2023-11-28T12:07:31.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:31.328+0000 7f4ab939b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4ab415a760 0x7f4ab4161200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:31.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:31.328+0000 7f4ab939b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4ab415a760 0x7f4ab4161200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46468/0 (socket says 172.21.15.45:46468) 2023-11-28T12:07:31.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:31.328+0000 7f4ab939b700 1 -- 172.21.15.45:0/3839947408 learned_addr learned my addr 172.21.15.45:0/3839947408 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:31.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:31.328+0000 7f4ab9b9c700 1 --2- 172.21.15.45:0/3839947408 >> v2:172.21.15.152:3300/0 conn(0x7f4ab40cded0 0x7f4ab40b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:31.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:31.329+0000 7f4ab939b700 1 -- 172.21.15.45:0/3839947408 >> v2:172.21.15.152:3300/0 conn(0x7f4ab40cded0 msgr2=0x7f4ab40b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:31.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:31.329+0000 7f4ab939b700 1 --2- 172.21.15.45:0/3839947408 >> v2:172.21.15.152:3300/0 conn(0x7f4ab40cded0 0x7f4ab40b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:31.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:31.329+0000 7f4ab939b700 1 -- 172.21.15.45:0/3839947408 >> v1:172.21.15.152:6789/0 conn(0x7f4ab415dc30 legacy=0x7f4ab40cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:31.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:31.329+0000 7f4ab939b700 1 -- 172.21.15.45:0/3839947408 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ab40b5130 con 0x7f4ab415a760 2023-11-28T12:07:31.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:31.329+0000 7f4ab939b700 1 --2- 172.21.15.45:0/3839947408 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ab415a760 0x7f4ab4161200 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f4ab4067500 tx=0x7f4ab0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4de897f40aff1f0b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:31.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:31.329+0000 7f4aabfff700 1 -- 172.21.15.45:0/3839947408 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab0004230 con 0x7f4ab415a760 2023-11-28T12:07:31.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:31.329+0000 7f4aabfff700 1 -- 172.21.15.45:0/3839947408 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ab0004390 con 0x7f4ab415a760 2023-11-28T12:07:31.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:31.329+0000 7f4aabfff700 1 -- 172.21.15.45:0/3839947408 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab00036a0 con 0x7f4ab415a760 2023-11-28T12:07:31.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:31.330+0000 7f4abb5ff700 1 -- 172.21.15.45:0/3839947408 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ab415a760 msgr2=0x7f4ab4161200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:31.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:31.330+0000 7f4abb5ff700 1 --2- 172.21.15.45:0/3839947408 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ab415a760 0x7f4ab4161200 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f4ab4067500 tx=0x7f4ab0009bd0 comp rx=0 tx=0).stop 2023-11-28T12:07:31.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:31.330+0000 7f4abb5ff700 1 -- 172.21.15.45:0/3839947408 shutdown_connections 2023-11-28T12:07:31.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:31.330+0000 7f4abb5ff700 1 --2- 172.21.15.45:0/3839947408 >> v2:172.21.15.152:3300/0 conn(0x7f4ab40cded0 0x7f4ab40b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:31.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:31.330+0000 7f4abb5ff700 1 --2- 172.21.15.45:0/3839947408 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ab415a760 0x7f4ab4161200 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:31.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:31.330+0000 7f4abb5ff700 1 -- 172.21.15.45:0/3839947408 >> 172.21.15.45:0/3839947408 conn(0x7f4ab4072620 msgr2=0x7f4ab40cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:31.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:31.330+0000 7f4abb5ff700 1 -- 172.21.15.45:0/3839947408 shutdown_connections 2023-11-28T12:07:31.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:31.330+0000 7f4abb5ff700 1 -- 172.21.15.45:0/3839947408 wait complete. 2023-11-28T12:07:31.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:31.332+0000 7f4abb5ff700 1 Processor -- start 2023-11-28T12:07:31.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:31.332+0000 7f4abb5ff700 1 -- start start 2023-11-28T12:07:31.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:31.333+0000 7f4abb5ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4ab40cded0 0x7f4ab40b68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:31.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:31.333+0000 7f4abb5ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ab415a760 0x7f4ab41f1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:31.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:31.333+0000 7f4abb5ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4ab415dc30 0x7f4ab40b8410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:31.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:31.333+0000 7f4abb5ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab40cbd40 con 0x7f4ab415a760 2023-11-28T12:07:31.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:31.333+0000 7f4abb5ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab40cc020 con 0x7f4ab40cded0 2023-11-28T12:07:31.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:31.333+0000 7f4abb5ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab40cc300 con 0x7f4ab415dc30 2023-11-28T12:07:31.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:31.333+0000 7f4ab8b9a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ab415a760 0x7f4ab41f1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:31.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:31.333+0000 7f4ab8b9a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ab415a760 0x7f4ab41f1c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46476/0 (socket says 172.21.15.45:46476) 2023-11-28T12:07:31.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:31.333+0000 7f4ab8b9a700 1 -- 172.21.15.45:0/883477833 learned_addr learned my addr 172.21.15.45:0/883477833 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:31.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:31.333+0000 7f4ab939b700 1 --2- 172.21.15.45:0/883477833 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4ab40cded0 0x7f4ab40b68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:31.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:31.333+0000 7f4ab9b9c700 1 --2- 172.21.15.45:0/883477833 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4ab415dc30 0x7f4ab40b8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:31.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:31.334+0000 7f4ab8b9a700 1 -- 172.21.15.45:0/883477833 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4ab415dc30 msgr2=0x7f4ab40b8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:31.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:31.334+0000 7f4ab8b9a700 1 --2- 172.21.15.45:0/883477833 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4ab415dc30 0x7f4ab40b8410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:31.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:31.334+0000 7f4ab8b9a700 1 -- 172.21.15.45:0/883477833 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4ab40cded0 msgr2=0x7f4ab40b68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:31.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:31.334+0000 7f4ab8b9a700 1 --2- 172.21.15.45:0/883477833 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4ab40cded0 0x7f4ab40b68b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:31.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:31.334+0000 7f4ab8b9a700 1 -- 172.21.15.45:0/883477833 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ab0009550 con 0x7f4ab415a760 2023-11-28T12:07:31.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:31.334+0000 7f4ab939b700 1 --2- 172.21.15.45:0/883477833 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4ab40cded0 0x7f4ab40b68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:07:31.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:31.334+0000 7f4ab9b9c700 1 --2- 172.21.15.45:0/883477833 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4ab415dc30 0x7f4ab40b8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:07:31.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:31.334+0000 7f4ab8b9a700 1 --2- 172.21.15.45:0/883477833 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ab415a760 0x7f4ab41f1c50 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f4aa400b4a0 tx=0x7f4aa400b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:31.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:31.334+0000 7f4aa9ffb700 1 -- 172.21.15.45:0/883477833 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa4011830 con 0x7f4ab415a760 2023-11-28T12:07:31.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:31.334+0000 7f4aa9ffb700 1 -- 172.21.15.45:0/883477833 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aa4011990 con 0x7f4ab415a760 2023-11-28T12:07:31.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:31.334+0000 7f4aa9ffb700 1 -- 172.21.15.45:0/883477833 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa4011d40 con 0x7f4ab415a760 2023-11-28T12:07:31.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:31.334+0000 7f4abb5ff700 1 -- 172.21.15.45:0/883477833 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ab40b5670 con 0x7f4ab415a760 2023-11-28T12:07:31.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:31.334+0000 7f4abb5ff700 1 -- 172.21.15.45:0/883477833 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ab40b5390 con 0x7f4ab415a760 2023-11-28T12:07:31.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:31.335+0000 7f4abb5ff700 1 -- 172.21.15.45:0/883477833 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ab4160720 con 0x7f4ab415a760 2023-11-28T12:07:31.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:31.336+0000 7f4aa9ffb700 1 -- 172.21.15.45:0/883477833 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f4aa400f050 con 0x7f4ab415a760 2023-11-28T12:07:31.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:31.337+0000 7f4aa9ffb700 1 --2- 172.21.15.45:0/883477833 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f4a980682f0 0x7f4a9806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:31.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:31.337+0000 7f4aa9ffb700 1 -- 172.21.15.45:0/883477833 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5768+0+0 (secure 0 0 0) 0x7f4aa40857e0 con 0x7f4ab415a760 2023-11-28T12:07:31.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:31.338+0000 7f4ab939b700 1 --2- 172.21.15.45:0/883477833 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f4a980682f0 0x7f4a9806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:31.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:31.338+0000 7f4ab939b700 1 --2- 172.21.15.45:0/883477833 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f4a980682f0 0x7f4a9806a7a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4ab0009130 tx=0x7f4ab0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:31.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:31.341+0000 7f4aa9ffb700 1 -- 172.21.15.45:0/883477833 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f4aa4052070 con 0x7f4ab415a760 2023-11-28T12:07:31.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:31.549+0000 7f4abb5ff700 1 -- 172.21.15.45:0/883477833 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4ab40ccb00 con 0x7f4ab415a760 2023-11-28T12:07:32.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:32.094+0000 7f4aa9ffb700 1 -- 172.21.15.45:0/883477833 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v25) v1 ==== 169+0+0 (secure 0 0 0) 0x7f4ab40ccb00 con 0x7f4ab415a760 2023-11-28T12:07:32.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:32.100+0000 7f4abb5ff700 1 -- 172.21.15.45:0/883477833 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f4a980682f0 msgr2=0x7f4a9806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:32.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:32.100+0000 7f4abb5ff700 1 --2- 172.21.15.45:0/883477833 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f4a980682f0 0x7f4a9806a7a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4ab0009130 tx=0x7f4ab0008030 comp rx=0 tx=0).stop 2023-11-28T12:07:32.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:32.100+0000 7f4abb5ff700 1 -- 172.21.15.45:0/883477833 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ab415a760 msgr2=0x7f4ab41f1c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:32.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:32.100+0000 7f4abb5ff700 1 --2- 172.21.15.45:0/883477833 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ab415a760 0x7f4ab41f1c50 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f4aa400b4a0 tx=0x7f4aa400b860 comp rx=0 tx=0).stop 2023-11-28T12:07:32.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:32.101+0000 7f4abb5ff700 1 -- 172.21.15.45:0/883477833 shutdown_connections 2023-11-28T12:07:32.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:32.101+0000 7f4abb5ff700 1 --2- 172.21.15.45:0/883477833 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f4a980682f0 0x7f4a9806a7a0 secure :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4ab0009130 tx=0x7f4ab0008030 comp rx=0 tx=0).stop 2023-11-28T12:07:32.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:32.101+0000 7f4abb5ff700 1 --2- 172.21.15.45:0/883477833 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4ab40cded0 0x7f4ab40b68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:32.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:32.101+0000 7f4abb5ff700 1 --2- 172.21.15.45:0/883477833 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4ab415dc30 0x7f4ab40b8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:32.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:32.101+0000 7f4abb5ff700 1 --2- 172.21.15.45:0/883477833 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ab415a760 0x7f4ab41f1c50 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:32.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:32.101+0000 7f4abb5ff700 1 -- 172.21.15.45:0/883477833 >> 172.21.15.45:0/883477833 conn(0x7f4ab4072620 msgr2=0x7f4ab406a900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:32.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:32.102+0000 7f4abb5ff700 1 -- 172.21.15.45:0/883477833 shutdown_connections 2023-11-28T12:07:32.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:32.103+0000 7f4abb5ff700 1 -- 172.21.15.45:0/883477833 wait complete. 2023-11-28T12:07:32.105 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' removed 2023-11-28T12:07:32.127 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-28T12:07:32.127 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-28T12:07:32.127 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-28T12:07:32.128 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T12:07:32.128 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-28T12:07:32.128 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-28T12:07:32.128 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-28T12:07:32.128 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T12:07:32.128 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-28T12:07:32.128 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-28T12:07:32.129 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-28T12:07:32.129 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T12:07:32.129 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-28T12:07:32.129 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-28T12:07:32.130 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-28T12:07:32.130 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T12:07:32.143 INFO:tasks.ceph.mds.c:Stopped 2023-11-28T12:07:32.143 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-28T12:07:32.144 INFO:tasks.ceph.mds.a:Stopped 2023-11-28T12:07:32.144 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-28T12:07:32.153 INFO:tasks.ceph.mds.b:Stopped 2023-11-28T12:07:32.153 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-28T12:07:32.154 INFO:tasks.ceph.mds.d:Stopped 2023-11-28T12:07:32.154 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-28T12:07:32.188 INFO:tasks.ceph.mds.c:Started 2023-11-28T12:07:32.188 DEBUG:teuthology.parallel:result is None 2023-11-28T12:07:32.190 INFO:tasks.ceph.mds.a:Started 2023-11-28T12:07:32.191 DEBUG:teuthology.parallel:result is None 2023-11-28T12:07:32.197 INFO:tasks.ceph.mds.b:Started 2023-11-28T12:07:32.198 DEBUG:teuthology.parallel:result is None 2023-11-28T12:07:32.200 INFO:tasks.ceph.mds.d:Started 2023-11-28T12:07:32.201 DEBUG:teuthology.parallel:result is None 2023-11-28T12:07:32.201 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-28T12:07:32.341 INFO:tasks.ceph.mds.c.smithi045.stdout:starting mds.c at 2023-11-28T12:07:32.342 INFO:tasks.ceph.mds.a.smithi045.stdout:starting mds.a at 2023-11-28T12:07:32.349 INFO:tasks.ceph.mds.d.smithi152.stdout:starting mds.d at 2023-11-28T12:07:32.349 INFO:tasks.ceph.mds.b.smithi152.stdout:starting mds.b at 2023-11-28T12:07:32.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:32.426+0000 7fe5971ff700 1 Processor -- start 2023-11-28T12:07:32.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:32.427+0000 7fe5971ff700 1 -- start start 2023-11-28T12:07:32.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:32.428+0000 7fe5971ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe590161340 0x7fe5900d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:32.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:32.428+0000 7fe5971ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5900d1950 con 0x7fe5900d2320 2023-11-28T12:07:32.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:32.428+0000 7fe5971ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5900b5520 con 0x7fe59015c9b0 2023-11-28T12:07:32.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:32.428+0000 7fe5971ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5900b5800 con 0x7fe590161340 2023-11-28T12:07:32.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:32.428+0000 7fe59579c700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fe5900d2320 0x7fe5900cd7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41246/0 (socket says 172.21.15.45:41246) 2023-11-28T12:07:32.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:32.428+0000 7fe59579c700 1 -- 172.21.15.45:0/1168425416 learned_addr learned my addr 172.21.15.45:0/1168425416 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:07:32.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:32.428+0000 7fe58ffff700 1 --2- 172.21.15.45:0/1168425416 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe590161340 0x7fe5900d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:32.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:32.428+0000 7fe58f7fe700 1 -- 172.21.15.45:0/1168425416 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4276846654 0 0) 0x7fe5900d1950 con 0x7fe5900d2320 2023-11-28T12:07:32.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:32.429+0000 7fe58f7fe700 1 -- 172.21.15.45:0/1168425416 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5800035b0 con 0x7fe5900d2320 2023-11-28T12:07:32.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:32.429+0000 7fe58f7fe700 1 -- 172.21.15.45:0/1168425416 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 501731392 0 0) 0x7fe5900b5520 con 0x7fe59015c9b0 2023-11-28T12:07:32.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:32.429+0000 7fe58f7fe700 1 -- 172.21.15.45:0/1168425416 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5900d1950 con 0x7fe59015c9b0 2023-11-28T12:07:32.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:32.429+0000 7fe58ffff700 1 -- 172.21.15.45:0/1168425416 >> v1:172.21.15.152:6789/0 conn(0x7fe59015c9b0 legacy=0x7fe5900b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:32.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:32.429+0000 7fe58ffff700 1 -- 172.21.15.45:0/1168425416 >> v1:172.21.15.45:6789/0 conn(0x7fe5900d2320 legacy=0x7fe5900cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:32.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:32.429+0000 7fe58ffff700 1 -- 172.21.15.45:0/1168425416 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5900d1300 con 0x7fe590161340 2023-11-28T12:07:32.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:32.429+0000 7fe58ffff700 1 --2- 172.21.15.45:0/1168425416 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe590161340 0x7fe5900d1de0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe57c009870 tx=0x7fe57c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ea0b684b7db42ed server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:32.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:32.429+0000 7fe58f7fe700 1 -- 172.21.15.45:0/1168425416 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe57c011830 con 0x7fe590161340 2023-11-28T12:07:32.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:32.429+0000 7fe58f7fe700 1 -- 172.21.15.45:0/1168425416 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe57c011990 con 0x7fe590161340 2023-11-28T12:07:32.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:32.429+0000 7fe58f7fe700 1 -- 172.21.15.45:0/1168425416 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe57c011d20 con 0x7fe590161340 2023-11-28T12:07:32.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:32.430+0000 7fe5971ff700 1 -- 172.21.15.45:0/1168425416 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe590161340 msgr2=0x7fe5900d1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:32.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:32.430+0000 7fe5971ff700 1 --2- 172.21.15.45:0/1168425416 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe590161340 0x7fe5900d1de0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe57c009870 tx=0x7fe57c009b80 comp rx=0 tx=0).stop 2023-11-28T12:07:32.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:32.430+0000 7fe5971ff700 1 -- 172.21.15.45:0/1168425416 shutdown_connections 2023-11-28T12:07:32.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:32.430+0000 7fe5971ff700 1 --2- 172.21.15.45:0/1168425416 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe590161340 0x7fe5900d1de0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:32.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:32.430+0000 7fe5971ff700 1 -- 172.21.15.45:0/1168425416 >> 172.21.15.45:0/1168425416 conn(0x7fe590072600 msgr2=0x7fe5900cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:32.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:32.430+0000 7fe5971ff700 1 -- 172.21.15.45:0/1168425416 shutdown_connections 2023-11-28T12:07:32.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:32.430+0000 7fe5971ff700 1 -- 172.21.15.45:0/1168425416 wait complete. 2023-11-28T12:07:32.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:32.432+0000 7fe5971ff700 1 Processor -- start 2023-11-28T12:07:32.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:32.432+0000 7fe5971ff700 1 -- start start 2023-11-28T12:07:32.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:32.433+0000 7fe5971ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe5900d2320 0x7fe5901569b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:32.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:32.433+0000 7fe5971ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe59015c9b0 0x7fe5900c8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:32.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:32.433+0000 7fe5971ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe590161340 0x7fe5901f2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:32.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:32.433+0000 7fe5971ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5900c7660 con 0x7fe590161340 2023-11-28T12:07:32.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:32.433+0000 7fe5971ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5901596e0 con 0x7fe59015c9b0 2023-11-28T12:07:32.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:32.433+0000 7fe5971ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5900c7850 con 0x7fe5900d2320 2023-11-28T12:07:32.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:32.433+0000 7fe59579c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe590161340 0x7fe5901f2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:32.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:32.433+0000 7fe59579c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe590161340 0x7fe5901f2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47370/0 (socket says 172.21.15.45:47370) 2023-11-28T12:07:32.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:32.433+0000 7fe59579c700 1 -- 172.21.15.45:0/2495248031 learned_addr learned my addr 172.21.15.45:0/2495248031 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:32.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:32.433+0000 7fe58ffff700 1 --2- 172.21.15.45:0/2495248031 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe59015c9b0 0x7fe5900c8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:32.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:32.433+0000 7fe594f9b700 1 --2- 172.21.15.45:0/2495248031 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe5900d2320 0x7fe5901569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:32.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:32.434+0000 7fe59579c700 1 -- 172.21.15.45:0/2495248031 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe5900d2320 msgr2=0x7fe5901569b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:32.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:32.434+0000 7fe59579c700 1 --2- 172.21.15.45:0/2495248031 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe5900d2320 0x7fe5901569b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:32.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:32.434+0000 7fe59579c700 1 -- 172.21.15.45:0/2495248031 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe59015c9b0 msgr2=0x7fe5900c8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:32.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:32.434+0000 7fe59579c700 1 --2- 172.21.15.45:0/2495248031 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe59015c9b0 0x7fe5900c8330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:32.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:32.434+0000 7fe59579c700 1 -- 172.21.15.45:0/2495248031 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe57c0094a0 con 0x7fe590161340 2023-11-28T12:07:32.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:32.434+0000 7fe59579c700 1 --2- 172.21.15.45:0/2495248031 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe590161340 0x7fe5901f2950 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fe58800caf0 tx=0x7fe58800ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:32.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:32.434+0000 7fe58d7fa700 1 -- 172.21.15.45:0/2495248031 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe58800a9e0 con 0x7fe590161340 2023-11-28T12:07:32.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:32.434+0000 7fe58d7fa700 1 -- 172.21.15.45:0/2495248031 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe58800ab40 con 0x7fe590161340 2023-11-28T12:07:32.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:32.434+0000 7fe5971ff700 1 -- 172.21.15.45:0/2495248031 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe59015cd80 con 0x7fe590161340 2023-11-28T12:07:32.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:32.434+0000 7fe58d7fa700 1 -- 172.21.15.45:0/2495248031 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe588012400 con 0x7fe590161340 2023-11-28T12:07:32.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:32.434+0000 7fe5971ff700 1 -- 172.21.15.45:0/2495248031 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5900d15e0 con 0x7fe590161340 2023-11-28T12:07:32.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:32.435+0000 7fe5971ff700 1 -- 172.21.15.45:0/2495248031 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe59015cf10 con 0x7fe590161340 2023-11-28T12:07:32.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:32.436+0000 7fe58d7fa700 1 -- 172.21.15.45:0/2495248031 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fe588019030 con 0x7fe590161340 2023-11-28T12:07:32.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:32.438+0000 7fe58d7fa700 1 --2- 172.21.15.45:0/2495248031 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fe5740682f0 0x7fe57406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:32.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:32.438+0000 7fe58d7fa700 1 -- 172.21.15.45:0/2495248031 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fe5880855a0 con 0x7fe590161340 2023-11-28T12:07:32.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:32.438+0000 7fe594f9b700 1 --2- 172.21.15.45:0/2495248031 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fe5740682f0 0x7fe57406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:32.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:32.439+0000 7fe594f9b700 1 --2- 172.21.15.45:0/2495248031 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fe5740682f0 0x7fe57406a7a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe5840011e0 tx=0x7fe584009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:32.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:32.441+0000 7fe58d7fa700 1 -- 172.21.15.45:0/2495248031 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fe588051fb0 con 0x7fe590161340 2023-11-28T12:07:32.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:32.659+0000 7fe5971ff700 1 -- 172.21.15.45:0/2495248031 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fe5900745c0 con 0x7fe590161340 2023-11-28T12:07:33.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:33.385+0000 7fe58d7fa700 1 -- 172.21.15.45:0/2495248031 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v30) v1 ==== 97+0+0 (secure 0 0 0) 0x7fe5880555d0 con 0x7fe590161340 2023-11-28T12:07:33.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:33.388+0000 7fe5971ff700 1 -- 172.21.15.45:0/2495248031 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fe5740682f0 msgr2=0x7fe57406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:33.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:33.388+0000 7fe5971ff700 1 --2- 172.21.15.45:0/2495248031 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fe5740682f0 0x7fe57406a7a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe5840011e0 tx=0x7fe584009040 comp rx=0 tx=0).stop 2023-11-28T12:07:33.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:33.388+0000 7fe5971ff700 1 -- 172.21.15.45:0/2495248031 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe590161340 msgr2=0x7fe5901f2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:33.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:33.388+0000 7fe5971ff700 1 --2- 172.21.15.45:0/2495248031 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe590161340 0x7fe5901f2950 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fe58800caf0 tx=0x7fe58800ce00 comp rx=0 tx=0).stop 2023-11-28T12:07:33.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:33.388+0000 7fe5971ff700 1 -- 172.21.15.45:0/2495248031 shutdown_connections 2023-11-28T12:07:33.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:33.388+0000 7fe5971ff700 1 --2- 172.21.15.45:0/2495248031 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fe5740682f0 0x7fe57406a7a0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:33.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:33.388+0000 7fe5971ff700 1 --2- 172.21.15.45:0/2495248031 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe590161340 0x7fe5901f2950 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:33.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:33.388+0000 7fe5971ff700 1 --2- 172.21.15.45:0/2495248031 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe5900d2320 0x7fe5901569b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:33.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:33.388+0000 7fe5971ff700 1 --2- 172.21.15.45:0/2495248031 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe59015c9b0 0x7fe5900c8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:33.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:33.388+0000 7fe5971ff700 1 -- 172.21.15.45:0/2495248031 >> 172.21.15.45:0/2495248031 conn(0x7fe590072600 msgr2=0x7fe5900b6e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:33.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:33.389+0000 7fe5971ff700 1 -- 172.21.15.45:0/2495248031 shutdown_connections 2023-11-28T12:07:33.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:33.389+0000 7fe5971ff700 1 -- 172.21.15.45:0/2495248031 wait complete. 2023-11-28T12:07:33.392 INFO:teuthology.orchestra.run.smithi045.stderr: removed all blocklist entries 2023-11-28T12:07:33.410 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-28T12:07:33.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:33.617+0000 7f760edff700 1 Processor -- start 2023-11-28T12:07:33.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:33.617+0000 7f760edff700 1 -- start start 2023-11-28T12:07:33.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:33.618+0000 7f760edff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f76080d01b0 0x7f76080d0c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:33.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:33.618+0000 7f760edff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f76080b16d0 0x7f76080d1160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:33.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:33.618+0000 7f760edff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76080b0230 con 0x7f76080b20b0 2023-11-28T12:07:33.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:33.618+0000 7f760edff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f760815cec0 con 0x7f76080d01b0 2023-11-28T12:07:33.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:33.618+0000 7f760edff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76080b4570 con 0x7f76080b16d0 2023-11-28T12:07:33.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:33.618+0000 7f760cb9b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f76080d01b0 0x7f76080d0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:33.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:33.618+0000 7f760cb9b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f76080d01b0 0x7f76080d0c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47382/0 (socket says 172.21.15.45:47382) 2023-11-28T12:07:33.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:33.618+0000 7f760cb9b700 1 -- 172.21.15.45:0/2353952658 learned_addr learned my addr 172.21.15.45:0/2353952658 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:33.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:33.619+0000 7f760d39c700 1 --2- 172.21.15.45:0/2353952658 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f76080b16d0 0x7f76080d1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:33.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:33.619+0000 7f760cb9b700 1 -- 172.21.15.45:0/2353952658 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f76080b16d0 msgr2=0x7f76080d1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:33.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:33.619+0000 7f760cb9b700 1 --2- 172.21.15.45:0/2353952658 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f76080b16d0 0x7f76080d1160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:33.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:33.619+0000 7f760cb9b700 1 -- 172.21.15.45:0/2353952658 >> v1:172.21.15.152:6789/0 conn(0x7f76080b20b0 legacy=0x7f76080b29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:33.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:33.619+0000 7f760cb9b700 1 -- 172.21.15.45:0/2353952658 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76080b4850 con 0x7f76080d01b0 2023-11-28T12:07:33.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:33.619+0000 7f760cb9b700 1 --2- 172.21.15.45:0/2353952658 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76080d01b0 0x7f76080d0c20 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f75fc0098f0 tx=0x7f75fc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa37b3fbb536b6b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:33.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:33.619+0000 7f76077fe700 1 -- 172.21.15.45:0/2353952658 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75fc00b8a0 con 0x7f76080d01b0 2023-11-28T12:07:33.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:33.619+0000 7f76077fe700 1 -- 172.21.15.45:0/2353952658 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75fc00ba00 con 0x7f76080d01b0 2023-11-28T12:07:33.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:33.619+0000 7f76077fe700 1 -- 172.21.15.45:0/2353952658 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75fc00bd90 con 0x7f76080d01b0 2023-11-28T12:07:33.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:33.620+0000 7f760edff700 1 -- 172.21.15.45:0/2353952658 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76080d01b0 msgr2=0x7f76080d0c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:33.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:33.620+0000 7f760edff700 1 --2- 172.21.15.45:0/2353952658 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76080d01b0 0x7f76080d0c20 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f75fc0098f0 tx=0x7f75fc009c00 comp rx=0 tx=0).stop 2023-11-28T12:07:33.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:33.620+0000 7f760edff700 1 -- 172.21.15.45:0/2353952658 shutdown_connections 2023-11-28T12:07:33.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:33.620+0000 7f760edff700 1 --2- 172.21.15.45:0/2353952658 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f76080b16d0 0x7f76080d1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:33.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:33.620+0000 7f760edff700 1 --2- 172.21.15.45:0/2353952658 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76080d01b0 0x7f76080d0c20 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:33.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:33.620+0000 7f760edff700 1 -- 172.21.15.45:0/2353952658 >> 172.21.15.45:0/2353952658 conn(0x7f760809c3f0 msgr2=0x7f76080d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:33.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:33.620+0000 7f760edff700 1 -- 172.21.15.45:0/2353952658 shutdown_connections 2023-11-28T12:07:33.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:33.620+0000 7f760edff700 1 -- 172.21.15.45:0/2353952658 wait complete. 2023-11-28T12:07:33.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:33.622+0000 7f760edff700 1 Processor -- start 2023-11-28T12:07:33.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:33.622+0000 7f760edff700 1 -- start start 2023-11-28T12:07:33.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:33.623+0000 7f760edff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76080b16d0 0x7f76080ca120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:33.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:33.623+0000 7f760edff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76080b20b0 0x7f76081f59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:33.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:33.623+0000 7f760edff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f76080d01b0 0x7f76081f5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:33.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:33.623+0000 7f760edff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76081e44d0 con 0x7f76080b16d0 2023-11-28T12:07:33.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:33.623+0000 7f760edff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76081e6cb0 con 0x7f76080b20b0 2023-11-28T12:07:33.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:33.623+0000 7f760edff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76080ca660 con 0x7f76080d01b0 2023-11-28T12:07:33.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:33.623+0000 7f760cb9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76080b16d0 0x7f76080ca120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:33.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:33.623+0000 7f760cb9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76080b16d0 0x7f76080ca120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47394/0 (socket says 172.21.15.45:47394) 2023-11-28T12:07:33.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:33.623+0000 7f760cb9b700 1 -- 172.21.15.45:0/2735937998 learned_addr learned my addr 172.21.15.45:0/2735937998 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:33.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:33.623+0000 7f7607fff700 1 --2- 172.21.15.45:0/2735937998 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76080b20b0 0x7f76081f59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:33.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:33.623+0000 7f760d39c700 1 --2- 172.21.15.45:0/2735937998 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f76080d01b0 0x7f76081f5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:33.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:33.624+0000 7f760cb9b700 1 -- 172.21.15.45:0/2735937998 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f76080d01b0 msgr2=0x7f76081f5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:33.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:33.624+0000 7f760cb9b700 1 --2- 172.21.15.45:0/2735937998 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f76080d01b0 0x7f76081f5ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:33.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:33.624+0000 7f760cb9b700 1 -- 172.21.15.45:0/2735937998 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76080b20b0 msgr2=0x7f76081f59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:33.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:33.624+0000 7f760cb9b700 1 --2- 172.21.15.45:0/2735937998 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76080b20b0 0x7f76081f59b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:33.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:33.624+0000 7f760cb9b700 1 -- 172.21.15.45:0/2735937998 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75fc009550 con 0x7f76080b16d0 2023-11-28T12:07:33.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:33.624+0000 7f7607fff700 1 --2- 172.21.15.45:0/2735937998 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76080b20b0 0x7f76081f59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:07:33.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:33.624+0000 7f760cb9b700 1 --2- 172.21.15.45:0/2735937998 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76080b16d0 0x7f76080ca120 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f75fc009c40 tx=0x7f75fc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:33.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:33.624+0000 7f76057fa700 1 -- 172.21.15.45:0/2735937998 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75fc004590 con 0x7f76080b16d0 2023-11-28T12:07:33.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:33.624+0000 7f76057fa700 1 -- 172.21.15.45:0/2735937998 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75fc01e070 con 0x7f76080b16d0 2023-11-28T12:07:33.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:33.624+0000 7f760edff700 1 -- 172.21.15.45:0/2735937998 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76080afec0 con 0x7f76080b16d0 2023-11-28T12:07:33.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:33.624+0000 7f76057fa700 1 -- 172.21.15.45:0/2735937998 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75fc0038e0 con 0x7f76080b16d0 2023-11-28T12:07:33.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:33.624+0000 7f760edff700 1 -- 172.21.15.45:0/2735937998 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76080afbe0 con 0x7f76080b16d0 2023-11-28T12:07:33.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:33.625+0000 7f760edff700 1 -- 172.21.15.45:0/2735937998 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76080b2600 con 0x7f76080b16d0 2023-11-28T12:07:33.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:33.626+0000 7f76057fa700 1 -- 172.21.15.45:0/2735937998 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f75fc00f050 con 0x7f76080b16d0 2023-11-28T12:07:33.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:33.628+0000 7f76057fa700 1 --2- 172.21.15.45:0/2735937998 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f75ec0682f0 0x7f75ec06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:33.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:33.628+0000 7f76057fa700 1 -- 172.21.15.45:0/2735937998 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f75fc020070 con 0x7f76080b16d0 2023-11-28T12:07:33.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:33.629+0000 7f7607fff700 1 --2- 172.21.15.45:0/2735937998 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f75ec0682f0 0x7f75ec06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:33.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:33.630+0000 7f7607fff700 1 --2- 172.21.15.45:0/2735937998 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f75ec0682f0 0x7f75ec06a7a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f76081f6ab0 tx=0x7f75f4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:33.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:33.632+0000 7f76057fa700 1 -- 172.21.15.45:0/2735937998 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f75fc0539e0 con 0x7f76080b16d0 2023-11-28T12:07:33.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:33.916+0000 7f760edff700 1 -- 172.21.15.45:0/2735937998 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f7608068690 con 0x7f76080b16d0 2023-11-28T12:07:33.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:33.916+0000 7f76057fa700 1 -- 172.21.15.45:0/2735937998 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f75fc057000 con 0x7f76080b16d0 2023-11-28T12:07:33.917 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:07:33.917 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-11-28T12:07:33.917 INFO:teuthology.orchestra.run.smithi045.stdout: "auth_dump": [ 2023-11-28T12:07:33.918 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T12:07:33.918 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.a", 2023-11-28T12:07:33.918 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQCN12VlhJ1iEBAAPwejLipJZQnV/6P7L6lA8g==", 2023-11-28T12:07:33.918 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T12:07:33.918 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-11-28T12:07:33.919 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-11-28T12:07:33.919 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-11-28T12:07:33.919 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-11-28T12:07:33.919 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T12:07:33.919 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T12:07:33.919 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T12:07:33.920 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.b", 2023-11-28T12:07:33.920 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQCN12Vlr6poKRAAtFhus9UGFZrdPX+6WU116A==", 2023-11-28T12:07:33.920 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T12:07:33.920 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-11-28T12:07:33.920 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-11-28T12:07:33.921 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-11-28T12:07:33.921 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-11-28T12:07:33.921 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T12:07:33.922 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T12:07:33.922 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T12:07:33.922 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.c", 2023-11-28T12:07:33.922 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQCN12Vlaxs2HRAA/rYFx19h5UmFvkpiAxDjKg==", 2023-11-28T12:07:33.923 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T12:07:33.923 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-11-28T12:07:33.923 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-11-28T12:07:33.923 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-11-28T12:07:33.923 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-11-28T12:07:33.924 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T12:07:33.924 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T12:07:33.924 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T12:07:33.924 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.d", 2023-11-28T12:07:33.924 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQCN12Vl46tjNRAA367PN+mS4wxerzI5vuXgCA==", 2023-11-28T12:07:33.924 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T12:07:33.925 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-11-28T12:07:33.925 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-11-28T12:07:33.925 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-11-28T12:07:33.925 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-11-28T12:07:33.925 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T12:07:33.926 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T12:07:33.926 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T12:07:33.926 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.0", 2023-11-28T12:07:33.926 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQCQ12Vl8522AhAAJv4sFjazwIQ5obUUGqgJ+g==", 2023-11-28T12:07:33.927 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T12:07:33.927 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-11-28T12:07:33.927 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-11-28T12:07:33.927 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-11-28T12:07:33.927 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T12:07:33.927 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T12:07:33.927 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T12:07:33.927 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.1", 2023-11-28T12:07:33.927 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQCT12VlPhVZCBAAS04ENEYS51RMXl904XaeNQ==", 2023-11-28T12:07:33.927 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T12:07:33.927 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-11-28T12:07:33.928 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-11-28T12:07:33.928 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-11-28T12:07:33.928 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T12:07:33.928 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T12:07:33.928 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T12:07:33.928 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.2", 2023-11-28T12:07:33.928 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQCW12Vl5RaxDBAA3n4GyG47l/H5wINInjSqWQ==", 2023-11-28T12:07:33.928 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T12:07:33.928 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-11-28T12:07:33.928 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-11-28T12:07:33.928 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-11-28T12:07:33.928 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T12:07:33.929 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T12:07:33.929 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T12:07:33.929 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.3", 2023-11-28T12:07:33.929 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQCZ12VloTQ4EBAAU8iRvrISZn7x8FfYJj6vOA==", 2023-11-28T12:07:33.929 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T12:07:33.929 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-11-28T12:07:33.929 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-11-28T12:07:33.930 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-11-28T12:07:33.930 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T12:07:33.930 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T12:07:33.930 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T12:07:33.931 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.4", 2023-11-28T12:07:33.931 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQCf12VlJs4aKxAA75OrLomZU+ZLWe6qj+CoJw==", 2023-11-28T12:07:33.931 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T12:07:33.931 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-11-28T12:07:33.931 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-11-28T12:07:33.931 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-11-28T12:07:33.931 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T12:07:33.932 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T12:07:33.932 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T12:07:33.932 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.5", 2023-11-28T12:07:33.932 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQCi12VlQkuxLxAAlT0F37mAouzhrSRKRD78MQ==", 2023-11-28T12:07:33.932 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T12:07:33.932 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-11-28T12:07:33.932 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-11-28T12:07:33.932 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-11-28T12:07:33.933 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T12:07:33.933 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T12:07:33.933 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T12:07:33.933 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.6", 2023-11-28T12:07:33.933 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQCl12Vl2OfDMxAAV9LEr55YsDldXYXahMy9Rg==", 2023-11-28T12:07:33.933 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T12:07:33.933 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-11-28T12:07:33.933 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-11-28T12:07:33.933 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-11-28T12:07:33.934 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T12:07:33.934 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T12:07:33.934 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T12:07:33.934 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.7", 2023-11-28T12:07:33.934 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQCo12VldQCsNxAALZb33rZWI6sXmHBWJlPX0g==", 2023-11-28T12:07:33.934 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T12:07:33.935 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-11-28T12:07:33.935 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-11-28T12:07:33.935 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-11-28T12:07:33.935 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T12:07:33.935 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T12:07:33.935 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T12:07:33.935 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.0", 2023-11-28T12:07:33.935 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQCO12VljkopBBAAR62fve9Sjku9pqyTv1pQXg==", 2023-11-28T12:07:33.936 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T12:07:33.936 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-11-28T12:07:33.936 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow r", 2023-11-28T12:07:33.936 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow rw", 2023-11-28T12:07:33.936 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rwx" 2023-11-28T12:07:33.936 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T12:07:33.936 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T12:07:33.937 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T12:07:33.937 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.1", 2023-11-28T12:07:33.937 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQCO12Vl1B+WExAAEsX9UkIk23pAuPUuKpyIIg==", 2023-11-28T12:07:33.937 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T12:07:33.937 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-11-28T12:07:33.937 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow r", 2023-11-28T12:07:33.937 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow rw", 2023-11-28T12:07:33.937 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rwx" 2023-11-28T12:07:33.937 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T12:07:33.938 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T12:07:33.938 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T12:07:33.938 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.2", 2023-11-28T12:07:33.938 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQCO12Vl3HDpCxAA4joXCEwKG9hndZHR0vziiw==", 2023-11-28T12:07:33.938 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T12:07:33.938 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-11-28T12:07:33.938 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow r", 2023-11-28T12:07:33.938 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow rw", 2023-11-28T12:07:33.939 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rwx" 2023-11-28T12:07:33.939 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T12:07:33.939 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T12:07:33.939 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T12:07:33.939 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.3", 2023-11-28T12:07:33.939 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQCO12VlqGtSGxAAWLALZhfUpjq0VBH/ACtOSA==", 2023-11-28T12:07:33.939 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T12:07:33.940 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-11-28T12:07:33.940 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow r", 2023-11-28T12:07:33.940 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow rw", 2023-11-28T12:07:33.940 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rwx" 2023-11-28T12:07:33.940 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T12:07:33.940 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T12:07:33.940 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T12:07:33.940 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.admin", 2023-11-28T12:07:33.941 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQCM12VlaZq7FBAATQ9oiWZS9FzJAahvR3R41g==", 2023-11-28T12:07:33.941 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T12:07:33.941 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-11-28T12:07:33.941 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-11-28T12:07:33.941 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-11-28T12:07:33.941 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-11-28T12:07:33.941 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T12:07:33.941 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T12:07:33.942 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T12:07:33.942 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.bootstrap-mds", 2023-11-28T12:07:33.942 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQCx12Vlc7u3AhAAgZZGIzI17glHtlucPnI3Xg==", 2023-11-28T12:07:33.942 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T12:07:33.942 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile bootstrap-mds" 2023-11-28T12:07:33.942 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T12:07:33.943 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T12:07:33.943 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T12:07:33.943 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.bootstrap-mgr", 2023-11-28T12:07:33.943 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQCx12VlmsW3AhAA6Qj8zlCik1PUdnTEPyM0/w==", 2023-11-28T12:07:33.943 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T12:07:33.943 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile bootstrap-mgr" 2023-11-28T12:07:33.943 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T12:07:33.944 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T12:07:33.944 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T12:07:33.944 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.bootstrap-osd", 2023-11-28T12:07:33.944 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQCx12Vl0dC3AhAAMvPpY47hJhLazgEpMQjBwQ==", 2023-11-28T12:07:33.945 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T12:07:33.945 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile bootstrap-osd" 2023-11-28T12:07:33.945 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T12:07:33.945 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T12:07:33.945 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T12:07:33.945 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.bootstrap-rbd", 2023-11-28T12:07:33.945 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQCx12VlG9u3AhAAP1CTvmbVM0EEA/ASew1zNw==", 2023-11-28T12:07:33.946 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T12:07:33.946 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile bootstrap-rbd" 2023-11-28T12:07:33.946 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T12:07:33.946 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T12:07:33.947 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T12:07:33.947 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-11-28T12:07:33.947 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQCx12Vl/uO3AhAABraKLn7z2mhPCbjGVGWRaA==", 2023-11-28T12:07:33.947 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T12:07:33.947 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-11-28T12:07:33.947 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T12:07:33.947 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T12:07:33.947 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T12:07:33.947 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.bootstrap-rgw", 2023-11-28T12:07:33.947 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQCx12Vl9uy3AhAAQX4CBKUarUIxXvRxaqdyJQ==", 2023-11-28T12:07:33.947 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T12:07:33.948 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile bootstrap-rgw" 2023-11-28T12:07:33.948 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T12:07:33.948 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T12:07:33.948 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T12:07:33.948 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mgr.x", 2023-11-28T12:07:33.948 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQCN12VlWJ4LCBAAY0cfxIlr/nfBfr8TP7L96w==", 2023-11-28T12:07:33.948 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T12:07:33.948 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-11-28T12:07:33.948 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile mgr", 2023-11-28T12:07:33.948 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-11-28T12:07:33.948 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T12:07:33.949 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T12:07:33.949 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T12:07:33.949 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mgr.y", 2023-11-28T12:07:33.949 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQCM12VlY8eOOxAAR6xl4mDL9yOV6aeCuYBojQ==", 2023-11-28T12:07:33.950 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T12:07:33.950 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-11-28T12:07:33.950 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile mgr", 2023-11-28T12:07:33.950 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-11-28T12:07:33.950 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T12:07:33.950 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T12:07:33.950 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-11-28T12:07:33.950 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-11-28T12:07:33.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:33.918+0000 7f760edff700 1 -- 172.21.15.45:0/2735937998 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f75ec0682f0 msgr2=0x7f75ec06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:33.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:33.918+0000 7f760edff700 1 --2- 172.21.15.45:0/2735937998 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f75ec0682f0 0x7f75ec06a7a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f76081f6ab0 tx=0x7f75f4009040 comp rx=0 tx=0).stop 2023-11-28T12:07:33.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:33.918+0000 7f760edff700 1 -- 172.21.15.45:0/2735937998 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76080b16d0 msgr2=0x7f76080ca120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:33.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:33.918+0000 7f760edff700 1 --2- 172.21.15.45:0/2735937998 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76080b16d0 0x7f76080ca120 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f75fc009c40 tx=0x7f75fc004750 comp rx=0 tx=0).stop 2023-11-28T12:07:33.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:33.918+0000 7f760edff700 1 -- 172.21.15.45:0/2735937998 shutdown_connections 2023-11-28T12:07:33.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:33.918+0000 7f760edff700 1 --2- 172.21.15.45:0/2735937998 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f75ec0682f0 0x7f75ec06a7a0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:33.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:33.919+0000 7f760edff700 1 --2- 172.21.15.45:0/2735937998 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f76080d01b0 0x7f76081f5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:33.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:33.919+0000 7f760edff700 1 --2- 172.21.15.45:0/2735937998 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76080b16d0 0x7f76080ca120 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:33.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:33.919+0000 7f760edff700 1 --2- 172.21.15.45:0/2735937998 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76080b20b0 0x7f76081f59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:33.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:33.919+0000 7f760edff700 1 -- 172.21.15.45:0/2735937998 >> 172.21.15.45:0/2735937998 conn(0x7f760809c3f0 msgr2=0x7f76080b0f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:33.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:33.919+0000 7f760edff700 1 -- 172.21.15.45:0/2735937998 shutdown_connections 2023-11-28T12:07:33.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:33.919+0000 7f760edff700 1 -- 172.21.15.45:0/2735937998 wait complete. 2023-11-28T12:07:33.953 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-11-28T12:07:34.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.158+0000 7fb87c5ff700 1 Processor -- start 2023-11-28T12:07:34.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.158+0000 7fb87c5ff700 1 -- start start 2023-11-28T12:07:34.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.159+0000 7fb87c5ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb8740d01b0 0x7fb8740d0c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:34.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.159+0000 7fb87c5ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb8740b20b0 0x7fb8740d1160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:34.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.159+0000 7fb87c5ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8740b0230 con 0x7fb8740b29b0 2023-11-28T12:07:34.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.159+0000 7fb87c5ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb87415cec0 con 0x7fb8740b20b0 2023-11-28T12:07:34.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.159+0000 7fb87c5ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8740b4570 con 0x7fb8740d01b0 2023-11-28T12:07:34.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.159+0000 7fb879b9a700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb8740b20b0 0x7fb8740d1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:34.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.159+0000 7fb879b9a700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb8740b20b0 0x7fb8740d1160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47408/0 (socket says 172.21.15.45:47408) 2023-11-28T12:07:34.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.159+0000 7fb879b9a700 1 -- 172.21.15.45:0/3739772264 learned_addr learned my addr 172.21.15.45:0/3739772264 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:34.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.159+0000 7fb87ab9c700 1 --1- 172.21.15.45:0/3739772264 >> v1:172.21.15.45:6789/0 conn(0x7fb8740b29b0 0x7fb8740b2e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41254/0 (socket says 172.21.15.45:41254) 2023-11-28T12:07:34.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.160+0000 7fb87a39b700 1 --2- 172.21.15.45:0/3739772264 >> v2:172.21.15.152:3300/0 conn(0x7fb8740d01b0 0x7fb8740d0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:34.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.160+0000 7fb879b9a700 1 -- 172.21.15.45:0/3739772264 >> v2:172.21.15.152:3300/0 conn(0x7fb8740d01b0 msgr2=0x7fb8740d0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:34.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.160+0000 7fb879b9a700 1 --2- 172.21.15.45:0/3739772264 >> v2:172.21.15.152:3300/0 conn(0x7fb8740d01b0 0x7fb8740d0c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:34.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.160+0000 7fb879b9a700 1 -- 172.21.15.45:0/3739772264 >> v1:172.21.15.45:6789/0 conn(0x7fb8740b29b0 legacy=0x7fb8740b2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:34.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.160+0000 7fb879b9a700 1 -- 172.21.15.45:0/3739772264 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8740b4850 con 0x7fb8740b20b0 2023-11-28T12:07:34.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.160+0000 7fb879399700 1 -- 172.21.15.45:0/3739772264 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2170188875 0 0) 0x7fb8740b0230 con 0x7fb8740b29b0 2023-11-28T12:07:34.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.160+0000 7fb879b9a700 1 --2- 172.21.15.45:0/3739772264 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8740b20b0 0x7fb8740d1160 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fb8740b5bb0 tx=0x7fb864009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=573fd6ca635f1621 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:34.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.160+0000 7fb879399700 1 -- 172.21.15.45:0/3739772264 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb864011830 con 0x7fb8740b20b0 2023-11-28T12:07:34.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.160+0000 7fb879399700 1 -- 172.21.15.45:0/3739772264 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb864011990 con 0x7fb8740b20b0 2023-11-28T12:07:34.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.160+0000 7fb879399700 1 -- 172.21.15.45:0/3739772264 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb864011d20 con 0x7fb8740b20b0 2023-11-28T12:07:34.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.161+0000 7fb87c5ff700 1 -- 172.21.15.45:0/3739772264 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8740b20b0 msgr2=0x7fb8740d1160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:34.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.161+0000 7fb87c5ff700 1 --2- 172.21.15.45:0/3739772264 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8740b20b0 0x7fb8740d1160 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fb8740b5bb0 tx=0x7fb864009bd0 comp rx=0 tx=0).stop 2023-11-28T12:07:34.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.161+0000 7fb87c5ff700 1 -- 172.21.15.45:0/3739772264 shutdown_connections 2023-11-28T12:07:34.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.161+0000 7fb87c5ff700 1 --2- 172.21.15.45:0/3739772264 >> v2:172.21.15.152:3300/0 conn(0x7fb8740d01b0 0x7fb8740d0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:34.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.161+0000 7fb87c5ff700 1 --2- 172.21.15.45:0/3739772264 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8740b20b0 0x7fb8740d1160 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:34.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.161+0000 7fb87c5ff700 1 -- 172.21.15.45:0/3739772264 >> 172.21.15.45:0/3739772264 conn(0x7fb87409c3f0 msgr2=0x7fb8740d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:34.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.161+0000 7fb87c5ff700 1 -- 172.21.15.45:0/3739772264 shutdown_connections 2023-11-28T12:07:34.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.161+0000 7fb87c5ff700 1 -- 172.21.15.45:0/3739772264 wait complete. 2023-11-28T12:07:34.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.163+0000 7fb87c5ff700 1 Processor -- start 2023-11-28T12:07:34.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.163+0000 7fb87c5ff700 1 -- start start 2023-11-28T12:07:34.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.164+0000 7fb87c5ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb8740b20b0 0x7fb8740ca120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:34.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.164+0000 7fb87c5ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8740b29b0 0x7fb8741f1970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:34.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.164+0000 7fb87c5ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb8740d01b0 0x7fb8741f1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:34.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.164+0000 7fb87c5ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8741f23f0 con 0x7fb8740b29b0 2023-11-28T12:07:34.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.164+0000 7fb87c5ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8740ca660 con 0x7fb8740d01b0 2023-11-28T12:07:34.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.164+0000 7fb87c5ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8740b76c0 con 0x7fb8740b20b0 2023-11-28T12:07:34.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.164+0000 7fb879b9a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8740b29b0 0x7fb8741f1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:34.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.164+0000 7fb879b9a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8740b29b0 0x7fb8741f1970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47416/0 (socket says 172.21.15.45:47416) 2023-11-28T12:07:34.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.164+0000 7fb879b9a700 1 -- 172.21.15.45:0/2451758523 learned_addr learned my addr 172.21.15.45:0/2451758523 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:34.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.165+0000 7fb879b9a700 1 -- 172.21.15.45:0/2451758523 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb8740b20b0 msgr2=0x7fb8740ca120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:34.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.165+0000 7fb87a39b700 1 --2- 172.21.15.45:0/2451758523 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb8740b20b0 0x7fb8740ca120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:34.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.165+0000 7fb87ab9c700 1 --2- 172.21.15.45:0/2451758523 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb8740d01b0 0x7fb8741f1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:34.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.165+0000 7fb879b9a700 1 --2- 172.21.15.45:0/2451758523 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb8740b20b0 0x7fb8740ca120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:34.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.165+0000 7fb879b9a700 1 -- 172.21.15.45:0/2451758523 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb8740d01b0 msgr2=0x7fb8741f1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:34.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.165+0000 7fb879b9a700 1 --2- 172.21.15.45:0/2451758523 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb8740d01b0 0x7fb8741f1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:34.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.165+0000 7fb879b9a700 1 -- 172.21.15.45:0/2451758523 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb864009550 con 0x7fb8740b29b0 2023-11-28T12:07:34.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.165+0000 7fb87a39b700 1 --2- 172.21.15.45:0/2451758523 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb8740b20b0 0x7fb8740ca120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:07:34.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.165+0000 7fb87ab9c700 1 --2- 172.21.15.45:0/2451758523 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb8740d01b0 0x7fb8741f1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:07:34.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.165+0000 7fb879b9a700 1 --2- 172.21.15.45:0/2451758523 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8740b29b0 0x7fb8741f1970 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fb864009c10 tx=0x7fb864004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:34.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.165+0000 7fb86affd700 1 -- 172.21.15.45:0/2451758523 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8640036a0 con 0x7fb8740b29b0 2023-11-28T12:07:34.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.165+0000 7fb86affd700 1 -- 172.21.15.45:0/2451758523 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb86401f070 con 0x7fb8740b29b0 2023-11-28T12:07:34.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.165+0000 7fb86affd700 1 -- 172.21.15.45:0/2451758523 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb864003a40 con 0x7fb8740b29b0 2023-11-28T12:07:34.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.165+0000 7fb87c5ff700 1 -- 172.21.15.45:0/2451758523 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8740afec0 con 0x7fb8740b29b0 2023-11-28T12:07:34.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.165+0000 7fb87c5ff700 1 -- 172.21.15.45:0/2451758523 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8740afbe0 con 0x7fb8740b29b0 2023-11-28T12:07:34.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.167+0000 7fb87c5ff700 1 -- 172.21.15.45:0/2451758523 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8740b2600 con 0x7fb8740b29b0 2023-11-28T12:07:34.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.168+0000 7fb86affd700 1 -- 172.21.15.45:0/2451758523 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fb86400f050 con 0x7fb8740b29b0 2023-11-28T12:07:34.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.168+0000 7fb86affd700 1 --2- 172.21.15.45:0/2451758523 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb8580682f0 0x7fb85806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:34.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.169+0000 7fb86affd700 1 -- 172.21.15.45:0/2451758523 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fb864021070 con 0x7fb8740b29b0 2023-11-28T12:07:34.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.169+0000 7fb87a39b700 1 --2- 172.21.15.45:0/2451758523 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb8580682f0 0x7fb85806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:34.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.170+0000 7fb87a39b700 1 --2- 172.21.15.45:0/2451758523 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb8580682f0 0x7fb85806a7a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb870009ac0 tx=0x7fb870008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:34.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.173+0000 7fb86affd700 1 -- 172.21.15.45:0/2451758523 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fb864053e30 con 0x7fb8740b29b0 2023-11-28T12:07:34.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.457+0000 7fb87c5ff700 1 -- 172.21.15.45:0/2451758523 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fb874068690 con 0x7fb8740b29b0 2023-11-28T12:07:34.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.461+0000 7fb86affd700 1 -- 172.21.15.45:0/2451758523 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7fb86402b0a0 con 0x7fb8740b29b0 2023-11-28T12:07:34.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.463+0000 7fb87c5ff700 1 -- 172.21.15.45:0/2451758523 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb8580682f0 msgr2=0x7fb85806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:34.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.463+0000 7fb87c5ff700 1 --2- 172.21.15.45:0/2451758523 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb8580682f0 0x7fb85806a7a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb870009ac0 tx=0x7fb870008040 comp rx=0 tx=0).stop 2023-11-28T12:07:34.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.463+0000 7fb87c5ff700 1 -- 172.21.15.45:0/2451758523 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8740b29b0 msgr2=0x7fb8741f1970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:34.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.463+0000 7fb87c5ff700 1 --2- 172.21.15.45:0/2451758523 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8740b29b0 0x7fb8741f1970 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fb864009c10 tx=0x7fb864004750 comp rx=0 tx=0).stop 2023-11-28T12:07:34.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.463+0000 7fb87c5ff700 1 -- 172.21.15.45:0/2451758523 shutdown_connections 2023-11-28T12:07:34.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.463+0000 7fb87c5ff700 1 --2- 172.21.15.45:0/2451758523 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb8580682f0 0x7fb85806a7a0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:34.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.463+0000 7fb87c5ff700 1 --2- 172.21.15.45:0/2451758523 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb8740d01b0 0x7fb8741f1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:34.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.463+0000 7fb87c5ff700 1 --2- 172.21.15.45:0/2451758523 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb8740b20b0 0x7fb8740ca120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:34.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.463+0000 7fb87c5ff700 1 --2- 172.21.15.45:0/2451758523 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8740b29b0 0x7fb8741f1970 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:34.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.464+0000 7fb87c5ff700 1 -- 172.21.15.45:0/2451758523 >> 172.21.15.45:0/2451758523 conn(0x7fb87409c3f0 msgr2=0x7fb8740c9930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:34.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.464+0000 7fb87c5ff700 1 -- 172.21.15.45:0/2451758523 shutdown_connections 2023-11-28T12:07:34.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.464+0000 7fb87c5ff700 1 -- 172.21.15.45:0/2451758523 wait complete. 2023-11-28T12:07:34.482 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-11-28T12:07:34.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.685+0000 7fe4d51ff700 1 Processor -- start 2023-11-28T12:07:34.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.685+0000 7fe4d51ff700 1 -- start start 2023-11-28T12:07:34.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.686+0000 7fe4d51ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fe4d0161340 0x7fe4d00d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:34.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.686+0000 7fe4d51ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe4d00d2320 0x7fe4d00cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:34.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.686+0000 7fe4d51ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4d00d1950 con 0x7fe4d015c9b0 2023-11-28T12:07:34.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.687+0000 7fe4d51ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4d00b5800 con 0x7fe4d0161340 2023-11-28T12:07:34.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.687+0000 7fe4d51ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d00b5300 con 0x7fe4d00d2320 2023-11-28T12:07:34.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.687+0000 7fe4ced9d700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fe4d015c9b0 0x7fe4d00b4bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41262/0 (socket says 172.21.15.45:41262) 2023-11-28T12:07:34.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.687+0000 7fe4ced9d700 1 -- 172.21.15.45:0/779422311 learned_addr learned my addr 172.21.15.45:0/779422311 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:07:34.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.687+0000 7fe4cf59e700 1 --2- 172.21.15.45:0/779422311 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe4d00d2320 0x7fe4d00cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:34.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.687+0000 7fe4ce59c700 1 --2- 172.21.15.45:0/779422311 >> v2:172.21.15.152:3300/0 conn(0x7fe4d0161340 0x7fe4d00d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:34.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.687+0000 7fe4cdd9b700 1 -- 172.21.15.45:0/779422311 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 868119123 0 0) 0x7fe4d00d1950 con 0x7fe4d015c9b0 2023-11-28T12:07:34.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.687+0000 7fe4cdd9b700 1 -- 172.21.15.45:0/779422311 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4b80035b0 con 0x7fe4d015c9b0 2023-11-28T12:07:34.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.688+0000 7fe4cf59e700 1 -- 172.21.15.45:0/779422311 >> v2:172.21.15.152:3300/0 conn(0x7fe4d0161340 msgr2=0x7fe4d00d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:34.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.688+0000 7fe4cf59e700 1 --2- 172.21.15.45:0/779422311 >> v2:172.21.15.152:3300/0 conn(0x7fe4d0161340 0x7fe4d00d1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:34.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.688+0000 7fe4cf59e700 1 -- 172.21.15.45:0/779422311 >> v1:172.21.15.45:6789/0 conn(0x7fe4d015c9b0 legacy=0x7fe4d00b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:34.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.688+0000 7fe4cf59e700 1 -- 172.21.15.45:0/779422311 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4d00b5520 con 0x7fe4d00d2320 2023-11-28T12:07:34.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.688+0000 7fe4cf59e700 1 --2- 172.21.15.45:0/779422311 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe4d00d2320 0x7fe4d00cd7c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe4c8009d90 tx=0x7fe4c800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9fd313c5364fcf5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:34.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.688+0000 7fe4cdd9b700 1 -- 172.21.15.45:0/779422311 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c800e070 con 0x7fe4d00d2320 2023-11-28T12:07:34.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.688+0000 7fe4cdd9b700 1 -- 172.21.15.45:0/779422311 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4c800bb20 con 0x7fe4d00d2320 2023-11-28T12:07:34.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.688+0000 7fe4cdd9b700 1 -- 172.21.15.45:0/779422311 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c8012430 con 0x7fe4d00d2320 2023-11-28T12:07:34.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.689+0000 7fe4d51ff700 1 -- 172.21.15.45:0/779422311 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe4d00d2320 msgr2=0x7fe4d00cd7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:34.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.689+0000 7fe4d51ff700 1 --2- 172.21.15.45:0/779422311 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe4d00d2320 0x7fe4d00cd7c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe4c8009d90 tx=0x7fe4c800b330 comp rx=0 tx=0).stop 2023-11-28T12:07:34.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.689+0000 7fe4d51ff700 1 -- 172.21.15.45:0/779422311 shutdown_connections 2023-11-28T12:07:34.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.689+0000 7fe4d51ff700 1 --2- 172.21.15.45:0/779422311 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe4d00d2320 0x7fe4d00cd7c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:34.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.689+0000 7fe4d51ff700 1 --2- 172.21.15.45:0/779422311 >> v2:172.21.15.152:3300/0 conn(0x7fe4d0161340 0x7fe4d00d1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:34.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.689+0000 7fe4d51ff700 1 -- 172.21.15.45:0/779422311 >> 172.21.15.45:0/779422311 conn(0x7fe4d0072600 msgr2=0x7fe4d00cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:34.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.689+0000 7fe4d51ff700 1 -- 172.21.15.45:0/779422311 shutdown_connections 2023-11-28T12:07:34.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.689+0000 7fe4d51ff700 1 -- 172.21.15.45:0/779422311 wait complete. 2023-11-28T12:07:34.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.691+0000 7fe4d51ff700 1 Processor -- start 2023-11-28T12:07:34.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.691+0000 7fe4d51ff700 1 -- start start 2023-11-28T12:07:34.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.692+0000 7fe4d51ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe4d00d2320 0x7fe4d0156530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:34.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.692+0000 7fe4d51ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4d015c9b0 0x7fe4d0153330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:34.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.692+0000 7fe4d51ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe4d0161340 0x7fe4d01594a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:34.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.692+0000 7fe4d51ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d0155490 con 0x7fe4d00d2320 2023-11-28T12:07:34.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.692+0000 7fe4d51ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d0155770 con 0x7fe4d015c9b0 2023-11-28T12:07:34.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.692+0000 7fe4d51ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d0155a50 con 0x7fe4d0161340 2023-11-28T12:07:34.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.692+0000 7fe4ced9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe4d00d2320 0x7fe4d0156530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:34.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.692+0000 7fe4ced9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe4d00d2320 0x7fe4d0156530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47422/0 (socket says 172.21.15.45:47422) 2023-11-28T12:07:34.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.692+0000 7fe4ced9d700 1 -- 172.21.15.45:0/3974300498 learned_addr learned my addr 172.21.15.45:0/3974300498 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:34.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.692+0000 7fe4ce59c700 1 --2- 172.21.15.45:0/3974300498 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4d015c9b0 0x7fe4d0153330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:34.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.692+0000 7fe4cf59e700 1 --2- 172.21.15.45:0/3974300498 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe4d0161340 0x7fe4d01594a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:34.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.692+0000 7fe4ced9d700 1 -- 172.21.15.45:0/3974300498 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe4d0161340 msgr2=0x7fe4d01594a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:34.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.692+0000 7fe4ced9d700 1 --2- 172.21.15.45:0/3974300498 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe4d0161340 0x7fe4d01594a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:34.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.692+0000 7fe4ced9d700 1 -- 172.21.15.45:0/3974300498 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4d015c9b0 msgr2=0x7fe4d0153330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:34.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.692+0000 7fe4ced9d700 1 --2- 172.21.15.45:0/3974300498 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4d015c9b0 0x7fe4d0153330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:34.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.692+0000 7fe4ced9d700 1 -- 172.21.15.45:0/3974300498 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4c8009a70 con 0x7fe4d00d2320 2023-11-28T12:07:34.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.693+0000 7fe4ced9d700 1 --2- 172.21.15.45:0/3974300498 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe4d00d2320 0x7fe4d0156530 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fe4c0001eb0 tx=0x7fe4c000c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:34.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.693+0000 7fe4b77fe700 1 -- 172.21.15.45:0/3974300498 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c0005d70 con 0x7fe4d00d2320 2023-11-28T12:07:34.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.693+0000 7fe4b77fe700 1 -- 172.21.15.45:0/3974300498 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4c00070d0 con 0x7fe4d00d2320 2023-11-28T12:07:34.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.693+0000 7fe4d51ff700 1 -- 172.21.15.45:0/3974300498 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4d00d15e0 con 0x7fe4d00d2320 2023-11-28T12:07:34.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.693+0000 7fe4b77fe700 1 -- 172.21.15.45:0/3974300498 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c0007460 con 0x7fe4d00d2320 2023-11-28T12:07:34.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.693+0000 7fe4d51ff700 1 -- 172.21.15.45:0/3974300498 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4d00d1300 con 0x7fe4d00d2320 2023-11-28T12:07:34.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.694+0000 7fe4d51ff700 1 -- 172.21.15.45:0/3974300498 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4d015cd80 con 0x7fe4d00d2320 2023-11-28T12:07:34.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.695+0000 7fe4b77fe700 1 -- 172.21.15.45:0/3974300498 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fe4c0019030 con 0x7fe4d00d2320 2023-11-28T12:07:34.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.696+0000 7fe4b77fe700 1 --2- 172.21.15.45:0/3974300498 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fe4bc0682f0 0x7fe4bc06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:34.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.696+0000 7fe4b77fe700 1 -- 172.21.15.45:0/3974300498 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fe4c0084d10 con 0x7fe4d00d2320 2023-11-28T12:07:34.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.696+0000 7fe4ce59c700 1 --2- 172.21.15.45:0/3974300498 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fe4bc0682f0 0x7fe4bc06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:34.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.697+0000 7fe4ce59c700 1 --2- 172.21.15.45:0/3974300498 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fe4bc0682f0 0x7fe4bc06a7a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe4d0154a30 tx=0x7fe4c4009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:34.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.700+0000 7fe4b77fe700 1 -- 172.21.15.45:0/3974300498 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fe4c008a020 con 0x7fe4d00d2320 2023-11-28T12:07:34.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.984+0000 7fe4d51ff700 1 -- 172.21.15.45:0/3974300498 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fe4d00745c0 con 0x7fe4d00d2320 2023-11-28T12:07:34.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.988+0000 7fe4b77fe700 1 -- 172.21.15.45:0/3974300498 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7fe4c0017020 con 0x7fe4d00d2320 2023-11-28T12:07:34.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.990+0000 7fe4d51ff700 1 -- 172.21.15.45:0/3974300498 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fe4bc0682f0 msgr2=0x7fe4bc06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:34.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.990+0000 7fe4d51ff700 1 --2- 172.21.15.45:0/3974300498 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fe4bc0682f0 0x7fe4bc06a7a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe4d0154a30 tx=0x7fe4c4009210 comp rx=0 tx=0).stop 2023-11-28T12:07:34.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.990+0000 7fe4d51ff700 1 -- 172.21.15.45:0/3974300498 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe4d00d2320 msgr2=0x7fe4d0156530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:34.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.990+0000 7fe4d51ff700 1 --2- 172.21.15.45:0/3974300498 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe4d00d2320 0x7fe4d0156530 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fe4c0001eb0 tx=0x7fe4c000c7b0 comp rx=0 tx=0).stop 2023-11-28T12:07:34.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.990+0000 7fe4d51ff700 1 -- 172.21.15.45:0/3974300498 shutdown_connections 2023-11-28T12:07:34.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.990+0000 7fe4d51ff700 1 --2- 172.21.15.45:0/3974300498 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fe4bc0682f0 0x7fe4bc06a7a0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:34.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.990+0000 7fe4d51ff700 1 --2- 172.21.15.45:0/3974300498 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe4d0161340 0x7fe4d01594a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:34.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.990+0000 7fe4d51ff700 1 --2- 172.21.15.45:0/3974300498 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe4d00d2320 0x7fe4d0156530 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:34.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.990+0000 7fe4d51ff700 1 --2- 172.21.15.45:0/3974300498 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4d015c9b0 0x7fe4d0153330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:34.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.990+0000 7fe4d51ff700 1 -- 172.21.15.45:0/3974300498 >> 172.21.15.45:0/3974300498 conn(0x7fe4d0072600 msgr2=0x7fe4d006a900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:34.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.990+0000 7fe4d51ff700 1 -- 172.21.15.45:0/3974300498 shutdown_connections 2023-11-28T12:07:34.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:34.990+0000 7fe4d51ff700 1 -- 172.21.15.45:0/3974300498 wait complete. 2023-11-28T12:07:35.009 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-11-28T12:07:35.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.213+0000 7faad09ff700 1 Processor -- start 2023-11-28T12:07:35.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.213+0000 7faad09ff700 1 -- start start 2023-11-28T12:07:35.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.215+0000 7faad09ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7faacc0b20b0 0x7faacc0b0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:35.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.215+0000 7faad09ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faacc0b0230 con 0x7faacc0d1330 2023-11-28T12:07:35.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.215+0000 7faad09ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faacc0b4570 con 0x7faacc0d01b0 2023-11-28T12:07:35.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.215+0000 7faad09ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faacc15cec0 con 0x7faacc0b20b0 2023-11-28T12:07:35.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.215+0000 7faac3fff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7faacc0d1330 0x7faacc0b06c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41276/0 (socket says 172.21.15.45:41276) 2023-11-28T12:07:35.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.215+0000 7faac3fff700 1 -- 172.21.15.45:0/1671127405 learned_addr learned my addr 172.21.15.45:0/1671127405 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:07:35.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.215+0000 7faacad9d700 1 --2- 172.21.15.45:0/1671127405 >> v2:172.21.15.152:3300/0 conn(0x7faacc0b20b0 0x7faacc0b0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:35.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.215+0000 7faac9d9b700 1 -- 172.21.15.45:0/1671127405 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1102282544 0 0) 0x7faacc0b0230 con 0x7faacc0d1330 2023-11-28T12:07:35.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.215+0000 7faac9d9b700 1 -- 172.21.15.45:0/1671127405 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faab80035b0 con 0x7faacc0d1330 2023-11-28T12:07:35.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.216+0000 7faacad9d700 1 -- 172.21.15.45:0/1671127405 >> v1:172.21.15.152:6789/0 conn(0x7faacc0d01b0 legacy=0x7faacc0d0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:35.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.216+0000 7faacad9d700 1 -- 172.21.15.45:0/1671127405 >> v1:172.21.15.45:6789/0 conn(0x7faacc0d1330 legacy=0x7faacc0b06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:35.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.216+0000 7faac9d9b700 1 -- 172.21.15.45:0/1671127405 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4063533096 0 0) 0x7faab80035b0 con 0x7faacc0d1330 2023-11-28T12:07:35.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.216+0000 7faacad9d700 1 -- 172.21.15.45:0/1671127405 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faacc0b4850 con 0x7faacc0b20b0 2023-11-28T12:07:35.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.216+0000 7faacad9d700 1 --2- 172.21.15.45:0/1671127405 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faacc0b20b0 0x7faacc0b0dd0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7faac4009d90 tx=0x7faac400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9a6344636cf0218 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:35.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.216+0000 7faac9d9b700 1 -- 172.21.15.45:0/1671127405 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac400e070 con 0x7faacc0b20b0 2023-11-28T12:07:35.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.216+0000 7faac9d9b700 1 -- 172.21.15.45:0/1671127405 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faac4003a20 con 0x7faacc0b20b0 2023-11-28T12:07:35.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.216+0000 7faac9d9b700 1 -- 172.21.15.45:0/1671127405 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab4001670 con 0x7faacc0b20b0 2023-11-28T12:07:35.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.217+0000 7faad09ff700 1 -- 172.21.15.45:0/1671127405 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faacc0b20b0 msgr2=0x7faacc0b0dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:35.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.217+0000 7faad09ff700 1 --2- 172.21.15.45:0/1671127405 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faacc0b20b0 0x7faacc0b0dd0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7faac4009d90 tx=0x7faac400b330 comp rx=0 tx=0).stop 2023-11-28T12:07:35.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.217+0000 7faad09ff700 1 -- 172.21.15.45:0/1671127405 shutdown_connections 2023-11-28T12:07:35.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.217+0000 7faad09ff700 1 --2- 172.21.15.45:0/1671127405 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faacc0b20b0 0x7faacc0b0dd0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:35.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.217+0000 7faad09ff700 1 -- 172.21.15.45:0/1671127405 >> 172.21.15.45:0/1671127405 conn(0x7faacc09c3f0 msgr2=0x7faacc0d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:35.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.217+0000 7faad09ff700 1 -- 172.21.15.45:0/1671127405 shutdown_connections 2023-11-28T12:07:35.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.217+0000 7faad09ff700 1 -- 172.21.15.45:0/1671127405 wait complete. 2023-11-28T12:07:35.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.219+0000 7faad09ff700 1 Processor -- start 2023-11-28T12:07:35.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.219+0000 7faad09ff700 1 -- start start 2023-11-28T12:07:35.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.220+0000 7faad09ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7faacc0b20b0 0x7faacc15f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:35.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.220+0000 7faad09ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faacc0d01b0 0x7faacc0b8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:35.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.220+0000 7faad09ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faacc0d1330 0x7faacc0b8590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:35.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.220+0000 7faad09ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faacc15afd0 con 0x7faacc0d01b0 2023-11-28T12:07:35.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.220+0000 7faad09ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faacc15e6e0 con 0x7faacc0d1330 2023-11-28T12:07:35.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.220+0000 7faad09ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faacc15e9c0 con 0x7faacc0b20b0 2023-11-28T12:07:35.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.220+0000 7faac3fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faacc0d01b0 0x7faacc0b8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:35.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.220+0000 7faac3fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faacc0d01b0 0x7faacc0b8050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47438/0 (socket says 172.21.15.45:47438) 2023-11-28T12:07:35.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.220+0000 7faac3fff700 1 -- 172.21.15.45:0/1134664787 learned_addr learned my addr 172.21.15.45:0/1134664787 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:35.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.220+0000 7faacad9d700 1 --2- 172.21.15.45:0/1134664787 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faacc0d1330 0x7faacc0b8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:35.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.220+0000 7faaca59c700 1 --2- 172.21.15.45:0/1134664787 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7faacc0b20b0 0x7faacc15f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:35.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.221+0000 7faac3fff700 1 -- 172.21.15.45:0/1134664787 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7faacc0b20b0 msgr2=0x7faacc15f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:35.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.221+0000 7faac3fff700 1 --2- 172.21.15.45:0/1134664787 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7faacc0b20b0 0x7faacc15f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:35.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.221+0000 7faac3fff700 1 -- 172.21.15.45:0/1134664787 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faacc0d1330 msgr2=0x7faacc0b8590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:35.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.221+0000 7faac3fff700 1 --2- 172.21.15.45:0/1134664787 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faacc0d1330 0x7faacc0b8590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:35.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.221+0000 7faac3fff700 1 -- 172.21.15.45:0/1134664787 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faac4009a70 con 0x7faacc0d01b0 2023-11-28T12:07:35.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.221+0000 7faaca59c700 1 --2- 172.21.15.45:0/1134664787 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7faacc0b20b0 0x7faacc15f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:07:35.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.221+0000 7faac3fff700 1 --2- 172.21.15.45:0/1134664787 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faacc0d01b0 0x7faacc0b8050 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7faab400c750 tx=0x7faab400ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:35.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.221+0000 7faac2ffd700 1 -- 172.21.15.45:0/1134664787 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab4004c80 con 0x7faacc0d01b0 2023-11-28T12:07:35.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.221+0000 7faac2ffd700 1 -- 172.21.15.45:0/1134664787 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faab4004e00 con 0x7faacc0d01b0 2023-11-28T12:07:35.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.221+0000 7faad09ff700 1 -- 172.21.15.45:0/1134664787 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faacc0afec0 con 0x7faacc0d01b0 2023-11-28T12:07:35.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.221+0000 7faac2ffd700 1 -- 172.21.15.45:0/1134664787 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab4007310 con 0x7faacc0d01b0 2023-11-28T12:07:35.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.221+0000 7faad09ff700 1 -- 172.21.15.45:0/1134664787 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faacc0afbe0 con 0x7faacc0d01b0 2023-11-28T12:07:35.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.222+0000 7faad09ff700 1 -- 172.21.15.45:0/1134664787 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faacc0b2600 con 0x7faacc0d01b0 2023-11-28T12:07:35.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.223+0000 7faac2ffd700 1 -- 172.21.15.45:0/1134664787 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7faab401a020 con 0x7faacc0d01b0 2023-11-28T12:07:35.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.224+0000 7faac2ffd700 1 --2- 172.21.15.45:0/1134664787 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7faaac0682f0 0x7faaac06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:35.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.224+0000 7faac2ffd700 1 -- 172.21.15.45:0/1134664787 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5210+0+0 (secure 0 0 0) 0x7faab4085540 con 0x7faacc0d01b0 2023-11-28T12:07:35.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.224+0000 7faaca59c700 1 --2- 172.21.15.45:0/1134664787 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7faaac0682f0 0x7faaac06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:35.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.225+0000 7faaca59c700 1 --2- 172.21.15.45:0/1134664787 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7faaac0682f0 0x7faaac06a7a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7faabc001780 tx=0x7faabc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:35.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.228+0000 7faac2ffd700 1 -- 172.21.15.45:0/1134664787 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7faab4052000 con 0x7faacc0d01b0 2023-11-28T12:07:35.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.513+0000 7faad09ff700 1 -- 172.21.15.45:0/1134664787 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7faacc068690 con 0x7faacc0d01b0 2023-11-28T12:07:35.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.517+0000 7faac2ffd700 1 -- 172.21.15.45:0/1134664787 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7faab4055620 con 0x7faacc0d01b0 2023-11-28T12:07:35.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.519+0000 7faad09ff700 1 -- 172.21.15.45:0/1134664787 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7faaac0682f0 msgr2=0x7faaac06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:35.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.519+0000 7faad09ff700 1 --2- 172.21.15.45:0/1134664787 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7faaac0682f0 0x7faaac06a7a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7faabc001780 tx=0x7faabc009040 comp rx=0 tx=0).stop 2023-11-28T12:07:35.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.519+0000 7faad09ff700 1 -- 172.21.15.45:0/1134664787 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faacc0d01b0 msgr2=0x7faacc0b8050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:35.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.519+0000 7faad09ff700 1 --2- 172.21.15.45:0/1134664787 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faacc0d01b0 0x7faacc0b8050 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7faab400c750 tx=0x7faab400ca60 comp rx=0 tx=0).stop 2023-11-28T12:07:35.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.519+0000 7faad09ff700 1 -- 172.21.15.45:0/1134664787 shutdown_connections 2023-11-28T12:07:35.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.519+0000 7faad09ff700 1 --2- 172.21.15.45:0/1134664787 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7faaac0682f0 0x7faaac06a7a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:35.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.519+0000 7faad09ff700 1 --2- 172.21.15.45:0/1134664787 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faacc0d1330 0x7faacc0b8590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:35.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.519+0000 7faad09ff700 1 --2- 172.21.15.45:0/1134664787 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7faacc0b20b0 0x7faacc15f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:35.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.519+0000 7faad09ff700 1 --2- 172.21.15.45:0/1134664787 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faacc0d01b0 0x7faacc0b8050 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:35.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.519+0000 7faad09ff700 1 -- 172.21.15.45:0/1134664787 >> 172.21.15.45:0/1134664787 conn(0x7faacc09c3f0 msgr2=0x7faacc06b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:35.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.520+0000 7faad09ff700 1 -- 172.21.15.45:0/1134664787 shutdown_connections 2023-11-28T12:07:35.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.520+0000 7faad09ff700 1 -- 172.21.15.45:0/1134664787 wait complete. 2023-11-28T12:07:35.538 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-11-28T12:07:35.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.742+0000 7f94a57ff700 1 Processor -- start 2023-11-28T12:07:35.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.742+0000 7f94a57ff700 1 -- start start 2023-11-28T12:07:35.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.743+0000 7f94a57ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f94a015c9b0 0x7f94a00b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:35.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.743+0000 7f94a57ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f94a0161340 0x7f94a00d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:35.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.743+0000 7f94a57ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94a00d1950 con 0x7f94a00d2320 2023-11-28T12:07:35.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.743+0000 7f94a57ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94a00b5800 con 0x7f94a015c9b0 2023-11-28T12:07:35.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.743+0000 7f94a57ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94a00b5520 con 0x7f94a0161340 2023-11-28T12:07:35.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.744+0000 7f949effd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f94a015c9b0 0x7f94a00b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:35.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.744+0000 7f949effd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f94a015c9b0 0x7f94a00b4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47450/0 (socket says 172.21.15.45:47450) 2023-11-28T12:07:35.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.744+0000 7f949effd700 1 -- 172.21.15.45:0/1162909694 learned_addr learned my addr 172.21.15.45:0/1162909694 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:35.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.744+0000 7f949e7fc700 1 --2- 172.21.15.45:0/1162909694 >> v2:172.21.15.152:3300/0 conn(0x7f94a0161340 0x7f94a00d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:35.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.744+0000 7f949effd700 1 -- 172.21.15.45:0/1162909694 >> v2:172.21.15.152:3300/0 conn(0x7f94a0161340 msgr2=0x7f94a00d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:35.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.744+0000 7f949effd700 1 --2- 172.21.15.45:0/1162909694 >> v2:172.21.15.152:3300/0 conn(0x7f94a0161340 0x7f94a00d1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:35.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.744+0000 7f949effd700 1 -- 172.21.15.45:0/1162909694 >> v1:172.21.15.152:6789/0 conn(0x7f94a00d2320 legacy=0x7f94a00cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:35.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.744+0000 7f949effd700 1 -- 172.21.15.45:0/1162909694 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94a00d1300 con 0x7f94a015c9b0 2023-11-28T12:07:35.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.744+0000 7f949effd700 1 --2- 172.21.15.45:0/1162909694 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94a015c9b0 0x7f94a00b4bf0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f94a00685c0 tx=0x7f9490009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb78fb7939aafd2d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:35.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.745+0000 7f949dffb700 1 -- 172.21.15.45:0/1162909694 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9490004230 con 0x7f94a015c9b0 2023-11-28T12:07:35.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.745+0000 7f949dffb700 1 -- 172.21.15.45:0/1162909694 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9490004390 con 0x7f94a015c9b0 2023-11-28T12:07:35.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.745+0000 7f949dffb700 1 -- 172.21.15.45:0/1162909694 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94900036a0 con 0x7f94a015c9b0 2023-11-28T12:07:35.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.745+0000 7f94a57ff700 1 -- 172.21.15.45:0/1162909694 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94a015c9b0 msgr2=0x7f94a00b4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:35.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.745+0000 7f94a57ff700 1 --2- 172.21.15.45:0/1162909694 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94a015c9b0 0x7f94a00b4bf0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f94a00685c0 tx=0x7f9490009bd0 comp rx=0 tx=0).stop 2023-11-28T12:07:35.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.745+0000 7f94a57ff700 1 -- 172.21.15.45:0/1162909694 shutdown_connections 2023-11-28T12:07:35.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.745+0000 7f94a57ff700 1 --2- 172.21.15.45:0/1162909694 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94a015c9b0 0x7f94a00b4bf0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:35.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.745+0000 7f94a57ff700 1 --2- 172.21.15.45:0/1162909694 >> v2:172.21.15.152:3300/0 conn(0x7f94a0161340 0x7f94a00d1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:35.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.745+0000 7f94a57ff700 1 -- 172.21.15.45:0/1162909694 >> 172.21.15.45:0/1162909694 conn(0x7f94a0072600 msgr2=0x7f94a00cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:35.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.745+0000 7f94a57ff700 1 -- 172.21.15.45:0/1162909694 shutdown_connections 2023-11-28T12:07:35.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.745+0000 7f94a57ff700 1 -- 172.21.15.45:0/1162909694 wait complete. 2023-11-28T12:07:35.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.747+0000 7f94a57ff700 1 Processor -- start 2023-11-28T12:07:35.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.747+0000 7f94a57ff700 1 -- start start 2023-11-28T12:07:35.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.748+0000 7f94a57ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f94a00d2320 0x7f94a014b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:35.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.748+0000 7f94a57ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94a015c9b0 0x7f94a0158500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:35.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.748+0000 7f94a57ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f94a0161340 0x7f94a014fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:35.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.748+0000 7f94a57ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94a01599b0 con 0x7f94a015c9b0 2023-11-28T12:07:35.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.748+0000 7f94a57ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94a0158d30 con 0x7f94a0161340 2023-11-28T12:07:35.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.748+0000 7f94a57ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94a0159010 con 0x7f94a00d2320 2023-11-28T12:07:35.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.748+0000 7f949e7fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94a015c9b0 0x7f94a0158500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:35.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.748+0000 7f949e7fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94a015c9b0 0x7f94a0158500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47458/0 (socket says 172.21.15.45:47458) 2023-11-28T12:07:35.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.748+0000 7f949e7fc700 1 -- 172.21.15.45:0/3379000530 learned_addr learned my addr 172.21.15.45:0/3379000530 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:35.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.748+0000 7f949f7fe700 1 --2- 172.21.15.45:0/3379000530 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f94a0161340 0x7f94a014fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:35.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.748+0000 7f949effd700 1 --2- 172.21.15.45:0/3379000530 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f94a00d2320 0x7f94a014b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:35.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.749+0000 7f949e7fc700 1 -- 172.21.15.45:0/3379000530 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f94a00d2320 msgr2=0x7f94a014b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:35.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.749+0000 7f949e7fc700 1 --2- 172.21.15.45:0/3379000530 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f94a00d2320 0x7f94a014b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:35.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.749+0000 7f949e7fc700 1 -- 172.21.15.45:0/3379000530 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f94a0161340 msgr2=0x7f94a014fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:35.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.749+0000 7f949e7fc700 1 --2- 172.21.15.45:0/3379000530 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f94a0161340 0x7f94a014fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:35.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.749+0000 7f949e7fc700 1 -- 172.21.15.45:0/3379000530 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9490009550 con 0x7f94a015c9b0 2023-11-28T12:07:35.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.749+0000 7f949f7fe700 1 --2- 172.21.15.45:0/3379000530 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f94a0161340 0x7f94a014fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:07:35.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.749+0000 7f949e7fc700 1 --2- 172.21.15.45:0/3379000530 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94a015c9b0 0x7f94a0158500 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f949400e810 tx=0x7f949400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:35.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.749+0000 7f94877fe700 1 -- 172.21.15.45:0/3379000530 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9494013610 con 0x7f94a015c9b0 2023-11-28T12:07:35.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.749+0000 7f94877fe700 1 -- 172.21.15.45:0/3379000530 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9494013770 con 0x7f94a015c9b0 2023-11-28T12:07:35.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.749+0000 7f94a57ff700 1 -- 172.21.15.45:0/3379000530 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94a00b5130 con 0x7f94a015c9b0 2023-11-28T12:07:35.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.749+0000 7f94877fe700 1 -- 172.21.15.45:0/3379000530 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9494013b20 con 0x7f94a015c9b0 2023-11-28T12:07:35.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.749+0000 7f94a57ff700 1 -- 172.21.15.45:0/3379000530 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94a00d15e0 con 0x7f94a015c9b0 2023-11-28T12:07:35.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.750+0000 7f94a57ff700 1 -- 172.21.15.45:0/3379000530 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94a00b52c0 con 0x7f94a015c9b0 2023-11-28T12:07:35.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.751+0000 7f94877fe700 1 -- 172.21.15.45:0/3379000530 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f9494023070 con 0x7f94a015c9b0 2023-11-28T12:07:35.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.753+0000 7f94877fe700 1 --2- 172.21.15.45:0/3379000530 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f948c0682f0 0x7f948c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:35.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.753+0000 7f94877fe700 1 -- 172.21.15.45:0/3379000530 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f9494085690 con 0x7f94a015c9b0 2023-11-28T12:07:35.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.753+0000 7f949effd700 1 --2- 172.21.15.45:0/3379000530 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f948c0682f0 0x7f948c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:35.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.754+0000 7f949effd700 1 --2- 172.21.15.45:0/3379000530 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f948c0682f0 0x7f948c06a7a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9490009130 tx=0x7f9490008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:35.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:35.757+0000 7f94877fe700 1 -- 172.21.15.45:0/3379000530 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f94940520d0 con 0x7f94a015c9b0 2023-11-28T12:07:36.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.037+0000 7f94a57ff700 1 -- 172.21.15.45:0/3379000530 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f94a00745c0 con 0x7f94a015c9b0 2023-11-28T12:07:36.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.041+0000 7f94877fe700 1 -- 172.21.15.45:0/3379000530 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f94940556f0 con 0x7f94a015c9b0 2023-11-28T12:07:36.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.043+0000 7f94a57ff700 1 -- 172.21.15.45:0/3379000530 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f948c0682f0 msgr2=0x7f948c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:36.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.043+0000 7f94a57ff700 1 --2- 172.21.15.45:0/3379000530 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f948c0682f0 0x7f948c06a7a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9490009130 tx=0x7f9490008030 comp rx=0 tx=0).stop 2023-11-28T12:07:36.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.043+0000 7f94a57ff700 1 -- 172.21.15.45:0/3379000530 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94a015c9b0 msgr2=0x7f94a0158500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:36.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.043+0000 7f94a57ff700 1 --2- 172.21.15.45:0/3379000530 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94a015c9b0 0x7f94a0158500 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f949400e810 tx=0x7f949400eb20 comp rx=0 tx=0).stop 2023-11-28T12:07:36.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.043+0000 7f94a57ff700 1 -- 172.21.15.45:0/3379000530 shutdown_connections 2023-11-28T12:07:36.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.043+0000 7f94a57ff700 1 --2- 172.21.15.45:0/3379000530 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f948c0682f0 0x7f948c06a7a0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:36.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.043+0000 7f94a57ff700 1 --2- 172.21.15.45:0/3379000530 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f94a0161340 0x7f94a014fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:36.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.043+0000 7f94a57ff700 1 --2- 172.21.15.45:0/3379000530 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f94a00d2320 0x7f94a014b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:36.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.043+0000 7f94a57ff700 1 --2- 172.21.15.45:0/3379000530 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94a015c9b0 0x7f94a0158500 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:36.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.043+0000 7f94a57ff700 1 -- 172.21.15.45:0/3379000530 >> 172.21.15.45:0/3379000530 conn(0x7f94a0072600 msgr2=0x7f94a00b7f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:36.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.044+0000 7f94a57ff700 1 -- 172.21.15.45:0/3379000530 shutdown_connections 2023-11-28T12:07:36.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.044+0000 7f94a57ff700 1 -- 172.21.15.45:0/3379000530 wait complete. 2023-11-28T12:07:36.062 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-11-28T12:07:36.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.268+0000 7f3c709ff700 1 Processor -- start 2023-11-28T12:07:36.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.268+0000 7f3c709ff700 1 -- start start 2023-11-28T12:07:36.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.269+0000 7f3c709ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f3c6c15c9b0 0x7f3c6c0b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:36.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.269+0000 7f3c709ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3c6c161340 0x7f3c6c0d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:36.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.269+0000 7f3c709ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c6c0d1950 con 0x7f3c6c0d2320 2023-11-28T12:07:36.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.269+0000 7f3c709ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c6c0b5800 con 0x7f3c6c15c9b0 2023-11-28T12:07:36.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.269+0000 7f3c709ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c6c0b5520 con 0x7f3c6c161340 2023-11-28T12:07:36.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.270+0000 7f3c6a59c700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f3c6c15c9b0 0x7f3c6c0b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:36.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.270+0000 7f3c63fff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3c6c161340 0x7f3c6c0d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:36.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.270+0000 7f3c6a59c700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f3c6c15c9b0 0x7f3c6c0b4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.45:59636/0 (socket says 172.21.15.45:59636) 2023-11-28T12:07:36.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.270+0000 7f3c6a59c700 1 -- 172.21.15.45:0/3878597376 learned_addr learned my addr 172.21.15.45:0/3878597376 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:36.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.270+0000 7f3c6ad9d700 1 --1- 172.21.15.45:0/3878597376 >> v1:172.21.15.152:6789/0 conn(0x7f3c6c0d2320 0x7f3c6c0cd7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.45:54536/0 (socket says 172.21.15.45:54536) 2023-11-28T12:07:36.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.271+0000 7f3c63fff700 1 -- 172.21.15.45:0/3878597376 >> v2:172.21.15.152:3300/0 conn(0x7f3c6c15c9b0 msgr2=0x7f3c6c0b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:36.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.271+0000 7f3c63fff700 1 --2- 172.21.15.45:0/3878597376 >> v2:172.21.15.152:3300/0 conn(0x7f3c6c15c9b0 0x7f3c6c0b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:36.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.271+0000 7f3c63fff700 1 -- 172.21.15.45:0/3878597376 >> v1:172.21.15.152:6789/0 conn(0x7f3c6c0d2320 legacy=0x7f3c6c0cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:36.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.271+0000 7f3c63fff700 1 -- 172.21.15.45:0/3878597376 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c6c0d1300 con 0x7f3c6c161340 2023-11-28T12:07:36.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.271+0000 7f3c6a59c700 1 --2- 172.21.15.45:0/3878597376 >> v2:172.21.15.152:3300/0 conn(0x7f3c6c15c9b0 0x7f3c6c0b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:07:36.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.271+0000 7f3c63fff700 1 --2- 172.21.15.45:0/3878597376 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3c6c161340 0x7f3c6c0d1de0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3c54009840 tx=0x7f3c54009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7ca2e8d9646a71d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:36.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.271+0000 7f3c69d9b700 1 -- 172.21.15.45:0/3878597376 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c54011830 con 0x7f3c6c161340 2023-11-28T12:07:36.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.271+0000 7f3c69d9b700 1 -- 172.21.15.45:0/3878597376 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c54011990 con 0x7f3c6c161340 2023-11-28T12:07:36.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.271+0000 7f3c69d9b700 1 -- 172.21.15.45:0/3878597376 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c54011d20 con 0x7f3c6c161340 2023-11-28T12:07:36.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.272+0000 7f3c709ff700 1 -- 172.21.15.45:0/3878597376 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3c6c161340 msgr2=0x7f3c6c0d1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:36.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.272+0000 7f3c709ff700 1 --2- 172.21.15.45:0/3878597376 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3c6c161340 0x7f3c6c0d1de0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3c54009840 tx=0x7f3c54009b50 comp rx=0 tx=0).stop 2023-11-28T12:07:36.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.272+0000 7f3c709ff700 1 -- 172.21.15.45:0/3878597376 shutdown_connections 2023-11-28T12:07:36.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.272+0000 7f3c709ff700 1 --2- 172.21.15.45:0/3878597376 >> v2:172.21.15.152:3300/0 conn(0x7f3c6c15c9b0 0x7f3c6c0b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:36.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.272+0000 7f3c709ff700 1 --2- 172.21.15.45:0/3878597376 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3c6c161340 0x7f3c6c0d1de0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:36.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.272+0000 7f3c709ff700 1 -- 172.21.15.45:0/3878597376 >> 172.21.15.45:0/3878597376 conn(0x7f3c6c072600 msgr2=0x7f3c6c0cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:36.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.272+0000 7f3c709ff700 1 -- 172.21.15.45:0/3878597376 shutdown_connections 2023-11-28T12:07:36.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.272+0000 7f3c709ff700 1 -- 172.21.15.45:0/3878597376 wait complete. 2023-11-28T12:07:36.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.274+0000 7f3c709ff700 1 Processor -- start 2023-11-28T12:07:36.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.274+0000 7f3c709ff700 1 -- start start 2023-11-28T12:07:36.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.275+0000 7f3c709ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c6c0d2320 0x7f3c6c151680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:36.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.275+0000 7f3c709ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3c6c15c9b0 0x7f3c6c15f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:36.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.275+0000 7f3c709ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c6c161340 0x7f3c6c15f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:36.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.275+0000 7f3c709ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c6c1520d0 con 0x7f3c6c161340 2023-11-28T12:07:36.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.275+0000 7f3c709ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c6c1523b0 con 0x7f3c6c0d2320 2023-11-28T12:07:36.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.275+0000 7f3c709ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c6c152690 con 0x7f3c6c15c9b0 2023-11-28T12:07:36.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.275+0000 7f3c6ad9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c6c161340 0x7f3c6c15f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:36.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.275+0000 7f3c6ad9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c6c161340 0x7f3c6c15f740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47470/0 (socket says 172.21.15.45:47470) 2023-11-28T12:07:36.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.275+0000 7f3c6ad9d700 1 -- 172.21.15.45:0/3485818234 learned_addr learned my addr 172.21.15.45:0/3485818234 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:36.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.275+0000 7f3c6a59c700 1 --2- 172.21.15.45:0/3485818234 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c6c0d2320 0x7f3c6c151680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:36.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.275+0000 7f3c63fff700 1 --2- 172.21.15.45:0/3485818234 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3c6c15c9b0 0x7f3c6c15f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:36.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.275+0000 7f3c6ad9d700 1 -- 172.21.15.45:0/3485818234 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3c6c15c9b0 msgr2=0x7f3c6c15f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:36.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.275+0000 7f3c6ad9d700 1 --2- 172.21.15.45:0/3485818234 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3c6c15c9b0 0x7f3c6c15f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:36.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.276+0000 7f3c6ad9d700 1 -- 172.21.15.45:0/3485818234 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c6c0d2320 msgr2=0x7f3c6c151680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:36.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.276+0000 7f3c6ad9d700 1 --2- 172.21.15.45:0/3485818234 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c6c0d2320 0x7f3c6c151680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:36.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.276+0000 7f3c6ad9d700 1 -- 172.21.15.45:0/3485818234 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c5c009550 con 0x7f3c6c161340 2023-11-28T12:07:36.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.276+0000 7f3c63fff700 1 --2- 172.21.15.45:0/3485818234 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3c6c15c9b0 0x7f3c6c15f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:07:36.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.276+0000 7f3c6a59c700 1 --2- 172.21.15.45:0/3485818234 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c6c0d2320 0x7f3c6c151680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:07:36.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.276+0000 7f3c6ad9d700 1 --2- 172.21.15.45:0/3485818234 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c6c161340 0x7f3c6c15f740 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3c6400cbc0 tx=0x7f3c6400cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:36.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.276+0000 7f3c62ffd700 1 -- 172.21.15.45:0/3485818234 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c6400ab50 con 0x7f3c6c161340 2023-11-28T12:07:36.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.276+0000 7f3c62ffd700 1 -- 172.21.15.45:0/3485818234 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c6400acb0 con 0x7f3c6c161340 2023-11-28T12:07:36.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.276+0000 7f3c62ffd700 1 -- 172.21.15.45:0/3485818234 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c64007270 con 0x7f3c6c161340 2023-11-28T12:07:36.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.276+0000 7f3c709ff700 1 -- 172.21.15.45:0/3485818234 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c540094a0 con 0x7f3c6c161340 2023-11-28T12:07:36.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.276+0000 7f3c709ff700 1 -- 172.21.15.45:0/3485818234 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c6c0b5130 con 0x7f3c6c161340 2023-11-28T12:07:36.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.277+0000 7f3c709ff700 1 -- 172.21.15.45:0/3485818234 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c6c0d15e0 con 0x7f3c6c161340 2023-11-28T12:07:36.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.278+0000 7f3c62ffd700 1 -- 172.21.15.45:0/3485818234 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f3c64019030 con 0x7f3c6c161340 2023-11-28T12:07:36.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.279+0000 7f3c62ffd700 1 --2- 172.21.15.45:0/3485818234 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f3c4c0682f0 0x7f3c4c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:36.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.279+0000 7f3c62ffd700 1 -- 172.21.15.45:0/3485818234 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f3c640855b0 con 0x7f3c6c161340 2023-11-28T12:07:36.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.280+0000 7f3c6a59c700 1 --2- 172.21.15.45:0/3485818234 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f3c4c0682f0 0x7f3c4c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:36.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.280+0000 7f3c6a59c700 1 --2- 172.21.15.45:0/3485818234 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f3c4c0682f0 0x7f3c4c06a7a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c009db0 tx=0x7f3c5c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:36.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.283+0000 7f3c62ffd700 1 -- 172.21.15.45:0/3485818234 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f3c6404b5e0 con 0x7f3c6c161340 2023-11-28T12:07:36.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.569+0000 7f3c709ff700 1 -- 172.21.15.45:0/3485818234 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f3c6c0b52c0 con 0x7f3c6c161340 2023-11-28T12:07:36.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.573+0000 7f3c62ffd700 1 -- 172.21.15.45:0/3485818234 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7f3c64017020 con 0x7f3c6c161340 2023-11-28T12:07:36.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.575+0000 7f3c709ff700 1 -- 172.21.15.45:0/3485818234 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f3c4c0682f0 msgr2=0x7f3c4c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:36.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.575+0000 7f3c709ff700 1 --2- 172.21.15.45:0/3485818234 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f3c4c0682f0 0x7f3c4c06a7a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c009db0 tx=0x7f3c5c008040 comp rx=0 tx=0).stop 2023-11-28T12:07:36.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.575+0000 7f3c709ff700 1 -- 172.21.15.45:0/3485818234 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c6c161340 msgr2=0x7f3c6c15f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:36.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.575+0000 7f3c709ff700 1 --2- 172.21.15.45:0/3485818234 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c6c161340 0x7f3c6c15f740 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3c6400cbc0 tx=0x7f3c6400cf80 comp rx=0 tx=0).stop 2023-11-28T12:07:36.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.575+0000 7f3c709ff700 1 -- 172.21.15.45:0/3485818234 shutdown_connections 2023-11-28T12:07:36.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.575+0000 7f3c709ff700 1 --2- 172.21.15.45:0/3485818234 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f3c4c0682f0 0x7f3c4c06a7a0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:36.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.575+0000 7f3c709ff700 1 --2- 172.21.15.45:0/3485818234 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c6c0d2320 0x7f3c6c151680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:36.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.575+0000 7f3c709ff700 1 --2- 172.21.15.45:0/3485818234 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c6c161340 0x7f3c6c15f740 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:36.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.575+0000 7f3c709ff700 1 --2- 172.21.15.45:0/3485818234 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3c6c15c9b0 0x7f3c6c15f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:36.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.575+0000 7f3c709ff700 1 -- 172.21.15.45:0/3485818234 >> 172.21.15.45:0/3485818234 conn(0x7f3c6c072600 msgr2=0x7f3c6c15d090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:36.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.575+0000 7f3c709ff700 1 -- 172.21.15.45:0/3485818234 shutdown_connections 2023-11-28T12:07:36.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.575+0000 7f3c709ff700 1 -- 172.21.15.45:0/3485818234 wait complete. 2023-11-28T12:07:36.594 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-11-28T12:07:36.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.798+0000 7f72bb9ff700 1 Processor -- start 2023-11-28T12:07:36.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.798+0000 7f72bb9ff700 1 -- start start 2023-11-28T12:07:36.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.799+0000 7f72bb9ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f72b415c9b0 0x7f72b40b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:36.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.800+0000 7f72bb9ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72b40d1950 con 0x7f72b4161340 2023-11-28T12:07:36.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.800+0000 7f72bb9ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72b40d24f0 con 0x7f72b40cd7c0 2023-11-28T12:07:36.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.800+0000 7f72bb9ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72b40b5800 con 0x7f72b415c9b0 2023-11-28T12:07:36.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.800+0000 7f72b979b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f72b415c9b0 0x7f72b40b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:36.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.800+0000 7f72b8f9a700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f72b4161340 0x7f72b40d1de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41292/0 (socket says 172.21.15.45:41292) 2023-11-28T12:07:36.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.800+0000 7f72b979b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f72b415c9b0 0x7f72b40b4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47486/0 (socket says 172.21.15.45:47486) 2023-11-28T12:07:36.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.800+0000 7f72b8f9a700 1 -- 172.21.15.45:0/2012927565 learned_addr learned my addr 172.21.15.45:0/2012927565 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:07:36.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.800+0000 7f72b979b700 1 -- 172.21.15.45:0/2012927565 >> v1:172.21.15.152:6789/0 conn(0x7f72b40cd7c0 legacy=0x7f72b40b5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:36.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.800+0000 7f72b979b700 1 -- 172.21.15.45:0/2012927565 >> v1:172.21.15.45:6789/0 conn(0x7f72b4161340 legacy=0x7f72b40d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:36.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.800+0000 7f72b979b700 1 -- 172.21.15.45:0/2012927565 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72b40b5520 con 0x7f72b415c9b0 2023-11-28T12:07:36.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.800+0000 7f72abfff700 1 -- 172.21.15.45:0/2012927565 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2125547926 0 0) 0x7f72b40d1950 con 0x7f72b4161340 2023-11-28T12:07:36.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.801+0000 7f72b979b700 1 --2- 172.21.15.45:0/2012927565 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72b415c9b0 0x7f72b40b4bf0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f72b0009840 tx=0x7f72b0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd1497a1f18f2e17 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:36.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.801+0000 7f72abfff700 1 -- 172.21.15.45:0/2012927565 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b0004230 con 0x7f72b415c9b0 2023-11-28T12:07:36.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.801+0000 7f72abfff700 1 -- 172.21.15.45:0/2012927565 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72b0004390 con 0x7f72b415c9b0 2023-11-28T12:07:36.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.801+0000 7f72abfff700 1 -- 172.21.15.45:0/2012927565 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b00036a0 con 0x7f72b415c9b0 2023-11-28T12:07:36.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.801+0000 7f72bb9ff700 1 -- 172.21.15.45:0/2012927565 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72b415c9b0 msgr2=0x7f72b40b4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:36.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.801+0000 7f72bb9ff700 1 --2- 172.21.15.45:0/2012927565 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72b415c9b0 0x7f72b40b4bf0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f72b0009840 tx=0x7f72b0009b50 comp rx=0 tx=0).stop 2023-11-28T12:07:36.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.802+0000 7f72bb9ff700 1 -- 172.21.15.45:0/2012927565 shutdown_connections 2023-11-28T12:07:36.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.802+0000 7f72bb9ff700 1 --2- 172.21.15.45:0/2012927565 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72b415c9b0 0x7f72b40b4bf0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:36.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.802+0000 7f72bb9ff700 1 -- 172.21.15.45:0/2012927565 >> 172.21.15.45:0/2012927565 conn(0x7f72b4072600 msgr2=0x7f72b40cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:36.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.802+0000 7f72bb9ff700 1 -- 172.21.15.45:0/2012927565 shutdown_connections 2023-11-28T12:07:36.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.802+0000 7f72bb9ff700 1 -- 172.21.15.45:0/2012927565 wait complete. 2023-11-28T12:07:36.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.803+0000 7f72bb9ff700 1 Processor -- start 2023-11-28T12:07:36.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.803+0000 7f72bb9ff700 1 -- start start 2023-11-28T12:07:36.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.804+0000 7f72bb9ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f72b40cd7c0 0x7f72b40c9860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:36.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.804+0000 7f72bb9ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f72b415c9b0 0x7f72b40cb9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:36.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.804+0000 7f72bb9ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72b4161340 0x7f72b415e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:36.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.804+0000 7f72bb9ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72b41f5fd0 con 0x7f72b4161340 2023-11-28T12:07:36.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.804+0000 7f72bb9ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72b41f62b0 con 0x7f72b415c9b0 2023-11-28T12:07:36.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.804+0000 7f72bb9ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72b41f6590 con 0x7f72b40cd7c0 2023-11-28T12:07:36.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.805+0000 7f72b9f9c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72b4161340 0x7f72b415e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:36.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.805+0000 7f72b8f9a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f72b415c9b0 0x7f72b40cb9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:36.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.805+0000 7f72b9f9c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72b4161340 0x7f72b415e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47498/0 (socket says 172.21.15.45:47498) 2023-11-28T12:07:36.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.805+0000 7f72b9f9c700 1 -- 172.21.15.45:0/4132501855 learned_addr learned my addr 172.21.15.45:0/4132501855 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:36.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.805+0000 7f72b979b700 1 --2- 172.21.15.45:0/4132501855 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f72b40cd7c0 0x7f72b40c9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:36.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.805+0000 7f72b9f9c700 1 -- 172.21.15.45:0/4132501855 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f72b40cd7c0 msgr2=0x7f72b40c9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:36.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.805+0000 7f72b9f9c700 1 --2- 172.21.15.45:0/4132501855 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f72b40cd7c0 0x7f72b40c9860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:36.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.805+0000 7f72b9f9c700 1 -- 172.21.15.45:0/4132501855 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f72b415c9b0 msgr2=0x7f72b40cb9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:36.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.805+0000 7f72b9f9c700 1 --2- 172.21.15.45:0/4132501855 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f72b415c9b0 0x7f72b40cb9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:36.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.805+0000 7f72b9f9c700 1 -- 172.21.15.45:0/4132501855 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72b00094a0 con 0x7f72b4161340 2023-11-28T12:07:36.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.806+0000 7f72b9f9c700 1 --2- 172.21.15.45:0/4132501855 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72b4161340 0x7f72b415e500 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f72ac00b970 tx=0x7f72ac00bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:36.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.806+0000 7f72a9ffb700 1 -- 172.21.15.45:0/4132501855 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72ac00d860 con 0x7f72b4161340 2023-11-28T12:07:36.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.806+0000 7f72a9ffb700 1 -- 172.21.15.45:0/4132501855 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72ac00d9c0 con 0x7f72b4161340 2023-11-28T12:07:36.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.806+0000 7f72a9ffb700 1 -- 172.21.15.45:0/4132501855 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72ac00dd70 con 0x7f72b4161340 2023-11-28T12:07:36.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.806+0000 7f72bb9ff700 1 -- 172.21.15.45:0/4132501855 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72b40d15e0 con 0x7f72b4161340 2023-11-28T12:07:36.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.806+0000 7f72bb9ff700 1 -- 172.21.15.45:0/4132501855 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72b40d1300 con 0x7f72b4161340 2023-11-28T12:07:36.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.807+0000 7f72bb9ff700 1 -- 172.21.15.45:0/4132501855 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72b40b5130 con 0x7f72b4161340 2023-11-28T12:07:36.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.808+0000 7f72a9ffb700 1 -- 172.21.15.45:0/4132501855 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f72ac00e430 con 0x7f72b4161340 2023-11-28T12:07:36.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.809+0000 7f72a9ffb700 1 --2- 172.21.15.45:0/4132501855 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f72980682f0 0x7f729806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:36.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.809+0000 7f72a9ffb700 1 -- 172.21.15.45:0/4132501855 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f72ac085c70 con 0x7f72b4161340 2023-11-28T12:07:36.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.809+0000 7f72b979b700 1 --2- 172.21.15.45:0/4132501855 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f72980682f0 0x7f729806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:36.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.810+0000 7f72b979b700 1 --2- 172.21.15.45:0/4132501855 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f72980682f0 0x7f729806a7a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f72b00090b0 tx=0x7f72b0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:36.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:36.813+0000 7f72a9ffb700 1 -- 172.21.15.45:0/4132501855 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f72ac0526d0 con 0x7f72b4161340 2023-11-28T12:07:37.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.100+0000 7f72bb9ff700 1 -- 172.21.15.45:0/4132501855 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f72b4067c00 con 0x7f72b4161340 2023-11-28T12:07:37.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.104+0000 7f72a9ffb700 1 -- 172.21.15.45:0/4132501855 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f72ac055cf0 con 0x7f72b4161340 2023-11-28T12:07:37.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.107+0000 7f72bb9ff700 1 -- 172.21.15.45:0/4132501855 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f72980682f0 msgr2=0x7f729806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:37.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.107+0000 7f72bb9ff700 1 --2- 172.21.15.45:0/4132501855 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f72980682f0 0x7f729806a7a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f72b00090b0 tx=0x7f72b0008030 comp rx=0 tx=0).stop 2023-11-28T12:07:37.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.107+0000 7f72bb9ff700 1 -- 172.21.15.45:0/4132501855 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72b4161340 msgr2=0x7f72b415e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:37.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.107+0000 7f72bb9ff700 1 --2- 172.21.15.45:0/4132501855 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72b4161340 0x7f72b415e500 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f72ac00b970 tx=0x7f72ac00bc80 comp rx=0 tx=0).stop 2023-11-28T12:07:37.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.107+0000 7f72bb9ff700 1 -- 172.21.15.45:0/4132501855 shutdown_connections 2023-11-28T12:07:37.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.107+0000 7f72bb9ff700 1 --2- 172.21.15.45:0/4132501855 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f72980682f0 0x7f729806a7a0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:37.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.107+0000 7f72bb9ff700 1 --2- 172.21.15.45:0/4132501855 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72b4161340 0x7f72b415e500 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:37.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.107+0000 7f72bb9ff700 1 --2- 172.21.15.45:0/4132501855 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f72b40cd7c0 0x7f72b40c9860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:37.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.107+0000 7f72bb9ff700 1 --2- 172.21.15.45:0/4132501855 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f72b415c9b0 0x7f72b40cb9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:37.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.107+0000 7f72bb9ff700 1 -- 172.21.15.45:0/4132501855 >> 172.21.15.45:0/4132501855 conn(0x7f72b4072600 msgr2=0x7f72b40d1de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:37.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.107+0000 7f72bb9ff700 1 -- 172.21.15.45:0/4132501855 shutdown_connections 2023-11-28T12:07:37.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.107+0000 7f72bb9ff700 1 -- 172.21.15.45:0/4132501855 wait complete. 2023-11-28T12:07:37.127 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T12:07:37.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.332+0000 7f072f1ff700 1 Processor -- start 2023-11-28T12:07:37.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.332+0000 7f072f1ff700 1 -- start start 2023-11-28T12:07:37.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.333+0000 7f072f1ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f07280cd7c0 0x7f07280cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:37.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.333+0000 7f072f1ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07280d1950 con 0x7f072815c9b0 2023-11-28T12:07:37.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.333+0000 7f072f1ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07280ce140 con 0x7f0728161340 2023-11-28T12:07:37.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.333+0000 7f072f1ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07280b5800 con 0x7f07280cd7c0 2023-11-28T12:07:37.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.333+0000 7f072cf9b700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f072815c9b0 0x7f07280b4bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41294/0 (socket says 172.21.15.45:41294) 2023-11-28T12:07:37.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.333+0000 7f072cf9b700 1 -- 172.21.15.45:0/2988957956 learned_addr learned my addr 172.21.15.45:0/2988957956 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:07:37.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.334+0000 7f07277fe700 1 -- 172.21.15.45:0/2988957956 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3665003611 0 0) 0x7f07280d1950 con 0x7f072815c9b0 2023-11-28T12:07:37.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.334+0000 7f072d79c700 1 --2- 172.21.15.45:0/2988957956 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f07280cd7c0 0x7f07280cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:37.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.334+0000 7f07277fe700 1 -- 172.21.15.45:0/2988957956 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07180035b0 con 0x7f072815c9b0 2023-11-28T12:07:37.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.334+0000 7f07277fe700 1 -- 172.21.15.45:0/2988957956 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 70563282 0 0) 0x7f07180035b0 con 0x7f072815c9b0 2023-11-28T12:07:37.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.334+0000 7f07277fe700 1 -- 172.21.15.45:0/2988957956 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f07280cd7c0 msgr2=0x7f07280cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:37.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.334+0000 7f07277fe700 1 --2- 172.21.15.45:0/2988957956 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f07280cd7c0 0x7f07280cdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:37.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.334+0000 7f07277fe700 1 -- 172.21.15.45:0/2988957956 >> v1:172.21.15.152:6789/0 conn(0x7f0728161340 legacy=0x7f07280d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:37.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.334+0000 7f07277fe700 1 -- 172.21.15.45:0/2988957956 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07280d24f0 con 0x7f072815c9b0 2023-11-28T12:07:37.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.334+0000 7f07277fe700 1 -- 172.21.15.45:0/2988957956 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3460218165 0 0) 0x7f071c001670 con 0x7f072815c9b0 2023-11-28T12:07:37.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.334+0000 7f07277fe700 1 -- 172.21.15.45:0/2988957956 >> v1:172.21.15.45:6789/0 conn(0x7f072815c9b0 legacy=0x7f07280b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:37.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.334+0000 7f07277fe700 1 --2- 172.21.15.45:0/2988957956 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0718003a30 0x7f0718003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:37.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.334+0000 7f07277fe700 1 --2- 172.21.15.45:0/2988957956 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f07280cd7c0 0x7f0718004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:37.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.334+0000 7f07277fe700 1 --2- 172.21.15.45:0/2988957956 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0718004d90 0x7f0718005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:37.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.334+0000 7f07277fe700 1 -- 172.21.15.45:0/2988957956 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07280b5800 con 0x7f0718003a30 2023-11-28T12:07:37.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.334+0000 7f07277fe700 1 -- 172.21.15.45:0/2988957956 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f071800bac0 con 0x7f0718004d90 2023-11-28T12:07:37.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.335+0000 7f07277fe700 1 -- 172.21.15.45:0/2988957956 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f071800bc80 con 0x7f07280cd7c0 2023-11-28T12:07:37.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.335+0000 7f072cf9b700 1 --2- 172.21.15.45:0/2988957956 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0718003a30 0x7f0718003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:37.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.335+0000 7f072d79c700 1 --2- 172.21.15.45:0/2988957956 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0718004d90 0x7f0718005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:37.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.335+0000 7f0727fff700 1 --2- 172.21.15.45:0/2988957956 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f07280cd7c0 0x7f0718004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:37.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.335+0000 7f072cf9b700 1 -- 172.21.15.45:0/2988957956 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f07280cd7c0 msgr2=0x7f0718004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:37.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.335+0000 7f072cf9b700 1 --2- 172.21.15.45:0/2988957956 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f07280cd7c0 0x7f0718004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:37.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.335+0000 7f072cf9b700 1 -- 172.21.15.45:0/2988957956 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0718004d90 msgr2=0x7f0718005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:37.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.335+0000 7f072cf9b700 1 --2- 172.21.15.45:0/2988957956 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0718004d90 0x7f0718005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:37.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.335+0000 7f072cf9b700 1 -- 172.21.15.45:0/2988957956 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07180035b0 con 0x7f0718003a30 2023-11-28T12:07:37.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.335+0000 7f072d79c700 1 --2- 172.21.15.45:0/2988957956 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0718004d90 0x7f0718005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:07:37.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.335+0000 7f072cf9b700 1 --2- 172.21.15.45:0/2988957956 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0718003a30 0x7f0718003e00 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f071c00c240 tx=0x7f0718005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30ddefc3b1d90e6f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:37.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.336+0000 7f07277fe700 1 -- 172.21.15.45:0/2988957956 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f071c00cd80 con 0x7f0718003a30 2023-11-28T12:07:37.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.336+0000 7f07277fe700 1 -- 172.21.15.45:0/2988957956 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f071c005960 con 0x7f0718003a30 2023-11-28T12:07:37.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.336+0000 7f07277fe700 1 -- 172.21.15.45:0/2988957956 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f071c005d10 con 0x7f0718003a30 2023-11-28T12:07:37.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.336+0000 7f072f1ff700 1 -- 172.21.15.45:0/2988957956 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0718003a30 msgr2=0x7f0718003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:37.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.336+0000 7f072f1ff700 1 --2- 172.21.15.45:0/2988957956 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0718003a30 0x7f0718003e00 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f071c00c240 tx=0x7f0718005880 comp rx=0 tx=0).stop 2023-11-28T12:07:37.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.336+0000 7f072d79c700 1 -- 172.21.15.45:0/2988957956 reap_dead start 2023-11-28T12:07:37.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.336+0000 7f072f1ff700 1 -- 172.21.15.45:0/2988957956 shutdown_connections 2023-11-28T12:07:37.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.336+0000 7f072f1ff700 1 -- 172.21.15.45:0/2988957956 >> 172.21.15.45:0/2988957956 conn(0x7f0728072600 msgr2=0x7f07280cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:37.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.336+0000 7f072f1ff700 1 -- 172.21.15.45:0/2988957956 shutdown_connections 2023-11-28T12:07:37.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.336+0000 7f072f1ff700 1 -- 172.21.15.45:0/2988957956 wait complete. 2023-11-28T12:07:37.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.339+0000 7f072f1ff700 1 Processor -- start 2023-11-28T12:07:37.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.339+0000 7f072f1ff700 1 -- start start 2023-11-28T12:07:37.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.340+0000 7f072f1ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0718003a30 0x7f07280c8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:37.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.340+0000 7f072f1ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f07281e8700 0x7f0728158a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:37.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.340+0000 7f072f1ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f07281e8b70 0x7f0728158f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:37.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.340+0000 7f072f1ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0728159890 con 0x7f07281e8b70 2023-11-28T12:07:37.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.340+0000 7f072f1ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f072815d4e0 con 0x7f0718003a30 2023-11-28T12:07:37.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.340+0000 7f072f1ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f072815d7c0 con 0x7f07281e8700 2023-11-28T12:07:37.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.341+0000 7f072d79c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f07281e8b70 0x7f0728158f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:37.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.341+0000 7f072d79c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f07281e8b70 0x7f0728158f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47520/0 (socket says 172.21.15.45:47520) 2023-11-28T12:07:37.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.341+0000 7f072d79c700 1 -- 172.21.15.45:0/1845928205 learned_addr learned my addr 172.21.15.45:0/1845928205 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:37.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.341+0000 7f072cf9b700 1 --2- 172.21.15.45:0/1845928205 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0718003a30 0x7f07280c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:37.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.341+0000 7f0727fff700 1 --2- 172.21.15.45:0/1845928205 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f07281e8700 0x7f0728158a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:37.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.341+0000 7f072d79c700 1 -- 172.21.15.45:0/1845928205 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f07281e8700 msgr2=0x7f0728158a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:37.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.341+0000 7f072d79c700 1 --2- 172.21.15.45:0/1845928205 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f07281e8700 0x7f0728158a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:37.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.341+0000 7f072d79c700 1 -- 172.21.15.45:0/1845928205 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0718003a30 msgr2=0x7f07280c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:37.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.341+0000 7f072d79c700 1 --2- 172.21.15.45:0/1845928205 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0718003a30 0x7f07280c8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:37.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.341+0000 7f072d79c700 1 -- 172.21.15.45:0/1845928205 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07280d1300 con 0x7f07281e8b70 2023-11-28T12:07:37.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.341+0000 7f072d79c700 1 --2- 172.21.15.45:0/1845928205 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f07281e8b70 0x7f0728158f80 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f072806bbb0 tx=0x7f07200104a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:37.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.341+0000 7f07257fa700 1 -- 172.21.15.45:0/1845928205 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f072001b070 con 0x7f07281e8b70 2023-11-28T12:07:37.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.342+0000 7f07257fa700 1 -- 172.21.15.45:0/1845928205 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f072000f040 con 0x7f07281e8b70 2023-11-28T12:07:37.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.342+0000 7f07257fa700 1 -- 172.21.15.45:0/1845928205 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f072000e050 con 0x7f07281e8b70 2023-11-28T12:07:37.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.342+0000 7f072f1ff700 1 -- 172.21.15.45:0/1845928205 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07280b5520 con 0x7f07281e8b70 2023-11-28T12:07:37.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.342+0000 7f072f1ff700 1 -- 172.21.15.45:0/1845928205 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07280d15e0 con 0x7f07281e8b70 2023-11-28T12:07:37.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.343+0000 7f072f1ff700 1 -- 172.21.15.45:0/1845928205 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07280745c0 con 0x7f07281e8b70 2023-11-28T12:07:37.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.344+0000 7f07257fa700 1 -- 172.21.15.45:0/1845928205 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f0720010d40 con 0x7f07281e8b70 2023-11-28T12:07:37.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.345+0000 7f07257fa700 1 --2- 172.21.15.45:0/1845928205 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f070c0682f0 0x7f070c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:37.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.345+0000 7f07257fa700 1 -- 172.21.15.45:0/1845928205 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f0720085b40 con 0x7f07281e8b70 2023-11-28T12:07:37.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.345+0000 7f072cf9b700 1 --2- 172.21.15.45:0/1845928205 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f070c0682f0 0x7f070c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:37.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.346+0000 7f072cf9b700 1 --2- 172.21.15.45:0/1845928205 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f070c0682f0 0x7f070c06a7a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f071c015040 tx=0x7f071c00a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:37.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.349+0000 7f07257fa700 1 -- 172.21.15.45:0/1845928205 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f0720052690 con 0x7f07281e8b70 2023-11-28T12:07:37.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.554+0000 7f072f1ff700 1 -- 172.21.15.45:0/1845928205 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f07280d08a0 con 0x7f07281e8b70 2023-11-28T12:07:37.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.555+0000 7f07257fa700 1 -- 172.21.15.45:0/1845928205 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+14209 (secure 0 0 0) 0x7f0720055cb0 con 0x7f07281e8b70 2023-11-28T12:07:37.556 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:07:37.557 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":30,"fsid":"bd7c37f1-f7c6-4778-b845-52cf2aa6e366","created":"2023-11-28T12:06:09.045075+0000","modified":"2023-11-28T12:07:33.382105+0000","last_up_change":"2023-11-28T12:06:21.282227+0000","last_in_change":"2023-11-28T12:06:12.560924+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T12:06:21.807108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T12:06:22.491009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d0cdd8a-87fd-4f2c-91bd-47bdfa661905","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":115843},{"type":"v1","addr":"172.21.15.45:6808","nonce":115843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":115843},{"type":"v1","addr":"172.21.15.45:6811","nonce":115843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":115843},{"type":"v1","addr":"172.21.15.45:6815","nonce":115843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":115843},{"type":"v1","addr":"172.21.15.45:6813","nonce":115843}]},"public_addr":"172.21.15.45:6808/115843","cluster_addr":"172.21.15.45:6811/115843","heartbeat_back_addr":"172.21.15.45:6815/115843","heartbeat_front_addr":"172.21.15.45:6813/115843","state":["exists","up"]},{"osd":1,"uuid":"c5de4ebd-9ec5-40b3-9caa-9b706fab4c76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":115842},{"type":"v1","addr":"172.21.15.45:6801","nonce":115842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":115842},{"type":"v1","addr":"172.21.15.45:6803","nonce":115842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6807","nonce":115842},{"type":"v1","addr":"172.21.15.45:6809","nonce":115842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":115842},{"type":"v1","addr":"172.21.15.45:6805","nonce":115842}]},"public_addr":"172.21.15.45:6801/115842","cluster_addr":"172.21.15.45:6803/115842","heartbeat_back_addr":"172.21.15.45:6809/115842","heartbeat_front_addr":"172.21.15.45:6805/115842","state":["exists","up"]},{"osd":2,"uuid":"9f4b36b2-65d2-40e7-9fe6-a2991afa71c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":115850},{"type":"v1","addr":"172.21.15.45:6819","nonce":115850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":115850},{"type":"v1","addr":"172.21.15.45:6823","nonce":115850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":115850},{"type":"v1","addr":"172.21.15.45:6831","nonce":115850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":115850},{"type":"v1","addr":"172.21.15.45:6828","nonce":115850}]},"public_addr":"172.21.15.45:6819/115850","cluster_addr":"172.21.15.45:6823/115850","heartbeat_back_addr":"172.21.15.45:6831/115850","heartbeat_front_addr":"172.21.15.45:6828/115850","state":["exists","up"]},{"osd":3,"uuid":"6fe7ef05-4e0d-426c-bf94-44b51d4d550b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":115848},{"type":"v1","addr":"172.21.15.45:6818","nonce":115848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":115848},{"type":"v1","addr":"172.21.15.45:6822","nonce":115848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6827","nonce":115848},{"type":"v1","addr":"172.21.15.45:6829","nonce":115848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":115848},{"type":"v1","addr":"172.21.15.45:6825","nonce":115848}]},"public_addr":"172.21.15.45:6818/115848","cluster_addr":"172.21.15.45:6822/115848","heartbeat_back_addr":"172.21.15.45:6829/115848","heartbeat_front_addr":"172.21.15.45:6825/115848","state":["exists","up"]},{"osd":4,"uuid":"fa403c08-d8a1-4a3a-8384-cb465c1a654c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":116092},{"type":"v1","addr":"172.21.15.152:6801","nonce":116092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":116092},{"type":"v1","addr":"172.21.15.152:6803","nonce":116092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":116092},{"type":"v1","addr":"172.21.15.152:6807","nonce":116092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":116092},{"type":"v1","addr":"172.21.15.152:6805","nonce":116092}]},"public_addr":"172.21.15.152:6801/116092","cluster_addr":"172.21.15.152:6803/116092","heartbeat_back_addr":"172.21.15.152:6807/116092","heartbeat_front_addr":"172.21.15.152:6805/116092","state":["exists","up"]},{"osd":5,"uuid":"399fc450-39fa-43a6-bf80-0b8bcb41bd95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6815","nonce":116093},{"type":"v1","addr":"172.21.15.152:6817","nonce":116093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":116093},{"type":"v1","addr":"172.21.15.152:6819","nonce":116093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":116093},{"type":"v1","addr":"172.21.15.152:6823","nonce":116093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":116093},{"type":"v1","addr":"172.21.15.152:6821","nonce":116093}]},"public_addr":"172.21.15.152:6817/116093","cluster_addr":"172.21.15.152:6819/116093","heartbeat_back_addr":"172.21.15.152:6823/116093","heartbeat_front_addr":"172.21.15.152:6821/116093","state":["exists","up"]},{"osd":6,"uuid":"e59a4017-2d23-4627-836b-e25b2d3ddaaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":116094},{"type":"v1","addr":"172.21.15.152:6809","nonce":116094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":116094},{"type":"v1","addr":"172.21.15.152:6811","nonce":116094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":116094},{"type":"v1","addr":"172.21.15.152:6816","nonce":116094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":116094},{"type":"v1","addr":"172.21.15.152:6813","nonce":116094}]},"public_addr":"172.21.15.152:6809/116094","cluster_addr":"172.21.15.152:6811/116094","heartbeat_back_addr":"172.21.15.152:6816/116094","heartbeat_front_addr":"172.21.15.152:6813/116094","state":["exists","up"]},{"osd":7,"uuid":"8d7f9d4b-bf08-4670-8591-388c0f012a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":116097},{"type":"v1","addr":"172.21.15.152:6825","nonce":116097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":116097},{"type":"v1","addr":"172.21.15.152:6827","nonce":116097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":116097},{"type":"v1","addr":"172.21.15.152:6831","nonce":116097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":116097},{"type":"v1","addr":"172.21.15.152:6829","nonce":116097}]},"public_addr":"172.21.15.152:6825/116097","cluster_addr":"172.21.15.152:6827/116097","heartbeat_back_addr":"172.21.15.152:6831/116097","heartbeat_front_addr":"172.21.15.152:6829/116097","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.937710+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.865423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.159434+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.913090+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.131647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.966255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.972583+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.177209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T12:07:37.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.557+0000 7f072f1ff700 1 -- 172.21.15.45:0/1845928205 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f070c0682f0 msgr2=0x7f070c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:37.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.557+0000 7f072f1ff700 1 --2- 172.21.15.45:0/1845928205 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f070c0682f0 0x7f070c06a7a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f071c015040 tx=0x7f071c00a000 comp rx=0 tx=0).stop 2023-11-28T12:07:37.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.557+0000 7f072f1ff700 1 -- 172.21.15.45:0/1845928205 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f07281e8b70 msgr2=0x7f0728158f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:37.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.557+0000 7f072f1ff700 1 --2- 172.21.15.45:0/1845928205 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f07281e8b70 0x7f0728158f80 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f072806bbb0 tx=0x7f07200104a0 comp rx=0 tx=0).stop 2023-11-28T12:07:37.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.558+0000 7f072f1ff700 1 -- 172.21.15.45:0/1845928205 shutdown_connections 2023-11-28T12:07:37.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.558+0000 7f072f1ff700 1 --2- 172.21.15.45:0/1845928205 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f070c0682f0 0x7f070c06a7a0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:37.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.558+0000 7f072f1ff700 1 --2- 172.21.15.45:0/1845928205 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0718003a30 0x7f07280c8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:37.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.558+0000 7f072f1ff700 1 --2- 172.21.15.45:0/1845928205 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f07281e8b70 0x7f0728158f80 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:37.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.558+0000 7f072f1ff700 1 --2- 172.21.15.45:0/1845928205 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f07281e8700 0x7f0728158a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:37.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.558+0000 7f072f1ff700 1 -- 172.21.15.45:0/1845928205 >> 172.21.15.45:0/1845928205 conn(0x7f0728072600 msgr2=0x7f072815a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:37.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.558+0000 7f072f1ff700 1 -- 172.21.15.45:0/1845928205 shutdown_connections 2023-11-28T12:07:37.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.558+0000 7f072f1ff700 1 -- 172.21.15.45:0/1845928205 wait complete. 2023-11-28T12:07:37.576 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-28T12:06:21.807108+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-28T12:06:22.491009+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T12:07:37.577 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T12:07:37.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.784+0000 7f3daddff700 1 Processor -- start 2023-11-28T12:07:37.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.784+0000 7f3daddff700 1 -- start start 2023-11-28T12:07:37.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.785+0000 7f3daddff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f3da8159860 0x7f3da80c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:37.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.785+0000 7f3daddff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3da80b0d80 0x7f3da80c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:37.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.785+0000 7f3daddff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3da80ccc00 con 0x7f3da8159490 2023-11-28T12:07:37.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.785+0000 7f3daddff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3da80ccec0 con 0x7f3da8159860 2023-11-28T12:07:37.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.785+0000 7f3daddff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3da80cd1a0 con 0x7f3da80b0d80 2023-11-28T12:07:37.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.786+0000 7f3da6ffd700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f3da8159860 0x7f3da80c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:37.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.786+0000 7f3da7fff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3da80b0d80 0x7f3da80c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:37.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.786+0000 7f3da6ffd700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f3da8159860 0x7f3da80c94c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.45:59678/0 (socket says 172.21.15.45:59678) 2023-11-28T12:07:37.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.786+0000 7f3da6ffd700 1 -- 172.21.15.45:0/183447366 learned_addr learned my addr 172.21.15.45:0/183447366 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:37.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.786+0000 7f3da7fff700 1 -- 172.21.15.45:0/183447366 >> v2:172.21.15.152:3300/0 conn(0x7f3da8159860 msgr2=0x7f3da80c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:37.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.786+0000 7f3da7fff700 1 --2- 172.21.15.45:0/183447366 >> v2:172.21.15.152:3300/0 conn(0x7f3da8159860 0x7f3da80c94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:37.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.786+0000 7f3da7fff700 1 -- 172.21.15.45:0/183447366 >> v1:172.21.15.152:6789/0 conn(0x7f3da8159490 legacy=0x7f3da80b0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:37.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.786+0000 7f3da7fff700 1 -- 172.21.15.45:0/183447366 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3da80cd480 con 0x7f3da80b0d80 2023-11-28T12:07:37.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.786+0000 7f3da6ffd700 1 --2- 172.21.15.45:0/183447366 >> v2:172.21.15.152:3300/0 conn(0x7f3da8159860 0x7f3da80c94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:07:37.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.787+0000 7f3da7fff700 1 --2- 172.21.15.45:0/183447366 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3da80b0d80 0x7f3da80c9a00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3da000bfa0 tx=0x7f3da000d330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac671211940ceb97 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:37.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.787+0000 7f3da67fc700 1 -- 172.21.15.45:0/183447366 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da0010070 con 0x7f3da80b0d80 2023-11-28T12:07:37.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.787+0000 7f3da67fc700 1 -- 172.21.15.45:0/183447366 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3da000b2e0 con 0x7f3da80b0d80 2023-11-28T12:07:37.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.787+0000 7f3da67fc700 1 -- 172.21.15.45:0/183447366 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da000dc40 con 0x7f3da80b0d80 2023-11-28T12:07:37.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.787+0000 7f3daddff700 1 -- 172.21.15.45:0/183447366 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3da80b0d80 msgr2=0x7f3da80c9a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:37.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.787+0000 7f3daddff700 1 --2- 172.21.15.45:0/183447366 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3da80b0d80 0x7f3da80c9a00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3da000bfa0 tx=0x7f3da000d330 comp rx=0 tx=0).stop 2023-11-28T12:07:37.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.788+0000 7f3daddff700 1 -- 172.21.15.45:0/183447366 shutdown_connections 2023-11-28T12:07:37.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.788+0000 7f3daddff700 1 --2- 172.21.15.45:0/183447366 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3da80b0d80 0x7f3da80c9a00 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:37.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.788+0000 7f3daddff700 1 --2- 172.21.15.45:0/183447366 >> v2:172.21.15.152:3300/0 conn(0x7f3da8159860 0x7f3da80c94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:37.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.788+0000 7f3daddff700 1 -- 172.21.15.45:0/183447366 >> 172.21.15.45:0/183447366 conn(0x7f3da80cb670 msgr2=0x7f3da80cba70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:37.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.788+0000 7f3daddff700 1 -- 172.21.15.45:0/183447366 shutdown_connections 2023-11-28T12:07:37.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.788+0000 7f3daddff700 1 -- 172.21.15.45:0/183447366 wait complete. 2023-11-28T12:07:37.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.789+0000 7f3daddff700 1 Processor -- start 2023-11-28T12:07:37.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.790+0000 7f3daddff700 1 -- start start 2023-11-28T12:07:37.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.790+0000 7f3daddff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3da80b0d80 0x7f3da8152ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:37.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.790+0000 7f3daddff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3da8159490 0x7f3da80b3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:37.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.791+0000 7f3daddff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3da80af8b0 0x7f3da80ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:37.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.791+0000 7f3daddff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da80ae810 con 0x7f3da80af8b0 2023-11-28T12:07:37.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.791+0000 7f3daddff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da80aeaf0 con 0x7f3da80b0d80 2023-11-28T12:07:37.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.791+0000 7f3daddff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3da80aedd0 con 0x7f3da8159490 2023-11-28T12:07:37.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.791+0000 7f3da7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3da80af8b0 0x7f3da80ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:37.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.791+0000 7f3da7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3da80af8b0 0x7f3da80ac8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47534/0 (socket says 172.21.15.45:47534) 2023-11-28T12:07:37.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.791+0000 7f3da7fff700 1 -- 172.21.15.45:0/3347128692 learned_addr learned my addr 172.21.15.45:0/3347128692 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:37.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.791+0000 7f3da6ffd700 1 --2- 172.21.15.45:0/3347128692 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3da8159490 0x7f3da80b3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:37.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.791+0000 7f3da77fe700 1 --2- 172.21.15.45:0/3347128692 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3da80b0d80 0x7f3da8152ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:37.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.791+0000 7f3da7fff700 1 -- 172.21.15.45:0/3347128692 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3da8159490 msgr2=0x7f3da80b3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:37.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.791+0000 7f3da7fff700 1 --2- 172.21.15.45:0/3347128692 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3da8159490 0x7f3da80b3e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:37.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.791+0000 7f3da7fff700 1 -- 172.21.15.45:0/3347128692 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3da80b0d80 msgr2=0x7f3da8152ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:37.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.791+0000 7f3da7fff700 1 --2- 172.21.15.45:0/3347128692 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3da80b0d80 0x7f3da8152ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:37.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.791+0000 7f3da7fff700 1 -- 172.21.15.45:0/3347128692 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d9c009550 con 0x7f3da80af8b0 2023-11-28T12:07:37.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.791+0000 7f3da77fe700 1 --2- 172.21.15.45:0/3347128692 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3da80b0d80 0x7f3da8152ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:07:37.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.792+0000 7f3da7fff700 1 --2- 172.21.15.45:0/3347128692 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3da80af8b0 0x7f3da80ac8c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f3da80cd2e0 tx=0x7f3da0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:37.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.792+0000 7f3d8ffff700 1 -- 172.21.15.45:0/3347128692 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da0004450 con 0x7f3da80af8b0 2023-11-28T12:07:37.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.792+0000 7f3d8ffff700 1 -- 172.21.15.45:0/3347128692 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3da00045b0 con 0x7f3da80af8b0 2023-11-28T12:07:37.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.792+0000 7f3d8ffff700 1 -- 172.21.15.45:0/3347128692 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da0004960 con 0x7f3da80af8b0 2023-11-28T12:07:37.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.792+0000 7f3daddff700 1 -- 172.21.15.45:0/3347128692 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3da000bc80 con 0x7f3da80af8b0 2023-11-28T12:07:37.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.792+0000 7f3daddff700 1 -- 172.21.15.45:0/3347128692 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3da80c9f40 con 0x7f3da80af8b0 2023-11-28T12:07:37.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.793+0000 7f3daddff700 1 -- 172.21.15.45:0/3347128692 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3da80cd760 con 0x7f3da80af8b0 2023-11-28T12:07:37.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.794+0000 7f3d8ffff700 1 -- 172.21.15.45:0/3347128692 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f3da002d070 con 0x7f3da80af8b0 2023-11-28T12:07:37.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.795+0000 7f3d8ffff700 1 --2- 172.21.15.45:0/3347128692 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f3d940682f0 0x7f3d9406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:37.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.795+0000 7f3d8ffff700 1 -- 172.21.15.45:0/3347128692 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f3da0087620 con 0x7f3da80af8b0 2023-11-28T12:07:37.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.795+0000 7f3da77fe700 1 --2- 172.21.15.45:0/3347128692 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f3d940682f0 0x7f3d9406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:37.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.796+0000 7f3da77fe700 1 --2- 172.21.15.45:0/3347128692 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f3d940682f0 0x7f3d9406a7a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3d98000f60 tx=0x7f3d98009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:37.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:37.799+0000 7f3d8ffff700 1 -- 172.21.15.45:0/3347128692 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f3da00540e0 con 0x7f3da80af8b0 2023-11-28T12:07:38.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.003+0000 7f3daddff700 1 -- 172.21.15.45:0/3347128692 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3da80cdc80 con 0x7f3da80af8b0 2023-11-28T12:07:38.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.003+0000 7f3d8ffff700 1 -- 172.21.15.45:0/3347128692 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v30) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3da0057700 con 0x7f3da80af8b0 2023-11-28T12:07:38.004 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-11-28T12:07:38.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.005+0000 7f3daddff700 1 -- 172.21.15.45:0/3347128692 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f3d940682f0 msgr2=0x7f3d9406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:38.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.005+0000 7f3daddff700 1 --2- 172.21.15.45:0/3347128692 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f3d940682f0 0x7f3d9406a7a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3d98000f60 tx=0x7f3d98009040 comp rx=0 tx=0).stop 2023-11-28T12:07:38.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.005+0000 7f3daddff700 1 -- 172.21.15.45:0/3347128692 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3da80af8b0 msgr2=0x7f3da80ac8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:38.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.005+0000 7f3daddff700 1 --2- 172.21.15.45:0/3347128692 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3da80af8b0 0x7f3da80ac8c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f3da80cd2e0 tx=0x7f3da0004ad0 comp rx=0 tx=0).stop 2023-11-28T12:07:38.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.006+0000 7f3daddff700 1 -- 172.21.15.45:0/3347128692 shutdown_connections 2023-11-28T12:07:38.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.006+0000 7f3daddff700 1 --2- 172.21.15.45:0/3347128692 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f3d940682f0 0x7f3d9406a7a0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:38.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.006+0000 7f3daddff700 1 --2- 172.21.15.45:0/3347128692 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3da80b0d80 0x7f3da8152ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:38.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.006+0000 7f3daddff700 1 --2- 172.21.15.45:0/3347128692 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3da80af8b0 0x7f3da80ac8c0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:38.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.006+0000 7f3daddff700 1 --2- 172.21.15.45:0/3347128692 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3da8159490 0x7f3da80b3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:38.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.006+0000 7f3daddff700 1 -- 172.21.15.45:0/3347128692 >> 172.21.15.45:0/3347128692 conn(0x7f3da80cb670 msgr2=0x7f3da8154f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:38.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.006+0000 7f3daddff700 1 -- 172.21.15.45:0/3347128692 shutdown_connections 2023-11-28T12:07:38.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.006+0000 7f3daddff700 1 -- 172.21.15.45:0/3347128692 wait complete. 2023-11-28T12:07:38.024 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T12:07:38.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.230+0000 7f9bf33ff700 1 Processor -- start 2023-11-28T12:07:38.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.231+0000 7f9bf33ff700 1 -- start start 2023-11-28T12:07:38.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.232+0000 7f9bf33ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9bec15c9b0 0x7f9bec0b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:38.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.232+0000 7f9bf33ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f9bec0cd7c0 0x7f9bec0cdc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:38.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.232+0000 7f9bf33ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bec0ce160 con 0x7f9bec161340 2023-11-28T12:07:38.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.232+0000 7f9bf33ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bec0b5800 con 0x7f9bec0cd7c0 2023-11-28T12:07:38.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.232+0000 7f9bf33ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bec0d1950 con 0x7f9bec15c9b0 2023-11-28T12:07:38.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.232+0000 7f9bf099a700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f9bec161340 0x7f9bec0d1de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41308/0 (socket says 172.21.15.45:41308) 2023-11-28T12:07:38.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.232+0000 7f9bf099a700 1 -- 172.21.15.45:0/1616637555 learned_addr learned my addr 172.21.15.45:0/1616637555 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:07:38.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.232+0000 7f9be3fff700 1 -- 172.21.15.45:0/1616637555 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1832487453 0 0) 0x7f9bec0ce160 con 0x7f9bec161340 2023-11-28T12:07:38.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.233+0000 7f9bf119b700 1 --2- 172.21.15.45:0/1616637555 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9bec15c9b0 0x7f9bec0b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:38.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.233+0000 7f9be3fff700 1 -- 172.21.15.45:0/1616637555 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9bd80035b0 con 0x7f9bec161340 2023-11-28T12:07:38.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.233+0000 7f9bf199c700 1 --2- 172.21.15.45:0/1616637555 >> v2:172.21.15.152:3300/0 conn(0x7f9bec0cd7c0 0x7f9bec0cdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:38.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.233+0000 7f9be3fff700 1 -- 172.21.15.45:0/1616637555 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2929098714 0 0) 0x7f9bd80035b0 con 0x7f9bec161340 2023-11-28T12:07:38.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.233+0000 7f9be3fff700 1 -- 172.21.15.45:0/1616637555 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9bec15c9b0 msgr2=0x7f9bec0b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:38.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.233+0000 7f9be3fff700 1 --2- 172.21.15.45:0/1616637555 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9bec15c9b0 0x7f9bec0b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:38.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.233+0000 7f9be3fff700 1 -- 172.21.15.45:0/1616637555 >> v2:172.21.15.152:3300/0 conn(0x7f9bec0cd7c0 msgr2=0x7f9bec0cdc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:38.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.233+0000 7f9be3fff700 1 --2- 172.21.15.45:0/1616637555 >> v2:172.21.15.152:3300/0 conn(0x7f9bec0cd7c0 0x7f9bec0cdc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:38.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.233+0000 7f9be3fff700 1 -- 172.21.15.45:0/1616637555 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bec0d24f0 con 0x7f9bec161340 2023-11-28T12:07:38.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.233+0000 7f9be3fff700 1 -- 172.21.15.45:0/1616637555 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3460218165 0 0) 0x7f9bdc001670 con 0x7f9bec161340 2023-11-28T12:07:38.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.233+0000 7f9be3fff700 1 -- 172.21.15.45:0/1616637555 >> v1:172.21.15.45:6789/0 conn(0x7f9bec161340 legacy=0x7f9bec0d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:38.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.233+0000 7f9be3fff700 1 --2- 172.21.15.45:0/1616637555 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9bd8003a00 0x7f9bd8003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:38.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.233+0000 7f9be3fff700 1 --2- 172.21.15.45:0/1616637555 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9bd8004430 0x7f9bd80048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:38.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.233+0000 7f9be3fff700 1 --2- 172.21.15.45:0/1616637555 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9bec15c9b0 0x7f9bd8005110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:38.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.233+0000 7f9be3fff700 1 -- 172.21.15.45:0/1616637555 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bec0b5800 con 0x7f9bd8003a00 2023-11-28T12:07:38.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.233+0000 7f9be3fff700 1 -- 172.21.15.45:0/1616637555 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bec0d1950 con 0x7f9bd8004430 2023-11-28T12:07:38.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.233+0000 7f9be3fff700 1 -- 172.21.15.45:0/1616637555 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd800ba90 con 0x7f9bec15c9b0 2023-11-28T12:07:38.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.233+0000 7f9bf199c700 1 --2- 172.21.15.45:0/1616637555 >> v2:172.21.15.152:3300/0 conn(0x7f9bec0cd7c0 0x7f9bec0cdc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:07:38.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.233+0000 7f9bf119b700 1 --2- 172.21.15.45:0/1616637555 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9bd8003a00 0x7f9bd8003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:38.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.233+0000 7f9bf099a700 1 --2- 172.21.15.45:0/1616637555 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9bd8004430 0x7f9bd80048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:38.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.233+0000 7f9bf199c700 1 --2- 172.21.15.45:0/1616637555 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9bec15c9b0 0x7f9bd8005110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:38.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.234+0000 7f9bf119b700 1 -- 172.21.15.45:0/1616637555 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9bec15c9b0 msgr2=0x7f9bd8005110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:38.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.234+0000 7f9bf119b700 1 --2- 172.21.15.45:0/1616637555 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9bec15c9b0 0x7f9bd8005110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:38.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.234+0000 7f9bf119b700 1 -- 172.21.15.45:0/1616637555 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9bd8004430 msgr2=0x7f9bd80048f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:38.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.234+0000 7f9bf119b700 1 --2- 172.21.15.45:0/1616637555 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9bd8004430 0x7f9bd80048f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:38.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.234+0000 7f9bf119b700 1 -- 172.21.15.45:0/1616637555 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bd80035b0 con 0x7f9bd8003a00 2023-11-28T12:07:38.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.234+0000 7f9bf119b700 1 --2- 172.21.15.45:0/1616637555 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9bd8003a00 0x7f9bd8003e10 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f9be8009b60 tx=0x7f9bd8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74db4a577e7003e7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:38.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.234+0000 7f9be3fff700 1 -- 172.21.15.45:0/1616637555 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be800e6c0 con 0x7f9bd8003a00 2023-11-28T12:07:38.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.234+0000 7f9be3fff700 1 -- 172.21.15.45:0/1616637555 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9be800e820 con 0x7f9bd8003a00 2023-11-28T12:07:38.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.234+0000 7f9be3fff700 1 -- 172.21.15.45:0/1616637555 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be800eb90 con 0x7f9bd8003a00 2023-11-28T12:07:38.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.235+0000 7f9bf33ff700 1 -- 172.21.15.45:0/1616637555 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9bd8003a00 msgr2=0x7f9bd8003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:38.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.235+0000 7f9bf33ff700 1 --2- 172.21.15.45:0/1616637555 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9bd8003a00 0x7f9bd8003e10 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f9be8009b60 tx=0x7f9bd8005880 comp rx=0 tx=0).stop 2023-11-28T12:07:38.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.235+0000 7f9bf199c700 1 -- 172.21.15.45:0/1616637555 reap_dead start 2023-11-28T12:07:38.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.235+0000 7f9bf33ff700 1 -- 172.21.15.45:0/1616637555 shutdown_connections 2023-11-28T12:07:38.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.235+0000 7f9bf33ff700 1 -- 172.21.15.45:0/1616637555 >> 172.21.15.45:0/1616637555 conn(0x7f9bec072600 msgr2=0x7f9bec0cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:38.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.235+0000 7f9bf33ff700 1 -- 172.21.15.45:0/1616637555 shutdown_connections 2023-11-28T12:07:38.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.235+0000 7f9bf33ff700 1 -- 172.21.15.45:0/1616637555 wait complete. 2023-11-28T12:07:38.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.237+0000 7f9bf33ff700 1 Processor -- start 2023-11-28T12:07:38.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.237+0000 7f9bf33ff700 1 -- start start 2023-11-28T12:07:38.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.238+0000 7f9bf33ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9bd8003a00 0x7f9bec0c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:38.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.238+0000 7f9bf33ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9bec0c9960 0x7f9bec1e8360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:38.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.238+0000 7f9bf33ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9bec1e88a0 0x7f9bec158fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:38.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.238+0000 7f9bf33ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bec1e8d40 con 0x7f9bec0c9960 2023-11-28T12:07:38.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.238+0000 7f9bf33ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bec1e8f90 con 0x7f9bd8003a00 2023-11-28T12:07:38.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.238+0000 7f9bf33ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bec1e9270 con 0x7f9bec1e88a0 2023-11-28T12:07:38.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.238+0000 7f9bf099a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9bec0c9960 0x7f9bec1e8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:38.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.238+0000 7f9bf099a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9bec0c9960 0x7f9bec1e8360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47544/0 (socket says 172.21.15.45:47544) 2023-11-28T12:07:38.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.238+0000 7f9bf099a700 1 -- 172.21.15.45:0/2377597490 learned_addr learned my addr 172.21.15.45:0/2377597490 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:38.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.238+0000 7f9bf119b700 1 --2- 172.21.15.45:0/2377597490 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9bd8003a00 0x7f9bec0c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:38.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.238+0000 7f9bf199c700 1 --2- 172.21.15.45:0/2377597490 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9bec1e88a0 0x7f9bec158fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:38.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.238+0000 7f9bf099a700 1 -- 172.21.15.45:0/2377597490 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9bec1e88a0 msgr2=0x7f9bec158fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:38.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.238+0000 7f9bf099a700 1 --2- 172.21.15.45:0/2377597490 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9bec1e88a0 0x7f9bec158fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:38.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.238+0000 7f9bf099a700 1 -- 172.21.15.45:0/2377597490 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9bd8003a00 msgr2=0x7f9bec0c8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:38.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.238+0000 7f9bf099a700 1 --2- 172.21.15.45:0/2377597490 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9bd8003a00 0x7f9bec0c8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:38.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.238+0000 7f9bf099a700 1 -- 172.21.15.45:0/2377597490 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bec0d1300 con 0x7f9bec0c9960 2023-11-28T12:07:38.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.238+0000 7f9bf119b700 1 --2- 172.21.15.45:0/2377597490 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9bd8003a00 0x7f9bec0c8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:07:38.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.239+0000 7f9bf099a700 1 --2- 172.21.15.45:0/2377597490 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9bec0c9960 0x7f9bec1e8360 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc007310 tx=0x7f9bdc0076d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:38.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.239+0000 7f9be1ffb700 1 -- 172.21.15.45:0/2377597490 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bdc0077f0 con 0x7f9bec0c9960 2023-11-28T12:07:38.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.239+0000 7f9be1ffb700 1 -- 172.21.15.45:0/2377597490 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bdc00f8d0 con 0x7f9bec0c9960 2023-11-28T12:07:38.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.239+0000 7f9be1ffb700 1 -- 172.21.15.45:0/2377597490 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bdc00fc60 con 0x7f9bec0c9960 2023-11-28T12:07:38.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.239+0000 7f9bf33ff700 1 -- 172.21.15.45:0/2377597490 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bec0b5520 con 0x7f9bec0c9960 2023-11-28T12:07:38.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.239+0000 7f9bf33ff700 1 -- 172.21.15.45:0/2377597490 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bec0d15e0 con 0x7f9bec0c9960 2023-11-28T12:07:38.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.240+0000 7f9bf33ff700 1 -- 172.21.15.45:0/2377597490 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bec0745c0 con 0x7f9bec0c9960 2023-11-28T12:07:38.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.241+0000 7f9be1ffb700 1 -- 172.21.15.45:0/2377597490 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f9bdc01d460 con 0x7f9bec0c9960 2023-11-28T12:07:38.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.242+0000 7f9be1ffb700 1 --2- 172.21.15.45:0/2377597490 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f9bd00682f0 0x7f9bd006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:38.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.242+0000 7f9be1ffb700 1 -- 172.21.15.45:0/2377597490 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f9bdc085c70 con 0x7f9bec0c9960 2023-11-28T12:07:38.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.242+0000 7f9bf119b700 1 --2- 172.21.15.45:0/2377597490 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f9bd00682f0 0x7f9bd006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:38.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.243+0000 7f9bf119b700 1 --2- 172.21.15.45:0/2377597490 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f9bd00682f0 0x7f9bd006a7a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9be8000c00 tx=0x7f9be8008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:38.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.246+0000 7f9be1ffb700 1 -- 172.21.15.45:0/2377597490 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f9bdc0526d0 con 0x7f9bec0c9960 2023-11-28T12:07:38.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.445+0000 7f9bf33ff700 1 -- 172.21.15.45:0/2377597490 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9bec0c9ef0 con 0x7f9bec0c9960 2023-11-28T12:07:38.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.445+0000 7f9be1ffb700 1 -- 172.21.15.45:0/2377597490 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9bdc055cf0 con 0x7f9bec0c9960 2023-11-28T12:07:38.446 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-11-28T12:07:38.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.448+0000 7f9bf33ff700 1 -- 172.21.15.45:0/2377597490 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f9bd00682f0 msgr2=0x7f9bd006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:38.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.448+0000 7f9bf33ff700 1 --2- 172.21.15.45:0/2377597490 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f9bd00682f0 0x7f9bd006a7a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9be8000c00 tx=0x7f9be8008030 comp rx=0 tx=0).stop 2023-11-28T12:07:38.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.448+0000 7f9bf33ff700 1 -- 172.21.15.45:0/2377597490 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9bec0c9960 msgr2=0x7f9bec1e8360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:38.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.448+0000 7f9bf33ff700 1 --2- 172.21.15.45:0/2377597490 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9bec0c9960 0x7f9bec1e8360 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc007310 tx=0x7f9bdc0076d0 comp rx=0 tx=0).stop 2023-11-28T12:07:38.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.448+0000 7f9bf33ff700 1 -- 172.21.15.45:0/2377597490 shutdown_connections 2023-11-28T12:07:38.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.448+0000 7f9bf33ff700 1 --2- 172.21.15.45:0/2377597490 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f9bd00682f0 0x7f9bd006a7a0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:38.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.448+0000 7f9bf33ff700 1 --2- 172.21.15.45:0/2377597490 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9bd8003a00 0x7f9bec0c8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:38.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.448+0000 7f9bf33ff700 1 --2- 172.21.15.45:0/2377597490 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9bec1e88a0 0x7f9bec158fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:38.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.448+0000 7f9bf33ff700 1 --2- 172.21.15.45:0/2377597490 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9bec0c9960 0x7f9bec1e8360 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:38.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.448+0000 7f9bf33ff700 1 -- 172.21.15.45:0/2377597490 >> 172.21.15.45:0/2377597490 conn(0x7f9bec072600 msgr2=0x7f9bec0b8620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:38.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.448+0000 7f9bf33ff700 1 -- 172.21.15.45:0/2377597490 shutdown_connections 2023-11-28T12:07:38.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.448+0000 7f9bf33ff700 1 -- 172.21.15.45:0/2377597490 wait complete. 2023-11-28T12:07:38.467 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-28T12:07:38.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.669+0000 7f8211fff700 1 Processor -- start 2023-11-28T12:07:38.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.669+0000 7f8211fff700 1 -- start start 2023-11-28T12:07:38.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.670+0000 7f8211fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f820c0d01b0 0x7f820c0d0c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:38.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.670+0000 7f8211fff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f820c0b20b0 0x7f820c0d1160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:38.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.670+0000 7f8211fff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f820c0b0230 con 0x7f820c0b29b0 2023-11-28T12:07:38.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.670+0000 7f8211fff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f820c15cec0 con 0x7f820c0d01b0 2023-11-28T12:07:38.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.670+0000 7f8211fff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f820c0b4570 con 0x7f820c0b20b0 2023-11-28T12:07:38.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.670+0000 7f820b7fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f820c0d01b0 0x7f820c0d0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:38.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.670+0000 7f820bfff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f820c0b29b0 0x7f820c0b2e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41316/0 (socket says 172.21.15.45:41316) 2023-11-28T12:07:38.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.670+0000 7f820bfff700 1 -- 172.21.15.45:0/2278866634 learned_addr learned my addr 172.21.15.45:0/2278866634 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:07:38.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.671+0000 7f8203fff700 1 --2- 172.21.15.45:0/2278866634 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f820c0b20b0 0x7f820c0d1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:38.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.671+0000 7f820b7fe700 1 -- 172.21.15.45:0/2278866634 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f820c0b20b0 msgr2=0x7f820c0d1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:38.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.671+0000 7f820b7fe700 1 --2- 172.21.15.45:0/2278866634 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f820c0b20b0 0x7f820c0d1160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:38.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.671+0000 7f820b7fe700 1 -- 172.21.15.45:0/2278866634 >> v1:172.21.15.45:6789/0 conn(0x7f820c0b29b0 legacy=0x7f820c0b2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:38.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.671+0000 7f820b7fe700 1 -- 172.21.15.45:0/2278866634 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f820c0b4850 con 0x7f820c0d01b0 2023-11-28T12:07:38.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.671+0000 7f820b7fe700 1 --2- 172.21.15.45:0/2278866634 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f820c0d01b0 0x7f820c0d0c20 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f81fc009840 tx=0x7f81fc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afc8ebd7a0c6344b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:38.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.671+0000 7f820affd700 1 -- 172.21.15.45:0/2278866634 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81fc011830 con 0x7f820c0d01b0 2023-11-28T12:07:38.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.671+0000 7f820affd700 1 -- 172.21.15.45:0/2278866634 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81fc011990 con 0x7f820c0d01b0 2023-11-28T12:07:38.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.671+0000 7f820affd700 1 -- 172.21.15.45:0/2278866634 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81fc011d20 con 0x7f820c0d01b0 2023-11-28T12:07:38.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.672+0000 7f8211fff700 1 -- 172.21.15.45:0/2278866634 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f820c0d01b0 msgr2=0x7f820c0d0c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:38.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.672+0000 7f8211fff700 1 --2- 172.21.15.45:0/2278866634 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f820c0d01b0 0x7f820c0d0c20 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f81fc009840 tx=0x7f81fc009b50 comp rx=0 tx=0).stop 2023-11-28T12:07:38.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.672+0000 7f8211fff700 1 -- 172.21.15.45:0/2278866634 shutdown_connections 2023-11-28T12:07:38.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.672+0000 7f8211fff700 1 --2- 172.21.15.45:0/2278866634 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f820c0d01b0 0x7f820c0d0c20 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:38.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.672+0000 7f8211fff700 1 --2- 172.21.15.45:0/2278866634 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f820c0b20b0 0x7f820c0d1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:38.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.672+0000 7f8211fff700 1 -- 172.21.15.45:0/2278866634 >> 172.21.15.45:0/2278866634 conn(0x7f820c09c3f0 msgr2=0x7f820c0d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:38.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.672+0000 7f8211fff700 1 -- 172.21.15.45:0/2278866634 shutdown_connections 2023-11-28T12:07:38.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.672+0000 7f8211fff700 1 -- 172.21.15.45:0/2278866634 wait complete. 2023-11-28T12:07:38.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.674+0000 7f8211fff700 1 Processor -- start 2023-11-28T12:07:38.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.675+0000 7f8211fff700 1 -- start start 2023-11-28T12:07:38.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.676+0000 7f8211fff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f820c0b20b0 0x7f820c1523d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:38.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.676+0000 7f8211fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f820c0b29b0 0x7f820c0b75b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:38.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.676+0000 7f8211fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f820c0d01b0 0x7f820c151bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:38.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.676+0000 7f8211fff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f820c0b6890 con 0x7f820c0d01b0 2023-11-28T12:07:38.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.676+0000 7f8211fff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f820c0b7af0 con 0x7f820c0b29b0 2023-11-28T12:07:38.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.676+0000 7f8211fff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f820c0b6ae0 con 0x7f820c0b20b0 2023-11-28T12:07:38.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.676+0000 7f820bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f820c0d01b0 0x7f820c151bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:38.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.676+0000 7f820bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f820c0d01b0 0x7f820c151bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47570/0 (socket says 172.21.15.45:47570) 2023-11-28T12:07:38.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.676+0000 7f820bfff700 1 -- 172.21.15.45:0/1957264538 learned_addr learned my addr 172.21.15.45:0/1957264538 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:38.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.676+0000 7f820b7fe700 1 --2- 172.21.15.45:0/1957264538 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f820c0b20b0 0x7f820c1523d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:38.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.676+0000 7f8203fff700 1 --2- 172.21.15.45:0/1957264538 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f820c0b29b0 0x7f820c0b75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:38.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.677+0000 7f820bfff700 1 -- 172.21.15.45:0/1957264538 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f820c0b20b0 msgr2=0x7f820c1523d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:38.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.677+0000 7f820bfff700 1 --2- 172.21.15.45:0/1957264538 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f820c0b20b0 0x7f820c1523d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:38.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.677+0000 7f820bfff700 1 -- 172.21.15.45:0/1957264538 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f820c0b29b0 msgr2=0x7f820c0b75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:38.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.677+0000 7f820bfff700 1 --2- 172.21.15.45:0/1957264538 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f820c0b29b0 0x7f820c0b75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:38.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.677+0000 7f820bfff700 1 -- 172.21.15.45:0/1957264538 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81fc0094a0 con 0x7f820c0d01b0 2023-11-28T12:07:38.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.677+0000 7f820bfff700 1 --2- 172.21.15.45:0/1957264538 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f820c0d01b0 0x7f820c151bf0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f820400cbf0 tx=0x7f820400cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:38.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.677+0000 7f8208ff9700 1 -- 172.21.15.45:0/1957264538 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820400ab10 con 0x7f820c0d01b0 2023-11-28T12:07:38.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.677+0000 7f8208ff9700 1 -- 172.21.15.45:0/1957264538 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f820400ac70 con 0x7f820c0d01b0 2023-11-28T12:07:38.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.677+0000 7f8211fff700 1 -- 172.21.15.45:0/1957264538 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f820c0afec0 con 0x7f820c0d01b0 2023-11-28T12:07:38.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.677+0000 7f8208ff9700 1 -- 172.21.15.45:0/1957264538 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8204012400 con 0x7f820c0d01b0 2023-11-28T12:07:38.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.677+0000 7f8211fff700 1 -- 172.21.15.45:0/1957264538 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f820c0afbe0 con 0x7f820c0d01b0 2023-11-28T12:07:38.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.678+0000 7f8211fff700 1 -- 172.21.15.45:0/1957264538 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f820c0b2600 con 0x7f820c0d01b0 2023-11-28T12:07:38.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.679+0000 7f8208ff9700 1 -- 172.21.15.45:0/1957264538 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f8204019030 con 0x7f820c0d01b0 2023-11-28T12:07:38.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.680+0000 7f8208ff9700 1 --2- 172.21.15.45:0/1957264538 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f81ec0682f0 0x7f81ec06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:38.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.680+0000 7f8208ff9700 1 -- 172.21.15.45:0/1957264538 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f8204085410 con 0x7f820c0d01b0 2023-11-28T12:07:38.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.680+0000 7f820b7fe700 1 --2- 172.21.15.45:0/1957264538 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f81ec0682f0 0x7f81ec06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:38.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.681+0000 7f820b7fe700 1 --2- 172.21.15.45:0/1957264538 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f81ec0682f0 0x7f81ec06a7a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f81fc0090b0 tx=0x7f81fc01c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:38.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.684+0000 7f8208ff9700 1 -- 172.21.15.45:0/1957264538 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f820404b5e0 con 0x7f820c0d01b0 2023-11-28T12:07:38.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.891+0000 7f8211fff700 1 -- 172.21.15.45:0/1957264538 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f820c068690 con 0x7f820c0d01b0 2023-11-28T12:07:38.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.892+0000 7f8208ff9700 1 -- 172.21.15.45:0/1957264538 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v30) v1 ==== 84+0+126 (secure 0 0 0) 0x7f8204051f80 con 0x7f820c0d01b0 2023-11-28T12:07:38.893 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:07:38.894 INFO:teuthology.orchestra.run.smithi045.stdout:[ 2023-11-28T12:07:38.894 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T12:07:38.894 INFO:teuthology.orchestra.run.smithi045.stdout: "poolnum": 1, 2023-11-28T12:07:38.894 INFO:teuthology.orchestra.run.smithi045.stdout: "poolname": "rbd" 2023-11-28T12:07:38.894 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T12:07:38.895 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T12:07:38.895 INFO:teuthology.orchestra.run.smithi045.stdout: "poolnum": 2, 2023-11-28T12:07:38.895 INFO:teuthology.orchestra.run.smithi045.stdout: "poolname": ".mgr" 2023-11-28T12:07:38.895 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T12:07:38.896 INFO:teuthology.orchestra.run.smithi045.stdout:] 2023-11-28T12:07:38.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.894+0000 7f8211fff700 1 -- 172.21.15.45:0/1957264538 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f81ec0682f0 msgr2=0x7f81ec06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:38.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.894+0000 7f8211fff700 1 --2- 172.21.15.45:0/1957264538 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f81ec0682f0 0x7f81ec06a7a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f81fc0090b0 tx=0x7f81fc01c040 comp rx=0 tx=0).stop 2023-11-28T12:07:38.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.894+0000 7f8211fff700 1 -- 172.21.15.45:0/1957264538 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f820c0d01b0 msgr2=0x7f820c151bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:38.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.894+0000 7f8211fff700 1 --2- 172.21.15.45:0/1957264538 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f820c0d01b0 0x7f820c151bf0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f820400cbf0 tx=0x7f820400cf00 comp rx=0 tx=0).stop 2023-11-28T12:07:38.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.894+0000 7f8211fff700 1 -- 172.21.15.45:0/1957264538 shutdown_connections 2023-11-28T12:07:38.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.894+0000 7f8211fff700 1 --2- 172.21.15.45:0/1957264538 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f81ec0682f0 0x7f81ec06a7a0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:38.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.894+0000 7f8211fff700 1 --2- 172.21.15.45:0/1957264538 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f820c0d01b0 0x7f820c151bf0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:38.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.894+0000 7f8211fff700 1 --2- 172.21.15.45:0/1957264538 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f820c0b20b0 0x7f820c1523d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:38.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.894+0000 7f8211fff700 1 --2- 172.21.15.45:0/1957264538 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f820c0b29b0 0x7f820c0b75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:38.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.894+0000 7f8211fff700 1 -- 172.21.15.45:0/1957264538 >> 172.21.15.45:0/1957264538 conn(0x7f820c09c3f0 msgr2=0x7f820c15c580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:38.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.895+0000 7f8211fff700 1 -- 172.21.15.45:0/1957264538 shutdown_connections 2023-11-28T12:07:38.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:38.895+0000 7f8211fff700 1 -- 172.21.15.45:0/1957264538 wait complete. 2023-11-28T12:07:38.913 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-28T12:07:38.913 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-28T12:07:39.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:39.121+0000 7f9c019ff700 1 Processor -- start 2023-11-28T12:07:39.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:39.122+0000 7f9c019ff700 1 -- start start 2023-11-28T12:07:39.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:39.123+0000 7f9c019ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9bfc0d1350 0x7f9bfc0b38b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:39.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:39.123+0000 7f9c019ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9bfc0b29d0 0x7f9bfc0b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:39.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:39.123+0000 7f9c019ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bfc0afbe0 con 0x7f9bfc15ca60 2023-11-28T12:07:39.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:39.123+0000 7f9c019ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bfc0b2750 con 0x7f9bfc0b29d0 2023-11-28T12:07:39.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:39.123+0000 7f9c019ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bfc15ce30 con 0x7f9bfc0d1350 2023-11-28T12:07:39.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:39.123+0000 7f9bfb7fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9bfc0b29d0 0x7f9bfc0b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:39.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:39.123+0000 7f9bfb7fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9bfc0b29d0 0x7f9bfc0b0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47586/0 (socket says 172.21.15.45:47586) 2023-11-28T12:07:39.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:39.123+0000 7f9bfb7fe700 1 -- 172.21.15.45:0/3475102376 learned_addr learned my addr 172.21.15.45:0/3475102376 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:39.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:39.123+0000 7f9bfa7fc700 1 --2- 172.21.15.45:0/3475102376 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9bfc0d1350 0x7f9bfc0b38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:39.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:39.124+0000 7f9bfb7fe700 1 -- 172.21.15.45:0/3475102376 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9bfc0d1350 msgr2=0x7f9bfc0b38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:39.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:39.124+0000 7f9bfb7fe700 1 --2- 172.21.15.45:0/3475102376 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9bfc0d1350 0x7f9bfc0b38b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:39.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:39.124+0000 7f9bfb7fe700 1 -- 172.21.15.45:0/3475102376 >> v1:172.21.15.152:6789/0 conn(0x7f9bfc15ca60 legacy=0x7f9bfc0d0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:39.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:39.124+0000 7f9bfb7fe700 1 -- 172.21.15.45:0/3475102376 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bfc0b3f20 con 0x7f9bfc0b29d0 2023-11-28T12:07:39.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:39.124+0000 7f9bfb7fe700 1 --2- 172.21.15.45:0/3475102376 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9bfc0b29d0 0x7f9bfc0b0070 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f9bf4009e50 tx=0x7f9bf400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb67f1385c7f77d9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:39.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:39.124+0000 7f9bf9ffb700 1 -- 172.21.15.45:0/3475102376 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf400e070 con 0x7f9bfc0b29d0 2023-11-28T12:07:39.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:39.124+0000 7f9bf9ffb700 1 -- 172.21.15.45:0/3475102376 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bf400b910 con 0x7f9bfc0b29d0 2023-11-28T12:07:39.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:39.124+0000 7f9bf9ffb700 1 -- 172.21.15.45:0/3475102376 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf400bcc0 con 0x7f9bfc0b29d0 2023-11-28T12:07:39.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:39.125+0000 7f9c019ff700 1 -- 172.21.15.45:0/3475102376 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9bfc0b29d0 msgr2=0x7f9bfc0b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:39.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:39.125+0000 7f9c019ff700 1 --2- 172.21.15.45:0/3475102376 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9bfc0b29d0 0x7f9bfc0b0070 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f9bf4009e50 tx=0x7f9bf400b330 comp rx=0 tx=0).stop 2023-11-28T12:07:39.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:39.125+0000 7f9c019ff700 1 -- 172.21.15.45:0/3475102376 shutdown_connections 2023-11-28T12:07:39.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:39.125+0000 7f9c019ff700 1 --2- 172.21.15.45:0/3475102376 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9bfc0b29d0 0x7f9bfc0b0070 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:39.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:39.125+0000 7f9c019ff700 1 --2- 172.21.15.45:0/3475102376 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9bfc0d1350 0x7f9bfc0b38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:39.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:39.125+0000 7f9c019ff700 1 -- 172.21.15.45:0/3475102376 >> 172.21.15.45:0/3475102376 conn(0x7f9bfc09c3f0 msgr2=0x7f9bfc0d3070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:39.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:39.125+0000 7f9c019ff700 1 -- 172.21.15.45:0/3475102376 shutdown_connections 2023-11-28T12:07:39.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:39.125+0000 7f9c019ff700 1 -- 172.21.15.45:0/3475102376 wait complete. 2023-11-28T12:07:39.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:39.127+0000 7f9c019ff700 1 Processor -- start 2023-11-28T12:07:39.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:39.127+0000 7f9c019ff700 1 -- start start 2023-11-28T12:07:39.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:39.128+0000 7f9c019ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9bfc0b29d0 0x7f9bfc1f1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:39.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:39.128+0000 7f9c019ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9bfc0d1350 0x7f9bfc15fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:39.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:39.128+0000 7f9c019ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9bfc15ca60 0x7f9bfc0b4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:39.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:39.128+0000 7f9c019ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bfc1f5a20 con 0x7f9bfc15ca60 2023-11-28T12:07:39.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:39.128+0000 7f9c019ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bfc1f5c70 con 0x7f9bfc0d1350 2023-11-28T12:07:39.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:39.128+0000 7f9c019ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bfc1f5f50 con 0x7f9bfc0b29d0 2023-11-28T12:07:39.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:39.128+0000 7f9bfb7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9bfc15ca60 0x7f9bfc0b4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:39.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:39.128+0000 7f9bfb7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9bfc15ca60 0x7f9bfc0b4fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47600/0 (socket says 172.21.15.45:47600) 2023-11-28T12:07:39.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:39.128+0000 7f9bfb7fe700 1 -- 172.21.15.45:0/2601439227 learned_addr learned my addr 172.21.15.45:0/2601439227 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:39.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:39.128+0000 7f9bfaffd700 1 --2- 172.21.15.45:0/2601439227 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9bfc0b29d0 0x7f9bfc1f1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:39.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:39.128+0000 7f9bfa7fc700 1 --2- 172.21.15.45:0/2601439227 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9bfc0d1350 0x7f9bfc15fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:39.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:39.128+0000 7f9bfb7fe700 1 -- 172.21.15.45:0/2601439227 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9bfc0b29d0 msgr2=0x7f9bfc1f1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:39.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:39.128+0000 7f9bfb7fe700 1 --2- 172.21.15.45:0/2601439227 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9bfc0b29d0 0x7f9bfc1f1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:39.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:39.128+0000 7f9bfb7fe700 1 -- 172.21.15.45:0/2601439227 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9bfc0d1350 msgr2=0x7f9bfc15fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:39.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:39.128+0000 7f9bfb7fe700 1 --2- 172.21.15.45:0/2601439227 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9bfc0d1350 0x7f9bfc15fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:39.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:39.128+0000 7f9bfb7fe700 1 -- 172.21.15.45:0/2601439227 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bf4009b30 con 0x7f9bfc15ca60 2023-11-28T12:07:39.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:39.129+0000 7f9bfb7fe700 1 --2- 172.21.15.45:0/2601439227 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9bfc15ca60 0x7f9bfc0b4fa0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc0b5c60 tx=0x7f9bf4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:39.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:39.129+0000 7f9be3fff700 1 -- 172.21.15.45:0/2601439227 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf4004960 con 0x7f9bfc15ca60 2023-11-28T12:07:39.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:39.129+0000 7f9be3fff700 1 -- 172.21.15.45:0/2601439227 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bf40099b0 con 0x7f9bfc15ca60 2023-11-28T12:07:39.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:39.129+0000 7f9be3fff700 1 -- 172.21.15.45:0/2601439227 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf401c680 con 0x7f9bfc15ca60 2023-11-28T12:07:39.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:39.129+0000 7f9c019ff700 1 -- 172.21.15.45:0/2601439227 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bfc0b44e0 con 0x7f9bfc15ca60 2023-11-28T12:07:39.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:39.129+0000 7f9c019ff700 1 -- 172.21.15.45:0/2601439227 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bfc0b4200 con 0x7f9bfc15ca60 2023-11-28T12:07:39.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:39.130+0000 7f9c019ff700 1 -- 172.21.15.45:0/2601439227 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bfc0b47c0 con 0x7f9bfc15ca60 2023-11-28T12:07:39.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:39.131+0000 7f9be3fff700 1 -- 172.21.15.45:0/2601439227 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f9bf402c070 con 0x7f9bfc15ca60 2023-11-28T12:07:39.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:39.132+0000 7f9be3fff700 1 --2- 172.21.15.45:0/2601439227 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f9be80682f0 0x7f9be806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:39.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:39.132+0000 7f9be3fff700 1 -- 172.21.15.45:0/2601439227 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f9bf4087630 con 0x7f9bfc15ca60 2023-11-28T12:07:39.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:39.132+0000 7f9bfaffd700 1 --2- 172.21.15.45:0/2601439227 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f9be80682f0 0x7f9be806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:39.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:39.133+0000 7f9bfaffd700 1 --2- 172.21.15.45:0/2601439227 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f9be80682f0 0x7f9be806a7a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f9bec000fb0 tx=0x7f9bec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:39.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:39.136+0000 7f9be3fff700 1 -- 172.21.15.45:0/2601439227 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f9bf40540f0 con 0x7f9bfc15ca60 2023-11-28T12:07:39.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:39.341+0000 7f9c019ff700 1 -- 172.21.15.45:0/2601439227 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f9bfc0672a0 con 0x7f9bfc15ca60 2023-11-28T12:07:40.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:40.136+0000 7f9be3fff700 1 -- 172.21.15.45:0/2601439227 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v31) v1 ==== 138+0+0 (secure 0 0 0) 0x7f9bf4057710 con 0x7f9bfc15ca60 2023-11-28T12:07:40.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:40.142+0000 7f9c019ff700 1 -- 172.21.15.45:0/2601439227 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f9be80682f0 msgr2=0x7f9be806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:40.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:40.142+0000 7f9c019ff700 1 --2- 172.21.15.45:0/2601439227 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f9be80682f0 0x7f9be806a7a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f9bec000fb0 tx=0x7f9bec009040 comp rx=0 tx=0).stop 2023-11-28T12:07:40.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:40.142+0000 7f9c019ff700 1 -- 172.21.15.45:0/2601439227 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9bfc15ca60 msgr2=0x7f9bfc0b4fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:40.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:40.142+0000 7f9c019ff700 1 --2- 172.21.15.45:0/2601439227 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9bfc15ca60 0x7f9bfc0b4fa0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc0b5c60 tx=0x7f9bf4004ad0 comp rx=0 tx=0).stop 2023-11-28T12:07:40.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:40.142+0000 7f9c019ff700 1 -- 172.21.15.45:0/2601439227 shutdown_connections 2023-11-28T12:07:40.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:40.142+0000 7f9c019ff700 1 --2- 172.21.15.45:0/2601439227 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f9be80682f0 0x7f9be806a7a0 secure :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f9bec000fb0 tx=0x7f9bec009040 comp rx=0 tx=0).stop 2023-11-28T12:07:40.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:40.142+0000 7f9c019ff700 1 --2- 172.21.15.45:0/2601439227 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9bfc15ca60 0x7f9bfc0b4fa0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:40.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:40.142+0000 7f9c019ff700 1 --2- 172.21.15.45:0/2601439227 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9bfc0b29d0 0x7f9bfc1f1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:40.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:40.142+0000 7f9c019ff700 1 --2- 172.21.15.45:0/2601439227 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9bfc0d1350 0x7f9bfc15fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:40.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:40.142+0000 7f9c019ff700 1 -- 172.21.15.45:0/2601439227 >> 172.21.15.45:0/2601439227 conn(0x7f9bfc09c3f0 msgr2=0x7f9bfc0b7eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:40.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:40.143+0000 7f9c019ff700 1 -- 172.21.15.45:0/2601439227 shutdown_connections 2023-11-28T12:07:40.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:40.144+0000 7f9c019ff700 1 -- 172.21.15.45:0/2601439227 wait complete. 2023-11-28T12:07:40.183 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' created 2023-11-28T12:07:40.183 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-28T12:07:40.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:40.399+0000 7f5fb09ff700 1 Processor -- start 2023-11-28T12:07:40.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:40.399+0000 7f5fb09ff700 1 -- start start 2023-11-28T12:07:40.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:40.400+0000 7f5fb09ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5fac0d01b0 0x7f5fac0d0c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:40.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:40.400+0000 7f5fb09ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5fac0b16d0 0x7f5fac0d1160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:40.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:40.400+0000 7f5fb09ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fac0b0230 con 0x7f5fac0b20b0 2023-11-28T12:07:40.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:40.400+0000 7f5fb09ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fac15cec0 con 0x7f5fac0b16d0 2023-11-28T12:07:40.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:40.400+0000 7f5fb09ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fac0b4570 con 0x7f5fac0d01b0 2023-11-28T12:07:40.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:40.400+0000 7f5faad9d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5fac0b16d0 0x7f5fac0d1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:40.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:40.401+0000 7f5faad9d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5fac0b16d0 0x7f5fac0d1160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47606/0 (socket says 172.21.15.45:47606) 2023-11-28T12:07:40.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:40.401+0000 7f5faad9d700 1 -- 172.21.15.45:0/563592873 learned_addr learned my addr 172.21.15.45:0/563592873 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:40.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:40.401+0000 7f5faa59c700 1 --2- 172.21.15.45:0/563592873 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5fac0d01b0 0x7f5fac0d0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:40.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:40.401+0000 7f5faad9d700 1 -- 172.21.15.45:0/563592873 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5fac0d01b0 msgr2=0x7f5fac0d0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:40.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:40.401+0000 7f5faad9d700 1 --2- 172.21.15.45:0/563592873 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5fac0d01b0 0x7f5fac0d0c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:40.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:40.401+0000 7f5faad9d700 1 -- 172.21.15.45:0/563592873 >> v1:172.21.15.152:6789/0 conn(0x7f5fac0b20b0 legacy=0x7f5fac0b29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:40.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:40.401+0000 7f5faad9d700 1 -- 172.21.15.45:0/563592873 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fac0b4850 con 0x7f5fac0b16d0 2023-11-28T12:07:40.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:40.401+0000 7f5fa959a700 1 -- 172.21.15.45:0/563592873 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2780555075 0 0) 0x7f5fac0b0230 con 0x7f5fac0b20b0 2023-11-28T12:07:40.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:40.401+0000 7f5faad9d700 1 --2- 172.21.15.45:0/563592873 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5fac0b16d0 0x7f5fac0d1160 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f5fa4009e80 tx=0x7f5fa400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57d743648bb74940 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:40.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:40.402+0000 7f5fa959a700 1 -- 172.21.15.45:0/563592873 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa400e070 con 0x7f5fac0b16d0 2023-11-28T12:07:40.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:40.402+0000 7f5fa959a700 1 -- 172.21.15.45:0/563592873 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fa400b8d0 con 0x7f5fac0b16d0 2023-11-28T12:07:40.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:40.402+0000 7f5fa959a700 1 -- 172.21.15.45:0/563592873 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa400bc80 con 0x7f5fac0b16d0 2023-11-28T12:07:40.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:40.402+0000 7f5fb09ff700 1 -- 172.21.15.45:0/563592873 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5fac0b16d0 msgr2=0x7f5fac0d1160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:40.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:40.402+0000 7f5fb09ff700 1 --2- 172.21.15.45:0/563592873 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5fac0b16d0 0x7f5fac0d1160 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f5fa4009e80 tx=0x7f5fa400b330 comp rx=0 tx=0).stop 2023-11-28T12:07:40.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:40.402+0000 7f5fb09ff700 1 -- 172.21.15.45:0/563592873 shutdown_connections 2023-11-28T12:07:40.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:40.402+0000 7f5fb09ff700 1 --2- 172.21.15.45:0/563592873 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5fac0d01b0 0x7f5fac0d0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:40.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:40.402+0000 7f5fb09ff700 1 --2- 172.21.15.45:0/563592873 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5fac0b16d0 0x7f5fac0d1160 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:40.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:40.402+0000 7f5fb09ff700 1 -- 172.21.15.45:0/563592873 >> 172.21.15.45:0/563592873 conn(0x7f5fac09c3f0 msgr2=0x7f5fac0d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:40.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:40.402+0000 7f5fb09ff700 1 -- 172.21.15.45:0/563592873 shutdown_connections 2023-11-28T12:07:40.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:40.402+0000 7f5fb09ff700 1 -- 172.21.15.45:0/563592873 wait complete. 2023-11-28T12:07:40.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:40.404+0000 7f5fb09ff700 1 Processor -- start 2023-11-28T12:07:40.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:40.404+0000 7f5fb09ff700 1 -- start start 2023-11-28T12:07:40.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:40.405+0000 7f5fb09ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5fac0b16d0 0x7f5fac1f2b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:40.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:40.405+0000 7f5fb09ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5fac0b20b0 0x7f5fac1f34f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:40.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:40.405+0000 7f5fb09ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5fac0d01b0 0x7f5fac0c6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:40.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:40.405+0000 7f5fb09ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fac0b7250 con 0x7f5fac0b20b0 2023-11-28T12:07:40.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:40.405+0000 7f5fb09ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fac1f3300 con 0x7f5fac0d01b0 2023-11-28T12:07:40.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:40.405+0000 7f5fb09ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fac1f3060 con 0x7f5fac0b16d0 2023-11-28T12:07:40.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:40.406+0000 7f5fa9d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5fac0b20b0 0x7f5fac1f34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:40.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:40.406+0000 7f5fa9d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5fac0b20b0 0x7f5fac1f34f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47610/0 (socket says 172.21.15.45:47610) 2023-11-28T12:07:40.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:40.406+0000 7f5fa9d9b700 1 -- 172.21.15.45:0/1949621092 learned_addr learned my addr 172.21.15.45:0/1949621092 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:40.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:40.406+0000 7f5faa59c700 1 --2- 172.21.15.45:0/1949621092 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5fac0b16d0 0x7f5fac1f2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:40.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:40.406+0000 7f5faad9d700 1 --2- 172.21.15.45:0/1949621092 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5fac0d01b0 0x7f5fac0c6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:40.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:40.406+0000 7f5fa9d9b700 1 -- 172.21.15.45:0/1949621092 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5fac0b16d0 msgr2=0x7f5fac1f2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:40.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:40.406+0000 7f5fa9d9b700 1 --2- 172.21.15.45:0/1949621092 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5fac0b16d0 0x7f5fac1f2b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:40.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:40.406+0000 7f5fa9d9b700 1 -- 172.21.15.45:0/1949621092 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5fac0d01b0 msgr2=0x7f5fac0c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:40.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:40.406+0000 7f5fa9d9b700 1 --2- 172.21.15.45:0/1949621092 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5fac0d01b0 0x7f5fac0c6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:40.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:40.406+0000 7f5fa9d9b700 1 -- 172.21.15.45:0/1949621092 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fa4009b30 con 0x7f5fac0b20b0 2023-11-28T12:07:40.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:40.406+0000 7f5fa9d9b700 1 --2- 172.21.15.45:0/1949621092 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5fac0b20b0 0x7f5fac1f34f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f5fa000c750 tx=0x7f5fa000ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:40.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:40.407+0000 7f5f9affd700 1 -- 172.21.15.45:0/1949621092 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa00054e0 con 0x7f5fac0b20b0 2023-11-28T12:07:40.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:40.407+0000 7f5f9affd700 1 -- 172.21.15.45:0/1949621092 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fa0003680 con 0x7f5fac0b20b0 2023-11-28T12:07:40.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:40.407+0000 7f5fb09ff700 1 -- 172.21.15.45:0/1949621092 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fac0afec0 con 0x7f5fac0b20b0 2023-11-28T12:07:40.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:40.407+0000 7f5f9affd700 1 -- 172.21.15.45:0/1949621092 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa0003a30 con 0x7f5fac0b20b0 2023-11-28T12:07:40.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:40.407+0000 7f5fb09ff700 1 -- 172.21.15.45:0/1949621092 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fac0afbe0 con 0x7f5fac0b20b0 2023-11-28T12:07:40.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:40.408+0000 7f5fb09ff700 1 -- 172.21.15.45:0/1949621092 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fac0b2600 con 0x7f5fac0b20b0 2023-11-28T12:07:40.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:40.409+0000 7f5f9affd700 1 -- 172.21.15.45:0/1949621092 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f5fa0019030 con 0x7f5fac0b20b0 2023-11-28T12:07:40.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:40.410+0000 7f5f9affd700 1 --2- 172.21.15.45:0/1949621092 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5f8c0682f0 0x7f5f8c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:40.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:40.410+0000 7f5f9affd700 1 -- 172.21.15.45:0/1949621092 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f5fa0084e60 con 0x7f5fac0b20b0 2023-11-28T12:07:40.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:40.410+0000 7f5faa59c700 1 --2- 172.21.15.45:0/1949621092 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5f8c0682f0 0x7f5f8c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:40.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:40.411+0000 7f5faa59c700 1 --2- 172.21.15.45:0/1949621092 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5f8c0682f0 0x7f5f8c06a7a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c009b40 tx=0x7f5f9c009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:40.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:40.414+0000 7f5f9affd700 1 -- 172.21.15.45:0/1949621092 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f5fa0051870 con 0x7f5fac0b20b0 2023-11-28T12:07:40.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:40.616+0000 7f5fb09ff700 1 -- 172.21.15.45:0/1949621092 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f5fac0b4390 con 0x7f5fac0b20b0 2023-11-28T12:07:41.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.143+0000 7f5f9affd700 1 -- 172.21.15.45:0/1949621092 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v32) v1 ==== 170+0+0 (secure 0 0 0) 0x7f5fa00170d0 con 0x7f5fac0b20b0 2023-11-28T12:07:41.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.149+0000 7f5fb09ff700 1 -- 172.21.15.45:0/1949621092 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5f8c0682f0 msgr2=0x7f5f8c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:41.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.149+0000 7f5fb09ff700 1 --2- 172.21.15.45:0/1949621092 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5f8c0682f0 0x7f5f8c06a7a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c009b40 tx=0x7f5f9c009210 comp rx=0 tx=0).stop 2023-11-28T12:07:41.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.149+0000 7f5fb09ff700 1 -- 172.21.15.45:0/1949621092 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5fac0b20b0 msgr2=0x7f5fac1f34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:41.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.149+0000 7f5fb09ff700 1 --2- 172.21.15.45:0/1949621092 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5fac0b20b0 0x7f5fac1f34f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f5fa000c750 tx=0x7f5fa000ca60 comp rx=0 tx=0).stop 2023-11-28T12:07:41.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.149+0000 7f5fb09ff700 1 -- 172.21.15.45:0/1949621092 shutdown_connections 2023-11-28T12:07:41.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.149+0000 7f5fb09ff700 1 --2- 172.21.15.45:0/1949621092 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5f8c0682f0 0x7f5f8c06a7a0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:41.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.149+0000 7f5fb09ff700 1 --2- 172.21.15.45:0/1949621092 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5fac0d01b0 0x7f5fac0c6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:41.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.149+0000 7f5fb09ff700 1 --2- 172.21.15.45:0/1949621092 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5fac0b16d0 0x7f5fac1f2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:41.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.149+0000 7f5fb09ff700 1 --2- 172.21.15.45:0/1949621092 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5fac0b20b0 0x7f5fac1f34f0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:41.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.149+0000 7f5fb09ff700 1 -- 172.21.15.45:0/1949621092 >> 172.21.15.45:0/1949621092 conn(0x7f5fac09c3f0 msgr2=0x7f5fac06ac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:41.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.149+0000 7f5fb09ff700 1 -- 172.21.15.45:0/1949621092 shutdown_connections 2023-11-28T12:07:41.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.149+0000 7f5fb09ff700 1 -- 172.21.15.45:0/1949621092 wait complete. 2023-11-28T12:07:41.156 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' created 2023-11-28T12:07:41.180 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-28T12:07:41.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.387+0000 7f3b9edff700 1 Processor -- start 2023-11-28T12:07:41.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.387+0000 7f3b9edff700 1 -- start start 2023-11-28T12:07:41.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.389+0000 7f3b9edff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3b980cd7c0 0x7f3b980cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:41.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.389+0000 7f3b9edff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b980d1950 con 0x7f3b9815c9b0 2023-11-28T12:07:41.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.389+0000 7f3b9edff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b980ce140 con 0x7f3b98161340 2023-11-28T12:07:41.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.389+0000 7f3b9edff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b980b5800 con 0x7f3b980cd7c0 2023-11-28T12:07:41.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.389+0000 7f3b9cb9b700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f3b9815c9b0 0x7f3b980b4bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41332/0 (socket says 172.21.15.45:41332) 2023-11-28T12:07:41.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.389+0000 7f3b9cb9b700 1 -- 172.21.15.45:0/2392480007 learned_addr learned my addr 172.21.15.45:0/2392480007 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:07:41.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.389+0000 7f3b9d39c700 1 --2- 172.21.15.45:0/2392480007 >> v2:172.21.15.45:3300/0 conn(0x7f3b980cd7c0 0x7f3b980cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:41.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.389+0000 7f3b9d39c700 1 -- 172.21.15.45:0/2392480007 >> v1:172.21.15.152:6789/0 conn(0x7f3b98161340 legacy=0x7f3b980d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:41.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.389+0000 7f3b9d39c700 1 -- 172.21.15.45:0/2392480007 >> v1:172.21.15.45:6789/0 conn(0x7f3b9815c9b0 legacy=0x7f3b980b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:41.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.389+0000 7f3b977fe700 1 -- 172.21.15.45:0/2392480007 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2757008088 0 0) 0x7f3b980d1950 con 0x7f3b9815c9b0 2023-11-28T12:07:41.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.389+0000 7f3b9d39c700 1 -- 172.21.15.45:0/2392480007 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b980d24f0 con 0x7f3b980cd7c0 2023-11-28T12:07:41.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.390+0000 7f3b9d39c700 1 --2- 172.21.15.45:0/2392480007 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b980cd7c0 0x7f3b980cdc00 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f3b90009d90 tx=0x7f3b9000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d516fb045b20aa8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:41.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.390+0000 7f3b977fe700 1 -- 172.21.15.45:0/2392480007 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b9000e070 con 0x7f3b980cd7c0 2023-11-28T12:07:41.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.390+0000 7f3b977fe700 1 -- 172.21.15.45:0/2392480007 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b9000bb90 con 0x7f3b980cd7c0 2023-11-28T12:07:41.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.390+0000 7f3b977fe700 1 -- 172.21.15.45:0/2392480007 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b90003a20 con 0x7f3b980cd7c0 2023-11-28T12:07:41.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.390+0000 7f3b9edff700 1 -- 172.21.15.45:0/2392480007 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b980cd7c0 msgr2=0x7f3b980cdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:41.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.390+0000 7f3b9edff700 1 --2- 172.21.15.45:0/2392480007 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b980cd7c0 0x7f3b980cdc00 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f3b90009d90 tx=0x7f3b9000b330 comp rx=0 tx=0).stop 2023-11-28T12:07:41.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.391+0000 7f3b9edff700 1 -- 172.21.15.45:0/2392480007 shutdown_connections 2023-11-28T12:07:41.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.391+0000 7f3b9edff700 1 --2- 172.21.15.45:0/2392480007 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b980cd7c0 0x7f3b980cdc00 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:41.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.391+0000 7f3b9edff700 1 -- 172.21.15.45:0/2392480007 >> 172.21.15.45:0/2392480007 conn(0x7f3b98072600 msgr2=0x7f3b980cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:41.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.391+0000 7f3b9edff700 1 -- 172.21.15.45:0/2392480007 shutdown_connections 2023-11-28T12:07:41.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.391+0000 7f3b9edff700 1 -- 172.21.15.45:0/2392480007 wait complete. 2023-11-28T12:07:41.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.392+0000 7f3b9edff700 1 Processor -- start 2023-11-28T12:07:41.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.392+0000 7f3b9edff700 1 -- start start 2023-11-28T12:07:41.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.393+0000 7f3b9edff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b980cd7c0 0x7f3b981539a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:41.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.393+0000 7f3b9edff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3b9815c9b0 0x7f3b98156040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:41.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.393+0000 7f3b9edff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b98161340 0x7f3b981f27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:41.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.393+0000 7f3b9edff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b980c8c90 con 0x7f3b98161340 2023-11-28T12:07:41.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.393+0000 7f3b9edff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b980c8080 con 0x7f3b980cd7c0 2023-11-28T12:07:41.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.393+0000 7f3b9edff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b980c8360 con 0x7f3b9815c9b0 2023-11-28T12:07:41.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.394+0000 7f3b9d39c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b98161340 0x7f3b981f27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:41.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.394+0000 7f3b9cb9b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b980cd7c0 0x7f3b981539a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:41.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.394+0000 7f3b9d39c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b98161340 0x7f3b981f27d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47618/0 (socket says 172.21.15.45:47618) 2023-11-28T12:07:41.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.394+0000 7f3b9d39c700 1 -- 172.21.15.45:0/4248489594 learned_addr learned my addr 172.21.15.45:0/4248489594 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:41.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.394+0000 7f3b97fff700 1 --2- 172.21.15.45:0/4248489594 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3b9815c9b0 0x7f3b98156040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:41.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.394+0000 7f3b9d39c700 1 -- 172.21.15.45:0/4248489594 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3b9815c9b0 msgr2=0x7f3b98156040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:41.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.394+0000 7f3b9d39c700 1 --2- 172.21.15.45:0/4248489594 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3b9815c9b0 0x7f3b98156040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:41.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.394+0000 7f3b9d39c700 1 -- 172.21.15.45:0/4248489594 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b980cd7c0 msgr2=0x7f3b981539a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:41.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.394+0000 7f3b9d39c700 1 --2- 172.21.15.45:0/4248489594 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b980cd7c0 0x7f3b981539a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:41.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.394+0000 7f3b9d39c700 1 -- 172.21.15.45:0/4248489594 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b90009a70 con 0x7f3b98161340 2023-11-28T12:07:41.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.394+0000 7f3b9d39c700 1 --2- 172.21.15.45:0/4248489594 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b98161340 0x7f3b981f27d0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f3b9000b730 tx=0x7f3b90004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:41.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.395+0000 7f3b957fa700 1 -- 172.21.15.45:0/4248489594 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b90012630 con 0x7f3b98161340 2023-11-28T12:07:41.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.395+0000 7f3b957fa700 1 -- 172.21.15.45:0/4248489594 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b90012790 con 0x7f3b98161340 2023-11-28T12:07:41.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.395+0000 7f3b9edff700 1 -- 172.21.15.45:0/4248489594 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b980d1300 con 0x7f3b98161340 2023-11-28T12:07:41.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.395+0000 7f3b957fa700 1 -- 172.21.15.45:0/4248489594 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b90012b40 con 0x7f3b98161340 2023-11-28T12:07:41.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.395+0000 7f3b9edff700 1 -- 172.21.15.45:0/4248489594 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b980b5520 con 0x7f3b98161340 2023-11-28T12:07:41.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.396+0000 7f3b9edff700 1 -- 172.21.15.45:0/4248489594 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b980d15e0 con 0x7f3b98161340 2023-11-28T12:07:41.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.397+0000 7f3b957fa700 1 -- 172.21.15.45:0/4248489594 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f3b9002c070 con 0x7f3b98161340 2023-11-28T12:07:41.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.398+0000 7f3b957fa700 1 --2- 172.21.15.45:0/4248489594 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f3b7c0682f0 0x7f3b7c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:41.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.398+0000 7f3b957fa700 1 -- 172.21.15.45:0/4248489594 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f3b90087c10 con 0x7f3b98161340 2023-11-28T12:07:41.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.399+0000 7f3b9cb9b700 1 --2- 172.21.15.45:0/4248489594 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f3b7c0682f0 0x7f3b7c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:41.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.400+0000 7f3b9cb9b700 1 --2- 172.21.15.45:0/4248489594 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f3b7c0682f0 0x7f3b7c06a7a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c000f60 tx=0x7f3b8c004a50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:41.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.403+0000 7f3b957fa700 1 -- 172.21.15.45:0/4248489594 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f3b90054470 con 0x7f3b98161340 2023-11-28T12:07:41.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.649+0000 7f3b9edff700 1 -- 172.21.15.45:0/4248489594 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f3b980745c0 con 0x7f3b98161340 2023-11-28T12:07:41.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.656+0000 7f3b957fa700 1 -- 172.21.15.45:0/4248489594 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v12) v1 ==== 172+0+0 (secure 0 0 0) 0x7f3b9002a0c0 con 0x7f3b98161340 2023-11-28T12:07:41.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.662+0000 7f3b9edff700 1 -- 172.21.15.45:0/4248489594 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f3b7c0682f0 msgr2=0x7f3b7c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:41.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.662+0000 7f3b9edff700 1 --2- 172.21.15.45:0/4248489594 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f3b7c0682f0 0x7f3b7c06a7a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c000f60 tx=0x7f3b8c004a50 comp rx=0 tx=0).stop 2023-11-28T12:07:41.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.662+0000 7f3b9edff700 1 -- 172.21.15.45:0/4248489594 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b98161340 msgr2=0x7f3b981f27d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:41.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.662+0000 7f3b9edff700 1 --2- 172.21.15.45:0/4248489594 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b98161340 0x7f3b981f27d0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f3b9000b730 tx=0x7f3b90004ad0 comp rx=0 tx=0).stop 2023-11-28T12:07:41.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.664+0000 7f3b9edff700 1 -- 172.21.15.45:0/4248489594 shutdown_connections 2023-11-28T12:07:41.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.664+0000 7f3b9edff700 1 --2- 172.21.15.45:0/4248489594 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f3b7c0682f0 0x7f3b7c06a7a0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:41.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.664+0000 7f3b9edff700 1 --2- 172.21.15.45:0/4248489594 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b980cd7c0 0x7f3b981539a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:41.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.664+0000 7f3b9edff700 1 --2- 172.21.15.45:0/4248489594 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b98161340 0x7f3b981f27d0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:41.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.664+0000 7f3b9edff700 1 --2- 172.21.15.45:0/4248489594 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3b9815c9b0 0x7f3b98156040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:41.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.664+0000 7f3b9edff700 1 -- 172.21.15.45:0/4248489594 >> 172.21.15.45:0/4248489594 conn(0x7f3b98072600 msgr2=0x7f3b98160610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:41.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.670+0000 7f3b9edff700 1 -- 172.21.15.45:0/4248489594 shutdown_connections 2023-11-28T12:07:41.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.670+0000 7f3b9edff700 1 -- 172.21.15.45:0/4248489594 wait complete. 2023-11-28T12:07:41.679 INFO:teuthology.orchestra.run.smithi045.stderr:new fs with metadata pool 5 and data pool 6 2023-11-28T12:07:41.701 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T12:07:41.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.906+0000 7f501dbff700 1 Processor -- start 2023-11-28T12:07:41.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.906+0000 7f501dbff700 1 -- start start 2023-11-28T12:07:41.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.907+0000 7f501dbff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f501815c9b0 0x7f50180b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:41.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.907+0000 7f501dbff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5018161340 0x7f50180d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:41.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.907+0000 7f501dbff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50180d1950 con 0x7f50180d2320 2023-11-28T12:07:41.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.907+0000 7f501dbff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50180b5800 con 0x7f5018161340 2023-11-28T12:07:41.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.907+0000 7f501dbff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50180b5520 con 0x7f501815c9b0 2023-11-28T12:07:41.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.907+0000 7f5016ffd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5018161340 0x7f50180d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:41.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.908+0000 7f5016ffd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5018161340 0x7f50180d1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34086/0 (socket says 172.21.15.45:34086) 2023-11-28T12:07:41.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.908+0000 7f5016ffd700 1 -- 172.21.15.45:0/656321994 learned_addr learned my addr 172.21.15.45:0/656321994 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:41.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.908+0000 7f50177fe700 1 --2- 172.21.15.45:0/656321994 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f501815c9b0 0x7f50180b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:41.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.908+0000 7f5016ffd700 1 -- 172.21.15.45:0/656321994 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f501815c9b0 msgr2=0x7f50180b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:41.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.908+0000 7f5016ffd700 1 --2- 172.21.15.45:0/656321994 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f501815c9b0 0x7f50180b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:41.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.908+0000 7f5016ffd700 1 -- 172.21.15.45:0/656321994 >> v1:172.21.15.152:6789/0 conn(0x7f50180d2320 legacy=0x7f50180cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:41.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.908+0000 7f5016ffd700 1 -- 172.21.15.45:0/656321994 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50180d1300 con 0x7f5018161340 2023-11-28T12:07:41.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.908+0000 7f5016ffd700 1 --2- 172.21.15.45:0/656321994 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5018161340 0x7f50180d1de0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f500c0098f0 tx=0x7f500c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7dd68355256fe4a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:41.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.909+0000 7f50167fc700 1 -- 172.21.15.45:0/656321994 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f500c00b8a0 con 0x7f5018161340 2023-11-28T12:07:41.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.909+0000 7f50167fc700 1 -- 172.21.15.45:0/656321994 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f500c00ba00 con 0x7f5018161340 2023-11-28T12:07:41.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.909+0000 7f50167fc700 1 -- 172.21.15.45:0/656321994 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f500c00bd90 con 0x7f5018161340 2023-11-28T12:07:41.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.909+0000 7f501dbff700 1 -- 172.21.15.45:0/656321994 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5018161340 msgr2=0x7f50180d1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:41.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.909+0000 7f501dbff700 1 --2- 172.21.15.45:0/656321994 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5018161340 0x7f50180d1de0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f500c0098f0 tx=0x7f500c009c00 comp rx=0 tx=0).stop 2023-11-28T12:07:41.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.909+0000 7f501dbff700 1 -- 172.21.15.45:0/656321994 shutdown_connections 2023-11-28T12:07:41.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.909+0000 7f501dbff700 1 --2- 172.21.15.45:0/656321994 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f501815c9b0 0x7f50180b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:41.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.909+0000 7f501dbff700 1 --2- 172.21.15.45:0/656321994 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5018161340 0x7f50180d1de0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:41.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.909+0000 7f501dbff700 1 -- 172.21.15.45:0/656321994 >> 172.21.15.45:0/656321994 conn(0x7f5018072600 msgr2=0x7f50180cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:41.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.909+0000 7f501dbff700 1 -- 172.21.15.45:0/656321994 shutdown_connections 2023-11-28T12:07:41.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.909+0000 7f501dbff700 1 -- 172.21.15.45:0/656321994 wait complete. 2023-11-28T12:07:41.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.911+0000 7f501dbff700 1 Processor -- start 2023-11-28T12:07:41.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.911+0000 7f501dbff700 1 -- start start 2023-11-28T12:07:41.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.912+0000 7f501dbff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50180d2320 0x7f5018153e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:41.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.912+0000 7f501dbff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f501815c9b0 0x7f50180c5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:41.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.912+0000 7f501dbff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5018161340 0x7f501815ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:41.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.912+0000 7f501dbff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5018156640 con 0x7f50180d2320 2023-11-28T12:07:41.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.912+0000 7f501dbff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5018153c20 con 0x7f5018161340 2023-11-28T12:07:41.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.912+0000 7f501dbff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50180c6480 con 0x7f501815c9b0 2023-11-28T12:07:41.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.912+0000 7f50177fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50180d2320 0x7f5018153e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:41.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.912+0000 7f50177fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50180d2320 0x7f5018153e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34100/0 (socket says 172.21.15.45:34100) 2023-11-28T12:07:41.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.912+0000 7f50177fe700 1 -- 172.21.15.45:0/4165278107 learned_addr learned my addr 172.21.15.45:0/4165278107 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:41.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.912+0000 7f5016ffd700 1 --2- 172.21.15.45:0/4165278107 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f501815c9b0 0x7f50180c5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:41.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.913+0000 7f5017fff700 1 --2- 172.21.15.45:0/4165278107 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5018161340 0x7f501815ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:41.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.913+0000 7f50177fe700 1 -- 172.21.15.45:0/4165278107 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f501815c9b0 msgr2=0x7f50180c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:41.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.913+0000 7f50177fe700 1 --2- 172.21.15.45:0/4165278107 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f501815c9b0 0x7f50180c5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:41.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.913+0000 7f50177fe700 1 -- 172.21.15.45:0/4165278107 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5018161340 msgr2=0x7f501815ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:41.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.913+0000 7f50177fe700 1 --2- 172.21.15.45:0/4165278107 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5018161340 0x7f501815ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:41.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.913+0000 7f50177fe700 1 -- 172.21.15.45:0/4165278107 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f500c009550 con 0x7f50180d2320 2023-11-28T12:07:41.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.913+0000 7f50177fe700 1 --2- 172.21.15.45:0/4165278107 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50180d2320 0x7f5018153e20 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f500800e840 tx=0x7f500800eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:41.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.913+0000 7f4ffffff700 1 -- 172.21.15.45:0/4165278107 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5008013610 con 0x7f50180d2320 2023-11-28T12:07:41.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.913+0000 7f4ffffff700 1 -- 172.21.15.45:0/4165278107 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5008013770 con 0x7f50180d2320 2023-11-28T12:07:41.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.913+0000 7f4ffffff700 1 -- 172.21.15.45:0/4165278107 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5008013b20 con 0x7f50180d2320 2023-11-28T12:07:41.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.913+0000 7f501dbff700 1 -- 172.21.15.45:0/4165278107 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50180b5130 con 0x7f50180d2320 2023-11-28T12:07:41.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.914+0000 7f501dbff700 1 -- 172.21.15.45:0/4165278107 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50180d15e0 con 0x7f50180d2320 2023-11-28T12:07:41.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.915+0000 7f501dbff700 1 -- 172.21.15.45:0/4165278107 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50180b52c0 con 0x7f50180d2320 2023-11-28T12:07:41.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.916+0000 7f4ffffff700 1 -- 172.21.15.45:0/4165278107 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f5008023070 con 0x7f50180d2320 2023-11-28T12:07:41.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.916+0000 7f4ffffff700 1 --2- 172.21.15.45:0/4165278107 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f50040682f0 0x7f500406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:41.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.917+0000 7f4ffffff700 1 -- 172.21.15.45:0/4165278107 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5008085900 con 0x7f50180d2320 2023-11-28T12:07:41.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.917+0000 7f5016ffd700 1 --2- 172.21.15.45:0/4165278107 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f50040682f0 0x7f500406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:41.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.918+0000 7f5016ffd700 1 --2- 172.21.15.45:0/4165278107 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f50040682f0 0x7f500406a7a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f500c009c40 tx=0x7f500c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:41.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:41.921+0000 7f4ffffff700 1 -- 172.21.15.45:0/4165278107 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f5008051ff0 con 0x7f50180d2320 2023-11-28T12:07:42.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.125+0000 7f501dbff700 1 -- 172.21.15.45:0/4165278107 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f50181568b0 con 0x7f50180d2320 2023-11-28T12:07:42.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.126+0000 7f4ffffff700 1 -- 172.21.15.45:0/4165278107 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+17934 (secure 0 0 0) 0x7f5008055610 con 0x7f50180d2320 2023-11-28T12:07:42.128 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:07:42.128 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":33,"fsid":"bd7c37f1-f7c6-4778-b845-52cf2aa6e366","created":"2023-11-28T12:06:09.045075+0000","modified":"2023-11-28T12:07:41.650406+0000","last_up_change":"2023-11-28T12:06:21.282227+0000","last_in_change":"2023-11-28T12:06:12.560924+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T12:06:21.807108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T12:06:22.491009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-28T12:07:39.383009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-28T12:07:40.658112+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d0cdd8a-87fd-4f2c-91bd-47bdfa661905","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":115843},{"type":"v1","addr":"172.21.15.45:6808","nonce":115843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":115843},{"type":"v1","addr":"172.21.15.45:6811","nonce":115843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":115843},{"type":"v1","addr":"172.21.15.45:6815","nonce":115843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":115843},{"type":"v1","addr":"172.21.15.45:6813","nonce":115843}]},"public_addr":"172.21.15.45:6808/115843","cluster_addr":"172.21.15.45:6811/115843","heartbeat_back_addr":"172.21.15.45:6815/115843","heartbeat_front_addr":"172.21.15.45:6813/115843","state":["exists","up"]},{"osd":1,"uuid":"c5de4ebd-9ec5-40b3-9caa-9b706fab4c76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":115842},{"type":"v1","addr":"172.21.15.45:6801","nonce":115842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":115842},{"type":"v1","addr":"172.21.15.45:6803","nonce":115842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6807","nonce":115842},{"type":"v1","addr":"172.21.15.45:6809","nonce":115842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":115842},{"type":"v1","addr":"172.21.15.45:6805","nonce":115842}]},"public_addr":"172.21.15.45:6801/115842","cluster_addr":"172.21.15.45:6803/115842","heartbeat_back_addr":"172.21.15.45:6809/115842","heartbeat_front_addr":"172.21.15.45:6805/115842","state":["exists","up"]},{"osd":2,"uuid":"9f4b36b2-65d2-40e7-9fe6-a2991afa71c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":115850},{"type":"v1","addr":"172.21.15.45:6819","nonce":115850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":115850},{"type":"v1","addr":"172.21.15.45:6823","nonce":115850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":115850},{"type":"v1","addr":"172.21.15.45:6831","nonce":115850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":115850},{"type":"v1","addr":"172.21.15.45:6828","nonce":115850}]},"public_addr":"172.21.15.45:6819/115850","cluster_addr":"172.21.15.45:6823/115850","heartbeat_back_addr":"172.21.15.45:6831/115850","heartbeat_front_addr":"172.21.15.45:6828/115850","state":["exists","up"]},{"osd":3,"uuid":"6fe7ef05-4e0d-426c-bf94-44b51d4d550b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":115848},{"type":"v1","addr":"172.21.15.45:6818","nonce":115848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":115848},{"type":"v1","addr":"172.21.15.45:6822","nonce":115848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6827","nonce":115848},{"type":"v1","addr":"172.21.15.45:6829","nonce":115848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":115848},{"type":"v1","addr":"172.21.15.45:6825","nonce":115848}]},"public_addr":"172.21.15.45:6818/115848","cluster_addr":"172.21.15.45:6822/115848","heartbeat_back_addr":"172.21.15.45:6829/115848","heartbeat_front_addr":"172.21.15.45:6825/115848","state":["exists","up"]},{"osd":4,"uuid":"fa403c08-d8a1-4a3a-8384-cb465c1a654c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":116092},{"type":"v1","addr":"172.21.15.152:6801","nonce":116092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":116092},{"type":"v1","addr":"172.21.15.152:6803","nonce":116092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":116092},{"type":"v1","addr":"172.21.15.152:6807","nonce":116092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":116092},{"type":"v1","addr":"172.21.15.152:6805","nonce":116092}]},"public_addr":"172.21.15.152:6801/116092","cluster_addr":"172.21.15.152:6803/116092","heartbeat_back_addr":"172.21.15.152:6807/116092","heartbeat_front_addr":"172.21.15.152:6805/116092","state":["exists","up"]},{"osd":5,"uuid":"399fc450-39fa-43a6-bf80-0b8bcb41bd95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6815","nonce":116093},{"type":"v1","addr":"172.21.15.152:6817","nonce":116093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":116093},{"type":"v1","addr":"172.21.15.152:6819","nonce":116093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":116093},{"type":"v1","addr":"172.21.15.152:6823","nonce":116093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":116093},{"type":"v1","addr":"172.21.15.152:6821","nonce":116093}]},"public_addr":"172.21.15.152:6817/116093","cluster_addr":"172.21.15.152:6819/116093","heartbeat_back_addr":"172.21.15.152:6823/116093","heartbeat_front_addr":"172.21.15.152:6821/116093","state":["exists","up"]},{"osd":6,"uuid":"e59a4017-2d23-4627-836b-e25b2d3ddaaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":116094},{"type":"v1","addr":"172.21.15.152:6809","nonce":116094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":116094},{"type":"v1","addr":"172.21.15.152:6811","nonce":116094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":116094},{"type":"v1","addr":"172.21.15.152:6816","nonce":116094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":116094},{"type":"v1","addr":"172.21.15.152:6813","nonce":116094}]},"public_addr":"172.21.15.152:6809/116094","cluster_addr":"172.21.15.152:6811/116094","heartbeat_back_addr":"172.21.15.152:6816/116094","heartbeat_front_addr":"172.21.15.152:6813/116094","state":["exists","up"]},{"osd":7,"uuid":"8d7f9d4b-bf08-4670-8591-388c0f012a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":116097},{"type":"v1","addr":"172.21.15.152:6825","nonce":116097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":116097},{"type":"v1","addr":"172.21.15.152:6827","nonce":116097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":116097},{"type":"v1","addr":"172.21.15.152:6831","nonce":116097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":116097},{"type":"v1","addr":"172.21.15.152:6829","nonce":116097}]},"public_addr":"172.21.15.152:6825/116097","cluster_addr":"172.21.15.152:6827/116097","heartbeat_back_addr":"172.21.15.152:6831/116097","heartbeat_front_addr":"172.21.15.152:6829/116097","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.937710+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.865423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.159434+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.913090+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.131647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.966255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.972583+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.177209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T12:07:42.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.128+0000 7f501dbff700 1 -- 172.21.15.45:0/4165278107 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f50040682f0 msgr2=0x7f500406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:42.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.128+0000 7f501dbff700 1 --2- 172.21.15.45:0/4165278107 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f50040682f0 0x7f500406a7a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f500c009c40 tx=0x7f500c008030 comp rx=0 tx=0).stop 2023-11-28T12:07:42.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.128+0000 7f501dbff700 1 -- 172.21.15.45:0/4165278107 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50180d2320 msgr2=0x7f5018153e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:42.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.128+0000 7f501dbff700 1 --2- 172.21.15.45:0/4165278107 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50180d2320 0x7f5018153e20 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f500800e840 tx=0x7f500800eb50 comp rx=0 tx=0).stop 2023-11-28T12:07:42.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.129+0000 7f501dbff700 1 -- 172.21.15.45:0/4165278107 shutdown_connections 2023-11-28T12:07:42.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.129+0000 7f501dbff700 1 --2- 172.21.15.45:0/4165278107 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f50040682f0 0x7f500406a7a0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:42.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.129+0000 7f501dbff700 1 --2- 172.21.15.45:0/4165278107 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5018161340 0x7f501815ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:42.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.129+0000 7f501dbff700 1 --2- 172.21.15.45:0/4165278107 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50180d2320 0x7f5018153e20 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:42.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.129+0000 7f501dbff700 1 --2- 172.21.15.45:0/4165278107 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f501815c9b0 0x7f50180c5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:42.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.129+0000 7f501dbff700 1 -- 172.21.15.45:0/4165278107 >> 172.21.15.45:0/4165278107 conn(0x7f5018072600 msgr2=0x7f501815d000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:42.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.129+0000 7f501dbff700 1 -- 172.21.15.45:0/4165278107 shutdown_connections 2023-11-28T12:07:42.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.129+0000 7f501dbff700 1 -- 172.21.15.45:0/4165278107 wait complete. 2023-11-28T12:07:42.149 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T12:07:42.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.351+0000 7f8bd77ff700 1 Processor -- start 2023-11-28T12:07:42.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.351+0000 7f8bd77ff700 1 -- start start 2023-11-28T12:07:42.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.353+0000 7f8bd77ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f8bd0161340 0x7f8bd00d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:42.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.353+0000 7f8bd77ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bd00d1950 con 0x7f8bd00d2320 2023-11-28T12:07:42.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.353+0000 7f8bd77ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bd00b5520 con 0x7f8bd015c9b0 2023-11-28T12:07:42.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.353+0000 7f8bd77ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bd00b5800 con 0x7f8bd0161340 2023-11-28T12:07:42.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.353+0000 7f8bd5d9c700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f8bd00d2320 0x7f8bd00cd7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:38704/0 (socket says 172.21.15.45:38704) 2023-11-28T12:07:42.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.353+0000 7f8bd5d9c700 1 -- 172.21.15.45:0/253617691 learned_addr learned my addr 172.21.15.45:0/253617691 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:07:42.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.353+0000 7f8bd4d9a700 1 --2- 172.21.15.45:0/253617691 >> v2:172.21.15.152:3300/0 conn(0x7f8bd0161340 0x7f8bd00d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:42.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.353+0000 7f8bc7fff700 1 -- 172.21.15.45:0/253617691 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 339140423 0 0) 0x7f8bd00d1950 con 0x7f8bd00d2320 2023-11-28T12:07:42.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.353+0000 7f8bc7fff700 1 -- 172.21.15.45:0/253617691 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8bbc0035b0 con 0x7f8bd00d2320 2023-11-28T12:07:42.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.354+0000 7f8bd4d9a700 1 -- 172.21.15.45:0/253617691 >> v1:172.21.15.152:6789/0 conn(0x7f8bd015c9b0 legacy=0x7f8bd00b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:42.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.354+0000 7f8bc7fff700 1 -- 172.21.15.45:0/253617691 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2302859451 0 0) 0x7f8bd00b5520 con 0x7f8bd015c9b0 2023-11-28T12:07:42.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.354+0000 7f8bd4d9a700 1 -- 172.21.15.45:0/253617691 >> v1:172.21.15.45:6789/0 conn(0x7f8bd00d2320 legacy=0x7f8bd00cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:42.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.354+0000 7f8bd4d9a700 1 -- 172.21.15.45:0/253617691 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bd00d1300 con 0x7f8bd0161340 2023-11-28T12:07:42.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.354+0000 7f8bd4d9a700 1 --2- 172.21.15.45:0/253617691 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8bd0161340 0x7f8bd00d1de0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8bc0009840 tx=0x7f8bc0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1cd697f8a5ccb836 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:42.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.354+0000 7f8bc7fff700 1 -- 172.21.15.45:0/253617691 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc0004230 con 0x7f8bd0161340 2023-11-28T12:07:42.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.354+0000 7f8bc7fff700 1 -- 172.21.15.45:0/253617691 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bc0004390 con 0x7f8bd0161340 2023-11-28T12:07:42.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.354+0000 7f8bc7fff700 1 -- 172.21.15.45:0/253617691 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc00036a0 con 0x7f8bd0161340 2023-11-28T12:07:42.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.355+0000 7f8bd77ff700 1 -- 172.21.15.45:0/253617691 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8bd0161340 msgr2=0x7f8bd00d1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:42.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.355+0000 7f8bd77ff700 1 --2- 172.21.15.45:0/253617691 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8bd0161340 0x7f8bd00d1de0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8bc0009840 tx=0x7f8bc0009b50 comp rx=0 tx=0).stop 2023-11-28T12:07:42.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.355+0000 7f8bd77ff700 1 -- 172.21.15.45:0/253617691 shutdown_connections 2023-11-28T12:07:42.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.355+0000 7f8bd77ff700 1 --2- 172.21.15.45:0/253617691 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8bd0161340 0x7f8bd00d1de0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:42.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.355+0000 7f8bd77ff700 1 -- 172.21.15.45:0/253617691 >> 172.21.15.45:0/253617691 conn(0x7f8bd0072600 msgr2=0x7f8bd00cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:42.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.355+0000 7f8bd77ff700 1 -- 172.21.15.45:0/253617691 shutdown_connections 2023-11-28T12:07:42.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.355+0000 7f8bd77ff700 1 -- 172.21.15.45:0/253617691 wait complete. 2023-11-28T12:07:42.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.357+0000 7f8bd77ff700 1 Processor -- start 2023-11-28T12:07:42.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.357+0000 7f8bd77ff700 1 -- start start 2023-11-28T12:07:42.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.358+0000 7f8bd77ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8bd00d2320 0x7f8bd014cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:42.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.358+0000 7f8bd77ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8bd015c9b0 0x7f8bd0155290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:42.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.358+0000 7f8bd77ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8bd0161340 0x7f8bd0152960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:42.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.358+0000 7f8bd77ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd014d470 con 0x7f8bd00d2320 2023-11-28T12:07:42.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.358+0000 7f8bd77ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd00c75d0 con 0x7f8bd0161340 2023-11-28T12:07:42.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.358+0000 7f8bd77ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd01f2370 con 0x7f8bd015c9b0 2023-11-28T12:07:42.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.358+0000 7f8bd559b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8bd00d2320 0x7f8bd014cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:42.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.358+0000 7f8bd559b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8bd00d2320 0x7f8bd014cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34104/0 (socket says 172.21.15.45:34104) 2023-11-28T12:07:42.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.358+0000 7f8bd559b700 1 -- 172.21.15.45:0/2838903550 learned_addr learned my addr 172.21.15.45:0/2838903550 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:42.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.358+0000 7f8bd4d9a700 1 --2- 172.21.15.45:0/2838903550 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8bd015c9b0 0x7f8bd0155290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:42.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.358+0000 7f8bd5d9c700 1 --2- 172.21.15.45:0/2838903550 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8bd0161340 0x7f8bd0152960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:42.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.358+0000 7f8bd559b700 1 -- 172.21.15.45:0/2838903550 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8bd015c9b0 msgr2=0x7f8bd0155290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:42.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.358+0000 7f8bd559b700 1 --2- 172.21.15.45:0/2838903550 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8bd015c9b0 0x7f8bd0155290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:42.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.358+0000 7f8bd559b700 1 -- 172.21.15.45:0/2838903550 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8bd0161340 msgr2=0x7f8bd0152960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:42.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.358+0000 7f8bd559b700 1 --2- 172.21.15.45:0/2838903550 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8bd0161340 0x7f8bd0152960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:42.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.358+0000 7f8bd559b700 1 -- 172.21.15.45:0/2838903550 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bc00094a0 con 0x7f8bd00d2320 2023-11-28T12:07:42.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.359+0000 7f8bd559b700 1 --2- 172.21.15.45:0/2838903550 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8bd00d2320 0x7f8bd014cf30 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc001eb0 tx=0x7f8bcc00c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:42.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.359+0000 7f8bc5ffb700 1 -- 172.21.15.45:0/2838903550 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bcc0054e0 con 0x7f8bd00d2320 2023-11-28T12:07:42.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.359+0000 7f8bc5ffb700 1 -- 172.21.15.45:0/2838903550 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bcc003680 con 0x7f8bd00d2320 2023-11-28T12:07:42.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.359+0000 7f8bc5ffb700 1 -- 172.21.15.45:0/2838903550 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bcc0039f0 con 0x7f8bd00d2320 2023-11-28T12:07:42.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.359+0000 7f8bd77ff700 1 -- 172.21.15.45:0/2838903550 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bd015cd80 con 0x7f8bd00d2320 2023-11-28T12:07:42.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.359+0000 7f8bd77ff700 1 -- 172.21.15.45:0/2838903550 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bd00d15e0 con 0x7f8bd00d2320 2023-11-28T12:07:42.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.360+0000 7f8bd77ff700 1 -- 172.21.15.45:0/2838903550 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bd015cf10 con 0x7f8bd00d2320 2023-11-28T12:07:42.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.361+0000 7f8bc5ffb700 1 -- 172.21.15.45:0/2838903550 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f8bcc019030 con 0x7f8bd00d2320 2023-11-28T12:07:42.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.362+0000 7f8bc5ffb700 1 --2- 172.21.15.45:0/2838903550 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f8bb40682f0 0x7f8bb406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:42.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.362+0000 7f8bc5ffb700 1 -- 172.21.15.45:0/2838903550 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8bcc084fc0 con 0x7f8bd00d2320 2023-11-28T12:07:42.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.362+0000 7f8bd4d9a700 1 --2- 172.21.15.45:0/2838903550 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f8bb40682f0 0x7f8bb406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:42.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.363+0000 7f8bd4d9a700 1 --2- 172.21.15.45:0/2838903550 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f8bb40682f0 0x7f8bb406a7a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8bc00090b0 tx=0x7f8bc0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:42.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.366+0000 7f8bc5ffb700 1 -- 172.21.15.45:0/2838903550 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f8bcc04b5e0 con 0x7f8bd00d2320 2023-11-28T12:07:42.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.566+0000 7f8bd77ff700 1 -- 172.21.15.45:0/2838903550 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8bd00745c0 con 0x7f8bd00d2320 2023-11-28T12:07:42.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.567+0000 7f8bc5ffb700 1 -- 172.21.15.45:0/2838903550 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+17934 (secure 0 0 0) 0x7f8bcc017020 con 0x7f8bd00d2320 2023-11-28T12:07:42.568 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:07:42.568 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":33,"fsid":"bd7c37f1-f7c6-4778-b845-52cf2aa6e366","created":"2023-11-28T12:06:09.045075+0000","modified":"2023-11-28T12:07:41.650406+0000","last_up_change":"2023-11-28T12:06:21.282227+0000","last_in_change":"2023-11-28T12:06:12.560924+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T12:06:21.807108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T12:06:22.491009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-28T12:07:39.383009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-28T12:07:40.658112+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d0cdd8a-87fd-4f2c-91bd-47bdfa661905","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":115843},{"type":"v1","addr":"172.21.15.45:6808","nonce":115843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":115843},{"type":"v1","addr":"172.21.15.45:6811","nonce":115843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":115843},{"type":"v1","addr":"172.21.15.45:6815","nonce":115843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":115843},{"type":"v1","addr":"172.21.15.45:6813","nonce":115843}]},"public_addr":"172.21.15.45:6808/115843","cluster_addr":"172.21.15.45:6811/115843","heartbeat_back_addr":"172.21.15.45:6815/115843","heartbeat_front_addr":"172.21.15.45:6813/115843","state":["exists","up"]},{"osd":1,"uuid":"c5de4ebd-9ec5-40b3-9caa-9b706fab4c76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":115842},{"type":"v1","addr":"172.21.15.45:6801","nonce":115842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":115842},{"type":"v1","addr":"172.21.15.45:6803","nonce":115842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6807","nonce":115842},{"type":"v1","addr":"172.21.15.45:6809","nonce":115842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":115842},{"type":"v1","addr":"172.21.15.45:6805","nonce":115842}]},"public_addr":"172.21.15.45:6801/115842","cluster_addr":"172.21.15.45:6803/115842","heartbeat_back_addr":"172.21.15.45:6809/115842","heartbeat_front_addr":"172.21.15.45:6805/115842","state":["exists","up"]},{"osd":2,"uuid":"9f4b36b2-65d2-40e7-9fe6-a2991afa71c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":115850},{"type":"v1","addr":"172.21.15.45:6819","nonce":115850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":115850},{"type":"v1","addr":"172.21.15.45:6823","nonce":115850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":115850},{"type":"v1","addr":"172.21.15.45:6831","nonce":115850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":115850},{"type":"v1","addr":"172.21.15.45:6828","nonce":115850}]},"public_addr":"172.21.15.45:6819/115850","cluster_addr":"172.21.15.45:6823/115850","heartbeat_back_addr":"172.21.15.45:6831/115850","heartbeat_front_addr":"172.21.15.45:6828/115850","state":["exists","up"]},{"osd":3,"uuid":"6fe7ef05-4e0d-426c-bf94-44b51d4d550b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":115848},{"type":"v1","addr":"172.21.15.45:6818","nonce":115848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":115848},{"type":"v1","addr":"172.21.15.45:6822","nonce":115848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6827","nonce":115848},{"type":"v1","addr":"172.21.15.45:6829","nonce":115848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":115848},{"type":"v1","addr":"172.21.15.45:6825","nonce":115848}]},"public_addr":"172.21.15.45:6818/115848","cluster_addr":"172.21.15.45:6822/115848","heartbeat_back_addr":"172.21.15.45:6829/115848","heartbeat_front_addr":"172.21.15.45:6825/115848","state":["exists","up"]},{"osd":4,"uuid":"fa403c08-d8a1-4a3a-8384-cb465c1a654c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":116092},{"type":"v1","addr":"172.21.15.152:6801","nonce":116092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":116092},{"type":"v1","addr":"172.21.15.152:6803","nonce":116092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":116092},{"type":"v1","addr":"172.21.15.152:6807","nonce":116092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":116092},{"type":"v1","addr":"172.21.15.152:6805","nonce":116092}]},"public_addr":"172.21.15.152:6801/116092","cluster_addr":"172.21.15.152:6803/116092","heartbeat_back_addr":"172.21.15.152:6807/116092","heartbeat_front_addr":"172.21.15.152:6805/116092","state":["exists","up"]},{"osd":5,"uuid":"399fc450-39fa-43a6-bf80-0b8bcb41bd95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6815","nonce":116093},{"type":"v1","addr":"172.21.15.152:6817","nonce":116093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":116093},{"type":"v1","addr":"172.21.15.152:6819","nonce":116093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":116093},{"type":"v1","addr":"172.21.15.152:6823","nonce":116093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":116093},{"type":"v1","addr":"172.21.15.152:6821","nonce":116093}]},"public_addr":"172.21.15.152:6817/116093","cluster_addr":"172.21.15.152:6819/116093","heartbeat_back_addr":"172.21.15.152:6823/116093","heartbeat_front_addr":"172.21.15.152:6821/116093","state":["exists","up"]},{"osd":6,"uuid":"e59a4017-2d23-4627-836b-e25b2d3ddaaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":116094},{"type":"v1","addr":"172.21.15.152:6809","nonce":116094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":116094},{"type":"v1","addr":"172.21.15.152:6811","nonce":116094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":116094},{"type":"v1","addr":"172.21.15.152:6816","nonce":116094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":116094},{"type":"v1","addr":"172.21.15.152:6813","nonce":116094}]},"public_addr":"172.21.15.152:6809/116094","cluster_addr":"172.21.15.152:6811/116094","heartbeat_back_addr":"172.21.15.152:6816/116094","heartbeat_front_addr":"172.21.15.152:6813/116094","state":["exists","up"]},{"osd":7,"uuid":"8d7f9d4b-bf08-4670-8591-388c0f012a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":116097},{"type":"v1","addr":"172.21.15.152:6825","nonce":116097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":116097},{"type":"v1","addr":"172.21.15.152:6827","nonce":116097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":116097},{"type":"v1","addr":"172.21.15.152:6831","nonce":116097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":116097},{"type":"v1","addr":"172.21.15.152:6829","nonce":116097}]},"public_addr":"172.21.15.152:6825/116097","cluster_addr":"172.21.15.152:6827/116097","heartbeat_back_addr":"172.21.15.152:6831/116097","heartbeat_front_addr":"172.21.15.152:6829/116097","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.937710+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.865423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.159434+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.913090+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.131647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.966255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.972583+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.177209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T12:07:42.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.569+0000 7f8bd77ff700 1 -- 172.21.15.45:0/2838903550 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f8bb40682f0 msgr2=0x7f8bb406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:42.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.569+0000 7f8bd77ff700 1 --2- 172.21.15.45:0/2838903550 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f8bb40682f0 0x7f8bb406a7a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8bc00090b0 tx=0x7f8bc0008030 comp rx=0 tx=0).stop 2023-11-28T12:07:42.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.569+0000 7f8bd77ff700 1 -- 172.21.15.45:0/2838903550 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8bd00d2320 msgr2=0x7f8bd014cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:42.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.569+0000 7f8bd77ff700 1 --2- 172.21.15.45:0/2838903550 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8bd00d2320 0x7f8bd014cf30 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc001eb0 tx=0x7f8bcc00c800 comp rx=0 tx=0).stop 2023-11-28T12:07:42.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.569+0000 7f8bd77ff700 1 -- 172.21.15.45:0/2838903550 shutdown_connections 2023-11-28T12:07:42.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.569+0000 7f8bd77ff700 1 --2- 172.21.15.45:0/2838903550 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f8bb40682f0 0x7f8bb406a7a0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:42.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.569+0000 7f8bd77ff700 1 --2- 172.21.15.45:0/2838903550 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8bd0161340 0x7f8bd0152960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:42.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.569+0000 7f8bd77ff700 1 --2- 172.21.15.45:0/2838903550 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8bd00d2320 0x7f8bd014cf30 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:42.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.569+0000 7f8bd77ff700 1 --2- 172.21.15.45:0/2838903550 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8bd015c9b0 0x7f8bd0155290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:42.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.569+0000 7f8bd77ff700 1 -- 172.21.15.45:0/2838903550 >> 172.21.15.45:0/2838903550 conn(0x7f8bd0072600 msgr2=0x7f8bd00b6010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:42.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.569+0000 7f8bd77ff700 1 -- 172.21.15.45:0/2838903550 shutdown_connections 2023-11-28T12:07:42.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.569+0000 7f8bd77ff700 1 -- 172.21.15.45:0/2838903550 wait complete. 2023-11-28T12:07:42.590 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-28T12:07:42.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.799+0000 7f9134bff700 1 Processor -- start 2023-11-28T12:07:42.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.799+0000 7f9134bff700 1 -- start start 2023-11-28T12:07:42.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.800+0000 7f9134bff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f913015c9b0 0x7f91300b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:42.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.800+0000 7f9134bff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91300d1950 con 0x7f91300cd7c0 2023-11-28T12:07:42.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.800+0000 7f9134bff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91300d24f0 con 0x7f9130161340 2023-11-28T12:07:42.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.800+0000 7f9134bff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91300b5800 con 0x7f913015c9b0 2023-11-28T12:07:42.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.801+0000 7f912e59c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f913015c9b0 0x7f91300b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:42.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.801+0000 7f912e59c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f913015c9b0 0x7f91300b4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34106/0 (socket says 172.21.15.45:34106) 2023-11-28T12:07:42.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.801+0000 7f912e59c700 1 -- 172.21.15.45:0/116356651 learned_addr learned my addr 172.21.15.45:0/116356651 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:42.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.801+0000 7f912ed9d700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f91300cd7c0 0x7f91300b5fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:38720/0 (socket says 172.21.15.45:38720) 2023-11-28T12:07:42.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.801+0000 7f912e59c700 1 -- 172.21.15.45:0/116356651 >> v1:172.21.15.152:6789/0 conn(0x7f9130161340 legacy=0x7f91300d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:42.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.801+0000 7f912e59c700 1 -- 172.21.15.45:0/116356651 >> v1:172.21.15.45:6789/0 conn(0x7f91300cd7c0 legacy=0x7f91300b5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:42.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.801+0000 7f912e59c700 1 -- 172.21.15.45:0/116356651 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91300b5520 con 0x7f913015c9b0 2023-11-28T12:07:42.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.801+0000 7f912e59c700 1 --2- 172.21.15.45:0/116356651 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f913015c9b0 0x7f91300b4bf0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f91200098f0 tx=0x7f9120009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76979f51de5cc598 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:42.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.802+0000 7f912d59a700 1 -- 172.21.15.45:0/116356651 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9120004230 con 0x7f913015c9b0 2023-11-28T12:07:42.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.802+0000 7f912d59a700 1 -- 172.21.15.45:0/116356651 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9120004390 con 0x7f913015c9b0 2023-11-28T12:07:42.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.802+0000 7f912d59a700 1 -- 172.21.15.45:0/116356651 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91200036a0 con 0x7f913015c9b0 2023-11-28T12:07:42.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.802+0000 7f9134bff700 1 -- 172.21.15.45:0/116356651 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f913015c9b0 msgr2=0x7f91300b4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:42.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.802+0000 7f9134bff700 1 --2- 172.21.15.45:0/116356651 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f913015c9b0 0x7f91300b4bf0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f91200098f0 tx=0x7f9120009c00 comp rx=0 tx=0).stop 2023-11-28T12:07:42.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.802+0000 7f9134bff700 1 -- 172.21.15.45:0/116356651 shutdown_connections 2023-11-28T12:07:42.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.802+0000 7f9134bff700 1 --2- 172.21.15.45:0/116356651 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f913015c9b0 0x7f91300b4bf0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:42.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.802+0000 7f9134bff700 1 -- 172.21.15.45:0/116356651 >> 172.21.15.45:0/116356651 conn(0x7f9130072600 msgr2=0x7f91300cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:42.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.802+0000 7f9134bff700 1 -- 172.21.15.45:0/116356651 shutdown_connections 2023-11-28T12:07:42.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.802+0000 7f9134bff700 1 -- 172.21.15.45:0/116356651 wait complete. 2023-11-28T12:07:42.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.804+0000 7f9134bff700 1 Processor -- start 2023-11-28T12:07:42.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.804+0000 7f9134bff700 1 -- start start 2023-11-28T12:07:42.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.805+0000 7f9134bff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91300cd7c0 0x7f9130157690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:42.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.805+0000 7f9134bff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f913015c9b0 0x7f91300b87f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:42.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.805+0000 7f9134bff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9130161340 0x7f91301e7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:42.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.805+0000 7f9134bff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91300b83d0 con 0x7f9130161340 2023-11-28T12:07:42.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.805+0000 7f9134bff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91300cc900 con 0x7f91300cd7c0 2023-11-28T12:07:42.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.805+0000 7f9134bff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91300b7de0 con 0x7f913015c9b0 2023-11-28T12:07:42.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.805+0000 7f912ed9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9130161340 0x7f91301e7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:42.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.805+0000 7f912ed9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9130161340 0x7f91301e7140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34108/0 (socket says 172.21.15.45:34108) 2023-11-28T12:07:42.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.805+0000 7f912ed9d700 1 -- 172.21.15.45:0/455989840 learned_addr learned my addr 172.21.15.45:0/455989840 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:42.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.805+0000 7f912e59c700 1 --2- 172.21.15.45:0/455989840 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91300cd7c0 0x7f9130157690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:42.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.806+0000 7f912dd9b700 1 --2- 172.21.15.45:0/455989840 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f913015c9b0 0x7f91300b87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:42.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.806+0000 7f912ed9d700 1 -- 172.21.15.45:0/455989840 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f913015c9b0 msgr2=0x7f91300b87f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:42.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.806+0000 7f912ed9d700 1 --2- 172.21.15.45:0/455989840 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f913015c9b0 0x7f91300b87f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:42.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.806+0000 7f912ed9d700 1 -- 172.21.15.45:0/455989840 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91300cd7c0 msgr2=0x7f9130157690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:42.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.806+0000 7f912ed9d700 1 --2- 172.21.15.45:0/455989840 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91300cd7c0 0x7f9130157690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:42.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.806+0000 7f912ed9d700 1 -- 172.21.15.45:0/455989840 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9120009550 con 0x7f9130161340 2023-11-28T12:07:42.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.806+0000 7f912ed9d700 1 --2- 172.21.15.45:0/455989840 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9130161340 0x7f91301e7140 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f912800cbc0 tx=0x7f912800ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:42.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.806+0000 7f911effd700 1 -- 172.21.15.45:0/455989840 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f912800aaa0 con 0x7f9130161340 2023-11-28T12:07:42.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.806+0000 7f911effd700 1 -- 172.21.15.45:0/455989840 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f912800ac00 con 0x7f9130161340 2023-11-28T12:07:42.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.806+0000 7f9134bff700 1 -- 172.21.15.45:0/455989840 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91300d15e0 con 0x7f9130161340 2023-11-28T12:07:42.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.806+0000 7f911effd700 1 -- 172.21.15.45:0/455989840 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9128007070 con 0x7f9130161340 2023-11-28T12:07:42.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.806+0000 7f9134bff700 1 -- 172.21.15.45:0/455989840 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91300d1300 con 0x7f9130161340 2023-11-28T12:07:42.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.807+0000 7f9134bff700 1 -- 172.21.15.45:0/455989840 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91300b5130 con 0x7f9130161340 2023-11-28T12:07:42.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.808+0000 7f911effd700 1 -- 172.21.15.45:0/455989840 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f9128019030 con 0x7f9130161340 2023-11-28T12:07:42.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.809+0000 7f911effd700 1 --2- 172.21.15.45:0/455989840 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f91100682f0 0x7f911006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:42.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.809+0000 7f911effd700 1 -- 172.21.15.45:0/455989840 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9128085780 con 0x7f9130161340 2023-11-28T12:07:42.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.810+0000 7f912e59c700 1 --2- 172.21.15.45:0/455989840 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f91100682f0 0x7f911006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:42.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.810+0000 7f912e59c700 1 --2- 172.21.15.45:0/455989840 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f91100682f0 0x7f911006a7a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9120009130 tx=0x7f9120008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:42.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:42.813+0000 7f911effd700 1 -- 172.21.15.45:0/455989840 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f912804b5e0 con 0x7f9130161340 2023-11-28T12:07:43.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:43.069+0000 7f9134bff700 1 -- 172.21.15.45:0/455989840 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f91300745c0 con 0x7f9130161340 2023-11-28T12:07:43.107 INFO:tasks.ceph.mds.a.smithi045.stderr:2023-11-28T12:07:43.107+0000 7f23b53f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-28T12:07:43.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:43.661+0000 7f911effd700 1 -- 172.21.15.45:0/455989840 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) v1 ==== 118+0+0 (secure 0 0 0) 0x7f91280170b0 con 0x7f9130161340 2023-11-28T12:07:43.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:43.664+0000 7f9134bff700 1 -- 172.21.15.45:0/455989840 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f91100682f0 msgr2=0x7f911006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:43.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:43.664+0000 7f9134bff700 1 --2- 172.21.15.45:0/455989840 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f91100682f0 0x7f911006a7a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9120009130 tx=0x7f9120008030 comp rx=0 tx=0).stop 2023-11-28T12:07:43.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:43.664+0000 7f9134bff700 1 -- 172.21.15.45:0/455989840 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9130161340 msgr2=0x7f91301e7140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:43.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:43.664+0000 7f9134bff700 1 --2- 172.21.15.45:0/455989840 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9130161340 0x7f91301e7140 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f912800cbc0 tx=0x7f912800ced0 comp rx=0 tx=0).stop 2023-11-28T12:07:43.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:43.664+0000 7f9134bff700 1 -- 172.21.15.45:0/455989840 shutdown_connections 2023-11-28T12:07:43.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:43.664+0000 7f9134bff700 1 --2- 172.21.15.45:0/455989840 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f91100682f0 0x7f911006a7a0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:43.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:43.664+0000 7f9134bff700 1 --2- 172.21.15.45:0/455989840 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91300cd7c0 0x7f9130157690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:43.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:43.664+0000 7f9134bff700 1 --2- 172.21.15.45:0/455989840 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9130161340 0x7f91301e7140 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:43.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:43.664+0000 7f9134bff700 1 --2- 172.21.15.45:0/455989840 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f913015c9b0 0x7f91300b87f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:43.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:43.664+0000 7f9134bff700 1 -- 172.21.15.45:0/455989840 >> 172.21.15.45:0/455989840 conn(0x7f9130072600 msgr2=0x7f91300b5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:43.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:43.664+0000 7f9134bff700 1 -- 172.21.15.45:0/455989840 shutdown_connections 2023-11-28T12:07:43.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:43.664+0000 7f9134bff700 1 -- 172.21.15.45:0/455989840 wait complete. 2023-11-28T12:07:43.684 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-28T12:07:43.685 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-28T12:07:43.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:43.894+0000 7f863bbff700 1 Processor -- start 2023-11-28T12:07:43.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:43.894+0000 7f863bbff700 1 -- start start 2023-11-28T12:07:43.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:43.895+0000 7f863bbff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f86340cd7c0 0x7f86340cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:43.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:43.895+0000 7f863bbff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86340d1950 con 0x7f863415c9b0 2023-11-28T12:07:43.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:43.895+0000 7f863bbff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86340ce140 con 0x7f8634161340 2023-11-28T12:07:43.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:43.895+0000 7f863bbff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86340b5800 con 0x7f86340cd7c0 2023-11-28T12:07:43.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:43.896+0000 7f863999b700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f863415c9b0 0x7f86340b4bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:38722/0 (socket says 172.21.15.45:38722) 2023-11-28T12:07:43.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:43.896+0000 7f863999b700 1 -- 172.21.15.45:0/1168997322 learned_addr learned my addr 172.21.15.45:0/1168997322 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:07:43.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:43.896+0000 7f863a19c700 1 --2- 172.21.15.45:0/1168997322 >> v2:172.21.15.45:3300/0 conn(0x7f86340cd7c0 0x7f86340cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:43.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:43.896+0000 7f8638999700 1 -- 172.21.15.45:0/1168997322 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 62924695 0 0) 0x7f86340d1950 con 0x7f863415c9b0 2023-11-28T12:07:43.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:43.896+0000 7f8638999700 1 -- 172.21.15.45:0/1168997322 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86200035b0 con 0x7f863415c9b0 2023-11-28T12:07:43.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:43.896+0000 7f863a19c700 1 -- 172.21.15.45:0/1168997322 >> v1:172.21.15.152:6789/0 conn(0x7f8634161340 legacy=0x7f86340d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:43.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:43.896+0000 7f863a19c700 1 -- 172.21.15.45:0/1168997322 >> v1:172.21.15.45:6789/0 conn(0x7f863415c9b0 legacy=0x7f86340b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:43.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:43.896+0000 7f863a19c700 1 -- 172.21.15.45:0/1168997322 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86340d24f0 con 0x7f86340cd7c0 2023-11-28T12:07:43.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:43.896+0000 7f863a19c700 1 --2- 172.21.15.45:0/1168997322 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86340cd7c0 0x7f86340cdc00 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f862c009d90 tx=0x7f862c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5dda4ffbd841ddd server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:43.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:43.897+0000 7f8638999700 1 -- 172.21.15.45:0/1168997322 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f862c00e070 con 0x7f86340cd7c0 2023-11-28T12:07:43.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:43.897+0000 7f8638999700 1 -- 172.21.15.45:0/1168997322 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f862c00bb20 con 0x7f86340cd7c0 2023-11-28T12:07:43.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:43.897+0000 7f8638999700 1 -- 172.21.15.45:0/1168997322 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f862c012430 con 0x7f86340cd7c0 2023-11-28T12:07:43.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:43.897+0000 7f863bbff700 1 -- 172.21.15.45:0/1168997322 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86340cd7c0 msgr2=0x7f86340cdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:43.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:43.897+0000 7f863bbff700 1 --2- 172.21.15.45:0/1168997322 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86340cd7c0 0x7f86340cdc00 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f862c009d90 tx=0x7f862c00b330 comp rx=0 tx=0).stop 2023-11-28T12:07:43.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:43.897+0000 7f863bbff700 1 -- 172.21.15.45:0/1168997322 shutdown_connections 2023-11-28T12:07:43.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:43.897+0000 7f863bbff700 1 --2- 172.21.15.45:0/1168997322 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86340cd7c0 0x7f86340cdc00 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:43.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:43.897+0000 7f863bbff700 1 -- 172.21.15.45:0/1168997322 >> 172.21.15.45:0/1168997322 conn(0x7f8634072600 msgr2=0x7f86340cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:43.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:43.897+0000 7f863bbff700 1 -- 172.21.15.45:0/1168997322 shutdown_connections 2023-11-28T12:07:43.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:43.897+0000 7f863bbff700 1 -- 172.21.15.45:0/1168997322 wait complete. 2023-11-28T12:07:43.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:43.899+0000 7f863bbff700 1 Processor -- start 2023-11-28T12:07:43.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:43.899+0000 7f863bbff700 1 -- start start 2023-11-28T12:07:43.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:43.900+0000 7f863bbff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86340cd7c0 0x7f86340ccae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:43.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:43.900+0000 7f863bbff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f863415c9b0 0x7f863415e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:43.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:43.900+0000 7f863bbff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8634161340 0x7f86341e6970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:43.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:43.900+0000 7f863bbff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86341f3e30 con 0x7f8634161340 2023-11-28T12:07:43.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:43.900+0000 7f863bbff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86340cd020 con 0x7f86340cd7c0 2023-11-28T12:07:43.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:43.900+0000 7f863bbff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f863415ece0 con 0x7f863415c9b0 2023-11-28T12:07:43.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:43.900+0000 7f863a19c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8634161340 0x7f86341e6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:43.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:43.900+0000 7f863a19c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8634161340 0x7f86341e6970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34118/0 (socket says 172.21.15.45:34118) 2023-11-28T12:07:43.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:43.900+0000 7f863a19c700 1 -- 172.21.15.45:0/1702214662 learned_addr learned my addr 172.21.15.45:0/1702214662 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:43.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:43.901+0000 7f863919a700 1 --2- 172.21.15.45:0/1702214662 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f863415c9b0 0x7f863415e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:43.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:43.901+0000 7f863999b700 1 --2- 172.21.15.45:0/1702214662 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86340cd7c0 0x7f86340ccae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:43.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:43.901+0000 7f863a19c700 1 -- 172.21.15.45:0/1702214662 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f863415c9b0 msgr2=0x7f863415e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:43.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:43.901+0000 7f863a19c700 1 --2- 172.21.15.45:0/1702214662 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f863415c9b0 0x7f863415e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:43.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:43.901+0000 7f863a19c700 1 -- 172.21.15.45:0/1702214662 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86340cd7c0 msgr2=0x7f86340ccae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:43.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:43.901+0000 7f863a19c700 1 --2- 172.21.15.45:0/1702214662 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86340cd7c0 0x7f86340ccae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:43.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:43.901+0000 7f863a19c700 1 -- 172.21.15.45:0/1702214662 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f862c009a70 con 0x7f8634161340 2023-11-28T12:07:43.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:43.901+0000 7f863a19c700 1 --2- 172.21.15.45:0/1702214662 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8634161340 0x7f86341e6970 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f86340675d0 tx=0x7f862c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:43.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:43.901+0000 7f862a7fc700 1 -- 172.21.15.45:0/1702214662 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f862c012430 con 0x7f8634161340 2023-11-28T12:07:43.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:43.901+0000 7f862a7fc700 1 -- 172.21.15.45:0/1702214662 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f862c020070 con 0x7f8634161340 2023-11-28T12:07:43.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:43.901+0000 7f862a7fc700 1 -- 172.21.15.45:0/1702214662 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f862c004280 con 0x7f8634161340 2023-11-28T12:07:43.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:43.901+0000 7f863bbff700 1 -- 172.21.15.45:0/1702214662 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86340d1300 con 0x7f8634161340 2023-11-28T12:07:43.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:43.901+0000 7f863bbff700 1 -- 172.21.15.45:0/1702214662 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86340b5520 con 0x7f8634161340 2023-11-28T12:07:43.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:43.903+0000 7f863bbff700 1 -- 172.21.15.45:0/1702214662 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86340d15e0 con 0x7f8634161340 2023-11-28T12:07:43.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:43.903+0000 7f862a7fc700 1 -- 172.21.15.45:0/1702214662 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f862c02e070 con 0x7f8634161340 2023-11-28T12:07:43.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:43.905+0000 7f862a7fc700 1 --2- 172.21.15.45:0/1702214662 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f86180682f0 0x7f861806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:43.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:43.905+0000 7f862a7fc700 1 -- 172.21.15.45:0/1702214662 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f862c022070 con 0x7f8634161340 2023-11-28T12:07:43.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:43.905+0000 7f863999b700 1 --2- 172.21.15.45:0/1702214662 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f86180682f0 0x7f861806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:43.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:43.906+0000 7f863999b700 1 --2- 172.21.15.45:0/1702214662 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f86180682f0 0x7f861806a7a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f86300011e0 tx=0x7f8630009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:43.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:43.910+0000 7f862a7fc700 1 -- 172.21.15.45:0/1702214662 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f862c054220 con 0x7f8634161340 2023-11-28T12:07:44.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:44.160+0000 7f863bbff700 1 -- 172.21.15.45:0/1702214662 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f86341f3f70 con 0x7f8634161340 2023-11-28T12:07:44.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:44.855+0000 7f862a7fc700 1 -- 172.21.15.45:0/1702214662 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f86341f3f70 con 0x7f8634161340 2023-11-28T12:07:44.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:44.859+0000 7f863bbff700 1 -- 172.21.15.45:0/1702214662 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f86180682f0 msgr2=0x7f861806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:44.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:44.859+0000 7f863bbff700 1 --2- 172.21.15.45:0/1702214662 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f86180682f0 0x7f861806a7a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f86300011e0 tx=0x7f8630009040 comp rx=0 tx=0).stop 2023-11-28T12:07:44.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:44.859+0000 7f863bbff700 1 -- 172.21.15.45:0/1702214662 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8634161340 msgr2=0x7f86341e6970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:44.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:44.859+0000 7f863bbff700 1 --2- 172.21.15.45:0/1702214662 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8634161340 0x7f86341e6970 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f86340675d0 tx=0x7f862c004ad0 comp rx=0 tx=0).stop 2023-11-28T12:07:44.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:44.859+0000 7f863bbff700 1 -- 172.21.15.45:0/1702214662 shutdown_connections 2023-11-28T12:07:44.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:44.859+0000 7f863bbff700 1 --2- 172.21.15.45:0/1702214662 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f86180682f0 0x7f861806a7a0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:44.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:44.859+0000 7f863bbff700 1 --2- 172.21.15.45:0/1702214662 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86340cd7c0 0x7f86340ccae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:44.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:44.859+0000 7f863bbff700 1 --2- 172.21.15.45:0/1702214662 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8634161340 0x7f86341e6970 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:44.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:44.859+0000 7f863bbff700 1 --2- 172.21.15.45:0/1702214662 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f863415c9b0 0x7f863415e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:44.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:44.859+0000 7f863bbff700 1 -- 172.21.15.45:0/1702214662 >> 172.21.15.45:0/1702214662 conn(0x7f8634072600 msgr2=0x7f8634160610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:44.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:44.859+0000 7f863bbff700 1 -- 172.21.15.45:0/1702214662 shutdown_connections 2023-11-28T12:07:44.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:44.859+0000 7f863bbff700 1 -- 172.21.15.45:0/1702214662 wait complete. 2023-11-28T12:07:44.881 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-28T12:07:44.881 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T12:07:45.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.088+0000 7f65697ff700 1 Processor -- start 2023-11-28T12:07:45.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.088+0000 7f65697ff700 1 -- start start 2023-11-28T12:07:45.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.089+0000 7f65697ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f656415c9b0 0x7f65640b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:45.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.089+0000 7f65697ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6564161340 0x7f65640d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:45.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.089+0000 7f65697ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65640d1950 con 0x7f65640d2320 2023-11-28T12:07:45.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.089+0000 7f65697ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65640b5800 con 0x7f6564161340 2023-11-28T12:07:45.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.089+0000 7f65697ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65640b5520 con 0x7f656415c9b0 2023-11-28T12:07:45.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.089+0000 7f65627fc700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6564161340 0x7f65640d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:45.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.090+0000 7f65637fe700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f65640d2320 0x7f65640cd7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:38724/0 (socket says 172.21.15.45:38724) 2023-11-28T12:07:45.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.090+0000 7f65637fe700 1 -- 172.21.15.45:0/1586043592 learned_addr learned my addr 172.21.15.45:0/1586043592 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:07:45.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.090+0000 7f65627fc700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6564161340 0x7f65640d1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34124/0 (socket says 172.21.15.45:34124) 2023-11-28T12:07:45.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.090+0000 7f6562ffd700 1 --2- 172.21.15.45:0/1586043592 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f656415c9b0 0x7f65640b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:45.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.090+0000 7f65627fc700 1 -- 172.21.15.45:0/1586043592 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f656415c9b0 msgr2=0x7f65640b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:45.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.090+0000 7f65627fc700 1 --2- 172.21.15.45:0/1586043592 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f656415c9b0 0x7f65640b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:45.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.090+0000 7f65627fc700 1 -- 172.21.15.45:0/1586043592 >> v1:172.21.15.45:6789/0 conn(0x7f65640d2320 legacy=0x7f65640cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:45.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.090+0000 7f65627fc700 1 -- 172.21.15.45:0/1586043592 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65640d1300 con 0x7f6564161340 2023-11-28T12:07:45.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.090+0000 7f65627fc700 1 --2- 172.21.15.45:0/1586043592 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6564161340 0x7f65640d1de0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f6558009840 tx=0x7f6558009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cce26187117446f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:45.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.090+0000 7f6561ffb700 1 -- 172.21.15.45:0/1586043592 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6558011830 con 0x7f6564161340 2023-11-28T12:07:45.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.091+0000 7f6561ffb700 1 -- 172.21.15.45:0/1586043592 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6558011990 con 0x7f6564161340 2023-11-28T12:07:45.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.091+0000 7f6561ffb700 1 -- 172.21.15.45:0/1586043592 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6558011d20 con 0x7f6564161340 2023-11-28T12:07:45.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.091+0000 7f65697ff700 1 -- 172.21.15.45:0/1586043592 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6564161340 msgr2=0x7f65640d1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:45.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.091+0000 7f65697ff700 1 --2- 172.21.15.45:0/1586043592 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6564161340 0x7f65640d1de0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f6558009840 tx=0x7f6558009b50 comp rx=0 tx=0).stop 2023-11-28T12:07:45.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.091+0000 7f65697ff700 1 -- 172.21.15.45:0/1586043592 shutdown_connections 2023-11-28T12:07:45.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.091+0000 7f65697ff700 1 --2- 172.21.15.45:0/1586043592 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f656415c9b0 0x7f65640b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:45.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.091+0000 7f65697ff700 1 --2- 172.21.15.45:0/1586043592 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6564161340 0x7f65640d1de0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:45.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.091+0000 7f65697ff700 1 -- 172.21.15.45:0/1586043592 >> 172.21.15.45:0/1586043592 conn(0x7f6564072600 msgr2=0x7f65640cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:45.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.091+0000 7f65697ff700 1 -- 172.21.15.45:0/1586043592 shutdown_connections 2023-11-28T12:07:45.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.091+0000 7f65697ff700 1 -- 172.21.15.45:0/1586043592 wait complete. 2023-11-28T12:07:45.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.093+0000 7f65697ff700 1 Processor -- start 2023-11-28T12:07:45.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.093+0000 7f65697ff700 1 -- start start 2023-11-28T12:07:45.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.094+0000 7f65697ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f65640d2320 0x7f65641e8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:45.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.094+0000 7f65697ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f656415c9b0 0x7f6564143460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:45.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.094+0000 7f65697ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6564161340 0x7f65641e6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:45.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.094+0000 7f65697ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65641e77d0 con 0x7f6564161340 2023-11-28T12:07:45.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.094+0000 7f65697ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65641e7ab0 con 0x7f65640d2320 2023-11-28T12:07:45.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.094+0000 7f65697ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65641e7d90 con 0x7f656415c9b0 2023-11-28T12:07:45.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.094+0000 7f65637fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6564161340 0x7f65641e6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:45.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.094+0000 7f65637fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6564161340 0x7f65641e6ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34138/0 (socket says 172.21.15.45:34138) 2023-11-28T12:07:45.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.094+0000 7f65637fe700 1 -- 172.21.15.45:0/175474883 learned_addr learned my addr 172.21.15.45:0/175474883 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:45.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.095+0000 7f65627fc700 1 --2- 172.21.15.45:0/175474883 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f656415c9b0 0x7f6564143460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:45.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.095+0000 7f6562ffd700 1 --2- 172.21.15.45:0/175474883 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f65640d2320 0x7f65641e8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:45.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.095+0000 7f65637fe700 1 -- 172.21.15.45:0/175474883 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f656415c9b0 msgr2=0x7f6564143460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:45.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.095+0000 7f65637fe700 1 --2- 172.21.15.45:0/175474883 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f656415c9b0 0x7f6564143460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:45.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.095+0000 7f65637fe700 1 -- 172.21.15.45:0/175474883 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f65640d2320 msgr2=0x7f65641e8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:45.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.095+0000 7f65637fe700 1 --2- 172.21.15.45:0/175474883 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f65640d2320 0x7f65641e8850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:45.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.095+0000 7f65637fe700 1 -- 172.21.15.45:0/175474883 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65580094a0 con 0x7f6564161340 2023-11-28T12:07:45.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.095+0000 7f65637fe700 1 --2- 172.21.15.45:0/175474883 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6564161340 0x7f65641e6ed0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f655c00ca80 tx=0x7f655c00ce40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:45.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.095+0000 7f654b7fe700 1 -- 172.21.15.45:0/175474883 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f655c00aaa0 con 0x7f6564161340 2023-11-28T12:07:45.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.095+0000 7f654b7fe700 1 -- 172.21.15.45:0/175474883 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f655c00ac00 con 0x7f6564161340 2023-11-28T12:07:45.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.095+0000 7f65697ff700 1 -- 172.21.15.45:0/175474883 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65640b5130 con 0x7f6564161340 2023-11-28T12:07:45.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.095+0000 7f654b7fe700 1 -- 172.21.15.45:0/175474883 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f655c012400 con 0x7f6564161340 2023-11-28T12:07:45.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.095+0000 7f65697ff700 1 -- 172.21.15.45:0/175474883 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65640d15e0 con 0x7f6564161340 2023-11-28T12:07:45.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.097+0000 7f65697ff700 1 -- 172.21.15.45:0/175474883 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65640b52c0 con 0x7f6564161340 2023-11-28T12:07:45.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.097+0000 7f654b7fe700 1 -- 172.21.15.45:0/175474883 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f655c019030 con 0x7f6564161340 2023-11-28T12:07:45.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.098+0000 7f654b7fe700 1 --2- 172.21.15.45:0/175474883 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f6550068370 0x7f655006a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:45.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.098+0000 7f654b7fe700 1 -- 172.21.15.45:0/175474883 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f655c0856e0 con 0x7f6564161340 2023-11-28T12:07:45.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.099+0000 7f6562ffd700 1 --2- 172.21.15.45:0/175474883 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f6550068370 0x7f655006a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:45.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.100+0000 7f6562ffd700 1 --2- 172.21.15.45:0/175474883 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f6550068370 0x7f655006a820 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6554009b70 tx=0x7f6554008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:45.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.103+0000 7f654b7fe700 1 -- 172.21.15.45:0/175474883 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f655c04b5e0 con 0x7f6564161340 2023-11-28T12:07:45.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.350+0000 7f65697ff700 1 -- 172.21.15.45:0/175474883 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6564066320 con 0x7f6564161340 2023-11-28T12:07:45.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.350+0000 7f654b7fe700 1 -- 172.21.15.45:0/175474883 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4654 (secure 0 0 0) 0x7f655c017090 con 0x7f6564161340 2023-11-28T12:07:45.351 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:07:45.351 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4805,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1232749056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1232749056},{"type":"v1","addr":"172.21.15.152:6837","nonce":1232749056}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4996,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/1358094304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":1358094304},{"type":"v1","addr":"172.21.15.45:6835","nonce":1358094304}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4999,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6836/2035520444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6835","nonce":2035520444},{"type":"v1","addr":"172.21.15.152:6836","nonce":2035520444}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T12:07:41.650740+0000","modified":"2023-11-28T12:07:44.849447+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5061},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5061":{"gid":5061,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.45:6834/2964277738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2964277738},{"type":"v1","addr":"172.21.15.45:6834","nonce":2964277738}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-28T12:07:45.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.353+0000 7f65697ff700 1 -- 172.21.15.45:0/175474883 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f6550068370 msgr2=0x7f655006a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:45.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.353+0000 7f65697ff700 1 --2- 172.21.15.45:0/175474883 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f6550068370 0x7f655006a820 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6554009b70 tx=0x7f6554008040 comp rx=0 tx=0).stop 2023-11-28T12:07:45.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.353+0000 7f65697ff700 1 -- 172.21.15.45:0/175474883 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6564161340 msgr2=0x7f65641e6ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:45.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.353+0000 7f65697ff700 1 --2- 172.21.15.45:0/175474883 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6564161340 0x7f65641e6ed0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f655c00ca80 tx=0x7f655c00ce40 comp rx=0 tx=0).stop 2023-11-28T12:07:45.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.353+0000 7f65697ff700 1 -- 172.21.15.45:0/175474883 shutdown_connections 2023-11-28T12:07:45.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.353+0000 7f65697ff700 1 --2- 172.21.15.45:0/175474883 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f6550068370 0x7f655006a820 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:45.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.353+0000 7f65697ff700 1 --2- 172.21.15.45:0/175474883 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f65640d2320 0x7f65641e8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:45.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.353+0000 7f65697ff700 1 --2- 172.21.15.45:0/175474883 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6564161340 0x7f65641e6ed0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:45.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.353+0000 7f65697ff700 1 --2- 172.21.15.45:0/175474883 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f656415c9b0 0x7f6564143460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:45.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.353+0000 7f65697ff700 1 -- 172.21.15.45:0/175474883 >> 172.21.15.45:0/175474883 conn(0x7f6564072600 msgr2=0x7f6564160610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:45.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.353+0000 7f65697ff700 1 -- 172.21.15.45:0/175474883 shutdown_connections 2023-11-28T12:07:45.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.353+0000 7f65697ff700 1 -- 172.21.15.45:0/175474883 wait complete. 2023-11-28T12:07:45.355 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 16 2023-11-28T12:07:45.372 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T12:07:45.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.574+0000 7fd677dff700 1 Processor -- start 2023-11-28T12:07:45.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.574+0000 7fd677dff700 1 -- start start 2023-11-28T12:07:45.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.575+0000 7fd677dff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd67015c9b0 0x7fd6700b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:45.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.575+0000 7fd677dff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd6700cd7c0 0x7fd6700cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:45.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.575+0000 7fd677dff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6700d1950 con 0x7fd670161340 2023-11-28T12:07:45.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.575+0000 7fd677dff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6700b5800 con 0x7fd67015c9b0 2023-11-28T12:07:45.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.575+0000 7fd677dff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6700ce140 con 0x7fd6700cd7c0 2023-11-28T12:07:45.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.575+0000 7fd675b9b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd67015c9b0 0x7fd6700b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:45.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.575+0000 7fd675b9b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd67015c9b0 0x7fd6700b4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34150/0 (socket says 172.21.15.45:34150) 2023-11-28T12:07:45.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.575+0000 7fd675b9b700 1 -- 172.21.15.45:0/1187066876 learned_addr learned my addr 172.21.15.45:0/1187066876 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:45.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.576+0000 7fd67639c700 1 --2- 172.21.15.45:0/1187066876 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd6700cd7c0 0x7fd6700cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:45.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.576+0000 7fd675b9b700 1 -- 172.21.15.45:0/1187066876 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd6700cd7c0 msgr2=0x7fd6700cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:45.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.576+0000 7fd675b9b700 1 --2- 172.21.15.45:0/1187066876 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd6700cd7c0 0x7fd6700cdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:45.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.576+0000 7fd675b9b700 1 -- 172.21.15.45:0/1187066876 >> v1:172.21.15.152:6789/0 conn(0x7fd670161340 legacy=0x7fd6700d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:45.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.576+0000 7fd675b9b700 1 -- 172.21.15.45:0/1187066876 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6700d24f0 con 0x7fd67015c9b0 2023-11-28T12:07:45.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.576+0000 7fd67639c700 1 --2- 172.21.15.45:0/1187066876 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd6700cd7c0 0x7fd6700cdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:07:45.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.576+0000 7fd675b9b700 1 --2- 172.21.15.45:0/1187066876 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd67015c9b0 0x7fd6700b4bf0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fd66c0098f0 tx=0x7fd66c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fffc8bcd3a8e6a9e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:45.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.576+0000 7fd674b99700 1 -- 172.21.15.45:0/1187066876 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd66c00b8a0 con 0x7fd67015c9b0 2023-11-28T12:07:45.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.576+0000 7fd674b99700 1 -- 172.21.15.45:0/1187066876 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd66c00ba00 con 0x7fd67015c9b0 2023-11-28T12:07:45.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.576+0000 7fd674b99700 1 -- 172.21.15.45:0/1187066876 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd66c00bd90 con 0x7fd67015c9b0 2023-11-28T12:07:45.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.577+0000 7fd677dff700 1 -- 172.21.15.45:0/1187066876 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd67015c9b0 msgr2=0x7fd6700b4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:45.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.577+0000 7fd677dff700 1 --2- 172.21.15.45:0/1187066876 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd67015c9b0 0x7fd6700b4bf0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fd66c0098f0 tx=0x7fd66c009c00 comp rx=0 tx=0).stop 2023-11-28T12:07:45.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.577+0000 7fd677dff700 1 -- 172.21.15.45:0/1187066876 shutdown_connections 2023-11-28T12:07:45.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.577+0000 7fd677dff700 1 --2- 172.21.15.45:0/1187066876 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd6700cd7c0 0x7fd6700cdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:45.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.577+0000 7fd677dff700 1 --2- 172.21.15.45:0/1187066876 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd67015c9b0 0x7fd6700b4bf0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:45.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.577+0000 7fd677dff700 1 -- 172.21.15.45:0/1187066876 >> 172.21.15.45:0/1187066876 conn(0x7fd670072600 msgr2=0x7fd6700cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:45.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.577+0000 7fd677dff700 1 -- 172.21.15.45:0/1187066876 shutdown_connections 2023-11-28T12:07:45.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.577+0000 7fd677dff700 1 -- 172.21.15.45:0/1187066876 wait complete. 2023-11-28T12:07:45.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.579+0000 7fd677dff700 1 Processor -- start 2023-11-28T12:07:45.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.579+0000 7fd677dff700 1 -- start start 2023-11-28T12:07:45.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.580+0000 7fd677dff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6700cd7c0 0x7fd6700cc4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:45.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.580+0000 7fd677dff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd67015c9b0 0x7fd6701e6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:45.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.580+0000 7fd677dff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd670161340 0x7fd6701e7200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:45.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.580+0000 7fd677dff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6700c82c0 con 0x7fd6700cd7c0 2023-11-28T12:07:45.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.580+0000 7fd677dff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd67015fc60 con 0x7fd67015c9b0 2023-11-28T12:07:45.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.580+0000 7fd677dff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6700c7c70 con 0x7fd670161340 2023-11-28T12:07:45.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.580+0000 7fd675b9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6700cd7c0 0x7fd6700cc4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:45.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.580+0000 7fd675b9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6700cd7c0 0x7fd6700cc4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34166/0 (socket says 172.21.15.45:34166) 2023-11-28T12:07:45.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.580+0000 7fd675b9b700 1 -- 172.21.15.45:0/3808346700 learned_addr learned my addr 172.21.15.45:0/3808346700 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:45.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.580+0000 7fd67639c700 1 --2- 172.21.15.45:0/3808346700 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd670161340 0x7fd6701e7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:45.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.580+0000 7fd67539a700 1 --2- 172.21.15.45:0/3808346700 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd67015c9b0 0x7fd6701e6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:45.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.580+0000 7fd675b9b700 1 -- 172.21.15.45:0/3808346700 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd670161340 msgr2=0x7fd6701e7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:45.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.581+0000 7fd675b9b700 1 --2- 172.21.15.45:0/3808346700 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd670161340 0x7fd6701e7200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:45.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.581+0000 7fd675b9b700 1 -- 172.21.15.45:0/3808346700 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd67015c9b0 msgr2=0x7fd6701e6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:45.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.581+0000 7fd675b9b700 1 --2- 172.21.15.45:0/3808346700 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd67015c9b0 0x7fd6701e6cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:45.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.581+0000 7fd675b9b700 1 -- 172.21.15.45:0/3808346700 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd66c009550 con 0x7fd6700cd7c0 2023-11-28T12:07:45.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.581+0000 7fd67539a700 1 --2- 172.21.15.45:0/3808346700 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd67015c9b0 0x7fd6701e6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:07:45.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.581+0000 7fd675b9b700 1 --2- 172.21.15.45:0/3808346700 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6700cd7c0 0x7fd6700cc4d0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fd66c009c40 tx=0x7fd66c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:45.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.581+0000 7fd6667fc700 1 -- 172.21.15.45:0/3808346700 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd66c0036a0 con 0x7fd6700cd7c0 2023-11-28T12:07:45.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.581+0000 7fd6667fc700 1 -- 172.21.15.45:0/3808346700 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd66c01e070 con 0x7fd6700cd7c0 2023-11-28T12:07:45.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.581+0000 7fd677dff700 1 -- 172.21.15.45:0/3808346700 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6700d1300 con 0x7fd6700cd7c0 2023-11-28T12:07:45.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.581+0000 7fd6667fc700 1 -- 172.21.15.45:0/3808346700 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd66c003a60 con 0x7fd6700cd7c0 2023-11-28T12:07:45.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.581+0000 7fd677dff700 1 -- 172.21.15.45:0/3808346700 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6700b5520 con 0x7fd6700cd7c0 2023-11-28T12:07:45.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.582+0000 7fd677dff700 1 -- 172.21.15.45:0/3808346700 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6700d15e0 con 0x7fd6700cd7c0 2023-11-28T12:07:45.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.583+0000 7fd6667fc700 1 -- 172.21.15.45:0/3808346700 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fd66c00f050 con 0x7fd6700cd7c0 2023-11-28T12:07:45.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.584+0000 7fd6667fc700 1 --2- 172.21.15.45:0/3808346700 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fd6540682f0 0x7fd65406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:45.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.585+0000 7fd6667fc700 1 -- 172.21.15.45:0/3808346700 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd66c020070 con 0x7fd6700cd7c0 2023-11-28T12:07:45.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.585+0000 7fd67539a700 1 --2- 172.21.15.45:0/3808346700 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fd6540682f0 0x7fd65406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:45.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.586+0000 7fd67539a700 1 --2- 172.21.15.45:0/3808346700 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fd6540682f0 0x7fd65406a7a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd6701e6b20 tx=0x7fd660009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:45.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.589+0000 7fd6667fc700 1 -- 172.21.15.45:0/3808346700 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fd66c053a40 con 0x7fd6700cd7c0 2023-11-28T12:07:45.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.796+0000 7fd677dff700 1 -- 172.21.15.45:0/3808346700 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd6700745c0 con 0x7fd6700cd7c0 2023-11-28T12:07:45.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.797+0000 7fd6667fc700 1 -- 172.21.15.45:0/3808346700 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+17921 (secure 0 0 0) 0x7fd66c057060 con 0x7fd6700cd7c0 2023-11-28T12:07:45.801 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:07:45.801 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":34,"fsid":"bd7c37f1-f7c6-4778-b845-52cf2aa6e366","created":"2023-11-28T12:06:09.045075+0000","modified":"2023-11-28T12:07:42.653488+0000","last_up_change":"2023-11-28T12:06:21.282227+0000","last_in_change":"2023-11-28T12:06:12.560924+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T12:06:21.807108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T12:06:22.491009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-28T12:07:39.383009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-28T12:07:40.658112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d0cdd8a-87fd-4f2c-91bd-47bdfa661905","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":115843},{"type":"v1","addr":"172.21.15.45:6808","nonce":115843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":115843},{"type":"v1","addr":"172.21.15.45:6811","nonce":115843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":115843},{"type":"v1","addr":"172.21.15.45:6815","nonce":115843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":115843},{"type":"v1","addr":"172.21.15.45:6813","nonce":115843}]},"public_addr":"172.21.15.45:6808/115843","cluster_addr":"172.21.15.45:6811/115843","heartbeat_back_addr":"172.21.15.45:6815/115843","heartbeat_front_addr":"172.21.15.45:6813/115843","state":["exists","up"]},{"osd":1,"uuid":"c5de4ebd-9ec5-40b3-9caa-9b706fab4c76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":115842},{"type":"v1","addr":"172.21.15.45:6801","nonce":115842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":115842},{"type":"v1","addr":"172.21.15.45:6803","nonce":115842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6807","nonce":115842},{"type":"v1","addr":"172.21.15.45:6809","nonce":115842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":115842},{"type":"v1","addr":"172.21.15.45:6805","nonce":115842}]},"public_addr":"172.21.15.45:6801/115842","cluster_addr":"172.21.15.45:6803/115842","heartbeat_back_addr":"172.21.15.45:6809/115842","heartbeat_front_addr":"172.21.15.45:6805/115842","state":["exists","up"]},{"osd":2,"uuid":"9f4b36b2-65d2-40e7-9fe6-a2991afa71c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":115850},{"type":"v1","addr":"172.21.15.45:6819","nonce":115850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":115850},{"type":"v1","addr":"172.21.15.45:6823","nonce":115850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":115850},{"type":"v1","addr":"172.21.15.45:6831","nonce":115850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":115850},{"type":"v1","addr":"172.21.15.45:6828","nonce":115850}]},"public_addr":"172.21.15.45:6819/115850","cluster_addr":"172.21.15.45:6823/115850","heartbeat_back_addr":"172.21.15.45:6831/115850","heartbeat_front_addr":"172.21.15.45:6828/115850","state":["exists","up"]},{"osd":3,"uuid":"6fe7ef05-4e0d-426c-bf94-44b51d4d550b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":115848},{"type":"v1","addr":"172.21.15.45:6818","nonce":115848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":115848},{"type":"v1","addr":"172.21.15.45:6822","nonce":115848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6827","nonce":115848},{"type":"v1","addr":"172.21.15.45:6829","nonce":115848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":115848},{"type":"v1","addr":"172.21.15.45:6825","nonce":115848}]},"public_addr":"172.21.15.45:6818/115848","cluster_addr":"172.21.15.45:6822/115848","heartbeat_back_addr":"172.21.15.45:6829/115848","heartbeat_front_addr":"172.21.15.45:6825/115848","state":["exists","up"]},{"osd":4,"uuid":"fa403c08-d8a1-4a3a-8384-cb465c1a654c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":116092},{"type":"v1","addr":"172.21.15.152:6801","nonce":116092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":116092},{"type":"v1","addr":"172.21.15.152:6803","nonce":116092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":116092},{"type":"v1","addr":"172.21.15.152:6807","nonce":116092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":116092},{"type":"v1","addr":"172.21.15.152:6805","nonce":116092}]},"public_addr":"172.21.15.152:6801/116092","cluster_addr":"172.21.15.152:6803/116092","heartbeat_back_addr":"172.21.15.152:6807/116092","heartbeat_front_addr":"172.21.15.152:6805/116092","state":["exists","up"]},{"osd":5,"uuid":"399fc450-39fa-43a6-bf80-0b8bcb41bd95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6815","nonce":116093},{"type":"v1","addr":"172.21.15.152:6817","nonce":116093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":116093},{"type":"v1","addr":"172.21.15.152:6819","nonce":116093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":116093},{"type":"v1","addr":"172.21.15.152:6823","nonce":116093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":116093},{"type":"v1","addr":"172.21.15.152:6821","nonce":116093}]},"public_addr":"172.21.15.152:6817/116093","cluster_addr":"172.21.15.152:6819/116093","heartbeat_back_addr":"172.21.15.152:6823/116093","heartbeat_front_addr":"172.21.15.152:6821/116093","state":["exists","up"]},{"osd":6,"uuid":"e59a4017-2d23-4627-836b-e25b2d3ddaaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":116094},{"type":"v1","addr":"172.21.15.152:6809","nonce":116094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":116094},{"type":"v1","addr":"172.21.15.152:6811","nonce":116094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":116094},{"type":"v1","addr":"172.21.15.152:6816","nonce":116094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":116094},{"type":"v1","addr":"172.21.15.152:6813","nonce":116094}]},"public_addr":"172.21.15.152:6809/116094","cluster_addr":"172.21.15.152:6811/116094","heartbeat_back_addr":"172.21.15.152:6816/116094","heartbeat_front_addr":"172.21.15.152:6813/116094","state":["exists","up"]},{"osd":7,"uuid":"8d7f9d4b-bf08-4670-8591-388c0f012a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":116097},{"type":"v1","addr":"172.21.15.152:6825","nonce":116097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":116097},{"type":"v1","addr":"172.21.15.152:6827","nonce":116097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":116097},{"type":"v1","addr":"172.21.15.152:6831","nonce":116097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":116097},{"type":"v1","addr":"172.21.15.152:6829","nonce":116097}]},"public_addr":"172.21.15.152:6825/116097","cluster_addr":"172.21.15.152:6827/116097","heartbeat_back_addr":"172.21.15.152:6831/116097","heartbeat_front_addr":"172.21.15.152:6829/116097","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.937710+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.865423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.159434+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.913090+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.131647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.966255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.972583+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.177209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T12:07:45.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.799+0000 7fd677dff700 1 -- 172.21.15.45:0/3808346700 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fd6540682f0 msgr2=0x7fd65406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:45.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.799+0000 7fd677dff700 1 --2- 172.21.15.45:0/3808346700 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fd6540682f0 0x7fd65406a7a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd6701e6b20 tx=0x7fd660009040 comp rx=0 tx=0).stop 2023-11-28T12:07:45.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.799+0000 7fd677dff700 1 -- 172.21.15.45:0/3808346700 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6700cd7c0 msgr2=0x7fd6700cc4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:45.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.799+0000 7fd677dff700 1 --2- 172.21.15.45:0/3808346700 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6700cd7c0 0x7fd6700cc4d0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fd66c009c40 tx=0x7fd66c004750 comp rx=0 tx=0).stop 2023-11-28T12:07:45.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.799+0000 7fd677dff700 1 -- 172.21.15.45:0/3808346700 shutdown_connections 2023-11-28T12:07:45.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.799+0000 7fd677dff700 1 --2- 172.21.15.45:0/3808346700 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fd6540682f0 0x7fd65406a7a0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:45.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.799+0000 7fd677dff700 1 --2- 172.21.15.45:0/3808346700 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd670161340 0x7fd6701e7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:45.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.799+0000 7fd677dff700 1 --2- 172.21.15.45:0/3808346700 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6700cd7c0 0x7fd6700cc4d0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:45.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.799+0000 7fd677dff700 1 --2- 172.21.15.45:0/3808346700 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd67015c9b0 0x7fd6701e6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:45.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.799+0000 7fd677dff700 1 -- 172.21.15.45:0/3808346700 >> 172.21.15.45:0/3808346700 conn(0x7fd670072600 msgr2=0x7fd6700b5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:45.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.800+0000 7fd677dff700 1 -- 172.21.15.45:0/3808346700 shutdown_connections 2023-11-28T12:07:45.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:45.800+0000 7fd677dff700 1 -- 172.21.15.45:0/3808346700 wait complete. 2023-11-28T12:07:45.819 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-28T12:07:45.819 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T12:07:46.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.022+0000 7f7d8ebff700 1 Processor -- start 2023-11-28T12:07:46.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.022+0000 7f7d8ebff700 1 -- start start 2023-11-28T12:07:46.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.023+0000 7f7d8ebff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f7d88161340 0x7f7d880d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:46.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.023+0000 7f7d8ebff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7d880d2320 0x7f7d880cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:46.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.023+0000 7f7d8ebff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d880d1950 con 0x7f7d8815c9b0 2023-11-28T12:07:46.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.023+0000 7f7d8ebff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d880b5800 con 0x7f7d880d2320 2023-11-28T12:07:46.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.023+0000 7f7d8ebff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d880b5300 con 0x7f7d88161340 2023-11-28T12:07:46.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.024+0000 7f7d8d19c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7d880d2320 0x7f7d880cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:46.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.024+0000 7f7d8c99b700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f7d8815c9b0 0x7f7d880b4bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:38740/0 (socket says 172.21.15.45:38740) 2023-11-28T12:07:46.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.024+0000 7f7d8c99b700 1 -- 172.21.15.45:0/1302008584 learned_addr learned my addr 172.21.15.45:0/1302008584 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:07:46.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.024+0000 7f7d87fff700 1 --2- 172.21.15.45:0/1302008584 >> v2:172.21.15.152:3300/0 conn(0x7f7d88161340 0x7f7d880d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:46.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.024+0000 7f7d8d19c700 1 -- 172.21.15.45:0/1302008584 >> v2:172.21.15.152:3300/0 conn(0x7f7d88161340 msgr2=0x7f7d880d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:46.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.024+0000 7f7d8d19c700 1 --2- 172.21.15.45:0/1302008584 >> v2:172.21.15.152:3300/0 conn(0x7f7d88161340 0x7f7d880d1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:46.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.024+0000 7f7d8d19c700 1 -- 172.21.15.45:0/1302008584 >> v1:172.21.15.45:6789/0 conn(0x7f7d8815c9b0 legacy=0x7f7d880b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:46.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.024+0000 7f7d877fe700 1 -- 172.21.15.45:0/1302008584 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4067433822 0 0) 0x7f7d880d1950 con 0x7f7d8815c9b0 2023-11-28T12:07:46.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.024+0000 7f7d8d19c700 1 -- 172.21.15.45:0/1302008584 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d880b5520 con 0x7f7d880d2320 2023-11-28T12:07:46.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.025+0000 7f7d8d19c700 1 --2- 172.21.15.45:0/1302008584 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d880d2320 0x7f7d880cd7c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f7d880685c0 tx=0x7f7d8000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5998df28a063df5b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:46.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.025+0000 7f7d877fe700 1 -- 172.21.15.45:0/1302008584 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d8000e070 con 0x7f7d880d2320 2023-11-28T12:07:46.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.025+0000 7f7d877fe700 1 -- 172.21.15.45:0/1302008584 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d8000bb90 con 0x7f7d880d2320 2023-11-28T12:07:46.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.025+0000 7f7d877fe700 1 -- 172.21.15.45:0/1302008584 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d80012430 con 0x7f7d880d2320 2023-11-28T12:07:46.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.025+0000 7f7d8ebff700 1 -- 172.21.15.45:0/1302008584 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d880d2320 msgr2=0x7f7d880cd7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:46.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.025+0000 7f7d8ebff700 1 --2- 172.21.15.45:0/1302008584 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d880d2320 0x7f7d880cd7c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f7d880685c0 tx=0x7f7d8000b330 comp rx=0 tx=0).stop 2023-11-28T12:07:46.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.025+0000 7f7d8ebff700 1 -- 172.21.15.45:0/1302008584 shutdown_connections 2023-11-28T12:07:46.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.025+0000 7f7d8ebff700 1 --2- 172.21.15.45:0/1302008584 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d880d2320 0x7f7d880cd7c0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:46.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.025+0000 7f7d8ebff700 1 --2- 172.21.15.45:0/1302008584 >> v2:172.21.15.152:3300/0 conn(0x7f7d88161340 0x7f7d880d1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:46.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.025+0000 7f7d8ebff700 1 -- 172.21.15.45:0/1302008584 >> 172.21.15.45:0/1302008584 conn(0x7f7d88072600 msgr2=0x7f7d880cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:46.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.025+0000 7f7d8ebff700 1 -- 172.21.15.45:0/1302008584 shutdown_connections 2023-11-28T12:07:46.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.025+0000 7f7d8ebff700 1 -- 172.21.15.45:0/1302008584 wait complete. 2023-11-28T12:07:46.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.028+0000 7f7d8ebff700 1 Processor -- start 2023-11-28T12:07:46.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.028+0000 7f7d8ebff700 1 -- start start 2023-11-28T12:07:46.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.029+0000 7f7d8ebff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d880d2320 0x7f7d8815f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:46.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.029+0000 7f7d8ebff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7d8815c9b0 0x7f7d881f26b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:46.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.029+0000 7f7d8ebff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7d88161340 0x7f7d881f2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:46.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.029+0000 7f7d8ebff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d880c84a0 con 0x7f7d880d2320 2023-11-28T12:07:46.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.029+0000 7f7d8ebff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d881f3870 con 0x7f7d88161340 2023-11-28T12:07:46.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.029+0000 7f7d8ebff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d881f31e0 con 0x7f7d8815c9b0 2023-11-28T12:07:46.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.030+0000 7f7d8c99b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d880d2320 0x7f7d8815f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:46.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.030+0000 7f7d8c99b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d880d2320 0x7f7d8815f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34174/0 (socket says 172.21.15.45:34174) 2023-11-28T12:07:46.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.030+0000 7f7d8c99b700 1 -- 172.21.15.45:0/697463461 learned_addr learned my addr 172.21.15.45:0/697463461 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:46.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.030+0000 7f7d87fff700 1 --2- 172.21.15.45:0/697463461 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7d8815c9b0 0x7f7d881f26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:46.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.030+0000 7f7d8d19c700 1 --2- 172.21.15.45:0/697463461 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7d88161340 0x7f7d881f2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:46.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.030+0000 7f7d8c99b700 1 -- 172.21.15.45:0/697463461 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7d8815c9b0 msgr2=0x7f7d881f26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:46.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.030+0000 7f7d8c99b700 1 --2- 172.21.15.45:0/697463461 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7d8815c9b0 0x7f7d881f26b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:46.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.030+0000 7f7d8c99b700 1 -- 172.21.15.45:0/697463461 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7d88161340 msgr2=0x7f7d881f2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:46.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.030+0000 7f7d8c99b700 1 --2- 172.21.15.45:0/697463461 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7d88161340 0x7f7d881f2bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:46.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.030+0000 7f7d8c99b700 1 -- 172.21.15.45:0/697463461 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d80009a70 con 0x7f7d880d2320 2023-11-28T12:07:46.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.030+0000 7f7d8c99b700 1 --2- 172.21.15.45:0/697463461 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d880d2320 0x7f7d8815f500 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c00c550 tx=0x7f7d7c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:46.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.031+0000 7f7d857fa700 1 -- 172.21.15.45:0/697463461 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c004c80 con 0x7f7d880d2320 2023-11-28T12:07:46.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.031+0000 7f7d857fa700 1 -- 172.21.15.45:0/697463461 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d7c004e00 con 0x7f7d880d2320 2023-11-28T12:07:46.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.031+0000 7f7d857fa700 1 -- 172.21.15.45:0/697463461 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c007310 con 0x7f7d880d2320 2023-11-28T12:07:46.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.031+0000 7f7d8ebff700 1 -- 172.21.15.45:0/697463461 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d880d15e0 con 0x7f7d880d2320 2023-11-28T12:07:46.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.031+0000 7f7d8ebff700 1 -- 172.21.15.45:0/697463461 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d880d1300 con 0x7f7d880d2320 2023-11-28T12:07:46.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.032+0000 7f7d8ebff700 1 -- 172.21.15.45:0/697463461 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d8815cd80 con 0x7f7d880d2320 2023-11-28T12:07:46.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.033+0000 7f7d857fa700 1 -- 172.21.15.45:0/697463461 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f7d7c01a020 con 0x7f7d880d2320 2023-11-28T12:07:46.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.034+0000 7f7d857fa700 1 --2- 172.21.15.45:0/697463461 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f7d6c0682f0 0x7f7d6c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:46.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.034+0000 7f7d857fa700 1 -- 172.21.15.45:0/697463461 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7d7c0856a0 con 0x7f7d880d2320 2023-11-28T12:07:46.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.034+0000 7f7d87fff700 1 --2- 172.21.15.45:0/697463461 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f7d6c0682f0 0x7f7d6c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:46.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.035+0000 7f7d87fff700 1 --2- 172.21.15.45:0/697463461 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f7d6c0682f0 0x7f7d6c06a7a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7d88151950 tx=0x7f7d74008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:46.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.038+0000 7f7d857fa700 1 -- 172.21.15.45:0/697463461 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f7d7c051f00 con 0x7f7d880d2320 2023-11-28T12:07:46.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.237+0000 7f7d8ebff700 1 -- 172.21.15.45:0/697463461 --> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7d880745c0 con 0x7f7d6c0682f0 2023-11-28T12:07:46.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.248+0000 7f7d857fa700 1 -- 172.21.15.45:0/697463461 <== mgr.4100 v2:172.21.15.152:6832/115389 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+308405 (secure 0 0 0) 0x7f7d880745c0 con 0x7f7d6c0682f0 2023-11-28T12:07:46.253 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:07:46.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.253+0000 7f7d8ebff700 1 -- 172.21.15.45:0/697463461 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f7d6c0682f0 msgr2=0x7f7d6c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:46.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.253+0000 7f7d8ebff700 1 --2- 172.21.15.45:0/697463461 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f7d6c0682f0 0x7f7d6c06a7a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7d88151950 tx=0x7f7d74008040 comp rx=0 tx=0).stop 2023-11-28T12:07:46.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.253+0000 7f7d8ebff700 1 -- 172.21.15.45:0/697463461 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d880d2320 msgr2=0x7f7d8815f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:46.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.253+0000 7f7d8ebff700 1 --2- 172.21.15.45:0/697463461 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d880d2320 0x7f7d8815f500 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c00c550 tx=0x7f7d7c00c860 comp rx=0 tx=0).stop 2023-11-28T12:07:46.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.253+0000 7f7d8ebff700 1 -- 172.21.15.45:0/697463461 shutdown_connections 2023-11-28T12:07:46.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.253+0000 7f7d8ebff700 1 --2- 172.21.15.45:0/697463461 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f7d6c0682f0 0x7f7d6c06a7a0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:46.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.253+0000 7f7d8ebff700 1 --2- 172.21.15.45:0/697463461 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7d88161340 0x7f7d881f2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:46.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.253+0000 7f7d8ebff700 1 --2- 172.21.15.45:0/697463461 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d880d2320 0x7f7d8815f500 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:46.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.253+0000 7f7d8ebff700 1 --2- 172.21.15.45:0/697463461 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7d8815c9b0 0x7f7d881f26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:46.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.253+0000 7f7d8ebff700 1 -- 172.21.15.45:0/697463461 >> 172.21.15.45:0/697463461 conn(0x7f7d88072600 msgr2=0x7f7d880b60a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:46.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.253+0000 7f7d8ebff700 1 -- 172.21.15.45:0/697463461 shutdown_connections 2023-11-28T12:07:46.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.253+0000 7f7d8ebff700 1 -- 172.21.15.45:0/697463461 wait complete. 2023-11-28T12:07:46.257 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-11-28T12:07:46.273 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":69,"stamp":"2023-11-28T12:07:44.443220+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":42,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":84600,"kb_used_data":3896,"kb_used_omap":0,"kb_used_meta":80640,"kb_avail":754890120,"statfs":{"total":773094113280,"available":773007482880,"internally_reserved":0,"allocated":3989504,"data_stored":2309734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":82575360},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.307160"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.149676+0000","last_change":"2023-11-28T12:07:41.149676+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.149676+0000","last_undegraded":"2023-11-28T12:07:41.149676+0000","last_fullsized":"2023-11-28T12:07:41.149676+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:29:27.513071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.150188+0000","last_change":"2023-11-28T12:07:41.150188+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.150188+0000","last_undegraded":"2023-11-28T12:07:41.150188+0000","last_fullsized":"2023-11-28T12:07:41.150188+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:46:48.928670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.150682+0000","last_change":"2023-11-28T12:07:41.150682+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.150682+0000","last_undegraded":"2023-11-28T12:07:41.150682+0000","last_fullsized":"2023-11-28T12:07:41.150682+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:46:48.928670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.151873+0000","last_change":"2023-11-28T12:07:41.151873+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.151873+0000","last_undegraded":"2023-11-28T12:07:41.151873+0000","last_fullsized":"2023-11-28T12:07:41.151873+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:28:50.548371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.146462+0000","last_change":"2023-11-28T12:07:41.146462+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.146462+0000","last_undegraded":"2023-11-28T12:07:41.146462+0000","last_fullsized":"2023-11-28T12:07:41.146462+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:50:22.991297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.155730+0000","last_change":"2023-11-28T12:07:41.155730+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.155730+0000","last_undegraded":"2023-11-28T12:07:41.155730+0000","last_fullsized":"2023-11-28T12:07:41.155730+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:10:52.015070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.151291+0000","last_change":"2023-11-28T12:07:41.151291+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.151291+0000","last_undegraded":"2023-11-28T12:07:41.151291+0000","last_fullsized":"2023-11-28T12:07:41.151291+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:22:57.069288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.149348+0000","last_change":"2023-11-28T12:07:41.149348+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.149348+0000","last_undegraded":"2023-11-28T12:07:41.149348+0000","last_fullsized":"2023-11-28T12:07:41.149348+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:36:26.400203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.151794+0000","last_change":"2023-11-28T12:07:41.151794+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.151794+0000","last_undegraded":"2023-11-28T12:07:41.151794+0000","last_fullsized":"2023-11-28T12:07:41.151794+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:21:44.583002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.160971+0000","last_change":"2023-11-28T12:07:41.160971+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.160971+0000","last_undegraded":"2023-11-28T12:07:41.160971+0000","last_fullsized":"2023-11-28T12:07:41.160971+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:46:48.928670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.154818+0000","last_change":"2023-11-28T12:07:41.154818+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.154818+0000","last_undegraded":"2023-11-28T12:07:41.154818+0000","last_fullsized":"2023-11-28T12:07:41.154818+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:32:42.598768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.147170+0000","last_change":"2023-11-28T12:07:41.147170+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.147170+0000","last_undegraded":"2023-11-28T12:07:41.147170+0000","last_fullsized":"2023-11-28T12:07:41.147170+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:37:01.124995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.158846+0000","last_change":"2023-11-28T12:07:41.158846+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.158846+0000","last_undegraded":"2023-11-28T12:07:41.158846+0000","last_fullsized":"2023-11-28T12:07:41.158846+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:37:01.124995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.153276+0000","last_change":"2023-11-28T12:07:41.153276+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.153276+0000","last_undegraded":"2023-11-28T12:07:41.153276+0000","last_fullsized":"2023-11-28T12:07:41.153276+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:53:09.125880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.158224+0000","last_change":"2023-11-28T12:07:41.158224+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.158224+0000","last_undegraded":"2023-11-28T12:07:41.158224+0000","last_fullsized":"2023-11-28T12:07:41.158224+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:04:15.307550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.152248+0000","last_change":"2023-11-28T12:07:41.152248+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.152248+0000","last_undegraded":"2023-11-28T12:07:41.152248+0000","last_fullsized":"2023-11-28T12:07:41.152248+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:19:36.237111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.152563+0000","last_change":"2023-11-28T12:07:41.152563+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.152563+0000","last_undegraded":"2023-11-28T12:07:41.152563+0000","last_fullsized":"2023-11-28T12:07:41.152563+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:37:01.124995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.147455+0000","last_change":"2023-11-28T12:07:41.147455+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.147455+0000","last_undegraded":"2023-11-28T12:07:41.147455+0000","last_fullsized":"2023-11-28T12:07:41.147455+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:50:22.991297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.148758+0000","last_change":"2023-11-28T12:07:41.148758+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.148758+0000","last_undegraded":"2023-11-28T12:07:41.148758+0000","last_fullsized":"2023-11-28T12:07:41.148758+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:10:52.015070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.149468+0000","last_change":"2023-11-28T12:07:41.149468+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.149468+0000","last_undegraded":"2023-11-28T12:07:41.149468+0000","last_fullsized":"2023-11-28T12:07:41.149468+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:50:53.505346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.154383+0000","last_change":"2023-11-28T12:07:41.154383+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.154383+0000","last_undegraded":"2023-11-28T12:07:41.154383+0000","last_fullsized":"2023-11-28T12:07:41.154383+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:51:19.561073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.155670+0000","last_change":"2023-11-28T12:07:41.155670+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.155670+0000","last_undegraded":"2023-11-28T12:07:41.155670+0000","last_fullsized":"2023-11-28T12:07:41.155670+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:48:09.410549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.149284+0000","last_change":"2023-11-28T12:07:41.149284+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.149284+0000","last_undegraded":"2023-11-28T12:07:41.149284+0000","last_fullsized":"2023-11-28T12:07:41.149284+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:36:32.514106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.146582+0000","last_change":"2023-11-28T12:07:41.146582+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.146582+0000","last_undegraded":"2023-11-28T12:07:41.146582+0000","last_fullsized":"2023-11-28T12:07:41.146582+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:02:13.155906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.150060+0000","last_change":"2023-11-28T12:07:41.150060+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.150060+0000","last_undegraded":"2023-11-28T12:07:41.150060+0000","last_fullsized":"2023-11-28T12:07:41.150060+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:17:46.712157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.158106+0000","last_change":"2023-11-28T12:07:41.158106+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.158106+0000","last_undegraded":"2023-11-28T12:07:41.158106+0000","last_fullsized":"2023-11-28T12:07:41.158106+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:07:05.409362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.147417+0000","last_change":"2023-11-28T12:07:41.147417+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.147417+0000","last_undegraded":"2023-11-28T12:07:41.147417+0000","last_fullsized":"2023-11-28T12:07:41.147417+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:46:35.658317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.154117+0000","last_change":"2023-11-28T12:07:41.154117+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.154117+0000","last_undegraded":"2023-11-28T12:07:41.154117+0000","last_fullsized":"2023-11-28T12:07:41.154117+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:19:36.237111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.149141+0000","last_change":"2023-11-28T12:07:41.149141+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.149141+0000","last_undegraded":"2023-11-28T12:07:41.149141+0000","last_fullsized":"2023-11-28T12:07:41.149141+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:02:13.155906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.148981+0000","last_change":"2023-11-28T12:07:41.148981+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.148981+0000","last_undegraded":"2023-11-28T12:07:41.148981+0000","last_fullsized":"2023-11-28T12:07:41.148981+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:55:26.362077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.147011+0000","last_change":"2023-11-28T12:07:41.147011+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.147011+0000","last_undegraded":"2023-11-28T12:07:41.147011+0000","last_fullsized":"2023-11-28T12:07:41.147011+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:04:15.307550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.155595+0000","last_change":"2023-11-28T12:07:41.155595+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.155595+0000","last_undegraded":"2023-11-28T12:07:41.155595+0000","last_fullsized":"2023-11-28T12:07:41.155595+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:28:50.548371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.150707+0000","last_change":"2023-11-28T12:07:41.150707+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.150707+0000","last_undegraded":"2023-11-28T12:07:41.150707+0000","last_fullsized":"2023-11-28T12:07:41.150707+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:22:57.069288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.168200+0000","last_change":"2023-11-28T12:07:41.165809+0000","last_active":"2023-11-28T12:07:41.168200+0000","last_peered":"2023-11-28T12:07:41.168200+0000","last_clean":"2023-11-28T12:07:41.168200+0000","last_became_active":"2023-11-28T12:07:41.163993+0000","last_became_peered":"2023-11-28T12:07:41.163993+0000","last_unstale":"2023-11-28T12:07:41.168200+0000","last_undegraded":"2023-11-28T12:07:41.168200+0000","last_fullsized":"2023-11-28T12:07:41.168200+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:48:59.983563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.160342+0000","last_change":"2023-11-28T12:07:41.160342+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.160342+0000","last_undegraded":"2023-11-28T12:07:41.160342+0000","last_fullsized":"2023-11-28T12:07:41.160342+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:21:19.797120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.168685+0000","last_change":"2023-11-28T12:07:41.167048+0000","last_active":"2023-11-28T12:07:41.168685+0000","last_peered":"2023-11-28T12:07:41.168685+0000","last_clean":"2023-11-28T12:07:41.168685+0000","last_became_active":"2023-11-28T12:07:41.166528+0000","last_became_peered":"2023-11-28T12:07:41.166528+0000","last_unstale":"2023-11-28T12:07:41.168685+0000","last_undegraded":"2023-11-28T12:07:41.168685+0000","last_fullsized":"2023-11-28T12:07:41.168685+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:03:41.008569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.152429+0000","last_change":"2023-11-28T12:07:41.152429+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.152429+0000","last_undegraded":"2023-11-28T12:07:41.152429+0000","last_fullsized":"2023-11-28T12:07:41.152429+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:42:14.979933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.170842+0000","last_change":"2023-11-28T12:07:41.169488+0000","last_active":"2023-11-28T12:07:41.170842+0000","last_peered":"2023-11-28T12:07:41.170842+0000","last_clean":"2023-11-28T12:07:41.170842+0000","last_became_active":"2023-11-28T12:07:41.169172+0000","last_became_peered":"2023-11-28T12:07:41.169172+0000","last_unstale":"2023-11-28T12:07:41.170842+0000","last_undegraded":"2023-11-28T12:07:41.170842+0000","last_fullsized":"2023-11-28T12:07:41.170842+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:36:37.411602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.149220+0000","last_change":"2023-11-28T12:07:41.149220+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.149220+0000","last_undegraded":"2023-11-28T12:07:41.149220+0000","last_fullsized":"2023-11-28T12:07:41.149220+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:21:09.502744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.168108+0000","last_change":"2023-11-28T12:07:41.163567+0000","last_active":"2023-11-28T12:07:41.168108+0000","last_peered":"2023-11-28T12:07:41.168108+0000","last_clean":"2023-11-28T12:07:41.168108+0000","last_became_active":"2023-11-28T12:07:41.162624+0000","last_became_peered":"2023-11-28T12:07:41.162624+0000","last_unstale":"2023-11-28T12:07:41.168108+0000","last_undegraded":"2023-11-28T12:07:41.168108+0000","last_fullsized":"2023-11-28T12:07:41.168108+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:19:35.229484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.146894+0000","last_change":"2023-11-28T12:07:41.146894+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.146894+0000","last_undegraded":"2023-11-28T12:07:41.146894+0000","last_fullsized":"2023-11-28T12:07:41.146894+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:51:19.561073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.172281+0000","last_change":"2023-11-28T12:07:41.170651+0000","last_active":"2023-11-28T12:07:41.172281+0000","last_peered":"2023-11-28T12:07:41.172281+0000","last_clean":"2023-11-28T12:07:41.172281+0000","last_became_active":"2023-11-28T12:07:41.170273+0000","last_became_peered":"2023-11-28T12:07:41.170273+0000","last_unstale":"2023-11-28T12:07:41.172281+0000","last_undegraded":"2023-11-28T12:07:41.172281+0000","last_fullsized":"2023-11-28T12:07:41.172281+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:01:45.697262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.155640+0000","last_change":"2023-11-28T12:07:41.155640+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.155640+0000","last_undegraded":"2023-11-28T12:07:41.155640+0000","last_fullsized":"2023-11-28T12:07:41.155640+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:40:24.727337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.171342+0000","last_change":"2023-11-28T12:07:41.168201+0000","last_active":"2023-11-28T12:07:41.171342+0000","last_peered":"2023-11-28T12:07:41.171342+0000","last_clean":"2023-11-28T12:07:41.171342+0000","last_became_active":"2023-11-28T12:07:41.166578+0000","last_became_peered":"2023-11-28T12:07:41.166578+0000","last_unstale":"2023-11-28T12:07:41.171342+0000","last_undegraded":"2023-11-28T12:07:41.171342+0000","last_fullsized":"2023-11-28T12:07:41.171342+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:28:20.315709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.155158+0000","last_change":"2023-11-28T12:07:41.155158+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.155158+0000","last_undegraded":"2023-11-28T12:07:41.155158+0000","last_fullsized":"2023-11-28T12:07:41.155158+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:36:26.400203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.169078+0000","last_change":"2023-11-28T12:07:41.167334+0000","last_active":"2023-11-28T12:07:41.169078+0000","last_peered":"2023-11-28T12:07:41.169078+0000","last_clean":"2023-11-28T12:07:41.169078+0000","last_became_active":"2023-11-28T12:07:41.166499+0000","last_became_peered":"2023-11-28T12:07:41.166499+0000","last_unstale":"2023-11-28T12:07:41.169078+0000","last_undegraded":"2023-11-28T12:07:41.169078+0000","last_fullsized":"2023-11-28T12:07:41.169078+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:28:20.315709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.149792+0000","last_change":"2023-11-28T12:07:41.149792+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.149792+0000","last_undegraded":"2023-11-28T12:07:41.149792+0000","last_fullsized":"2023-11-28T12:07:41.149792+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:15:46.212373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.168039+0000","last_change":"2023-11-28T12:07:41.163322+0000","last_active":"2023-11-28T12:07:41.168039+0000","last_peered":"2023-11-28T12:07:41.168039+0000","last_clean":"2023-11-28T12:07:41.168039+0000","last_became_active":"2023-11-28T12:07:41.161561+0000","last_became_peered":"2023-11-28T12:07:41.161561+0000","last_unstale":"2023-11-28T12:07:41.168039+0000","last_undegraded":"2023-11-28T12:07:41.168039+0000","last_fullsized":"2023-11-28T12:07:41.168039+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:07:04.401735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.151159+0000","last_change":"2023-11-28T12:07:41.151159+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.151159+0000","last_undegraded":"2023-11-28T12:07:41.151159+0000","last_fullsized":"2023-11-28T12:07:41.151159+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:03:42.016196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.171161+0000","last_change":"2023-11-28T12:07:41.170122+0000","last_active":"2023-11-28T12:07:41.171161+0000","last_peered":"2023-11-28T12:07:41.171161+0000","last_clean":"2023-11-28T12:07:41.171161+0000","last_became_active":"2023-11-28T12:07:41.168780+0000","last_became_peered":"2023-11-28T12:07:41.168780+0000","last_unstale":"2023-11-28T12:07:41.171161+0000","last_undegraded":"2023-11-28T12:07:41.171161+0000","last_fullsized":"2023-11-28T12:07:41.171161+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:10:51.007442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.149474+0000","last_change":"2023-11-28T12:07:41.149474+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.149474+0000","last_undegraded":"2023-11-28T12:07:41.149474+0000","last_fullsized":"2023-11-28T12:07:41.149474+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:51:19.561073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.171895+0000","last_change":"2023-11-28T12:07:41.168616+0000","last_active":"2023-11-28T12:07:41.171895+0000","last_peered":"2023-11-28T12:07:41.171895+0000","last_clean":"2023-11-28T12:07:41.171895+0000","last_became_active":"2023-11-28T12:07:41.168368+0000","last_became_peered":"2023-11-28T12:07:41.168368+0000","last_unstale":"2023-11-28T12:07:41.171895+0000","last_undegraded":"2023-11-28T12:07:41.171895+0000","last_fullsized":"2023-11-28T12:07:41.171895+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:43:58.515090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.152164+0000","last_change":"2023-11-28T12:07:41.152164+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.152164+0000","last_undegraded":"2023-11-28T12:07:41.152164+0000","last_fullsized":"2023-11-28T12:07:41.152164+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:40:24.727337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.171731+0000","last_change":"2023-11-28T12:07:41.168261+0000","last_active":"2023-11-28T12:07:41.171731+0000","last_peered":"2023-11-28T12:07:41.171731+0000","last_clean":"2023-11-28T12:07:41.171731+0000","last_became_active":"2023-11-28T12:07:41.167980+0000","last_became_peered":"2023-11-28T12:07:41.167980+0000","last_unstale":"2023-11-28T12:07:41.171731+0000","last_undegraded":"2023-11-28T12:07:41.171731+0000","last_fullsized":"2023-11-28T12:07:41.171731+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:46:34.650690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.151582+0000","last_change":"2023-11-28T12:07:41.151582+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.151582+0000","last_undegraded":"2023-11-28T12:07:41.151582+0000","last_fullsized":"2023-11-28T12:07:41.151582+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:46:48.928670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.167861+0000","last_change":"2023-11-28T12:07:41.164624+0000","last_active":"2023-11-28T12:07:41.167861+0000","last_peered":"2023-11-28T12:07:41.167861+0000","last_clean":"2023-11-28T12:07:41.167861+0000","last_became_active":"2023-11-28T12:07:41.164356+0000","last_became_peered":"2023-11-28T12:07:41.164356+0000","last_unstale":"2023-11-28T12:07:41.167861+0000","last_undegraded":"2023-11-28T12:07:41.167861+0000","last_fullsized":"2023-11-28T12:07:41.167861+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:02:12.148279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.145864+0000","last_change":"2023-11-28T12:07:41.145864+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.145864+0000","last_undegraded":"2023-11-28T12:07:41.145864+0000","last_fullsized":"2023-11-28T12:07:41.145864+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:32:42.598768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.162176+0000","last_change":"2023-11-28T12:07:41.159717+0000","last_active":"2023-11-28T12:07:41.162176+0000","last_peered":"2023-11-28T12:07:41.162176+0000","last_clean":"2023-11-28T12:07:41.162176+0000","last_became_active":"2023-11-28T12:07:41.159459+0000","last_became_peered":"2023-11-28T12:07:41.159459+0000","last_unstale":"2023-11-28T12:07:41.162176+0000","last_undegraded":"2023-11-28T12:07:41.162176+0000","last_fullsized":"2023-11-28T12:07:41.162176+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:03:41.008569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.146411+0000","last_change":"2023-11-28T12:07:41.146411+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.146411+0000","last_undegraded":"2023-11-28T12:07:41.146411+0000","last_fullsized":"2023-11-28T12:07:41.146411+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:36:32.514106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.169694+0000","last_change":"2023-11-28T12:07:41.168453+0000","last_active":"2023-11-28T12:07:41.169694+0000","last_peered":"2023-11-28T12:07:41.169694+0000","last_clean":"2023-11-28T12:07:41.169694+0000","last_became_active":"2023-11-28T12:07:41.168179+0000","last_became_peered":"2023-11-28T12:07:41.168179+0000","last_unstale":"2023-11-28T12:07:41.169694+0000","last_undegraded":"2023-11-28T12:07:41.169694+0000","last_fullsized":"2023-11-28T12:07:41.169694+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:43:58.515090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.148257+0000","last_change":"2023-11-28T12:07:41.148257+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.148257+0000","last_undegraded":"2023-11-28T12:07:41.148257+0000","last_fullsized":"2023-11-28T12:07:41.148257+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:32:42.598768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.161463+0000","last_change":"2023-11-28T12:07:41.157503+0000","last_active":"2023-11-28T12:07:41.161463+0000","last_peered":"2023-11-28T12:07:41.161463+0000","last_clean":"2023-11-28T12:07:41.161463+0000","last_became_active":"2023-11-28T12:07:41.156917+0000","last_became_peered":"2023-11-28T12:07:41.156917+0000","last_unstale":"2023-11-28T12:07:41.161463+0000","last_undegraded":"2023-11-28T12:07:41.161463+0000","last_fullsized":"2023-11-28T12:07:41.161463+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:21:58.563957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.148393+0000","last_change":"2023-11-28T12:07:41.148393+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.148393+0000","last_undegraded":"2023-11-28T12:07:41.148393+0000","last_fullsized":"2023-11-28T12:07:41.148393+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:21:44.583002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.171018+0000","last_change":"2023-11-28T12:07:41.166866+0000","last_active":"2023-11-28T12:07:41.171018+0000","last_peered":"2023-11-28T12:07:41.171018+0000","last_clean":"2023-11-28T12:07:41.171018+0000","last_became_active":"2023-11-28T12:07:41.166584+0000","last_became_peered":"2023-11-28T12:07:41.166584+0000","last_unstale":"2023-11-28T12:07:41.171018+0000","last_undegraded":"2023-11-28T12:07:41.171018+0000","last_fullsized":"2023-11-28T12:07:41.171018+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:43:58.515090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.147847+0000","last_change":"2023-11-28T12:07:41.147847+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.147847+0000","last_undegraded":"2023-11-28T12:07:41.147847+0000","last_fullsized":"2023-11-28T12:07:41.147847+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:48:09.410549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.172292+0000","last_change":"2023-11-28T12:07:41.171141+0000","last_active":"2023-11-28T12:07:41.172292+0000","last_peered":"2023-11-28T12:07:41.172292+0000","last_clean":"2023-11-28T12:07:41.172292+0000","last_became_active":"2023-11-28T12:07:41.170256+0000","last_became_peered":"2023-11-28T12:07:41.170256+0000","last_unstale":"2023-11-28T12:07:41.172292+0000","last_undegraded":"2023-11-28T12:07:41.172292+0000","last_fullsized":"2023-11-28T12:07:41.172292+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:17:45.704529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.160079+0000","last_change":"2023-11-28T12:07:41.160079+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.160079+0000","last_undegraded":"2023-11-28T12:07:41.160079+0000","last_fullsized":"2023-11-28T12:07:41.160079+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:21:44.583002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.174922+0000","last_change":"2023-11-28T12:07:41.171992+0000","last_active":"2023-11-28T12:07:41.174922+0000","last_peered":"2023-11-28T12:07:41.174922+0000","last_clean":"2023-11-28T12:07:41.174922+0000","last_became_active":"2023-11-28T12:07:41.171295+0000","last_became_peered":"2023-11-28T12:07:41.171295+0000","last_unstale":"2023-11-28T12:07:41.174922+0000","last_undegraded":"2023-11-28T12:07:41.174922+0000","last_fullsized":"2023-11-28T12:07:41.174922+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:22:56.061661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.151916+0000","last_change":"2023-11-28T12:07:41.151916+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.151916+0000","last_undegraded":"2023-11-28T12:07:41.151916+0000","last_fullsized":"2023-11-28T12:07:41.151916+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:29:27.513071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.167590+0000","last_change":"2023-11-28T12:07:41.166346+0000","last_active":"2023-11-28T12:07:41.167590+0000","last_peered":"2023-11-28T12:07:41.167590+0000","last_clean":"2023-11-28T12:07:41.167590+0000","last_became_active":"2023-11-28T12:07:41.165885+0000","last_became_peered":"2023-11-28T12:07:41.165885+0000","last_unstale":"2023-11-28T12:07:41.167590+0000","last_undegraded":"2023-11-28T12:07:41.167590+0000","last_fullsized":"2023-11-28T12:07:41.167590+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:21:58.563957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.147885+0000","last_change":"2023-11-28T12:07:41.147885+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.147885+0000","last_undegraded":"2023-11-28T12:07:41.147885+0000","last_fullsized":"2023-11-28T12:07:41.147885+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:55:26.362077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.169106+0000","last_change":"2023-11-28T12:07:41.167652+0000","last_active":"2023-11-28T12:07:41.169106+0000","last_peered":"2023-11-28T12:07:41.169106+0000","last_clean":"2023-11-28T12:07:41.169106+0000","last_became_active":"2023-11-28T12:07:41.166796+0000","last_became_peered":"2023-11-28T12:07:41.166796+0000","last_unstale":"2023-11-28T12:07:41.169106+0000","last_undegraded":"2023-11-28T12:07:41.169106+0000","last_fullsized":"2023-11-28T12:07:41.169106+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:01:45.697262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.149621+0000","last_change":"2023-11-28T12:07:41.149621+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.149621+0000","last_undegraded":"2023-11-28T12:07:41.149621+0000","last_fullsized":"2023-11-28T12:07:41.149621+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:02:08.714843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.164501+0000","last_change":"2023-11-28T12:07:41.160266+0000","last_active":"2023-11-28T12:07:41.164501+0000","last_peered":"2023-11-28T12:07:41.164501+0000","last_clean":"2023-11-28T12:07:41.164501+0000","last_became_active":"2023-11-28T12:07:41.160022+0000","last_became_peered":"2023-11-28T12:07:41.160022+0000","last_unstale":"2023-11-28T12:07:41.164501+0000","last_undegraded":"2023-11-28T12:07:41.164501+0000","last_fullsized":"2023-11-28T12:07:41.164501+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:16:20.525710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.145926+0000","last_change":"2023-11-28T12:07:41.145926+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.145926+0000","last_undegraded":"2023-11-28T12:07:41.145926+0000","last_fullsized":"2023-11-28T12:07:41.145926+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:38:08.530818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.166036+0000","last_change":"2023-11-28T12:07:41.163164+0000","last_active":"2023-11-28T12:07:41.166036+0000","last_peered":"2023-11-28T12:07:41.166036+0000","last_clean":"2023-11-28T12:07:41.166036+0000","last_became_active":"2023-11-28T12:07:41.162678+0000","last_became_peered":"2023-11-28T12:07:41.162678+0000","last_unstale":"2023-11-28T12:07:41.166036+0000","last_undegraded":"2023-11-28T12:07:41.166036+0000","last_fullsized":"2023-11-28T12:07:41.166036+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:39:04.670777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.157549+0000","last_change":"2023-11-28T12:07:41.157549+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.157549+0000","last_undegraded":"2023-11-28T12:07:41.157549+0000","last_fullsized":"2023-11-28T12:07:41.157549+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:38:08.530818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.170948+0000","last_change":"2023-11-28T12:07:41.166168+0000","last_active":"2023-11-28T12:07:41.170948+0000","last_peered":"2023-11-28T12:07:41.170948+0000","last_clean":"2023-11-28T12:07:41.170948+0000","last_became_active":"2023-11-28T12:07:41.164114+0000","last_became_peered":"2023-11-28T12:07:41.164114+0000","last_unstale":"2023-11-28T12:07:41.170948+0000","last_undegraded":"2023-11-28T12:07:41.170948+0000","last_fullsized":"2023-11-28T12:07:41.170948+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:01:45.697262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.146322+0000","last_change":"2023-11-28T12:07:41.146322+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.146322+0000","last_undegraded":"2023-11-28T12:07:41.146322+0000","last_fullsized":"2023-11-28T12:07:41.146322+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:53:09.125880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.165318+0000","last_change":"2023-11-28T12:07:41.162583+0000","last_active":"2023-11-28T12:07:41.165318+0000","last_peered":"2023-11-28T12:07:41.165318+0000","last_clean":"2023-11-28T12:07:41.165318+0000","last_became_active":"2023-11-28T12:07:41.161213+0000","last_became_peered":"2023-11-28T12:07:41.161213+0000","last_unstale":"2023-11-28T12:07:41.165318+0000","last_undegraded":"2023-11-28T12:07:41.165318+0000","last_fullsized":"2023-11-28T12:07:41.165318+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:48:59.983563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.153733+0000","last_change":"2023-11-28T12:07:41.153733+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.153733+0000","last_undegraded":"2023-11-28T12:07:41.153733+0000","last_fullsized":"2023-11-28T12:07:41.153733+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:15:46.212373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.160357+0000","last_change":"2023-11-28T12:07:41.154433+0000","last_active":"2023-11-28T12:07:41.160357+0000","last_peered":"2023-11-28T12:07:41.160357+0000","last_clean":"2023-11-28T12:07:41.160357+0000","last_became_active":"2023-11-28T12:07:41.154159+0000","last_became_peered":"2023-11-28T12:07:41.154159+0000","last_unstale":"2023-11-28T12:07:41.160357+0000","last_undegraded":"2023-11-28T12:07:41.160357+0000","last_fullsized":"2023-11-28T12:07:41.160357+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:04:14.299923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T12:07:40.145722+0000","last_change":"2023-11-28T12:06:23.961595+0000","last_active":"2023-11-28T12:07:40.145722+0000","last_peered":"2023-11-28T12:07:40.145722+0000","last_clean":"2023-11-28T12:07:40.145722+0000","last_became_active":"2023-11-28T12:06:23.961257+0000","last_became_peered":"2023-11-28T12:06:23.961257+0000","last_unstale":"2023-11-28T12:07:40.145722+0000","last_undegraded":"2023-11-28T12:07:40.145722+0000","last_fullsized":"2023-11-28T12:07:40.145722+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:30:40.200095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.147168+0000","last_change":"2023-11-28T12:07:41.147168+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.147168+0000","last_undegraded":"2023-11-28T12:07:41.147168+0000","last_fullsized":"2023-11-28T12:07:41.147168+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:40:24.727337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.167755+0000","last_change":"2023-11-28T12:07:41.164138+0000","last_active":"2023-11-28T12:07:41.167755+0000","last_peered":"2023-11-28T12:07:41.167755+0000","last_clean":"2023-11-28T12:07:41.167755+0000","last_became_active":"2023-11-28T12:07:41.162131+0000","last_became_peered":"2023-11-28T12:07:41.162131+0000","last_unstale":"2023-11-28T12:07:41.167755+0000","last_undegraded":"2023-11-28T12:07:41.167755+0000","last_fullsized":"2023-11-28T12:07:41.167755+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:28:49.540743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T12:07:40.143874+0000","last_change":"2023-11-28T12:06:23.517505+0000","last_active":"2023-11-28T12:07:40.143874+0000","last_peered":"2023-11-28T12:07:40.143874+0000","last_clean":"2023-11-28T12:07:40.143874+0000","last_became_active":"2023-11-28T12:06:23.517151+0000","last_became_peered":"2023-11-28T12:06:23.517151+0000","last_unstale":"2023-11-28T12:07:40.143874+0000","last_undegraded":"2023-11-28T12:07:40.143874+0000","last_fullsized":"2023-11-28T12:07:40.143874+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:30:40.200095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.156626+0000","last_change":"2023-11-28T12:07:41.156626+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.156626+0000","last_undegraded":"2023-11-28T12:07:41.156626+0000","last_fullsized":"2023-11-28T12:07:41.156626+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:47:04.900190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.171873+0000","last_change":"2023-11-28T12:07:41.169674+0000","last_active":"2023-11-28T12:07:41.171873+0000","last_peered":"2023-11-28T12:07:41.171873+0000","last_clean":"2023-11-28T12:07:41.171873+0000","last_became_active":"2023-11-28T12:07:41.169182+0000","last_became_peered":"2023-11-28T12:07:41.169182+0000","last_unstale":"2023-11-28T12:07:41.171873+0000","last_undegraded":"2023-11-28T12:07:41.171873+0000","last_fullsized":"2023-11-28T12:07:41.171873+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:28:20.315709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T12:07:40.145277+0000","last_change":"2023-11-28T12:06:23.517967+0000","last_active":"2023-11-28T12:07:40.145277+0000","last_peered":"2023-11-28T12:07:40.145277+0000","last_clean":"2023-11-28T12:07:40.145277+0000","last_became_active":"2023-11-28T12:06:23.517495+0000","last_became_peered":"2023-11-28T12:06:23.517495+0000","last_unstale":"2023-11-28T12:07:40.145277+0000","last_undegraded":"2023-11-28T12:07:40.145277+0000","last_fullsized":"2023-11-28T12:07:40.145277+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:51:06.844441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":172,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T12:07:40.143568+0000","last_change":"2023-11-28T12:06:23.513472+0000","last_active":"2023-11-28T12:07:40.143568+0000","last_peered":"2023-11-28T12:07:40.143568+0000","last_clean":"2023-11-28T12:07:40.143568+0000","last_became_active":"2023-11-28T12:06:23.513150+0000","last_became_peered":"2023-11-28T12:06:23.513150+0000","last_unstale":"2023-11-28T12:07:40.143568+0000","last_undegraded":"2023-11-28T12:07:40.143568+0000","last_fullsized":"2023-11-28T12:07:40.143568+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:34:18.653049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.147660+0000","last_change":"2023-11-28T12:07:41.147660+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.147660+0000","last_undegraded":"2023-11-28T12:07:41.147660+0000","last_fullsized":"2023-11-28T12:07:41.147660+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:38:08.530818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.169197+0000","last_change":"2023-11-28T12:07:41.167454+0000","last_active":"2023-11-28T12:07:41.169197+0000","last_peered":"2023-11-28T12:07:41.169197+0000","last_clean":"2023-11-28T12:07:41.169197+0000","last_became_active":"2023-11-28T12:07:41.166407+0000","last_became_peered":"2023-11-28T12:07:41.166407+0000","last_unstale":"2023-11-28T12:07:41.169197+0000","last_undegraded":"2023-11-28T12:07:41.169197+0000","last_fullsized":"2023-11-28T12:07:41.169197+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:04:29.977354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T12:07:40.144200+0000","last_change":"2023-11-28T12:06:23.903708+0000","last_active":"2023-11-28T12:07:40.144200+0000","last_peered":"2023-11-28T12:07:40.144200+0000","last_clean":"2023-11-28T12:07:40.144200+0000","last_became_active":"2023-11-28T12:06:23.903399+0000","last_became_peered":"2023-11-28T12:06:23.903399+0000","last_unstale":"2023-11-28T12:07:40.144200+0000","last_undegraded":"2023-11-28T12:07:40.144200+0000","last_fullsized":"2023-11-28T12:07:40.144200+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:31:13.187145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.155565+0000","last_change":"2023-11-28T12:07:41.155565+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.155565+0000","last_undegraded":"2023-11-28T12:07:41.155565+0000","last_fullsized":"2023-11-28T12:07:41.155565+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:36:32.514106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.171367+0000","last_change":"2023-11-28T12:07:41.167913+0000","last_active":"2023-11-28T12:07:41.171367+0000","last_peered":"2023-11-28T12:07:41.171367+0000","last_clean":"2023-11-28T12:07:41.171367+0000","last_became_active":"2023-11-28T12:07:41.167043+0000","last_became_peered":"2023-11-28T12:07:41.167043+0000","last_unstale":"2023-11-28T12:07:41.171367+0000","last_undegraded":"2023-11-28T12:07:41.171367+0000","last_fullsized":"2023-11-28T12:07:41.171367+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:46:34.650690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T12:07:40.143472+0000","last_change":"2023-11-28T12:06:23.903662+0000","last_active":"2023-11-28T12:07:40.143472+0000","last_peered":"2023-11-28T12:07:40.143472+0000","last_clean":"2023-11-28T12:07:40.143472+0000","last_became_active":"2023-11-28T12:06:23.903354+0000","last_became_peered":"2023-11-28T12:06:23.903354+0000","last_unstale":"2023-11-28T12:07:40.143472+0000","last_undegraded":"2023-11-28T12:07:40.143472+0000","last_fullsized":"2023-11-28T12:07:40.143472+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:02:07.694087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.145671+0000","last_change":"2023-11-28T12:07:41.145671+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.145671+0000","last_undegraded":"2023-11-28T12:07:41.145671+0000","last_fullsized":"2023-11-28T12:07:41.145671+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:42:14.979933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.169635+0000","last_change":"2023-11-28T12:07:41.165591+0000","last_active":"2023-11-28T12:07:41.169635+0000","last_peered":"2023-11-28T12:07:41.169635+0000","last_clean":"2023-11-28T12:07:41.169635+0000","last_became_active":"2023-11-28T12:07:41.164238+0000","last_became_peered":"2023-11-28T12:07:41.164238+0000","last_unstale":"2023-11-28T12:07:41.169635+0000","last_undegraded":"2023-11-28T12:07:41.169635+0000","last_fullsized":"2023-11-28T12:07:41.169635+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:28:49.540743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T12:07:40.140130+0000","last_change":"2023-11-28T12:06:23.903797+0000","last_active":"2023-11-28T12:07:40.140130+0000","last_peered":"2023-11-28T12:07:40.140130+0000","last_clean":"2023-11-28T12:07:40.140130+0000","last_became_active":"2023-11-28T12:06:23.903475+0000","last_became_peered":"2023-11-28T12:06:23.903475+0000","last_unstale":"2023-11-28T12:07:40.140130+0000","last_undegraded":"2023-11-28T12:07:40.140130+0000","last_fullsized":"2023-11-28T12:07:40.140130+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:51:06.844441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.156133+0000","last_change":"2023-11-28T12:07:41.156133+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.156133+0000","last_undegraded":"2023-11-28T12:07:41.156133+0000","last_fullsized":"2023-11-28T12:07:41.156133+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:00:21.039405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.162113+0000","last_change":"2023-11-28T12:07:41.160433+0000","last_active":"2023-11-28T12:07:41.162113+0000","last_peered":"2023-11-28T12:07:41.162113+0000","last_clean":"2023-11-28T12:07:41.162113+0000","last_became_active":"2023-11-28T12:07:41.156521+0000","last_became_peered":"2023-11-28T12:07:41.156521+0000","last_unstale":"2023-11-28T12:07:41.162113+0000","last_undegraded":"2023-11-28T12:07:41.162113+0000","last_fullsized":"2023-11-28T12:07:41.162113+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:13:06.059949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T12:07:40.139422+0000","last_change":"2023-11-28T12:06:23.903983+0000","last_active":"2023-11-28T12:07:40.139422+0000","last_peered":"2023-11-28T12:07:40.139422+0000","last_clean":"2023-11-28T12:07:40.139422+0000","last_became_active":"2023-11-28T12:06:23.903511+0000","last_became_peered":"2023-11-28T12:06:23.903511+0000","last_unstale":"2023-11-28T12:07:40.139422+0000","last_undegraded":"2023-11-28T12:07:40.139422+0000","last_fullsized":"2023-11-28T12:07:40.139422+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:31:13.187145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.146439+0000","last_change":"2023-11-28T12:07:41.146439+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.146439+0000","last_undegraded":"2023-11-28T12:07:41.146439+0000","last_fullsized":"2023-11-28T12:07:41.146439+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:04:15.307550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.166158+0000","last_change":"2023-11-28T12:07:41.162201+0000","last_active":"2023-11-28T12:07:41.166158+0000","last_peered":"2023-11-28T12:07:41.166158+0000","last_clean":"2023-11-28T12:07:41.166158+0000","last_became_active":"2023-11-28T12:07:41.159342+0000","last_became_peered":"2023-11-28T12:07:41.159342+0000","last_unstale":"2023-11-28T12:07:41.166158+0000","last_undegraded":"2023-11-28T12:07:41.166158+0000","last_fullsized":"2023-11-28T12:07:41.166158+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:02:12.148279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T12:07:40.140015+0000","last_change":"2023-11-28T12:06:23.517246+0000","last_active":"2023-11-28T12:07:40.140015+0000","last_peered":"2023-11-28T12:07:40.140015+0000","last_clean":"2023-11-28T12:07:40.140015+0000","last_became_active":"2023-11-28T12:06:23.516854+0000","last_became_peered":"2023-11-28T12:06:23.516854+0000","last_unstale":"2023-11-28T12:07:40.140015+0000","last_undegraded":"2023-11-28T12:07:40.140015+0000","last_fullsized":"2023-11-28T12:07:40.140015+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:51:06.844441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9388,"kb_used_data":932,"kb_used_omap":0,"kb_used_meta":8448,"kb_avail":94362452,"statfs":{"total":96636764160,"available":96627150848,"internally_reserved":0,"allocated":954368,"data_stored":736804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8650752},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":2.7469999999999999,"5min":2.7469999999999999,"15min":2.7469999999999999},"last":0.754}]},{"osd":1,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.65300000000000002}]},{"osd":2,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.819,"5min":1.819,"15min":1.819},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":0.67300000000000004}]},{"osd":3,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.71899999999999997}]},{"osd":4,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.376},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.77000000000000002}]},{"osd":5,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.69199999999999995}]},{"osd":6,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.74299999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8232,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363608,"statfs":{"total":96636764160,"available":96628334592,"internally_reserved":0,"allocated":360448,"data_stored":146436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.46700000000000003}]},{"osd":1,"last update":"Tue Nov 28 12:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.61899999999999999}]},{"osd":2,"last update":"Tue Nov 28 12:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.55200000000000005}]},{"osd":3,"last update":"Tue Nov 28 12:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.60599999999999998}]},{"osd":4,"last update":"Tue Nov 28 12:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.72899999999999998}]},{"osd":5,"last update":"Tue Nov 28 12:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.73899999999999999}]},{"osd":7,"last update":"Tue Nov 28 12:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.65100000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13408,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":12480,"kb_avail":94358432,"statfs":{"total":96636764160,"available":96623034368,"internally_reserved":0,"allocated":942080,"data_stored":730176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12779520},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.374}]},{"osd":2,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.52300000000000002}]},{"osd":3,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.45000000000000001}]},{"osd":4,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.7350000000000001,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.60499999999999998}]},{"osd":5,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.61799999999999999}]},{"osd":6,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.627}]},{"osd":7,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.752}]}]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12376,"kb_used_data":336,"kb_used_omap":0,"kb_used_meta":12032,"kb_avail":94359464,"statfs":{"total":96636764160,"available":96624091136,"internally_reserved":0,"allocated":344064,"data_stored":138447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12320768},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 12:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.47399999999999998}]},{"osd":2,"last update":"Tue Nov 28 12:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.499},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.52700000000000002}]},{"osd":3,"last update":"Tue Nov 28 12:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.57299999999999995}]},{"osd":4,"last update":"Tue Nov 28 12:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.9159999999999999,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.69999999999999996}]},{"osd":5,"last update":"Tue Nov 28 12:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.68200000000000005}]},{"osd":6,"last update":"Tue Nov 28 12:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.82999999999999996}]},{"osd":7,"last update":"Tue Nov 28 12:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.87}]}]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12252,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":11904,"kb_avail":94359588,"statfs":{"total":96636764160,"available":96624218112,"internally_reserved":0,"allocated":348160,"data_stored":139808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12189696},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.46700000000000003}]},{"osd":1,"last update":"Tue Nov 28 12:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.51100000000000001}]},{"osd":3,"last update":"Tue Nov 28 12:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.41099999999999998}]},{"osd":4,"last update":"Tue Nov 28 12:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.57699999999999996}]},{"osd":5,"last update":"Tue Nov 28 12:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.60399999999999998}]},{"osd":6,"last update":"Tue Nov 28 12:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.67700000000000005}]},{"osd":7,"last update":"Tue Nov 28 12:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.63300000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12376,"kb_used_data":336,"kb_used_omap":0,"kb_used_meta":12032,"kb_avail":94359464,"statfs":{"total":96636764160,"available":96624091136,"internally_reserved":0,"allocated":344064,"data_stored":138447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12320768},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.33500000000000002}]},{"osd":1,"last update":"Tue Nov 28 12:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.372},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.53500000000000003}]},{"osd":2,"last update":"Tue Nov 28 12:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.58499999999999996}]},{"osd":4,"last update":"Tue Nov 28 12:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.752},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.69799999999999995}]},{"osd":5,"last update":"Tue Nov 28 12:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.82399999999999995}]},{"osd":6,"last update":"Tue Nov 28 12:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.77900000000000003}]},{"osd":7,"last update":"Tue Nov 28 12:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.67100000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8348,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":8000,"kb_avail":94363492,"statfs":{"total":96636764160,"available":96628215808,"internally_reserved":0,"allocated":348160,"data_stored":139808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8192000},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.58199999999999996}]},{"osd":1,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.65500000000000003}]},{"osd":2,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.54500000000000004}]},{"osd":3,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.622}]},{"osd":5,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.50900000000000001}]},{"osd":6,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.60199999999999998}]},{"osd":7,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.66300000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8220,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363620,"statfs":{"total":96636764160,"available":96628346880,"internally_reserved":0,"allocated":348160,"data_stored":139808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.67400000000000004}]},{"osd":1,"last update":"Tue Nov 28 12:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.624}]},{"osd":2,"last update":"Tue Nov 28 12:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.65800000000000003}]},{"osd":3,"last update":"Tue Nov 28 12:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.71099999999999997}]},{"osd":4,"last update":"Tue Nov 28 12:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.79600000000000004}]},{"osd":6,"last update":"Tue Nov 28 12:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.75},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.81299999999999994}]},{"osd":7,"last update":"Tue Nov 28 12:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.84199999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T12:07:46.278 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T12:07:46.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.518+0000 7f9734bff700 1 Processor -- start 2023-11-28T12:07:46.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.518+0000 7f9734bff700 1 -- start start 2023-11-28T12:07:46.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.519+0000 7f9734bff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9730161340 0x7f97300d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:46.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.519+0000 7f9734bff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f97300d2320 0x7f97300cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:46.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.519+0000 7f9734bff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97300d1950 con 0x7f973015c9b0 2023-11-28T12:07:46.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.519+0000 7f9734bff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97300b5800 con 0x7f97300d2320 2023-11-28T12:07:46.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.519+0000 7f9734bff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97300b5300 con 0x7f9730161340 2023-11-28T12:07:46.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.519+0000 7f972e59c700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f973015c9b0 0x7f97300b4bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:38750/0 (socket says 172.21.15.45:38750) 2023-11-28T12:07:46.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.519+0000 7f972e59c700 1 -- 172.21.15.45:0/542565942 learned_addr learned my addr 172.21.15.45:0/542565942 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:07:46.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.519+0000 7f972ed9d700 1 --2- 172.21.15.45:0/542565942 >> v2:172.21.15.45:3300/0 conn(0x7f97300d2320 0x7f97300cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:46.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.520+0000 7f972dd9b700 1 --2- 172.21.15.45:0/542565942 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9730161340 0x7f97300d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:46.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.520+0000 7f972d59a700 1 -- 172.21.15.45:0/542565942 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4277779268 0 0) 0x7f97300d1950 con 0x7f973015c9b0 2023-11-28T12:07:46.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.520+0000 7f972ed9d700 1 -- 172.21.15.45:0/542565942 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9730161340 msgr2=0x7f97300d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:46.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.520+0000 7f972ed9d700 1 --2- 172.21.15.45:0/542565942 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9730161340 0x7f97300d1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:46.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.520+0000 7f972ed9d700 1 -- 172.21.15.45:0/542565942 >> v1:172.21.15.45:6789/0 conn(0x7f973015c9b0 legacy=0x7f97300b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:46.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.520+0000 7f972ed9d700 1 -- 172.21.15.45:0/542565942 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97300b5520 con 0x7f97300d2320 2023-11-28T12:07:46.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.520+0000 7f972ed9d700 1 --2- 172.21.15.45:0/542565942 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97300d2320 0x7f97300cd7c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f9728009dc0 tx=0x7f972800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ff99149337d60ab server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:46.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.520+0000 7f972d59a700 1 -- 172.21.15.45:0/542565942 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f972800e070 con 0x7f97300d2320 2023-11-28T12:07:46.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.520+0000 7f972d59a700 1 -- 172.21.15.45:0/542565942 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f972800bb90 con 0x7f97300d2320 2023-11-28T12:07:46.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.520+0000 7f972d59a700 1 -- 172.21.15.45:0/542565942 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9728012430 con 0x7f97300d2320 2023-11-28T12:07:46.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.521+0000 7f9734bff700 1 -- 172.21.15.45:0/542565942 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97300d2320 msgr2=0x7f97300cd7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:46.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.521+0000 7f9734bff700 1 --2- 172.21.15.45:0/542565942 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97300d2320 0x7f97300cd7c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f9728009dc0 tx=0x7f972800b330 comp rx=0 tx=0).stop 2023-11-28T12:07:46.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.521+0000 7f9734bff700 1 -- 172.21.15.45:0/542565942 shutdown_connections 2023-11-28T12:07:46.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.521+0000 7f9734bff700 1 --2- 172.21.15.45:0/542565942 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97300d2320 0x7f97300cd7c0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:46.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.521+0000 7f9734bff700 1 --2- 172.21.15.45:0/542565942 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9730161340 0x7f97300d1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:46.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.521+0000 7f9734bff700 1 -- 172.21.15.45:0/542565942 >> 172.21.15.45:0/542565942 conn(0x7f9730072600 msgr2=0x7f97300cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:46.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.521+0000 7f9734bff700 1 -- 172.21.15.45:0/542565942 shutdown_connections 2023-11-28T12:07:46.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.521+0000 7f9734bff700 1 -- 172.21.15.45:0/542565942 wait complete. 2023-11-28T12:07:46.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.523+0000 7f9734bff700 1 Processor -- start 2023-11-28T12:07:46.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.523+0000 7f9734bff700 1 -- start start 2023-11-28T12:07:46.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.524+0000 7f9734bff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f97300d2320 0x7f9730153b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:46.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.524+0000 7f9734bff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f973015c9b0 0x7f97301e7c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:46.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.524+0000 7f9734bff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9730161340 0x7f97301e6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:46.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.524+0000 7f9734bff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97301e7800 con 0x7f9730161340 2023-11-28T12:07:46.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.524+0000 7f9734bff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9730150c60 con 0x7f97300d2320 2023-11-28T12:07:46.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.524+0000 7f9734bff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97301e6b80 con 0x7f973015c9b0 2023-11-28T12:07:46.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.524+0000 7f972ed9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9730161340 0x7f97301e6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:46.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.524+0000 7f972ed9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9730161340 0x7f97301e6480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34188/0 (socket says 172.21.15.45:34188) 2023-11-28T12:07:46.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.524+0000 7f972ed9d700 1 -- 172.21.15.45:0/1800637552 learned_addr learned my addr 172.21.15.45:0/1800637552 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:46.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.524+0000 7f972e59c700 1 --2- 172.21.15.45:0/1800637552 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f97300d2320 0x7f9730153b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:46.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.524+0000 7f972dd9b700 1 --2- 172.21.15.45:0/1800637552 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f973015c9b0 0x7f97301e7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:46.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.524+0000 7f972ed9d700 1 -- 172.21.15.45:0/1800637552 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f973015c9b0 msgr2=0x7f97301e7c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:46.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.524+0000 7f972ed9d700 1 --2- 172.21.15.45:0/1800637552 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f973015c9b0 0x7f97301e7c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:46.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.524+0000 7f972ed9d700 1 -- 172.21.15.45:0/1800637552 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f97300d2320 msgr2=0x7f9730153b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:46.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.524+0000 7f972ed9d700 1 --2- 172.21.15.45:0/1800637552 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f97300d2320 0x7f9730153b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:46.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.524+0000 7f972ed9d700 1 -- 172.21.15.45:0/1800637552 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9728009a70 con 0x7f9730161340 2023-11-28T12:07:46.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.525+0000 7f972ed9d700 1 --2- 172.21.15.45:0/1800637552 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9730161340 0x7f97301e6480 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f9728014040 tx=0x7f9728004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:46.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.525+0000 7f971effd700 1 -- 172.21.15.45:0/1800637552 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9728012430 con 0x7f9730161340 2023-11-28T12:07:46.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.525+0000 7f971effd700 1 -- 172.21.15.45:0/1800637552 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9728020070 con 0x7f9730161340 2023-11-28T12:07:46.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.525+0000 7f9734bff700 1 -- 172.21.15.45:0/1800637552 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97300d15e0 con 0x7f9730161340 2023-11-28T12:07:46.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.525+0000 7f971effd700 1 -- 172.21.15.45:0/1800637552 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9728004280 con 0x7f9730161340 2023-11-28T12:07:46.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.525+0000 7f9734bff700 1 -- 172.21.15.45:0/1800637552 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97300d1300 con 0x7f9730161340 2023-11-28T12:07:46.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.526+0000 7f9734bff700 1 -- 172.21.15.45:0/1800637552 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f973015cd80 con 0x7f9730161340 2023-11-28T12:07:46.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.527+0000 7f971effd700 1 -- 172.21.15.45:0/1800637552 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f97280043e0 con 0x7f9730161340 2023-11-28T12:07:46.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.528+0000 7f971effd700 1 --2- 172.21.15.45:0/1800637552 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f97100682f0 0x7f971006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:46.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.528+0000 7f971effd700 1 -- 172.21.15.45:0/1800637552 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9728022070 con 0x7f9730161340 2023-11-28T12:07:46.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.528+0000 7f972e59c700 1 --2- 172.21.15.45:0/1800637552 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f97100682f0 0x7f971006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:46.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.529+0000 7f972e59c700 1 --2- 172.21.15.45:0/1800637552 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f97100682f0 0x7f971006a7a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9720000f60 tx=0x7f9720007c90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:46.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.532+0000 7f971effd700 1 -- 172.21.15.45:0/1800637552 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f97280548b0 con 0x7f9730161340 2023-11-28T12:07:46.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.730+0000 7f9734bff700 1 -- 172.21.15.45:0/1800637552 --> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f97301e7940 con 0x7f97100682f0 2023-11-28T12:07:46.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.740+0000 7f971effd700 1 -- 172.21.15.45:0/1800637552 <== mgr.4100 v2:172.21.15.152:6832/115389 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+308405 (secure 0 0 0) 0x7f97301e7940 con 0x7f97100682f0 2023-11-28T12:07:46.744 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:07:46.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.744+0000 7f9734bff700 1 -- 172.21.15.45:0/1800637552 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f97100682f0 msgr2=0x7f971006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:46.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.744+0000 7f9734bff700 1 --2- 172.21.15.45:0/1800637552 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f97100682f0 0x7f971006a7a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9720000f60 tx=0x7f9720007c90 comp rx=0 tx=0).stop 2023-11-28T12:07:46.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.744+0000 7f9734bff700 1 -- 172.21.15.45:0/1800637552 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9730161340 msgr2=0x7f97301e6480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:46.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.744+0000 7f9734bff700 1 --2- 172.21.15.45:0/1800637552 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9730161340 0x7f97301e6480 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f9728014040 tx=0x7f9728004ad0 comp rx=0 tx=0).stop 2023-11-28T12:07:46.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.744+0000 7f9734bff700 1 -- 172.21.15.45:0/1800637552 shutdown_connections 2023-11-28T12:07:46.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.744+0000 7f9734bff700 1 --2- 172.21.15.45:0/1800637552 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f97100682f0 0x7f971006a7a0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:46.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.744+0000 7f9734bff700 1 --2- 172.21.15.45:0/1800637552 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f97300d2320 0x7f9730153b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:46.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.744+0000 7f9734bff700 1 --2- 172.21.15.45:0/1800637552 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9730161340 0x7f97301e6480 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:46.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.744+0000 7f9734bff700 1 --2- 172.21.15.45:0/1800637552 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f973015c9b0 0x7f97301e7c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:46.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.744+0000 7f9734bff700 1 -- 172.21.15.45:0/1800637552 >> 172.21.15.45:0/1800637552 conn(0x7f9730072600 msgr2=0x7f973015e270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:46.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.744+0000 7f9734bff700 1 -- 172.21.15.45:0/1800637552 shutdown_connections 2023-11-28T12:07:46.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:46.744+0000 7f9734bff700 1 -- 172.21.15.45:0/1800637552 wait complete. 2023-11-28T12:07:46.748 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-11-28T12:07:46.763 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":70,"stamp":"2023-11-28T12:07:46.443621+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":42,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":84600,"kb_used_data":3896,"kb_used_omap":0,"kb_used_meta":80640,"kb_avail":754890120,"statfs":{"total":773094113280,"available":773007482880,"internally_reserved":0,"allocated":3989504,"data_stored":2309734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":82575360},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001259"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.149676+0000","last_change":"2023-11-28T12:07:41.149676+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.149676+0000","last_undegraded":"2023-11-28T12:07:41.149676+0000","last_fullsized":"2023-11-28T12:07:41.149676+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:29:27.513071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.150188+0000","last_change":"2023-11-28T12:07:41.150188+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.150188+0000","last_undegraded":"2023-11-28T12:07:41.150188+0000","last_fullsized":"2023-11-28T12:07:41.150188+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:46:48.928670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.150682+0000","last_change":"2023-11-28T12:07:41.150682+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.150682+0000","last_undegraded":"2023-11-28T12:07:41.150682+0000","last_fullsized":"2023-11-28T12:07:41.150682+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:46:48.928670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.151873+0000","last_change":"2023-11-28T12:07:41.151873+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.151873+0000","last_undegraded":"2023-11-28T12:07:41.151873+0000","last_fullsized":"2023-11-28T12:07:41.151873+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:28:50.548371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.146462+0000","last_change":"2023-11-28T12:07:41.146462+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.146462+0000","last_undegraded":"2023-11-28T12:07:41.146462+0000","last_fullsized":"2023-11-28T12:07:41.146462+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:50:22.991297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.155730+0000","last_change":"2023-11-28T12:07:41.155730+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.155730+0000","last_undegraded":"2023-11-28T12:07:41.155730+0000","last_fullsized":"2023-11-28T12:07:41.155730+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:10:52.015070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.151291+0000","last_change":"2023-11-28T12:07:41.151291+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.151291+0000","last_undegraded":"2023-11-28T12:07:41.151291+0000","last_fullsized":"2023-11-28T12:07:41.151291+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:22:57.069288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.149348+0000","last_change":"2023-11-28T12:07:41.149348+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.149348+0000","last_undegraded":"2023-11-28T12:07:41.149348+0000","last_fullsized":"2023-11-28T12:07:41.149348+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:36:26.400203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.151794+0000","last_change":"2023-11-28T12:07:41.151794+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.151794+0000","last_undegraded":"2023-11-28T12:07:41.151794+0000","last_fullsized":"2023-11-28T12:07:41.151794+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:21:44.583002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.160971+0000","last_change":"2023-11-28T12:07:41.160971+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.160971+0000","last_undegraded":"2023-11-28T12:07:41.160971+0000","last_fullsized":"2023-11-28T12:07:41.160971+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:46:48.928670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.154818+0000","last_change":"2023-11-28T12:07:41.154818+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.154818+0000","last_undegraded":"2023-11-28T12:07:41.154818+0000","last_fullsized":"2023-11-28T12:07:41.154818+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:32:42.598768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.147170+0000","last_change":"2023-11-28T12:07:41.147170+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.147170+0000","last_undegraded":"2023-11-28T12:07:41.147170+0000","last_fullsized":"2023-11-28T12:07:41.147170+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:37:01.124995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.158846+0000","last_change":"2023-11-28T12:07:41.158846+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.158846+0000","last_undegraded":"2023-11-28T12:07:41.158846+0000","last_fullsized":"2023-11-28T12:07:41.158846+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:37:01.124995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.153276+0000","last_change":"2023-11-28T12:07:41.153276+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.153276+0000","last_undegraded":"2023-11-28T12:07:41.153276+0000","last_fullsized":"2023-11-28T12:07:41.153276+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:53:09.125880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.158224+0000","last_change":"2023-11-28T12:07:41.158224+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.158224+0000","last_undegraded":"2023-11-28T12:07:41.158224+0000","last_fullsized":"2023-11-28T12:07:41.158224+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:04:15.307550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.152248+0000","last_change":"2023-11-28T12:07:41.152248+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.152248+0000","last_undegraded":"2023-11-28T12:07:41.152248+0000","last_fullsized":"2023-11-28T12:07:41.152248+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:19:36.237111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.152563+0000","last_change":"2023-11-28T12:07:41.152563+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.152563+0000","last_undegraded":"2023-11-28T12:07:41.152563+0000","last_fullsized":"2023-11-28T12:07:41.152563+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:37:01.124995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.147455+0000","last_change":"2023-11-28T12:07:41.147455+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.147455+0000","last_undegraded":"2023-11-28T12:07:41.147455+0000","last_fullsized":"2023-11-28T12:07:41.147455+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:50:22.991297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.148758+0000","last_change":"2023-11-28T12:07:41.148758+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.148758+0000","last_undegraded":"2023-11-28T12:07:41.148758+0000","last_fullsized":"2023-11-28T12:07:41.148758+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:10:52.015070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.149468+0000","last_change":"2023-11-28T12:07:41.149468+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.149468+0000","last_undegraded":"2023-11-28T12:07:41.149468+0000","last_fullsized":"2023-11-28T12:07:41.149468+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:50:53.505346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.154383+0000","last_change":"2023-11-28T12:07:41.154383+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.154383+0000","last_undegraded":"2023-11-28T12:07:41.154383+0000","last_fullsized":"2023-11-28T12:07:41.154383+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:51:19.561073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.155670+0000","last_change":"2023-11-28T12:07:41.155670+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.155670+0000","last_undegraded":"2023-11-28T12:07:41.155670+0000","last_fullsized":"2023-11-28T12:07:41.155670+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:48:09.410549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.149284+0000","last_change":"2023-11-28T12:07:41.149284+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.149284+0000","last_undegraded":"2023-11-28T12:07:41.149284+0000","last_fullsized":"2023-11-28T12:07:41.149284+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:36:32.514106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.146582+0000","last_change":"2023-11-28T12:07:41.146582+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.146582+0000","last_undegraded":"2023-11-28T12:07:41.146582+0000","last_fullsized":"2023-11-28T12:07:41.146582+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:02:13.155906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.150060+0000","last_change":"2023-11-28T12:07:41.150060+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.150060+0000","last_undegraded":"2023-11-28T12:07:41.150060+0000","last_fullsized":"2023-11-28T12:07:41.150060+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:17:46.712157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.158106+0000","last_change":"2023-11-28T12:07:41.158106+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.158106+0000","last_undegraded":"2023-11-28T12:07:41.158106+0000","last_fullsized":"2023-11-28T12:07:41.158106+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:07:05.409362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.147417+0000","last_change":"2023-11-28T12:07:41.147417+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.147417+0000","last_undegraded":"2023-11-28T12:07:41.147417+0000","last_fullsized":"2023-11-28T12:07:41.147417+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:46:35.658317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.154117+0000","last_change":"2023-11-28T12:07:41.154117+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.154117+0000","last_undegraded":"2023-11-28T12:07:41.154117+0000","last_fullsized":"2023-11-28T12:07:41.154117+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:19:36.237111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.149141+0000","last_change":"2023-11-28T12:07:41.149141+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.149141+0000","last_undegraded":"2023-11-28T12:07:41.149141+0000","last_fullsized":"2023-11-28T12:07:41.149141+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:02:13.155906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.148981+0000","last_change":"2023-11-28T12:07:41.148981+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.148981+0000","last_undegraded":"2023-11-28T12:07:41.148981+0000","last_fullsized":"2023-11-28T12:07:41.148981+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:55:26.362077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.147011+0000","last_change":"2023-11-28T12:07:41.147011+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.147011+0000","last_undegraded":"2023-11-28T12:07:41.147011+0000","last_fullsized":"2023-11-28T12:07:41.147011+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:04:15.307550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.155595+0000","last_change":"2023-11-28T12:07:41.155595+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.155595+0000","last_undegraded":"2023-11-28T12:07:41.155595+0000","last_fullsized":"2023-11-28T12:07:41.155595+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:28:50.548371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.150707+0000","last_change":"2023-11-28T12:07:41.150707+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.150707+0000","last_undegraded":"2023-11-28T12:07:41.150707+0000","last_fullsized":"2023-11-28T12:07:41.150707+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:22:57.069288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.168200+0000","last_change":"2023-11-28T12:07:41.165809+0000","last_active":"2023-11-28T12:07:41.168200+0000","last_peered":"2023-11-28T12:07:41.168200+0000","last_clean":"2023-11-28T12:07:41.168200+0000","last_became_active":"2023-11-28T12:07:41.163993+0000","last_became_peered":"2023-11-28T12:07:41.163993+0000","last_unstale":"2023-11-28T12:07:41.168200+0000","last_undegraded":"2023-11-28T12:07:41.168200+0000","last_fullsized":"2023-11-28T12:07:41.168200+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:48:59.983563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.160342+0000","last_change":"2023-11-28T12:07:41.160342+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.160342+0000","last_undegraded":"2023-11-28T12:07:41.160342+0000","last_fullsized":"2023-11-28T12:07:41.160342+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:21:19.797120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.168685+0000","last_change":"2023-11-28T12:07:41.167048+0000","last_active":"2023-11-28T12:07:41.168685+0000","last_peered":"2023-11-28T12:07:41.168685+0000","last_clean":"2023-11-28T12:07:41.168685+0000","last_became_active":"2023-11-28T12:07:41.166528+0000","last_became_peered":"2023-11-28T12:07:41.166528+0000","last_unstale":"2023-11-28T12:07:41.168685+0000","last_undegraded":"2023-11-28T12:07:41.168685+0000","last_fullsized":"2023-11-28T12:07:41.168685+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:03:41.008569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.152429+0000","last_change":"2023-11-28T12:07:41.152429+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.152429+0000","last_undegraded":"2023-11-28T12:07:41.152429+0000","last_fullsized":"2023-11-28T12:07:41.152429+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:42:14.979933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.170842+0000","last_change":"2023-11-28T12:07:41.169488+0000","last_active":"2023-11-28T12:07:41.170842+0000","last_peered":"2023-11-28T12:07:41.170842+0000","last_clean":"2023-11-28T12:07:41.170842+0000","last_became_active":"2023-11-28T12:07:41.169172+0000","last_became_peered":"2023-11-28T12:07:41.169172+0000","last_unstale":"2023-11-28T12:07:41.170842+0000","last_undegraded":"2023-11-28T12:07:41.170842+0000","last_fullsized":"2023-11-28T12:07:41.170842+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:36:37.411602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.149220+0000","last_change":"2023-11-28T12:07:41.149220+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.149220+0000","last_undegraded":"2023-11-28T12:07:41.149220+0000","last_fullsized":"2023-11-28T12:07:41.149220+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:21:09.502744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.168108+0000","last_change":"2023-11-28T12:07:41.163567+0000","last_active":"2023-11-28T12:07:41.168108+0000","last_peered":"2023-11-28T12:07:41.168108+0000","last_clean":"2023-11-28T12:07:41.168108+0000","last_became_active":"2023-11-28T12:07:41.162624+0000","last_became_peered":"2023-11-28T12:07:41.162624+0000","last_unstale":"2023-11-28T12:07:41.168108+0000","last_undegraded":"2023-11-28T12:07:41.168108+0000","last_fullsized":"2023-11-28T12:07:41.168108+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:19:35.229484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.146894+0000","last_change":"2023-11-28T12:07:41.146894+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.146894+0000","last_undegraded":"2023-11-28T12:07:41.146894+0000","last_fullsized":"2023-11-28T12:07:41.146894+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:51:19.561073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.172281+0000","last_change":"2023-11-28T12:07:41.170651+0000","last_active":"2023-11-28T12:07:41.172281+0000","last_peered":"2023-11-28T12:07:41.172281+0000","last_clean":"2023-11-28T12:07:41.172281+0000","last_became_active":"2023-11-28T12:07:41.170273+0000","last_became_peered":"2023-11-28T12:07:41.170273+0000","last_unstale":"2023-11-28T12:07:41.172281+0000","last_undegraded":"2023-11-28T12:07:41.172281+0000","last_fullsized":"2023-11-28T12:07:41.172281+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:01:45.697262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.155640+0000","last_change":"2023-11-28T12:07:41.155640+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.155640+0000","last_undegraded":"2023-11-28T12:07:41.155640+0000","last_fullsized":"2023-11-28T12:07:41.155640+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:40:24.727337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.171342+0000","last_change":"2023-11-28T12:07:41.168201+0000","last_active":"2023-11-28T12:07:41.171342+0000","last_peered":"2023-11-28T12:07:41.171342+0000","last_clean":"2023-11-28T12:07:41.171342+0000","last_became_active":"2023-11-28T12:07:41.166578+0000","last_became_peered":"2023-11-28T12:07:41.166578+0000","last_unstale":"2023-11-28T12:07:41.171342+0000","last_undegraded":"2023-11-28T12:07:41.171342+0000","last_fullsized":"2023-11-28T12:07:41.171342+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:28:20.315709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.155158+0000","last_change":"2023-11-28T12:07:41.155158+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.155158+0000","last_undegraded":"2023-11-28T12:07:41.155158+0000","last_fullsized":"2023-11-28T12:07:41.155158+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:36:26.400203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.169078+0000","last_change":"2023-11-28T12:07:41.167334+0000","last_active":"2023-11-28T12:07:41.169078+0000","last_peered":"2023-11-28T12:07:41.169078+0000","last_clean":"2023-11-28T12:07:41.169078+0000","last_became_active":"2023-11-28T12:07:41.166499+0000","last_became_peered":"2023-11-28T12:07:41.166499+0000","last_unstale":"2023-11-28T12:07:41.169078+0000","last_undegraded":"2023-11-28T12:07:41.169078+0000","last_fullsized":"2023-11-28T12:07:41.169078+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:28:20.315709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.149792+0000","last_change":"2023-11-28T12:07:41.149792+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.149792+0000","last_undegraded":"2023-11-28T12:07:41.149792+0000","last_fullsized":"2023-11-28T12:07:41.149792+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:15:46.212373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.168039+0000","last_change":"2023-11-28T12:07:41.163322+0000","last_active":"2023-11-28T12:07:41.168039+0000","last_peered":"2023-11-28T12:07:41.168039+0000","last_clean":"2023-11-28T12:07:41.168039+0000","last_became_active":"2023-11-28T12:07:41.161561+0000","last_became_peered":"2023-11-28T12:07:41.161561+0000","last_unstale":"2023-11-28T12:07:41.168039+0000","last_undegraded":"2023-11-28T12:07:41.168039+0000","last_fullsized":"2023-11-28T12:07:41.168039+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:07:04.401735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.151159+0000","last_change":"2023-11-28T12:07:41.151159+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.151159+0000","last_undegraded":"2023-11-28T12:07:41.151159+0000","last_fullsized":"2023-11-28T12:07:41.151159+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:03:42.016196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.171161+0000","last_change":"2023-11-28T12:07:41.170122+0000","last_active":"2023-11-28T12:07:41.171161+0000","last_peered":"2023-11-28T12:07:41.171161+0000","last_clean":"2023-11-28T12:07:41.171161+0000","last_became_active":"2023-11-28T12:07:41.168780+0000","last_became_peered":"2023-11-28T12:07:41.168780+0000","last_unstale":"2023-11-28T12:07:41.171161+0000","last_undegraded":"2023-11-28T12:07:41.171161+0000","last_fullsized":"2023-11-28T12:07:41.171161+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:10:51.007442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.149474+0000","last_change":"2023-11-28T12:07:41.149474+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.149474+0000","last_undegraded":"2023-11-28T12:07:41.149474+0000","last_fullsized":"2023-11-28T12:07:41.149474+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:51:19.561073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.171895+0000","last_change":"2023-11-28T12:07:41.168616+0000","last_active":"2023-11-28T12:07:41.171895+0000","last_peered":"2023-11-28T12:07:41.171895+0000","last_clean":"2023-11-28T12:07:41.171895+0000","last_became_active":"2023-11-28T12:07:41.168368+0000","last_became_peered":"2023-11-28T12:07:41.168368+0000","last_unstale":"2023-11-28T12:07:41.171895+0000","last_undegraded":"2023-11-28T12:07:41.171895+0000","last_fullsized":"2023-11-28T12:07:41.171895+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:43:58.515090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.152164+0000","last_change":"2023-11-28T12:07:41.152164+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.152164+0000","last_undegraded":"2023-11-28T12:07:41.152164+0000","last_fullsized":"2023-11-28T12:07:41.152164+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:40:24.727337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.171731+0000","last_change":"2023-11-28T12:07:41.168261+0000","last_active":"2023-11-28T12:07:41.171731+0000","last_peered":"2023-11-28T12:07:41.171731+0000","last_clean":"2023-11-28T12:07:41.171731+0000","last_became_active":"2023-11-28T12:07:41.167980+0000","last_became_peered":"2023-11-28T12:07:41.167980+0000","last_unstale":"2023-11-28T12:07:41.171731+0000","last_undegraded":"2023-11-28T12:07:41.171731+0000","last_fullsized":"2023-11-28T12:07:41.171731+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:46:34.650690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.151582+0000","last_change":"2023-11-28T12:07:41.151582+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.151582+0000","last_undegraded":"2023-11-28T12:07:41.151582+0000","last_fullsized":"2023-11-28T12:07:41.151582+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:46:48.928670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.167861+0000","last_change":"2023-11-28T12:07:41.164624+0000","last_active":"2023-11-28T12:07:41.167861+0000","last_peered":"2023-11-28T12:07:41.167861+0000","last_clean":"2023-11-28T12:07:41.167861+0000","last_became_active":"2023-11-28T12:07:41.164356+0000","last_became_peered":"2023-11-28T12:07:41.164356+0000","last_unstale":"2023-11-28T12:07:41.167861+0000","last_undegraded":"2023-11-28T12:07:41.167861+0000","last_fullsized":"2023-11-28T12:07:41.167861+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:02:12.148279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.145864+0000","last_change":"2023-11-28T12:07:41.145864+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.145864+0000","last_undegraded":"2023-11-28T12:07:41.145864+0000","last_fullsized":"2023-11-28T12:07:41.145864+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:32:42.598768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.162176+0000","last_change":"2023-11-28T12:07:41.159717+0000","last_active":"2023-11-28T12:07:41.162176+0000","last_peered":"2023-11-28T12:07:41.162176+0000","last_clean":"2023-11-28T12:07:41.162176+0000","last_became_active":"2023-11-28T12:07:41.159459+0000","last_became_peered":"2023-11-28T12:07:41.159459+0000","last_unstale":"2023-11-28T12:07:41.162176+0000","last_undegraded":"2023-11-28T12:07:41.162176+0000","last_fullsized":"2023-11-28T12:07:41.162176+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:03:41.008569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.146411+0000","last_change":"2023-11-28T12:07:41.146411+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.146411+0000","last_undegraded":"2023-11-28T12:07:41.146411+0000","last_fullsized":"2023-11-28T12:07:41.146411+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:36:32.514106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.169694+0000","last_change":"2023-11-28T12:07:41.168453+0000","last_active":"2023-11-28T12:07:41.169694+0000","last_peered":"2023-11-28T12:07:41.169694+0000","last_clean":"2023-11-28T12:07:41.169694+0000","last_became_active":"2023-11-28T12:07:41.168179+0000","last_became_peered":"2023-11-28T12:07:41.168179+0000","last_unstale":"2023-11-28T12:07:41.169694+0000","last_undegraded":"2023-11-28T12:07:41.169694+0000","last_fullsized":"2023-11-28T12:07:41.169694+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:43:58.515090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.148257+0000","last_change":"2023-11-28T12:07:41.148257+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.148257+0000","last_undegraded":"2023-11-28T12:07:41.148257+0000","last_fullsized":"2023-11-28T12:07:41.148257+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:32:42.598768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.161463+0000","last_change":"2023-11-28T12:07:41.157503+0000","last_active":"2023-11-28T12:07:41.161463+0000","last_peered":"2023-11-28T12:07:41.161463+0000","last_clean":"2023-11-28T12:07:41.161463+0000","last_became_active":"2023-11-28T12:07:41.156917+0000","last_became_peered":"2023-11-28T12:07:41.156917+0000","last_unstale":"2023-11-28T12:07:41.161463+0000","last_undegraded":"2023-11-28T12:07:41.161463+0000","last_fullsized":"2023-11-28T12:07:41.161463+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:21:58.563957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.148393+0000","last_change":"2023-11-28T12:07:41.148393+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.148393+0000","last_undegraded":"2023-11-28T12:07:41.148393+0000","last_fullsized":"2023-11-28T12:07:41.148393+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:21:44.583002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.171018+0000","last_change":"2023-11-28T12:07:41.166866+0000","last_active":"2023-11-28T12:07:41.171018+0000","last_peered":"2023-11-28T12:07:41.171018+0000","last_clean":"2023-11-28T12:07:41.171018+0000","last_became_active":"2023-11-28T12:07:41.166584+0000","last_became_peered":"2023-11-28T12:07:41.166584+0000","last_unstale":"2023-11-28T12:07:41.171018+0000","last_undegraded":"2023-11-28T12:07:41.171018+0000","last_fullsized":"2023-11-28T12:07:41.171018+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:43:58.515090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.147847+0000","last_change":"2023-11-28T12:07:41.147847+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.147847+0000","last_undegraded":"2023-11-28T12:07:41.147847+0000","last_fullsized":"2023-11-28T12:07:41.147847+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:48:09.410549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.172292+0000","last_change":"2023-11-28T12:07:41.171141+0000","last_active":"2023-11-28T12:07:41.172292+0000","last_peered":"2023-11-28T12:07:41.172292+0000","last_clean":"2023-11-28T12:07:41.172292+0000","last_became_active":"2023-11-28T12:07:41.170256+0000","last_became_peered":"2023-11-28T12:07:41.170256+0000","last_unstale":"2023-11-28T12:07:41.172292+0000","last_undegraded":"2023-11-28T12:07:41.172292+0000","last_fullsized":"2023-11-28T12:07:41.172292+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:17:45.704529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.160079+0000","last_change":"2023-11-28T12:07:41.160079+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.160079+0000","last_undegraded":"2023-11-28T12:07:41.160079+0000","last_fullsized":"2023-11-28T12:07:41.160079+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:21:44.583002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.174922+0000","last_change":"2023-11-28T12:07:41.171992+0000","last_active":"2023-11-28T12:07:41.174922+0000","last_peered":"2023-11-28T12:07:41.174922+0000","last_clean":"2023-11-28T12:07:41.174922+0000","last_became_active":"2023-11-28T12:07:41.171295+0000","last_became_peered":"2023-11-28T12:07:41.171295+0000","last_unstale":"2023-11-28T12:07:41.174922+0000","last_undegraded":"2023-11-28T12:07:41.174922+0000","last_fullsized":"2023-11-28T12:07:41.174922+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:22:56.061661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.151916+0000","last_change":"2023-11-28T12:07:41.151916+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.151916+0000","last_undegraded":"2023-11-28T12:07:41.151916+0000","last_fullsized":"2023-11-28T12:07:41.151916+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:29:27.513071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.167590+0000","last_change":"2023-11-28T12:07:41.166346+0000","last_active":"2023-11-28T12:07:41.167590+0000","last_peered":"2023-11-28T12:07:41.167590+0000","last_clean":"2023-11-28T12:07:41.167590+0000","last_became_active":"2023-11-28T12:07:41.165885+0000","last_became_peered":"2023-11-28T12:07:41.165885+0000","last_unstale":"2023-11-28T12:07:41.167590+0000","last_undegraded":"2023-11-28T12:07:41.167590+0000","last_fullsized":"2023-11-28T12:07:41.167590+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:21:58.563957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.147885+0000","last_change":"2023-11-28T12:07:41.147885+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.147885+0000","last_undegraded":"2023-11-28T12:07:41.147885+0000","last_fullsized":"2023-11-28T12:07:41.147885+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:55:26.362077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.169106+0000","last_change":"2023-11-28T12:07:41.167652+0000","last_active":"2023-11-28T12:07:41.169106+0000","last_peered":"2023-11-28T12:07:41.169106+0000","last_clean":"2023-11-28T12:07:41.169106+0000","last_became_active":"2023-11-28T12:07:41.166796+0000","last_became_peered":"2023-11-28T12:07:41.166796+0000","last_unstale":"2023-11-28T12:07:41.169106+0000","last_undegraded":"2023-11-28T12:07:41.169106+0000","last_fullsized":"2023-11-28T12:07:41.169106+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:01:45.697262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.149621+0000","last_change":"2023-11-28T12:07:41.149621+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.149621+0000","last_undegraded":"2023-11-28T12:07:41.149621+0000","last_fullsized":"2023-11-28T12:07:41.149621+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:02:08.714843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.164501+0000","last_change":"2023-11-28T12:07:41.160266+0000","last_active":"2023-11-28T12:07:41.164501+0000","last_peered":"2023-11-28T12:07:41.164501+0000","last_clean":"2023-11-28T12:07:41.164501+0000","last_became_active":"2023-11-28T12:07:41.160022+0000","last_became_peered":"2023-11-28T12:07:41.160022+0000","last_unstale":"2023-11-28T12:07:41.164501+0000","last_undegraded":"2023-11-28T12:07:41.164501+0000","last_fullsized":"2023-11-28T12:07:41.164501+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:16:20.525710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.145926+0000","last_change":"2023-11-28T12:07:41.145926+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.145926+0000","last_undegraded":"2023-11-28T12:07:41.145926+0000","last_fullsized":"2023-11-28T12:07:41.145926+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:38:08.530818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.166036+0000","last_change":"2023-11-28T12:07:41.163164+0000","last_active":"2023-11-28T12:07:41.166036+0000","last_peered":"2023-11-28T12:07:41.166036+0000","last_clean":"2023-11-28T12:07:41.166036+0000","last_became_active":"2023-11-28T12:07:41.162678+0000","last_became_peered":"2023-11-28T12:07:41.162678+0000","last_unstale":"2023-11-28T12:07:41.166036+0000","last_undegraded":"2023-11-28T12:07:41.166036+0000","last_fullsized":"2023-11-28T12:07:41.166036+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:39:04.670777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.157549+0000","last_change":"2023-11-28T12:07:41.157549+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.157549+0000","last_undegraded":"2023-11-28T12:07:41.157549+0000","last_fullsized":"2023-11-28T12:07:41.157549+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:38:08.530818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.170948+0000","last_change":"2023-11-28T12:07:41.166168+0000","last_active":"2023-11-28T12:07:41.170948+0000","last_peered":"2023-11-28T12:07:41.170948+0000","last_clean":"2023-11-28T12:07:41.170948+0000","last_became_active":"2023-11-28T12:07:41.164114+0000","last_became_peered":"2023-11-28T12:07:41.164114+0000","last_unstale":"2023-11-28T12:07:41.170948+0000","last_undegraded":"2023-11-28T12:07:41.170948+0000","last_fullsized":"2023-11-28T12:07:41.170948+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:01:45.697262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.146322+0000","last_change":"2023-11-28T12:07:41.146322+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.146322+0000","last_undegraded":"2023-11-28T12:07:41.146322+0000","last_fullsized":"2023-11-28T12:07:41.146322+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:53:09.125880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.165318+0000","last_change":"2023-11-28T12:07:41.162583+0000","last_active":"2023-11-28T12:07:41.165318+0000","last_peered":"2023-11-28T12:07:41.165318+0000","last_clean":"2023-11-28T12:07:41.165318+0000","last_became_active":"2023-11-28T12:07:41.161213+0000","last_became_peered":"2023-11-28T12:07:41.161213+0000","last_unstale":"2023-11-28T12:07:41.165318+0000","last_undegraded":"2023-11-28T12:07:41.165318+0000","last_fullsized":"2023-11-28T12:07:41.165318+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:48:59.983563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.153733+0000","last_change":"2023-11-28T12:07:41.153733+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.153733+0000","last_undegraded":"2023-11-28T12:07:41.153733+0000","last_fullsized":"2023-11-28T12:07:41.153733+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:15:46.212373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.160357+0000","last_change":"2023-11-28T12:07:41.154433+0000","last_active":"2023-11-28T12:07:41.160357+0000","last_peered":"2023-11-28T12:07:41.160357+0000","last_clean":"2023-11-28T12:07:41.160357+0000","last_became_active":"2023-11-28T12:07:41.154159+0000","last_became_peered":"2023-11-28T12:07:41.154159+0000","last_unstale":"2023-11-28T12:07:41.160357+0000","last_undegraded":"2023-11-28T12:07:41.160357+0000","last_fullsized":"2023-11-28T12:07:41.160357+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:04:14.299923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T12:07:40.145722+0000","last_change":"2023-11-28T12:06:23.961595+0000","last_active":"2023-11-28T12:07:40.145722+0000","last_peered":"2023-11-28T12:07:40.145722+0000","last_clean":"2023-11-28T12:07:40.145722+0000","last_became_active":"2023-11-28T12:06:23.961257+0000","last_became_peered":"2023-11-28T12:06:23.961257+0000","last_unstale":"2023-11-28T12:07:40.145722+0000","last_undegraded":"2023-11-28T12:07:40.145722+0000","last_fullsized":"2023-11-28T12:07:40.145722+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:30:40.200095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.147168+0000","last_change":"2023-11-28T12:07:41.147168+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.147168+0000","last_undegraded":"2023-11-28T12:07:41.147168+0000","last_fullsized":"2023-11-28T12:07:41.147168+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:40:24.727337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.167755+0000","last_change":"2023-11-28T12:07:41.164138+0000","last_active":"2023-11-28T12:07:41.167755+0000","last_peered":"2023-11-28T12:07:41.167755+0000","last_clean":"2023-11-28T12:07:41.167755+0000","last_became_active":"2023-11-28T12:07:41.162131+0000","last_became_peered":"2023-11-28T12:07:41.162131+0000","last_unstale":"2023-11-28T12:07:41.167755+0000","last_undegraded":"2023-11-28T12:07:41.167755+0000","last_fullsized":"2023-11-28T12:07:41.167755+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:28:49.540743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T12:07:40.143874+0000","last_change":"2023-11-28T12:06:23.517505+0000","last_active":"2023-11-28T12:07:40.143874+0000","last_peered":"2023-11-28T12:07:40.143874+0000","last_clean":"2023-11-28T12:07:40.143874+0000","last_became_active":"2023-11-28T12:06:23.517151+0000","last_became_peered":"2023-11-28T12:06:23.517151+0000","last_unstale":"2023-11-28T12:07:40.143874+0000","last_undegraded":"2023-11-28T12:07:40.143874+0000","last_fullsized":"2023-11-28T12:07:40.143874+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:30:40.200095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.156626+0000","last_change":"2023-11-28T12:07:41.156626+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.156626+0000","last_undegraded":"2023-11-28T12:07:41.156626+0000","last_fullsized":"2023-11-28T12:07:41.156626+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:47:04.900190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.171873+0000","last_change":"2023-11-28T12:07:41.169674+0000","last_active":"2023-11-28T12:07:41.171873+0000","last_peered":"2023-11-28T12:07:41.171873+0000","last_clean":"2023-11-28T12:07:41.171873+0000","last_became_active":"2023-11-28T12:07:41.169182+0000","last_became_peered":"2023-11-28T12:07:41.169182+0000","last_unstale":"2023-11-28T12:07:41.171873+0000","last_undegraded":"2023-11-28T12:07:41.171873+0000","last_fullsized":"2023-11-28T12:07:41.171873+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:28:20.315709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T12:07:40.145277+0000","last_change":"2023-11-28T12:06:23.517967+0000","last_active":"2023-11-28T12:07:40.145277+0000","last_peered":"2023-11-28T12:07:40.145277+0000","last_clean":"2023-11-28T12:07:40.145277+0000","last_became_active":"2023-11-28T12:06:23.517495+0000","last_became_peered":"2023-11-28T12:06:23.517495+0000","last_unstale":"2023-11-28T12:07:40.145277+0000","last_undegraded":"2023-11-28T12:07:40.145277+0000","last_fullsized":"2023-11-28T12:07:40.145277+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:51:06.844441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":172,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T12:07:40.143568+0000","last_change":"2023-11-28T12:06:23.513472+0000","last_active":"2023-11-28T12:07:40.143568+0000","last_peered":"2023-11-28T12:07:40.143568+0000","last_clean":"2023-11-28T12:07:40.143568+0000","last_became_active":"2023-11-28T12:06:23.513150+0000","last_became_peered":"2023-11-28T12:06:23.513150+0000","last_unstale":"2023-11-28T12:07:40.143568+0000","last_undegraded":"2023-11-28T12:07:40.143568+0000","last_fullsized":"2023-11-28T12:07:40.143568+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:34:18.653049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.147660+0000","last_change":"2023-11-28T12:07:41.147660+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.147660+0000","last_undegraded":"2023-11-28T12:07:41.147660+0000","last_fullsized":"2023-11-28T12:07:41.147660+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:38:08.530818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.169197+0000","last_change":"2023-11-28T12:07:41.167454+0000","last_active":"2023-11-28T12:07:41.169197+0000","last_peered":"2023-11-28T12:07:41.169197+0000","last_clean":"2023-11-28T12:07:41.169197+0000","last_became_active":"2023-11-28T12:07:41.166407+0000","last_became_peered":"2023-11-28T12:07:41.166407+0000","last_unstale":"2023-11-28T12:07:41.169197+0000","last_undegraded":"2023-11-28T12:07:41.169197+0000","last_fullsized":"2023-11-28T12:07:41.169197+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:04:29.977354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T12:07:40.144200+0000","last_change":"2023-11-28T12:06:23.903708+0000","last_active":"2023-11-28T12:07:40.144200+0000","last_peered":"2023-11-28T12:07:40.144200+0000","last_clean":"2023-11-28T12:07:40.144200+0000","last_became_active":"2023-11-28T12:06:23.903399+0000","last_became_peered":"2023-11-28T12:06:23.903399+0000","last_unstale":"2023-11-28T12:07:40.144200+0000","last_undegraded":"2023-11-28T12:07:40.144200+0000","last_fullsized":"2023-11-28T12:07:40.144200+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:31:13.187145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.155565+0000","last_change":"2023-11-28T12:07:41.155565+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.155565+0000","last_undegraded":"2023-11-28T12:07:41.155565+0000","last_fullsized":"2023-11-28T12:07:41.155565+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:36:32.514106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.171367+0000","last_change":"2023-11-28T12:07:41.167913+0000","last_active":"2023-11-28T12:07:41.171367+0000","last_peered":"2023-11-28T12:07:41.171367+0000","last_clean":"2023-11-28T12:07:41.171367+0000","last_became_active":"2023-11-28T12:07:41.167043+0000","last_became_peered":"2023-11-28T12:07:41.167043+0000","last_unstale":"2023-11-28T12:07:41.171367+0000","last_undegraded":"2023-11-28T12:07:41.171367+0000","last_fullsized":"2023-11-28T12:07:41.171367+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:46:34.650690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T12:07:40.143472+0000","last_change":"2023-11-28T12:06:23.903662+0000","last_active":"2023-11-28T12:07:40.143472+0000","last_peered":"2023-11-28T12:07:40.143472+0000","last_clean":"2023-11-28T12:07:40.143472+0000","last_became_active":"2023-11-28T12:06:23.903354+0000","last_became_peered":"2023-11-28T12:06:23.903354+0000","last_unstale":"2023-11-28T12:07:40.143472+0000","last_undegraded":"2023-11-28T12:07:40.143472+0000","last_fullsized":"2023-11-28T12:07:40.143472+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:02:07.694087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.145671+0000","last_change":"2023-11-28T12:07:41.145671+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.145671+0000","last_undegraded":"2023-11-28T12:07:41.145671+0000","last_fullsized":"2023-11-28T12:07:41.145671+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:42:14.979933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.169635+0000","last_change":"2023-11-28T12:07:41.165591+0000","last_active":"2023-11-28T12:07:41.169635+0000","last_peered":"2023-11-28T12:07:41.169635+0000","last_clean":"2023-11-28T12:07:41.169635+0000","last_became_active":"2023-11-28T12:07:41.164238+0000","last_became_peered":"2023-11-28T12:07:41.164238+0000","last_unstale":"2023-11-28T12:07:41.169635+0000","last_undegraded":"2023-11-28T12:07:41.169635+0000","last_fullsized":"2023-11-28T12:07:41.169635+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:28:49.540743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T12:07:40.140130+0000","last_change":"2023-11-28T12:06:23.903797+0000","last_active":"2023-11-28T12:07:40.140130+0000","last_peered":"2023-11-28T12:07:40.140130+0000","last_clean":"2023-11-28T12:07:40.140130+0000","last_became_active":"2023-11-28T12:06:23.903475+0000","last_became_peered":"2023-11-28T12:06:23.903475+0000","last_unstale":"2023-11-28T12:07:40.140130+0000","last_undegraded":"2023-11-28T12:07:40.140130+0000","last_fullsized":"2023-11-28T12:07:40.140130+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:51:06.844441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.156133+0000","last_change":"2023-11-28T12:07:41.156133+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.156133+0000","last_undegraded":"2023-11-28T12:07:41.156133+0000","last_fullsized":"2023-11-28T12:07:41.156133+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:00:21.039405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.162113+0000","last_change":"2023-11-28T12:07:41.160433+0000","last_active":"2023-11-28T12:07:41.162113+0000","last_peered":"2023-11-28T12:07:41.162113+0000","last_clean":"2023-11-28T12:07:41.162113+0000","last_became_active":"2023-11-28T12:07:41.156521+0000","last_became_peered":"2023-11-28T12:07:41.156521+0000","last_unstale":"2023-11-28T12:07:41.162113+0000","last_undegraded":"2023-11-28T12:07:41.162113+0000","last_fullsized":"2023-11-28T12:07:41.162113+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:13:06.059949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T12:07:40.139422+0000","last_change":"2023-11-28T12:06:23.903983+0000","last_active":"2023-11-28T12:07:40.139422+0000","last_peered":"2023-11-28T12:07:40.139422+0000","last_clean":"2023-11-28T12:07:40.139422+0000","last_became_active":"2023-11-28T12:06:23.903511+0000","last_became_peered":"2023-11-28T12:06:23.903511+0000","last_unstale":"2023-11-28T12:07:40.139422+0000","last_undegraded":"2023-11-28T12:07:40.139422+0000","last_fullsized":"2023-11-28T12:07:40.139422+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:31:13.187145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.146439+0000","last_change":"2023-11-28T12:07:41.146439+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.146439+0000","last_undegraded":"2023-11-28T12:07:41.146439+0000","last_fullsized":"2023-11-28T12:07:41.146439+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:04:15.307550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.166158+0000","last_change":"2023-11-28T12:07:41.162201+0000","last_active":"2023-11-28T12:07:41.166158+0000","last_peered":"2023-11-28T12:07:41.166158+0000","last_clean":"2023-11-28T12:07:41.166158+0000","last_became_active":"2023-11-28T12:07:41.159342+0000","last_became_peered":"2023-11-28T12:07:41.159342+0000","last_unstale":"2023-11-28T12:07:41.166158+0000","last_undegraded":"2023-11-28T12:07:41.166158+0000","last_fullsized":"2023-11-28T12:07:41.166158+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:02:12.148279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T12:07:40.140015+0000","last_change":"2023-11-28T12:06:23.517246+0000","last_active":"2023-11-28T12:07:40.140015+0000","last_peered":"2023-11-28T12:07:40.140015+0000","last_clean":"2023-11-28T12:07:40.140015+0000","last_became_active":"2023-11-28T12:06:23.516854+0000","last_became_peered":"2023-11-28T12:06:23.516854+0000","last_unstale":"2023-11-28T12:07:40.140015+0000","last_undegraded":"2023-11-28T12:07:40.140015+0000","last_fullsized":"2023-11-28T12:07:40.140015+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:51:06.844441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9388,"kb_used_data":932,"kb_used_omap":0,"kb_used_meta":8448,"kb_avail":94362452,"statfs":{"total":96636764160,"available":96627150848,"internally_reserved":0,"allocated":954368,"data_stored":736804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8650752},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":2.7469999999999999,"5min":2.7469999999999999,"15min":2.7469999999999999},"last":0.754}]},{"osd":1,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.65300000000000002}]},{"osd":2,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.819,"5min":1.819,"15min":1.819},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":0.67300000000000004}]},{"osd":3,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.71899999999999997}]},{"osd":4,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.376},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.77000000000000002}]},{"osd":5,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.69199999999999995}]},{"osd":6,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.74299999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8232,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363608,"statfs":{"total":96636764160,"available":96628334592,"internally_reserved":0,"allocated":360448,"data_stored":146436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.46700000000000003}]},{"osd":1,"last update":"Tue Nov 28 12:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.61899999999999999}]},{"osd":2,"last update":"Tue Nov 28 12:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.55200000000000005}]},{"osd":3,"last update":"Tue Nov 28 12:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.60599999999999998}]},{"osd":4,"last update":"Tue Nov 28 12:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.72899999999999998}]},{"osd":5,"last update":"Tue Nov 28 12:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.73899999999999999}]},{"osd":7,"last update":"Tue Nov 28 12:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.65100000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13408,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":12480,"kb_avail":94358432,"statfs":{"total":96636764160,"available":96623034368,"internally_reserved":0,"allocated":942080,"data_stored":730176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12779520},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.374}]},{"osd":2,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.52300000000000002}]},{"osd":3,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.45000000000000001}]},{"osd":4,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.7350000000000001,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.60499999999999998}]},{"osd":5,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.61799999999999999}]},{"osd":6,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.627}]},{"osd":7,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.752}]}]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12376,"kb_used_data":336,"kb_used_omap":0,"kb_used_meta":12032,"kb_avail":94359464,"statfs":{"total":96636764160,"available":96624091136,"internally_reserved":0,"allocated":344064,"data_stored":138447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12320768},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 12:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.47399999999999998}]},{"osd":2,"last update":"Tue Nov 28 12:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.499},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.52700000000000002}]},{"osd":3,"last update":"Tue Nov 28 12:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.57299999999999995}]},{"osd":4,"last update":"Tue Nov 28 12:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.9159999999999999,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.69999999999999996}]},{"osd":5,"last update":"Tue Nov 28 12:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.68200000000000005}]},{"osd":6,"last update":"Tue Nov 28 12:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.82999999999999996}]},{"osd":7,"last update":"Tue Nov 28 12:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.87}]}]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12252,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":11904,"kb_avail":94359588,"statfs":{"total":96636764160,"available":96624218112,"internally_reserved":0,"allocated":348160,"data_stored":139808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12189696},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.46700000000000003}]},{"osd":1,"last update":"Tue Nov 28 12:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.51100000000000001}]},{"osd":3,"last update":"Tue Nov 28 12:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.41099999999999998}]},{"osd":4,"last update":"Tue Nov 28 12:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.57699999999999996}]},{"osd":5,"last update":"Tue Nov 28 12:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.60399999999999998}]},{"osd":6,"last update":"Tue Nov 28 12:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.67700000000000005}]},{"osd":7,"last update":"Tue Nov 28 12:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.63300000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12376,"kb_used_data":336,"kb_used_omap":0,"kb_used_meta":12032,"kb_avail":94359464,"statfs":{"total":96636764160,"available":96624091136,"internally_reserved":0,"allocated":344064,"data_stored":138447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12320768},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.33500000000000002}]},{"osd":1,"last update":"Tue Nov 28 12:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.372},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.53500000000000003}]},{"osd":2,"last update":"Tue Nov 28 12:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.58499999999999996}]},{"osd":4,"last update":"Tue Nov 28 12:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.752},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.69799999999999995}]},{"osd":5,"last update":"Tue Nov 28 12:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.82399999999999995}]},{"osd":6,"last update":"Tue Nov 28 12:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.77900000000000003}]},{"osd":7,"last update":"Tue Nov 28 12:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.67100000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8348,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":8000,"kb_avail":94363492,"statfs":{"total":96636764160,"available":96628215808,"internally_reserved":0,"allocated":348160,"data_stored":139808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8192000},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.58199999999999996}]},{"osd":1,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.65500000000000003}]},{"osd":2,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.54500000000000004}]},{"osd":3,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.622}]},{"osd":5,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.50900000000000001}]},{"osd":6,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.60199999999999998}]},{"osd":7,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.66300000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8220,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363620,"statfs":{"total":96636764160,"available":96628346880,"internally_reserved":0,"allocated":348160,"data_stored":139808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.67400000000000004}]},{"osd":1,"last update":"Tue Nov 28 12:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.624}]},{"osd":2,"last update":"Tue Nov 28 12:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.65800000000000003}]},{"osd":3,"last update":"Tue Nov 28 12:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.71099999999999997}]},{"osd":4,"last update":"Tue Nov 28 12:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.79600000000000004}]},{"osd":6,"last update":"Tue Nov 28 12:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.75},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.81299999999999994}]},{"osd":7,"last update":"Tue Nov 28 12:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.84199999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T12:07:46.768 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T12:07:47.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.006+0000 7fa8b93ff700 1 Processor -- start 2023-11-28T12:07:47.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.007+0000 7fa8b93ff700 1 -- start start 2023-11-28T12:07:47.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.008+0000 7fa8b93ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa8b40d01b0 0x7fa8b40d0c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:47.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.008+0000 7fa8b93ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa8b40b20b0 0x7fa8b40d1160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:47.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.008+0000 7fa8b93ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8b40b0230 con 0x7fa8b40b29b0 2023-11-28T12:07:47.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.008+0000 7fa8b93ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8b415cec0 con 0x7fa8b40d01b0 2023-11-28T12:07:47.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.008+0000 7fa8b93ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b40b4570 con 0x7fa8b40b20b0 2023-11-28T12:07:47.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.008+0000 7fa8b2ffd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa8b40d01b0 0x7fa8b40d0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:47.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.008+0000 7fa8b2ffd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa8b40d01b0 0x7fa8b40d0c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34192/0 (socket says 172.21.15.45:34192) 2023-11-28T12:07:47.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.008+0000 7fa8b2ffd700 1 -- 172.21.15.45:0/2449778974 learned_addr learned my addr 172.21.15.45:0/2449778974 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:47.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.008+0000 7fa8b2ffd700 1 -- 172.21.15.45:0/2449778974 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa8b40b20b0 msgr2=0x7fa8b40d1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:47.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.008+0000 7fa8b27fc700 1 --2- 172.21.15.45:0/2449778974 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa8b40b20b0 0x7fa8b40d1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:47.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.009+0000 7fa8b2ffd700 1 --2- 172.21.15.45:0/2449778974 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa8b40b20b0 0x7fa8b40d1160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:47.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.009+0000 7fa8b2ffd700 1 -- 172.21.15.45:0/2449778974 >> v1:172.21.15.152:6789/0 conn(0x7fa8b40b29b0 legacy=0x7fa8b40b2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:47.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.009+0000 7fa8b2ffd700 1 -- 172.21.15.45:0/2449778974 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8b40b4850 con 0x7fa8b40d01b0 2023-11-28T12:07:47.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.009+0000 7fa8b27fc700 1 --2- 172.21.15.45:0/2449778974 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa8b40b20b0 0x7fa8b40d1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:07:47.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.009+0000 7fa8b2ffd700 1 --2- 172.21.15.45:0/2449778974 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8b40d01b0 0x7fa8b40d0c20 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fa8a40098f0 tx=0x7fa8a4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6039489720b5eb98 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:47.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.009+0000 7fa8b1ffb700 1 -- 172.21.15.45:0/2449778974 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a4004230 con 0x7fa8b40d01b0 2023-11-28T12:07:47.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.009+0000 7fa8b1ffb700 1 -- 172.21.15.45:0/2449778974 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8a4004390 con 0x7fa8b40d01b0 2023-11-28T12:07:47.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.009+0000 7fa8b1ffb700 1 -- 172.21.15.45:0/2449778974 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a40036a0 con 0x7fa8b40d01b0 2023-11-28T12:07:47.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.010+0000 7fa8b93ff700 1 -- 172.21.15.45:0/2449778974 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8b40d01b0 msgr2=0x7fa8b40d0c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:47.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.010+0000 7fa8b93ff700 1 --2- 172.21.15.45:0/2449778974 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8b40d01b0 0x7fa8b40d0c20 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fa8a40098f0 tx=0x7fa8a4009c00 comp rx=0 tx=0).stop 2023-11-28T12:07:47.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.010+0000 7fa8b93ff700 1 -- 172.21.15.45:0/2449778974 shutdown_connections 2023-11-28T12:07:47.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.010+0000 7fa8b93ff700 1 --2- 172.21.15.45:0/2449778974 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8b40d01b0 0x7fa8b40d0c20 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:47.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.010+0000 7fa8b93ff700 1 --2- 172.21.15.45:0/2449778974 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa8b40b20b0 0x7fa8b40d1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:47.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.010+0000 7fa8b93ff700 1 -- 172.21.15.45:0/2449778974 >> 172.21.15.45:0/2449778974 conn(0x7fa8b409c3f0 msgr2=0x7fa8b40d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:47.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.010+0000 7fa8b93ff700 1 -- 172.21.15.45:0/2449778974 shutdown_connections 2023-11-28T12:07:47.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.010+0000 7fa8b93ff700 1 -- 172.21.15.45:0/2449778974 wait complete. 2023-11-28T12:07:47.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.012+0000 7fa8b93ff700 1 Processor -- start 2023-11-28T12:07:47.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.012+0000 7fa8b93ff700 1 -- start start 2023-11-28T12:07:47.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.014+0000 7fa8b93ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa8b40b20b0 0x7fa8b40cbca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:47.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.014+0000 7fa8b93ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8b40b29b0 0x7fa8b40cc950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:47.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.014+0000 7fa8b93ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa8b40d01b0 0x7fa8b41f1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:47.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.014+0000 7fa8b93ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b40cce90 con 0x7fa8b40b29b0 2023-11-28T12:07:47.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.014+0000 7fa8b93ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b41f5720 con 0x7fa8b40d01b0 2023-11-28T12:07:47.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.014+0000 7fa8b93ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b41f59c0 con 0x7fa8b40b20b0 2023-11-28T12:07:47.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.014+0000 7fa8b27fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8b40b29b0 0x7fa8b40cc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:47.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.014+0000 7fa8b27fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8b40b29b0 0x7fa8b40cc950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34198/0 (socket says 172.21.15.45:34198) 2023-11-28T12:07:47.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.014+0000 7fa8b27fc700 1 -- 172.21.15.45:0/1431621422 learned_addr learned my addr 172.21.15.45:0/1431621422 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:47.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.014+0000 7fa8b2ffd700 1 --2- 172.21.15.45:0/1431621422 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa8b40b20b0 0x7fa8b40cbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:47.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.014+0000 7fa8b37fe700 1 --2- 172.21.15.45:0/1431621422 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa8b40d01b0 0x7fa8b41f1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:47.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.014+0000 7fa8b27fc700 1 -- 172.21.15.45:0/1431621422 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa8b40b20b0 msgr2=0x7fa8b40cbca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:47.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.014+0000 7fa8b27fc700 1 --2- 172.21.15.45:0/1431621422 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa8b40b20b0 0x7fa8b40cbca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:47.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.014+0000 7fa8b27fc700 1 -- 172.21.15.45:0/1431621422 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa8b40d01b0 msgr2=0x7fa8b41f1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:47.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.014+0000 7fa8b27fc700 1 --2- 172.21.15.45:0/1431621422 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa8b40d01b0 0x7fa8b41f1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:47.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.014+0000 7fa8b27fc700 1 -- 172.21.15.45:0/1431621422 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8a4009550 con 0x7fa8b40b29b0 2023-11-28T12:07:47.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.015+0000 7fa8b27fc700 1 --2- 172.21.15.45:0/1431621422 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8b40b29b0 0x7fa8b40cc950 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa8a800c750 tx=0x7fa8a800ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:47.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.015+0000 7fa89b7fe700 1 -- 172.21.15.45:0/1431621422 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a8011800 con 0x7fa8b40b29b0 2023-11-28T12:07:47.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.015+0000 7fa89b7fe700 1 -- 172.21.15.45:0/1431621422 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8a8011960 con 0x7fa8b40b29b0 2023-11-28T12:07:47.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.015+0000 7fa89b7fe700 1 -- 172.21.15.45:0/1431621422 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a8011cd0 con 0x7fa8b40b29b0 2023-11-28T12:07:47.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.015+0000 7fa8b93ff700 1 -- 172.21.15.45:0/1431621422 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8b40afec0 con 0x7fa8b40b29b0 2023-11-28T12:07:47.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.015+0000 7fa8b93ff700 1 -- 172.21.15.45:0/1431621422 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8b40afbe0 con 0x7fa8b40b29b0 2023-11-28T12:07:47.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.016+0000 7fa8b93ff700 1 -- 172.21.15.45:0/1431621422 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8b40b2600 con 0x7fa8b40b29b0 2023-11-28T12:07:47.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.017+0000 7fa89b7fe700 1 -- 172.21.15.45:0/1431621422 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fa8a8020070 con 0x7fa8b40b29b0 2023-11-28T12:07:47.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.018+0000 7fa89b7fe700 1 --2- 172.21.15.45:0/1431621422 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fa8a00682f0 0x7fa8a006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:47.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.018+0000 7fa89b7fe700 1 -- 172.21.15.45:0/1431621422 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa8a8085bb0 con 0x7fa8b40b29b0 2023-11-28T12:07:47.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.018+0000 7fa8b2ffd700 1 --2- 172.21.15.45:0/1431621422 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fa8a00682f0 0x7fa8a006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:47.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.019+0000 7fa8b2ffd700 1 --2- 172.21.15.45:0/1431621422 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fa8a00682f0 0x7fa8a006a7a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa8a4009130 tx=0x7fa8a4008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:47.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.022+0000 7fa89b7fe700 1 -- 172.21.15.45:0/1431621422 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fa8a8052320 con 0x7fa8b40b29b0 2023-11-28T12:07:47.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.220+0000 7fa8b93ff700 1 -- 172.21.15.45:0/1431621422 --> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa8b4068690 con 0x7fa8a00682f0 2023-11-28T12:07:47.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.230+0000 7fa89b7fe700 1 -- 172.21.15.45:0/1431621422 <== mgr.4100 v2:172.21.15.152:6832/115389 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+308405 (secure 0 0 0) 0x7fa8b4068690 con 0x7fa8a00682f0 2023-11-28T12:07:47.234 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:07:47.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.234+0000 7fa8b93ff700 1 -- 172.21.15.45:0/1431621422 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fa8a00682f0 msgr2=0x7fa8a006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:47.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.234+0000 7fa8b93ff700 1 --2- 172.21.15.45:0/1431621422 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fa8a00682f0 0x7fa8a006a7a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa8a4009130 tx=0x7fa8a4008030 comp rx=0 tx=0).stop 2023-11-28T12:07:47.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.234+0000 7fa8b93ff700 1 -- 172.21.15.45:0/1431621422 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8b40b29b0 msgr2=0x7fa8b40cc950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:47.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.234+0000 7fa8b93ff700 1 --2- 172.21.15.45:0/1431621422 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8b40b29b0 0x7fa8b40cc950 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa8a800c750 tx=0x7fa8a800ca60 comp rx=0 tx=0).stop 2023-11-28T12:07:47.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.234+0000 7fa8b93ff700 1 -- 172.21.15.45:0/1431621422 shutdown_connections 2023-11-28T12:07:47.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.234+0000 7fa8b93ff700 1 --2- 172.21.15.45:0/1431621422 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fa8a00682f0 0x7fa8a006a7a0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:47.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.234+0000 7fa8b93ff700 1 --2- 172.21.15.45:0/1431621422 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa8b40d01b0 0x7fa8b41f1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:47.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.234+0000 7fa8b93ff700 1 --2- 172.21.15.45:0/1431621422 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa8b40b20b0 0x7fa8b40cbca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:47.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.234+0000 7fa8b93ff700 1 --2- 172.21.15.45:0/1431621422 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8b40b29b0 0x7fa8b40cc950 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:47.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.234+0000 7fa8b93ff700 1 -- 172.21.15.45:0/1431621422 >> 172.21.15.45:0/1431621422 conn(0x7fa8b409c3f0 msgr2=0x7fa8b40d2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:47.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.234+0000 7fa8b93ff700 1 -- 172.21.15.45:0/1431621422 shutdown_connections 2023-11-28T12:07:47.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.234+0000 7fa8b93ff700 1 -- 172.21.15.45:0/1431621422 wait complete. 2023-11-28T12:07:47.237 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-11-28T12:07:47.253 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":70,"stamp":"2023-11-28T12:07:46.443621+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":42,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":84600,"kb_used_data":3896,"kb_used_omap":0,"kb_used_meta":80640,"kb_avail":754890120,"statfs":{"total":773094113280,"available":773007482880,"internally_reserved":0,"allocated":3989504,"data_stored":2309734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":82575360},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001259"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.149676+0000","last_change":"2023-11-28T12:07:41.149676+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.149676+0000","last_undegraded":"2023-11-28T12:07:41.149676+0000","last_fullsized":"2023-11-28T12:07:41.149676+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:29:27.513071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.150188+0000","last_change":"2023-11-28T12:07:41.150188+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.150188+0000","last_undegraded":"2023-11-28T12:07:41.150188+0000","last_fullsized":"2023-11-28T12:07:41.150188+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:46:48.928670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.150682+0000","last_change":"2023-11-28T12:07:41.150682+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.150682+0000","last_undegraded":"2023-11-28T12:07:41.150682+0000","last_fullsized":"2023-11-28T12:07:41.150682+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:46:48.928670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.151873+0000","last_change":"2023-11-28T12:07:41.151873+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.151873+0000","last_undegraded":"2023-11-28T12:07:41.151873+0000","last_fullsized":"2023-11-28T12:07:41.151873+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:28:50.548371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.146462+0000","last_change":"2023-11-28T12:07:41.146462+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.146462+0000","last_undegraded":"2023-11-28T12:07:41.146462+0000","last_fullsized":"2023-11-28T12:07:41.146462+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:50:22.991297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.155730+0000","last_change":"2023-11-28T12:07:41.155730+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.155730+0000","last_undegraded":"2023-11-28T12:07:41.155730+0000","last_fullsized":"2023-11-28T12:07:41.155730+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:10:52.015070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.151291+0000","last_change":"2023-11-28T12:07:41.151291+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.151291+0000","last_undegraded":"2023-11-28T12:07:41.151291+0000","last_fullsized":"2023-11-28T12:07:41.151291+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:22:57.069288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.149348+0000","last_change":"2023-11-28T12:07:41.149348+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.149348+0000","last_undegraded":"2023-11-28T12:07:41.149348+0000","last_fullsized":"2023-11-28T12:07:41.149348+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:36:26.400203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.151794+0000","last_change":"2023-11-28T12:07:41.151794+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.151794+0000","last_undegraded":"2023-11-28T12:07:41.151794+0000","last_fullsized":"2023-11-28T12:07:41.151794+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:21:44.583002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.160971+0000","last_change":"2023-11-28T12:07:41.160971+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.160971+0000","last_undegraded":"2023-11-28T12:07:41.160971+0000","last_fullsized":"2023-11-28T12:07:41.160971+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:46:48.928670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.154818+0000","last_change":"2023-11-28T12:07:41.154818+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.154818+0000","last_undegraded":"2023-11-28T12:07:41.154818+0000","last_fullsized":"2023-11-28T12:07:41.154818+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:32:42.598768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.147170+0000","last_change":"2023-11-28T12:07:41.147170+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.147170+0000","last_undegraded":"2023-11-28T12:07:41.147170+0000","last_fullsized":"2023-11-28T12:07:41.147170+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:37:01.124995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.158846+0000","last_change":"2023-11-28T12:07:41.158846+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.158846+0000","last_undegraded":"2023-11-28T12:07:41.158846+0000","last_fullsized":"2023-11-28T12:07:41.158846+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:37:01.124995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.153276+0000","last_change":"2023-11-28T12:07:41.153276+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.153276+0000","last_undegraded":"2023-11-28T12:07:41.153276+0000","last_fullsized":"2023-11-28T12:07:41.153276+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:53:09.125880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.158224+0000","last_change":"2023-11-28T12:07:41.158224+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.158224+0000","last_undegraded":"2023-11-28T12:07:41.158224+0000","last_fullsized":"2023-11-28T12:07:41.158224+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:04:15.307550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.152248+0000","last_change":"2023-11-28T12:07:41.152248+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.152248+0000","last_undegraded":"2023-11-28T12:07:41.152248+0000","last_fullsized":"2023-11-28T12:07:41.152248+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:19:36.237111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.152563+0000","last_change":"2023-11-28T12:07:41.152563+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.152563+0000","last_undegraded":"2023-11-28T12:07:41.152563+0000","last_fullsized":"2023-11-28T12:07:41.152563+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:37:01.124995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.147455+0000","last_change":"2023-11-28T12:07:41.147455+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.147455+0000","last_undegraded":"2023-11-28T12:07:41.147455+0000","last_fullsized":"2023-11-28T12:07:41.147455+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:50:22.991297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.148758+0000","last_change":"2023-11-28T12:07:41.148758+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.148758+0000","last_undegraded":"2023-11-28T12:07:41.148758+0000","last_fullsized":"2023-11-28T12:07:41.148758+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:10:52.015070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.149468+0000","last_change":"2023-11-28T12:07:41.149468+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.149468+0000","last_undegraded":"2023-11-28T12:07:41.149468+0000","last_fullsized":"2023-11-28T12:07:41.149468+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:50:53.505346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.154383+0000","last_change":"2023-11-28T12:07:41.154383+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.154383+0000","last_undegraded":"2023-11-28T12:07:41.154383+0000","last_fullsized":"2023-11-28T12:07:41.154383+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:51:19.561073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.155670+0000","last_change":"2023-11-28T12:07:41.155670+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.155670+0000","last_undegraded":"2023-11-28T12:07:41.155670+0000","last_fullsized":"2023-11-28T12:07:41.155670+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:48:09.410549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.149284+0000","last_change":"2023-11-28T12:07:41.149284+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.149284+0000","last_undegraded":"2023-11-28T12:07:41.149284+0000","last_fullsized":"2023-11-28T12:07:41.149284+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:36:32.514106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.146582+0000","last_change":"2023-11-28T12:07:41.146582+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.146582+0000","last_undegraded":"2023-11-28T12:07:41.146582+0000","last_fullsized":"2023-11-28T12:07:41.146582+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:02:13.155906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.150060+0000","last_change":"2023-11-28T12:07:41.150060+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.150060+0000","last_undegraded":"2023-11-28T12:07:41.150060+0000","last_fullsized":"2023-11-28T12:07:41.150060+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:17:46.712157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.158106+0000","last_change":"2023-11-28T12:07:41.158106+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.158106+0000","last_undegraded":"2023-11-28T12:07:41.158106+0000","last_fullsized":"2023-11-28T12:07:41.158106+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:07:05.409362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.147417+0000","last_change":"2023-11-28T12:07:41.147417+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.147417+0000","last_undegraded":"2023-11-28T12:07:41.147417+0000","last_fullsized":"2023-11-28T12:07:41.147417+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:46:35.658317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.154117+0000","last_change":"2023-11-28T12:07:41.154117+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.154117+0000","last_undegraded":"2023-11-28T12:07:41.154117+0000","last_fullsized":"2023-11-28T12:07:41.154117+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:19:36.237111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.149141+0000","last_change":"2023-11-28T12:07:41.149141+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.149141+0000","last_undegraded":"2023-11-28T12:07:41.149141+0000","last_fullsized":"2023-11-28T12:07:41.149141+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:02:13.155906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.148981+0000","last_change":"2023-11-28T12:07:41.148981+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.148981+0000","last_undegraded":"2023-11-28T12:07:41.148981+0000","last_fullsized":"2023-11-28T12:07:41.148981+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:55:26.362077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.147011+0000","last_change":"2023-11-28T12:07:41.147011+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.147011+0000","last_undegraded":"2023-11-28T12:07:41.147011+0000","last_fullsized":"2023-11-28T12:07:41.147011+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:04:15.307550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.155595+0000","last_change":"2023-11-28T12:07:41.155595+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.155595+0000","last_undegraded":"2023-11-28T12:07:41.155595+0000","last_fullsized":"2023-11-28T12:07:41.155595+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:28:50.548371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.150707+0000","last_change":"2023-11-28T12:07:41.150707+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.150707+0000","last_undegraded":"2023-11-28T12:07:41.150707+0000","last_fullsized":"2023-11-28T12:07:41.150707+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:22:57.069288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.168200+0000","last_change":"2023-11-28T12:07:41.165809+0000","last_active":"2023-11-28T12:07:41.168200+0000","last_peered":"2023-11-28T12:07:41.168200+0000","last_clean":"2023-11-28T12:07:41.168200+0000","last_became_active":"2023-11-28T12:07:41.163993+0000","last_became_peered":"2023-11-28T12:07:41.163993+0000","last_unstale":"2023-11-28T12:07:41.168200+0000","last_undegraded":"2023-11-28T12:07:41.168200+0000","last_fullsized":"2023-11-28T12:07:41.168200+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:48:59.983563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.160342+0000","last_change":"2023-11-28T12:07:41.160342+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.160342+0000","last_undegraded":"2023-11-28T12:07:41.160342+0000","last_fullsized":"2023-11-28T12:07:41.160342+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:21:19.797120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.168685+0000","last_change":"2023-11-28T12:07:41.167048+0000","last_active":"2023-11-28T12:07:41.168685+0000","last_peered":"2023-11-28T12:07:41.168685+0000","last_clean":"2023-11-28T12:07:41.168685+0000","last_became_active":"2023-11-28T12:07:41.166528+0000","last_became_peered":"2023-11-28T12:07:41.166528+0000","last_unstale":"2023-11-28T12:07:41.168685+0000","last_undegraded":"2023-11-28T12:07:41.168685+0000","last_fullsized":"2023-11-28T12:07:41.168685+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:03:41.008569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.152429+0000","last_change":"2023-11-28T12:07:41.152429+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.152429+0000","last_undegraded":"2023-11-28T12:07:41.152429+0000","last_fullsized":"2023-11-28T12:07:41.152429+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:42:14.979933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.170842+0000","last_change":"2023-11-28T12:07:41.169488+0000","last_active":"2023-11-28T12:07:41.170842+0000","last_peered":"2023-11-28T12:07:41.170842+0000","last_clean":"2023-11-28T12:07:41.170842+0000","last_became_active":"2023-11-28T12:07:41.169172+0000","last_became_peered":"2023-11-28T12:07:41.169172+0000","last_unstale":"2023-11-28T12:07:41.170842+0000","last_undegraded":"2023-11-28T12:07:41.170842+0000","last_fullsized":"2023-11-28T12:07:41.170842+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:36:37.411602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.149220+0000","last_change":"2023-11-28T12:07:41.149220+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.149220+0000","last_undegraded":"2023-11-28T12:07:41.149220+0000","last_fullsized":"2023-11-28T12:07:41.149220+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:21:09.502744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.168108+0000","last_change":"2023-11-28T12:07:41.163567+0000","last_active":"2023-11-28T12:07:41.168108+0000","last_peered":"2023-11-28T12:07:41.168108+0000","last_clean":"2023-11-28T12:07:41.168108+0000","last_became_active":"2023-11-28T12:07:41.162624+0000","last_became_peered":"2023-11-28T12:07:41.162624+0000","last_unstale":"2023-11-28T12:07:41.168108+0000","last_undegraded":"2023-11-28T12:07:41.168108+0000","last_fullsized":"2023-11-28T12:07:41.168108+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:19:35.229484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.146894+0000","last_change":"2023-11-28T12:07:41.146894+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.146894+0000","last_undegraded":"2023-11-28T12:07:41.146894+0000","last_fullsized":"2023-11-28T12:07:41.146894+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:51:19.561073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.172281+0000","last_change":"2023-11-28T12:07:41.170651+0000","last_active":"2023-11-28T12:07:41.172281+0000","last_peered":"2023-11-28T12:07:41.172281+0000","last_clean":"2023-11-28T12:07:41.172281+0000","last_became_active":"2023-11-28T12:07:41.170273+0000","last_became_peered":"2023-11-28T12:07:41.170273+0000","last_unstale":"2023-11-28T12:07:41.172281+0000","last_undegraded":"2023-11-28T12:07:41.172281+0000","last_fullsized":"2023-11-28T12:07:41.172281+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:01:45.697262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.155640+0000","last_change":"2023-11-28T12:07:41.155640+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.155640+0000","last_undegraded":"2023-11-28T12:07:41.155640+0000","last_fullsized":"2023-11-28T12:07:41.155640+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:40:24.727337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.171342+0000","last_change":"2023-11-28T12:07:41.168201+0000","last_active":"2023-11-28T12:07:41.171342+0000","last_peered":"2023-11-28T12:07:41.171342+0000","last_clean":"2023-11-28T12:07:41.171342+0000","last_became_active":"2023-11-28T12:07:41.166578+0000","last_became_peered":"2023-11-28T12:07:41.166578+0000","last_unstale":"2023-11-28T12:07:41.171342+0000","last_undegraded":"2023-11-28T12:07:41.171342+0000","last_fullsized":"2023-11-28T12:07:41.171342+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:28:20.315709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.155158+0000","last_change":"2023-11-28T12:07:41.155158+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.155158+0000","last_undegraded":"2023-11-28T12:07:41.155158+0000","last_fullsized":"2023-11-28T12:07:41.155158+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:36:26.400203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.169078+0000","last_change":"2023-11-28T12:07:41.167334+0000","last_active":"2023-11-28T12:07:41.169078+0000","last_peered":"2023-11-28T12:07:41.169078+0000","last_clean":"2023-11-28T12:07:41.169078+0000","last_became_active":"2023-11-28T12:07:41.166499+0000","last_became_peered":"2023-11-28T12:07:41.166499+0000","last_unstale":"2023-11-28T12:07:41.169078+0000","last_undegraded":"2023-11-28T12:07:41.169078+0000","last_fullsized":"2023-11-28T12:07:41.169078+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:28:20.315709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.149792+0000","last_change":"2023-11-28T12:07:41.149792+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.149792+0000","last_undegraded":"2023-11-28T12:07:41.149792+0000","last_fullsized":"2023-11-28T12:07:41.149792+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:15:46.212373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.168039+0000","last_change":"2023-11-28T12:07:41.163322+0000","last_active":"2023-11-28T12:07:41.168039+0000","last_peered":"2023-11-28T12:07:41.168039+0000","last_clean":"2023-11-28T12:07:41.168039+0000","last_became_active":"2023-11-28T12:07:41.161561+0000","last_became_peered":"2023-11-28T12:07:41.161561+0000","last_unstale":"2023-11-28T12:07:41.168039+0000","last_undegraded":"2023-11-28T12:07:41.168039+0000","last_fullsized":"2023-11-28T12:07:41.168039+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:07:04.401735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.151159+0000","last_change":"2023-11-28T12:07:41.151159+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.151159+0000","last_undegraded":"2023-11-28T12:07:41.151159+0000","last_fullsized":"2023-11-28T12:07:41.151159+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:03:42.016196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.171161+0000","last_change":"2023-11-28T12:07:41.170122+0000","last_active":"2023-11-28T12:07:41.171161+0000","last_peered":"2023-11-28T12:07:41.171161+0000","last_clean":"2023-11-28T12:07:41.171161+0000","last_became_active":"2023-11-28T12:07:41.168780+0000","last_became_peered":"2023-11-28T12:07:41.168780+0000","last_unstale":"2023-11-28T12:07:41.171161+0000","last_undegraded":"2023-11-28T12:07:41.171161+0000","last_fullsized":"2023-11-28T12:07:41.171161+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:10:51.007442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.149474+0000","last_change":"2023-11-28T12:07:41.149474+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.149474+0000","last_undegraded":"2023-11-28T12:07:41.149474+0000","last_fullsized":"2023-11-28T12:07:41.149474+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:51:19.561073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.171895+0000","last_change":"2023-11-28T12:07:41.168616+0000","last_active":"2023-11-28T12:07:41.171895+0000","last_peered":"2023-11-28T12:07:41.171895+0000","last_clean":"2023-11-28T12:07:41.171895+0000","last_became_active":"2023-11-28T12:07:41.168368+0000","last_became_peered":"2023-11-28T12:07:41.168368+0000","last_unstale":"2023-11-28T12:07:41.171895+0000","last_undegraded":"2023-11-28T12:07:41.171895+0000","last_fullsized":"2023-11-28T12:07:41.171895+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:43:58.515090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.152164+0000","last_change":"2023-11-28T12:07:41.152164+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.152164+0000","last_undegraded":"2023-11-28T12:07:41.152164+0000","last_fullsized":"2023-11-28T12:07:41.152164+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:40:24.727337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.171731+0000","last_change":"2023-11-28T12:07:41.168261+0000","last_active":"2023-11-28T12:07:41.171731+0000","last_peered":"2023-11-28T12:07:41.171731+0000","last_clean":"2023-11-28T12:07:41.171731+0000","last_became_active":"2023-11-28T12:07:41.167980+0000","last_became_peered":"2023-11-28T12:07:41.167980+0000","last_unstale":"2023-11-28T12:07:41.171731+0000","last_undegraded":"2023-11-28T12:07:41.171731+0000","last_fullsized":"2023-11-28T12:07:41.171731+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:46:34.650690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.151582+0000","last_change":"2023-11-28T12:07:41.151582+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.151582+0000","last_undegraded":"2023-11-28T12:07:41.151582+0000","last_fullsized":"2023-11-28T12:07:41.151582+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:46:48.928670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.167861+0000","last_change":"2023-11-28T12:07:41.164624+0000","last_active":"2023-11-28T12:07:41.167861+0000","last_peered":"2023-11-28T12:07:41.167861+0000","last_clean":"2023-11-28T12:07:41.167861+0000","last_became_active":"2023-11-28T12:07:41.164356+0000","last_became_peered":"2023-11-28T12:07:41.164356+0000","last_unstale":"2023-11-28T12:07:41.167861+0000","last_undegraded":"2023-11-28T12:07:41.167861+0000","last_fullsized":"2023-11-28T12:07:41.167861+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:02:12.148279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.145864+0000","last_change":"2023-11-28T12:07:41.145864+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.145864+0000","last_undegraded":"2023-11-28T12:07:41.145864+0000","last_fullsized":"2023-11-28T12:07:41.145864+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:32:42.598768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.162176+0000","last_change":"2023-11-28T12:07:41.159717+0000","last_active":"2023-11-28T12:07:41.162176+0000","last_peered":"2023-11-28T12:07:41.162176+0000","last_clean":"2023-11-28T12:07:41.162176+0000","last_became_active":"2023-11-28T12:07:41.159459+0000","last_became_peered":"2023-11-28T12:07:41.159459+0000","last_unstale":"2023-11-28T12:07:41.162176+0000","last_undegraded":"2023-11-28T12:07:41.162176+0000","last_fullsized":"2023-11-28T12:07:41.162176+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:03:41.008569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.146411+0000","last_change":"2023-11-28T12:07:41.146411+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.146411+0000","last_undegraded":"2023-11-28T12:07:41.146411+0000","last_fullsized":"2023-11-28T12:07:41.146411+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:36:32.514106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.169694+0000","last_change":"2023-11-28T12:07:41.168453+0000","last_active":"2023-11-28T12:07:41.169694+0000","last_peered":"2023-11-28T12:07:41.169694+0000","last_clean":"2023-11-28T12:07:41.169694+0000","last_became_active":"2023-11-28T12:07:41.168179+0000","last_became_peered":"2023-11-28T12:07:41.168179+0000","last_unstale":"2023-11-28T12:07:41.169694+0000","last_undegraded":"2023-11-28T12:07:41.169694+0000","last_fullsized":"2023-11-28T12:07:41.169694+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:43:58.515090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.148257+0000","last_change":"2023-11-28T12:07:41.148257+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.148257+0000","last_undegraded":"2023-11-28T12:07:41.148257+0000","last_fullsized":"2023-11-28T12:07:41.148257+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:32:42.598768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.161463+0000","last_change":"2023-11-28T12:07:41.157503+0000","last_active":"2023-11-28T12:07:41.161463+0000","last_peered":"2023-11-28T12:07:41.161463+0000","last_clean":"2023-11-28T12:07:41.161463+0000","last_became_active":"2023-11-28T12:07:41.156917+0000","last_became_peered":"2023-11-28T12:07:41.156917+0000","last_unstale":"2023-11-28T12:07:41.161463+0000","last_undegraded":"2023-11-28T12:07:41.161463+0000","last_fullsized":"2023-11-28T12:07:41.161463+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:21:58.563957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.148393+0000","last_change":"2023-11-28T12:07:41.148393+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.148393+0000","last_undegraded":"2023-11-28T12:07:41.148393+0000","last_fullsized":"2023-11-28T12:07:41.148393+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:21:44.583002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.171018+0000","last_change":"2023-11-28T12:07:41.166866+0000","last_active":"2023-11-28T12:07:41.171018+0000","last_peered":"2023-11-28T12:07:41.171018+0000","last_clean":"2023-11-28T12:07:41.171018+0000","last_became_active":"2023-11-28T12:07:41.166584+0000","last_became_peered":"2023-11-28T12:07:41.166584+0000","last_unstale":"2023-11-28T12:07:41.171018+0000","last_undegraded":"2023-11-28T12:07:41.171018+0000","last_fullsized":"2023-11-28T12:07:41.171018+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:43:58.515090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.147847+0000","last_change":"2023-11-28T12:07:41.147847+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.147847+0000","last_undegraded":"2023-11-28T12:07:41.147847+0000","last_fullsized":"2023-11-28T12:07:41.147847+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:48:09.410549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.172292+0000","last_change":"2023-11-28T12:07:41.171141+0000","last_active":"2023-11-28T12:07:41.172292+0000","last_peered":"2023-11-28T12:07:41.172292+0000","last_clean":"2023-11-28T12:07:41.172292+0000","last_became_active":"2023-11-28T12:07:41.170256+0000","last_became_peered":"2023-11-28T12:07:41.170256+0000","last_unstale":"2023-11-28T12:07:41.172292+0000","last_undegraded":"2023-11-28T12:07:41.172292+0000","last_fullsized":"2023-11-28T12:07:41.172292+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:17:45.704529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.160079+0000","last_change":"2023-11-28T12:07:41.160079+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.160079+0000","last_undegraded":"2023-11-28T12:07:41.160079+0000","last_fullsized":"2023-11-28T12:07:41.160079+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:21:44.583002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.174922+0000","last_change":"2023-11-28T12:07:41.171992+0000","last_active":"2023-11-28T12:07:41.174922+0000","last_peered":"2023-11-28T12:07:41.174922+0000","last_clean":"2023-11-28T12:07:41.174922+0000","last_became_active":"2023-11-28T12:07:41.171295+0000","last_became_peered":"2023-11-28T12:07:41.171295+0000","last_unstale":"2023-11-28T12:07:41.174922+0000","last_undegraded":"2023-11-28T12:07:41.174922+0000","last_fullsized":"2023-11-28T12:07:41.174922+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:22:56.061661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.151916+0000","last_change":"2023-11-28T12:07:41.151916+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.151916+0000","last_undegraded":"2023-11-28T12:07:41.151916+0000","last_fullsized":"2023-11-28T12:07:41.151916+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:29:27.513071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.167590+0000","last_change":"2023-11-28T12:07:41.166346+0000","last_active":"2023-11-28T12:07:41.167590+0000","last_peered":"2023-11-28T12:07:41.167590+0000","last_clean":"2023-11-28T12:07:41.167590+0000","last_became_active":"2023-11-28T12:07:41.165885+0000","last_became_peered":"2023-11-28T12:07:41.165885+0000","last_unstale":"2023-11-28T12:07:41.167590+0000","last_undegraded":"2023-11-28T12:07:41.167590+0000","last_fullsized":"2023-11-28T12:07:41.167590+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:21:58.563957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.147885+0000","last_change":"2023-11-28T12:07:41.147885+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.147885+0000","last_undegraded":"2023-11-28T12:07:41.147885+0000","last_fullsized":"2023-11-28T12:07:41.147885+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:55:26.362077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.169106+0000","last_change":"2023-11-28T12:07:41.167652+0000","last_active":"2023-11-28T12:07:41.169106+0000","last_peered":"2023-11-28T12:07:41.169106+0000","last_clean":"2023-11-28T12:07:41.169106+0000","last_became_active":"2023-11-28T12:07:41.166796+0000","last_became_peered":"2023-11-28T12:07:41.166796+0000","last_unstale":"2023-11-28T12:07:41.169106+0000","last_undegraded":"2023-11-28T12:07:41.169106+0000","last_fullsized":"2023-11-28T12:07:41.169106+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:01:45.697262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.149621+0000","last_change":"2023-11-28T12:07:41.149621+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.149621+0000","last_undegraded":"2023-11-28T12:07:41.149621+0000","last_fullsized":"2023-11-28T12:07:41.149621+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:02:08.714843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.164501+0000","last_change":"2023-11-28T12:07:41.160266+0000","last_active":"2023-11-28T12:07:41.164501+0000","last_peered":"2023-11-28T12:07:41.164501+0000","last_clean":"2023-11-28T12:07:41.164501+0000","last_became_active":"2023-11-28T12:07:41.160022+0000","last_became_peered":"2023-11-28T12:07:41.160022+0000","last_unstale":"2023-11-28T12:07:41.164501+0000","last_undegraded":"2023-11-28T12:07:41.164501+0000","last_fullsized":"2023-11-28T12:07:41.164501+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:16:20.525710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.145926+0000","last_change":"2023-11-28T12:07:41.145926+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.145926+0000","last_undegraded":"2023-11-28T12:07:41.145926+0000","last_fullsized":"2023-11-28T12:07:41.145926+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:38:08.530818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.166036+0000","last_change":"2023-11-28T12:07:41.163164+0000","last_active":"2023-11-28T12:07:41.166036+0000","last_peered":"2023-11-28T12:07:41.166036+0000","last_clean":"2023-11-28T12:07:41.166036+0000","last_became_active":"2023-11-28T12:07:41.162678+0000","last_became_peered":"2023-11-28T12:07:41.162678+0000","last_unstale":"2023-11-28T12:07:41.166036+0000","last_undegraded":"2023-11-28T12:07:41.166036+0000","last_fullsized":"2023-11-28T12:07:41.166036+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:39:04.670777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.157549+0000","last_change":"2023-11-28T12:07:41.157549+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.157549+0000","last_undegraded":"2023-11-28T12:07:41.157549+0000","last_fullsized":"2023-11-28T12:07:41.157549+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:38:08.530818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.170948+0000","last_change":"2023-11-28T12:07:41.166168+0000","last_active":"2023-11-28T12:07:41.170948+0000","last_peered":"2023-11-28T12:07:41.170948+0000","last_clean":"2023-11-28T12:07:41.170948+0000","last_became_active":"2023-11-28T12:07:41.164114+0000","last_became_peered":"2023-11-28T12:07:41.164114+0000","last_unstale":"2023-11-28T12:07:41.170948+0000","last_undegraded":"2023-11-28T12:07:41.170948+0000","last_fullsized":"2023-11-28T12:07:41.170948+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:01:45.697262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.146322+0000","last_change":"2023-11-28T12:07:41.146322+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.146322+0000","last_undegraded":"2023-11-28T12:07:41.146322+0000","last_fullsized":"2023-11-28T12:07:41.146322+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:53:09.125880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.165318+0000","last_change":"2023-11-28T12:07:41.162583+0000","last_active":"2023-11-28T12:07:41.165318+0000","last_peered":"2023-11-28T12:07:41.165318+0000","last_clean":"2023-11-28T12:07:41.165318+0000","last_became_active":"2023-11-28T12:07:41.161213+0000","last_became_peered":"2023-11-28T12:07:41.161213+0000","last_unstale":"2023-11-28T12:07:41.165318+0000","last_undegraded":"2023-11-28T12:07:41.165318+0000","last_fullsized":"2023-11-28T12:07:41.165318+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:48:59.983563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.153733+0000","last_change":"2023-11-28T12:07:41.153733+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.153733+0000","last_undegraded":"2023-11-28T12:07:41.153733+0000","last_fullsized":"2023-11-28T12:07:41.153733+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:15:46.212373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.160357+0000","last_change":"2023-11-28T12:07:41.154433+0000","last_active":"2023-11-28T12:07:41.160357+0000","last_peered":"2023-11-28T12:07:41.160357+0000","last_clean":"2023-11-28T12:07:41.160357+0000","last_became_active":"2023-11-28T12:07:41.154159+0000","last_became_peered":"2023-11-28T12:07:41.154159+0000","last_unstale":"2023-11-28T12:07:41.160357+0000","last_undegraded":"2023-11-28T12:07:41.160357+0000","last_fullsized":"2023-11-28T12:07:41.160357+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:04:14.299923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T12:07:40.145722+0000","last_change":"2023-11-28T12:06:23.961595+0000","last_active":"2023-11-28T12:07:40.145722+0000","last_peered":"2023-11-28T12:07:40.145722+0000","last_clean":"2023-11-28T12:07:40.145722+0000","last_became_active":"2023-11-28T12:06:23.961257+0000","last_became_peered":"2023-11-28T12:06:23.961257+0000","last_unstale":"2023-11-28T12:07:40.145722+0000","last_undegraded":"2023-11-28T12:07:40.145722+0000","last_fullsized":"2023-11-28T12:07:40.145722+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:30:40.200095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.147168+0000","last_change":"2023-11-28T12:07:41.147168+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.147168+0000","last_undegraded":"2023-11-28T12:07:41.147168+0000","last_fullsized":"2023-11-28T12:07:41.147168+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:40:24.727337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.167755+0000","last_change":"2023-11-28T12:07:41.164138+0000","last_active":"2023-11-28T12:07:41.167755+0000","last_peered":"2023-11-28T12:07:41.167755+0000","last_clean":"2023-11-28T12:07:41.167755+0000","last_became_active":"2023-11-28T12:07:41.162131+0000","last_became_peered":"2023-11-28T12:07:41.162131+0000","last_unstale":"2023-11-28T12:07:41.167755+0000","last_undegraded":"2023-11-28T12:07:41.167755+0000","last_fullsized":"2023-11-28T12:07:41.167755+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:28:49.540743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T12:07:40.143874+0000","last_change":"2023-11-28T12:06:23.517505+0000","last_active":"2023-11-28T12:07:40.143874+0000","last_peered":"2023-11-28T12:07:40.143874+0000","last_clean":"2023-11-28T12:07:40.143874+0000","last_became_active":"2023-11-28T12:06:23.517151+0000","last_became_peered":"2023-11-28T12:06:23.517151+0000","last_unstale":"2023-11-28T12:07:40.143874+0000","last_undegraded":"2023-11-28T12:07:40.143874+0000","last_fullsized":"2023-11-28T12:07:40.143874+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:30:40.200095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.156626+0000","last_change":"2023-11-28T12:07:41.156626+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.156626+0000","last_undegraded":"2023-11-28T12:07:41.156626+0000","last_fullsized":"2023-11-28T12:07:41.156626+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:47:04.900190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.171873+0000","last_change":"2023-11-28T12:07:41.169674+0000","last_active":"2023-11-28T12:07:41.171873+0000","last_peered":"2023-11-28T12:07:41.171873+0000","last_clean":"2023-11-28T12:07:41.171873+0000","last_became_active":"2023-11-28T12:07:41.169182+0000","last_became_peered":"2023-11-28T12:07:41.169182+0000","last_unstale":"2023-11-28T12:07:41.171873+0000","last_undegraded":"2023-11-28T12:07:41.171873+0000","last_fullsized":"2023-11-28T12:07:41.171873+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:28:20.315709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T12:07:40.145277+0000","last_change":"2023-11-28T12:06:23.517967+0000","last_active":"2023-11-28T12:07:40.145277+0000","last_peered":"2023-11-28T12:07:40.145277+0000","last_clean":"2023-11-28T12:07:40.145277+0000","last_became_active":"2023-11-28T12:06:23.517495+0000","last_became_peered":"2023-11-28T12:06:23.517495+0000","last_unstale":"2023-11-28T12:07:40.145277+0000","last_undegraded":"2023-11-28T12:07:40.145277+0000","last_fullsized":"2023-11-28T12:07:40.145277+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:51:06.844441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":172,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T12:07:40.143568+0000","last_change":"2023-11-28T12:06:23.513472+0000","last_active":"2023-11-28T12:07:40.143568+0000","last_peered":"2023-11-28T12:07:40.143568+0000","last_clean":"2023-11-28T12:07:40.143568+0000","last_became_active":"2023-11-28T12:06:23.513150+0000","last_became_peered":"2023-11-28T12:06:23.513150+0000","last_unstale":"2023-11-28T12:07:40.143568+0000","last_undegraded":"2023-11-28T12:07:40.143568+0000","last_fullsized":"2023-11-28T12:07:40.143568+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:34:18.653049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.147660+0000","last_change":"2023-11-28T12:07:41.147660+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.147660+0000","last_undegraded":"2023-11-28T12:07:41.147660+0000","last_fullsized":"2023-11-28T12:07:41.147660+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:38:08.530818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.169197+0000","last_change":"2023-11-28T12:07:41.167454+0000","last_active":"2023-11-28T12:07:41.169197+0000","last_peered":"2023-11-28T12:07:41.169197+0000","last_clean":"2023-11-28T12:07:41.169197+0000","last_became_active":"2023-11-28T12:07:41.166407+0000","last_became_peered":"2023-11-28T12:07:41.166407+0000","last_unstale":"2023-11-28T12:07:41.169197+0000","last_undegraded":"2023-11-28T12:07:41.169197+0000","last_fullsized":"2023-11-28T12:07:41.169197+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:04:29.977354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T12:07:40.144200+0000","last_change":"2023-11-28T12:06:23.903708+0000","last_active":"2023-11-28T12:07:40.144200+0000","last_peered":"2023-11-28T12:07:40.144200+0000","last_clean":"2023-11-28T12:07:40.144200+0000","last_became_active":"2023-11-28T12:06:23.903399+0000","last_became_peered":"2023-11-28T12:06:23.903399+0000","last_unstale":"2023-11-28T12:07:40.144200+0000","last_undegraded":"2023-11-28T12:07:40.144200+0000","last_fullsized":"2023-11-28T12:07:40.144200+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:31:13.187145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.155565+0000","last_change":"2023-11-28T12:07:41.155565+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.155565+0000","last_undegraded":"2023-11-28T12:07:41.155565+0000","last_fullsized":"2023-11-28T12:07:41.155565+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:36:32.514106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.171367+0000","last_change":"2023-11-28T12:07:41.167913+0000","last_active":"2023-11-28T12:07:41.171367+0000","last_peered":"2023-11-28T12:07:41.171367+0000","last_clean":"2023-11-28T12:07:41.171367+0000","last_became_active":"2023-11-28T12:07:41.167043+0000","last_became_peered":"2023-11-28T12:07:41.167043+0000","last_unstale":"2023-11-28T12:07:41.171367+0000","last_undegraded":"2023-11-28T12:07:41.171367+0000","last_fullsized":"2023-11-28T12:07:41.171367+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:46:34.650690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T12:07:40.143472+0000","last_change":"2023-11-28T12:06:23.903662+0000","last_active":"2023-11-28T12:07:40.143472+0000","last_peered":"2023-11-28T12:07:40.143472+0000","last_clean":"2023-11-28T12:07:40.143472+0000","last_became_active":"2023-11-28T12:06:23.903354+0000","last_became_peered":"2023-11-28T12:06:23.903354+0000","last_unstale":"2023-11-28T12:07:40.143472+0000","last_undegraded":"2023-11-28T12:07:40.143472+0000","last_fullsized":"2023-11-28T12:07:40.143472+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:02:07.694087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.145671+0000","last_change":"2023-11-28T12:07:41.145671+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.145671+0000","last_undegraded":"2023-11-28T12:07:41.145671+0000","last_fullsized":"2023-11-28T12:07:41.145671+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:42:14.979933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.169635+0000","last_change":"2023-11-28T12:07:41.165591+0000","last_active":"2023-11-28T12:07:41.169635+0000","last_peered":"2023-11-28T12:07:41.169635+0000","last_clean":"2023-11-28T12:07:41.169635+0000","last_became_active":"2023-11-28T12:07:41.164238+0000","last_became_peered":"2023-11-28T12:07:41.164238+0000","last_unstale":"2023-11-28T12:07:41.169635+0000","last_undegraded":"2023-11-28T12:07:41.169635+0000","last_fullsized":"2023-11-28T12:07:41.169635+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:28:49.540743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T12:07:40.140130+0000","last_change":"2023-11-28T12:06:23.903797+0000","last_active":"2023-11-28T12:07:40.140130+0000","last_peered":"2023-11-28T12:07:40.140130+0000","last_clean":"2023-11-28T12:07:40.140130+0000","last_became_active":"2023-11-28T12:06:23.903475+0000","last_became_peered":"2023-11-28T12:06:23.903475+0000","last_unstale":"2023-11-28T12:07:40.140130+0000","last_undegraded":"2023-11-28T12:07:40.140130+0000","last_fullsized":"2023-11-28T12:07:40.140130+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:51:06.844441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.156133+0000","last_change":"2023-11-28T12:07:41.156133+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.156133+0000","last_undegraded":"2023-11-28T12:07:41.156133+0000","last_fullsized":"2023-11-28T12:07:41.156133+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:00:21.039405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.162113+0000","last_change":"2023-11-28T12:07:41.160433+0000","last_active":"2023-11-28T12:07:41.162113+0000","last_peered":"2023-11-28T12:07:41.162113+0000","last_clean":"2023-11-28T12:07:41.162113+0000","last_became_active":"2023-11-28T12:07:41.156521+0000","last_became_peered":"2023-11-28T12:07:41.156521+0000","last_unstale":"2023-11-28T12:07:41.162113+0000","last_undegraded":"2023-11-28T12:07:41.162113+0000","last_fullsized":"2023-11-28T12:07:41.162113+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:13:06.059949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T12:07:40.139422+0000","last_change":"2023-11-28T12:06:23.903983+0000","last_active":"2023-11-28T12:07:40.139422+0000","last_peered":"2023-11-28T12:07:40.139422+0000","last_clean":"2023-11-28T12:07:40.139422+0000","last_became_active":"2023-11-28T12:06:23.903511+0000","last_became_peered":"2023-11-28T12:06:23.903511+0000","last_unstale":"2023-11-28T12:07:40.139422+0000","last_undegraded":"2023-11-28T12:07:40.139422+0000","last_fullsized":"2023-11-28T12:07:40.139422+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:31:13.187145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.146439+0000","last_change":"2023-11-28T12:07:41.146439+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.146439+0000","last_undegraded":"2023-11-28T12:07:41.146439+0000","last_fullsized":"2023-11-28T12:07:41.146439+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:04:15.307550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.166158+0000","last_change":"2023-11-28T12:07:41.162201+0000","last_active":"2023-11-28T12:07:41.166158+0000","last_peered":"2023-11-28T12:07:41.166158+0000","last_clean":"2023-11-28T12:07:41.166158+0000","last_became_active":"2023-11-28T12:07:41.159342+0000","last_became_peered":"2023-11-28T12:07:41.159342+0000","last_unstale":"2023-11-28T12:07:41.166158+0000","last_undegraded":"2023-11-28T12:07:41.166158+0000","last_fullsized":"2023-11-28T12:07:41.166158+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:02:12.148279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T12:07:40.140015+0000","last_change":"2023-11-28T12:06:23.517246+0000","last_active":"2023-11-28T12:07:40.140015+0000","last_peered":"2023-11-28T12:07:40.140015+0000","last_clean":"2023-11-28T12:07:40.140015+0000","last_became_active":"2023-11-28T12:06:23.516854+0000","last_became_peered":"2023-11-28T12:06:23.516854+0000","last_unstale":"2023-11-28T12:07:40.140015+0000","last_undegraded":"2023-11-28T12:07:40.140015+0000","last_fullsized":"2023-11-28T12:07:40.140015+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:51:06.844441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9388,"kb_used_data":932,"kb_used_omap":0,"kb_used_meta":8448,"kb_avail":94362452,"statfs":{"total":96636764160,"available":96627150848,"internally_reserved":0,"allocated":954368,"data_stored":736804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8650752},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":2.7469999999999999,"5min":2.7469999999999999,"15min":2.7469999999999999},"last":0.754}]},{"osd":1,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.65300000000000002}]},{"osd":2,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.819,"5min":1.819,"15min":1.819},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":0.67300000000000004}]},{"osd":3,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.71899999999999997}]},{"osd":4,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.376},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.77000000000000002}]},{"osd":5,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.69199999999999995}]},{"osd":6,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.74299999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8232,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363608,"statfs":{"total":96636764160,"available":96628334592,"internally_reserved":0,"allocated":360448,"data_stored":146436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.46700000000000003}]},{"osd":1,"last update":"Tue Nov 28 12:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.61899999999999999}]},{"osd":2,"last update":"Tue Nov 28 12:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.55200000000000005}]},{"osd":3,"last update":"Tue Nov 28 12:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.60599999999999998}]},{"osd":4,"last update":"Tue Nov 28 12:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.72899999999999998}]},{"osd":5,"last update":"Tue Nov 28 12:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.73899999999999999}]},{"osd":7,"last update":"Tue Nov 28 12:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.65100000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13408,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":12480,"kb_avail":94358432,"statfs":{"total":96636764160,"available":96623034368,"internally_reserved":0,"allocated":942080,"data_stored":730176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12779520},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.374}]},{"osd":2,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.52300000000000002}]},{"osd":3,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.45000000000000001}]},{"osd":4,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.7350000000000001,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.60499999999999998}]},{"osd":5,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.61799999999999999}]},{"osd":6,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.627}]},{"osd":7,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.752}]}]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12376,"kb_used_data":336,"kb_used_omap":0,"kb_used_meta":12032,"kb_avail":94359464,"statfs":{"total":96636764160,"available":96624091136,"internally_reserved":0,"allocated":344064,"data_stored":138447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12320768},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 12:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.47399999999999998}]},{"osd":2,"last update":"Tue Nov 28 12:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.499},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.52700000000000002}]},{"osd":3,"last update":"Tue Nov 28 12:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.57299999999999995}]},{"osd":4,"last update":"Tue Nov 28 12:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.9159999999999999,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.69999999999999996}]},{"osd":5,"last update":"Tue Nov 28 12:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.68200000000000005}]},{"osd":6,"last update":"Tue Nov 28 12:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.82999999999999996}]},{"osd":7,"last update":"Tue Nov 28 12:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.87}]}]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12252,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":11904,"kb_avail":94359588,"statfs":{"total":96636764160,"available":96624218112,"internally_reserved":0,"allocated":348160,"data_stored":139808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12189696},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.46700000000000003}]},{"osd":1,"last update":"Tue Nov 28 12:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.51100000000000001}]},{"osd":3,"last update":"Tue Nov 28 12:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.41099999999999998}]},{"osd":4,"last update":"Tue Nov 28 12:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.57699999999999996}]},{"osd":5,"last update":"Tue Nov 28 12:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.60399999999999998}]},{"osd":6,"last update":"Tue Nov 28 12:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.67700000000000005}]},{"osd":7,"last update":"Tue Nov 28 12:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.63300000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12376,"kb_used_data":336,"kb_used_omap":0,"kb_used_meta":12032,"kb_avail":94359464,"statfs":{"total":96636764160,"available":96624091136,"internally_reserved":0,"allocated":344064,"data_stored":138447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12320768},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.33500000000000002}]},{"osd":1,"last update":"Tue Nov 28 12:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.372},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.53500000000000003}]},{"osd":2,"last update":"Tue Nov 28 12:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.58499999999999996}]},{"osd":4,"last update":"Tue Nov 28 12:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.752},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.69799999999999995}]},{"osd":5,"last update":"Tue Nov 28 12:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.82399999999999995}]},{"osd":6,"last update":"Tue Nov 28 12:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.77900000000000003}]},{"osd":7,"last update":"Tue Nov 28 12:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.67100000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8348,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":8000,"kb_avail":94363492,"statfs":{"total":96636764160,"available":96628215808,"internally_reserved":0,"allocated":348160,"data_stored":139808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8192000},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.58199999999999996}]},{"osd":1,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.65500000000000003}]},{"osd":2,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.54500000000000004}]},{"osd":3,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.622}]},{"osd":5,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.50900000000000001}]},{"osd":6,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.60199999999999998}]},{"osd":7,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.66300000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8220,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363620,"statfs":{"total":96636764160,"available":96628346880,"internally_reserved":0,"allocated":348160,"data_stored":139808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.67400000000000004}]},{"osd":1,"last update":"Tue Nov 28 12:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.624}]},{"osd":2,"last update":"Tue Nov 28 12:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.65800000000000003}]},{"osd":3,"last update":"Tue Nov 28 12:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.71099999999999997}]},{"osd":4,"last update":"Tue Nov 28 12:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.79600000000000004}]},{"osd":6,"last update":"Tue Nov 28 12:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.75},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.81299999999999994}]},{"osd":7,"last update":"Tue Nov 28 12:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.84199999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T12:07:47.258 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3f is not active+clean 2023-11-28T12:07:47.258 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T12:07:41.149676+0000', 'last_change': '2023-11-28T12:07:41.149676+0000', 'last_active': '2023-11-28T12:07:41.135506+0000', 'last_peered': '2023-11-28T12:07:41.135506+0000', 'last_clean': '2023-11-28T12:07:41.135506+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T12:07:41.149676+0000', 'last_undegraded': '2023-11-28T12:07:41.149676+0000', 'last_fullsized': '2023-11-28T12:07:41.149676+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_clean_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T12:29:27.513071+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T12:07:47.258 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3e is not active+clean 2023-11-28T12:07:47.258 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T12:07:41.150188+0000', 'last_change': '2023-11-28T12:07:41.150188+0000', 'last_active': '2023-11-28T12:07:41.135506+0000', 'last_peered': '2023-11-28T12:07:41.135506+0000', 'last_clean': '2023-11-28T12:07:41.135506+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T12:07:41.150188+0000', 'last_undegraded': '2023-11-28T12:07:41.150188+0000', 'last_fullsized': '2023-11-28T12:07:41.150188+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_clean_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T22:46:48.928670+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T12:07:47.258 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3d is not active+clean 2023-11-28T12:07:47.258 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T12:07:41.150682+0000', 'last_change': '2023-11-28T12:07:41.150682+0000', 'last_active': '2023-11-28T12:07:41.135506+0000', 'last_peered': '2023-11-28T12:07:41.135506+0000', 'last_clean': '2023-11-28T12:07:41.135506+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T12:07:41.150682+0000', 'last_undegraded': '2023-11-28T12:07:41.150682+0000', 'last_fullsized': '2023-11-28T12:07:41.150682+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_clean_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T22:46:48.928670+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-28T12:07:47.259 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3c is not active+clean 2023-11-28T12:07:47.259 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T12:07:41.151873+0000', 'last_change': '2023-11-28T12:07:41.151873+0000', 'last_active': '2023-11-28T12:07:41.135506+0000', 'last_peered': '2023-11-28T12:07:41.135506+0000', 'last_clean': '2023-11-28T12:07:41.135506+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T12:07:41.151873+0000', 'last_undegraded': '2023-11-28T12:07:41.151873+0000', 'last_fullsized': '2023-11-28T12:07:41.151873+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_clean_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T21:28:50.548371+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-28T12:07:47.259 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3b is not active+clean 2023-11-28T12:07:47.259 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T12:07:41.146462+0000', 'last_change': '2023-11-28T12:07:41.146462+0000', 'last_active': '2023-11-28T12:07:41.135506+0000', 'last_peered': '2023-11-28T12:07:41.135506+0000', 'last_clean': '2023-11-28T12:07:41.135506+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T12:07:41.146462+0000', 'last_undegraded': '2023-11-28T12:07:41.146462+0000', 'last_fullsized': '2023-11-28T12:07:41.146462+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_clean_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T17:50:22.991297+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-28T12:07:47.259 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3a is not active+clean 2023-11-28T12:07:47.259 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T12:07:41.155730+0000', 'last_change': '2023-11-28T12:07:41.155730+0000', 'last_active': '2023-11-28T12:07:41.135506+0000', 'last_peered': '2023-11-28T12:07:41.135506+0000', 'last_clean': '2023-11-28T12:07:41.135506+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T12:07:41.155730+0000', 'last_undegraded': '2023-11-28T12:07:41.155730+0000', 'last_fullsized': '2023-11-28T12:07:41.155730+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_clean_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T23:10:52.015070+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-28T12:07:47.259 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.39 is not active+clean 2023-11-28T12:07:47.259 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T12:07:41.151291+0000', 'last_change': '2023-11-28T12:07:41.151291+0000', 'last_active': '2023-11-28T12:07:41.135506+0000', 'last_peered': '2023-11-28T12:07:41.135506+0000', 'last_clean': '2023-11-28T12:07:41.135506+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T12:07:41.151291+0000', 'last_undegraded': '2023-11-28T12:07:41.151291+0000', 'last_fullsized': '2023-11-28T12:07:41.151291+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_clean_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T15:22:57.069288+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-28T12:07:47.259 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.38 is not active+clean 2023-11-28T12:07:47.260 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T12:07:41.149348+0000', 'last_change': '2023-11-28T12:07:41.149348+0000', 'last_active': '2023-11-28T12:07:41.135506+0000', 'last_peered': '2023-11-28T12:07:41.135506+0000', 'last_clean': '2023-11-28T12:07:41.135506+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T12:07:41.149348+0000', 'last_undegraded': '2023-11-28T12:07:41.149348+0000', 'last_fullsized': '2023-11-28T12:07:41.149348+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_clean_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T15:36:26.400203+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T12:07:47.260 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.37 is not active+clean 2023-11-28T12:07:47.260 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T12:07:41.151794+0000', 'last_change': '2023-11-28T12:07:41.151794+0000', 'last_active': '2023-11-28T12:07:41.135506+0000', 'last_peered': '2023-11-28T12:07:41.135506+0000', 'last_clean': '2023-11-28T12:07:41.135506+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T12:07:41.151794+0000', 'last_undegraded': '2023-11-28T12:07:41.151794+0000', 'last_fullsized': '2023-11-28T12:07:41.151794+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_clean_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T13:21:44.583002+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-28T12:07:47.260 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.36 is not active+clean 2023-11-28T12:07:47.260 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T12:07:41.160971+0000', 'last_change': '2023-11-28T12:07:41.160971+0000', 'last_active': '2023-11-28T12:07:41.135506+0000', 'last_peered': '2023-11-28T12:07:41.135506+0000', 'last_clean': '2023-11-28T12:07:41.135506+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T12:07:41.160971+0000', 'last_undegraded': '2023-11-28T12:07:41.160971+0000', 'last_fullsized': '2023-11-28T12:07:41.160971+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_clean_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T22:46:48.928670+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-28T12:07:47.260 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.35 is not active+clean 2023-11-28T12:07:47.260 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T12:07:41.154818+0000', 'last_change': '2023-11-28T12:07:41.154818+0000', 'last_active': '2023-11-28T12:07:41.135506+0000', 'last_peered': '2023-11-28T12:07:41.135506+0000', 'last_clean': '2023-11-28T12:07:41.135506+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T12:07:41.154818+0000', 'last_undegraded': '2023-11-28T12:07:41.154818+0000', 'last_fullsized': '2023-11-28T12:07:41.154818+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_clean_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T23:32:42.598768+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-28T12:07:47.260 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.34 is not active+clean 2023-11-28T12:07:47.260 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T12:07:41.147170+0000', 'last_change': '2023-11-28T12:07:41.147170+0000', 'last_active': '2023-11-28T12:07:41.135506+0000', 'last_peered': '2023-11-28T12:07:41.135506+0000', 'last_clean': '2023-11-28T12:07:41.135506+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T12:07:41.147170+0000', 'last_undegraded': '2023-11-28T12:07:41.147170+0000', 'last_fullsized': '2023-11-28T12:07:41.147170+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_clean_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T12:37:01.124995+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-28T12:07:47.260 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.33 is not active+clean 2023-11-28T12:07:47.261 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T12:07:41.158846+0000', 'last_change': '2023-11-28T12:07:41.158846+0000', 'last_active': '2023-11-28T12:07:41.135506+0000', 'last_peered': '2023-11-28T12:07:41.135506+0000', 'last_clean': '2023-11-28T12:07:41.135506+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T12:07:41.158846+0000', 'last_undegraded': '2023-11-28T12:07:41.158846+0000', 'last_fullsized': '2023-11-28T12:07:41.158846+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_clean_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T12:37:01.124995+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-28T12:07:47.261 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.32 is not active+clean 2023-11-28T12:07:47.261 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T12:07:41.153276+0000', 'last_change': '2023-11-28T12:07:41.153276+0000', 'last_active': '2023-11-28T12:07:41.135506+0000', 'last_peered': '2023-11-28T12:07:41.135506+0000', 'last_clean': '2023-11-28T12:07:41.135506+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T12:07:41.153276+0000', 'last_undegraded': '2023-11-28T12:07:41.153276+0000', 'last_fullsized': '2023-11-28T12:07:41.153276+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_clean_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T12:53:09.125880+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T12:07:47.261 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.31 is not active+clean 2023-11-28T12:07:47.261 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T12:07:41.158224+0000', 'last_change': '2023-11-28T12:07:41.158224+0000', 'last_active': '2023-11-28T12:07:41.135506+0000', 'last_peered': '2023-11-28T12:07:41.135506+0000', 'last_clean': '2023-11-28T12:07:41.135506+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T12:07:41.158224+0000', 'last_undegraded': '2023-11-28T12:07:41.158224+0000', 'last_fullsized': '2023-11-28T12:07:41.158224+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_clean_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T14:04:15.307550+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-28T12:07:47.261 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.30 is not active+clean 2023-11-28T12:07:47.261 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T12:07:41.152248+0000', 'last_change': '2023-11-28T12:07:41.152248+0000', 'last_active': '2023-11-28T12:07:41.135506+0000', 'last_peered': '2023-11-28T12:07:41.135506+0000', 'last_clean': '2023-11-28T12:07:41.135506+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T12:07:41.152248+0000', 'last_undegraded': '2023-11-28T12:07:41.152248+0000', 'last_fullsized': '2023-11-28T12:07:41.152248+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_clean_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T23:19:36.237111+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T12:07:47.261 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2f is not active+clean 2023-11-28T12:07:47.261 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T12:07:41.152563+0000', 'last_change': '2023-11-28T12:07:41.152563+0000', 'last_active': '2023-11-28T12:07:41.135506+0000', 'last_peered': '2023-11-28T12:07:41.135506+0000', 'last_clean': '2023-11-28T12:07:41.135506+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T12:07:41.152563+0000', 'last_undegraded': '2023-11-28T12:07:41.152563+0000', 'last_fullsized': '2023-11-28T12:07:41.152563+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_clean_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T12:37:01.124995+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T12:07:47.262 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2e is not active+clean 2023-11-28T12:07:47.262 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T12:07:41.147455+0000', 'last_change': '2023-11-28T12:07:41.147455+0000', 'last_active': '2023-11-28T12:07:41.135506+0000', 'last_peered': '2023-11-28T12:07:41.135506+0000', 'last_clean': '2023-11-28T12:07:41.135506+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T12:07:41.147455+0000', 'last_undegraded': '2023-11-28T12:07:41.147455+0000', 'last_fullsized': '2023-11-28T12:07:41.147455+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_clean_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T17:50:22.991297+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-28T12:07:47.262 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2d is not active+clean 2023-11-28T12:07:47.262 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T12:07:41.148758+0000', 'last_change': '2023-11-28T12:07:41.148758+0000', 'last_active': '2023-11-28T12:07:41.135506+0000', 'last_peered': '2023-11-28T12:07:41.135506+0000', 'last_clean': '2023-11-28T12:07:41.135506+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T12:07:41.148758+0000', 'last_undegraded': '2023-11-28T12:07:41.148758+0000', 'last_fullsized': '2023-11-28T12:07:41.148758+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_clean_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T23:10:52.015070+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-28T12:07:47.262 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2c is not active+clean 2023-11-28T12:07:47.262 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T12:07:41.149468+0000', 'last_change': '2023-11-28T12:07:41.149468+0000', 'last_active': '2023-11-28T12:07:41.135506+0000', 'last_peered': '2023-11-28T12:07:41.135506+0000', 'last_clean': '2023-11-28T12:07:41.135506+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T12:07:41.149468+0000', 'last_undegraded': '2023-11-28T12:07:41.149468+0000', 'last_fullsized': '2023-11-28T12:07:41.149468+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_clean_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T16:50:53.505346+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-28T12:07:47.262 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2b is not active+clean 2023-11-28T12:07:47.262 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T12:07:41.154383+0000', 'last_change': '2023-11-28T12:07:41.154383+0000', 'last_active': '2023-11-28T12:07:41.135506+0000', 'last_peered': '2023-11-28T12:07:41.135506+0000', 'last_clean': '2023-11-28T12:07:41.135506+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T12:07:41.154383+0000', 'last_undegraded': '2023-11-28T12:07:41.154383+0000', 'last_fullsized': '2023-11-28T12:07:41.154383+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_clean_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T19:51:19.561073+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-28T12:07:47.262 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2a is not active+clean 2023-11-28T12:07:47.263 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T12:07:41.155670+0000', 'last_change': '2023-11-28T12:07:41.155670+0000', 'last_active': '2023-11-28T12:07:41.135506+0000', 'last_peered': '2023-11-28T12:07:41.135506+0000', 'last_clean': '2023-11-28T12:07:41.135506+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T12:07:41.155670+0000', 'last_undegraded': '2023-11-28T12:07:41.155670+0000', 'last_fullsized': '2023-11-28T12:07:41.155670+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_clean_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T17:48:09.410549+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T12:07:47.263 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.29 is not active+clean 2023-11-28T12:07:47.263 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T12:07:41.149284+0000', 'last_change': '2023-11-28T12:07:41.149284+0000', 'last_active': '2023-11-28T12:07:41.135506+0000', 'last_peered': '2023-11-28T12:07:41.135506+0000', 'last_clean': '2023-11-28T12:07:41.135506+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T12:07:41.149284+0000', 'last_undegraded': '2023-11-28T12:07:41.149284+0000', 'last_fullsized': '2023-11-28T12:07:41.149284+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_clean_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T12:36:32.514106+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T12:07:47.263 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.28 is not active+clean 2023-11-28T12:07:47.263 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T12:07:41.146582+0000', 'last_change': '2023-11-28T12:07:41.146582+0000', 'last_active': '2023-11-28T12:07:41.135506+0000', 'last_peered': '2023-11-28T12:07:41.135506+0000', 'last_clean': '2023-11-28T12:07:41.135506+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T12:07:41.146582+0000', 'last_undegraded': '2023-11-28T12:07:41.146582+0000', 'last_fullsized': '2023-11-28T12:07:41.146582+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_clean_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T16:02:13.155906+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-28T12:07:47.263 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.27 is not active+clean 2023-11-28T12:07:47.263 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T12:07:41.150060+0000', 'last_change': '2023-11-28T12:07:41.150060+0000', 'last_active': '2023-11-28T12:07:41.135506+0000', 'last_peered': '2023-11-28T12:07:41.135506+0000', 'last_clean': '2023-11-28T12:07:41.135506+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T12:07:41.150060+0000', 'last_undegraded': '2023-11-28T12:07:41.150060+0000', 'last_fullsized': '2023-11-28T12:07:41.150060+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_clean_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T23:17:46.712157+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-28T12:07:47.263 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.26 is not active+clean 2023-11-28T12:07:47.263 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T12:07:41.158106+0000', 'last_change': '2023-11-28T12:07:41.158106+0000', 'last_active': '2023-11-28T12:07:41.135506+0000', 'last_peered': '2023-11-28T12:07:41.135506+0000', 'last_clean': '2023-11-28T12:07:41.135506+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T12:07:41.158106+0000', 'last_undegraded': '2023-11-28T12:07:41.158106+0000', 'last_fullsized': '2023-11-28T12:07:41.158106+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_clean_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T21:07:05.409362+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-28T12:07:47.264 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.25 is not active+clean 2023-11-28T12:07:47.264 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T12:07:41.147417+0000', 'last_change': '2023-11-28T12:07:41.147417+0000', 'last_active': '2023-11-28T12:07:41.135506+0000', 'last_peered': '2023-11-28T12:07:41.135506+0000', 'last_clean': '2023-11-28T12:07:41.135506+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T12:07:41.147417+0000', 'last_undegraded': '2023-11-28T12:07:41.147417+0000', 'last_fullsized': '2023-11-28T12:07:41.147417+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_clean_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T20:46:35.658317+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-28T12:07:47.264 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.24 is not active+clean 2023-11-28T12:07:47.264 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T12:07:41.154117+0000', 'last_change': '2023-11-28T12:07:41.154117+0000', 'last_active': '2023-11-28T12:07:41.135506+0000', 'last_peered': '2023-11-28T12:07:41.135506+0000', 'last_clean': '2023-11-28T12:07:41.135506+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T12:07:41.154117+0000', 'last_undegraded': '2023-11-28T12:07:41.154117+0000', 'last_fullsized': '2023-11-28T12:07:41.154117+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_clean_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T23:19:36.237111+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-28T12:07:47.264 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.23 is not active+clean 2023-11-28T12:07:47.264 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T12:07:41.149141+0000', 'last_change': '2023-11-28T12:07:41.149141+0000', 'last_active': '2023-11-28T12:07:41.135506+0000', 'last_peered': '2023-11-28T12:07:41.135506+0000', 'last_clean': '2023-11-28T12:07:41.135506+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T12:07:41.149141+0000', 'last_undegraded': '2023-11-28T12:07:41.149141+0000', 'last_fullsized': '2023-11-28T12:07:41.149141+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_clean_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T16:02:13.155906+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-28T12:07:47.264 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.22 is not active+clean 2023-11-28T12:07:47.264 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T12:07:41.148981+0000', 'last_change': '2023-11-28T12:07:41.148981+0000', 'last_active': '2023-11-28T12:07:41.135506+0000', 'last_peered': '2023-11-28T12:07:41.135506+0000', 'last_clean': '2023-11-28T12:07:41.135506+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T12:07:41.148981+0000', 'last_undegraded': '2023-11-28T12:07:41.148981+0000', 'last_fullsized': '2023-11-28T12:07:41.148981+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_clean_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T20:55:26.362077+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-28T12:07:47.264 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.21 is not active+clean 2023-11-28T12:07:47.264 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T12:07:41.147011+0000', 'last_change': '2023-11-28T12:07:41.147011+0000', 'last_active': '2023-11-28T12:07:41.135506+0000', 'last_peered': '2023-11-28T12:07:41.135506+0000', 'last_clean': '2023-11-28T12:07:41.135506+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T12:07:41.147011+0000', 'last_undegraded': '2023-11-28T12:07:41.147011+0000', 'last_fullsized': '2023-11-28T12:07:41.147011+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_clean_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T14:04:15.307550+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T12:07:47.265 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.20 is not active+clean 2023-11-28T12:07:47.265 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T12:07:41.155595+0000', 'last_change': '2023-11-28T12:07:41.155595+0000', 'last_active': '2023-11-28T12:07:41.135506+0000', 'last_peered': '2023-11-28T12:07:41.135506+0000', 'last_clean': '2023-11-28T12:07:41.135506+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T12:07:41.155595+0000', 'last_undegraded': '2023-11-28T12:07:41.155595+0000', 'last_fullsized': '2023-11-28T12:07:41.155595+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_clean_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T21:28:50.548371+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-28T12:07:47.265 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1c is not active+clean 2023-11-28T12:07:47.265 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T12:07:41.150707+0000', 'last_change': '2023-11-28T12:07:41.150707+0000', 'last_active': '2023-11-28T12:07:41.135506+0000', 'last_peered': '2023-11-28T12:07:41.135506+0000', 'last_clean': '2023-11-28T12:07:41.135506+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T12:07:41.150707+0000', 'last_undegraded': '2023-11-28T12:07:41.150707+0000', 'last_fullsized': '2023-11-28T12:07:41.150707+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_clean_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T15:22:57.069288+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T12:07:47.265 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1d is not active+clean 2023-11-28T12:07:47.265 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T12:07:41.160342+0000', 'last_change': '2023-11-28T12:07:41.160342+0000', 'last_active': '2023-11-28T12:07:41.135506+0000', 'last_peered': '2023-11-28T12:07:41.135506+0000', 'last_clean': '2023-11-28T12:07:41.135506+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T12:07:41.160342+0000', 'last_undegraded': '2023-11-28T12:07:41.160342+0000', 'last_fullsized': '2023-11-28T12:07:41.160342+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_clean_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T23:21:19.797120+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-28T12:07:47.265 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1e is not active+clean 2023-11-28T12:07:47.265 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T12:07:41.152429+0000', 'last_change': '2023-11-28T12:07:41.152429+0000', 'last_active': '2023-11-28T12:07:41.135506+0000', 'last_peered': '2023-11-28T12:07:41.135506+0000', 'last_clean': '2023-11-28T12:07:41.135506+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T12:07:41.152429+0000', 'last_undegraded': '2023-11-28T12:07:41.152429+0000', 'last_fullsized': '2023-11-28T12:07:41.152429+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_clean_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T23:42:14.979933+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T12:07:47.265 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1f is not active+clean 2023-11-28T12:07:47.266 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T12:07:41.149220+0000', 'last_change': '2023-11-28T12:07:41.149220+0000', 'last_active': '2023-11-28T12:07:41.135506+0000', 'last_peered': '2023-11-28T12:07:41.135506+0000', 'last_clean': '2023-11-28T12:07:41.135506+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T12:07:41.149220+0000', 'last_undegraded': '2023-11-28T12:07:41.149220+0000', 'last_fullsized': '2023-11-28T12:07:41.149220+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_clean_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T20:21:09.502744+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T12:07:47.266 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.18 is not active+clean 2023-11-28T12:07:47.266 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T12:07:41.146894+0000', 'last_change': '2023-11-28T12:07:41.146894+0000', 'last_active': '2023-11-28T12:07:41.135506+0000', 'last_peered': '2023-11-28T12:07:41.135506+0000', 'last_clean': '2023-11-28T12:07:41.135506+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T12:07:41.146894+0000', 'last_undegraded': '2023-11-28T12:07:41.146894+0000', 'last_fullsized': '2023-11-28T12:07:41.146894+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_clean_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T19:51:19.561073+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-28T12:07:47.266 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.19 is not active+clean 2023-11-28T12:07:47.266 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T12:07:41.155640+0000', 'last_change': '2023-11-28T12:07:41.155640+0000', 'last_active': '2023-11-28T12:07:41.135506+0000', 'last_peered': '2023-11-28T12:07:41.135506+0000', 'last_clean': '2023-11-28T12:07:41.135506+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T12:07:41.155640+0000', 'last_undegraded': '2023-11-28T12:07:41.155640+0000', 'last_fullsized': '2023-11-28T12:07:41.155640+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_clean_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T20:40:24.727337+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-28T12:07:47.266 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1a is not active+clean 2023-11-28T12:07:47.266 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T12:07:41.155158+0000', 'last_change': '2023-11-28T12:07:41.155158+0000', 'last_active': '2023-11-28T12:07:41.135506+0000', 'last_peered': '2023-11-28T12:07:41.135506+0000', 'last_clean': '2023-11-28T12:07:41.135506+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T12:07:41.155158+0000', 'last_undegraded': '2023-11-28T12:07:41.155158+0000', 'last_fullsized': '2023-11-28T12:07:41.155158+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_clean_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T15:36:26.400203+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T12:07:47.266 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1b is not active+clean 2023-11-28T12:07:47.266 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T12:07:41.149792+0000', 'last_change': '2023-11-28T12:07:41.149792+0000', 'last_active': '2023-11-28T12:07:41.135506+0000', 'last_peered': '2023-11-28T12:07:41.135506+0000', 'last_clean': '2023-11-28T12:07:41.135506+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T12:07:41.149792+0000', 'last_undegraded': '2023-11-28T12:07:41.149792+0000', 'last_fullsized': '2023-11-28T12:07:41.149792+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_clean_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T14:15:46.212373+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T12:07:47.267 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.14 is not active+clean 2023-11-28T12:07:47.267 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T12:07:41.151159+0000', 'last_change': '2023-11-28T12:07:41.151159+0000', 'last_active': '2023-11-28T12:07:41.135506+0000', 'last_peered': '2023-11-28T12:07:41.135506+0000', 'last_clean': '2023-11-28T12:07:41.135506+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T12:07:41.151159+0000', 'last_undegraded': '2023-11-28T12:07:41.151159+0000', 'last_fullsized': '2023-11-28T12:07:41.151159+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_clean_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T16:03:42.016196+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-28T12:07:47.267 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.15 is not active+clean 2023-11-28T12:07:47.267 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T12:07:41.149474+0000', 'last_change': '2023-11-28T12:07:41.149474+0000', 'last_active': '2023-11-28T12:07:41.135506+0000', 'last_peered': '2023-11-28T12:07:41.135506+0000', 'last_clean': '2023-11-28T12:07:41.135506+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T12:07:41.149474+0000', 'last_undegraded': '2023-11-28T12:07:41.149474+0000', 'last_fullsized': '2023-11-28T12:07:41.149474+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_clean_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T19:51:19.561073+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T12:07:47.267 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.16 is not active+clean 2023-11-28T12:07:47.267 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T12:07:41.152164+0000', 'last_change': '2023-11-28T12:07:41.152164+0000', 'last_active': '2023-11-28T12:07:41.135506+0000', 'last_peered': '2023-11-28T12:07:41.135506+0000', 'last_clean': '2023-11-28T12:07:41.135506+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T12:07:41.152164+0000', 'last_undegraded': '2023-11-28T12:07:41.152164+0000', 'last_fullsized': '2023-11-28T12:07:41.152164+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_clean_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T20:40:24.727337+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-28T12:07:47.267 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.17 is not active+clean 2023-11-28T12:07:47.267 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T12:07:41.151582+0000', 'last_change': '2023-11-28T12:07:41.151582+0000', 'last_active': '2023-11-28T12:07:41.135506+0000', 'last_peered': '2023-11-28T12:07:41.135506+0000', 'last_clean': '2023-11-28T12:07:41.135506+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T12:07:41.151582+0000', 'last_undegraded': '2023-11-28T12:07:41.151582+0000', 'last_fullsized': '2023-11-28T12:07:41.151582+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_clean_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T22:46:48.928670+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T12:07:47.267 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.10 is not active+clean 2023-11-28T12:07:47.267 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T12:07:41.145864+0000', 'last_change': '2023-11-28T12:07:41.145864+0000', 'last_active': '2023-11-28T12:07:41.135506+0000', 'last_peered': '2023-11-28T12:07:41.135506+0000', 'last_clean': '2023-11-28T12:07:41.135506+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T12:07:41.145864+0000', 'last_undegraded': '2023-11-28T12:07:41.145864+0000', 'last_fullsized': '2023-11-28T12:07:41.145864+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_clean_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T23:32:42.598768+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-28T12:07:47.268 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.11 is not active+clean 2023-11-28T12:07:47.268 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T12:07:41.146411+0000', 'last_change': '2023-11-28T12:07:41.146411+0000', 'last_active': '2023-11-28T12:07:41.135506+0000', 'last_peered': '2023-11-28T12:07:41.135506+0000', 'last_clean': '2023-11-28T12:07:41.135506+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T12:07:41.146411+0000', 'last_undegraded': '2023-11-28T12:07:41.146411+0000', 'last_fullsized': '2023-11-28T12:07:41.146411+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_clean_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T12:36:32.514106+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T12:07:47.268 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.12 is not active+clean 2023-11-28T12:07:47.268 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T12:07:41.148257+0000', 'last_change': '2023-11-28T12:07:41.148257+0000', 'last_active': '2023-11-28T12:07:41.135506+0000', 'last_peered': '2023-11-28T12:07:41.135506+0000', 'last_clean': '2023-11-28T12:07:41.135506+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T12:07:41.148257+0000', 'last_undegraded': '2023-11-28T12:07:41.148257+0000', 'last_fullsized': '2023-11-28T12:07:41.148257+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_clean_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T23:32:42.598768+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T12:07:47.268 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.13 is not active+clean 2023-11-28T12:07:47.268 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T12:07:41.148393+0000', 'last_change': '2023-11-28T12:07:41.148393+0000', 'last_active': '2023-11-28T12:07:41.135506+0000', 'last_peered': '2023-11-28T12:07:41.135506+0000', 'last_clean': '2023-11-28T12:07:41.135506+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T12:07:41.148393+0000', 'last_undegraded': '2023-11-28T12:07:41.148393+0000', 'last_fullsized': '2023-11-28T12:07:41.148393+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_clean_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T13:21:44.583002+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T12:07:47.268 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.c is not active+clean 2023-11-28T12:07:47.268 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T12:07:41.147847+0000', 'last_change': '2023-11-28T12:07:41.147847+0000', 'last_active': '2023-11-28T12:07:41.135506+0000', 'last_peered': '2023-11-28T12:07:41.135506+0000', 'last_clean': '2023-11-28T12:07:41.135506+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T12:07:41.147847+0000', 'last_undegraded': '2023-11-28T12:07:41.147847+0000', 'last_fullsized': '2023-11-28T12:07:41.147847+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_clean_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T17:48:09.410549+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T12:07:47.268 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.d is not active+clean 2023-11-28T12:07:47.268 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T12:07:41.160079+0000', 'last_change': '2023-11-28T12:07:41.160079+0000', 'last_active': '2023-11-28T12:07:41.135506+0000', 'last_peered': '2023-11-28T12:07:41.135506+0000', 'last_clean': '2023-11-28T12:07:41.135506+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T12:07:41.160079+0000', 'last_undegraded': '2023-11-28T12:07:41.160079+0000', 'last_fullsized': '2023-11-28T12:07:41.160079+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_clean_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T13:21:44.583002+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-28T12:07:47.269 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.e is not active+clean 2023-11-28T12:07:47.269 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T12:07:41.151916+0000', 'last_change': '2023-11-28T12:07:41.151916+0000', 'last_active': '2023-11-28T12:07:41.135506+0000', 'last_peered': '2023-11-28T12:07:41.135506+0000', 'last_clean': '2023-11-28T12:07:41.135506+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T12:07:41.151916+0000', 'last_undegraded': '2023-11-28T12:07:41.151916+0000', 'last_fullsized': '2023-11-28T12:07:41.151916+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_clean_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T12:29:27.513071+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T12:07:47.269 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.f is not active+clean 2023-11-28T12:07:47.269 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T12:07:41.147885+0000', 'last_change': '2023-11-28T12:07:41.147885+0000', 'last_active': '2023-11-28T12:07:41.135506+0000', 'last_peered': '2023-11-28T12:07:41.135506+0000', 'last_clean': '2023-11-28T12:07:41.135506+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T12:07:41.147885+0000', 'last_undegraded': '2023-11-28T12:07:41.147885+0000', 'last_fullsized': '2023-11-28T12:07:41.147885+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_clean_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T20:55:26.362077+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-28T12:07:47.269 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.8 is not active+clean 2023-11-28T12:07:47.269 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T12:07:41.149621+0000', 'last_change': '2023-11-28T12:07:41.149621+0000', 'last_active': '2023-11-28T12:07:41.135506+0000', 'last_peered': '2023-11-28T12:07:41.135506+0000', 'last_clean': '2023-11-28T12:07:41.135506+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T12:07:41.149621+0000', 'last_undegraded': '2023-11-28T12:07:41.149621+0000', 'last_fullsized': '2023-11-28T12:07:41.149621+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_clean_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T15:02:08.714843+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T12:07:47.269 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.9 is not active+clean 2023-11-28T12:07:47.269 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T12:07:41.145926+0000', 'last_change': '2023-11-28T12:07:41.145926+0000', 'last_active': '2023-11-28T12:07:41.135506+0000', 'last_peered': '2023-11-28T12:07:41.135506+0000', 'last_clean': '2023-11-28T12:07:41.135506+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T12:07:41.145926+0000', 'last_undegraded': '2023-11-28T12:07:41.145926+0000', 'last_fullsized': '2023-11-28T12:07:41.145926+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_clean_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T16:38:08.530818+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-28T12:07:47.269 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.a is not active+clean 2023-11-28T12:07:47.270 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T12:07:41.157549+0000', 'last_change': '2023-11-28T12:07:41.157549+0000', 'last_active': '2023-11-28T12:07:41.135506+0000', 'last_peered': '2023-11-28T12:07:41.135506+0000', 'last_clean': '2023-11-28T12:07:41.135506+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T12:07:41.157549+0000', 'last_undegraded': '2023-11-28T12:07:41.157549+0000', 'last_fullsized': '2023-11-28T12:07:41.157549+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_clean_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T16:38:08.530818+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-28T12:07:47.270 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.b is not active+clean 2023-11-28T12:07:47.270 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T12:07:41.146322+0000', 'last_change': '2023-11-28T12:07:41.146322+0000', 'last_active': '2023-11-28T12:07:41.135506+0000', 'last_peered': '2023-11-28T12:07:41.135506+0000', 'last_clean': '2023-11-28T12:07:41.135506+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T12:07:41.146322+0000', 'last_undegraded': '2023-11-28T12:07:41.146322+0000', 'last_fullsized': '2023-11-28T12:07:41.146322+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_clean_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T12:53:09.125880+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T12:07:47.270 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2 is not active+clean 2023-11-28T12:07:47.270 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T12:07:41.153733+0000', 'last_change': '2023-11-28T12:07:41.153733+0000', 'last_active': '2023-11-28T12:07:41.135506+0000', 'last_peered': '2023-11-28T12:07:41.135506+0000', 'last_clean': '2023-11-28T12:07:41.135506+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T12:07:41.153733+0000', 'last_undegraded': '2023-11-28T12:07:41.153733+0000', 'last_fullsized': '2023-11-28T12:07:41.153733+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_clean_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T14:15:46.212373+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T12:07:47.270 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3 is not active+clean 2023-11-28T12:07:47.270 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T12:07:41.147168+0000', 'last_change': '2023-11-28T12:07:41.147168+0000', 'last_active': '2023-11-28T12:07:41.135506+0000', 'last_peered': '2023-11-28T12:07:41.135506+0000', 'last_clean': '2023-11-28T12:07:41.135506+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T12:07:41.147168+0000', 'last_undegraded': '2023-11-28T12:07:41.147168+0000', 'last_fullsized': '2023-11-28T12:07:41.147168+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_clean_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T20:40:24.727337+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T12:07:47.270 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.4 is not active+clean 2023-11-28T12:07:47.270 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T12:07:41.156626+0000', 'last_change': '2023-11-28T12:07:41.156626+0000', 'last_active': '2023-11-28T12:07:41.135506+0000', 'last_peered': '2023-11-28T12:07:41.135506+0000', 'last_clean': '2023-11-28T12:07:41.135506+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T12:07:41.156626+0000', 'last_undegraded': '2023-11-28T12:07:41.156626+0000', 'last_fullsized': '2023-11-28T12:07:41.156626+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_clean_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T21:47:04.900190+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-28T12:07:47.271 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.5 is not active+clean 2023-11-28T12:07:47.271 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T12:07:41.147660+0000', 'last_change': '2023-11-28T12:07:41.147660+0000', 'last_active': '2023-11-28T12:07:41.135506+0000', 'last_peered': '2023-11-28T12:07:41.135506+0000', 'last_clean': '2023-11-28T12:07:41.135506+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T12:07:41.147660+0000', 'last_undegraded': '2023-11-28T12:07:41.147660+0000', 'last_fullsized': '2023-11-28T12:07:41.147660+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_clean_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T16:38:08.530818+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-11-28T12:07:47.271 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.7 is not active+clean 2023-11-28T12:07:47.271 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T12:07:41.155565+0000', 'last_change': '2023-11-28T12:07:41.155565+0000', 'last_active': '2023-11-28T12:07:41.135506+0000', 'last_peered': '2023-11-28T12:07:41.135506+0000', 'last_clean': '2023-11-28T12:07:41.135506+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T12:07:41.155565+0000', 'last_undegraded': '2023-11-28T12:07:41.155565+0000', 'last_fullsized': '2023-11-28T12:07:41.155565+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_clean_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T12:36:32.514106+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-28T12:07:47.271 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.6 is not active+clean 2023-11-28T12:07:47.271 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T12:07:41.145671+0000', 'last_change': '2023-11-28T12:07:41.145671+0000', 'last_active': '2023-11-28T12:07:41.135506+0000', 'last_peered': '2023-11-28T12:07:41.135506+0000', 'last_clean': '2023-11-28T12:07:41.135506+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T12:07:41.145671+0000', 'last_undegraded': '2023-11-28T12:07:41.145671+0000', 'last_fullsized': '2023-11-28T12:07:41.145671+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_clean_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T23:42:14.979933+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T12:07:47.271 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1 is not active+clean 2023-11-28T12:07:47.271 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T12:07:41.156133+0000', 'last_change': '2023-11-28T12:07:41.156133+0000', 'last_active': '2023-11-28T12:07:41.135506+0000', 'last_peered': '2023-11-28T12:07:41.135506+0000', 'last_clean': '2023-11-28T12:07:41.135506+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T12:07:41.156133+0000', 'last_undegraded': '2023-11-28T12:07:41.156133+0000', 'last_fullsized': '2023-11-28T12:07:41.156133+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_clean_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T22:00:21.039405+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-28T12:07:47.271 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.0 is not active+clean 2023-11-28T12:07:47.271 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2023-11-28T12:07:41.146439+0000', 'last_change': '2023-11-28T12:07:41.146439+0000', 'last_active': '2023-11-28T12:07:41.135506+0000', 'last_peered': '2023-11-28T12:07:41.135506+0000', 'last_clean': '2023-11-28T12:07:41.135506+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T12:07:41.146439+0000', 'last_undegraded': '2023-11-28T12:07:41.146439+0000', 'last_fullsized': '2023-11-28T12:07:41.146439+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'last_clean_scrub_stamp': '2023-11-28T12:07:41.135506+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-11-29T14:04:15.307550+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-28T12:07:47.272 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-11-28T12:07:47.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.496+0000 7fb5e01ff700 1 Processor -- start 2023-11-28T12:07:47.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.496+0000 7fb5e01ff700 1 -- start start 2023-11-28T12:07:47.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.497+0000 7fb5e01ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb5d815c9b0 0x7fb5d80b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:47.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.497+0000 7fb5e01ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb5d8161340 0x7fb5d80d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:47.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.497+0000 7fb5e01ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5d80d1950 con 0x7fb5d80d2320 2023-11-28T12:07:47.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.497+0000 7fb5e01ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5d80b5800 con 0x7fb5d815c9b0 2023-11-28T12:07:47.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.497+0000 7fb5e01ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5d80b5520 con 0x7fb5d8161340 2023-11-28T12:07:47.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.498+0000 7fb5ddf9b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb5d815c9b0 0x7fb5d80b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:47.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.498+0000 7fb5ddf9b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb5d815c9b0 0x7fb5d80b4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34202/0 (socket says 172.21.15.45:34202) 2023-11-28T12:07:47.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.498+0000 7fb5ddf9b700 1 -- 172.21.15.45:0/2224584025 learned_addr learned my addr 172.21.15.45:0/2224584025 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:47.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.498+0000 7fb5dd79a700 1 --2- 172.21.15.45:0/2224584025 >> v2:172.21.15.152:3300/0 conn(0x7fb5d8161340 0x7fb5d80d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:47.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.498+0000 7fb5ddf9b700 1 -- 172.21.15.45:0/2224584025 >> v2:172.21.15.152:3300/0 conn(0x7fb5d8161340 msgr2=0x7fb5d80d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:47.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.498+0000 7fb5ddf9b700 1 --2- 172.21.15.45:0/2224584025 >> v2:172.21.15.152:3300/0 conn(0x7fb5d8161340 0x7fb5d80d1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:47.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.498+0000 7fb5ddf9b700 1 -- 172.21.15.45:0/2224584025 >> v1:172.21.15.152:6789/0 conn(0x7fb5d80d2320 legacy=0x7fb5d80cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:47.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.498+0000 7fb5ddf9b700 1 -- 172.21.15.45:0/2224584025 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5d80d1300 con 0x7fb5d815c9b0 2023-11-28T12:07:47.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.498+0000 7fb5ddf9b700 1 --2- 172.21.15.45:0/2224584025 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5d815c9b0 0x7fb5d80b4bf0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fb5d80685c0 tx=0x7fb5d4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb947d1954f3972f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:47.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.499+0000 7fb5dcf99700 1 -- 172.21.15.45:0/2224584025 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d4004230 con 0x7fb5d815c9b0 2023-11-28T12:07:47.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.499+0000 7fb5dcf99700 1 -- 172.21.15.45:0/2224584025 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5d4004390 con 0x7fb5d815c9b0 2023-11-28T12:07:47.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.499+0000 7fb5dcf99700 1 -- 172.21.15.45:0/2224584025 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d40036a0 con 0x7fb5d815c9b0 2023-11-28T12:07:47.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.499+0000 7fb5e01ff700 1 -- 172.21.15.45:0/2224584025 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5d815c9b0 msgr2=0x7fb5d80b4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:47.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.499+0000 7fb5e01ff700 1 --2- 172.21.15.45:0/2224584025 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5d815c9b0 0x7fb5d80b4bf0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fb5d80685c0 tx=0x7fb5d4009bd0 comp rx=0 tx=0).stop 2023-11-28T12:07:47.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.499+0000 7fb5e01ff700 1 -- 172.21.15.45:0/2224584025 shutdown_connections 2023-11-28T12:07:47.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.499+0000 7fb5e01ff700 1 --2- 172.21.15.45:0/2224584025 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5d815c9b0 0x7fb5d80b4bf0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:47.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.499+0000 7fb5e01ff700 1 --2- 172.21.15.45:0/2224584025 >> v2:172.21.15.152:3300/0 conn(0x7fb5d8161340 0x7fb5d80d1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:47.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.499+0000 7fb5e01ff700 1 -- 172.21.15.45:0/2224584025 >> 172.21.15.45:0/2224584025 conn(0x7fb5d8072600 msgr2=0x7fb5d80cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:47.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.499+0000 7fb5e01ff700 1 -- 172.21.15.45:0/2224584025 shutdown_connections 2023-11-28T12:07:47.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.499+0000 7fb5e01ff700 1 -- 172.21.15.45:0/2224584025 wait complete. 2023-11-28T12:07:47.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.501+0000 7fb5e01ff700 1 Processor -- start 2023-11-28T12:07:47.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.501+0000 7fb5e01ff700 1 -- start start 2023-11-28T12:07:47.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.502+0000 7fb5e01ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5d80d2320 0x7fb5d8152240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:47.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.502+0000 7fb5e01ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb5d815c9b0 0x7fb5d8152e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:47.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.502+0000 7fb5e01ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5d8161340 0x7fb5d80c5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:47.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.502+0000 7fb5e01ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d81533c0 con 0x7fb5d8161340 2023-11-28T12:07:47.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.502+0000 7fb5e01ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d8153690 con 0x7fb5d80d2320 2023-11-28T12:07:47.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.502+0000 7fb5e01ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d8153970 con 0x7fb5d815c9b0 2023-11-28T12:07:47.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.503+0000 7fb5de79c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5d8161340 0x7fb5d80c5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:47.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.503+0000 7fb5de79c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5d8161340 0x7fb5d80c5e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34204/0 (socket says 172.21.15.45:34204) 2023-11-28T12:07:47.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.503+0000 7fb5de79c700 1 -- 172.21.15.45:0/3491741886 learned_addr learned my addr 172.21.15.45:0/3491741886 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:47.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.503+0000 7fb5ddf9b700 1 --2- 172.21.15.45:0/3491741886 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5d80d2320 0x7fb5d8152240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:47.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.503+0000 7fb5dd79a700 1 --2- 172.21.15.45:0/3491741886 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb5d815c9b0 0x7fb5d8152e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:47.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.503+0000 7fb5de79c700 1 -- 172.21.15.45:0/3491741886 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb5d815c9b0 msgr2=0x7fb5d8152e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:47.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.503+0000 7fb5de79c700 1 --2- 172.21.15.45:0/3491741886 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb5d815c9b0 0x7fb5d8152e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:47.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.503+0000 7fb5de79c700 1 -- 172.21.15.45:0/3491741886 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5d80d2320 msgr2=0x7fb5d8152240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:47.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.503+0000 7fb5de79c700 1 --2- 172.21.15.45:0/3491741886 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5d80d2320 0x7fb5d8152240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:47.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.503+0000 7fb5de79c700 1 -- 172.21.15.45:0/3491741886 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5d4009550 con 0x7fb5d8161340 2023-11-28T12:07:47.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.503+0000 7fb5de79c700 1 --2- 172.21.15.45:0/3491741886 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5d8161340 0x7fb5d80c5e40 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fb5d000b9e0 tx=0x7fb5d000bcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:47.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.504+0000 7fb5ce7fc700 1 -- 172.21.15.45:0/3491741886 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d0003c00 con 0x7fb5d8161340 2023-11-28T12:07:47.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.504+0000 7fb5ce7fc700 1 -- 172.21.15.45:0/3491741886 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5d0003da0 con 0x7fb5d8161340 2023-11-28T12:07:47.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.504+0000 7fb5ce7fc700 1 -- 172.21.15.45:0/3491741886 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d000d920 con 0x7fb5d8161340 2023-11-28T12:07:47.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.504+0000 7fb5e01ff700 1 -- 172.21.15.45:0/3491741886 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5d80b5130 con 0x7fb5d8161340 2023-11-28T12:07:47.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.504+0000 7fb5e01ff700 1 -- 172.21.15.45:0/3491741886 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5d80d15e0 con 0x7fb5d8161340 2023-11-28T12:07:47.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.505+0000 7fb5e01ff700 1 -- 172.21.15.45:0/3491741886 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5d80b52c0 con 0x7fb5d8161340 2023-11-28T12:07:47.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.506+0000 7fb5ce7fc700 1 -- 172.21.15.45:0/3491741886 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fb5d001b020 con 0x7fb5d8161340 2023-11-28T12:07:47.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.507+0000 7fb5ce7fc700 1 --2- 172.21.15.45:0/3491741886 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb5bc0682f0 0x7fb5bc06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:47.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.507+0000 7fb5ce7fc700 1 -- 172.21.15.45:0/3491741886 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb5d0011070 con 0x7fb5d8161340 2023-11-28T12:07:47.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.507+0000 7fb5ddf9b700 1 --2- 172.21.15.45:0/3491741886 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb5bc0682f0 0x7fb5bc06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:47.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.508+0000 7fb5ddf9b700 1 --2- 172.21.15.45:0/3491741886 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb5bc0682f0 0x7fb5bc06a7a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb5d4009130 tx=0x7fb5d4008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:47.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.511+0000 7fb5ce7fc700 1 -- 172.21.15.45:0/3491741886 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fb5d00522f0 con 0x7fb5d8161340 2023-11-28T12:07:47.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.795+0000 7fb5e01ff700 1 -- 172.21.15.45:0/3491741886 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fb5d80745c0 con 0x7fb5d8161340 2023-11-28T12:07:47.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.795+0000 7fb5ce7fc700 1 -- 172.21.15.45:0/3491741886 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1193 (secure 0 0 0) 0x7fb5d0055910 con 0x7fb5d8161340 2023-11-28T12:07:47.796 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:07:47.796 INFO:teuthology.orchestra.run.smithi045.stdout:{"fsid":"bd7c37f1-f7c6-4778-b845-52cf2aa6e366","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":98,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":34,"num_osds":8,"num_up_osds":8,"osd_up_since":1701173181,"num_in_osds":8,"osd_in_since":1701173172,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":41}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":86630400,"bytes_avail":773007482880,"bytes_total":773094113280,"inactive_pgs_ratio":0.60952383279800415},"fsmap":{"epoch":16,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":5061}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2023-11-28T12:07:26.439246+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-11-28T12:07:47.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.798+0000 7fb5e01ff700 1 -- 172.21.15.45:0/3491741886 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb5bc0682f0 msgr2=0x7fb5bc06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:47.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.798+0000 7fb5e01ff700 1 --2- 172.21.15.45:0/3491741886 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb5bc0682f0 0x7fb5bc06a7a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb5d4009130 tx=0x7fb5d4008030 comp rx=0 tx=0).stop 2023-11-28T12:07:47.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.798+0000 7fb5e01ff700 1 -- 172.21.15.45:0/3491741886 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5d8161340 msgr2=0x7fb5d80c5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:47.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.798+0000 7fb5e01ff700 1 --2- 172.21.15.45:0/3491741886 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5d8161340 0x7fb5d80c5e40 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fb5d000b9e0 tx=0x7fb5d000bcf0 comp rx=0 tx=0).stop 2023-11-28T12:07:47.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.798+0000 7fb5e01ff700 1 -- 172.21.15.45:0/3491741886 shutdown_connections 2023-11-28T12:07:47.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.798+0000 7fb5e01ff700 1 --2- 172.21.15.45:0/3491741886 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb5bc0682f0 0x7fb5bc06a7a0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:47.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.798+0000 7fb5e01ff700 1 --2- 172.21.15.45:0/3491741886 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5d80d2320 0x7fb5d8152240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:47.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.798+0000 7fb5e01ff700 1 --2- 172.21.15.45:0/3491741886 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5d8161340 0x7fb5d80c5e40 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:47.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.798+0000 7fb5e01ff700 1 --2- 172.21.15.45:0/3491741886 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb5d815c9b0 0x7fb5d8152e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:47.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.798+0000 7fb5e01ff700 1 -- 172.21.15.45:0/3491741886 >> 172.21.15.45:0/3491741886 conn(0x7fb5d8072600 msgr2=0x7fb5d815a5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:47.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.798+0000 7fb5e01ff700 1 -- 172.21.15.45:0/3491741886 shutdown_connections 2023-11-28T12:07:47.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:47.798+0000 7fb5e01ff700 1 -- 172.21.15.45:0/3491741886 wait complete. 2023-11-28T12:07:47.816 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-11-28T12:07:47.817 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T12:07:48.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:48.021+0000 7fd9d89ff700 1 Processor -- start 2023-11-28T12:07:48.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:48.021+0000 7fd9d89ff700 1 -- start start 2023-11-28T12:07:48.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:48.022+0000 7fd9d89ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd9d406a980 0x7fd9d4070de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:48.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:48.022+0000 7fd9d89ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9d40d0840 con 0x7fd9d4161150 2023-11-28T12:07:48.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:48.022+0000 7fd9d89ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9d40d0b20 con 0x7fd9d415cd30 2023-11-28T12:07:48.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:48.022+0000 7fd9d89ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d41615f0 con 0x7fd9d406a980 2023-11-28T12:07:48.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:48.022+0000 7fd9cbfff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fd9d4161150 0x7fd9d406a270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:38758/0 (socket says 172.21.15.45:38758) 2023-11-28T12:07:48.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:48.022+0000 7fd9cbfff700 1 -- 172.21.15.45:0/2750857860 learned_addr learned my addr 172.21.15.45:0/2750857860 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:07:48.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:48.023+0000 7fd9d2d9d700 1 --2- 172.21.15.45:0/2750857860 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd9d406a980 0x7fd9d4070de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:48.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:48.023+0000 7fd9d1d9b700 1 -- 172.21.15.45:0/2750857860 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2402298849 0 0) 0x7fd9d40d0840 con 0x7fd9d4161150 2023-11-28T12:07:48.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:48.023+0000 7fd9d1d9b700 1 -- 172.21.15.45:0/2750857860 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9c00035b0 con 0x7fd9d4161150 2023-11-28T12:07:48.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:48.023+0000 7fd9d2d9d700 1 -- 172.21.15.45:0/2750857860 >> v1:172.21.15.152:6789/0 conn(0x7fd9d415cd30 legacy=0x7fd9d40cfda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:48.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:48.023+0000 7fd9d1d9b700 1 -- 172.21.15.45:0/2750857860 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 434227243 0 0) 0x7fd9d40d0b20 con 0x7fd9d415cd30 2023-11-28T12:07:48.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:48.023+0000 7fd9d2d9d700 1 -- 172.21.15.45:0/2750857860 >> v1:172.21.15.45:6789/0 conn(0x7fd9d4161150 legacy=0x7fd9d406a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:48.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:48.023+0000 7fd9d2d9d700 1 -- 172.21.15.45:0/2750857860 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9d4160670 con 0x7fd9d406a980 2023-11-28T12:07:48.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:48.023+0000 7fd9d2d9d700 1 --2- 172.21.15.45:0/2750857860 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd9d406a980 0x7fd9d4070de0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc009df0 tx=0x7fd9cc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=207c4111f937682d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:48.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:48.024+0000 7fd9d1d9b700 1 -- 172.21.15.45:0/2750857860 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9cc00e070 con 0x7fd9d406a980 2023-11-28T12:07:48.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:48.024+0000 7fd9d1d9b700 1 -- 172.21.15.45:0/2750857860 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9cc00bae0 con 0x7fd9d406a980 2023-11-28T12:07:48.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:48.024+0000 7fd9d1d9b700 1 -- 172.21.15.45:0/2750857860 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9cc00be90 con 0x7fd9d406a980 2023-11-28T12:07:48.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:48.024+0000 7fd9d89ff700 1 -- 172.21.15.45:0/2750857860 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd9d406a980 msgr2=0x7fd9d4070de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:48.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:48.024+0000 7fd9d89ff700 1 --2- 172.21.15.45:0/2750857860 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd9d406a980 0x7fd9d4070de0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc009df0 tx=0x7fd9cc00b330 comp rx=0 tx=0).stop 2023-11-28T12:07:48.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:48.024+0000 7fd9d89ff700 1 -- 172.21.15.45:0/2750857860 shutdown_connections 2023-11-28T12:07:48.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:48.024+0000 7fd9d89ff700 1 --2- 172.21.15.45:0/2750857860 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd9d406a980 0x7fd9d4070de0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:48.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:48.024+0000 7fd9d89ff700 1 -- 172.21.15.45:0/2750857860 >> 172.21.15.45:0/2750857860 conn(0x7fd9d406b380 msgr2=0x7fd9d406b780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:48.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:48.024+0000 7fd9d89ff700 1 -- 172.21.15.45:0/2750857860 shutdown_connections 2023-11-28T12:07:48.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:48.024+0000 7fd9d89ff700 1 -- 172.21.15.45:0/2750857860 wait complete. 2023-11-28T12:07:48.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:48.027+0000 7fd9d89ff700 1 Processor -- start 2023-11-28T12:07:48.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:48.027+0000 7fd9d89ff700 1 -- start start 2023-11-28T12:07:48.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:48.028+0000 7fd9d89ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9d406a980 0x7fd9d40b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:48.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:48.028+0000 7fd9d89ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9d415cd30 0x7fd9d40b2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:48.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:48.028+0000 7fd9d89ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd9d4161150 0x7fd9d40c8e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:48.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:48.028+0000 7fd9d89ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d40c7840 con 0x7fd9d415cd30 2023-11-28T12:07:48.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:48.028+0000 7fd9d89ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d40b4ee0 con 0x7fd9d406a980 2023-11-28T12:07:48.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:48.028+0000 7fd9d89ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d41f6390 con 0x7fd9d4161150 2023-11-28T12:07:48.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:48.028+0000 7fd9cbfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9d415cd30 0x7fd9d40b2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:48.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:48.028+0000 7fd9cbfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9d415cd30 0x7fd9d40b2cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34208/0 (socket says 172.21.15.45:34208) 2023-11-28T12:07:48.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:48.028+0000 7fd9cbfff700 1 -- 172.21.15.45:0/706097676 learned_addr learned my addr 172.21.15.45:0/706097676 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:48.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:48.028+0000 7fd9d259c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9d406a980 0x7fd9d40b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:48.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:48.029+0000 7fd9d2d9d700 1 --2- 172.21.15.45:0/706097676 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd9d4161150 0x7fd9d40c8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:48.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:48.029+0000 7fd9cbfff700 1 -- 172.21.15.45:0/706097676 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd9d4161150 msgr2=0x7fd9d40c8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:48.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:48.029+0000 7fd9cbfff700 1 --2- 172.21.15.45:0/706097676 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd9d4161150 0x7fd9d40c8e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:48.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:48.029+0000 7fd9cbfff700 1 -- 172.21.15.45:0/706097676 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9d406a980 msgr2=0x7fd9d40b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:48.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:48.029+0000 7fd9cbfff700 1 --2- 172.21.15.45:0/706097676 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9d406a980 0x7fd9d40b49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:48.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:48.029+0000 7fd9cbfff700 1 -- 172.21.15.45:0/706097676 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9cc009a70 con 0x7fd9d415cd30 2023-11-28T12:07:48.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:48.029+0000 7fd9cbfff700 1 --2- 172.21.15.45:0/706097676 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9d415cd30 0x7fd9d40b2cf0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fd9bc00c420 tx=0x7fd9bc00c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:48.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:48.029+0000 7fd9caffd700 1 -- 172.21.15.45:0/706097676 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9bc005d70 con 0x7fd9d415cd30 2023-11-28T12:07:48.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:48.029+0000 7fd9caffd700 1 -- 172.21.15.45:0/706097676 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9bc00ce30 con 0x7fd9d415cd30 2023-11-28T12:07:48.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:48.029+0000 7fd9caffd700 1 -- 172.21.15.45:0/706097676 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9bc0072d0 con 0x7fd9d415cd30 2023-11-28T12:07:48.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:48.029+0000 7fd9d89ff700 1 -- 172.21.15.45:0/706097676 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9d4160c30 con 0x7fd9d415cd30 2023-11-28T12:07:48.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:48.030+0000 7fd9d89ff700 1 -- 172.21.15.45:0/706097676 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9d4160950 con 0x7fd9d415cd30 2023-11-28T12:07:48.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:48.031+0000 7fd9d89ff700 1 -- 172.21.15.45:0/706097676 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9d40d04b0 con 0x7fd9d415cd30 2023-11-28T12:07:48.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:48.031+0000 7fd9caffd700 1 -- 172.21.15.45:0/706097676 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fd9bc019030 con 0x7fd9d415cd30 2023-11-28T12:07:48.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:48.032+0000 7fd9caffd700 1 --2- 172.21.15.45:0/706097676 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fd9b40682f0 0x7fd9b406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:48.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:48.032+0000 7fd9caffd700 1 -- 172.21.15.45:0/706097676 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd9bc084e60 con 0x7fd9d415cd30 2023-11-28T12:07:48.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:48.033+0000 7fd9d259c700 1 --2- 172.21.15.45:0/706097676 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fd9b40682f0 0x7fd9b406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:48.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:48.034+0000 7fd9d259c700 1 --2- 172.21.15.45:0/706097676 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fd9b40682f0 0x7fd9b406a7a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd9c4007fd0 tx=0x7fd9c4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:48.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:48.036+0000 7fd9caffd700 1 -- 172.21.15.45:0/706097676 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fd9bc04b5e0 con 0x7fd9d415cd30 2023-11-28T12:07:48.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:48.230+0000 7fd9d89ff700 1 -- 172.21.15.45:0/706097676 --> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd9d40745c0 con 0x7fd9b40682f0 2023-11-28T12:07:48.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:48.239+0000 7fd9caffd700 1 -- 172.21.15.45:0/706097676 <== mgr.4100 v2:172.21.15.152:6832/115389 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+308405 (secure 0 0 0) 0x7fd9d40745c0 con 0x7fd9b40682f0 2023-11-28T12:07:48.245 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:07:48.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:48.244+0000 7fd9d89ff700 1 -- 172.21.15.45:0/706097676 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fd9b40682f0 msgr2=0x7fd9b406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:48.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:48.244+0000 7fd9d89ff700 1 --2- 172.21.15.45:0/706097676 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fd9b40682f0 0x7fd9b406a7a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd9c4007fd0 tx=0x7fd9c4009040 comp rx=0 tx=0).stop 2023-11-28T12:07:48.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:48.244+0000 7fd9d89ff700 1 -- 172.21.15.45:0/706097676 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9d415cd30 msgr2=0x7fd9d40b2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:48.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:48.244+0000 7fd9d89ff700 1 --2- 172.21.15.45:0/706097676 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9d415cd30 0x7fd9d40b2cf0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fd9bc00c420 tx=0x7fd9bc00c730 comp rx=0 tx=0).stop 2023-11-28T12:07:48.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:48.244+0000 7fd9d89ff700 1 -- 172.21.15.45:0/706097676 shutdown_connections 2023-11-28T12:07:48.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:48.244+0000 7fd9d89ff700 1 --2- 172.21.15.45:0/706097676 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fd9b40682f0 0x7fd9b406a7a0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:48.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:48.244+0000 7fd9d89ff700 1 --2- 172.21.15.45:0/706097676 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd9d406a980 0x7fd9d40b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:48.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:48.244+0000 7fd9d89ff700 1 --2- 172.21.15.45:0/706097676 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd9d4161150 0x7fd9d40c8e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:48.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:48.244+0000 7fd9d89ff700 1 --2- 172.21.15.45:0/706097676 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9d415cd30 0x7fd9d40b2cf0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:48.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:48.244+0000 7fd9d89ff700 1 -- 172.21.15.45:0/706097676 >> 172.21.15.45:0/706097676 conn(0x7fd9d406b380 msgr2=0x7fd9d40cfcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:48.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:48.244+0000 7fd9d89ff700 1 -- 172.21.15.45:0/706097676 shutdown_connections 2023-11-28T12:07:48.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:48.244+0000 7fd9d89ff700 1 -- 172.21.15.45:0/706097676 wait complete. 2023-11-28T12:07:48.249 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-11-28T12:07:48.264 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":70,"stamp":"2023-11-28T12:07:46.443621+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":42,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":84600,"kb_used_data":3896,"kb_used_omap":0,"kb_used_meta":80640,"kb_avail":754890120,"statfs":{"total":773094113280,"available":773007482880,"internally_reserved":0,"allocated":3989504,"data_stored":2309734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":82575360},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001259"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.149676+0000","last_change":"2023-11-28T12:07:41.149676+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.149676+0000","last_undegraded":"2023-11-28T12:07:41.149676+0000","last_fullsized":"2023-11-28T12:07:41.149676+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:29:27.513071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.150188+0000","last_change":"2023-11-28T12:07:41.150188+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.150188+0000","last_undegraded":"2023-11-28T12:07:41.150188+0000","last_fullsized":"2023-11-28T12:07:41.150188+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:46:48.928670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.150682+0000","last_change":"2023-11-28T12:07:41.150682+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.150682+0000","last_undegraded":"2023-11-28T12:07:41.150682+0000","last_fullsized":"2023-11-28T12:07:41.150682+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:46:48.928670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.151873+0000","last_change":"2023-11-28T12:07:41.151873+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.151873+0000","last_undegraded":"2023-11-28T12:07:41.151873+0000","last_fullsized":"2023-11-28T12:07:41.151873+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:28:50.548371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.146462+0000","last_change":"2023-11-28T12:07:41.146462+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.146462+0000","last_undegraded":"2023-11-28T12:07:41.146462+0000","last_fullsized":"2023-11-28T12:07:41.146462+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:50:22.991297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.155730+0000","last_change":"2023-11-28T12:07:41.155730+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.155730+0000","last_undegraded":"2023-11-28T12:07:41.155730+0000","last_fullsized":"2023-11-28T12:07:41.155730+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:10:52.015070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.151291+0000","last_change":"2023-11-28T12:07:41.151291+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.151291+0000","last_undegraded":"2023-11-28T12:07:41.151291+0000","last_fullsized":"2023-11-28T12:07:41.151291+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:22:57.069288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.149348+0000","last_change":"2023-11-28T12:07:41.149348+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.149348+0000","last_undegraded":"2023-11-28T12:07:41.149348+0000","last_fullsized":"2023-11-28T12:07:41.149348+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:36:26.400203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.151794+0000","last_change":"2023-11-28T12:07:41.151794+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.151794+0000","last_undegraded":"2023-11-28T12:07:41.151794+0000","last_fullsized":"2023-11-28T12:07:41.151794+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:21:44.583002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.160971+0000","last_change":"2023-11-28T12:07:41.160971+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.160971+0000","last_undegraded":"2023-11-28T12:07:41.160971+0000","last_fullsized":"2023-11-28T12:07:41.160971+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:46:48.928670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.154818+0000","last_change":"2023-11-28T12:07:41.154818+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.154818+0000","last_undegraded":"2023-11-28T12:07:41.154818+0000","last_fullsized":"2023-11-28T12:07:41.154818+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:32:42.598768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.147170+0000","last_change":"2023-11-28T12:07:41.147170+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.147170+0000","last_undegraded":"2023-11-28T12:07:41.147170+0000","last_fullsized":"2023-11-28T12:07:41.147170+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:37:01.124995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.158846+0000","last_change":"2023-11-28T12:07:41.158846+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.158846+0000","last_undegraded":"2023-11-28T12:07:41.158846+0000","last_fullsized":"2023-11-28T12:07:41.158846+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:37:01.124995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.153276+0000","last_change":"2023-11-28T12:07:41.153276+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.153276+0000","last_undegraded":"2023-11-28T12:07:41.153276+0000","last_fullsized":"2023-11-28T12:07:41.153276+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:53:09.125880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.158224+0000","last_change":"2023-11-28T12:07:41.158224+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.158224+0000","last_undegraded":"2023-11-28T12:07:41.158224+0000","last_fullsized":"2023-11-28T12:07:41.158224+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:04:15.307550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.152248+0000","last_change":"2023-11-28T12:07:41.152248+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.152248+0000","last_undegraded":"2023-11-28T12:07:41.152248+0000","last_fullsized":"2023-11-28T12:07:41.152248+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:19:36.237111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.152563+0000","last_change":"2023-11-28T12:07:41.152563+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.152563+0000","last_undegraded":"2023-11-28T12:07:41.152563+0000","last_fullsized":"2023-11-28T12:07:41.152563+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:37:01.124995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.147455+0000","last_change":"2023-11-28T12:07:41.147455+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.147455+0000","last_undegraded":"2023-11-28T12:07:41.147455+0000","last_fullsized":"2023-11-28T12:07:41.147455+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:50:22.991297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.148758+0000","last_change":"2023-11-28T12:07:41.148758+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.148758+0000","last_undegraded":"2023-11-28T12:07:41.148758+0000","last_fullsized":"2023-11-28T12:07:41.148758+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:10:52.015070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.149468+0000","last_change":"2023-11-28T12:07:41.149468+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.149468+0000","last_undegraded":"2023-11-28T12:07:41.149468+0000","last_fullsized":"2023-11-28T12:07:41.149468+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:50:53.505346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.154383+0000","last_change":"2023-11-28T12:07:41.154383+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.154383+0000","last_undegraded":"2023-11-28T12:07:41.154383+0000","last_fullsized":"2023-11-28T12:07:41.154383+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:51:19.561073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.155670+0000","last_change":"2023-11-28T12:07:41.155670+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.155670+0000","last_undegraded":"2023-11-28T12:07:41.155670+0000","last_fullsized":"2023-11-28T12:07:41.155670+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:48:09.410549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.149284+0000","last_change":"2023-11-28T12:07:41.149284+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.149284+0000","last_undegraded":"2023-11-28T12:07:41.149284+0000","last_fullsized":"2023-11-28T12:07:41.149284+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:36:32.514106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.146582+0000","last_change":"2023-11-28T12:07:41.146582+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.146582+0000","last_undegraded":"2023-11-28T12:07:41.146582+0000","last_fullsized":"2023-11-28T12:07:41.146582+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:02:13.155906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.150060+0000","last_change":"2023-11-28T12:07:41.150060+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.150060+0000","last_undegraded":"2023-11-28T12:07:41.150060+0000","last_fullsized":"2023-11-28T12:07:41.150060+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:17:46.712157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.158106+0000","last_change":"2023-11-28T12:07:41.158106+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.158106+0000","last_undegraded":"2023-11-28T12:07:41.158106+0000","last_fullsized":"2023-11-28T12:07:41.158106+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:07:05.409362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.147417+0000","last_change":"2023-11-28T12:07:41.147417+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.147417+0000","last_undegraded":"2023-11-28T12:07:41.147417+0000","last_fullsized":"2023-11-28T12:07:41.147417+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:46:35.658317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.154117+0000","last_change":"2023-11-28T12:07:41.154117+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.154117+0000","last_undegraded":"2023-11-28T12:07:41.154117+0000","last_fullsized":"2023-11-28T12:07:41.154117+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:19:36.237111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.149141+0000","last_change":"2023-11-28T12:07:41.149141+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.149141+0000","last_undegraded":"2023-11-28T12:07:41.149141+0000","last_fullsized":"2023-11-28T12:07:41.149141+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:02:13.155906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.148981+0000","last_change":"2023-11-28T12:07:41.148981+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.148981+0000","last_undegraded":"2023-11-28T12:07:41.148981+0000","last_fullsized":"2023-11-28T12:07:41.148981+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:55:26.362077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.147011+0000","last_change":"2023-11-28T12:07:41.147011+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.147011+0000","last_undegraded":"2023-11-28T12:07:41.147011+0000","last_fullsized":"2023-11-28T12:07:41.147011+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:04:15.307550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.155595+0000","last_change":"2023-11-28T12:07:41.155595+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.155595+0000","last_undegraded":"2023-11-28T12:07:41.155595+0000","last_fullsized":"2023-11-28T12:07:41.155595+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:28:50.548371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.150707+0000","last_change":"2023-11-28T12:07:41.150707+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.150707+0000","last_undegraded":"2023-11-28T12:07:41.150707+0000","last_fullsized":"2023-11-28T12:07:41.150707+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:22:57.069288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.168200+0000","last_change":"2023-11-28T12:07:41.165809+0000","last_active":"2023-11-28T12:07:41.168200+0000","last_peered":"2023-11-28T12:07:41.168200+0000","last_clean":"2023-11-28T12:07:41.168200+0000","last_became_active":"2023-11-28T12:07:41.163993+0000","last_became_peered":"2023-11-28T12:07:41.163993+0000","last_unstale":"2023-11-28T12:07:41.168200+0000","last_undegraded":"2023-11-28T12:07:41.168200+0000","last_fullsized":"2023-11-28T12:07:41.168200+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:48:59.983563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.160342+0000","last_change":"2023-11-28T12:07:41.160342+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.160342+0000","last_undegraded":"2023-11-28T12:07:41.160342+0000","last_fullsized":"2023-11-28T12:07:41.160342+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:21:19.797120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.168685+0000","last_change":"2023-11-28T12:07:41.167048+0000","last_active":"2023-11-28T12:07:41.168685+0000","last_peered":"2023-11-28T12:07:41.168685+0000","last_clean":"2023-11-28T12:07:41.168685+0000","last_became_active":"2023-11-28T12:07:41.166528+0000","last_became_peered":"2023-11-28T12:07:41.166528+0000","last_unstale":"2023-11-28T12:07:41.168685+0000","last_undegraded":"2023-11-28T12:07:41.168685+0000","last_fullsized":"2023-11-28T12:07:41.168685+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:03:41.008569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.152429+0000","last_change":"2023-11-28T12:07:41.152429+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.152429+0000","last_undegraded":"2023-11-28T12:07:41.152429+0000","last_fullsized":"2023-11-28T12:07:41.152429+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:42:14.979933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.170842+0000","last_change":"2023-11-28T12:07:41.169488+0000","last_active":"2023-11-28T12:07:41.170842+0000","last_peered":"2023-11-28T12:07:41.170842+0000","last_clean":"2023-11-28T12:07:41.170842+0000","last_became_active":"2023-11-28T12:07:41.169172+0000","last_became_peered":"2023-11-28T12:07:41.169172+0000","last_unstale":"2023-11-28T12:07:41.170842+0000","last_undegraded":"2023-11-28T12:07:41.170842+0000","last_fullsized":"2023-11-28T12:07:41.170842+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:36:37.411602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.149220+0000","last_change":"2023-11-28T12:07:41.149220+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.149220+0000","last_undegraded":"2023-11-28T12:07:41.149220+0000","last_fullsized":"2023-11-28T12:07:41.149220+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:21:09.502744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.168108+0000","last_change":"2023-11-28T12:07:41.163567+0000","last_active":"2023-11-28T12:07:41.168108+0000","last_peered":"2023-11-28T12:07:41.168108+0000","last_clean":"2023-11-28T12:07:41.168108+0000","last_became_active":"2023-11-28T12:07:41.162624+0000","last_became_peered":"2023-11-28T12:07:41.162624+0000","last_unstale":"2023-11-28T12:07:41.168108+0000","last_undegraded":"2023-11-28T12:07:41.168108+0000","last_fullsized":"2023-11-28T12:07:41.168108+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:19:35.229484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.146894+0000","last_change":"2023-11-28T12:07:41.146894+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.146894+0000","last_undegraded":"2023-11-28T12:07:41.146894+0000","last_fullsized":"2023-11-28T12:07:41.146894+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:51:19.561073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.172281+0000","last_change":"2023-11-28T12:07:41.170651+0000","last_active":"2023-11-28T12:07:41.172281+0000","last_peered":"2023-11-28T12:07:41.172281+0000","last_clean":"2023-11-28T12:07:41.172281+0000","last_became_active":"2023-11-28T12:07:41.170273+0000","last_became_peered":"2023-11-28T12:07:41.170273+0000","last_unstale":"2023-11-28T12:07:41.172281+0000","last_undegraded":"2023-11-28T12:07:41.172281+0000","last_fullsized":"2023-11-28T12:07:41.172281+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:01:45.697262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.155640+0000","last_change":"2023-11-28T12:07:41.155640+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.155640+0000","last_undegraded":"2023-11-28T12:07:41.155640+0000","last_fullsized":"2023-11-28T12:07:41.155640+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:40:24.727337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.171342+0000","last_change":"2023-11-28T12:07:41.168201+0000","last_active":"2023-11-28T12:07:41.171342+0000","last_peered":"2023-11-28T12:07:41.171342+0000","last_clean":"2023-11-28T12:07:41.171342+0000","last_became_active":"2023-11-28T12:07:41.166578+0000","last_became_peered":"2023-11-28T12:07:41.166578+0000","last_unstale":"2023-11-28T12:07:41.171342+0000","last_undegraded":"2023-11-28T12:07:41.171342+0000","last_fullsized":"2023-11-28T12:07:41.171342+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:28:20.315709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.155158+0000","last_change":"2023-11-28T12:07:41.155158+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.155158+0000","last_undegraded":"2023-11-28T12:07:41.155158+0000","last_fullsized":"2023-11-28T12:07:41.155158+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:36:26.400203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.169078+0000","last_change":"2023-11-28T12:07:41.167334+0000","last_active":"2023-11-28T12:07:41.169078+0000","last_peered":"2023-11-28T12:07:41.169078+0000","last_clean":"2023-11-28T12:07:41.169078+0000","last_became_active":"2023-11-28T12:07:41.166499+0000","last_became_peered":"2023-11-28T12:07:41.166499+0000","last_unstale":"2023-11-28T12:07:41.169078+0000","last_undegraded":"2023-11-28T12:07:41.169078+0000","last_fullsized":"2023-11-28T12:07:41.169078+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:28:20.315709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.149792+0000","last_change":"2023-11-28T12:07:41.149792+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.149792+0000","last_undegraded":"2023-11-28T12:07:41.149792+0000","last_fullsized":"2023-11-28T12:07:41.149792+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:15:46.212373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.168039+0000","last_change":"2023-11-28T12:07:41.163322+0000","last_active":"2023-11-28T12:07:41.168039+0000","last_peered":"2023-11-28T12:07:41.168039+0000","last_clean":"2023-11-28T12:07:41.168039+0000","last_became_active":"2023-11-28T12:07:41.161561+0000","last_became_peered":"2023-11-28T12:07:41.161561+0000","last_unstale":"2023-11-28T12:07:41.168039+0000","last_undegraded":"2023-11-28T12:07:41.168039+0000","last_fullsized":"2023-11-28T12:07:41.168039+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:07:04.401735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.151159+0000","last_change":"2023-11-28T12:07:41.151159+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.151159+0000","last_undegraded":"2023-11-28T12:07:41.151159+0000","last_fullsized":"2023-11-28T12:07:41.151159+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:03:42.016196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.171161+0000","last_change":"2023-11-28T12:07:41.170122+0000","last_active":"2023-11-28T12:07:41.171161+0000","last_peered":"2023-11-28T12:07:41.171161+0000","last_clean":"2023-11-28T12:07:41.171161+0000","last_became_active":"2023-11-28T12:07:41.168780+0000","last_became_peered":"2023-11-28T12:07:41.168780+0000","last_unstale":"2023-11-28T12:07:41.171161+0000","last_undegraded":"2023-11-28T12:07:41.171161+0000","last_fullsized":"2023-11-28T12:07:41.171161+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:10:51.007442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.149474+0000","last_change":"2023-11-28T12:07:41.149474+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.149474+0000","last_undegraded":"2023-11-28T12:07:41.149474+0000","last_fullsized":"2023-11-28T12:07:41.149474+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:51:19.561073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.171895+0000","last_change":"2023-11-28T12:07:41.168616+0000","last_active":"2023-11-28T12:07:41.171895+0000","last_peered":"2023-11-28T12:07:41.171895+0000","last_clean":"2023-11-28T12:07:41.171895+0000","last_became_active":"2023-11-28T12:07:41.168368+0000","last_became_peered":"2023-11-28T12:07:41.168368+0000","last_unstale":"2023-11-28T12:07:41.171895+0000","last_undegraded":"2023-11-28T12:07:41.171895+0000","last_fullsized":"2023-11-28T12:07:41.171895+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:43:58.515090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.152164+0000","last_change":"2023-11-28T12:07:41.152164+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.152164+0000","last_undegraded":"2023-11-28T12:07:41.152164+0000","last_fullsized":"2023-11-28T12:07:41.152164+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:40:24.727337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.171731+0000","last_change":"2023-11-28T12:07:41.168261+0000","last_active":"2023-11-28T12:07:41.171731+0000","last_peered":"2023-11-28T12:07:41.171731+0000","last_clean":"2023-11-28T12:07:41.171731+0000","last_became_active":"2023-11-28T12:07:41.167980+0000","last_became_peered":"2023-11-28T12:07:41.167980+0000","last_unstale":"2023-11-28T12:07:41.171731+0000","last_undegraded":"2023-11-28T12:07:41.171731+0000","last_fullsized":"2023-11-28T12:07:41.171731+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:46:34.650690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.151582+0000","last_change":"2023-11-28T12:07:41.151582+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.151582+0000","last_undegraded":"2023-11-28T12:07:41.151582+0000","last_fullsized":"2023-11-28T12:07:41.151582+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:46:48.928670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.167861+0000","last_change":"2023-11-28T12:07:41.164624+0000","last_active":"2023-11-28T12:07:41.167861+0000","last_peered":"2023-11-28T12:07:41.167861+0000","last_clean":"2023-11-28T12:07:41.167861+0000","last_became_active":"2023-11-28T12:07:41.164356+0000","last_became_peered":"2023-11-28T12:07:41.164356+0000","last_unstale":"2023-11-28T12:07:41.167861+0000","last_undegraded":"2023-11-28T12:07:41.167861+0000","last_fullsized":"2023-11-28T12:07:41.167861+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:02:12.148279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.145864+0000","last_change":"2023-11-28T12:07:41.145864+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.145864+0000","last_undegraded":"2023-11-28T12:07:41.145864+0000","last_fullsized":"2023-11-28T12:07:41.145864+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:32:42.598768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.162176+0000","last_change":"2023-11-28T12:07:41.159717+0000","last_active":"2023-11-28T12:07:41.162176+0000","last_peered":"2023-11-28T12:07:41.162176+0000","last_clean":"2023-11-28T12:07:41.162176+0000","last_became_active":"2023-11-28T12:07:41.159459+0000","last_became_peered":"2023-11-28T12:07:41.159459+0000","last_unstale":"2023-11-28T12:07:41.162176+0000","last_undegraded":"2023-11-28T12:07:41.162176+0000","last_fullsized":"2023-11-28T12:07:41.162176+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:03:41.008569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.146411+0000","last_change":"2023-11-28T12:07:41.146411+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.146411+0000","last_undegraded":"2023-11-28T12:07:41.146411+0000","last_fullsized":"2023-11-28T12:07:41.146411+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:36:32.514106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.169694+0000","last_change":"2023-11-28T12:07:41.168453+0000","last_active":"2023-11-28T12:07:41.169694+0000","last_peered":"2023-11-28T12:07:41.169694+0000","last_clean":"2023-11-28T12:07:41.169694+0000","last_became_active":"2023-11-28T12:07:41.168179+0000","last_became_peered":"2023-11-28T12:07:41.168179+0000","last_unstale":"2023-11-28T12:07:41.169694+0000","last_undegraded":"2023-11-28T12:07:41.169694+0000","last_fullsized":"2023-11-28T12:07:41.169694+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:43:58.515090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.148257+0000","last_change":"2023-11-28T12:07:41.148257+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.148257+0000","last_undegraded":"2023-11-28T12:07:41.148257+0000","last_fullsized":"2023-11-28T12:07:41.148257+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:32:42.598768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.161463+0000","last_change":"2023-11-28T12:07:41.157503+0000","last_active":"2023-11-28T12:07:41.161463+0000","last_peered":"2023-11-28T12:07:41.161463+0000","last_clean":"2023-11-28T12:07:41.161463+0000","last_became_active":"2023-11-28T12:07:41.156917+0000","last_became_peered":"2023-11-28T12:07:41.156917+0000","last_unstale":"2023-11-28T12:07:41.161463+0000","last_undegraded":"2023-11-28T12:07:41.161463+0000","last_fullsized":"2023-11-28T12:07:41.161463+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:21:58.563957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.148393+0000","last_change":"2023-11-28T12:07:41.148393+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.148393+0000","last_undegraded":"2023-11-28T12:07:41.148393+0000","last_fullsized":"2023-11-28T12:07:41.148393+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:21:44.583002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.171018+0000","last_change":"2023-11-28T12:07:41.166866+0000","last_active":"2023-11-28T12:07:41.171018+0000","last_peered":"2023-11-28T12:07:41.171018+0000","last_clean":"2023-11-28T12:07:41.171018+0000","last_became_active":"2023-11-28T12:07:41.166584+0000","last_became_peered":"2023-11-28T12:07:41.166584+0000","last_unstale":"2023-11-28T12:07:41.171018+0000","last_undegraded":"2023-11-28T12:07:41.171018+0000","last_fullsized":"2023-11-28T12:07:41.171018+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:43:58.515090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.147847+0000","last_change":"2023-11-28T12:07:41.147847+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.147847+0000","last_undegraded":"2023-11-28T12:07:41.147847+0000","last_fullsized":"2023-11-28T12:07:41.147847+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:48:09.410549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.172292+0000","last_change":"2023-11-28T12:07:41.171141+0000","last_active":"2023-11-28T12:07:41.172292+0000","last_peered":"2023-11-28T12:07:41.172292+0000","last_clean":"2023-11-28T12:07:41.172292+0000","last_became_active":"2023-11-28T12:07:41.170256+0000","last_became_peered":"2023-11-28T12:07:41.170256+0000","last_unstale":"2023-11-28T12:07:41.172292+0000","last_undegraded":"2023-11-28T12:07:41.172292+0000","last_fullsized":"2023-11-28T12:07:41.172292+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:17:45.704529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.160079+0000","last_change":"2023-11-28T12:07:41.160079+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.160079+0000","last_undegraded":"2023-11-28T12:07:41.160079+0000","last_fullsized":"2023-11-28T12:07:41.160079+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:21:44.583002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.174922+0000","last_change":"2023-11-28T12:07:41.171992+0000","last_active":"2023-11-28T12:07:41.174922+0000","last_peered":"2023-11-28T12:07:41.174922+0000","last_clean":"2023-11-28T12:07:41.174922+0000","last_became_active":"2023-11-28T12:07:41.171295+0000","last_became_peered":"2023-11-28T12:07:41.171295+0000","last_unstale":"2023-11-28T12:07:41.174922+0000","last_undegraded":"2023-11-28T12:07:41.174922+0000","last_fullsized":"2023-11-28T12:07:41.174922+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:22:56.061661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.151916+0000","last_change":"2023-11-28T12:07:41.151916+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.151916+0000","last_undegraded":"2023-11-28T12:07:41.151916+0000","last_fullsized":"2023-11-28T12:07:41.151916+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:29:27.513071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.167590+0000","last_change":"2023-11-28T12:07:41.166346+0000","last_active":"2023-11-28T12:07:41.167590+0000","last_peered":"2023-11-28T12:07:41.167590+0000","last_clean":"2023-11-28T12:07:41.167590+0000","last_became_active":"2023-11-28T12:07:41.165885+0000","last_became_peered":"2023-11-28T12:07:41.165885+0000","last_unstale":"2023-11-28T12:07:41.167590+0000","last_undegraded":"2023-11-28T12:07:41.167590+0000","last_fullsized":"2023-11-28T12:07:41.167590+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:21:58.563957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.147885+0000","last_change":"2023-11-28T12:07:41.147885+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.147885+0000","last_undegraded":"2023-11-28T12:07:41.147885+0000","last_fullsized":"2023-11-28T12:07:41.147885+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:55:26.362077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.169106+0000","last_change":"2023-11-28T12:07:41.167652+0000","last_active":"2023-11-28T12:07:41.169106+0000","last_peered":"2023-11-28T12:07:41.169106+0000","last_clean":"2023-11-28T12:07:41.169106+0000","last_became_active":"2023-11-28T12:07:41.166796+0000","last_became_peered":"2023-11-28T12:07:41.166796+0000","last_unstale":"2023-11-28T12:07:41.169106+0000","last_undegraded":"2023-11-28T12:07:41.169106+0000","last_fullsized":"2023-11-28T12:07:41.169106+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:01:45.697262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.149621+0000","last_change":"2023-11-28T12:07:41.149621+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.149621+0000","last_undegraded":"2023-11-28T12:07:41.149621+0000","last_fullsized":"2023-11-28T12:07:41.149621+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:02:08.714843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.164501+0000","last_change":"2023-11-28T12:07:41.160266+0000","last_active":"2023-11-28T12:07:41.164501+0000","last_peered":"2023-11-28T12:07:41.164501+0000","last_clean":"2023-11-28T12:07:41.164501+0000","last_became_active":"2023-11-28T12:07:41.160022+0000","last_became_peered":"2023-11-28T12:07:41.160022+0000","last_unstale":"2023-11-28T12:07:41.164501+0000","last_undegraded":"2023-11-28T12:07:41.164501+0000","last_fullsized":"2023-11-28T12:07:41.164501+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:16:20.525710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.145926+0000","last_change":"2023-11-28T12:07:41.145926+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.145926+0000","last_undegraded":"2023-11-28T12:07:41.145926+0000","last_fullsized":"2023-11-28T12:07:41.145926+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:38:08.530818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.166036+0000","last_change":"2023-11-28T12:07:41.163164+0000","last_active":"2023-11-28T12:07:41.166036+0000","last_peered":"2023-11-28T12:07:41.166036+0000","last_clean":"2023-11-28T12:07:41.166036+0000","last_became_active":"2023-11-28T12:07:41.162678+0000","last_became_peered":"2023-11-28T12:07:41.162678+0000","last_unstale":"2023-11-28T12:07:41.166036+0000","last_undegraded":"2023-11-28T12:07:41.166036+0000","last_fullsized":"2023-11-28T12:07:41.166036+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:39:04.670777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.157549+0000","last_change":"2023-11-28T12:07:41.157549+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.157549+0000","last_undegraded":"2023-11-28T12:07:41.157549+0000","last_fullsized":"2023-11-28T12:07:41.157549+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:38:08.530818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.170948+0000","last_change":"2023-11-28T12:07:41.166168+0000","last_active":"2023-11-28T12:07:41.170948+0000","last_peered":"2023-11-28T12:07:41.170948+0000","last_clean":"2023-11-28T12:07:41.170948+0000","last_became_active":"2023-11-28T12:07:41.164114+0000","last_became_peered":"2023-11-28T12:07:41.164114+0000","last_unstale":"2023-11-28T12:07:41.170948+0000","last_undegraded":"2023-11-28T12:07:41.170948+0000","last_fullsized":"2023-11-28T12:07:41.170948+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:01:45.697262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.146322+0000","last_change":"2023-11-28T12:07:41.146322+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.146322+0000","last_undegraded":"2023-11-28T12:07:41.146322+0000","last_fullsized":"2023-11-28T12:07:41.146322+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:53:09.125880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.165318+0000","last_change":"2023-11-28T12:07:41.162583+0000","last_active":"2023-11-28T12:07:41.165318+0000","last_peered":"2023-11-28T12:07:41.165318+0000","last_clean":"2023-11-28T12:07:41.165318+0000","last_became_active":"2023-11-28T12:07:41.161213+0000","last_became_peered":"2023-11-28T12:07:41.161213+0000","last_unstale":"2023-11-28T12:07:41.165318+0000","last_undegraded":"2023-11-28T12:07:41.165318+0000","last_fullsized":"2023-11-28T12:07:41.165318+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:48:59.983563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.153733+0000","last_change":"2023-11-28T12:07:41.153733+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.153733+0000","last_undegraded":"2023-11-28T12:07:41.153733+0000","last_fullsized":"2023-11-28T12:07:41.153733+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:15:46.212373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.160357+0000","last_change":"2023-11-28T12:07:41.154433+0000","last_active":"2023-11-28T12:07:41.160357+0000","last_peered":"2023-11-28T12:07:41.160357+0000","last_clean":"2023-11-28T12:07:41.160357+0000","last_became_active":"2023-11-28T12:07:41.154159+0000","last_became_peered":"2023-11-28T12:07:41.154159+0000","last_unstale":"2023-11-28T12:07:41.160357+0000","last_undegraded":"2023-11-28T12:07:41.160357+0000","last_fullsized":"2023-11-28T12:07:41.160357+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:04:14.299923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T12:07:40.145722+0000","last_change":"2023-11-28T12:06:23.961595+0000","last_active":"2023-11-28T12:07:40.145722+0000","last_peered":"2023-11-28T12:07:40.145722+0000","last_clean":"2023-11-28T12:07:40.145722+0000","last_became_active":"2023-11-28T12:06:23.961257+0000","last_became_peered":"2023-11-28T12:06:23.961257+0000","last_unstale":"2023-11-28T12:07:40.145722+0000","last_undegraded":"2023-11-28T12:07:40.145722+0000","last_fullsized":"2023-11-28T12:07:40.145722+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:30:40.200095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.147168+0000","last_change":"2023-11-28T12:07:41.147168+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.147168+0000","last_undegraded":"2023-11-28T12:07:41.147168+0000","last_fullsized":"2023-11-28T12:07:41.147168+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:40:24.727337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.167755+0000","last_change":"2023-11-28T12:07:41.164138+0000","last_active":"2023-11-28T12:07:41.167755+0000","last_peered":"2023-11-28T12:07:41.167755+0000","last_clean":"2023-11-28T12:07:41.167755+0000","last_became_active":"2023-11-28T12:07:41.162131+0000","last_became_peered":"2023-11-28T12:07:41.162131+0000","last_unstale":"2023-11-28T12:07:41.167755+0000","last_undegraded":"2023-11-28T12:07:41.167755+0000","last_fullsized":"2023-11-28T12:07:41.167755+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:28:49.540743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T12:07:40.143874+0000","last_change":"2023-11-28T12:06:23.517505+0000","last_active":"2023-11-28T12:07:40.143874+0000","last_peered":"2023-11-28T12:07:40.143874+0000","last_clean":"2023-11-28T12:07:40.143874+0000","last_became_active":"2023-11-28T12:06:23.517151+0000","last_became_peered":"2023-11-28T12:06:23.517151+0000","last_unstale":"2023-11-28T12:07:40.143874+0000","last_undegraded":"2023-11-28T12:07:40.143874+0000","last_fullsized":"2023-11-28T12:07:40.143874+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:30:40.200095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.156626+0000","last_change":"2023-11-28T12:07:41.156626+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.156626+0000","last_undegraded":"2023-11-28T12:07:41.156626+0000","last_fullsized":"2023-11-28T12:07:41.156626+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:47:04.900190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.171873+0000","last_change":"2023-11-28T12:07:41.169674+0000","last_active":"2023-11-28T12:07:41.171873+0000","last_peered":"2023-11-28T12:07:41.171873+0000","last_clean":"2023-11-28T12:07:41.171873+0000","last_became_active":"2023-11-28T12:07:41.169182+0000","last_became_peered":"2023-11-28T12:07:41.169182+0000","last_unstale":"2023-11-28T12:07:41.171873+0000","last_undegraded":"2023-11-28T12:07:41.171873+0000","last_fullsized":"2023-11-28T12:07:41.171873+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:28:20.315709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T12:07:40.145277+0000","last_change":"2023-11-28T12:06:23.517967+0000","last_active":"2023-11-28T12:07:40.145277+0000","last_peered":"2023-11-28T12:07:40.145277+0000","last_clean":"2023-11-28T12:07:40.145277+0000","last_became_active":"2023-11-28T12:06:23.517495+0000","last_became_peered":"2023-11-28T12:06:23.517495+0000","last_unstale":"2023-11-28T12:07:40.145277+0000","last_undegraded":"2023-11-28T12:07:40.145277+0000","last_fullsized":"2023-11-28T12:07:40.145277+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:51:06.844441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":172,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T12:07:40.143568+0000","last_change":"2023-11-28T12:06:23.513472+0000","last_active":"2023-11-28T12:07:40.143568+0000","last_peered":"2023-11-28T12:07:40.143568+0000","last_clean":"2023-11-28T12:07:40.143568+0000","last_became_active":"2023-11-28T12:06:23.513150+0000","last_became_peered":"2023-11-28T12:06:23.513150+0000","last_unstale":"2023-11-28T12:07:40.143568+0000","last_undegraded":"2023-11-28T12:07:40.143568+0000","last_fullsized":"2023-11-28T12:07:40.143568+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:34:18.653049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.147660+0000","last_change":"2023-11-28T12:07:41.147660+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.147660+0000","last_undegraded":"2023-11-28T12:07:41.147660+0000","last_fullsized":"2023-11-28T12:07:41.147660+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:38:08.530818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.169197+0000","last_change":"2023-11-28T12:07:41.167454+0000","last_active":"2023-11-28T12:07:41.169197+0000","last_peered":"2023-11-28T12:07:41.169197+0000","last_clean":"2023-11-28T12:07:41.169197+0000","last_became_active":"2023-11-28T12:07:41.166407+0000","last_became_peered":"2023-11-28T12:07:41.166407+0000","last_unstale":"2023-11-28T12:07:41.169197+0000","last_undegraded":"2023-11-28T12:07:41.169197+0000","last_fullsized":"2023-11-28T12:07:41.169197+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:04:29.977354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T12:07:40.144200+0000","last_change":"2023-11-28T12:06:23.903708+0000","last_active":"2023-11-28T12:07:40.144200+0000","last_peered":"2023-11-28T12:07:40.144200+0000","last_clean":"2023-11-28T12:07:40.144200+0000","last_became_active":"2023-11-28T12:06:23.903399+0000","last_became_peered":"2023-11-28T12:06:23.903399+0000","last_unstale":"2023-11-28T12:07:40.144200+0000","last_undegraded":"2023-11-28T12:07:40.144200+0000","last_fullsized":"2023-11-28T12:07:40.144200+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:31:13.187145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.155565+0000","last_change":"2023-11-28T12:07:41.155565+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.155565+0000","last_undegraded":"2023-11-28T12:07:41.155565+0000","last_fullsized":"2023-11-28T12:07:41.155565+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:36:32.514106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.171367+0000","last_change":"2023-11-28T12:07:41.167913+0000","last_active":"2023-11-28T12:07:41.171367+0000","last_peered":"2023-11-28T12:07:41.171367+0000","last_clean":"2023-11-28T12:07:41.171367+0000","last_became_active":"2023-11-28T12:07:41.167043+0000","last_became_peered":"2023-11-28T12:07:41.167043+0000","last_unstale":"2023-11-28T12:07:41.171367+0000","last_undegraded":"2023-11-28T12:07:41.171367+0000","last_fullsized":"2023-11-28T12:07:41.171367+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:46:34.650690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":22,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T12:07:40.143472+0000","last_change":"2023-11-28T12:06:23.903662+0000","last_active":"2023-11-28T12:07:40.143472+0000","last_peered":"2023-11-28T12:07:40.143472+0000","last_clean":"2023-11-28T12:07:40.143472+0000","last_became_active":"2023-11-28T12:06:23.903354+0000","last_became_peered":"2023-11-28T12:06:23.903354+0000","last_unstale":"2023-11-28T12:07:40.143472+0000","last_undegraded":"2023-11-28T12:07:40.143472+0000","last_fullsized":"2023-11-28T12:07:40.143472+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:02:07.694087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.145671+0000","last_change":"2023-11-28T12:07:41.145671+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.145671+0000","last_undegraded":"2023-11-28T12:07:41.145671+0000","last_fullsized":"2023-11-28T12:07:41.145671+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:42:14.979933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.169635+0000","last_change":"2023-11-28T12:07:41.165591+0000","last_active":"2023-11-28T12:07:41.169635+0000","last_peered":"2023-11-28T12:07:41.169635+0000","last_clean":"2023-11-28T12:07:41.169635+0000","last_became_active":"2023-11-28T12:07:41.164238+0000","last_became_peered":"2023-11-28T12:07:41.164238+0000","last_unstale":"2023-11-28T12:07:41.169635+0000","last_undegraded":"2023-11-28T12:07:41.169635+0000","last_fullsized":"2023-11-28T12:07:41.169635+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:28:49.540743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T12:07:40.140130+0000","last_change":"2023-11-28T12:06:23.903797+0000","last_active":"2023-11-28T12:07:40.140130+0000","last_peered":"2023-11-28T12:07:40.140130+0000","last_clean":"2023-11-28T12:07:40.140130+0000","last_became_active":"2023-11-28T12:06:23.903475+0000","last_became_peered":"2023-11-28T12:06:23.903475+0000","last_unstale":"2023-11-28T12:07:40.140130+0000","last_undegraded":"2023-11-28T12:07:40.140130+0000","last_fullsized":"2023-11-28T12:07:40.140130+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:51:06.844441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.156133+0000","last_change":"2023-11-28T12:07:41.156133+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.156133+0000","last_undegraded":"2023-11-28T12:07:41.156133+0000","last_fullsized":"2023-11-28T12:07:41.156133+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:00:21.039405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.162113+0000","last_change":"2023-11-28T12:07:41.160433+0000","last_active":"2023-11-28T12:07:41.162113+0000","last_peered":"2023-11-28T12:07:41.162113+0000","last_clean":"2023-11-28T12:07:41.162113+0000","last_became_active":"2023-11-28T12:07:41.156521+0000","last_became_peered":"2023-11-28T12:07:41.156521+0000","last_unstale":"2023-11-28T12:07:41.162113+0000","last_undegraded":"2023-11-28T12:07:41.162113+0000","last_fullsized":"2023-11-28T12:07:41.162113+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:13:06.059949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T12:07:40.139422+0000","last_change":"2023-11-28T12:06:23.903983+0000","last_active":"2023-11-28T12:07:40.139422+0000","last_peered":"2023-11-28T12:07:40.139422+0000","last_clean":"2023-11-28T12:07:40.139422+0000","last_became_active":"2023-11-28T12:06:23.903511+0000","last_became_peered":"2023-11-28T12:06:23.903511+0000","last_unstale":"2023-11-28T12:07:40.139422+0000","last_undegraded":"2023-11-28T12:07:40.139422+0000","last_fullsized":"2023-11-28T12:07:40.139422+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:31:13.187145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T12:07:41.146439+0000","last_change":"2023-11-28T12:07:41.146439+0000","last_active":"2023-11-28T12:07:41.135506+0000","last_peered":"2023-11-28T12:07:41.135506+0000","last_clean":"2023-11-28T12:07:41.135506+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T12:07:41.146439+0000","last_undegraded":"2023-11-28T12:07:41.146439+0000","last_fullsized":"2023-11-28T12:07:41.146439+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:04:15.307550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.166158+0000","last_change":"2023-11-28T12:07:41.162201+0000","last_active":"2023-11-28T12:07:41.166158+0000","last_peered":"2023-11-28T12:07:41.166158+0000","last_clean":"2023-11-28T12:07:41.166158+0000","last_became_active":"2023-11-28T12:07:41.159342+0000","last_became_peered":"2023-11-28T12:07:41.159342+0000","last_unstale":"2023-11-28T12:07:41.166158+0000","last_undegraded":"2023-11-28T12:07:41.166158+0000","last_fullsized":"2023-11-28T12:07:41.166158+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:02:12.148279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T12:07:40.140015+0000","last_change":"2023-11-28T12:06:23.517246+0000","last_active":"2023-11-28T12:07:40.140015+0000","last_peered":"2023-11-28T12:07:40.140015+0000","last_clean":"2023-11-28T12:07:40.140015+0000","last_became_active":"2023-11-28T12:06:23.516854+0000","last_became_peered":"2023-11-28T12:06:23.516854+0000","last_unstale":"2023-11-28T12:07:40.140015+0000","last_undegraded":"2023-11-28T12:07:40.140015+0000","last_fullsized":"2023-11-28T12:07:40.140015+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:51:06.844441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9388,"kb_used_data":932,"kb_used_omap":0,"kb_used_meta":8448,"kb_avail":94362452,"statfs":{"total":96636764160,"available":96627150848,"internally_reserved":0,"allocated":954368,"data_stored":736804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8650752},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":2.7469999999999999,"5min":2.7469999999999999,"15min":2.7469999999999999},"last":0.754}]},{"osd":1,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.65300000000000002}]},{"osd":2,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.819,"5min":1.819,"15min":1.819},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":0.67300000000000004}]},{"osd":3,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.71899999999999997}]},{"osd":4,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.376},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.77000000000000002}]},{"osd":5,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.69199999999999995}]},{"osd":6,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.74299999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8232,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363608,"statfs":{"total":96636764160,"available":96628334592,"internally_reserved":0,"allocated":360448,"data_stored":146436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.46700000000000003}]},{"osd":1,"last update":"Tue Nov 28 12:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.61899999999999999}]},{"osd":2,"last update":"Tue Nov 28 12:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.55200000000000005}]},{"osd":3,"last update":"Tue Nov 28 12:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.60599999999999998}]},{"osd":4,"last update":"Tue Nov 28 12:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.72899999999999998}]},{"osd":5,"last update":"Tue Nov 28 12:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.73899999999999999}]},{"osd":7,"last update":"Tue Nov 28 12:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.65100000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13408,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":12480,"kb_avail":94358432,"statfs":{"total":96636764160,"available":96623034368,"internally_reserved":0,"allocated":942080,"data_stored":730176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12779520},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.374}]},{"osd":2,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.52300000000000002}]},{"osd":3,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.45000000000000001}]},{"osd":4,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.7350000000000001,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.60499999999999998}]},{"osd":5,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.61799999999999999}]},{"osd":6,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.627}]},{"osd":7,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.752}]}]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12376,"kb_used_data":336,"kb_used_omap":0,"kb_used_meta":12032,"kb_avail":94359464,"statfs":{"total":96636764160,"available":96624091136,"internally_reserved":0,"allocated":344064,"data_stored":138447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12320768},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 12:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.47399999999999998}]},{"osd":2,"last update":"Tue Nov 28 12:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.499},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.52700000000000002}]},{"osd":3,"last update":"Tue Nov 28 12:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.57299999999999995}]},{"osd":4,"last update":"Tue Nov 28 12:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.9159999999999999,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.69999999999999996}]},{"osd":5,"last update":"Tue Nov 28 12:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.68200000000000005}]},{"osd":6,"last update":"Tue Nov 28 12:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.82999999999999996}]},{"osd":7,"last update":"Tue Nov 28 12:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.87}]}]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12252,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":11904,"kb_avail":94359588,"statfs":{"total":96636764160,"available":96624218112,"internally_reserved":0,"allocated":348160,"data_stored":139808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12189696},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.46700000000000003}]},{"osd":1,"last update":"Tue Nov 28 12:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.51100000000000001}]},{"osd":3,"last update":"Tue Nov 28 12:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.41099999999999998}]},{"osd":4,"last update":"Tue Nov 28 12:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.57699999999999996}]},{"osd":5,"last update":"Tue Nov 28 12:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.60399999999999998}]},{"osd":6,"last update":"Tue Nov 28 12:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.67700000000000005}]},{"osd":7,"last update":"Tue Nov 28 12:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.63300000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12376,"kb_used_data":336,"kb_used_omap":0,"kb_used_meta":12032,"kb_avail":94359464,"statfs":{"total":96636764160,"available":96624091136,"internally_reserved":0,"allocated":344064,"data_stored":138447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12320768},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.33500000000000002}]},{"osd":1,"last update":"Tue Nov 28 12:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.372},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.53500000000000003}]},{"osd":2,"last update":"Tue Nov 28 12:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.58499999999999996}]},{"osd":4,"last update":"Tue Nov 28 12:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.752},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.69799999999999995}]},{"osd":5,"last update":"Tue Nov 28 12:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.82399999999999995}]},{"osd":6,"last update":"Tue Nov 28 12:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.77900000000000003}]},{"osd":7,"last update":"Tue Nov 28 12:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.67100000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8348,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":8000,"kb_avail":94363492,"statfs":{"total":96636764160,"available":96628215808,"internally_reserved":0,"allocated":348160,"data_stored":139808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8192000},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.58199999999999996}]},{"osd":1,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.65500000000000003}]},{"osd":2,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.54500000000000004}]},{"osd":3,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.622}]},{"osd":5,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.50900000000000001}]},{"osd":6,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.60199999999999998}]},{"osd":7,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.66300000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8220,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363620,"statfs":{"total":96636764160,"available":96628346880,"internally_reserved":0,"allocated":348160,"data_stored":139808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.67400000000000004}]},{"osd":1,"last update":"Tue Nov 28 12:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.624}]},{"osd":2,"last update":"Tue Nov 28 12:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.65800000000000003}]},{"osd":3,"last update":"Tue Nov 28 12:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.71099999999999997}]},{"osd":4,"last update":"Tue Nov 28 12:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.79600000000000004}]},{"osd":6,"last update":"Tue Nov 28 12:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.75},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.81299999999999994}]},{"osd":7,"last update":"Tue Nov 28 12:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.84199999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T12:07:51.270 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T12:07:51.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.482+0000 7f9f551ff700 1 Processor -- start 2023-11-28T12:07:51.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.482+0000 7f9f551ff700 1 -- start start 2023-11-28T12:07:51.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.483+0000 7f9f551ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f9f5015c9b0 0x7f9f500b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:51.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.483+0000 7f9f551ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9f50161340 0x7f9f500d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:51.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.483+0000 7f9f551ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9f500d2320 0x7f9f500cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:51.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.483+0000 7f9f551ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f500b5800 con 0x7f9f50161340 2023-11-28T12:07:51.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.483+0000 7f9f551ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f500d1950 con 0x7f9f5015c9b0 2023-11-28T12:07:51.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.483+0000 7f9f551ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f500b5520 con 0x7f9f500d2320 2023-11-28T12:07:51.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.484+0000 7f9f4e59c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9f50161340 0x7f9f500d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:51.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.484+0000 7f9f4e59c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9f50161340 0x7f9f500d1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34216/0 (socket says 172.21.15.45:34216) 2023-11-28T12:07:51.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.484+0000 7f9f4e59c700 1 -- 172.21.15.45:0/186094995 learned_addr learned my addr 172.21.15.45:0/186094995 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:51.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.484+0000 7f9f4ed9d700 1 --2- 172.21.15.45:0/186094995 >> v2:172.21.15.152:3300/0 conn(0x7f9f5015c9b0 0x7f9f500b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:51.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.484+0000 7f9f4f59e700 1 --2- 172.21.15.45:0/186094995 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9f500d2320 0x7f9f500cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:51.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.484+0000 7f9f4e59c700 1 -- 172.21.15.45:0/186094995 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9f500d2320 msgr2=0x7f9f500cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:51.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.484+0000 7f9f4e59c700 1 --2- 172.21.15.45:0/186094995 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9f500d2320 0x7f9f500cd7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:51.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.484+0000 7f9f4e59c700 1 -- 172.21.15.45:0/186094995 >> v2:172.21.15.152:3300/0 conn(0x7f9f5015c9b0 msgr2=0x7f9f500b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:51.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.484+0000 7f9f4e59c700 1 --2- 172.21.15.45:0/186094995 >> v2:172.21.15.152:3300/0 conn(0x7f9f5015c9b0 0x7f9f500b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:51.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.484+0000 7f9f4e59c700 1 -- 172.21.15.45:0/186094995 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f500d1300 con 0x7f9f50161340 2023-11-28T12:07:51.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.484+0000 7f9f4ed9d700 1 --2- 172.21.15.45:0/186094995 >> v2:172.21.15.152:3300/0 conn(0x7f9f5015c9b0 0x7f9f500b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:07:51.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.484+0000 7f9f4e59c700 1 --2- 172.21.15.45:0/186094995 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f50161340 0x7f9f500d1de0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f9f50067460 tx=0x7f9f44009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f413c51a2b971403 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:51.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.485+0000 7f9f4dd9b700 1 -- 172.21.15.45:0/186094995 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f4400b870 con 0x7f9f50161340 2023-11-28T12:07:51.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.485+0000 7f9f4dd9b700 1 -- 172.21.15.45:0/186094995 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f4400b9d0 con 0x7f9f50161340 2023-11-28T12:07:51.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.485+0000 7f9f4dd9b700 1 -- 172.21.15.45:0/186094995 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f4400bd60 con 0x7f9f50161340 2023-11-28T12:07:51.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.485+0000 7f9f551ff700 1 -- 172.21.15.45:0/186094995 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f50161340 msgr2=0x7f9f500d1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:51.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.485+0000 7f9f551ff700 1 --2- 172.21.15.45:0/186094995 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f50161340 0x7f9f500d1de0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f9f50067460 tx=0x7f9f44009bd0 comp rx=0 tx=0).stop 2023-11-28T12:07:51.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.485+0000 7f9f551ff700 1 -- 172.21.15.45:0/186094995 shutdown_connections 2023-11-28T12:07:51.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.485+0000 7f9f551ff700 1 --2- 172.21.15.45:0/186094995 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9f500d2320 0x7f9f500cd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:51.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.485+0000 7f9f551ff700 1 --2- 172.21.15.45:0/186094995 >> v2:172.21.15.152:3300/0 conn(0x7f9f5015c9b0 0x7f9f500b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:51.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.485+0000 7f9f551ff700 1 --2- 172.21.15.45:0/186094995 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f50161340 0x7f9f500d1de0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:51.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.485+0000 7f9f551ff700 1 -- 172.21.15.45:0/186094995 >> 172.21.15.45:0/186094995 conn(0x7f9f50072600 msgr2=0x7f9f500cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:51.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.485+0000 7f9f551ff700 1 -- 172.21.15.45:0/186094995 shutdown_connections 2023-11-28T12:07:51.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.485+0000 7f9f551ff700 1 -- 172.21.15.45:0/186094995 wait complete. 2023-11-28T12:07:51.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.487+0000 7f9f551ff700 1 Processor -- start 2023-11-28T12:07:51.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.487+0000 7f9f551ff700 1 -- start start 2023-11-28T12:07:51.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.488+0000 7f9f551ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f500d2320 0x7f9f500c5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:51.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.488+0000 7f9f551ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9f5015c9b0 0x7f9f50151630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:51.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.488+0000 7f9f551ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9f50161340 0x7f9f50143d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:51.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.488+0000 7f9f551ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f500c64a0 con 0x7f9f500d2320 2023-11-28T12:07:51.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.488+0000 7f9f551ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f50151e10 con 0x7f9f50161340 2023-11-28T12:07:51.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.488+0000 7f9f551ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f50151b70 con 0x7f9f5015c9b0 2023-11-28T12:07:51.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.488+0000 7f9f4ed9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f500d2320 0x7f9f500c5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:51.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.488+0000 7f9f4ed9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f500d2320 0x7f9f500c5f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34224/0 (socket says 172.21.15.45:34224) 2023-11-28T12:07:51.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.488+0000 7f9f4ed9d700 1 -- 172.21.15.45:0/1788830075 learned_addr learned my addr 172.21.15.45:0/1788830075 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:51.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.489+0000 7f9f4e59c700 1 --2- 172.21.15.45:0/1788830075 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9f5015c9b0 0x7f9f50151630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:51.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.489+0000 7f9f4f59e700 1 --2- 172.21.15.45:0/1788830075 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9f50161340 0x7f9f50143d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:51.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.489+0000 7f9f4ed9d700 1 -- 172.21.15.45:0/1788830075 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9f5015c9b0 msgr2=0x7f9f50151630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:51.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.489+0000 7f9f4ed9d700 1 --2- 172.21.15.45:0/1788830075 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9f5015c9b0 0x7f9f50151630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:51.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.489+0000 7f9f4ed9d700 1 -- 172.21.15.45:0/1788830075 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9f50161340 msgr2=0x7f9f50143d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:51.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.489+0000 7f9f4ed9d700 1 --2- 172.21.15.45:0/1788830075 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9f50161340 0x7f9f50143d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:51.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.489+0000 7f9f4ed9d700 1 -- 172.21.15.45:0/1788830075 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f44009550 con 0x7f9f500d2320 2023-11-28T12:07:51.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.489+0000 7f9f4ed9d700 1 --2- 172.21.15.45:0/1788830075 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f500d2320 0x7f9f500c5f60 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f9f4000e810 tx=0x7f9f4000eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:51.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.489+0000 7f9f377fe700 1 -- 172.21.15.45:0/1788830075 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f40013610 con 0x7f9f500d2320 2023-11-28T12:07:51.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.489+0000 7f9f377fe700 1 -- 172.21.15.45:0/1788830075 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f40013770 con 0x7f9f500d2320 2023-11-28T12:07:51.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.489+0000 7f9f377fe700 1 -- 172.21.15.45:0/1788830075 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f40013b20 con 0x7f9f500d2320 2023-11-28T12:07:51.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.489+0000 7f9f551ff700 1 -- 172.21.15.45:0/1788830075 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f500b5130 con 0x7f9f500d2320 2023-11-28T12:07:51.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.490+0000 7f9f551ff700 1 -- 172.21.15.45:0/1788830075 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f500d15e0 con 0x7f9f500d2320 2023-11-28T12:07:51.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.491+0000 7f9f551ff700 1 -- 172.21.15.45:0/1788830075 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f500b52c0 con 0x7f9f500d2320 2023-11-28T12:07:51.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.491+0000 7f9f377fe700 1 -- 172.21.15.45:0/1788830075 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f9f40023070 con 0x7f9f500d2320 2023-11-28T12:07:51.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.493+0000 7f9f377fe700 1 --2- 172.21.15.45:0/1788830075 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f9f3c0682f0 0x7f9f3c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:51.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.493+0000 7f9f377fe700 1 -- 172.21.15.45:0/1788830075 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9f400857d0 con 0x7f9f500d2320 2023-11-28T12:07:51.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.494+0000 7f9f4e59c700 1 --2- 172.21.15.45:0/1788830075 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f9f3c0682f0 0x7f9f3c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:51.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.494+0000 7f9f4e59c700 1 --2- 172.21.15.45:0/1788830075 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f9f3c0682f0 0x7f9f3c06a7a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9f44000c00 tx=0x7f9f44008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:51.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.498+0000 7f9f377fe700 1 -- 172.21.15.45:0/1788830075 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f9f40052030 con 0x7f9f500d2320 2023-11-28T12:07:51.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.696+0000 7f9f551ff700 1 -- 172.21.15.45:0/1788830075 --> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9f50157360 con 0x7f9f3c0682f0 2023-11-28T12:07:51.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.706+0000 7f9f377fe700 1 -- 172.21.15.45:0/1788830075 <== mgr.4100 v2:172.21.15.152:6832/115389 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311375 (secure 0 0 0) 0x7f9f50157360 con 0x7f9f3c0682f0 2023-11-28T12:07:51.712 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:07:51.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.710+0000 7f9f551ff700 1 -- 172.21.15.45:0/1788830075 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f9f3c0682f0 msgr2=0x7f9f3c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:51.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.710+0000 7f9f551ff700 1 --2- 172.21.15.45:0/1788830075 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f9f3c0682f0 0x7f9f3c06a7a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9f44000c00 tx=0x7f9f44008030 comp rx=0 tx=0).stop 2023-11-28T12:07:51.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.710+0000 7f9f551ff700 1 -- 172.21.15.45:0/1788830075 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f500d2320 msgr2=0x7f9f500c5f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:51.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.710+0000 7f9f551ff700 1 --2- 172.21.15.45:0/1788830075 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f500d2320 0x7f9f500c5f60 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f9f4000e810 tx=0x7f9f4000eb20 comp rx=0 tx=0).stop 2023-11-28T12:07:51.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.711+0000 7f9f551ff700 1 -- 172.21.15.45:0/1788830075 shutdown_connections 2023-11-28T12:07:51.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.711+0000 7f9f551ff700 1 --2- 172.21.15.45:0/1788830075 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f9f3c0682f0 0x7f9f3c06a7a0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:51.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.711+0000 7f9f551ff700 1 --2- 172.21.15.45:0/1788830075 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9f50161340 0x7f9f50143d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:51.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.711+0000 7f9f551ff700 1 --2- 172.21.15.45:0/1788830075 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f500d2320 0x7f9f500c5f60 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:51.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.711+0000 7f9f551ff700 1 --2- 172.21.15.45:0/1788830075 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9f5015c9b0 0x7f9f50151630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:51.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.711+0000 7f9f551ff700 1 -- 172.21.15.45:0/1788830075 >> 172.21.15.45:0/1788830075 conn(0x7f9f50072600 msgr2=0x7f9f500b5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:51.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.711+0000 7f9f551ff700 1 -- 172.21.15.45:0/1788830075 shutdown_connections 2023-11-28T12:07:51.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.711+0000 7f9f551ff700 1 -- 172.21.15.45:0/1788830075 wait complete. 2023-11-28T12:07:51.715 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-11-28T12:07:51.731 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":72,"stamp":"2023-11-28T12:07:50.444662+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":86144,"kb_used_data":4224,"kb_used_omap":0,"kb_used_meta":81856,"kb_avail":754888576,"statfs":{"total":773094113280,"available":773005901824,"internally_reserved":0,"allocated":4325376,"data_stored":2464410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":83820544},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.789937"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.692421+0000","last_change":"2023-11-28T12:07:41.691764+0000","last_active":"2023-11-28T12:07:41.692421+0000","last_peered":"2023-11-28T12:07:41.692421+0000","last_clean":"2023-11-28T12:07:41.692421+0000","last_became_active":"2023-11-28T12:07:41.690126+0000","last_became_peered":"2023-11-28T12:07:41.690126+0000","last_unstale":"2023-11-28T12:07:41.692421+0000","last_undegraded":"2023-11-28T12:07:41.692421+0000","last_fullsized":"2023-11-28T12:07:41.692421+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:29:27.513071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.687819+0000","last_change":"2023-11-28T12:07:41.682983+0000","last_active":"2023-11-28T12:07:41.687819+0000","last_peered":"2023-11-28T12:07:41.687819+0000","last_clean":"2023-11-28T12:07:41.687819+0000","last_became_active":"2023-11-28T12:07:41.679811+0000","last_became_peered":"2023-11-28T12:07:41.679811+0000","last_unstale":"2023-11-28T12:07:41.687819+0000","last_undegraded":"2023-11-28T12:07:41.687819+0000","last_fullsized":"2023-11-28T12:07:41.687819+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:46:48.928670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.676426+0000","last_change":"2023-11-28T12:07:41.668645+0000","last_active":"2023-11-28T12:07:41.676426+0000","last_peered":"2023-11-28T12:07:41.676426+0000","last_clean":"2023-11-28T12:07:41.676426+0000","last_became_active":"2023-11-28T12:07:41.668354+0000","last_became_peered":"2023-11-28T12:07:41.668354+0000","last_unstale":"2023-11-28T12:07:41.676426+0000","last_undegraded":"2023-11-28T12:07:41.676426+0000","last_fullsized":"2023-11-28T12:07:41.676426+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:46:48.928670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.684771+0000","last_change":"2023-11-28T12:07:41.684012+0000","last_active":"2023-11-28T12:07:41.684771+0000","last_peered":"2023-11-28T12:07:41.684771+0000","last_clean":"2023-11-28T12:07:41.684771+0000","last_became_active":"2023-11-28T12:07:41.683758+0000","last_became_peered":"2023-11-28T12:07:41.683758+0000","last_unstale":"2023-11-28T12:07:41.684771+0000","last_undegraded":"2023-11-28T12:07:41.684771+0000","last_fullsized":"2023-11-28T12:07:41.684771+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:28:50.548371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.683466+0000","last_change":"2023-11-28T12:07:41.682214+0000","last_active":"2023-11-28T12:07:41.683466+0000","last_peered":"2023-11-28T12:07:41.683466+0000","last_clean":"2023-11-28T12:07:41.683466+0000","last_became_active":"2023-11-28T12:07:41.681368+0000","last_became_peered":"2023-11-28T12:07:41.681368+0000","last_unstale":"2023-11-28T12:07:41.683466+0000","last_undegraded":"2023-11-28T12:07:41.683466+0000","last_fullsized":"2023-11-28T12:07:41.683466+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:50:22.991297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.681668+0000","last_change":"2023-11-28T12:07:41.677489+0000","last_active":"2023-11-28T12:07:41.681668+0000","last_peered":"2023-11-28T12:07:41.681668+0000","last_clean":"2023-11-28T12:07:41.681668+0000","last_became_active":"2023-11-28T12:07:41.676468+0000","last_became_peered":"2023-11-28T12:07:41.676468+0000","last_unstale":"2023-11-28T12:07:41.681668+0000","last_undegraded":"2023-11-28T12:07:41.681668+0000","last_fullsized":"2023-11-28T12:07:41.681668+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:10:52.015070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.693168+0000","last_change":"2023-11-28T12:07:41.688685+0000","last_active":"2023-11-28T12:07:41.693168+0000","last_peered":"2023-11-28T12:07:41.693168+0000","last_clean":"2023-11-28T12:07:41.693168+0000","last_became_active":"2023-11-28T12:07:41.687922+0000","last_became_peered":"2023-11-28T12:07:41.687922+0000","last_unstale":"2023-11-28T12:07:41.693168+0000","last_undegraded":"2023-11-28T12:07:41.693168+0000","last_fullsized":"2023-11-28T12:07:41.693168+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:22:57.069288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.670332+0000","last_change":"2023-11-28T12:07:41.668514+0000","last_active":"2023-11-28T12:07:41.670332+0000","last_peered":"2023-11-28T12:07:41.670332+0000","last_clean":"2023-11-28T12:07:41.670332+0000","last_became_active":"2023-11-28T12:07:41.668254+0000","last_became_peered":"2023-11-28T12:07:41.668254+0000","last_unstale":"2023-11-28T12:07:41.670332+0000","last_undegraded":"2023-11-28T12:07:41.670332+0000","last_fullsized":"2023-11-28T12:07:41.670332+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:36:26.400203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.677331+0000","last_change":"2023-11-28T12:07:41.669411+0000","last_active":"2023-11-28T12:07:41.677331+0000","last_peered":"2023-11-28T12:07:41.677331+0000","last_clean":"2023-11-28T12:07:41.677331+0000","last_became_active":"2023-11-28T12:07:41.668518+0000","last_became_peered":"2023-11-28T12:07:41.668518+0000","last_unstale":"2023-11-28T12:07:41.677331+0000","last_undegraded":"2023-11-28T12:07:41.677331+0000","last_fullsized":"2023-11-28T12:07:41.677331+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:21:44.583002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.690163+0000","last_change":"2023-11-28T12:07:41.671198+0000","last_active":"2023-11-28T12:07:41.690163+0000","last_peered":"2023-11-28T12:07:41.690163+0000","last_clean":"2023-11-28T12:07:41.690163+0000","last_became_active":"2023-11-28T12:07:41.670935+0000","last_became_peered":"2023-11-28T12:07:41.670935+0000","last_unstale":"2023-11-28T12:07:41.690163+0000","last_undegraded":"2023-11-28T12:07:41.690163+0000","last_fullsized":"2023-11-28T12:07:41.690163+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:46:48.928670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.690497+0000","last_change":"2023-11-28T12:07:41.681754+0000","last_active":"2023-11-28T12:07:41.690497+0000","last_peered":"2023-11-28T12:07:41.690497+0000","last_clean":"2023-11-28T12:07:41.690497+0000","last_became_active":"2023-11-28T12:07:41.681431+0000","last_became_peered":"2023-11-28T12:07:41.681431+0000","last_unstale":"2023-11-28T12:07:41.690497+0000","last_undegraded":"2023-11-28T12:07:41.690497+0000","last_fullsized":"2023-11-28T12:07:41.690497+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:32:42.598768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.679290+0000","last_change":"2023-11-28T12:07:41.675291+0000","last_active":"2023-11-28T12:07:41.679290+0000","last_peered":"2023-11-28T12:07:41.679290+0000","last_clean":"2023-11-28T12:07:41.679290+0000","last_became_active":"2023-11-28T12:07:41.674971+0000","last_became_peered":"2023-11-28T12:07:41.674971+0000","last_unstale":"2023-11-28T12:07:41.679290+0000","last_undegraded":"2023-11-28T12:07:41.679290+0000","last_fullsized":"2023-11-28T12:07:41.679290+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:37:01.124995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.688081+0000","last_change":"2023-11-28T12:07:41.668631+0000","last_active":"2023-11-28T12:07:41.688081+0000","last_peered":"2023-11-28T12:07:41.688081+0000","last_clean":"2023-11-28T12:07:41.688081+0000","last_became_active":"2023-11-28T12:07:41.668321+0000","last_became_peered":"2023-11-28T12:07:41.668321+0000","last_unstale":"2023-11-28T12:07:41.688081+0000","last_undegraded":"2023-11-28T12:07:41.688081+0000","last_fullsized":"2023-11-28T12:07:41.688081+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:37:01.124995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.681422+0000","last_change":"2023-11-28T12:07:41.673660+0000","last_active":"2023-11-28T12:07:41.681422+0000","last_peered":"2023-11-28T12:07:41.681422+0000","last_clean":"2023-11-28T12:07:41.681422+0000","last_became_active":"2023-11-28T12:07:41.673346+0000","last_became_peered":"2023-11-28T12:07:41.673346+0000","last_unstale":"2023-11-28T12:07:41.681422+0000","last_undegraded":"2023-11-28T12:07:41.681422+0000","last_fullsized":"2023-11-28T12:07:41.681422+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:53:09.125880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.689774+0000","last_change":"2023-11-28T12:07:41.677656+0000","last_active":"2023-11-28T12:07:41.689774+0000","last_peered":"2023-11-28T12:07:41.689774+0000","last_clean":"2023-11-28T12:07:41.689774+0000","last_became_active":"2023-11-28T12:07:41.677364+0000","last_became_peered":"2023-11-28T12:07:41.677364+0000","last_unstale":"2023-11-28T12:07:41.689774+0000","last_undegraded":"2023-11-28T12:07:41.689774+0000","last_fullsized":"2023-11-28T12:07:41.689774+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:04:15.307550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.691007+0000","last_change":"2023-11-28T12:07:41.685836+0000","last_active":"2023-11-28T12:07:41.691007+0000","last_peered":"2023-11-28T12:07:41.691007+0000","last_clean":"2023-11-28T12:07:41.691007+0000","last_became_active":"2023-11-28T12:07:41.685385+0000","last_became_peered":"2023-11-28T12:07:41.685385+0000","last_unstale":"2023-11-28T12:07:41.691007+0000","last_undegraded":"2023-11-28T12:07:41.691007+0000","last_fullsized":"2023-11-28T12:07:41.691007+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:19:36.237111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.690781+0000","last_change":"2023-11-28T12:07:41.683156+0000","last_active":"2023-11-28T12:07:41.690781+0000","last_peered":"2023-11-28T12:07:41.690781+0000","last_clean":"2023-11-28T12:07:41.690781+0000","last_became_active":"2023-11-28T12:07:41.682866+0000","last_became_peered":"2023-11-28T12:07:41.682866+0000","last_unstale":"2023-11-28T12:07:41.690781+0000","last_undegraded":"2023-11-28T12:07:41.690781+0000","last_fullsized":"2023-11-28T12:07:41.690781+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:37:01.124995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.682112+0000","last_change":"2023-11-28T12:07:41.676003+0000","last_active":"2023-11-28T12:07:41.682112+0000","last_peered":"2023-11-28T12:07:41.682112+0000","last_clean":"2023-11-28T12:07:41.682112+0000","last_became_active":"2023-11-28T12:07:41.675713+0000","last_became_peered":"2023-11-28T12:07:41.675713+0000","last_unstale":"2023-11-28T12:07:41.682112+0000","last_undegraded":"2023-11-28T12:07:41.682112+0000","last_fullsized":"2023-11-28T12:07:41.682112+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:50:22.991297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.683117+0000","last_change":"2023-11-28T12:07:41.680166+0000","last_active":"2023-11-28T12:07:41.683117+0000","last_peered":"2023-11-28T12:07:41.683117+0000","last_clean":"2023-11-28T12:07:41.683117+0000","last_became_active":"2023-11-28T12:07:41.679079+0000","last_became_peered":"2023-11-28T12:07:41.679079+0000","last_unstale":"2023-11-28T12:07:41.683117+0000","last_undegraded":"2023-11-28T12:07:41.683117+0000","last_fullsized":"2023-11-28T12:07:41.683117+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:10:52.015070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.681852+0000","last_change":"2023-11-28T12:07:41.675187+0000","last_active":"2023-11-28T12:07:41.681852+0000","last_peered":"2023-11-28T12:07:41.681852+0000","last_clean":"2023-11-28T12:07:41.681852+0000","last_became_active":"2023-11-28T12:07:41.674574+0000","last_became_peered":"2023-11-28T12:07:41.674574+0000","last_unstale":"2023-11-28T12:07:41.681852+0000","last_undegraded":"2023-11-28T12:07:41.681852+0000","last_fullsized":"2023-11-28T12:07:41.681852+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:50:53.505346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.689571+0000","last_change":"2023-11-28T12:07:41.675199+0000","last_active":"2023-11-28T12:07:41.689571+0000","last_peered":"2023-11-28T12:07:41.689571+0000","last_clean":"2023-11-28T12:07:41.689571+0000","last_became_active":"2023-11-28T12:07:41.672873+0000","last_became_peered":"2023-11-28T12:07:41.672873+0000","last_unstale":"2023-11-28T12:07:41.689571+0000","last_undegraded":"2023-11-28T12:07:41.689571+0000","last_fullsized":"2023-11-28T12:07:41.689571+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:51:19.561073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.681453+0000","last_change":"2023-11-28T12:07:41.676667+0000","last_active":"2023-11-28T12:07:41.681453+0000","last_peered":"2023-11-28T12:07:41.681453+0000","last_clean":"2023-11-28T12:07:41.681453+0000","last_became_active":"2023-11-28T12:07:41.676371+0000","last_became_peered":"2023-11-28T12:07:41.676371+0000","last_unstale":"2023-11-28T12:07:41.681453+0000","last_undegraded":"2023-11-28T12:07:41.681453+0000","last_fullsized":"2023-11-28T12:07:41.681453+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:48:09.410549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.688697+0000","last_change":"2023-11-28T12:07:41.681036+0000","last_active":"2023-11-28T12:07:41.688697+0000","last_peered":"2023-11-28T12:07:41.688697+0000","last_clean":"2023-11-28T12:07:41.688697+0000","last_became_active":"2023-11-28T12:07:41.677905+0000","last_became_peered":"2023-11-28T12:07:41.677905+0000","last_unstale":"2023-11-28T12:07:41.688697+0000","last_undegraded":"2023-11-28T12:07:41.688697+0000","last_fullsized":"2023-11-28T12:07:41.688697+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:36:32.514106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.690883+0000","last_change":"2023-11-28T12:07:41.687067+0000","last_active":"2023-11-28T12:07:41.690883+0000","last_peered":"2023-11-28T12:07:41.690883+0000","last_clean":"2023-11-28T12:07:41.690883+0000","last_became_active":"2023-11-28T12:07:41.686779+0000","last_became_peered":"2023-11-28T12:07:41.686779+0000","last_unstale":"2023-11-28T12:07:41.690883+0000","last_undegraded":"2023-11-28T12:07:41.690883+0000","last_fullsized":"2023-11-28T12:07:41.690883+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:02:13.155906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.682151+0000","last_change":"2023-11-28T12:07:41.676541+0000","last_active":"2023-11-28T12:07:41.682151+0000","last_peered":"2023-11-28T12:07:41.682151+0000","last_clean":"2023-11-28T12:07:41.682151+0000","last_became_active":"2023-11-28T12:07:41.676197+0000","last_became_peered":"2023-11-28T12:07:41.676197+0000","last_unstale":"2023-11-28T12:07:41.682151+0000","last_undegraded":"2023-11-28T12:07:41.682151+0000","last_fullsized":"2023-11-28T12:07:41.682151+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:17:46.712157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.689922+0000","last_change":"2023-11-28T12:07:41.688268+0000","last_active":"2023-11-28T12:07:41.689922+0000","last_peered":"2023-11-28T12:07:41.689922+0000","last_clean":"2023-11-28T12:07:41.689922+0000","last_became_active":"2023-11-28T12:07:41.687755+0000","last_became_peered":"2023-11-28T12:07:41.687755+0000","last_unstale":"2023-11-28T12:07:41.689922+0000","last_undegraded":"2023-11-28T12:07:41.689922+0000","last_fullsized":"2023-11-28T12:07:41.689922+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:07:05.409362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.682511+0000","last_change":"2023-11-28T12:07:41.674798+0000","last_active":"2023-11-28T12:07:41.682511+0000","last_peered":"2023-11-28T12:07:41.682511+0000","last_clean":"2023-11-28T12:07:41.682511+0000","last_became_active":"2023-11-28T12:07:41.674460+0000","last_became_peered":"2023-11-28T12:07:41.674460+0000","last_unstale":"2023-11-28T12:07:41.682511+0000","last_undegraded":"2023-11-28T12:07:41.682511+0000","last_fullsized":"2023-11-28T12:07:41.682511+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:46:35.658317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.689327+0000","last_change":"2023-11-28T12:07:41.671921+0000","last_active":"2023-11-28T12:07:41.689327+0000","last_peered":"2023-11-28T12:07:41.689327+0000","last_clean":"2023-11-28T12:07:41.689327+0000","last_became_active":"2023-11-28T12:07:41.671604+0000","last_became_peered":"2023-11-28T12:07:41.671604+0000","last_unstale":"2023-11-28T12:07:41.689327+0000","last_undegraded":"2023-11-28T12:07:41.689327+0000","last_fullsized":"2023-11-28T12:07:41.689327+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:19:36.237111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.682177+0000","last_change":"2023-11-28T12:07:41.678092+0000","last_active":"2023-11-28T12:07:41.682177+0000","last_peered":"2023-11-28T12:07:41.682177+0000","last_clean":"2023-11-28T12:07:41.682177+0000","last_became_active":"2023-11-28T12:07:41.677407+0000","last_became_peered":"2023-11-28T12:07:41.677407+0000","last_unstale":"2023-11-28T12:07:41.682177+0000","last_undegraded":"2023-11-28T12:07:41.682177+0000","last_fullsized":"2023-11-28T12:07:41.682177+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:02:13.155906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.681776+0000","last_change":"2023-11-28T12:07:41.674297+0000","last_active":"2023-11-28T12:07:41.681776+0000","last_peered":"2023-11-28T12:07:41.681776+0000","last_clean":"2023-11-28T12:07:41.681776+0000","last_became_active":"2023-11-28T12:07:41.673843+0000","last_became_peered":"2023-11-28T12:07:41.673843+0000","last_unstale":"2023-11-28T12:07:41.681776+0000","last_undegraded":"2023-11-28T12:07:41.681776+0000","last_fullsized":"2023-11-28T12:07:41.681776+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:55:26.362077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.690352+0000","last_change":"2023-11-28T12:07:41.681317+0000","last_active":"2023-11-28T12:07:41.690352+0000","last_peered":"2023-11-28T12:07:41.690352+0000","last_clean":"2023-11-28T12:07:41.690352+0000","last_became_active":"2023-11-28T12:07:41.677452+0000","last_became_peered":"2023-11-28T12:07:41.677452+0000","last_unstale":"2023-11-28T12:07:41.690352+0000","last_undegraded":"2023-11-28T12:07:41.690352+0000","last_fullsized":"2023-11-28T12:07:41.690352+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:04:15.307550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.681709+0000","last_change":"2023-11-28T12:07:41.679619+0000","last_active":"2023-11-28T12:07:41.681709+0000","last_peered":"2023-11-28T12:07:41.681709+0000","last_clean":"2023-11-28T12:07:41.681709+0000","last_became_active":"2023-11-28T12:07:41.679311+0000","last_became_peered":"2023-11-28T12:07:41.679311+0000","last_unstale":"2023-11-28T12:07:41.681709+0000","last_undegraded":"2023-11-28T12:07:41.681709+0000","last_fullsized":"2023-11-28T12:07:41.681709+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:28:50.548371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.690909+0000","last_change":"2023-11-28T12:07:41.683700+0000","last_active":"2023-11-28T12:07:41.690909+0000","last_peered":"2023-11-28T12:07:41.690909+0000","last_clean":"2023-11-28T12:07:41.690909+0000","last_became_active":"2023-11-28T12:07:41.683457+0000","last_became_peered":"2023-11-28T12:07:41.683457+0000","last_unstale":"2023-11-28T12:07:41.690909+0000","last_undegraded":"2023-11-28T12:07:41.690909+0000","last_fullsized":"2023-11-28T12:07:41.690909+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:22:57.069288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"33'4","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.691510+0000","last_change":"2023-11-28T12:07:41.165809+0000","last_active":"2023-11-28T12:07:41.691510+0000","last_peered":"2023-11-28T12:07:41.691510+0000","last_clean":"2023-11-28T12:07:41.691510+0000","last_became_active":"2023-11-28T12:07:41.163993+0000","last_became_peered":"2023-11-28T12:07:41.163993+0000","last_unstale":"2023-11-28T12:07:41.691510+0000","last_undegraded":"2023-11-28T12:07:41.691510+0000","last_fullsized":"2023-11-28T12:07:41.691510+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:48:59.983563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.690076+0000","last_change":"2023-11-28T12:07:41.687474+0000","last_active":"2023-11-28T12:07:41.690076+0000","last_peered":"2023-11-28T12:07:41.690076+0000","last_clean":"2023-11-28T12:07:41.690076+0000","last_became_active":"2023-11-28T12:07:41.687222+0000","last_became_peered":"2023-11-28T12:07:41.687222+0000","last_unstale":"2023-11-28T12:07:41.690076+0000","last_undegraded":"2023-11-28T12:07:41.690076+0000","last_fullsized":"2023-11-28T12:07:41.690076+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:21:19.797120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"33'1","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.689073+0000","last_change":"2023-11-28T12:07:41.167048+0000","last_active":"2023-11-28T12:07:41.689073+0000","last_peered":"2023-11-28T12:07:41.689073+0000","last_clean":"2023-11-28T12:07:41.689073+0000","last_became_active":"2023-11-28T12:07:41.166528+0000","last_became_peered":"2023-11-28T12:07:41.166528+0000","last_unstale":"2023-11-28T12:07:41.689073+0000","last_undegraded":"2023-11-28T12:07:41.689073+0000","last_fullsized":"2023-11-28T12:07:41.689073+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:03:41.008569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.681228+0000","last_change":"2023-11-28T12:07:41.672390+0000","last_active":"2023-11-28T12:07:41.681228+0000","last_peered":"2023-11-28T12:07:41.681228+0000","last_clean":"2023-11-28T12:07:41.681228+0000","last_became_active":"2023-11-28T12:07:41.672140+0000","last_became_peered":"2023-11-28T12:07:41.672140+0000","last_unstale":"2023-11-28T12:07:41.681228+0000","last_undegraded":"2023-11-28T12:07:41.681228+0000","last_fullsized":"2023-11-28T12:07:41.681228+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:42:14.979933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"33'2","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.693773+0000","last_change":"2023-11-28T12:07:41.169488+0000","last_active":"2023-11-28T12:07:41.693773+0000","last_peered":"2023-11-28T12:07:41.693773+0000","last_clean":"2023-11-28T12:07:41.693773+0000","last_became_active":"2023-11-28T12:07:41.169172+0000","last_became_peered":"2023-11-28T12:07:41.169172+0000","last_unstale":"2023-11-28T12:07:41.693773+0000","last_undegraded":"2023-11-28T12:07:41.693773+0000","last_fullsized":"2023-11-28T12:07:41.693773+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:36:37.411602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.691978+0000","last_change":"2023-11-28T12:07:41.686349+0000","last_active":"2023-11-28T12:07:41.691978+0000","last_peered":"2023-11-28T12:07:41.691978+0000","last_clean":"2023-11-28T12:07:41.691978+0000","last_became_active":"2023-11-28T12:07:41.686098+0000","last_became_peered":"2023-11-28T12:07:41.686098+0000","last_unstale":"2023-11-28T12:07:41.691978+0000","last_undegraded":"2023-11-28T12:07:41.691978+0000","last_fullsized":"2023-11-28T12:07:41.691978+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:21:09.502744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"33'2","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.693043+0000","last_change":"2023-11-28T12:07:41.163567+0000","last_active":"2023-11-28T12:07:41.693043+0000","last_peered":"2023-11-28T12:07:41.693043+0000","last_clean":"2023-11-28T12:07:41.693043+0000","last_became_active":"2023-11-28T12:07:41.162624+0000","last_became_peered":"2023-11-28T12:07:41.162624+0000","last_unstale":"2023-11-28T12:07:41.693043+0000","last_undegraded":"2023-11-28T12:07:41.693043+0000","last_fullsized":"2023-11-28T12:07:41.693043+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:19:35.229484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.676656+0000","last_change":"2023-11-28T12:07:41.669103+0000","last_active":"2023-11-28T12:07:41.676656+0000","last_peered":"2023-11-28T12:07:41.676656+0000","last_clean":"2023-11-28T12:07:41.676656+0000","last_became_active":"2023-11-28T12:07:41.668134+0000","last_became_peered":"2023-11-28T12:07:41.668134+0000","last_unstale":"2023-11-28T12:07:41.676656+0000","last_undegraded":"2023-11-28T12:07:41.676656+0000","last_fullsized":"2023-11-28T12:07:41.676656+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:51:19.561073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"33'1","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.689603+0000","last_change":"2023-11-28T12:07:41.170651+0000","last_active":"2023-11-28T12:07:41.689603+0000","last_peered":"2023-11-28T12:07:41.689603+0000","last_clean":"2023-11-28T12:07:41.689603+0000","last_became_active":"2023-11-28T12:07:41.170273+0000","last_became_peered":"2023-11-28T12:07:41.170273+0000","last_unstale":"2023-11-28T12:07:41.689603+0000","last_undegraded":"2023-11-28T12:07:41.689603+0000","last_fullsized":"2023-11-28T12:07:41.689603+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:01:45.697262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.689751+0000","last_change":"2023-11-28T12:07:41.672407+0000","last_active":"2023-11-28T12:07:41.689751+0000","last_peered":"2023-11-28T12:07:41.689751+0000","last_clean":"2023-11-28T12:07:41.689751+0000","last_became_active":"2023-11-28T12:07:41.672058+0000","last_became_peered":"2023-11-28T12:07:41.672058+0000","last_unstale":"2023-11-28T12:07:41.689751+0000","last_undegraded":"2023-11-28T12:07:41.689751+0000","last_fullsized":"2023-11-28T12:07:41.689751+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:40:24.727337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"33'1","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.686021+0000","last_change":"2023-11-28T12:07:41.168201+0000","last_active":"2023-11-28T12:07:41.686021+0000","last_peered":"2023-11-28T12:07:41.686021+0000","last_clean":"2023-11-28T12:07:41.686021+0000","last_became_active":"2023-11-28T12:07:41.166578+0000","last_became_peered":"2023-11-28T12:07:41.166578+0000","last_unstale":"2023-11-28T12:07:41.686021+0000","last_undegraded":"2023-11-28T12:07:41.686021+0000","last_fullsized":"2023-11-28T12:07:41.686021+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:28:20.315709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.692863+0000","last_change":"2023-11-28T12:07:41.689839+0000","last_active":"2023-11-28T12:07:41.692863+0000","last_peered":"2023-11-28T12:07:41.692863+0000","last_clean":"2023-11-28T12:07:41.692863+0000","last_became_active":"2023-11-28T12:07:41.689047+0000","last_became_peered":"2023-11-28T12:07:41.689047+0000","last_unstale":"2023-11-28T12:07:41.692863+0000","last_undegraded":"2023-11-28T12:07:41.692863+0000","last_fullsized":"2023-11-28T12:07:41.692863+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:36:26.400203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.665230+0000","last_change":"2023-11-28T12:07:41.167334+0000","last_active":"2023-11-28T12:07:41.665230+0000","last_peered":"2023-11-28T12:07:41.665230+0000","last_clean":"2023-11-28T12:07:41.665230+0000","last_became_active":"2023-11-28T12:07:41.166499+0000","last_became_peered":"2023-11-28T12:07:41.166499+0000","last_unstale":"2023-11-28T12:07:41.665230+0000","last_undegraded":"2023-11-28T12:07:41.665230+0000","last_fullsized":"2023-11-28T12:07:41.665230+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:28:20.315709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.688919+0000","last_change":"2023-11-28T12:07:41.684191+0000","last_active":"2023-11-28T12:07:41.688919+0000","last_peered":"2023-11-28T12:07:41.688919+0000","last_clean":"2023-11-28T12:07:41.688919+0000","last_became_active":"2023-11-28T12:07:41.679843+0000","last_became_peered":"2023-11-28T12:07:41.679843+0000","last_unstale":"2023-11-28T12:07:41.688919+0000","last_undegraded":"2023-11-28T12:07:41.688919+0000","last_fullsized":"2023-11-28T12:07:41.688919+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:15:46.212373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.661043+0000","last_change":"2023-11-28T12:07:41.163322+0000","last_active":"2023-11-28T12:07:41.661043+0000","last_peered":"2023-11-28T12:07:41.661043+0000","last_clean":"2023-11-28T12:07:41.661043+0000","last_became_active":"2023-11-28T12:07:41.161561+0000","last_became_peered":"2023-11-28T12:07:41.161561+0000","last_unstale":"2023-11-28T12:07:41.661043+0000","last_undegraded":"2023-11-28T12:07:41.661043+0000","last_fullsized":"2023-11-28T12:07:41.661043+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:07:04.401735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.684301+0000","last_change":"2023-11-28T12:07:41.683663+0000","last_active":"2023-11-28T12:07:41.684301+0000","last_peered":"2023-11-28T12:07:41.684301+0000","last_clean":"2023-11-28T12:07:41.684301+0000","last_became_active":"2023-11-28T12:07:41.682678+0000","last_became_peered":"2023-11-28T12:07:41.682678+0000","last_unstale":"2023-11-28T12:07:41.684301+0000","last_undegraded":"2023-11-28T12:07:41.684301+0000","last_fullsized":"2023-11-28T12:07:41.684301+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:03:42.016196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.672879+0000","last_change":"2023-11-28T12:07:41.170122+0000","last_active":"2023-11-28T12:07:41.672879+0000","last_peered":"2023-11-28T12:07:41.672879+0000","last_clean":"2023-11-28T12:07:41.672879+0000","last_became_active":"2023-11-28T12:07:41.168780+0000","last_became_peered":"2023-11-28T12:07:41.168780+0000","last_unstale":"2023-11-28T12:07:41.672879+0000","last_undegraded":"2023-11-28T12:07:41.672879+0000","last_fullsized":"2023-11-28T12:07:41.672879+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:10:51.007442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.679625+0000","last_change":"2023-11-28T12:07:41.677312+0000","last_active":"2023-11-28T12:07:41.679625+0000","last_peered":"2023-11-28T12:07:41.679625+0000","last_clean":"2023-11-28T12:07:41.679625+0000","last_became_active":"2023-11-28T12:07:41.677004+0000","last_became_peered":"2023-11-28T12:07:41.677004+0000","last_unstale":"2023-11-28T12:07:41.679625+0000","last_undegraded":"2023-11-28T12:07:41.679625+0000","last_fullsized":"2023-11-28T12:07:41.679625+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:51:19.561073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.667434+0000","last_change":"2023-11-28T12:07:41.168616+0000","last_active":"2023-11-28T12:07:41.667434+0000","last_peered":"2023-11-28T12:07:41.667434+0000","last_clean":"2023-11-28T12:07:41.667434+0000","last_became_active":"2023-11-28T12:07:41.168368+0000","last_became_peered":"2023-11-28T12:07:41.168368+0000","last_unstale":"2023-11-28T12:07:41.667434+0000","last_undegraded":"2023-11-28T12:07:41.667434+0000","last_fullsized":"2023-11-28T12:07:41.667434+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:43:58.515090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.667621+0000","last_change":"2023-11-28T12:07:41.665082+0000","last_active":"2023-11-28T12:07:41.667621+0000","last_peered":"2023-11-28T12:07:41.667621+0000","last_clean":"2023-11-28T12:07:41.667621+0000","last_became_active":"2023-11-28T12:07:41.664786+0000","last_became_peered":"2023-11-28T12:07:41.664786+0000","last_unstale":"2023-11-28T12:07:41.667621+0000","last_undegraded":"2023-11-28T12:07:41.667621+0000","last_fullsized":"2023-11-28T12:07:41.667621+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:40:24.727337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"33'3","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.691717+0000","last_change":"2023-11-28T12:07:41.168261+0000","last_active":"2023-11-28T12:07:41.691717+0000","last_peered":"2023-11-28T12:07:41.691717+0000","last_clean":"2023-11-28T12:07:41.691717+0000","last_became_active":"2023-11-28T12:07:41.167980+0000","last_became_peered":"2023-11-28T12:07:41.167980+0000","last_unstale":"2023-11-28T12:07:41.691717+0000","last_undegraded":"2023-11-28T12:07:41.691717+0000","last_fullsized":"2023-11-28T12:07:41.691717+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:46:34.650690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.683561+0000","last_change":"2023-11-28T12:07:41.678504+0000","last_active":"2023-11-28T12:07:41.683561+0000","last_peered":"2023-11-28T12:07:41.683561+0000","last_clean":"2023-11-28T12:07:41.683561+0000","last_became_active":"2023-11-28T12:07:41.678236+0000","last_became_peered":"2023-11-28T12:07:41.678236+0000","last_unstale":"2023-11-28T12:07:41.683561+0000","last_undegraded":"2023-11-28T12:07:41.683561+0000","last_fullsized":"2023-11-28T12:07:41.683561+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:46:48.928670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"33'6","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.696041+0000","last_change":"2023-11-28T12:07:41.164624+0000","last_active":"2023-11-28T12:07:41.696041+0000","last_peered":"2023-11-28T12:07:41.696041+0000","last_clean":"2023-11-28T12:07:41.696041+0000","last_became_active":"2023-11-28T12:07:41.164356+0000","last_became_peered":"2023-11-28T12:07:41.164356+0000","last_unstale":"2023-11-28T12:07:41.696041+0000","last_undegraded":"2023-11-28T12:07:41.696041+0000","last_fullsized":"2023-11-28T12:07:41.696041+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:02:12.148279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.676789+0000","last_change":"2023-11-28T12:07:41.669272+0000","last_active":"2023-11-28T12:07:41.676789+0000","last_peered":"2023-11-28T12:07:41.676789+0000","last_clean":"2023-11-28T12:07:41.676789+0000","last_became_active":"2023-11-28T12:07:41.668478+0000","last_became_peered":"2023-11-28T12:07:41.668478+0000","last_unstale":"2023-11-28T12:07:41.676789+0000","last_undegraded":"2023-11-28T12:07:41.676789+0000","last_fullsized":"2023-11-28T12:07:41.676789+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:32:42.598768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"33'2","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.690764+0000","last_change":"2023-11-28T12:07:41.159717+0000","last_active":"2023-11-28T12:07:41.690764+0000","last_peered":"2023-11-28T12:07:41.690764+0000","last_clean":"2023-11-28T12:07:41.690764+0000","last_became_active":"2023-11-28T12:07:41.159459+0000","last_became_peered":"2023-11-28T12:07:41.159459+0000","last_unstale":"2023-11-28T12:07:41.690764+0000","last_undegraded":"2023-11-28T12:07:41.690764+0000","last_fullsized":"2023-11-28T12:07:41.690764+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:03:41.008569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.684111+0000","last_change":"2023-11-28T12:07:41.678301+0000","last_active":"2023-11-28T12:07:41.684111+0000","last_peered":"2023-11-28T12:07:41.684111+0000","last_clean":"2023-11-28T12:07:41.684111+0000","last_became_active":"2023-11-28T12:07:41.677122+0000","last_became_peered":"2023-11-28T12:07:41.677122+0000","last_unstale":"2023-11-28T12:07:41.684111+0000","last_undegraded":"2023-11-28T12:07:41.684111+0000","last_fullsized":"2023-11-28T12:07:41.684111+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:36:32.514106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.664970+0000","last_change":"2023-11-28T12:07:41.168453+0000","last_active":"2023-11-28T12:07:41.664970+0000","last_peered":"2023-11-28T12:07:41.664970+0000","last_clean":"2023-11-28T12:07:41.664970+0000","last_became_active":"2023-11-28T12:07:41.168179+0000","last_became_peered":"2023-11-28T12:07:41.168179+0000","last_unstale":"2023-11-28T12:07:41.664970+0000","last_undegraded":"2023-11-28T12:07:41.664970+0000","last_fullsized":"2023-11-28T12:07:41.664970+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:43:58.515090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.690811+0000","last_change":"2023-11-28T12:07:41.685414+0000","last_active":"2023-11-28T12:07:41.690811+0000","last_peered":"2023-11-28T12:07:41.690811+0000","last_clean":"2023-11-28T12:07:41.690811+0000","last_became_active":"2023-11-28T12:07:41.680348+0000","last_became_peered":"2023-11-28T12:07:41.680348+0000","last_unstale":"2023-11-28T12:07:41.690811+0000","last_undegraded":"2023-11-28T12:07:41.690811+0000","last_fullsized":"2023-11-28T12:07:41.690811+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:32:42.598768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.663310+0000","last_change":"2023-11-28T12:07:41.157503+0000","last_active":"2023-11-28T12:07:41.663310+0000","last_peered":"2023-11-28T12:07:41.663310+0000","last_clean":"2023-11-28T12:07:41.663310+0000","last_became_active":"2023-11-28T12:07:41.156917+0000","last_became_peered":"2023-11-28T12:07:41.156917+0000","last_unstale":"2023-11-28T12:07:41.663310+0000","last_undegraded":"2023-11-28T12:07:41.663310+0000","last_fullsized":"2023-11-28T12:07:41.663310+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:21:58.563957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.692101+0000","last_change":"2023-11-28T12:07:41.690777+0000","last_active":"2023-11-28T12:07:41.692101+0000","last_peered":"2023-11-28T12:07:41.692101+0000","last_clean":"2023-11-28T12:07:41.692101+0000","last_became_active":"2023-11-28T12:07:41.690167+0000","last_became_peered":"2023-11-28T12:07:41.690167+0000","last_unstale":"2023-11-28T12:07:41.692101+0000","last_undegraded":"2023-11-28T12:07:41.692101+0000","last_fullsized":"2023-11-28T12:07:41.692101+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:21:44.583002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"33'8","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.691162+0000","last_change":"2023-11-28T12:07:41.166866+0000","last_active":"2023-11-28T12:07:41.691162+0000","last_peered":"2023-11-28T12:07:41.691162+0000","last_clean":"2023-11-28T12:07:41.691162+0000","last_became_active":"2023-11-28T12:07:41.166584+0000","last_became_peered":"2023-11-28T12:07:41.166584+0000","last_unstale":"2023-11-28T12:07:41.691162+0000","last_undegraded":"2023-11-28T12:07:41.691162+0000","last_fullsized":"2023-11-28T12:07:41.691162+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:43:58.515090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.689877+0000","last_change":"2023-11-28T12:07:41.686016+0000","last_active":"2023-11-28T12:07:41.689877+0000","last_peered":"2023-11-28T12:07:41.689877+0000","last_clean":"2023-11-28T12:07:41.689877+0000","last_became_active":"2023-11-28T12:07:41.685765+0000","last_became_peered":"2023-11-28T12:07:41.685765+0000","last_unstale":"2023-11-28T12:07:41.689877+0000","last_undegraded":"2023-11-28T12:07:41.689877+0000","last_fullsized":"2023-11-28T12:07:41.689877+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:48:09.410549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'1","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.690183+0000","last_change":"2023-11-28T12:07:41.171141+0000","last_active":"2023-11-28T12:07:41.690183+0000","last_peered":"2023-11-28T12:07:41.690183+0000","last_clean":"2023-11-28T12:07:41.690183+0000","last_became_active":"2023-11-28T12:07:41.170256+0000","last_became_peered":"2023-11-28T12:07:41.170256+0000","last_unstale":"2023-11-28T12:07:41.690183+0000","last_undegraded":"2023-11-28T12:07:41.690183+0000","last_fullsized":"2023-11-28T12:07:41.690183+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:17:45.704529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.688151+0000","last_change":"2023-11-28T12:07:41.668762+0000","last_active":"2023-11-28T12:07:41.688151+0000","last_peered":"2023-11-28T12:07:41.688151+0000","last_clean":"2023-11-28T12:07:41.688151+0000","last_became_active":"2023-11-28T12:07:41.668434+0000","last_became_peered":"2023-11-28T12:07:41.668434+0000","last_unstale":"2023-11-28T12:07:41.688151+0000","last_undegraded":"2023-11-28T12:07:41.688151+0000","last_fullsized":"2023-11-28T12:07:41.688151+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:21:44.583002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"33'2","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.695764+0000","last_change":"2023-11-28T12:07:41.171992+0000","last_active":"2023-11-28T12:07:41.695764+0000","last_peered":"2023-11-28T12:07:41.695764+0000","last_clean":"2023-11-28T12:07:41.695764+0000","last_became_active":"2023-11-28T12:07:41.171295+0000","last_became_peered":"2023-11-28T12:07:41.171295+0000","last_unstale":"2023-11-28T12:07:41.695764+0000","last_undegraded":"2023-11-28T12:07:41.695764+0000","last_fullsized":"2023-11-28T12:07:41.695764+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:22:56.061661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.681293+0000","last_change":"2023-11-28T12:07:41.674383+0000","last_active":"2023-11-28T12:07:41.681293+0000","last_peered":"2023-11-28T12:07:41.681293+0000","last_clean":"2023-11-28T12:07:41.681293+0000","last_became_active":"2023-11-28T12:07:41.671811+0000","last_became_peered":"2023-11-28T12:07:41.671811+0000","last_unstale":"2023-11-28T12:07:41.681293+0000","last_undegraded":"2023-11-28T12:07:41.681293+0000","last_fullsized":"2023-11-28T12:07:41.681293+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:29:27.513071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"33'1","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.691387+0000","last_change":"2023-11-28T12:07:41.166346+0000","last_active":"2023-11-28T12:07:41.691387+0000","last_peered":"2023-11-28T12:07:41.691387+0000","last_clean":"2023-11-28T12:07:41.691387+0000","last_became_active":"2023-11-28T12:07:41.165885+0000","last_became_peered":"2023-11-28T12:07:41.165885+0000","last_unstale":"2023-11-28T12:07:41.691387+0000","last_undegraded":"2023-11-28T12:07:41.691387+0000","last_fullsized":"2023-11-28T12:07:41.691387+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:21:58.563957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.677418+0000","last_change":"2023-11-28T12:07:41.673522+0000","last_active":"2023-11-28T12:07:41.677418+0000","last_peered":"2023-11-28T12:07:41.677418+0000","last_clean":"2023-11-28T12:07:41.677418+0000","last_became_active":"2023-11-28T12:07:41.671627+0000","last_became_peered":"2023-11-28T12:07:41.671627+0000","last_unstale":"2023-11-28T12:07:41.677418+0000","last_undegraded":"2023-11-28T12:07:41.677418+0000","last_fullsized":"2023-11-28T12:07:41.677418+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:55:26.362077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.665753+0000","last_change":"2023-11-28T12:07:41.167652+0000","last_active":"2023-11-28T12:07:41.665753+0000","last_peered":"2023-11-28T12:07:41.665753+0000","last_clean":"2023-11-28T12:07:41.665753+0000","last_became_active":"2023-11-28T12:07:41.166796+0000","last_became_peered":"2023-11-28T12:07:41.166796+0000","last_unstale":"2023-11-28T12:07:41.665753+0000","last_undegraded":"2023-11-28T12:07:41.665753+0000","last_fullsized":"2023-11-28T12:07:41.665753+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:01:45.697262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.690641+0000","last_change":"2023-11-28T12:07:41.680907+0000","last_active":"2023-11-28T12:07:41.690641+0000","last_peered":"2023-11-28T12:07:41.690641+0000","last_clean":"2023-11-28T12:07:41.690641+0000","last_became_active":"2023-11-28T12:07:41.679482+0000","last_became_peered":"2023-11-28T12:07:41.679482+0000","last_unstale":"2023-11-28T12:07:41.690641+0000","last_undegraded":"2023-11-28T12:07:41.690641+0000","last_fullsized":"2023-11-28T12:07:41.690641+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:02:08.714843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"33'2","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.690932+0000","last_change":"2023-11-28T12:07:41.160266+0000","last_active":"2023-11-28T12:07:41.690932+0000","last_peered":"2023-11-28T12:07:41.690932+0000","last_clean":"2023-11-28T12:07:41.690932+0000","last_became_active":"2023-11-28T12:07:41.160022+0000","last_became_peered":"2023-11-28T12:07:41.160022+0000","last_unstale":"2023-11-28T12:07:41.690932+0000","last_undegraded":"2023-11-28T12:07:41.690932+0000","last_fullsized":"2023-11-28T12:07:41.690932+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:16:20.525710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.675598+0000","last_change":"2023-11-28T12:07:41.665274+0000","last_active":"2023-11-28T12:07:41.675598+0000","last_peered":"2023-11-28T12:07:41.675598+0000","last_clean":"2023-11-28T12:07:41.675598+0000","last_became_active":"2023-11-28T12:07:41.665010+0000","last_became_peered":"2023-11-28T12:07:41.665010+0000","last_unstale":"2023-11-28T12:07:41.675598+0000","last_undegraded":"2023-11-28T12:07:41.675598+0000","last_fullsized":"2023-11-28T12:07:41.675598+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:38:08.530818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.660770+0000","last_change":"2023-11-28T12:07:41.163164+0000","last_active":"2023-11-28T12:07:41.660770+0000","last_peered":"2023-11-28T12:07:41.660770+0000","last_clean":"2023-11-28T12:07:41.660770+0000","last_became_active":"2023-11-28T12:07:41.162678+0000","last_became_peered":"2023-11-28T12:07:41.162678+0000","last_unstale":"2023-11-28T12:07:41.660770+0000","last_undegraded":"2023-11-28T12:07:41.660770+0000","last_fullsized":"2023-11-28T12:07:41.660770+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:39:04.670777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.687980+0000","last_change":"2023-11-28T12:07:41.668788+0000","last_active":"2023-11-28T12:07:41.687980+0000","last_peered":"2023-11-28T12:07:41.687980+0000","last_clean":"2023-11-28T12:07:41.687980+0000","last_became_active":"2023-11-28T12:07:41.668469+0000","last_became_peered":"2023-11-28T12:07:41.668469+0000","last_unstale":"2023-11-28T12:07:41.687980+0000","last_undegraded":"2023-11-28T12:07:41.687980+0000","last_fullsized":"2023-11-28T12:07:41.687980+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:38:08.530818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.661018+0000","last_change":"2023-11-28T12:07:41.166168+0000","last_active":"2023-11-28T12:07:41.661018+0000","last_peered":"2023-11-28T12:07:41.661018+0000","last_clean":"2023-11-28T12:07:41.661018+0000","last_became_active":"2023-11-28T12:07:41.164114+0000","last_became_peered":"2023-11-28T12:07:41.164114+0000","last_unstale":"2023-11-28T12:07:41.661018+0000","last_undegraded":"2023-11-28T12:07:41.661018+0000","last_fullsized":"2023-11-28T12:07:41.661018+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:01:45.697262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.690829+0000","last_change":"2023-11-28T12:07:41.686502+0000","last_active":"2023-11-28T12:07:41.690829+0000","last_peered":"2023-11-28T12:07:41.690829+0000","last_clean":"2023-11-28T12:07:41.690829+0000","last_became_active":"2023-11-28T12:07:41.679477+0000","last_became_peered":"2023-11-28T12:07:41.679477+0000","last_unstale":"2023-11-28T12:07:41.690829+0000","last_undegraded":"2023-11-28T12:07:41.690829+0000","last_fullsized":"2023-11-28T12:07:41.690829+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:53:09.125880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.660904+0000","last_change":"2023-11-28T12:07:41.162583+0000","last_active":"2023-11-28T12:07:41.660904+0000","last_peered":"2023-11-28T12:07:41.660904+0000","last_clean":"2023-11-28T12:07:41.660904+0000","last_became_active":"2023-11-28T12:07:41.161213+0000","last_became_peered":"2023-11-28T12:07:41.161213+0000","last_unstale":"2023-11-28T12:07:41.660904+0000","last_undegraded":"2023-11-28T12:07:41.660904+0000","last_fullsized":"2023-11-28T12:07:41.660904+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:48:59.983563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.681400+0000","last_change":"2023-11-28T12:07:41.673687+0000","last_active":"2023-11-28T12:07:41.681400+0000","last_peered":"2023-11-28T12:07:41.681400+0000","last_clean":"2023-11-28T12:07:41.681400+0000","last_became_active":"2023-11-28T12:07:41.673381+0000","last_became_peered":"2023-11-28T12:07:41.673381+0000","last_unstale":"2023-11-28T12:07:41.681400+0000","last_undegraded":"2023-11-28T12:07:41.681400+0000","last_fullsized":"2023-11-28T12:07:41.681400+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:15:46.212373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.661713+0000","last_change":"2023-11-28T12:07:41.154433+0000","last_active":"2023-11-28T12:07:41.661713+0000","last_peered":"2023-11-28T12:07:41.661713+0000","last_clean":"2023-11-28T12:07:41.661713+0000","last_became_active":"2023-11-28T12:07:41.154159+0000","last_became_peered":"2023-11-28T12:07:41.154159+0000","last_unstale":"2023-11-28T12:07:41.661713+0000","last_undegraded":"2023-11-28T12:07:41.661713+0000","last_fullsized":"2023-11-28T12:07:41.661713+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:04:14.299923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.665095+0000","last_change":"2023-11-28T12:06:23.961595+0000","last_active":"2023-11-28T12:07:41.665095+0000","last_peered":"2023-11-28T12:07:41.665095+0000","last_clean":"2023-11-28T12:07:41.665095+0000","last_became_active":"2023-11-28T12:06:23.961257+0000","last_became_peered":"2023-11-28T12:06:23.961257+0000","last_unstale":"2023-11-28T12:07:41.665095+0000","last_undegraded":"2023-11-28T12:07:41.665095+0000","last_fullsized":"2023-11-28T12:07:41.665095+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:30:40.200095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.675826+0000","last_change":"2023-11-28T12:07:41.669926+0000","last_active":"2023-11-28T12:07:41.675826+0000","last_peered":"2023-11-28T12:07:41.675826+0000","last_clean":"2023-11-28T12:07:41.675826+0000","last_became_active":"2023-11-28T12:07:41.668601+0000","last_became_peered":"2023-11-28T12:07:41.668601+0000","last_unstale":"2023-11-28T12:07:41.675826+0000","last_undegraded":"2023-11-28T12:07:41.675826+0000","last_fullsized":"2023-11-28T12:07:41.675826+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:40:24.727337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.666468+0000","last_change":"2023-11-28T12:07:41.164138+0000","last_active":"2023-11-28T12:07:41.666468+0000","last_peered":"2023-11-28T12:07:41.666468+0000","last_clean":"2023-11-28T12:07:41.666468+0000","last_became_active":"2023-11-28T12:07:41.162131+0000","last_became_peered":"2023-11-28T12:07:41.162131+0000","last_unstale":"2023-11-28T12:07:41.666468+0000","last_undegraded":"2023-11-28T12:07:41.666468+0000","last_fullsized":"2023-11-28T12:07:41.666468+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:28:49.540743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.672282+0000","last_change":"2023-11-28T12:06:23.517505+0000","last_active":"2023-11-28T12:07:41.672282+0000","last_peered":"2023-11-28T12:07:41.672282+0000","last_clean":"2023-11-28T12:07:41.672282+0000","last_became_active":"2023-11-28T12:06:23.517151+0000","last_became_peered":"2023-11-28T12:06:23.517151+0000","last_unstale":"2023-11-28T12:07:41.672282+0000","last_undegraded":"2023-11-28T12:07:41.672282+0000","last_fullsized":"2023-11-28T12:07:41.672282+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:30:40.200095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.689291+0000","last_change":"2023-11-28T12:07:41.686333+0000","last_active":"2023-11-28T12:07:41.689291+0000","last_peered":"2023-11-28T12:07:41.689291+0000","last_clean":"2023-11-28T12:07:41.689291+0000","last_became_active":"2023-11-28T12:07:41.685998+0000","last_became_peered":"2023-11-28T12:07:41.685998+0000","last_unstale":"2023-11-28T12:07:41.689291+0000","last_undegraded":"2023-11-28T12:07:41.689291+0000","last_fullsized":"2023-11-28T12:07:41.689291+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:47:04.900190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"33'2","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.689981+0000","last_change":"2023-11-28T12:07:41.169674+0000","last_active":"2023-11-28T12:07:41.689981+0000","last_peered":"2023-11-28T12:07:41.689981+0000","last_clean":"2023-11-28T12:07:41.689981+0000","last_became_active":"2023-11-28T12:07:41.169182+0000","last_became_peered":"2023-11-28T12:07:41.169182+0000","last_unstale":"2023-11-28T12:07:41.689981+0000","last_undegraded":"2023-11-28T12:07:41.689981+0000","last_fullsized":"2023-11-28T12:07:41.689981+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:28:20.315709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.665021+0000","last_change":"2023-11-28T12:06:23.517967+0000","last_active":"2023-11-28T12:07:41.665021+0000","last_peered":"2023-11-28T12:07:41.665021+0000","last_clean":"2023-11-28T12:07:41.665021+0000","last_became_active":"2023-11-28T12:06:23.517495+0000","last_became_peered":"2023-11-28T12:06:23.517495+0000","last_unstale":"2023-11-28T12:07:41.665021+0000","last_undegraded":"2023-11-28T12:07:41.665021+0000","last_fullsized":"2023-11-28T12:07:41.665021+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:51:06.844441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":174,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.660198+0000","last_change":"2023-11-28T12:06:23.513472+0000","last_active":"2023-11-28T12:07:41.660198+0000","last_peered":"2023-11-28T12:07:41.660198+0000","last_clean":"2023-11-28T12:07:41.660198+0000","last_became_active":"2023-11-28T12:06:23.513150+0000","last_became_peered":"2023-11-28T12:06:23.513150+0000","last_unstale":"2023-11-28T12:07:41.660198+0000","last_undegraded":"2023-11-28T12:07:41.660198+0000","last_fullsized":"2023-11-28T12:07:41.660198+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:34:18.653049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.690717+0000","last_change":"2023-11-28T12:07:41.682538+0000","last_active":"2023-11-28T12:07:41.690717+0000","last_peered":"2023-11-28T12:07:41.690717+0000","last_clean":"2023-11-28T12:07:41.690717+0000","last_became_active":"2023-11-28T12:07:41.681947+0000","last_became_peered":"2023-11-28T12:07:41.681947+0000","last_unstale":"2023-11-28T12:07:41.690717+0000","last_undegraded":"2023-11-28T12:07:41.690717+0000","last_fullsized":"2023-11-28T12:07:41.690717+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:38:08.530818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.661017+0000","last_change":"2023-11-28T12:07:41.167454+0000","last_active":"2023-11-28T12:07:41.661017+0000","last_peered":"2023-11-28T12:07:41.661017+0000","last_clean":"2023-11-28T12:07:41.661017+0000","last_became_active":"2023-11-28T12:07:41.166407+0000","last_became_peered":"2023-11-28T12:07:41.166407+0000","last_unstale":"2023-11-28T12:07:41.661017+0000","last_undegraded":"2023-11-28T12:07:41.661017+0000","last_fullsized":"2023-11-28T12:07:41.661017+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:04:29.977354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.660905+0000","last_change":"2023-11-28T12:06:23.903708+0000","last_active":"2023-11-28T12:07:41.660905+0000","last_peered":"2023-11-28T12:07:41.660905+0000","last_clean":"2023-11-28T12:07:41.660905+0000","last_became_active":"2023-11-28T12:06:23.903399+0000","last_became_peered":"2023-11-28T12:06:23.903399+0000","last_unstale":"2023-11-28T12:07:41.660905+0000","last_undegraded":"2023-11-28T12:07:41.660905+0000","last_fullsized":"2023-11-28T12:07:41.660905+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:31:13.187145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.689803+0000","last_change":"2023-11-28T12:07:41.672199+0000","last_active":"2023-11-28T12:07:41.689803+0000","last_peered":"2023-11-28T12:07:41.689803+0000","last_clean":"2023-11-28T12:07:41.689803+0000","last_became_active":"2023-11-28T12:07:41.671612+0000","last_became_peered":"2023-11-28T12:07:41.671612+0000","last_unstale":"2023-11-28T12:07:41.689803+0000","last_undegraded":"2023-11-28T12:07:41.689803+0000","last_fullsized":"2023-11-28T12:07:41.689803+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:36:32.514106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.661351+0000","last_change":"2023-11-28T12:07:41.167913+0000","last_active":"2023-11-28T12:07:41.661351+0000","last_peered":"2023-11-28T12:07:41.661351+0000","last_clean":"2023-11-28T12:07:41.661351+0000","last_became_active":"2023-11-28T12:07:41.167043+0000","last_became_peered":"2023-11-28T12:07:41.167043+0000","last_unstale":"2023-11-28T12:07:41.661351+0000","last_undegraded":"2023-11-28T12:07:41.661351+0000","last_fullsized":"2023-11-28T12:07:41.661351+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:46:34.650690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.660107+0000","last_change":"2023-11-28T12:06:23.903662+0000","last_active":"2023-11-28T12:07:41.660107+0000","last_peered":"2023-11-28T12:07:41.660107+0000","last_clean":"2023-11-28T12:07:41.660107+0000","last_became_active":"2023-11-28T12:06:23.903354+0000","last_became_peered":"2023-11-28T12:06:23.903354+0000","last_unstale":"2023-11-28T12:07:41.660107+0000","last_undegraded":"2023-11-28T12:07:41.660107+0000","last_fullsized":"2023-11-28T12:07:41.660107+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:02:07.694087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.690942+0000","last_change":"2023-11-28T12:07:41.687791+0000","last_active":"2023-11-28T12:07:41.690942+0000","last_peered":"2023-11-28T12:07:41.690942+0000","last_clean":"2023-11-28T12:07:41.690942+0000","last_became_active":"2023-11-28T12:07:41.687372+0000","last_became_peered":"2023-11-28T12:07:41.687372+0000","last_unstale":"2023-11-28T12:07:41.690942+0000","last_undegraded":"2023-11-28T12:07:41.690942+0000","last_fullsized":"2023-11-28T12:07:41.690942+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:42:14.979933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.656027+0000","last_change":"2023-11-28T12:07:41.165591+0000","last_active":"2023-11-28T12:07:41.656027+0000","last_peered":"2023-11-28T12:07:41.656027+0000","last_clean":"2023-11-28T12:07:41.656027+0000","last_became_active":"2023-11-28T12:07:41.164238+0000","last_became_peered":"2023-11-28T12:07:41.164238+0000","last_unstale":"2023-11-28T12:07:41.656027+0000","last_undegraded":"2023-11-28T12:07:41.656027+0000","last_fullsized":"2023-11-28T12:07:41.656027+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:28:49.540743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":26,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.665567+0000","last_change":"2023-11-28T12:06:23.903797+0000","last_active":"2023-11-28T12:07:41.665567+0000","last_peered":"2023-11-28T12:07:41.665567+0000","last_clean":"2023-11-28T12:07:41.665567+0000","last_became_active":"2023-11-28T12:06:23.903475+0000","last_became_peered":"2023-11-28T12:06:23.903475+0000","last_unstale":"2023-11-28T12:07:41.665567+0000","last_undegraded":"2023-11-28T12:07:41.665567+0000","last_fullsized":"2023-11-28T12:07:41.665567+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:51:06.844441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.686499+0000","last_change":"2023-11-28T12:07:41.681551+0000","last_active":"2023-11-28T12:07:41.686499+0000","last_peered":"2023-11-28T12:07:41.686499+0000","last_clean":"2023-11-28T12:07:41.686499+0000","last_became_active":"2023-11-28T12:07:41.681288+0000","last_became_peered":"2023-11-28T12:07:41.681288+0000","last_unstale":"2023-11-28T12:07:41.686499+0000","last_undegraded":"2023-11-28T12:07:41.686499+0000","last_fullsized":"2023-11-28T12:07:41.686499+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:00:21.039405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.662676+0000","last_change":"2023-11-28T12:07:41.160433+0000","last_active":"2023-11-28T12:07:41.662676+0000","last_peered":"2023-11-28T12:07:41.662676+0000","last_clean":"2023-11-28T12:07:41.662676+0000","last_became_active":"2023-11-28T12:07:41.156521+0000","last_became_peered":"2023-11-28T12:07:41.156521+0000","last_unstale":"2023-11-28T12:07:41.662676+0000","last_undegraded":"2023-11-28T12:07:41.662676+0000","last_fullsized":"2023-11-28T12:07:41.662676+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:13:06.059949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.669405+0000","last_change":"2023-11-28T12:06:23.903983+0000","last_active":"2023-11-28T12:07:41.669405+0000","last_peered":"2023-11-28T12:07:41.669405+0000","last_clean":"2023-11-28T12:07:41.669405+0000","last_became_active":"2023-11-28T12:06:23.903511+0000","last_became_peered":"2023-11-28T12:06:23.903511+0000","last_unstale":"2023-11-28T12:07:41.669405+0000","last_undegraded":"2023-11-28T12:07:41.669405+0000","last_fullsized":"2023-11-28T12:07:41.669405+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:31:13.187145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.677639+0000","last_change":"2023-11-28T12:07:41.669478+0000","last_active":"2023-11-28T12:07:41.677639+0000","last_peered":"2023-11-28T12:07:41.677639+0000","last_clean":"2023-11-28T12:07:41.677639+0000","last_became_active":"2023-11-28T12:07:41.668840+0000","last_became_peered":"2023-11-28T12:07:41.668840+0000","last_unstale":"2023-11-28T12:07:41.677639+0000","last_undegraded":"2023-11-28T12:07:41.677639+0000","last_fullsized":"2023-11-28T12:07:41.677639+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:41.135506+0000","last_clean_scrub_stamp":"2023-11-28T12:07:41.135506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:04:15.307550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.656242+0000","last_change":"2023-11-28T12:07:41.162201+0000","last_active":"2023-11-28T12:07:41.656242+0000","last_peered":"2023-11-28T12:07:41.656242+0000","last_clean":"2023-11-28T12:07:41.656242+0000","last_became_active":"2023-11-28T12:07:41.159342+0000","last_became_peered":"2023-11-28T12:07:41.159342+0000","last_unstale":"2023-11-28T12:07:41.656242+0000","last_undegraded":"2023-11-28T12:07:41.656242+0000","last_fullsized":"2023-11-28T12:07:41.656242+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:07:40.127879+0000","last_clean_scrub_stamp":"2023-11-28T12:07:40.127879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:02:12.148279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-28T12:07:41.669936+0000","last_change":"2023-11-28T12:06:23.517246+0000","last_active":"2023-11-28T12:07:41.669936+0000","last_peered":"2023-11-28T12:07:41.669936+0000","last_clean":"2023-11-28T12:07:41.669936+0000","last_became_active":"2023-11-28T12:06:23.516854+0000","last_became_peered":"2023-11-28T12:06:23.516854+0000","last_unstale":"2023-11-28T12:07:41.669936+0000","last_undegraded":"2023-11-28T12:07:41.669936+0000","last_fullsized":"2023-11-28T12:07:41.669936+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:51:06.844441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9556,"kb_used_data":972,"kb_used_omap":0,"kb_used_meta":8576,"kb_avail":94362284,"statfs":{"total":96636764160,"available":96626978816,"internally_reserved":0,"allocated":995328,"data_stored":752203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8781824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":2.7469999999999999,"5min":2.7469999999999999,"15min":2.7469999999999999},"last":0.72699999999999998}]},{"osd":1,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.64600000000000002}]},{"osd":2,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.819,"5min":1.819,"15min":1.819},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":0.66600000000000004}]},{"osd":3,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.63500000000000001}]},{"osd":4,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.747}]},{"osd":5,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.79400000000000004}]},{"osd":6,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.82599999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8388,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":8000,"kb_avail":94363452,"statfs":{"total":96636764160,"available":96628174848,"internally_reserved":0,"allocated":389120,"data_stored":160783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8192000},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.41199999999999998}]},{"osd":1,"last update":"Tue Nov 28 12:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.65600000000000003}]},{"osd":2,"last update":"Tue Nov 28 12:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.61199999999999999}]},{"osd":3,"last update":"Tue Nov 28 12:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.71699999999999997}]},{"osd":4,"last update":"Tue Nov 28 12:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.73999999999999999}]},{"osd":5,"last update":"Tue Nov 28 12:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.79400000000000004}]},{"osd":7,"last update":"Tue Nov 28 12:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.76500000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13576,"kb_used_data":960,"kb_used_omap":0,"kb_used_meta":12608,"kb_avail":94358264,"statfs":{"total":96636764160,"available":96622862336,"internally_reserved":0,"allocated":983040,"data_stored":750675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12910592},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.432},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.309}]},{"osd":2,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.35699999999999998}]},{"osd":3,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.63300000000000001}]},{"osd":4,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.5},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.7350000000000001,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.56899999999999995}]},{"osd":5,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.61599999999999999}]},{"osd":6,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.68100000000000005}]},{"osd":7,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.65000000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12544,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":12160,"kb_avail":94359296,"statfs":{"total":96636764160,"available":96623919104,"internally_reserved":0,"allocated":385024,"data_stored":158890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12451840},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 12:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.37}]},{"osd":2,"last update":"Tue Nov 28 12:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.46700000000000003}]},{"osd":3,"last update":"Tue Nov 28 12:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.47699999999999998}]},{"osd":4,"last update":"Tue Nov 28 12:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.9159999999999999,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.68600000000000005}]},{"osd":5,"last update":"Tue Nov 28 12:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.70199999999999996}]},{"osd":6,"last update":"Tue Nov 28 12:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.625},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.56699999999999995}]},{"osd":7,"last update":"Tue Nov 28 12:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.58399999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12420,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":12032,"kb_avail":94359420,"statfs":{"total":96636764160,"available":96624046080,"internally_reserved":0,"allocated":389120,"data_stored":160287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12320768},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.317}]},{"osd":1,"last update":"Tue Nov 28 12:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.36899999999999999}]},{"osd":3,"last update":"Tue Nov 28 12:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.46500000000000002}]},{"osd":4,"last update":"Tue Nov 28 12:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.73099999999999998}]},{"osd":5,"last update":"Tue Nov 28 12:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.81100000000000005}]},{"osd":6,"last update":"Tue Nov 28 12:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.91200000000000003}]},{"osd":7,"last update":"Tue Nov 28 12:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.82999999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12620,"kb_used_data":388,"kb_used_omap":0,"kb_used_meta":12224,"kb_avail":94359220,"statfs":{"total":96636764160,"available":96623841280,"internally_reserved":0,"allocated":397312,"data_stored":160438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12517376},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.45800000000000002}]},{"osd":1,"last update":"Tue Nov 28 12:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.498}]},{"osd":2,"last update":"Tue Nov 28 12:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.377},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.54200000000000004}]},{"osd":4,"last update":"Tue Nov 28 12:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.55100000000000005}]},{"osd":5,"last update":"Tue Nov 28 12:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.65400000000000003}]},{"osd":6,"last update":"Tue Nov 28 12:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.63500000000000001}]},{"osd":7,"last update":"Tue Nov 28 12:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.56699999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8584,"kb_used_data":384,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363256,"statfs":{"total":96636764160,"available":96627974144,"internally_reserved":0,"allocated":393216,"data_stored":160805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.53900000000000003}]},{"osd":1,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.55600000000000005}]},{"osd":2,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.66800000000000004}]},{"osd":3,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.65100000000000002}]},{"osd":5,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.68200000000000005}]},{"osd":6,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.79600000000000004}]},{"osd":7,"last update":"Tue Nov 28 12:07:22 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.84999999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8456,"kb_used_data":384,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94363384,"statfs":{"total":96636764160,"available":96628105216,"internally_reserved":0,"allocated":393216,"data_stored":160329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.56799999999999995}]},{"osd":1,"last update":"Tue Nov 28 12:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.65000000000000002}]},{"osd":2,"last update":"Tue Nov 28 12:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.53300000000000003}]},{"osd":3,"last update":"Tue Nov 28 12:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.621},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.57599999999999996}]},{"osd":4,"last update":"Tue Nov 28 12:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.749}]},{"osd":6,"last update":"Tue Nov 28 12:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.80800000000000005}]},{"osd":7,"last update":"Tue Nov 28 12:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.66400000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T12:07:51.736 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-28T12:07:51.737 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw pool=cephfs_data' mds allow 2023-11-28T12:07:51.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.983+0000 7f78ad5ff700 1 Processor -- start 2023-11-28T12:07:51.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.983+0000 7f78ad5ff700 1 -- start start 2023-11-28T12:07:51.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.984+0000 7f78ad5ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f78a8161340 0x7f78a80d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:51.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.984+0000 7f78ad5ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78a80d1950 con 0x7f78a815c9b0 2023-11-28T12:07:51.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.984+0000 7f78ad5ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78a80b5520 con 0x7f78a80d2320 2023-11-28T12:07:51.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.984+0000 7f78ad5ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78a80b5800 con 0x7f78a8161340 2023-11-28T12:07:51.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.984+0000 7f78a67fc700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f78a8161340 0x7f78a80d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:51.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.984+0000 7f78a6ffd700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f78a815c9b0 0x7f78a80b4bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:35218/0 (socket says 172.21.15.45:35218) 2023-11-28T12:07:51.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.984+0000 7f78a67fc700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f78a8161340 0x7f78a80d1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55420/0 (socket says 172.21.15.45:55420) 2023-11-28T12:07:51.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.984+0000 7f78a6ffd700 1 -- 172.21.15.45:0/1434934358 learned_addr learned my addr 172.21.15.45:0/1434934358 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:07:51.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.985+0000 7f78a67fc700 1 -- 172.21.15.45:0/1434934358 >> v1:172.21.15.152:6789/0 conn(0x7f78a80d2320 legacy=0x7f78a80cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:51.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.985+0000 7f78a67fc700 1 -- 172.21.15.45:0/1434934358 >> v1:172.21.15.45:6789/0 conn(0x7f78a815c9b0 legacy=0x7f78a80b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:51.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.985+0000 7f78a67fc700 1 -- 172.21.15.45:0/1434934358 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78a80d1300 con 0x7f78a8161340 2023-11-28T12:07:51.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.985+0000 7f78a5ffb700 1 -- 172.21.15.45:0/1434934358 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1655232561 0 0) 0x7f78a80d1950 con 0x7f78a815c9b0 2023-11-28T12:07:51.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.985+0000 7f78a67fc700 1 --2- 172.21.15.45:0/1434934358 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78a8161340 0x7f78a80d1de0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f789c009840 tx=0x7f789c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=396da383b45e8e5d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:51.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.985+0000 7f78a5ffb700 1 -- 172.21.15.45:0/1434934358 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f789c004230 con 0x7f78a8161340 2023-11-28T12:07:51.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.985+0000 7f78a5ffb700 1 -- 172.21.15.45:0/1434934358 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f789c004390 con 0x7f78a8161340 2023-11-28T12:07:51.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.985+0000 7f78a5ffb700 1 -- 172.21.15.45:0/1434934358 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f789c0036a0 con 0x7f78a8161340 2023-11-28T12:07:51.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.986+0000 7f78ad5ff700 1 -- 172.21.15.45:0/1434934358 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78a8161340 msgr2=0x7f78a80d1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:51.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.986+0000 7f78ad5ff700 1 --2- 172.21.15.45:0/1434934358 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78a8161340 0x7f78a80d1de0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f789c009840 tx=0x7f789c009b50 comp rx=0 tx=0).stop 2023-11-28T12:07:51.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.986+0000 7f78ad5ff700 1 -- 172.21.15.45:0/1434934358 shutdown_connections 2023-11-28T12:07:51.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.986+0000 7f78ad5ff700 1 --2- 172.21.15.45:0/1434934358 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78a8161340 0x7f78a80d1de0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:51.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.986+0000 7f78ad5ff700 1 -- 172.21.15.45:0/1434934358 >> 172.21.15.45:0/1434934358 conn(0x7f78a8072600 msgr2=0x7f78a80cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:51.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.986+0000 7f78ad5ff700 1 -- 172.21.15.45:0/1434934358 shutdown_connections 2023-11-28T12:07:51.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.986+0000 7f78ad5ff700 1 -- 172.21.15.45:0/1434934358 wait complete. 2023-11-28T12:07:51.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.987+0000 7f78ad5ff700 1 Processor -- start 2023-11-28T12:07:51.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.988+0000 7f78ad5ff700 1 -- start start 2023-11-28T12:07:51.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.989+0000 7f78ad5ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f78a80d2320 0x7f78a80cdb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:51.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.989+0000 7f78ad5ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78a815c9b0 0x7f78a815db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:51.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.989+0000 7f78ad5ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f78a8161340 0x7f78a80b78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:51.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.989+0000 7f78ad5ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a815fab0 con 0x7f78a815c9b0 2023-11-28T12:07:51.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.989+0000 7f78ad5ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a815eea0 con 0x7f78a8161340 2023-11-28T12:07:51.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.989+0000 7f78ad5ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78a815f180 con 0x7f78a80d2320 2023-11-28T12:07:51.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.989+0000 7f78a6ffd700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f78a80d2320 0x7f78a80cdb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:51.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.989+0000 7f78a77fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f78a8161340 0x7f78a80b78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:51.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.989+0000 7f78a6ffd700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f78a80d2320 0x7f78a80cdb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.45:38936/0 (socket says 172.21.15.45:38936) 2023-11-28T12:07:51.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.989+0000 7f78a6ffd700 1 -- 172.21.15.45:0/389044400 learned_addr learned my addr 172.21.15.45:0/389044400 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:51.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.989+0000 7f78a67fc700 1 --2- 172.21.15.45:0/389044400 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78a815c9b0 0x7f78a815db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:51.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.989+0000 7f78a67fc700 1 -- 172.21.15.45:0/389044400 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f78a80d2320 msgr2=0x7f78a80cdb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:51.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.989+0000 7f78a67fc700 1 --2- 172.21.15.45:0/389044400 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f78a80d2320 0x7f78a80cdb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:51.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.989+0000 7f78a67fc700 1 -- 172.21.15.45:0/389044400 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f78a8161340 msgr2=0x7f78a80b78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:51.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.989+0000 7f78a67fc700 1 --2- 172.21.15.45:0/389044400 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f78a8161340 0x7f78a80b78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:51.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.989+0000 7f78a67fc700 1 -- 172.21.15.45:0/389044400 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f789c0094a0 con 0x7f78a815c9b0 2023-11-28T12:07:51.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.990+0000 7f78a67fc700 1 --2- 172.21.15.45:0/389044400 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78a815c9b0 0x7f78a815db10 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f789c015000 tx=0x7f789c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:51.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.990+0000 7f788f7fe700 1 -- 172.21.15.45:0/389044400 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f789c003de0 con 0x7f78a815c9b0 2023-11-28T12:07:51.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.990+0000 7f788f7fe700 1 -- 172.21.15.45:0/389044400 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f789c01e070 con 0x7f78a815c9b0 2023-11-28T12:07:51.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.990+0000 7f788f7fe700 1 -- 172.21.15.45:0/389044400 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f789c011870 con 0x7f78a815c9b0 2023-11-28T12:07:51.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.990+0000 7f78ad5ff700 1 -- 172.21.15.45:0/389044400 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78a815cd80 con 0x7f78a815c9b0 2023-11-28T12:07:51.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.990+0000 7f78ad5ff700 1 -- 172.21.15.45:0/389044400 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78a80d15e0 con 0x7f78a815c9b0 2023-11-28T12:07:51.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.991+0000 7f78ad5ff700 1 -- 172.21.15.45:0/389044400 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78a815cf10 con 0x7f78a815c9b0 2023-11-28T12:07:51.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.992+0000 7f788f7fe700 1 -- 172.21.15.45:0/389044400 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f789c017020 con 0x7f78a815c9b0 2023-11-28T12:07:51.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.994+0000 7f788f7fe700 1 --2- 172.21.15.45:0/389044400 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f78940682f0 0x7f789406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:51.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.994+0000 7f788f7fe700 1 -- 172.21.15.45:0/389044400 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f789c087020 con 0x7f78a815c9b0 2023-11-28T12:07:51.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.994+0000 7f78a6ffd700 1 --2- 172.21.15.45:0/389044400 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f78940682f0 0x7f789406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:51.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.995+0000 7f78a6ffd700 1 --2- 172.21.15.45:0/389044400 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f78940682f0 0x7f789406a7a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7898001340 tx=0x7f78980012d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:52.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:51.998+0000 7f788f7fe700 1 -- 172.21.15.45:0/389044400 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f789c053880 con 0x7f78a815c9b0 2023-11-28T12:07:52.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:52.284+0000 7f78ad5ff700 1 -- 172.21.15.45:0/389044400 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs_data", "mds", "allow"]} v 0) v1 -- 0x7f78a815fc60 con 0x7f78a815c9b0 2023-11-28T12:07:52.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:52.288+0000 7f788f7fe700 1 -- 172.21.15.45:0/389044400 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs_data", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 184+0+0 (secure 0 0 0) 0x7f78a815fc60 con 0x7f78a815c9b0 2023-11-28T12:07:52.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:52.290+0000 7f78ad5ff700 1 -- 172.21.15.45:0/389044400 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f78940682f0 msgr2=0x7f789406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:52.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:52.290+0000 7f78ad5ff700 1 --2- 172.21.15.45:0/389044400 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f78940682f0 0x7f789406a7a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7898001340 tx=0x7f78980012d0 comp rx=0 tx=0).stop 2023-11-28T12:07:52.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:52.290+0000 7f78ad5ff700 1 -- 172.21.15.45:0/389044400 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78a815c9b0 msgr2=0x7f78a815db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:52.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:52.290+0000 7f78ad5ff700 1 --2- 172.21.15.45:0/389044400 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78a815c9b0 0x7f78a815db10 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f789c015000 tx=0x7f789c004750 comp rx=0 tx=0).stop 2023-11-28T12:07:52.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:52.290+0000 7f78ad5ff700 1 -- 172.21.15.45:0/389044400 shutdown_connections 2023-11-28T12:07:52.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:52.290+0000 7f78ad5ff700 1 --2- 172.21.15.45:0/389044400 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f78940682f0 0x7f789406a7a0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:52.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:52.290+0000 7f78ad5ff700 1 --2- 172.21.15.45:0/389044400 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f78a8161340 0x7f78a80b78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:52.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:52.290+0000 7f78ad5ff700 1 --2- 172.21.15.45:0/389044400 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f78a80d2320 0x7f78a80cdb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:52.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:52.290+0000 7f78ad5ff700 1 --2- 172.21.15.45:0/389044400 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78a815c9b0 0x7f78a815db10 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:52.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:52.290+0000 7f78ad5ff700 1 -- 172.21.15.45:0/389044400 >> 172.21.15.45:0/389044400 conn(0x7f78a8072600 msgr2=0x7f78a815a450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:52.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:52.290+0000 7f78ad5ff700 1 -- 172.21.15.45:0/389044400 shutdown_connections 2023-11-28T12:07:52.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:52.290+0000 7f78ad5ff700 1 -- 172.21.15.45:0/389044400 wait complete. 2023-11-28T12:07:52.295 INFO:teuthology.orchestra.run.smithi045.stderr:updated caps for client.0 2023-11-28T12:07:52.310 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T12:07:52.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:52.513+0000 7f83289ff700 1 Processor -- start 2023-11-28T12:07:52.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:52.513+0000 7f83289ff700 1 -- start start 2023-11-28T12:07:52.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:52.514+0000 7f83289ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8324161340 0x7f83240d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:52.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:52.514+0000 7f83289ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f83240d2320 0x7f83240cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:52.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:52.514+0000 7f83289ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83240d1950 con 0x7f832415c9b0 2023-11-28T12:07:52.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:52.514+0000 7f83289ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83240b5800 con 0x7f8324161340 2023-11-28T12:07:52.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:52.514+0000 7f83289ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83240b5300 con 0x7f83240d2320 2023-11-28T12:07:52.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:52.514+0000 7f831bfff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8324161340 0x7f83240d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:52.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:52.514+0000 7f831bfff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8324161340 0x7f83240d1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55450/0 (socket says 172.21.15.45:55450) 2023-11-28T12:07:52.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:52.514+0000 7f831bfff700 1 -- 172.21.15.45:0/3398872940 learned_addr learned my addr 172.21.15.45:0/3398872940 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:52.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:52.515+0000 7f8322d9d700 1 --2- 172.21.15.45:0/3398872940 >> v2:172.21.15.152:3300/0 conn(0x7f83240d2320 0x7f83240cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:52.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:52.515+0000 7f831bfff700 1 -- 172.21.15.45:0/3398872940 >> v2:172.21.15.152:3300/0 conn(0x7f83240d2320 msgr2=0x7f83240cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:52.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:52.515+0000 7f831bfff700 1 --2- 172.21.15.45:0/3398872940 >> v2:172.21.15.152:3300/0 conn(0x7f83240d2320 0x7f83240cd7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:52.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:52.515+0000 7f831bfff700 1 -- 172.21.15.45:0/3398872940 >> v1:172.21.15.152:6789/0 conn(0x7f832415c9b0 legacy=0x7f83240b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:52.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:52.515+0000 7f831bfff700 1 -- 172.21.15.45:0/3398872940 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83240b5520 con 0x7f8324161340 2023-11-28T12:07:52.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:52.515+0000 7f831bfff700 1 --2- 172.21.15.45:0/3398872940 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8324161340 0x7f83240d1de0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f832406c170 tx=0x7f830c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3c2922e070f9778 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:52.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:52.515+0000 7f8321d9b700 1 -- 172.21.15.45:0/3398872940 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f830c00b860 con 0x7f8324161340 2023-11-28T12:07:52.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:52.515+0000 7f8321d9b700 1 -- 172.21.15.45:0/3398872940 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f830c00b9c0 con 0x7f8324161340 2023-11-28T12:07:52.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:52.515+0000 7f8321d9b700 1 -- 172.21.15.45:0/3398872940 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f830c00bd50 con 0x7f8324161340 2023-11-28T12:07:52.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:52.516+0000 7f83289ff700 1 -- 172.21.15.45:0/3398872940 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8324161340 msgr2=0x7f83240d1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:52.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:52.516+0000 7f83289ff700 1 --2- 172.21.15.45:0/3398872940 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8324161340 0x7f83240d1de0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f832406c170 tx=0x7f830c009c00 comp rx=0 tx=0).stop 2023-11-28T12:07:52.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:52.516+0000 7f83289ff700 1 -- 172.21.15.45:0/3398872940 shutdown_connections 2023-11-28T12:07:52.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:52.516+0000 7f83289ff700 1 --2- 172.21.15.45:0/3398872940 >> v2:172.21.15.152:3300/0 conn(0x7f83240d2320 0x7f83240cd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:52.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:52.516+0000 7f83289ff700 1 --2- 172.21.15.45:0/3398872940 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8324161340 0x7f83240d1de0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:52.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:52.516+0000 7f83289ff700 1 -- 172.21.15.45:0/3398872940 >> 172.21.15.45:0/3398872940 conn(0x7f8324072600 msgr2=0x7f83240cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:52.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:52.516+0000 7f83289ff700 1 -- 172.21.15.45:0/3398872940 shutdown_connections 2023-11-28T12:07:52.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:52.516+0000 7f83289ff700 1 -- 172.21.15.45:0/3398872940 wait complete. 2023-11-28T12:07:52.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:52.518+0000 7f83289ff700 1 Processor -- start 2023-11-28T12:07:52.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:52.518+0000 7f83289ff700 1 -- start start 2023-11-28T12:07:52.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:52.519+0000 7f83289ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f83240d2320 0x7f8324150cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:52.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:52.519+0000 7f83289ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f832415c9b0 0x7f83241e7750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:52.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:52.519+0000 7f83289ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8324161340 0x7f8324156230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:52.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:52.519+0000 7f83289ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83241547e0 con 0x7f8324161340 2023-11-28T12:07:52.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:52.519+0000 7f83289ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83241e6460 con 0x7f832415c9b0 2023-11-28T12:07:52.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:52.519+0000 7f83289ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83241e72c0 con 0x7f83240d2320 2023-11-28T12:07:52.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:52.519+0000 7f8322d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8324161340 0x7f8324156230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:52.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:52.519+0000 7f8322d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8324161340 0x7f8324156230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55454/0 (socket says 172.21.15.45:55454) 2023-11-28T12:07:52.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:52.519+0000 7f8322d9d700 1 -- 172.21.15.45:0/1801727373 learned_addr learned my addr 172.21.15.45:0/1801727373 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:52.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:52.520+0000 7f831bfff700 1 --2- 172.21.15.45:0/1801727373 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f832415c9b0 0x7f83241e7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:52.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:52.520+0000 7f832259c700 1 --2- 172.21.15.45:0/1801727373 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f83240d2320 0x7f8324150cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:52.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:52.520+0000 7f8322d9d700 1 -- 172.21.15.45:0/1801727373 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f83240d2320 msgr2=0x7f8324150cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:52.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:52.520+0000 7f8322d9d700 1 --2- 172.21.15.45:0/1801727373 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f83240d2320 0x7f8324150cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:52.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:52.520+0000 7f8322d9d700 1 -- 172.21.15.45:0/1801727373 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f832415c9b0 msgr2=0x7f83241e7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:52.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:52.520+0000 7f8322d9d700 1 --2- 172.21.15.45:0/1801727373 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f832415c9b0 0x7f83241e7750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:52.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:52.520+0000 7f8322d9d700 1 -- 172.21.15.45:0/1801727373 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f830c009550 con 0x7f8324161340 2023-11-28T12:07:52.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:52.520+0000 7f8322d9d700 1 --2- 172.21.15.45:0/1801727373 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8324161340 0x7f8324156230 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f831c007d80 tx=0x7f831c00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:52.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:52.520+0000 7f831affd700 1 -- 172.21.15.45:0/1801727373 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831c00ed30 con 0x7f8324161340 2023-11-28T12:07:52.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:52.520+0000 7f831affd700 1 -- 172.21.15.45:0/1801727373 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f831c00ee90 con 0x7f8324161340 2023-11-28T12:07:52.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:52.520+0000 7f83289ff700 1 -- 172.21.15.45:0/1801727373 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83240d15e0 con 0x7f8324161340 2023-11-28T12:07:52.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:52.520+0000 7f831affd700 1 -- 172.21.15.45:0/1801727373 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831c014660 con 0x7f8324161340 2023-11-28T12:07:52.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:52.521+0000 7f83289ff700 1 -- 172.21.15.45:0/1801727373 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83240d1300 con 0x7f8324161340 2023-11-28T12:07:52.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:52.522+0000 7f83289ff700 1 -- 172.21.15.45:0/1801727373 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f832415cd80 con 0x7f8324161340 2023-11-28T12:07:52.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:52.522+0000 7f831affd700 1 -- 172.21.15.45:0/1801727373 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f831c012050 con 0x7f8324161340 2023-11-28T12:07:52.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:52.523+0000 7f831affd700 1 --2- 172.21.15.45:0/1801727373 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f83040682f0 0x7f830406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:52.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:52.523+0000 7f831affd700 1 -- 172.21.15.45:0/1801727373 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f831c086100 con 0x7f8324161340 2023-11-28T12:07:52.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:52.524+0000 7f832259c700 1 --2- 172.21.15.45:0/1801727373 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f83040682f0 0x7f830406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:52.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:52.525+0000 7f832259c700 1 --2- 172.21.15.45:0/1801727373 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f83040682f0 0x7f830406a7a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8314007fd0 tx=0x7f8314009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:52.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:52.527+0000 7f831affd700 1 -- 172.21.15.45:0/1801727373 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f831c052900 con 0x7f8324161340 2023-11-28T12:07:52.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:52.773+0000 7f83289ff700 1 -- 172.21.15.45:0/1801727373 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f832415d0c0 con 0x7f8324161340 2023-11-28T12:07:52.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:52.773+0000 7f831affd700 1 -- 172.21.15.45:0/1801727373 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4654 (secure 0 0 0) 0x7f831c055f20 con 0x7f8324161340 2023-11-28T12:07:52.775 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:07:52.775 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4805,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1232749056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1232749056},{"type":"v1","addr":"172.21.15.152:6837","nonce":1232749056}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4996,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/1358094304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":1358094304},{"type":"v1","addr":"172.21.15.45:6835","nonce":1358094304}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4999,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6836/2035520444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6835","nonce":2035520444},{"type":"v1","addr":"172.21.15.152:6836","nonce":2035520444}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T12:07:41.650740+0000","modified":"2023-11-28T12:07:44.849447+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5061},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5061":{"gid":5061,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.45:6834/2964277738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2964277738},{"type":"v1","addr":"172.21.15.45:6834","nonce":2964277738}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-28T12:07:52.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:52.776+0000 7f83289ff700 1 -- 172.21.15.45:0/1801727373 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f83040682f0 msgr2=0x7f830406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:52.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:52.776+0000 7f83289ff700 1 --2- 172.21.15.45:0/1801727373 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f83040682f0 0x7f830406a7a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8314007fd0 tx=0x7f8314009040 comp rx=0 tx=0).stop 2023-11-28T12:07:52.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:52.776+0000 7f83289ff700 1 -- 172.21.15.45:0/1801727373 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8324161340 msgr2=0x7f8324156230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:52.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:52.776+0000 7f83289ff700 1 --2- 172.21.15.45:0/1801727373 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8324161340 0x7f8324156230 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f831c007d80 tx=0x7f831c00e3c0 comp rx=0 tx=0).stop 2023-11-28T12:07:52.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:52.776+0000 7f83289ff700 1 -- 172.21.15.45:0/1801727373 shutdown_connections 2023-11-28T12:07:52.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:52.776+0000 7f83289ff700 1 --2- 172.21.15.45:0/1801727373 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f83040682f0 0x7f830406a7a0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:52.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:52.776+0000 7f83289ff700 1 --2- 172.21.15.45:0/1801727373 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8324161340 0x7f8324156230 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:52.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:52.776+0000 7f83289ff700 1 --2- 172.21.15.45:0/1801727373 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f83240d2320 0x7f8324150cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:52.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:52.776+0000 7f83289ff700 1 --2- 172.21.15.45:0/1801727373 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f832415c9b0 0x7f83241e7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:52.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:52.776+0000 7f83289ff700 1 -- 172.21.15.45:0/1801727373 >> 172.21.15.45:0/1801727373 conn(0x7f8324072600 msgr2=0x7f83240b6dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:52.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:52.776+0000 7f83289ff700 1 -- 172.21.15.45:0/1801727373 shutdown_connections 2023-11-28T12:07:52.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:52.776+0000 7f83289ff700 1 -- 172.21.15.45:0/1801727373 wait complete. 2023-11-28T12:07:52.779 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 16 2023-11-28T12:07:53.198 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-28T12:07:41.650740+0000', 'modified': '2023-11-28T12:07:44.849447+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5061}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5061': {'gid': 5061, 'name': 'a', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.45:6834/2964277738', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.45:6832', 'nonce': 2964277738}, {'type': 'v1', 'addr': '172.21.15.45:6834', 'nonce': 2964277738}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-28T12:07:53.199 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-28T12:07:53.199 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-11-28T12:07:53.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.405+0000 7f9ab01ff700 1 Processor -- start 2023-11-28T12:07:53.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.405+0000 7f9ab01ff700 1 -- start start 2023-11-28T12:07:53.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.407+0000 7f9ab01ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f9aa80d0ff0 0x7f9aa80cff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:53.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.407+0000 7f9ab01ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9aa80b4750 0x7f9aa80b30a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:53.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.407+0000 7f9ab01ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9aa80cf220 con 0x7f9aa80d13c0 2023-11-28T12:07:53.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.407+0000 7f9ab01ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9aa80b3e50 con 0x7f9aa80b4750 2023-11-28T12:07:53.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.407+0000 7f9ab01ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9aa80cf470 con 0x7f9aa80d0ff0 2023-11-28T12:07:53.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.407+0000 7f9aad79a700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9aa80b4750 0x7f9aa80b30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:53.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.407+0000 7f9aae79c700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f9aa80d13c0 0x7f9aa80b6000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:35222/0 (socket says 172.21.15.45:35222) 2023-11-28T12:07:53.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.407+0000 7f9aae79c700 1 -- 172.21.15.45:0/1719622485 learned_addr learned my addr 172.21.15.45:0/1719622485 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:07:53.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.407+0000 7f9aadf9b700 1 --2- 172.21.15.45:0/1719622485 >> v2:172.21.15.152:3300/0 conn(0x7f9aa80d0ff0 0x7f9aa80cff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:53.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.407+0000 7f9aad79a700 1 -- 172.21.15.45:0/1719622485 >> v2:172.21.15.152:3300/0 conn(0x7f9aa80d0ff0 msgr2=0x7f9aa80cff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:53.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.407+0000 7f9aad79a700 1 --2- 172.21.15.45:0/1719622485 >> v2:172.21.15.152:3300/0 conn(0x7f9aa80d0ff0 0x7f9aa80cff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:53.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.407+0000 7f9aacf99700 1 -- 172.21.15.45:0/1719622485 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 363158256 0 0) 0x7f9aa80cf220 con 0x7f9aa80d13c0 2023-11-28T12:07:53.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.407+0000 7f9aad79a700 1 -- 172.21.15.45:0/1719622485 >> v1:172.21.15.45:6789/0 conn(0x7f9aa80d13c0 legacy=0x7f9aa80b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:53.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.407+0000 7f9aad79a700 1 -- 172.21.15.45:0/1719622485 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aa80cf750 con 0x7f9aa80b4750 2023-11-28T12:07:53.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.408+0000 7f9aad79a700 1 --2- 172.21.15.45:0/1719622485 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9aa80b4750 0x7f9aa80b30a0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f9aa80668d0 tx=0x7f9a98009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb4bd618727d39e4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:53.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.408+0000 7f9aacf99700 1 -- 172.21.15.45:0/1719622485 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a98011830 con 0x7f9aa80b4750 2023-11-28T12:07:53.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.408+0000 7f9aacf99700 1 -- 172.21.15.45:0/1719622485 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a98011990 con 0x7f9aa80b4750 2023-11-28T12:07:53.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.408+0000 7f9aacf99700 1 -- 172.21.15.45:0/1719622485 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a98011d20 con 0x7f9aa80b4750 2023-11-28T12:07:53.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.408+0000 7f9ab01ff700 1 -- 172.21.15.45:0/1719622485 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9aa80b4750 msgr2=0x7f9aa80b30a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:53.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.408+0000 7f9ab01ff700 1 --2- 172.21.15.45:0/1719622485 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9aa80b4750 0x7f9aa80b30a0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f9aa80668d0 tx=0x7f9a98009b20 comp rx=0 tx=0).stop 2023-11-28T12:07:53.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.409+0000 7f9ab01ff700 1 -- 172.21.15.45:0/1719622485 shutdown_connections 2023-11-28T12:07:53.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.409+0000 7f9ab01ff700 1 --2- 172.21.15.45:0/1719622485 >> v2:172.21.15.152:3300/0 conn(0x7f9aa80d0ff0 0x7f9aa80cff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:53.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.409+0000 7f9ab01ff700 1 --2- 172.21.15.45:0/1719622485 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9aa80b4750 0x7f9aa80b30a0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:53.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.409+0000 7f9ab01ff700 1 -- 172.21.15.45:0/1719622485 >> 172.21.15.45:0/1719622485 conn(0x7f9aa809c3c0 msgr2=0x7f9aa80d31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:53.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.409+0000 7f9ab01ff700 1 -- 172.21.15.45:0/1719622485 shutdown_connections 2023-11-28T12:07:53.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.409+0000 7f9ab01ff700 1 -- 172.21.15.45:0/1719622485 wait complete. 2023-11-28T12:07:53.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.411+0000 7f9ab01ff700 1 Processor -- start 2023-11-28T12:07:53.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.411+0000 7f9ab01ff700 1 -- start start 2023-11-28T12:07:53.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.413+0000 7f9ab01ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9aa80b4750 0x7f9aa80c97e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:53.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.413+0000 7f9ab01ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9aa80d0ff0 0x7f9aa8155770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:53.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.413+0000 7f9ab01ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9aa80d13c0 0x7f9aa8158780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:53.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.413+0000 7f9ab01ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa8155cb0 con 0x7f9aa80b4750 2023-11-28T12:07:53.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.413+0000 7f9ab01ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa8159800 con 0x7f9aa80d0ff0 2023-11-28T12:07:53.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.413+0000 7f9ab01ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa8158cc0 con 0x7f9aa80d13c0 2023-11-28T12:07:53.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.413+0000 7f9aadf9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9aa80b4750 0x7f9aa80c97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:53.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.413+0000 7f9aadf9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9aa80b4750 0x7f9aa80c97e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55468/0 (socket says 172.21.15.45:55468) 2023-11-28T12:07:53.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.413+0000 7f9aadf9b700 1 -- 172.21.15.45:0/4286224339 learned_addr learned my addr 172.21.15.45:0/4286224339 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:53.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.413+0000 7f9aadf9b700 1 -- 172.21.15.45:0/4286224339 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9aa80d13c0 msgr2=0x7f9aa8158780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:53.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.413+0000 7f9aae79c700 1 --2- 172.21.15.45:0/4286224339 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9aa80d13c0 0x7f9aa8158780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:53.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.413+0000 7f9aad79a700 1 --2- 172.21.15.45:0/4286224339 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9aa80d0ff0 0x7f9aa8155770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:53.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.413+0000 7f9aadf9b700 1 --2- 172.21.15.45:0/4286224339 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9aa80d13c0 0x7f9aa8158780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:53.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.413+0000 7f9aadf9b700 1 -- 172.21.15.45:0/4286224339 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9aa80d0ff0 msgr2=0x7f9aa8155770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:53.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.413+0000 7f9aadf9b700 1 --2- 172.21.15.45:0/4286224339 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9aa80d0ff0 0x7f9aa8155770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:53.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.413+0000 7f9aadf9b700 1 -- 172.21.15.45:0/4286224339 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a980094a0 con 0x7f9aa80b4750 2023-11-28T12:07:53.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.413+0000 7f9aad79a700 1 --2- 172.21.15.45:0/4286224339 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9aa80d0ff0 0x7f9aa8155770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:07:53.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.413+0000 7f9aae79c700 1 --2- 172.21.15.45:0/4286224339 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9aa80d13c0 0x7f9aa8158780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:07:53.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.414+0000 7f9aadf9b700 1 --2- 172.21.15.45:0/4286224339 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9aa80b4750 0x7f9aa80c97e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f9aa400e730 tx=0x7f9aa400eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:53.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.414+0000 7f9a9e7fc700 1 -- 172.21.15.45:0/4286224339 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa4013610 con 0x7f9aa80b4750 2023-11-28T12:07:53.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.414+0000 7f9a9e7fc700 1 -- 172.21.15.45:0/4286224339 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aa4013770 con 0x7f9aa80b4750 2023-11-28T12:07:53.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.414+0000 7f9a9e7fc700 1 -- 172.21.15.45:0/4286224339 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa4013b20 con 0x7f9aa80b4750 2023-11-28T12:07:53.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.414+0000 7f9ab01ff700 1 -- 172.21.15.45:0/4286224339 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9aa80d0a50 con 0x7f9aa80b4750 2023-11-28T12:07:53.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.414+0000 7f9ab01ff700 1 -- 172.21.15.45:0/4286224339 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9aa80cfa30 con 0x7f9aa80b4750 2023-11-28T12:07:53.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.416+0000 7f9a9e7fc700 1 -- 172.21.15.45:0/4286224339 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f9aa4019030 con 0x7f9aa80b4750 2023-11-28T12:07:53.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.417+0000 7f9a9e7fc700 1 --2- 172.21.15.45:0/4286224339 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f9a8c0682f0 0x7f9a8c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:53.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.417+0000 7f9a9e7fc700 1 -- 172.21.15.45:0/4286224339 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9aa4085720 con 0x7f9aa80b4750 2023-11-28T12:07:53.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.417+0000 7f9aad79a700 1 --2- 172.21.15.45:0/4286224339 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f9a8c0682f0 0x7f9a8c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:53.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.418+0000 7f9aad79a700 1 --2- 172.21.15.45:0/4286224339 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f9a8c0682f0 0x7f9a8c06a7a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9aa80b4b50 tx=0x7f9a98008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:53.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.419+0000 7f9ac3c0bb80 1 Processor -- start 2023-11-28T12:07:53.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.419+0000 7f9ac3c0bb80 1 -- start start 2023-11-28T12:07:53.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.420+0000 7f9ac3c0bb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d9b5aef50 0x559d9b5689f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:53.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.420+0000 7f9ac3c0bb80 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x559d9b5a5ac0 0x559d9b5af320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:53.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.420+0000 7f9ac3c0bb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559d9b591660 0x559d9b569b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:53.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.420+0000 7f9ac3c0bb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d9b4e6de0 con 0x559d9b591660 2023-11-28T12:07:53.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.420+0000 7f9ac3c0bb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d9b453140 con 0x559d9b5aef50 2023-11-28T12:07:53.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.420+0000 7f9ac3c0bb80 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x559d9b4c1db0 con 0x559d9b5a5ac0 2023-11-28T12:07:53.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.420+0000 7f9aae79c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559d9b591660 0x559d9b569b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:53.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.420+0000 7f9aae79c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559d9b591660 0x559d9b569b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55476/0 (socket says 172.21.15.45:55476) 2023-11-28T12:07:53.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.420+0000 7f9aae79c700 1 -- 172.21.15.45:0/3119601124 learned_addr learned my addr 172.21.15.45:0/3119601124 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:53.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.420+0000 7f9aad79a700 1 --2- 172.21.15.45:0/3119601124 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x559d9b5a5ac0 0x559d9b5af320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:53.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.421+0000 7f9aadf9b700 1 --2- 172.21.15.45:0/3119601124 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d9b5aef50 0x559d9b5689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:53.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.421+0000 7f9aae79c700 1 -- 172.21.15.45:0/3119601124 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x559d9b5a5ac0 msgr2=0x559d9b5af320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:53.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.421+0000 7f9aae79c700 1 --2- 172.21.15.45:0/3119601124 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x559d9b5a5ac0 0x559d9b5af320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:53.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.421+0000 7f9aae79c700 1 -- 172.21.15.45:0/3119601124 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d9b5aef50 msgr2=0x559d9b5689f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:53.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.421+0000 7f9aae79c700 1 --2- 172.21.15.45:0/3119601124 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d9b5aef50 0x559d9b5689f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:53.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.421+0000 7f9aae79c700 1 -- 172.21.15.45:0/3119601124 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559d9b2af790 con 0x559d9b591660 2023-11-28T12:07:53.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.421+0000 7f9aae79c700 1 --2- 172.21.15.45:0/3119601124 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559d9b591660 0x559d9b569b60 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f9aa000d1b0 tx=0x7f9aa000d4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21547bf35dd9d2ba server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:53.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.421+0000 7f9a8b7fe700 1 -- 172.21.15.45:0/3119601124 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa000de90 con 0x559d9b591660 2023-11-28T12:07:53.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.421+0000 7f9a8b7fe700 1 -- 172.21.15.45:0/3119601124 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aa00070d0 con 0x559d9b591660 2023-11-28T12:07:53.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.421+0000 7f9a8b7fe700 1 -- 172.21.15.45:0/3119601124 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa0007440 con 0x559d9b591660 2023-11-28T12:07:53.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.422+0000 7f9ac3c0bb80 1 -- 172.21.15.45:0/3119601124 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559d9b591660 msgr2=0x559d9b569b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:53.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.422+0000 7f9ac3c0bb80 1 --2- 172.21.15.45:0/3119601124 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559d9b591660 0x559d9b569b60 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f9aa000d1b0 tx=0x7f9aa000d4c0 comp rx=0 tx=0).stop 2023-11-28T12:07:53.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.422+0000 7f9ac3c0bb80 1 -- 172.21.15.45:0/3119601124 shutdown_connections 2023-11-28T12:07:53.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.422+0000 7f9ac3c0bb80 1 --2- 172.21.15.45:0/3119601124 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d9b5aef50 0x559d9b5689f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:53.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.422+0000 7f9ac3c0bb80 1 --2- 172.21.15.45:0/3119601124 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559d9b591660 0x559d9b569b60 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:53.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.422+0000 7f9ac3c0bb80 1 --2- 172.21.15.45:0/3119601124 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x559d9b5a5ac0 0x559d9b5af320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:53.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.422+0000 7f9ac3c0bb80 1 -- 172.21.15.45:0/3119601124 >> 172.21.15.45:0/3119601124 conn(0x559d9b55ed20 msgr2=0x559d9b567f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:53.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.422+0000 7f9ac3c0bb80 1 -- 172.21.15.45:0/3119601124 shutdown_connections 2023-11-28T12:07:53.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.422+0000 7f9ac3c0bb80 1 -- 172.21.15.45:0/3119601124 wait complete. 2023-11-28T12:07:53.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.423+0000 7f9ac3c0bb80 1 -- start start 2023-11-28T12:07:53.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.423+0000 7f9ac3c0bb80 1 Processor -- start 2023-11-28T12:07:53.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.424+0000 7f9ac3c0bb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d9b591660 0x559d9b58c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:53.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.424+0000 7f9ac3c0bb80 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x559d9b5a5ac0 0x559d9b5be0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:53.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.424+0000 7f9ac3c0bb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559d9b5aef50 0x559d9b5be620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:53.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.424+0000 7f9ac3c0bb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d9b4bb120 con 0x559d9b5aef50 2023-11-28T12:07:53.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.424+0000 7f9ac3c0bb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d9b2b0390 con 0x559d9b591660 2023-11-28T12:07:53.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.424+0000 7f9ac3c0bb80 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x559d9b453340 con 0x559d9b5a5ac0 2023-11-28T12:07:53.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.424+0000 7f9ac3c0bb80 10 client.0 _ll_register_callbacks cb 0x559d9b459400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T12:07:53.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.425+0000 7f9aae79c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559d9b5aef50 0x559d9b5be620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:53.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.425+0000 7f9aae79c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559d9b5aef50 0x559d9b5be620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55478/0 (socket says 172.21.15.45:55478) 2023-11-28T12:07:53.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.425+0000 7f9aae79c700 1 -- 172.21.15.45:0/2428311261 learned_addr learned my addr 172.21.15.45:0/2428311261 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:53.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.425+0000 7f9aadf9b700 1 --2- 172.21.15.45:0/2428311261 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d9b591660 0x559d9b58c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:53.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.425+0000 7f9aad79a700 1 --2- 172.21.15.45:0/2428311261 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x559d9b5a5ac0 0x559d9b5be0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:53.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.425+0000 7f9aae79c700 1 -- 172.21.15.45:0/2428311261 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x559d9b5a5ac0 msgr2=0x559d9b5be0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:53.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.425+0000 7f9aae79c700 1 --2- 172.21.15.45:0/2428311261 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x559d9b5a5ac0 0x559d9b5be0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:53.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.425+0000 7f9aae79c700 1 -- 172.21.15.45:0/2428311261 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d9b591660 msgr2=0x559d9b58c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:53.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.425+0000 7f9aae79c700 1 --2- 172.21.15.45:0/2428311261 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d9b591660 0x559d9b58c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:53.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.425+0000 7f9aae79c700 1 -- 172.21.15.45:0/2428311261 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9aa0001e80 con 0x559d9b5aef50 2023-11-28T12:07:53.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.425+0000 7f9aae79c700 1 --2- 172.21.15.45:0/2428311261 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559d9b5aef50 0x559d9b5be620 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f9aa00070a0 tx=0x7f9aa0001590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da92e2a4587321be server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:53.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.425+0000 7f9a88ff9700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-11-28T12:07:53.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.426+0000 7f9a88ff9700 1 -- 172.21.15.45:0/2428311261 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa0007750 con 0x559d9b5aef50 2023-11-28T12:07:53.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.426+0000 7f9a88ff9700 1 -- 172.21.15.45:0/2428311261 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9aa00078b0 con 0x559d9b5aef50 2023-11-28T12:07:53.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.426+0000 7f9ac3c0bb80 1 -- 172.21.15.45:0/2428311261 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559d9b4bf030 con 0x559d9b5aef50 2023-11-28T12:07:53.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.426+0000 7f9a88ff9700 1 -- 172.21.15.45:0/2428311261 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9aa0007ab0 con 0x559d9b5aef50 2023-11-28T12:07:53.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.426+0000 7f9ac3c0bb80 10 client.5286 fetch_fsmap learned FSMap version 16 2023-11-28T12:07:53.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.426+0000 7f9ac3c0bb80 1 -- 172.21.15.45:0/2428311261 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x559d9b39c0a0 con 0x559d9b5aef50 2023-11-28T12:07:53.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.426+0000 7f9a88ff9700 1 -- 172.21.15.45:0/2428311261 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559d9b4bf030 con 0x559d9b5aef50 2023-11-28T12:07:53.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.426+0000 7f9a88ff9700 1 -- 172.21.15.45:0/2428311261 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 16) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f9aa0020480 con 0x559d9b5aef50 2023-11-28T12:07:53.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.426+0000 7f9ac3c0bb80 10 client.5286 fetch_fsmap finished waiting for FSMap version 16 2023-11-28T12:07:53.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.426+0000 7f9ac3c0bb80 10 client.5286 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-28T12:07:53.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.427+0000 7f9ac3c0bb80 20 client.5286 populate_metadata read hostname 'smithi045' 2023-11-28T12:07:53.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.427+0000 7f9ac3c0bb80 1 --2- 172.21.15.45:0/2428311261 >> [v2:172.21.15.45:6832/2964277738,v1:172.21.15.45:6834/2964277738] conn(0x559d9b591b60 0x559d9b591f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:53.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.427+0000 7f9ac3c0bb80 4 client.5286 mds_command: new command op to 5061 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-28T12:07:53.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.427+0000 7f9ac3c0bb80 1 -- 172.21.15.45:0/2428311261 --> [v2:172.21.15.45:6832/2964277738,v1:172.21.15.45:6834/2964277738] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559d9b30aef0 con 0x559d9b591b60 2023-11-28T12:07:53.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.427+0000 7f9aadf9b700 1 --2- 172.21.15.45:0/2428311261 >> [v2:172.21.15.45:6832/2964277738,v1:172.21.15.45:6834/2964277738] conn(0x559d9b591b60 0x559d9b591f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:53.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.427+0000 7f9aadf9b700 1 --2- 172.21.15.45:0/2428311261 >> [v2:172.21.15.45:6832/2964277738,v1:172.21.15.45:6834/2964277738] conn(0x559d9b591b60 0x559d9b591f30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a268e97ea1eb511 server_cookie=efd8df924f1c6002 in_seq=0 out_seq=0 2023-11-28T12:07:53.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.427+0000 7f9a88ff9700 10 client.5286 ms_handle_connect on v2:172.21.15.45:6832/2964277738 2023-11-28T12:07:53.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.428+0000 7f9a88ff9700 1 -- 172.21.15.45:0/2428311261 <== mds.0 v2:172.21.15.45:6832/2964277738 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x559d9b30aef0 con 0x559d9b591b60 2023-11-28T12:07:53.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.428+0000 7f9a88ff9700 10 client.5286 handle_command_reply: tid=0 2023-11-28T12:07:53.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.428+0000 7f9ac3c0bb80 1 client.5286 shutdown 2023-11-28T12:07:53.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.428+0000 7f9ac3c0bb80 1 -- 172.21.15.45:0/2428311261 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559d9b5aef50 msgr2=0x559d9b5be620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:53.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.428+0000 7f9ac3c0bb80 1 --2- 172.21.15.45:0/2428311261 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559d9b5aef50 0x559d9b5be620 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f9aa00070a0 tx=0x7f9aa0001590 comp rx=0 tx=0).stop 2023-11-28T12:07:53.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.428+0000 7f9ac3c0bb80 1 -- 172.21.15.45:0/2428311261 shutdown_connections 2023-11-28T12:07:53.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.428+0000 7f9ac3c0bb80 1 --2- 172.21.15.45:0/2428311261 >> [v2:172.21.15.45:6832/2964277738,v1:172.21.15.45:6834/2964277738] conn(0x559d9b591b60 0x559d9b591f30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:53.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.428+0000 7f9ac3c0bb80 1 --2- 172.21.15.45:0/2428311261 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d9b591660 0x559d9b58c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:53.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.428+0000 7f9ac3c0bb80 1 --2- 172.21.15.45:0/2428311261 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559d9b5aef50 0x559d9b5be620 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:53.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.428+0000 7f9ac3c0bb80 1 --2- 172.21.15.45:0/2428311261 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x559d9b5a5ac0 0x559d9b5be0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:53.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.428+0000 7f9a88ff9700 0 client.5286 ms_handle_reset on v2:172.21.15.45:6832/2964277738 2023-11-28T12:07:53.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.428+0000 7f9ac3c0bb80 1 -- 172.21.15.45:0/2428311261 >> 172.21.15.45:0/2428311261 conn(0x559d9b55ed20 msgr2=0x559d9b563ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:53.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.429+0000 7f9ac3c0bb80 1 -- 172.21.15.45:0/2428311261 shutdown_connections 2023-11-28T12:07:53.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.429+0000 7f9ac3c0bb80 1 -- 172.21.15.45:0/2428311261 wait complete. 2023-11-28T12:07:53.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.429+0000 7f9ac3c0bb80 20 client.5286 trim_cache size 0 max 16384 2023-11-28T12:07:53.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.447+0000 7f9ac3c0bb80 1 Processor -- start 2023-11-28T12:07:53.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.447+0000 7f9ac3c0bb80 1 -- start start 2023-11-28T12:07:53.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.447+0000 7f9ac3c0bb80 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x559d9b591660 0x559d9b593710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:53.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.448+0000 7f9ac3c0bb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d9b5a5ac0 0x559d9b565610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:53.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.448+0000 7f9ac3c0bb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559d9b5aef50 0x559d9b5bdd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:53.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.448+0000 7f9ac3c0bb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d9b5bebd0 con 0x559d9b5aef50 2023-11-28T12:07:53.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.448+0000 7f9ac3c0bb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d9b590430 con 0x559d9b5a5ac0 2023-11-28T12:07:53.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.448+0000 7f9ac3c0bb80 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x559d9b565b50 con 0x559d9b591660 2023-11-28T12:07:53.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.448+0000 7f9aae79c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559d9b5aef50 0x559d9b5bdd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:53.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.448+0000 7f9aae79c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559d9b5aef50 0x559d9b5bdd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55494/0 (socket says 172.21.15.45:55494) 2023-11-28T12:07:53.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.448+0000 7f9aae79c700 1 -- 172.21.15.45:0/2639194309 learned_addr learned my addr 172.21.15.45:0/2639194309 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:53.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.448+0000 7f9aad79a700 1 --2- 172.21.15.45:0/2639194309 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d9b5a5ac0 0x559d9b565610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:53.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.448+0000 7f9aadf9b700 1 --2- 172.21.15.45:0/2639194309 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x559d9b591660 0x559d9b593710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:53.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.448+0000 7f9aae79c700 1 -- 172.21.15.45:0/2639194309 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x559d9b591660 msgr2=0x559d9b593710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:53.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.448+0000 7f9aae79c700 1 --2- 172.21.15.45:0/2639194309 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x559d9b591660 0x559d9b593710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:53.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.448+0000 7f9aae79c700 1 -- 172.21.15.45:0/2639194309 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d9b5a5ac0 msgr2=0x559d9b565610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:53.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.448+0000 7f9aae79c700 1 --2- 172.21.15.45:0/2639194309 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d9b5a5ac0 0x559d9b565610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:53.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.448+0000 7f9aae79c700 1 -- 172.21.15.45:0/2639194309 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559d9b4822e0 con 0x559d9b5aef50 2023-11-28T12:07:53.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.449+0000 7f9aae79c700 1 --2- 172.21.15.45:0/2639194309 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559d9b5aef50 0x559d9b5bdd90 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f9aa0001e50 tx=0x7f9aa001f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eb625cef601322c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:53.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.449+0000 7f9a8bfff700 1 -- 172.21.15.45:0/2639194309 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa0020480 con 0x559d9b5aef50 2023-11-28T12:07:53.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.449+0000 7f9a8bfff700 1 -- 172.21.15.45:0/2639194309 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aa00205e0 con 0x559d9b5aef50 2023-11-28T12:07:53.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.449+0000 7f9a8bfff700 1 -- 172.21.15.45:0/2639194309 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa0007790 con 0x559d9b5aef50 2023-11-28T12:07:53.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.449+0000 7f9ac3c0bb80 1 -- 172.21.15.45:0/2639194309 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559d9b5aef50 msgr2=0x559d9b5bdd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:53.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.449+0000 7f9ac3c0bb80 1 --2- 172.21.15.45:0/2639194309 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559d9b5aef50 0x559d9b5bdd90 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f9aa0001e50 tx=0x7f9aa001f000 comp rx=0 tx=0).stop 2023-11-28T12:07:53.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.450+0000 7f9ac3c0bb80 1 -- 172.21.15.45:0/2639194309 shutdown_connections 2023-11-28T12:07:53.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.450+0000 7f9ac3c0bb80 1 --2- 172.21.15.45:0/2639194309 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559d9b5aef50 0x559d9b5bdd90 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:53.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.450+0000 7f9ac3c0bb80 1 --2- 172.21.15.45:0/2639194309 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x559d9b591660 0x559d9b593710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:53.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.450+0000 7f9ac3c0bb80 1 --2- 172.21.15.45:0/2639194309 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d9b5a5ac0 0x559d9b565610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:53.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.450+0000 7f9ac3c0bb80 1 -- 172.21.15.45:0/2639194309 >> 172.21.15.45:0/2639194309 conn(0x559d9b55ed20 msgr2=0x559d9b595070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:53.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.450+0000 7f9ac3c0bb80 1 -- 172.21.15.45:0/2639194309 shutdown_connections 2023-11-28T12:07:53.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.450+0000 7f9ac3c0bb80 1 -- 172.21.15.45:0/2639194309 wait complete. 2023-11-28T12:07:53.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.450+0000 7f9ac3c0bb80 1 -- start start 2023-11-28T12:07:53.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.450+0000 7f9ac3c0bb80 1 Processor -- start 2023-11-28T12:07:53.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.451+0000 7f9ac3c0bb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559d9b591660 0x559d9b613700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:53.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.451+0000 7f9ac3c0bb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d9b5a5ac0 0x559d9b5ae680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:53.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.451+0000 7f9ac3c0bb80 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x559d9b5aef50 0x559d9b5ab260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:53.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.451+0000 7f9ac3c0bb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d9b58b940 con 0x559d9b591660 2023-11-28T12:07:53.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.451+0000 7f9ac3c0bb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d9b591fc0 con 0x559d9b5a5ac0 2023-11-28T12:07:53.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.451+0000 7f9ac3c0bb80 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x559d9b5aebc0 con 0x559d9b5aef50 2023-11-28T12:07:53.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.451+0000 7f9ac3c0bb80 10 client.0 _ll_register_callbacks cb 0x559d9b459400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T12:07:53.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.452+0000 7f9aadf9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559d9b591660 0x559d9b613700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:53.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.452+0000 7f9aadf9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559d9b591660 0x559d9b613700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55508/0 (socket says 172.21.15.45:55508) 2023-11-28T12:07:53.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.452+0000 7f9aadf9b700 1 -- 172.21.15.45:0/3009799665 learned_addr learned my addr 172.21.15.45:0/3009799665 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:53.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.452+0000 7f9aae79c700 1 --2- 172.21.15.45:0/3009799665 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x559d9b5aef50 0x559d9b5ab260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:53.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.452+0000 7f9aad79a700 1 --2- 172.21.15.45:0/3009799665 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d9b5a5ac0 0x559d9b5ae680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:53.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.452+0000 7f9aadf9b700 1 -- 172.21.15.45:0/3009799665 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x559d9b5aef50 msgr2=0x559d9b5ab260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:53.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.452+0000 7f9aadf9b700 1 --2- 172.21.15.45:0/3009799665 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x559d9b5aef50 0x559d9b5ab260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:53.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.452+0000 7f9aadf9b700 1 -- 172.21.15.45:0/3009799665 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d9b5a5ac0 msgr2=0x559d9b5ae680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:53.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.452+0000 7f9aadf9b700 1 --2- 172.21.15.45:0/3009799665 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d9b5a5ac0 0x559d9b5ae680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:53.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.452+0000 7f9aadf9b700 1 -- 172.21.15.45:0/3009799665 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559d9b39c0a0 con 0x559d9b591660 2023-11-28T12:07:53.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.452+0000 7f9aadf9b700 1 --2- 172.21.15.45:0/3009799665 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559d9b591660 0x559d9b613700 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f9aa4052050 tx=0x7f9aa405b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e808c41d0ee74787 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:53.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.452+0000 7f9a88ff9700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-11-28T12:07:53.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.453+0000 7f9a88ff9700 1 -- 172.21.15.45:0/3009799665 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa4081070 con 0x559d9b591660 2023-11-28T12:07:53.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.453+0000 7f9a88ff9700 1 -- 172.21.15.45:0/3009799665 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9aa4051b50 con 0x559d9b591660 2023-11-28T12:07:53.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.453+0000 7f9ac3c0bb80 1 -- 172.21.15.45:0/3009799665 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559d9b340040 con 0x559d9b591660 2023-11-28T12:07:53.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.453+0000 7f9a88ff9700 1 -- 172.21.15.45:0/3009799665 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9aa4059ab0 con 0x559d9b591660 2023-11-28T12:07:53.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.453+0000 7f9ac3c0bb80 10 client.5292 fetch_fsmap learned FSMap version 16 2023-11-28T12:07:53.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.453+0000 7f9ac3c0bb80 1 -- 172.21.15.45:0/3009799665 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x559d9b3101d0 con 0x559d9b591660 2023-11-28T12:07:53.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.453+0000 7f9a88ff9700 1 -- 172.21.15.45:0/3009799665 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aa4073020 con 0x559d9b591660 2023-11-28T12:07:53.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.453+0000 7f9a88ff9700 1 -- 172.21.15.45:0/3009799665 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 16) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f9aa4059c10 con 0x559d9b591660 2023-11-28T12:07:53.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.453+0000 7f9ac3c0bb80 10 client.5292 fetch_fsmap finished waiting for FSMap version 16 2023-11-28T12:07:53.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.453+0000 7f9ac3c0bb80 10 client.5292 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-28T12:07:53.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.453+0000 7f9ac3c0bb80 20 client.5292 populate_metadata read hostname 'smithi045' 2023-11-28T12:07:53.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.453+0000 7f9ac3c0bb80 1 --2- 172.21.15.45:0/3009799665 >> [v2:172.21.15.45:6832/2964277738,v1:172.21.15.45:6834/2964277738] conn(0x559d9b5be3c0 0x559d9b5be790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:53.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.453+0000 7f9ac3c0bb80 4 client.5292 mds_command: new command op to 5061 tid=0[{"prefix": "status"}] 2023-11-28T12:07:53.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.453+0000 7f9ac3c0bb80 1 -- 172.21.15.45:0/3009799665 --> [v2:172.21.15.45:6832/2964277738,v1:172.21.15.45:6834/2964277738] -- command(tid 0: {"prefix": "status"}) v1 -- 0x559d9b3fd3c0 con 0x559d9b5be3c0 2023-11-28T12:07:53.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.453+0000 7f9aad79a700 1 --2- 172.21.15.45:0/3009799665 >> [v2:172.21.15.45:6832/2964277738,v1:172.21.15.45:6834/2964277738] conn(0x559d9b5be3c0 0x559d9b5be790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:53.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.454+0000 7f9aad79a700 1 --2- 172.21.15.45:0/3009799665 >> [v2:172.21.15.45:6832/2964277738,v1:172.21.15.45:6834/2964277738] conn(0x559d9b5be3c0 0x559d9b5be790 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a673a9984d3a85dd server_cookie=a4438cd80c9bf41f in_seq=0 out_seq=0 2023-11-28T12:07:53.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.454+0000 7f9a88ff9700 10 client.5292 ms_handle_connect on v2:172.21.15.45:6832/2964277738 2023-11-28T12:07:53.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.454+0000 7f9a88ff9700 1 -- 172.21.15.45:0/3009799665 <== mds.0 v2:172.21.15.45:6832/2964277738 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x559d9b3fd3c0 con 0x559d9b5be3c0 2023-11-28T12:07:53.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.454+0000 7f9a88ff9700 10 client.5292 handle_command_reply: tid=0 2023-11-28T12:07:53.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.454+0000 7f9ac3c0bb80 1 client.5292 shutdown 2023-11-28T12:07:53.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.454+0000 7f9ac3c0bb80 1 -- 172.21.15.45:0/3009799665 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559d9b591660 msgr2=0x559d9b613700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:53.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.454+0000 7f9ac3c0bb80 1 --2- 172.21.15.45:0/3009799665 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559d9b591660 0x559d9b613700 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f9aa4052050 tx=0x7f9aa405b040 comp rx=0 tx=0).stop 2023-11-28T12:07:53.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.454+0000 7f9ac3c0bb80 1 -- 172.21.15.45:0/3009799665 shutdown_connections 2023-11-28T12:07:53.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.454+0000 7f9ac3c0bb80 1 --2- 172.21.15.45:0/3009799665 >> [v2:172.21.15.45:6832/2964277738,v1:172.21.15.45:6834/2964277738] conn(0x559d9b5be3c0 0x559d9b5be790 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:53.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.454+0000 7f9ac3c0bb80 1 --2- 172.21.15.45:0/3009799665 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x559d9b5aef50 0x559d9b5ab260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:53.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.454+0000 7f9ac3c0bb80 1 --2- 172.21.15.45:0/3009799665 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559d9b591660 0x559d9b613700 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:53.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.454+0000 7f9ac3c0bb80 1 --2- 172.21.15.45:0/3009799665 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559d9b5a5ac0 0x559d9b5ae680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:53.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.454+0000 7f9a88ff9700 0 client.5292 ms_handle_reset on v2:172.21.15.45:6832/2964277738 2023-11-28T12:07:53.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.454+0000 7f9ac3c0bb80 1 -- 172.21.15.45:0/3009799665 >> 172.21.15.45:0/3009799665 conn(0x559d9b55ed20 msgr2=0x559d9b5905c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:53.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.455+0000 7f9ac3c0bb80 1 -- 172.21.15.45:0/3009799665 shutdown_connections 2023-11-28T12:07:53.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.455+0000 7f9ac3c0bb80 1 -- 172.21.15.45:0/3009799665 wait complete. 2023-11-28T12:07:53.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.455+0000 7f9ac3c0bb80 20 client.5292 trim_cache size 0 max 16384 2023-11-28T12:07:53.461 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-11-28T12:07:53.461 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_fsid": "bd7c37f1-f7c6-4778-b845-52cf2aa6e366", 2023-11-28T12:07:53.462 INFO:teuthology.orchestra.run.smithi045.stdout: "whoami": 0, 2023-11-28T12:07:53.462 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 5061, 2023-11-28T12:07:53.462 INFO:teuthology.orchestra.run.smithi045.stdout: "want_state": "up:active", 2023-11-28T12:07:53.462 INFO:teuthology.orchestra.run.smithi045.stdout: "state": "up:active", 2023-11-28T12:07:53.462 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs", 2023-11-28T12:07:53.462 INFO:teuthology.orchestra.run.smithi045.stdout: "rank_uptime": 11.802350150000001, 2023-11-28T12:07:53.462 INFO:teuthology.orchestra.run.smithi045.stdout: "mdsmap_epoch": 16, 2023-11-28T12:07:53.462 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch": 34, 2023-11-28T12:07:53.462 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch_barrier": 34, 2023-11-28T12:07:53.462 INFO:teuthology.orchestra.run.smithi045.stdout: "uptime": 21.110558594 2023-11-28T12:07:53.462 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-11-28T12:07:53.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.455+0000 7f9ab01ff700 1 -- 172.21.15.45:0/4286224339 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f9a8c0682f0 msgr2=0x7f9a8c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:53.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.455+0000 7f9ab01ff700 1 --2- 172.21.15.45:0/4286224339 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f9a8c0682f0 0x7f9a8c06a7a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9aa80b4b50 tx=0x7f9a98008030 comp rx=0 tx=0).stop 2023-11-28T12:07:53.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.455+0000 7f9ab01ff700 1 -- 172.21.15.45:0/4286224339 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9aa80b4750 msgr2=0x7f9aa80c97e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:53.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.455+0000 7f9ab01ff700 1 --2- 172.21.15.45:0/4286224339 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9aa80b4750 0x7f9aa80c97e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f9aa400e730 tx=0x7f9aa400eaf0 comp rx=0 tx=0).stop 2023-11-28T12:07:53.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.455+0000 7f9ab01ff700 1 -- 172.21.15.45:0/4286224339 shutdown_connections 2023-11-28T12:07:53.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.455+0000 7f9ab01ff700 1 --2- 172.21.15.45:0/4286224339 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f9a8c0682f0 0x7f9a8c06a7a0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:53.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.455+0000 7f9ab01ff700 1 --2- 172.21.15.45:0/4286224339 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9aa80d13c0 0x7f9aa8158780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:53.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.455+0000 7f9ab01ff700 1 --2- 172.21.15.45:0/4286224339 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9aa80b4750 0x7f9aa80c97e0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:53.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.455+0000 7f9ab01ff700 1 --2- 172.21.15.45:0/4286224339 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9aa80d0ff0 0x7f9aa8155770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:53.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.455+0000 7f9ab01ff700 1 -- 172.21.15.45:0/4286224339 >> 172.21.15.45:0/4286224339 conn(0x7f9aa809c3c0 msgr2=0x7f9aa80afcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:53.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.456+0000 7f9ab01ff700 1 -- 172.21.15.45:0/4286224339 shutdown_connections 2023-11-28T12:07:53.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.456+0000 7f9ab01ff700 1 -- 172.21.15.45:0/4286224339 wait complete. 2023-11-28T12:07:53.475 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T12:07:53.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.677+0000 7f0689bff700 1 Processor -- start 2023-11-28T12:07:53.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.678+0000 7f0689bff700 1 -- start start 2023-11-28T12:07:53.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.679+0000 7f0689bff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0684161340 0x7f06840d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:53.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.679+0000 7f0689bff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06840d1950 con 0x7f068415c9b0 2023-11-28T12:07:53.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.679+0000 7f0689bff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06840b5520 con 0x7f06840d2320 2023-11-28T12:07:53.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.679+0000 7f0689bff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06840b5800 con 0x7f0684161340 2023-11-28T12:07:53.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.679+0000 7f06837fe700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f068415c9b0 0x7f06840b4bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:35232/0 (socket says 172.21.15.45:35232) 2023-11-28T12:07:53.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.679+0000 7f06837fe700 1 -- 172.21.15.45:0/3154397180 learned_addr learned my addr 172.21.15.45:0/3154397180 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:07:53.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.679+0000 7f0682ffd700 1 --2- 172.21.15.45:0/3154397180 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0684161340 0x7f06840d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:53.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.680+0000 7f06827fc700 1 -- 172.21.15.45:0/3154397180 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2001730318 0 0) 0x7f06840d1950 con 0x7f068415c9b0 2023-11-28T12:07:53.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.680+0000 7f06827fc700 1 -- 172.21.15.45:0/3154397180 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f066c0035b0 con 0x7f068415c9b0 2023-11-28T12:07:53.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.680+0000 7f06827fc700 1 -- 172.21.15.45:0/3154397180 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1041683980 0 0) 0x7f06840b5520 con 0x7f06840d2320 2023-11-28T12:07:53.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.680+0000 7f0682ffd700 1 -- 172.21.15.45:0/3154397180 >> v1:172.21.15.152:6789/0 conn(0x7f06840d2320 legacy=0x7f06840cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:53.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.680+0000 7f0682ffd700 1 -- 172.21.15.45:0/3154397180 >> v1:172.21.15.45:6789/0 conn(0x7f068415c9b0 legacy=0x7f06840b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:53.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.680+0000 7f0682ffd700 1 -- 172.21.15.45:0/3154397180 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06840d1300 con 0x7f0684161340 2023-11-28T12:07:53.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.680+0000 7f0682ffd700 1 --2- 172.21.15.45:0/3154397180 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0684161340 0x7f06840d1de0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0678009870 tx=0x7f0678009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5a37c1129c29fa9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:53.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.680+0000 7f06827fc700 1 -- 172.21.15.45:0/3154397180 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0678011830 con 0x7f0684161340 2023-11-28T12:07:53.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.681+0000 7f06827fc700 1 -- 172.21.15.45:0/3154397180 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0678011990 con 0x7f0684161340 2023-11-28T12:07:53.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.681+0000 7f06827fc700 1 -- 172.21.15.45:0/3154397180 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0678011d20 con 0x7f0684161340 2023-11-28T12:07:53.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.681+0000 7f0689bff700 1 -- 172.21.15.45:0/3154397180 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0684161340 msgr2=0x7f06840d1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:53.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.681+0000 7f0689bff700 1 --2- 172.21.15.45:0/3154397180 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0684161340 0x7f06840d1de0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0678009870 tx=0x7f0678009b80 comp rx=0 tx=0).stop 2023-11-28T12:07:53.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.681+0000 7f0689bff700 1 -- 172.21.15.45:0/3154397180 shutdown_connections 2023-11-28T12:07:53.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.681+0000 7f0689bff700 1 --2- 172.21.15.45:0/3154397180 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0684161340 0x7f06840d1de0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:53.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.681+0000 7f0689bff700 1 -- 172.21.15.45:0/3154397180 >> 172.21.15.45:0/3154397180 conn(0x7f0684072600 msgr2=0x7f06840cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:53.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.681+0000 7f0689bff700 1 -- 172.21.15.45:0/3154397180 shutdown_connections 2023-11-28T12:07:53.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.681+0000 7f0689bff700 1 -- 172.21.15.45:0/3154397180 wait complete. 2023-11-28T12:07:53.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.683+0000 7f0689bff700 1 Processor -- start 2023-11-28T12:07:53.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.683+0000 7f0689bff700 1 -- start start 2023-11-28T12:07:53.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.684+0000 7f0689bff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06840d2320 0x7f0684151910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:53.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.684+0000 7f0689bff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f068415c9b0 0x7f068415f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:53.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.684+0000 7f0689bff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0684161340 0x7f0684156570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:53.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.684+0000 7f0689bff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f068415e080 con 0x7f0684161340 2023-11-28T12:07:53.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.684+0000 7f0689bff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f068415f7a0 con 0x7f06840d2320 2023-11-28T12:07:53.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.684+0000 7f0689bff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f068415d470 con 0x7f068415c9b0 2023-11-28T12:07:53.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.684+0000 7f06837fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06840d2320 0x7f0684151910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:53.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.684+0000 7f0683fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0684161340 0x7f0684156570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:53.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.684+0000 7f0682ffd700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f068415c9b0 0x7f068415f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:53.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.685+0000 7f06837fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06840d2320 0x7f0684151910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.45:45620/0 (socket says 172.21.15.45:45620) 2023-11-28T12:07:53.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.685+0000 7f06837fe700 1 -- 172.21.15.45:0/410007014 learned_addr learned my addr 172.21.15.45:0/410007014 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:53.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.685+0000 7f0683fff700 1 -- 172.21.15.45:0/410007014 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f068415c9b0 msgr2=0x7f068415f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:53.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.685+0000 7f0683fff700 1 --2- 172.21.15.45:0/410007014 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f068415c9b0 0x7f068415f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:53.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.685+0000 7f0683fff700 1 -- 172.21.15.45:0/410007014 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06840d2320 msgr2=0x7f0684151910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:53.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.685+0000 7f0683fff700 1 --2- 172.21.15.45:0/410007014 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06840d2320 0x7f0684151910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:53.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.685+0000 7f0683fff700 1 -- 172.21.15.45:0/410007014 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06780094a0 con 0x7f0684161340 2023-11-28T12:07:53.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.685+0000 7f0683fff700 1 --2- 172.21.15.45:0/410007014 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0684161340 0x7f0684156570 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f067c00c780 tx=0x7f067c00ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:53.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.685+0000 7f066bfff700 1 -- 172.21.15.45:0/410007014 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f067c003e30 con 0x7f0684161340 2023-11-28T12:07:53.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.685+0000 7f066bfff700 1 -- 172.21.15.45:0/410007014 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f067c0050d0 con 0x7f0684161340 2023-11-28T12:07:53.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.685+0000 7f0689bff700 1 -- 172.21.15.45:0/410007014 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f068415cd80 con 0x7f0684161340 2023-11-28T12:07:53.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.686+0000 7f066bfff700 1 -- 172.21.15.45:0/410007014 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f067c005480 con 0x7f0684161340 2023-11-28T12:07:53.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.686+0000 7f0689bff700 1 -- 172.21.15.45:0/410007014 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06840d15e0 con 0x7f0684161340 2023-11-28T12:07:53.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.687+0000 7f0689bff700 1 -- 172.21.15.45:0/410007014 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f068415cf10 con 0x7f0684161340 2023-11-28T12:07:53.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.688+0000 7f066bfff700 1 -- 172.21.15.45:0/410007014 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f067c019030 con 0x7f0684161340 2023-11-28T12:07:53.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.689+0000 7f066bfff700 1 --2- 172.21.15.45:0/410007014 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f06700682f0 0x7f067006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:53.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.689+0000 7f066bfff700 1 -- 172.21.15.45:0/410007014 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f067c085230 con 0x7f0684161340 2023-11-28T12:07:53.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.689+0000 7f06837fe700 1 --2- 172.21.15.45:0/410007014 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f06700682f0 0x7f067006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:53.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.690+0000 7f06837fe700 1 --2- 172.21.15.45:0/410007014 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f06700682f0 0x7f067006a7a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0674005910 tx=0x7f0674009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:53.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.692+0000 7f066bfff700 1 -- 172.21.15.45:0/410007014 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f067c051940 con 0x7f0684161340 2023-11-28T12:07:53.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.939+0000 7f0689bff700 1 -- 172.21.15.45:0/410007014 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f068415e1c0 con 0x7f0684161340 2023-11-28T12:07:53.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.939+0000 7f066bfff700 1 -- 172.21.15.45:0/410007014 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7f068415e1c0 con 0x7f0684161340 2023-11-28T12:07:53.941 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-28T12:07:53.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.941+0000 7f0689bff700 1 -- 172.21.15.45:0/410007014 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f06700682f0 msgr2=0x7f067006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:53.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.941+0000 7f0689bff700 1 --2- 172.21.15.45:0/410007014 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f06700682f0 0x7f067006a7a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0674005910 tx=0x7f0674009040 comp rx=0 tx=0).stop 2023-11-28T12:07:53.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.941+0000 7f0689bff700 1 -- 172.21.15.45:0/410007014 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0684161340 msgr2=0x7f0684156570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:53.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.941+0000 7f0689bff700 1 --2- 172.21.15.45:0/410007014 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0684161340 0x7f0684156570 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f067c00c780 tx=0x7f067c00ca90 comp rx=0 tx=0).stop 2023-11-28T12:07:53.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.941+0000 7f0689bff700 1 -- 172.21.15.45:0/410007014 shutdown_connections 2023-11-28T12:07:53.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.941+0000 7f0689bff700 1 --2- 172.21.15.45:0/410007014 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f06700682f0 0x7f067006a7a0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:53.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.941+0000 7f0689bff700 1 --2- 172.21.15.45:0/410007014 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06840d2320 0x7f0684151910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:53.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.941+0000 7f0689bff700 1 --2- 172.21.15.45:0/410007014 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0684161340 0x7f0684156570 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:53.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.941+0000 7f0689bff700 1 --2- 172.21.15.45:0/410007014 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f068415c9b0 0x7f068415f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:53.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.941+0000 7f0689bff700 1 -- 172.21.15.45:0/410007014 >> 172.21.15.45:0/410007014 conn(0x7f0684072600 msgr2=0x7f068415f970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:53.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.941+0000 7f0689bff700 1 -- 172.21.15.45:0/410007014 shutdown_connections 2023-11-28T12:07:53.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:53.941+0000 7f0689bff700 1 -- 172.21.15.45:0/410007014 wait complete. 2023-11-28T12:07:53.960 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-28T12:07:53.961 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T12:07:53.961 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi045.front.sepia.ceph.com 2023-11-28T12:07:53.961 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-28T12:07:53.961 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-28T12:07:53.961 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-28T12:07:53.961 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-28T12:07:53.961 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T12:07:53.961 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T12:07:53.961 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:07:53.962 DEBUG:teuthology.orchestra.run.smithi045:> ip addr 2023-11-28T12:07:54.010 INFO:teuthology.orchestra.run.smithi045.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T12:07:54.010 INFO:teuthology.orchestra.run.smithi045.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T12:07:54.010 INFO:teuthology.orchestra.run.smithi045.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T12:07:54.010 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T12:07:54.010 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 ::1/128 scope host 2023-11-28T12:07:54.010 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T12:07:54.010 INFO:teuthology.orchestra.run.smithi045.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-28T12:07:54.010 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a6 brd ff:ff:ff:ff:ff:ff 2023-11-28T12:07:54.010 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f0 2023-11-28T12:07:54.011 INFO:teuthology.orchestra.run.smithi045.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-28T12:07:54.011 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a7 brd ff:ff:ff:ff:ff:ff 2023-11-28T12:07:54.011 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f1 2023-11-28T12:07:54.011 INFO:teuthology.orchestra.run.smithi045.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T12:07:54.011 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:be brd ff:ff:ff:ff:ff:ff 2023-11-28T12:07:54.011 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f0 2023-11-28T12:07:54.011 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.21.15.45/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-11-28T12:07:54.011 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft 41915sec preferred_lft 41915sec 2023-11-28T12:07:54.011 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::ec4:7aff:febd:12be/64 scope link 2023-11-28T12:07:54.011 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T12:07:54.011 INFO:teuthology.orchestra.run.smithi045.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-28T12:07:54.011 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:bf brd ff:ff:ff:ff:ff:ff 2023-11-28T12:07:54.012 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f1 2023-11-28T12:07:54.012 INFO:teuthology.orchestra.run.smithi045.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T12:07:54.012 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 22:47:66:33:f5:4d brd ff:ff:ff:ff:ff:ff 2023-11-28T12:07:54.012 INFO:teuthology.orchestra.run.smithi045.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-28T12:07:54.012 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T12:07:54.012 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::c479:bdff:fe23:e158/64 scope link 2023-11-28T12:07:54.012 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T12:07:54.012 INFO:teuthology.orchestra.run.smithi045.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T12:07:54.012 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 62:87:bf:4a:62:2a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T12:07:54.012 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::6087:bfff:fe4a:622a/64 scope link 2023-11-28T12:07:54.012 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T12:07:54.012 INFO:teuthology.orchestra.run.smithi045.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T12:07:54.012 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 22:47:66:33:f5:4d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T12:07:54.013 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::2047:66ff:fe33:f54d/64 scope link 2023-11-28T12:07:54.013 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T12:07:54.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:07:54.013 DEBUG:teuthology.orchestra.run.smithi045:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T12:07:54.119 INFO:teuthology.orchestra.run.smithi045.stdout:1 2023-11-28T12:07:54.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:07:54.123 DEBUG:teuthology.orchestra.run.smithi045:> route 2023-11-28T12:07:54.172 INFO:teuthology.orchestra.run.smithi045.stdout:Kernel IP routing table 2023-11-28T12:07:54.172 INFO:teuthology.orchestra.run.smithi045.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T12:07:54.173 INFO:teuthology.orchestra.run.smithi045.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-11-28T12:07:54.173 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-11-28T12:07:54.173 INFO:teuthology.orchestra.run.smithi045.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T12:07:54.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:07:54.174 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-11-28T12:07:54.174 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-11-28T12:07:54.174 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-28T12:07:54.174 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-28T12:07:54.174 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-28T12:07:54.174 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-11-28T12:07:54.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:07:54.347 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2023-11-28T12:07:54.397 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-28T12:07:54.397 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-28T12:07:54.398 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T12:07:54.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:07:54.398 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set brx.0 up 2023-11-28T12:07:54.510 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T12:07:54.510 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-28T12:07:54.556 INFO:teuthology.orchestra.run.smithi045.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-28T12:07:54.556 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T12:07:54.557 DEBUG:teuthology.orchestra.run.smithi045:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-28T12:07:54.642 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-28T12:07:54.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:07:54.643 DEBUG:teuthology.orchestra.run.smithi045:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-28T12:07:54.790 INFO:teuthology.orchestra.run.smithi045.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-28T12:07:54.791 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-28T12:07:54.791 INFO:teuthology.orchestra.run.smithi045.stdout:invalid new device string format 2023-11-28T12:07:54.807 INFO:teuthology.orchestra.run.smithi045.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-28T12:07:54.807 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-28T12:07:54.807 INFO:teuthology.orchestra.run.smithi045.stdout:invalid new device string format 2023-11-28T12:07:54.807 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: resolved to: "172.21.15.45:3300,172.21.15.152:3300,172.21.15.152:3301" 2023-11-28T12:07:54.807 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-28T12:07:54.829 INFO:teuthology.orchestra.run.smithi045.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-28T12:07:54.829 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-28T12:07:54.829 INFO:teuthology.orchestra.run.smithi045.stdout:invalid new device string format 2023-11-28T12:07:54.829 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: resolved to: "172.21.15.45:3300,172.21.15.152:3300,172.21.15.152:3301" 2023-11-28T12:07:54.829 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-28T12:07:54.829 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: resolved to: "172.21.15.45:6789,172.21.15.152:6789,172.21.15.152:6790" 2023-11-28T12:07:54.830 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.45:6789,172.21.15.152:6789,172.21.15.152:6790:/ 2023-11-28T12:07:54.830 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=bd7c37f1-f7c6-4778-b845-52cf2aa6e366" will pass to kernel 2023-11-28T12:07:54.835 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-28T12:07:54.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:07:54.835 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-28T12:07:54.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:07:54.907 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-28T12:07:55.008 INFO:teuthology.orchestra.run.smithi045.stdout:client5301 2023-11-28T12:07:55.009 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T12:07:55.009 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T12:07:55.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:07:55.056 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parentdir) 2023-11-28T12:07:55.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:07:55.149 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parentdir/childdir) 2023-11-28T12:07:55.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:07:55.198 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch rfile) 2023-11-28T12:07:55.247 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:07:55.247 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch parentdir/pfile) 2023-11-28T12:07:55.299 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:07:55.299 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch parentdir/childdir/cfile) 2023-11-28T12:07:55.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:07:55.347 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec find ./) 2023-11-28T12:07:55.399 INFO:teuthology.orchestra.run.smithi045.stdout:./ 2023-11-28T12:07:55.400 INFO:teuthology.orchestra.run.smithi045.stdout:./rfile 2023-11-28T12:07:55.400 INFO:teuthology.orchestra.run.smithi045.stdout:./parentdir 2023-11-28T12:07:55.400 INFO:teuthology.orchestra.run.smithi045.stdout:./parentdir/pfile 2023-11-28T12:07:55.400 INFO:teuthology.orchestra.run.smithi045.stdout:./parentdir/childdir 2023-11-28T12:07:55.400 INFO:teuthology.orchestra.run.smithi045.stdout:./parentdir/childdir/cfile 2023-11-28T12:07:55.401 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits daemon-helper kill python3 -c ' 2023-11-28T12:07:55.401 DEBUG:teuthology.orchestra.run.smithi045:> import os 2023-11-28T12:07:55.401 DEBUG:teuthology.orchestra.run.smithi045:> import stat 2023-11-28T12:07:55.401 DEBUG:teuthology.orchestra.run.smithi045:> 2023-11-28T12:07:55.401 DEBUG:teuthology.orchestra.run.smithi045:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./").st_ino) 2023-11-28T12:07:55.402 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-11-28T12:07:55.520 INFO:teuthology.orchestra.run.smithi045.stdout:1 2023-11-28T12:07:55.702 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits daemon-helper kill python3 -c ' 2023-11-28T12:07:55.702 DEBUG:teuthology.orchestra.run.smithi045:> import os 2023-11-28T12:07:55.702 DEBUG:teuthology.orchestra.run.smithi045:> import stat 2023-11-28T12:07:55.702 DEBUG:teuthology.orchestra.run.smithi045:> 2023-11-28T12:07:55.702 DEBUG:teuthology.orchestra.run.smithi045:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./rfile").st_ino) 2023-11-28T12:07:55.702 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-11-28T12:07:55.859 INFO:teuthology.orchestra.run.smithi045.stdout:1099511627778 2023-11-28T12:07:56.043 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits daemon-helper kill python3 -c ' 2023-11-28T12:07:56.043 DEBUG:teuthology.orchestra.run.smithi045:> import os 2023-11-28T12:07:56.043 DEBUG:teuthology.orchestra.run.smithi045:> import stat 2023-11-28T12:07:56.043 DEBUG:teuthology.orchestra.run.smithi045:> 2023-11-28T12:07:56.043 DEBUG:teuthology.orchestra.run.smithi045:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir").st_ino) 2023-11-28T12:07:56.043 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-11-28T12:07:56.200 INFO:teuthology.orchestra.run.smithi045.stdout:1099511627776 2023-11-28T12:07:56.385 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits daemon-helper kill python3 -c ' 2023-11-28T12:07:56.385 DEBUG:teuthology.orchestra.run.smithi045:> import os 2023-11-28T12:07:56.385 DEBUG:teuthology.orchestra.run.smithi045:> import stat 2023-11-28T12:07:56.385 DEBUG:teuthology.orchestra.run.smithi045:> 2023-11-28T12:07:56.385 DEBUG:teuthology.orchestra.run.smithi045:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir/pfile").st_ino) 2023-11-28T12:07:56.385 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-11-28T12:07:56.543 INFO:teuthology.orchestra.run.smithi045.stdout:1099511628279 2023-11-28T12:07:56.728 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits daemon-helper kill python3 -c ' 2023-11-28T12:07:56.729 DEBUG:teuthology.orchestra.run.smithi045:> import os 2023-11-28T12:07:56.729 DEBUG:teuthology.orchestra.run.smithi045:> import stat 2023-11-28T12:07:56.729 DEBUG:teuthology.orchestra.run.smithi045:> 2023-11-28T12:07:56.729 DEBUG:teuthology.orchestra.run.smithi045:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir/childdir").st_ino) 2023-11-28T12:07:56.729 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-11-28T12:07:56.886 INFO:teuthology.orchestra.run.smithi045.stdout:1099511627777 2023-11-28T12:07:57.070 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits daemon-helper kill python3 -c ' 2023-11-28T12:07:57.071 DEBUG:teuthology.orchestra.run.smithi045:> import os 2023-11-28T12:07:57.071 DEBUG:teuthology.orchestra.run.smithi045:> import stat 2023-11-28T12:07:57.071 DEBUG:teuthology.orchestra.run.smithi045:> 2023-11-28T12:07:57.071 DEBUG:teuthology.orchestra.run.smithi045:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir/childdir/cfile").st_ino) 2023-11-28T12:07:57.071 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-11-28T12:07:57.228 INFO:teuthology.orchestra.run.smithi045.stdout:1099511628280 2023-11-28T12:07:57.413 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T12:07:57.413 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T12:07:57.501 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T12:07:57.501 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T12:07:57.588 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T12:07:57.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:57.833+0000 7f513e9ff700 1 Processor -- start 2023-11-28T12:07:57.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:57.833+0000 7f513e9ff700 1 -- start start 2023-11-28T12:07:57.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:57.834+0000 7f513e9ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f513815c9b0 0x7f51380b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:57.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:57.835+0000 7f513e9ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f5138161340 0x7f51380d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:57.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:57.835+0000 7f513e9ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51380d1950 con 0x7f51380d2320 2023-11-28T12:07:57.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:57.835+0000 7f513e9ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51380b5800 con 0x7f513815c9b0 2023-11-28T12:07:57.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:57.835+0000 7f513e9ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51380b5520 con 0x7f5138161340 2023-11-28T12:07:57.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:57.835+0000 7f5137fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f513815c9b0 0x7f51380b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:57.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:57.835+0000 7f5137fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f513815c9b0 0x7f51380b4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55528/0 (socket says 172.21.15.45:55528) 2023-11-28T12:07:57.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:57.835+0000 7f5137fff700 1 -- 172.21.15.45:0/1077650519 learned_addr learned my addr 172.21.15.45:0/1077650519 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:57.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:57.835+0000 7f51377fe700 1 --2- 172.21.15.45:0/1077650519 >> v2:172.21.15.152:3300/0 conn(0x7f5138161340 0x7f51380d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:57.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:57.835+0000 7f5137fff700 1 -- 172.21.15.45:0/1077650519 >> v2:172.21.15.152:3300/0 conn(0x7f5138161340 msgr2=0x7f51380d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:57.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:57.835+0000 7f5137fff700 1 --2- 172.21.15.45:0/1077650519 >> v2:172.21.15.152:3300/0 conn(0x7f5138161340 0x7f51380d1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:57.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:57.835+0000 7f5137fff700 1 -- 172.21.15.45:0/1077650519 >> v1:172.21.15.152:6789/0 conn(0x7f51380d2320 legacy=0x7f51380cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:57.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:57.835+0000 7f5137fff700 1 -- 172.21.15.45:0/1077650519 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51380d1300 con 0x7f513815c9b0 2023-11-28T12:07:57.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:57.835+0000 7f51377fe700 1 --2- 172.21.15.45:0/1077650519 >> v2:172.21.15.152:3300/0 conn(0x7f5138161340 0x7f51380d1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:07:57.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:57.836+0000 7f5137fff700 1 --2- 172.21.15.45:0/1077650519 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f513815c9b0 0x7f51380b4bf0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f51380685c0 tx=0x7f5128009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd44bcbbe27591ad server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:57.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:57.836+0000 7f5136ffd700 1 -- 172.21.15.45:0/1077650519 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f512800b870 con 0x7f513815c9b0 2023-11-28T12:07:57.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:57.836+0000 7f5136ffd700 1 -- 172.21.15.45:0/1077650519 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f512800b9d0 con 0x7f513815c9b0 2023-11-28T12:07:57.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:57.836+0000 7f5136ffd700 1 -- 172.21.15.45:0/1077650519 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f512800bd60 con 0x7f513815c9b0 2023-11-28T12:07:57.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:57.836+0000 7f513e9ff700 1 -- 172.21.15.45:0/1077650519 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f513815c9b0 msgr2=0x7f51380b4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:57.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:57.836+0000 7f513e9ff700 1 --2- 172.21.15.45:0/1077650519 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f513815c9b0 0x7f51380b4bf0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f51380685c0 tx=0x7f5128009bd0 comp rx=0 tx=0).stop 2023-11-28T12:07:57.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:57.837+0000 7f513e9ff700 1 -- 172.21.15.45:0/1077650519 shutdown_connections 2023-11-28T12:07:57.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:57.837+0000 7f513e9ff700 1 --2- 172.21.15.45:0/1077650519 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f513815c9b0 0x7f51380b4bf0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:57.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:57.837+0000 7f513e9ff700 1 --2- 172.21.15.45:0/1077650519 >> v2:172.21.15.152:3300/0 conn(0x7f5138161340 0x7f51380d1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:57.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:57.837+0000 7f513e9ff700 1 -- 172.21.15.45:0/1077650519 >> 172.21.15.45:0/1077650519 conn(0x7f5138072600 msgr2=0x7f51380cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:57.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:57.837+0000 7f513e9ff700 1 -- 172.21.15.45:0/1077650519 shutdown_connections 2023-11-28T12:07:57.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:57.837+0000 7f513e9ff700 1 -- 172.21.15.45:0/1077650519 wait complete. 2023-11-28T12:07:57.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:57.838+0000 7f513e9ff700 1 Processor -- start 2023-11-28T12:07:57.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:57.839+0000 7f513e9ff700 1 -- start start 2023-11-28T12:07:57.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:57.840+0000 7f513e9ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51380d2320 0x7f5138150970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:57.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:57.840+0000 7f513e9ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f513815c9b0 0x7f5138157660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:57.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:57.840+0000 7f513e9ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5138161340 0x7f51380b7a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:57.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:57.840+0000 7f513e9ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5138157fb0 con 0x7f513815c9b0 2023-11-28T12:07:57.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:57.840+0000 7f513e9ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5138152590 con 0x7f51380d2320 2023-11-28T12:07:57.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:57.840+0000 7f513e9ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51381517d0 con 0x7f5138161340 2023-11-28T12:07:57.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:57.840+0000 7f51377fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f513815c9b0 0x7f5138157660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:57.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:57.840+0000 7f51377fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f513815c9b0 0x7f5138157660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55536/0 (socket says 172.21.15.45:55536) 2023-11-28T12:07:57.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:57.840+0000 7f51377fe700 1 -- 172.21.15.45:0/2242327844 learned_addr learned my addr 172.21.15.45:0/2242327844 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:57.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:57.840+0000 7f5137fff700 1 --2- 172.21.15.45:0/2242327844 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51380d2320 0x7f5138150970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:57.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:57.840+0000 7f513cf9c700 1 --2- 172.21.15.45:0/2242327844 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5138161340 0x7f51380b7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:57.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:57.840+0000 7f51377fe700 1 -- 172.21.15.45:0/2242327844 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5138161340 msgr2=0x7f51380b7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:57.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:57.840+0000 7f51377fe700 1 --2- 172.21.15.45:0/2242327844 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5138161340 0x7f51380b7a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:57.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:57.840+0000 7f51377fe700 1 -- 172.21.15.45:0/2242327844 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51380d2320 msgr2=0x7f5138150970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:57.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:57.840+0000 7f51377fe700 1 --2- 172.21.15.45:0/2242327844 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51380d2320 0x7f5138150970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:57.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:57.840+0000 7f51377fe700 1 -- 172.21.15.45:0/2242327844 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5128009550 con 0x7f513815c9b0 2023-11-28T12:07:57.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:57.840+0000 7f5137fff700 1 --2- 172.21.15.45:0/2242327844 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51380d2320 0x7f5138150970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:07:57.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:57.841+0000 7f51377fe700 1 --2- 172.21.15.45:0/2242327844 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f513815c9b0 0x7f5138157660 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f512c00e810 tx=0x7f512c00ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:57.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:57.841+0000 7f5134ff9700 1 -- 172.21.15.45:0/2242327844 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f512c013610 con 0x7f513815c9b0 2023-11-28T12:07:57.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:57.841+0000 7f5134ff9700 1 -- 172.21.15.45:0/2242327844 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f512c013770 con 0x7f513815c9b0 2023-11-28T12:07:57.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:57.841+0000 7f5134ff9700 1 -- 172.21.15.45:0/2242327844 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f512c013b20 con 0x7f513815c9b0 2023-11-28T12:07:57.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:57.841+0000 7f513e9ff700 1 -- 172.21.15.45:0/2242327844 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51380b5130 con 0x7f513815c9b0 2023-11-28T12:07:57.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:57.841+0000 7f513e9ff700 1 -- 172.21.15.45:0/2242327844 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51380d15e0 con 0x7f513815c9b0 2023-11-28T12:07:57.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:57.842+0000 7f513e9ff700 1 -- 172.21.15.45:0/2242327844 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51380b52c0 con 0x7f513815c9b0 2023-11-28T12:07:57.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:57.843+0000 7f5134ff9700 1 -- 172.21.15.45:0/2242327844 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f512c023070 con 0x7f513815c9b0 2023-11-28T12:07:57.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:57.844+0000 7f5134ff9700 1 --2- 172.21.15.45:0/2242327844 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f51240682f0 0x7f512406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:57.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:57.844+0000 7f5134ff9700 1 -- 172.21.15.45:0/2242327844 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f512c085a60 con 0x7f513815c9b0 2023-11-28T12:07:57.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:57.845+0000 7f5137fff700 1 --2- 172.21.15.45:0/2242327844 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f51240682f0 0x7f512406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:57.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:57.845+0000 7f5137fff700 1 --2- 172.21.15.45:0/2242327844 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f51240682f0 0x7f512406a7a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5128000c00 tx=0x7f5128008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:57.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:57.849+0000 7f5134ff9700 1 -- 172.21.15.45:0/2242327844 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f512c0521d0 con 0x7f513815c9b0 2023-11-28T12:07:58.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.055+0000 7f513e9ff700 1 -- 172.21.15.45:0/2242327844 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f51380745c0 con 0x7f513815c9b0 2023-11-28T12:07:58.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.057+0000 7f5134ff9700 1 -- 172.21.15.45:0/2242327844 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+17921 (secure 0 0 0) 0x7f512c0557f0 con 0x7f513815c9b0 2023-11-28T12:07:58.058 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:07:58.059 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":34,"fsid":"bd7c37f1-f7c6-4778-b845-52cf2aa6e366","created":"2023-11-28T12:06:09.045075+0000","modified":"2023-11-28T12:07:42.653488+0000","last_up_change":"2023-11-28T12:06:21.282227+0000","last_in_change":"2023-11-28T12:06:12.560924+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T12:06:21.807108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T12:06:22.491009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-28T12:07:39.383009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-28T12:07:40.658112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d0cdd8a-87fd-4f2c-91bd-47bdfa661905","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":115843},{"type":"v1","addr":"172.21.15.45:6808","nonce":115843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":115843},{"type":"v1","addr":"172.21.15.45:6811","nonce":115843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":115843},{"type":"v1","addr":"172.21.15.45:6815","nonce":115843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":115843},{"type":"v1","addr":"172.21.15.45:6813","nonce":115843}]},"public_addr":"172.21.15.45:6808/115843","cluster_addr":"172.21.15.45:6811/115843","heartbeat_back_addr":"172.21.15.45:6815/115843","heartbeat_front_addr":"172.21.15.45:6813/115843","state":["exists","up"]},{"osd":1,"uuid":"c5de4ebd-9ec5-40b3-9caa-9b706fab4c76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":115842},{"type":"v1","addr":"172.21.15.45:6801","nonce":115842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":115842},{"type":"v1","addr":"172.21.15.45:6803","nonce":115842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6807","nonce":115842},{"type":"v1","addr":"172.21.15.45:6809","nonce":115842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":115842},{"type":"v1","addr":"172.21.15.45:6805","nonce":115842}]},"public_addr":"172.21.15.45:6801/115842","cluster_addr":"172.21.15.45:6803/115842","heartbeat_back_addr":"172.21.15.45:6809/115842","heartbeat_front_addr":"172.21.15.45:6805/115842","state":["exists","up"]},{"osd":2,"uuid":"9f4b36b2-65d2-40e7-9fe6-a2991afa71c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":115850},{"type":"v1","addr":"172.21.15.45:6819","nonce":115850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":115850},{"type":"v1","addr":"172.21.15.45:6823","nonce":115850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":115850},{"type":"v1","addr":"172.21.15.45:6831","nonce":115850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":115850},{"type":"v1","addr":"172.21.15.45:6828","nonce":115850}]},"public_addr":"172.21.15.45:6819/115850","cluster_addr":"172.21.15.45:6823/115850","heartbeat_back_addr":"172.21.15.45:6831/115850","heartbeat_front_addr":"172.21.15.45:6828/115850","state":["exists","up"]},{"osd":3,"uuid":"6fe7ef05-4e0d-426c-bf94-44b51d4d550b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":115848},{"type":"v1","addr":"172.21.15.45:6818","nonce":115848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":115848},{"type":"v1","addr":"172.21.15.45:6822","nonce":115848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6827","nonce":115848},{"type":"v1","addr":"172.21.15.45:6829","nonce":115848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":115848},{"type":"v1","addr":"172.21.15.45:6825","nonce":115848}]},"public_addr":"172.21.15.45:6818/115848","cluster_addr":"172.21.15.45:6822/115848","heartbeat_back_addr":"172.21.15.45:6829/115848","heartbeat_front_addr":"172.21.15.45:6825/115848","state":["exists","up"]},{"osd":4,"uuid":"fa403c08-d8a1-4a3a-8384-cb465c1a654c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":116092},{"type":"v1","addr":"172.21.15.152:6801","nonce":116092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":116092},{"type":"v1","addr":"172.21.15.152:6803","nonce":116092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":116092},{"type":"v1","addr":"172.21.15.152:6807","nonce":116092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":116092},{"type":"v1","addr":"172.21.15.152:6805","nonce":116092}]},"public_addr":"172.21.15.152:6801/116092","cluster_addr":"172.21.15.152:6803/116092","heartbeat_back_addr":"172.21.15.152:6807/116092","heartbeat_front_addr":"172.21.15.152:6805/116092","state":["exists","up"]},{"osd":5,"uuid":"399fc450-39fa-43a6-bf80-0b8bcb41bd95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6815","nonce":116093},{"type":"v1","addr":"172.21.15.152:6817","nonce":116093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":116093},{"type":"v1","addr":"172.21.15.152:6819","nonce":116093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":116093},{"type":"v1","addr":"172.21.15.152:6823","nonce":116093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":116093},{"type":"v1","addr":"172.21.15.152:6821","nonce":116093}]},"public_addr":"172.21.15.152:6817/116093","cluster_addr":"172.21.15.152:6819/116093","heartbeat_back_addr":"172.21.15.152:6823/116093","heartbeat_front_addr":"172.21.15.152:6821/116093","state":["exists","up"]},{"osd":6,"uuid":"e59a4017-2d23-4627-836b-e25b2d3ddaaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":116094},{"type":"v1","addr":"172.21.15.152:6809","nonce":116094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":116094},{"type":"v1","addr":"172.21.15.152:6811","nonce":116094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":116094},{"type":"v1","addr":"172.21.15.152:6816","nonce":116094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":116094},{"type":"v1","addr":"172.21.15.152:6813","nonce":116094}]},"public_addr":"172.21.15.152:6809/116094","cluster_addr":"172.21.15.152:6811/116094","heartbeat_back_addr":"172.21.15.152:6816/116094","heartbeat_front_addr":"172.21.15.152:6813/116094","state":["exists","up"]},{"osd":7,"uuid":"8d7f9d4b-bf08-4670-8591-388c0f012a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":116097},{"type":"v1","addr":"172.21.15.152:6825","nonce":116097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":116097},{"type":"v1","addr":"172.21.15.152:6827","nonce":116097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":116097},{"type":"v1","addr":"172.21.15.152:6831","nonce":116097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":116097},{"type":"v1","addr":"172.21.15.152:6829","nonce":116097}]},"public_addr":"172.21.15.152:6825/116097","cluster_addr":"172.21.15.152:6827/116097","heartbeat_back_addr":"172.21.15.152:6831/116097","heartbeat_front_addr":"172.21.15.152:6829/116097","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.937710+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.865423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.159434+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.913090+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.131647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.966255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.972583+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.177209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T12:07:58.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.059+0000 7f513e9ff700 1 -- 172.21.15.45:0/2242327844 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f51240682f0 msgr2=0x7f512406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:58.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.059+0000 7f513e9ff700 1 --2- 172.21.15.45:0/2242327844 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f51240682f0 0x7f512406a7a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5128000c00 tx=0x7f5128008030 comp rx=0 tx=0).stop 2023-11-28T12:07:58.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.059+0000 7f513e9ff700 1 -- 172.21.15.45:0/2242327844 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f513815c9b0 msgr2=0x7f5138157660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:58.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.059+0000 7f513e9ff700 1 --2- 172.21.15.45:0/2242327844 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f513815c9b0 0x7f5138157660 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f512c00e810 tx=0x7f512c00ebd0 comp rx=0 tx=0).stop 2023-11-28T12:07:58.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.059+0000 7f513e9ff700 1 -- 172.21.15.45:0/2242327844 shutdown_connections 2023-11-28T12:07:58.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.059+0000 7f513e9ff700 1 --2- 172.21.15.45:0/2242327844 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f51240682f0 0x7f512406a7a0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:58.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.059+0000 7f513e9ff700 1 --2- 172.21.15.45:0/2242327844 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51380d2320 0x7f5138150970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:58.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.059+0000 7f513e9ff700 1 --2- 172.21.15.45:0/2242327844 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5138161340 0x7f51380b7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:58.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.059+0000 7f513e9ff700 1 --2- 172.21.15.45:0/2242327844 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f513815c9b0 0x7f5138157660 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:58.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.059+0000 7f513e9ff700 1 -- 172.21.15.45:0/2242327844 >> 172.21.15.45:0/2242327844 conn(0x7f5138072600 msgr2=0x7f513815cd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:58.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.059+0000 7f513e9ff700 1 -- 172.21.15.45:0/2242327844 shutdown_connections 2023-11-28T12:07:58.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.059+0000 7f513e9ff700 1 -- 172.21.15.45:0/2242327844 wait complete. 2023-11-28T12:07:58.079 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-28T12:06:21.807108+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-28T12:06:22.491009+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T12:07:39.383009+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T12:07:40.658112+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T12:07:58.080 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T12:07:58.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.284+0000 7f82111ff700 1 Processor -- start 2023-11-28T12:07:58.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.284+0000 7f82111ff700 1 -- start start 2023-11-28T12:07:58.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.285+0000 7f82111ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f820c15c9b0 0x7f820c0b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:58.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.286+0000 7f82111ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f820c0d1950 con 0x7f820c0cd7c0 2023-11-28T12:07:58.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.286+0000 7f82111ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f820c0d24f0 con 0x7f820c161340 2023-11-28T12:07:58.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.286+0000 7f82111ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f820c0b5800 con 0x7f820c15c9b0 2023-11-28T12:07:58.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.286+0000 7f820b59e700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f820c0cd7c0 0x7f820c0b5fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:35238/0 (socket says 172.21.15.45:35238) 2023-11-28T12:07:58.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.286+0000 7f820b59e700 1 -- 172.21.15.45:0/98575213 learned_addr learned my addr 172.21.15.45:0/98575213 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:07:58.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.286+0000 7f820ad9d700 1 --2- 172.21.15.45:0/98575213 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f820c15c9b0 0x7f820c0b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:58.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.286+0000 7f8209d9b700 1 -- 172.21.15.45:0/98575213 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 663547413 0 0) 0x7f820c0d1950 con 0x7f820c0cd7c0 2023-11-28T12:07:58.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.286+0000 7f8209d9b700 1 -- 172.21.15.45:0/98575213 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81f40035b0 con 0x7f820c0cd7c0 2023-11-28T12:07:58.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.286+0000 7f8209d9b700 1 -- 172.21.15.45:0/98575213 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2348396637 0 0) 0x7f820c0d24f0 con 0x7f820c161340 2023-11-28T12:07:58.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.286+0000 7f8209d9b700 1 -- 172.21.15.45:0/98575213 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f820c0d1950 con 0x7f820c161340 2023-11-28T12:07:58.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.287+0000 7f820ad9d700 1 -- 172.21.15.45:0/98575213 >> v1:172.21.15.152:6789/0 conn(0x7f820c161340 legacy=0x7f820c0d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:58.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.287+0000 7f820ad9d700 1 -- 172.21.15.45:0/98575213 >> v1:172.21.15.45:6789/0 conn(0x7f820c0cd7c0 legacy=0x7f820c0b5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:58.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.287+0000 7f820ad9d700 1 -- 172.21.15.45:0/98575213 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f820c0b5520 con 0x7f820c15c9b0 2023-11-28T12:07:58.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.287+0000 7f820ad9d700 1 --2- 172.21.15.45:0/98575213 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f820c15c9b0 0x7f820c0b4bf0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f81fc009870 tx=0x7f81fc009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f131ccdd343e186c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:58.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.287+0000 7f8209d9b700 1 -- 172.21.15.45:0/98575213 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81fc011830 con 0x7f820c15c9b0 2023-11-28T12:07:58.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.287+0000 7f8209d9b700 1 -- 172.21.15.45:0/98575213 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81fc011990 con 0x7f820c15c9b0 2023-11-28T12:07:58.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.287+0000 7f8209d9b700 1 -- 172.21.15.45:0/98575213 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81fc011d00 con 0x7f820c15c9b0 2023-11-28T12:07:58.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.288+0000 7f82111ff700 1 -- 172.21.15.45:0/98575213 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f820c15c9b0 msgr2=0x7f820c0b4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:58.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.288+0000 7f82111ff700 1 --2- 172.21.15.45:0/98575213 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f820c15c9b0 0x7f820c0b4bf0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f81fc009870 tx=0x7f81fc009b80 comp rx=0 tx=0).stop 2023-11-28T12:07:58.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.288+0000 7f82111ff700 1 -- 172.21.15.45:0/98575213 shutdown_connections 2023-11-28T12:07:58.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.288+0000 7f82111ff700 1 --2- 172.21.15.45:0/98575213 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f820c15c9b0 0x7f820c0b4bf0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:58.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.288+0000 7f82111ff700 1 -- 172.21.15.45:0/98575213 >> 172.21.15.45:0/98575213 conn(0x7f820c072600 msgr2=0x7f820c0cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:58.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.288+0000 7f82111ff700 1 -- 172.21.15.45:0/98575213 shutdown_connections 2023-11-28T12:07:58.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.288+0000 7f82111ff700 1 -- 172.21.15.45:0/98575213 wait complete. 2023-11-28T12:07:58.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.290+0000 7f82111ff700 1 Processor -- start 2023-11-28T12:07:58.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.290+0000 7f82111ff700 1 -- start start 2023-11-28T12:07:58.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.291+0000 7f82111ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f820c0cd7c0 0x7f820c0c76b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:58.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.291+0000 7f82111ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f820c15c9b0 0x7f820c0c9230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:58.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.291+0000 7f82111ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f820c161340 0x7f820c1568d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:58.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.291+0000 7f82111ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f820c0c7bf0 con 0x7f820c0cd7c0 2023-11-28T12:07:58.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.291+0000 7f82111ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f820c0c9770 con 0x7f820c161340 2023-11-28T12:07:58.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.291+0000 7f82111ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f820c156e10 con 0x7f820c15c9b0 2023-11-28T12:07:58.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.291+0000 7f820ad9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f820c0cd7c0 0x7f820c0c76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:58.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.291+0000 7f820ad9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f820c0cd7c0 0x7f820c0c76b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55552/0 (socket says 172.21.15.45:55552) 2023-11-28T12:07:58.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.291+0000 7f820ad9d700 1 -- 172.21.15.45:0/3916373888 learned_addr learned my addr 172.21.15.45:0/3916373888 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:58.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.291+0000 7f820a59c700 1 --2- 172.21.15.45:0/3916373888 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f820c15c9b0 0x7f820c0c9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:58.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.291+0000 7f820b59e700 1 --2- 172.21.15.45:0/3916373888 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f820c161340 0x7f820c1568d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:58.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.292+0000 7f820ad9d700 1 -- 172.21.15.45:0/3916373888 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f820c15c9b0 msgr2=0x7f820c0c9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:58.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.292+0000 7f820ad9d700 1 --2- 172.21.15.45:0/3916373888 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f820c15c9b0 0x7f820c0c9230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:58.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.292+0000 7f820ad9d700 1 -- 172.21.15.45:0/3916373888 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f820c161340 msgr2=0x7f820c1568d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:58.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.292+0000 7f820ad9d700 1 --2- 172.21.15.45:0/3916373888 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f820c161340 0x7f820c1568d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:58.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.292+0000 7f820ad9d700 1 -- 172.21.15.45:0/3916373888 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81fc0094a0 con 0x7f820c0cd7c0 2023-11-28T12:07:58.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.292+0000 7f820ad9d700 1 --2- 172.21.15.45:0/3916373888 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f820c0cd7c0 0x7f820c0c76b0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f81fc009bc0 tx=0x7f81fc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:58.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.292+0000 7f81f37fe700 1 -- 172.21.15.45:0/3916373888 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81fc0045c0 con 0x7f820c0cd7c0 2023-11-28T12:07:58.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.292+0000 7f81f37fe700 1 -- 172.21.15.45:0/3916373888 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81fc01e070 con 0x7f820c0cd7c0 2023-11-28T12:07:58.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.292+0000 7f82111ff700 1 -- 172.21.15.45:0/3916373888 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f820c0d15e0 con 0x7f820c0cd7c0 2023-11-28T12:07:58.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.292+0000 7f81f37fe700 1 -- 172.21.15.45:0/3916373888 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81fc003900 con 0x7f820c0cd7c0 2023-11-28T12:07:58.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.292+0000 7f82111ff700 1 -- 172.21.15.45:0/3916373888 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f820c0d1300 con 0x7f820c0cd7c0 2023-11-28T12:07:58.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.293+0000 7f82111ff700 1 -- 172.21.15.45:0/3916373888 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f820c0b5130 con 0x7f820c0cd7c0 2023-11-28T12:07:58.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.294+0000 7f81f37fe700 1 -- 172.21.15.45:0/3916373888 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f81fc00f050 con 0x7f820c0cd7c0 2023-11-28T12:07:58.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.295+0000 7f81f37fe700 1 --2- 172.21.15.45:0/3916373888 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f81f80682f0 0x7f81f806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:58.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.295+0000 7f81f37fe700 1 -- 172.21.15.45:0/3916373888 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f81fc086d10 con 0x7f820c0cd7c0 2023-11-28T12:07:58.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.296+0000 7f820a59c700 1 --2- 172.21.15.45:0/3916373888 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f81f80682f0 0x7f81f806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:58.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.296+0000 7f820a59c700 1 --2- 172.21.15.45:0/3916373888 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f81f80682f0 0x7f81f806a7a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8200007fd0 tx=0x7f8200009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:58.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.299+0000 7f81f37fe700 1 -- 172.21.15.45:0/3916373888 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f81fc08c020 con 0x7f820c0cd7c0 2023-11-28T12:07:58.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.503+0000 7f82111ff700 1 -- 172.21.15.45:0/3916373888 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f820c0745c0 con 0x7f820c0cd7c0 2023-11-28T12:07:58.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.503+0000 7f81f37fe700 1 -- 172.21.15.45:0/3916373888 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v34) v1 ==== 92+0+10 (secure 0 0 0) 0x7f81fc0150a0 con 0x7f820c0cd7c0 2023-11-28T12:07:58.505 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-11-28T12:07:58.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.506+0000 7f82111ff700 1 -- 172.21.15.45:0/3916373888 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f81f80682f0 msgr2=0x7f81f806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:58.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.506+0000 7f82111ff700 1 --2- 172.21.15.45:0/3916373888 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f81f80682f0 0x7f81f806a7a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8200007fd0 tx=0x7f8200009040 comp rx=0 tx=0).stop 2023-11-28T12:07:58.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.506+0000 7f82111ff700 1 -- 172.21.15.45:0/3916373888 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f820c0cd7c0 msgr2=0x7f820c0c76b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:58.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.506+0000 7f82111ff700 1 --2- 172.21.15.45:0/3916373888 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f820c0cd7c0 0x7f820c0c76b0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f81fc009bc0 tx=0x7f81fc004750 comp rx=0 tx=0).stop 2023-11-28T12:07:58.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.506+0000 7f82111ff700 1 -- 172.21.15.45:0/3916373888 shutdown_connections 2023-11-28T12:07:58.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.506+0000 7f82111ff700 1 --2- 172.21.15.45:0/3916373888 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f81f80682f0 0x7f81f806a7a0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:58.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.506+0000 7f82111ff700 1 --2- 172.21.15.45:0/3916373888 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f820c161340 0x7f820c1568d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:58.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.506+0000 7f82111ff700 1 --2- 172.21.15.45:0/3916373888 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f820c0cd7c0 0x7f820c0c76b0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:58.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.506+0000 7f82111ff700 1 --2- 172.21.15.45:0/3916373888 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f820c15c9b0 0x7f820c0c9230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:58.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.506+0000 7f82111ff700 1 -- 172.21.15.45:0/3916373888 >> 172.21.15.45:0/3916373888 conn(0x7f820c072600 msgr2=0x7f820c160460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:58.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.506+0000 7f82111ff700 1 -- 172.21.15.45:0/3916373888 shutdown_connections 2023-11-28T12:07:58.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.506+0000 7f82111ff700 1 -- 172.21.15.45:0/3916373888 wait complete. 2023-11-28T12:07:58.526 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T12:07:58.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.731+0000 7fa26d7ff700 1 Processor -- start 2023-11-28T12:07:58.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.731+0000 7fa26d7ff700 1 -- start start 2023-11-28T12:07:58.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.732+0000 7fa26d7ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fa26815c9b0 0x7fa2680b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:58.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.732+0000 7fa26d7ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa2680cd7c0 0x7fa2680cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:58.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.732+0000 7fa26d7ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2680d1950 con 0x7fa268161340 2023-11-28T12:07:58.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.732+0000 7fa26d7ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2680b5800 con 0x7fa26815c9b0 2023-11-28T12:07:58.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.732+0000 7fa26d7ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2680ce140 con 0x7fa2680cd7c0 2023-11-28T12:07:58.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.732+0000 7fa2677fe700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa2680cd7c0 0x7fa2680cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:58.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.732+0000 7fa266ffd700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fa26815c9b0 0x7fa2680b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:58.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.733+0000 7fa2677fe700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa2680cd7c0 0x7fa2680cdc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.45:39060/0 (socket says 172.21.15.45:39060) 2023-11-28T12:07:58.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.733+0000 7fa2677fe700 1 -- 172.21.15.45:0/2710698275 learned_addr learned my addr 172.21.15.45:0/2710698275 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:58.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.733+0000 7fa266ffd700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fa26815c9b0 0x7fa2680b4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.45:45652/0 (socket says 172.21.15.45:45652) 2023-11-28T12:07:58.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.733+0000 7fa2677fe700 1 -- 172.21.15.45:0/2710698275 >> v2:172.21.15.152:3300/0 conn(0x7fa26815c9b0 msgr2=0x7fa2680b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:58.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.733+0000 7fa2677fe700 1 --2- 172.21.15.45:0/2710698275 >> v2:172.21.15.152:3300/0 conn(0x7fa26815c9b0 0x7fa2680b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:58.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.733+0000 7fa2677fe700 1 -- 172.21.15.45:0/2710698275 >> v1:172.21.15.152:6789/0 conn(0x7fa268161340 legacy=0x7fa2680d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:58.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.733+0000 7fa2677fe700 1 -- 172.21.15.45:0/2710698275 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2680d24f0 con 0x7fa2680cd7c0 2023-11-28T12:07:58.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.733+0000 7fa2677fe700 1 --2- 172.21.15.45:0/2710698275 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa2680cd7c0 0x7fa2680cdc00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa260009e50 tx=0x7fa26000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cfa9bfb4642e2d2d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:58.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.734+0000 7fa265ffb700 1 -- 172.21.15.45:0/2710698275 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa26000e070 con 0x7fa2680cd7c0 2023-11-28T12:07:58.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.734+0000 7fa265ffb700 1 -- 172.21.15.45:0/2710698275 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa26000b910 con 0x7fa2680cd7c0 2023-11-28T12:07:58.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.734+0000 7fa265ffb700 1 -- 172.21.15.45:0/2710698275 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa26000bcc0 con 0x7fa2680cd7c0 2023-11-28T12:07:58.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.734+0000 7fa26d7ff700 1 -- 172.21.15.45:0/2710698275 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa2680cd7c0 msgr2=0x7fa2680cdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:58.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.734+0000 7fa26d7ff700 1 --2- 172.21.15.45:0/2710698275 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa2680cd7c0 0x7fa2680cdc00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa260009e50 tx=0x7fa26000b330 comp rx=0 tx=0).stop 2023-11-28T12:07:58.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.734+0000 7fa26d7ff700 1 -- 172.21.15.45:0/2710698275 shutdown_connections 2023-11-28T12:07:58.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.734+0000 7fa26d7ff700 1 --2- 172.21.15.45:0/2710698275 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa2680cd7c0 0x7fa2680cdc00 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:58.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.734+0000 7fa26d7ff700 1 --2- 172.21.15.45:0/2710698275 >> v2:172.21.15.152:3300/0 conn(0x7fa26815c9b0 0x7fa2680b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:58.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.734+0000 7fa26d7ff700 1 -- 172.21.15.45:0/2710698275 >> 172.21.15.45:0/2710698275 conn(0x7fa268072600 msgr2=0x7fa2680cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:58.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.734+0000 7fa26d7ff700 1 -- 172.21.15.45:0/2710698275 shutdown_connections 2023-11-28T12:07:58.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.734+0000 7fa26d7ff700 1 -- 172.21.15.45:0/2710698275 wait complete. 2023-11-28T12:07:58.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.736+0000 7fa26d7ff700 1 Processor -- start 2023-11-28T12:07:58.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.736+0000 7fa26d7ff700 1 -- start start 2023-11-28T12:07:58.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.737+0000 7fa26d7ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa2680cd7c0 0x7fa2681543f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:58.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.737+0000 7fa26d7ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa26815c9b0 0x7fa2681593a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:58.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.737+0000 7fa26d7ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa268161340 0x7fa2681598e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:58.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.737+0000 7fa26d7ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2680caf70 con 0x7fa268161340 2023-11-28T12:07:58.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.737+0000 7fa26d7ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2680cb250 con 0x7fa2680cd7c0 2023-11-28T12:07:58.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.737+0000 7fa26d7ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2680cb530 con 0x7fa26815c9b0 2023-11-28T12:07:58.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.737+0000 7fa2677fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa268161340 0x7fa2681598e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:58.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.737+0000 7fa2677fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa268161340 0x7fa2681598e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55560/0 (socket says 172.21.15.45:55560) 2023-11-28T12:07:58.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.737+0000 7fa2677fe700 1 -- 172.21.15.45:0/1930249714 learned_addr learned my addr 172.21.15.45:0/1930249714 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:58.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.737+0000 7fa2667fc700 1 --2- 172.21.15.45:0/1930249714 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa26815c9b0 0x7fa2681593a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:58.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.738+0000 7fa266ffd700 1 --2- 172.21.15.45:0/1930249714 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa2680cd7c0 0x7fa2681543f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:58.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.738+0000 7fa2677fe700 1 -- 172.21.15.45:0/1930249714 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa26815c9b0 msgr2=0x7fa2681593a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:58.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.738+0000 7fa2677fe700 1 --2- 172.21.15.45:0/1930249714 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa26815c9b0 0x7fa2681593a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:58.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.738+0000 7fa2677fe700 1 -- 172.21.15.45:0/1930249714 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa2680cd7c0 msgr2=0x7fa2681543f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:58.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.738+0000 7fa2677fe700 1 --2- 172.21.15.45:0/1930249714 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa2680cd7c0 0x7fa2681543f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:58.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.738+0000 7fa2677fe700 1 -- 172.21.15.45:0/1930249714 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa260009b30 con 0x7fa268161340 2023-11-28T12:07:58.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.738+0000 7fa2677fe700 1 --2- 172.21.15.45:0/1930249714 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa268161340 0x7fa2681598e0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fa268067550 tx=0x7fa260004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:58.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.738+0000 7fa24f7fe700 1 -- 172.21.15.45:0/1930249714 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa260004800 con 0x7fa268161340 2023-11-28T12:07:58.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.738+0000 7fa24f7fe700 1 -- 172.21.15.45:0/1930249714 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa260004960 con 0x7fa268161340 2023-11-28T12:07:58.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.738+0000 7fa26d7ff700 1 -- 172.21.15.45:0/1930249714 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2680d1300 con 0x7fa268161340 2023-11-28T12:07:58.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.738+0000 7fa24f7fe700 1 -- 172.21.15.45:0/1930249714 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa26001b670 con 0x7fa268161340 2023-11-28T12:07:58.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.739+0000 7fa26d7ff700 1 -- 172.21.15.45:0/1930249714 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2680b5520 con 0x7fa268161340 2023-11-28T12:07:58.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.740+0000 7fa26d7ff700 1 -- 172.21.15.45:0/1930249714 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2680d15e0 con 0x7fa268161340 2023-11-28T12:07:58.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.741+0000 7fa24f7fe700 1 -- 172.21.15.45:0/1930249714 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fa26002b070 con 0x7fa268161340 2023-11-28T12:07:58.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.741+0000 7fa24f7fe700 1 --2- 172.21.15.45:0/1930249714 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fa2540682f0 0x7fa25406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:58.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.741+0000 7fa24f7fe700 1 -- 172.21.15.45:0/1930249714 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa260087480 con 0x7fa268161340 2023-11-28T12:07:58.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.742+0000 7fa266ffd700 1 --2- 172.21.15.45:0/1930249714 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fa2540682f0 0x7fa25406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:58.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.742+0000 7fa266ffd700 1 --2- 172.21.15.45:0/1930249714 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fa2540682f0 0x7fa25406a7a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa258009b40 tx=0x7fa258009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:58.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.746+0000 7fa24f7fe700 1 -- 172.21.15.45:0/1930249714 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fa260053bf0 con 0x7fa268161340 2023-11-28T12:07:58.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.949+0000 7fa26d7ff700 1 -- 172.21.15.45:0/1930249714 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa2680745c0 con 0x7fa268161340 2023-11-28T12:07:58.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.949+0000 7fa24f7fe700 1 -- 172.21.15.45:0/1930249714 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v34) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa260057210 con 0x7fa268161340 2023-11-28T12:07:58.951 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-11-28T12:07:58.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.952+0000 7fa26d7ff700 1 -- 172.21.15.45:0/1930249714 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fa2540682f0 msgr2=0x7fa25406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:58.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.952+0000 7fa26d7ff700 1 --2- 172.21.15.45:0/1930249714 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fa2540682f0 0x7fa25406a7a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa258009b40 tx=0x7fa258009210 comp rx=0 tx=0).stop 2023-11-28T12:07:58.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.952+0000 7fa26d7ff700 1 -- 172.21.15.45:0/1930249714 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa268161340 msgr2=0x7fa2681598e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:58.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.952+0000 7fa26d7ff700 1 --2- 172.21.15.45:0/1930249714 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa268161340 0x7fa2681598e0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fa268067550 tx=0x7fa260004ad0 comp rx=0 tx=0).stop 2023-11-28T12:07:58.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.952+0000 7fa26d7ff700 1 -- 172.21.15.45:0/1930249714 shutdown_connections 2023-11-28T12:07:58.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.952+0000 7fa26d7ff700 1 --2- 172.21.15.45:0/1930249714 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fa2540682f0 0x7fa25406a7a0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:58.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.952+0000 7fa26d7ff700 1 --2- 172.21.15.45:0/1930249714 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa2680cd7c0 0x7fa2681543f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:58.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.952+0000 7fa26d7ff700 1 --2- 172.21.15.45:0/1930249714 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa268161340 0x7fa2681598e0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:58.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.952+0000 7fa26d7ff700 1 --2- 172.21.15.45:0/1930249714 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa26815c9b0 0x7fa2681593a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:58.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.952+0000 7fa26d7ff700 1 -- 172.21.15.45:0/1930249714 >> 172.21.15.45:0/1930249714 conn(0x7fa268072600 msgr2=0x7fa2680b8800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:58.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.952+0000 7fa26d7ff700 1 -- 172.21.15.45:0/1930249714 shutdown_connections 2023-11-28T12:07:58.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:58.952+0000 7fa26d7ff700 1 -- 172.21.15.45:0/1930249714 wait complete. 2023-11-28T12:07:58.972 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T12:07:59.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.176+0000 7f0fb33ff700 1 Processor -- start 2023-11-28T12:07:59.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.176+0000 7f0fb33ff700 1 -- start start 2023-11-28T12:07:59.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.177+0000 7f0fb33ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f0fac15c9b0 0x7f0fac0b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:59.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.177+0000 7f0fb33ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0fac161340 0x7f0fac0d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:59.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.178+0000 7f0fb33ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fac0d1950 con 0x7f0fac0d2320 2023-11-28T12:07:59.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.178+0000 7f0fb33ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fac0b5800 con 0x7f0fac15c9b0 2023-11-28T12:07:59.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.178+0000 7f0fb33ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fac0b5520 con 0x7f0fac161340 2023-11-28T12:07:59.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.178+0000 7f0fb199c700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f0fac0d2320 0x7f0fac0cd7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:35246/0 (socket says 172.21.15.45:35246) 2023-11-28T12:07:59.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.178+0000 7f0fb199c700 1 -- 172.21.15.45:0/2229679063 learned_addr learned my addr 172.21.15.45:0/2229679063 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:07:59.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.178+0000 7f0fb099a700 1 --2- 172.21.15.45:0/2229679063 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0fac161340 0x7f0fac0d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:59.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.178+0000 7f0fb119b700 1 --2- 172.21.15.45:0/2229679063 >> v2:172.21.15.152:3300/0 conn(0x7f0fac15c9b0 0x7f0fac0b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:59.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.178+0000 7f0fa3fff700 1 -- 172.21.15.45:0/2229679063 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1435930136 0 0) 0x7f0fac0d1950 con 0x7f0fac0d2320 2023-11-28T12:07:59.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.178+0000 7f0fa3fff700 1 -- 172.21.15.45:0/2229679063 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f980035b0 con 0x7f0fac0d2320 2023-11-28T12:07:59.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.179+0000 7f0fb099a700 1 -- 172.21.15.45:0/2229679063 >> v2:172.21.15.152:3300/0 conn(0x7f0fac15c9b0 msgr2=0x7f0fac0b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:59.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.179+0000 7f0fb099a700 1 --2- 172.21.15.45:0/2229679063 >> v2:172.21.15.152:3300/0 conn(0x7f0fac15c9b0 0x7f0fac0b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:59.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.179+0000 7f0fb099a700 1 -- 172.21.15.45:0/2229679063 >> v1:172.21.15.45:6789/0 conn(0x7f0fac0d2320 legacy=0x7f0fac0cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:59.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.179+0000 7f0fa3fff700 1 -- 172.21.15.45:0/2229679063 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3323097641 0 0) 0x7f0f980035b0 con 0x7f0fac0d2320 2023-11-28T12:07:59.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.179+0000 7f0fb099a700 1 -- 172.21.15.45:0/2229679063 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fac0d1300 con 0x7f0fac161340 2023-11-28T12:07:59.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.179+0000 7f0fb119b700 1 --2- 172.21.15.45:0/2229679063 >> v2:172.21.15.152:3300/0 conn(0x7f0fac15c9b0 0x7f0fac0b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:07:59.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.179+0000 7f0fb099a700 1 --2- 172.21.15.45:0/2229679063 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0fac161340 0x7f0fac0d1de0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c009840 tx=0x7f0f9c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=935f4cad5dcb555d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:59.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.179+0000 7f0fa3fff700 1 -- 172.21.15.45:0/2229679063 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa40019f0 con 0x7f0fac161340 2023-11-28T12:07:59.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.179+0000 7f0fa3fff700 1 -- 172.21.15.45:0/2229679063 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f9c004030 con 0x7f0fac161340 2023-11-28T12:07:59.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.179+0000 7f0fa3fff700 1 -- 172.21.15.45:0/2229679063 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9c0043a0 con 0x7f0fac161340 2023-11-28T12:07:59.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.180+0000 7f0fb33ff700 1 -- 172.21.15.45:0/2229679063 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0fac161340 msgr2=0x7f0fac0d1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:59.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.180+0000 7f0fb33ff700 1 --2- 172.21.15.45:0/2229679063 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0fac161340 0x7f0fac0d1de0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c009840 tx=0x7f0f9c009b50 comp rx=0 tx=0).stop 2023-11-28T12:07:59.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.180+0000 7f0fb33ff700 1 -- 172.21.15.45:0/2229679063 shutdown_connections 2023-11-28T12:07:59.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.180+0000 7f0fb33ff700 1 --2- 172.21.15.45:0/2229679063 >> v2:172.21.15.152:3300/0 conn(0x7f0fac15c9b0 0x7f0fac0b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:59.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.180+0000 7f0fb33ff700 1 --2- 172.21.15.45:0/2229679063 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0fac161340 0x7f0fac0d1de0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:59.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.180+0000 7f0fb33ff700 1 -- 172.21.15.45:0/2229679063 >> 172.21.15.45:0/2229679063 conn(0x7f0fac072600 msgr2=0x7f0fac0cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:59.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.180+0000 7f0fb33ff700 1 -- 172.21.15.45:0/2229679063 shutdown_connections 2023-11-28T12:07:59.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.180+0000 7f0fb33ff700 1 -- 172.21.15.45:0/2229679063 wait complete. 2023-11-28T12:07:59.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.182+0000 7f0fb33ff700 1 Processor -- start 2023-11-28T12:07:59.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.182+0000 7f0fb33ff700 1 -- start start 2023-11-28T12:07:59.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.183+0000 7f0fb33ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0fac0d2320 0x7f0fac0b5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:59.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.183+0000 7f0fb33ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0fac15c9b0 0x7f0fac154380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:59.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.183+0000 7f0fb33ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0fac161340 0x7f0fac14dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:59.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.183+0000 7f0fb33ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fac1548c0 con 0x7f0fac0d2320 2023-11-28T12:07:59.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.183+0000 7f0fb33ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fac14e210 con 0x7f0fac161340 2023-11-28T12:07:59.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.183+0000 7f0fb33ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fac0b66a0 con 0x7f0fac15c9b0 2023-11-28T12:07:59.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.183+0000 7f0fb119b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0fac0d2320 0x7f0fac0b5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:59.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.183+0000 7f0fb119b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0fac0d2320 0x7f0fac0b5fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55570/0 (socket says 172.21.15.45:55570) 2023-11-28T12:07:59.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.183+0000 7f0fb119b700 1 -- 172.21.15.45:0/1384546149 learned_addr learned my addr 172.21.15.45:0/1384546149 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:59.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.183+0000 7f0fb099a700 1 --2- 172.21.15.45:0/1384546149 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0fac15c9b0 0x7f0fac154380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:59.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.183+0000 7f0fb199c700 1 --2- 172.21.15.45:0/1384546149 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0fac161340 0x7f0fac14dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:59.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.183+0000 7f0fb119b700 1 -- 172.21.15.45:0/1384546149 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0fac15c9b0 msgr2=0x7f0fac154380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:59.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.183+0000 7f0fb119b700 1 --2- 172.21.15.45:0/1384546149 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0fac15c9b0 0x7f0fac154380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:59.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.183+0000 7f0fb119b700 1 -- 172.21.15.45:0/1384546149 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0fac161340 msgr2=0x7f0fac14dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:59.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.183+0000 7f0fb119b700 1 --2- 172.21.15.45:0/1384546149 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0fac161340 0x7f0fac14dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:59.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.183+0000 7f0fb119b700 1 -- 172.21.15.45:0/1384546149 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fa80094a0 con 0x7f0fac0d2320 2023-11-28T12:07:59.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.183+0000 7f0fb099a700 1 --2- 172.21.15.45:0/1384546149 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0fac15c9b0 0x7f0fac154380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:07:59.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.184+0000 7f0fb119b700 1 --2- 172.21.15.45:0/1384546149 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0fac0d2320 0x7f0fac0b5fa0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f0fa800ebe0 tx=0x7f0fa8009e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:59.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.184+0000 7f0fa1ffb700 1 -- 172.21.15.45:0/1384546149 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa800c8b0 con 0x7f0fac0d2320 2023-11-28T12:07:59.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.184+0000 7f0fa1ffb700 1 -- 172.21.15.45:0/1384546149 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fa800ca10 con 0x7f0fac0d2320 2023-11-28T12:07:59.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.184+0000 7f0fb33ff700 1 -- 172.21.15.45:0/1384546149 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f9c0094a0 con 0x7f0fac0d2320 2023-11-28T12:07:59.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.184+0000 7f0fa1ffb700 1 -- 172.21.15.45:0/1384546149 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa800cda0 con 0x7f0fac0d2320 2023-11-28T12:07:59.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.184+0000 7f0fb33ff700 1 -- 172.21.15.45:0/1384546149 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fac0b5130 con 0x7f0fac0d2320 2023-11-28T12:07:59.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.185+0000 7f0fb33ff700 1 -- 172.21.15.45:0/1384546149 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fac0d15e0 con 0x7f0fac0d2320 2023-11-28T12:07:59.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.186+0000 7f0fa1ffb700 1 -- 172.21.15.45:0/1384546149 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f0fa8023070 con 0x7f0fac0d2320 2023-11-28T12:07:59.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.187+0000 7f0fa1ffb700 1 --2- 172.21.15.45:0/1384546149 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f0f900682f0 0x7f0f9006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:59.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.187+0000 7f0fa1ffb700 1 -- 172.21.15.45:0/1384546149 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0fa8086160 con 0x7f0fac0d2320 2023-11-28T12:07:59.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.188+0000 7f0fb099a700 1 --2- 172.21.15.45:0/1384546149 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f0f900682f0 0x7f0f9006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:59.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.188+0000 7f0fb099a700 1 --2- 172.21.15.45:0/1384546149 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f0f900682f0 0x7f0f9006a7a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0fac15b390 tx=0x7f0f9c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:59.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.191+0000 7f0fa1ffb700 1 -- 172.21.15.45:0/1384546149 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f0fa8052840 con 0x7f0fac0d2320 2023-11-28T12:07:59.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.393+0000 7f0fb33ff700 1 -- 172.21.15.45:0/1384546149 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0fac0b7590 con 0x7f0fac0d2320 2023-11-28T12:07:59.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.393+0000 7f0fa1ffb700 1 -- 172.21.15.45:0/1384546149 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v34) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0fa8055e60 con 0x7f0fac0d2320 2023-11-28T12:07:59.395 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-11-28T12:07:59.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.396+0000 7f0fb33ff700 1 -- 172.21.15.45:0/1384546149 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f0f900682f0 msgr2=0x7f0f9006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:59.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.396+0000 7f0fb33ff700 1 --2- 172.21.15.45:0/1384546149 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f0f900682f0 0x7f0f9006a7a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0fac15b390 tx=0x7f0f9c008030 comp rx=0 tx=0).stop 2023-11-28T12:07:59.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.396+0000 7f0fb33ff700 1 -- 172.21.15.45:0/1384546149 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0fac0d2320 msgr2=0x7f0fac0b5fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:59.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.396+0000 7f0fb33ff700 1 --2- 172.21.15.45:0/1384546149 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0fac0d2320 0x7f0fac0b5fa0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f0fa800ebe0 tx=0x7f0fa8009e20 comp rx=0 tx=0).stop 2023-11-28T12:07:59.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.396+0000 7f0fb33ff700 1 -- 172.21.15.45:0/1384546149 shutdown_connections 2023-11-28T12:07:59.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.396+0000 7f0fb33ff700 1 --2- 172.21.15.45:0/1384546149 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f0f900682f0 0x7f0f9006a7a0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:59.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.396+0000 7f0fb33ff700 1 --2- 172.21.15.45:0/1384546149 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0fac161340 0x7f0fac14dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:59.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.396+0000 7f0fb33ff700 1 --2- 172.21.15.45:0/1384546149 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0fac0d2320 0x7f0fac0b5fa0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:59.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.396+0000 7f0fb33ff700 1 --2- 172.21.15.45:0/1384546149 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0fac15c9b0 0x7f0fac154380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:59.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.396+0000 7f0fb33ff700 1 -- 172.21.15.45:0/1384546149 >> 172.21.15.45:0/1384546149 conn(0x7f0fac072600 msgr2=0x7f0fac15cd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:59.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.396+0000 7f0fb33ff700 1 -- 172.21.15.45:0/1384546149 shutdown_connections 2023-11-28T12:07:59.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.396+0000 7f0fb33ff700 1 -- 172.21.15.45:0/1384546149 wait complete. 2023-11-28T12:07:59.416 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T12:07:59.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.621+0000 7f2f69bff700 1 Processor -- start 2023-11-28T12:07:59.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.621+0000 7f2f69bff700 1 -- start start 2023-11-28T12:07:59.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.622+0000 7f2f69bff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2f6415c9b0 0x7f2f640b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:59.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.622+0000 7f2f69bff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2f640cd7c0 0x7f2f640cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:59.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.622+0000 7f2f69bff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f640d1950 con 0x7f2f64161340 2023-11-28T12:07:59.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.622+0000 7f2f69bff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f640b5800 con 0x7f2f6415c9b0 2023-11-28T12:07:59.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.622+0000 7f2f69bff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f640ce140 con 0x7f2f640cd7c0 2023-11-28T12:07:59.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.622+0000 7f2f637fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2f6415c9b0 0x7f2f640b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:59.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.623+0000 7f2f637fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2f6415c9b0 0x7f2f640b4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55580/0 (socket says 172.21.15.45:55580) 2023-11-28T12:07:59.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.623+0000 7f2f637fe700 1 -- 172.21.15.45:0/3684284050 learned_addr learned my addr 172.21.15.45:0/3684284050 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:59.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.623+0000 7f2f63fff700 1 --2- 172.21.15.45:0/3684284050 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2f640cd7c0 0x7f2f640cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:59.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.623+0000 7f2f637fe700 1 -- 172.21.15.45:0/3684284050 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2f640cd7c0 msgr2=0x7f2f640cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:59.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.623+0000 7f2f637fe700 1 --2- 172.21.15.45:0/3684284050 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2f640cd7c0 0x7f2f640cdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:59.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.623+0000 7f2f637fe700 1 -- 172.21.15.45:0/3684284050 >> v1:172.21.15.152:6789/0 conn(0x7f2f64161340 legacy=0x7f2f640d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:07:59.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.623+0000 7f2f637fe700 1 -- 172.21.15.45:0/3684284050 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f640d24f0 con 0x7f2f6415c9b0 2023-11-28T12:07:59.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.623+0000 7f2f637fe700 1 --2- 172.21.15.45:0/3684284050 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f6415c9b0 0x7f2f640b4bf0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f2f540098f0 tx=0x7f2f54009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f87c1683d367df2d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:59.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.623+0000 7f2f627fc700 1 -- 172.21.15.45:0/3684284050 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f54004230 con 0x7f2f6415c9b0 2023-11-28T12:07:59.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.623+0000 7f2f627fc700 1 -- 172.21.15.45:0/3684284050 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f54004390 con 0x7f2f6415c9b0 2023-11-28T12:07:59.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.624+0000 7f2f627fc700 1 -- 172.21.15.45:0/3684284050 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f540036a0 con 0x7f2f6415c9b0 2023-11-28T12:07:59.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.624+0000 7f2f69bff700 1 -- 172.21.15.45:0/3684284050 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f6415c9b0 msgr2=0x7f2f640b4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:59.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.624+0000 7f2f69bff700 1 --2- 172.21.15.45:0/3684284050 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f6415c9b0 0x7f2f640b4bf0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f2f540098f0 tx=0x7f2f54009c00 comp rx=0 tx=0).stop 2023-11-28T12:07:59.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.624+0000 7f2f69bff700 1 -- 172.21.15.45:0/3684284050 shutdown_connections 2023-11-28T12:07:59.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.624+0000 7f2f69bff700 1 --2- 172.21.15.45:0/3684284050 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2f640cd7c0 0x7f2f640cdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:59.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.624+0000 7f2f69bff700 1 --2- 172.21.15.45:0/3684284050 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f6415c9b0 0x7f2f640b4bf0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:59.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.624+0000 7f2f69bff700 1 -- 172.21.15.45:0/3684284050 >> 172.21.15.45:0/3684284050 conn(0x7f2f64072600 msgr2=0x7f2f640cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:59.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.624+0000 7f2f69bff700 1 -- 172.21.15.45:0/3684284050 shutdown_connections 2023-11-28T12:07:59.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.624+0000 7f2f69bff700 1 -- 172.21.15.45:0/3684284050 wait complete. 2023-11-28T12:07:59.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.626+0000 7f2f69bff700 1 Processor -- start 2023-11-28T12:07:59.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.626+0000 7f2f69bff700 1 -- start start 2023-11-28T12:07:59.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.627+0000 7f2f69bff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f640cd7c0 0x7f2f6414a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:59.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.627+0000 7f2f69bff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2f6415c9b0 0x7f2f640cc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:59.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.627+0000 7f2f69bff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2f64161340 0x7f2f640b79c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:59.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.627+0000 7f2f69bff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f641554c0 con 0x7f2f640cd7c0 2023-11-28T12:07:59.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.627+0000 7f2f69bff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f640cc830 con 0x7f2f6415c9b0 2023-11-28T12:07:59.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.627+0000 7f2f69bff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f640cbc90 con 0x7f2f64161340 2023-11-28T12:07:59.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.627+0000 7f2f637fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f640cd7c0 0x7f2f6414a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:59.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.627+0000 7f2f637fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f640cd7c0 0x7f2f6414a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55588/0 (socket says 172.21.15.45:55588) 2023-11-28T12:07:59.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.627+0000 7f2f637fe700 1 -- 172.21.15.45:0/4076096705 learned_addr learned my addr 172.21.15.45:0/4076096705 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:07:59.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.628+0000 7f2f63fff700 1 --2- 172.21.15.45:0/4076096705 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2f64161340 0x7f2f640b79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:59.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.628+0000 7f2f62ffd700 1 --2- 172.21.15.45:0/4076096705 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2f6415c9b0 0x7f2f640cc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:59.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.628+0000 7f2f637fe700 1 -- 172.21.15.45:0/4076096705 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2f64161340 msgr2=0x7f2f640b79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:59.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.628+0000 7f2f637fe700 1 --2- 172.21.15.45:0/4076096705 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2f64161340 0x7f2f640b79c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:59.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.628+0000 7f2f637fe700 1 -- 172.21.15.45:0/4076096705 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2f6415c9b0 msgr2=0x7f2f640cc2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:59.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.628+0000 7f2f637fe700 1 --2- 172.21.15.45:0/4076096705 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2f6415c9b0 0x7f2f640cc2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:59.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.628+0000 7f2f637fe700 1 -- 172.21.15.45:0/4076096705 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f54009550 con 0x7f2f640cd7c0 2023-11-28T12:07:59.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.628+0000 7f2f63fff700 1 --2- 172.21.15.45:0/4076096705 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2f64161340 0x7f2f640b79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:07:59.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.628+0000 7f2f62ffd700 1 --2- 172.21.15.45:0/4076096705 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2f6415c9b0 0x7f2f640cc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:07:59.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.628+0000 7f2f637fe700 1 --2- 172.21.15.45:0/4076096705 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f640cd7c0 0x7f2f6414a710 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f2f54009130 tx=0x7f2f54004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:59.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.628+0000 7f2f4bfff700 1 -- 172.21.15.45:0/4076096705 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f54003e10 con 0x7f2f640cd7c0 2023-11-28T12:07:59.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.628+0000 7f2f4bfff700 1 -- 172.21.15.45:0/4076096705 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f5400b660 con 0x7f2f640cd7c0 2023-11-28T12:07:59.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.628+0000 7f2f69bff700 1 -- 172.21.15.45:0/4076096705 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f640d1300 con 0x7f2f640cd7c0 2023-11-28T12:07:59.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.628+0000 7f2f4bfff700 1 -- 172.21.15.45:0/4076096705 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f5400ba10 con 0x7f2f640cd7c0 2023-11-28T12:07:59.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.628+0000 7f2f69bff700 1 -- 172.21.15.45:0/4076096705 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f640b5520 con 0x7f2f640cd7c0 2023-11-28T12:07:59.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.629+0000 7f2f69bff700 1 -- 172.21.15.45:0/4076096705 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f640d15e0 con 0x7f2f640cd7c0 2023-11-28T12:07:59.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.630+0000 7f2f4bfff700 1 -- 172.21.15.45:0/4076096705 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f2f54017020 con 0x7f2f640cd7c0 2023-11-28T12:07:59.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.631+0000 7f2f4bfff700 1 --2- 172.21.15.45:0/4076096705 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f2f500682f0 0x7f2f5006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:07:59.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.631+0000 7f2f4bfff700 1 -- 172.21.15.45:0/4076096705 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2f54087530 con 0x7f2f640cd7c0 2023-11-28T12:07:59.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.632+0000 7f2f62ffd700 1 --2- 172.21.15.45:0/4076096705 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f2f500682f0 0x7f2f5006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:07:59.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.632+0000 7f2f62ffd700 1 --2- 172.21.15.45:0/4076096705 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f2f500682f0 0x7f2f5006a7a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2f6406bf10 tx=0x7f2f58009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:07:59.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.635+0000 7f2f4bfff700 1 -- 172.21.15.45:0/4076096705 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f2f54053c40 con 0x7f2f640cd7c0 2023-11-28T12:07:59.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.839+0000 7f2f69bff700 1 -- 172.21.15.45:0/4076096705 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2f640cedf0 con 0x7f2f640cd7c0 2023-11-28T12:07:59.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.840+0000 7f2f4bfff700 1 -- 172.21.15.45:0/4076096705 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v34) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2f54057260 con 0x7f2f640cd7c0 2023-11-28T12:07:59.842 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-11-28T12:07:59.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.842+0000 7f2f69bff700 1 -- 172.21.15.45:0/4076096705 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f2f500682f0 msgr2=0x7f2f5006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:59.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.842+0000 7f2f69bff700 1 --2- 172.21.15.45:0/4076096705 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f2f500682f0 0x7f2f5006a7a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2f6406bf10 tx=0x7f2f58009040 comp rx=0 tx=0).stop 2023-11-28T12:07:59.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.842+0000 7f2f69bff700 1 -- 172.21.15.45:0/4076096705 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f640cd7c0 msgr2=0x7f2f6414a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:07:59.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.842+0000 7f2f69bff700 1 --2- 172.21.15.45:0/4076096705 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f640cd7c0 0x7f2f6414a710 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f2f54009130 tx=0x7f2f54004750 comp rx=0 tx=0).stop 2023-11-28T12:07:59.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.842+0000 7f2f69bff700 1 -- 172.21.15.45:0/4076096705 shutdown_connections 2023-11-28T12:07:59.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.842+0000 7f2f69bff700 1 --2- 172.21.15.45:0/4076096705 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f2f500682f0 0x7f2f5006a7a0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:59.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.842+0000 7f2f69bff700 1 --2- 172.21.15.45:0/4076096705 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2f64161340 0x7f2f640b79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:59.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.842+0000 7f2f69bff700 1 --2- 172.21.15.45:0/4076096705 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f640cd7c0 0x7f2f6414a710 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:59.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.842+0000 7f2f69bff700 1 --2- 172.21.15.45:0/4076096705 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2f6415c9b0 0x7f2f640cc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:07:59.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.842+0000 7f2f69bff700 1 -- 172.21.15.45:0/4076096705 >> 172.21.15.45:0/4076096705 conn(0x7f2f64072600 msgr2=0x7f2f640b5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:07:59.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.842+0000 7f2f69bff700 1 -- 172.21.15.45:0/4076096705 shutdown_connections 2023-11-28T12:07:59.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:07:59.843+0000 7f2f69bff700 1 -- 172.21.15.45:0/4076096705 wait complete. 2023-11-28T12:07:59.862 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T12:08:00.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.067+0000 7fdcc77ff700 1 Processor -- start 2023-11-28T12:08:00.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.067+0000 7fdcc77ff700 1 -- start start 2023-11-28T12:08:00.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.068+0000 7fdcc77ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fdcc015c9b0 0x7fdcc00b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:00.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.068+0000 7fdcc77ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdcc00cd7c0 0x7fdcc00cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:00.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.068+0000 7fdcc77ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcc00d1950 con 0x7fdcc0161340 2023-11-28T12:08:00.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.068+0000 7fdcc77ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcc00b5800 con 0x7fdcc015c9b0 2023-11-28T12:08:00.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.068+0000 7fdcc77ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc00ce140 con 0x7fdcc00cd7c0 2023-11-28T12:08:00.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.068+0000 7fdcc5d9c700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdcc00cd7c0 0x7fdcc00cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:00.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.068+0000 7fdcc559b700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fdcc015c9b0 0x7fdcc00b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:00.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.068+0000 7fdcc5d9c700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdcc00cd7c0 0x7fdcc00cdc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.45:39108/0 (socket says 172.21.15.45:39108) 2023-11-28T12:08:00.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.068+0000 7fdcc5d9c700 1 -- 172.21.15.45:0/3756149882 learned_addr learned my addr 172.21.15.45:0/3756149882 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:00.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.068+0000 7fdcc559b700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fdcc015c9b0 0x7fdcc00b4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.45:45696/0 (socket says 172.21.15.45:45696) 2023-11-28T12:08:00.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.068+0000 7fdcc4d9a700 1 --1- 172.21.15.45:0/3756149882 >> v1:172.21.15.152:6789/0 conn(0x7fdcc0161340 0x7fdcc00d1de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.45:45358/0 (socket says 172.21.15.45:45358) 2023-11-28T12:08:00.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.069+0000 7fdcb7fff700 1 -- 172.21.15.45:0/3756149882 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 380390031 0 0) 0x7fdcc00d1950 con 0x7fdcc0161340 2023-11-28T12:08:00.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.069+0000 7fdcc5d9c700 1 -- 172.21.15.45:0/3756149882 >> v2:172.21.15.152:3300/0 conn(0x7fdcc015c9b0 msgr2=0x7fdcc00b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:00.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.069+0000 7fdcc5d9c700 1 --2- 172.21.15.45:0/3756149882 >> v2:172.21.15.152:3300/0 conn(0x7fdcc015c9b0 0x7fdcc00b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:00.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.069+0000 7fdcc5d9c700 1 -- 172.21.15.45:0/3756149882 >> v1:172.21.15.152:6789/0 conn(0x7fdcc0161340 legacy=0x7fdcc00d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:00.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.069+0000 7fdcc5d9c700 1 -- 172.21.15.45:0/3756149882 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcc00d24f0 con 0x7fdcc00cd7c0 2023-11-28T12:08:00.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.069+0000 7fdcc559b700 1 --2- 172.21.15.45:0/3756149882 >> v2:172.21.15.152:3300/0 conn(0x7fdcc015c9b0 0x7fdcc00b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:08:00.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.069+0000 7fdcc5d9c700 1 --2- 172.21.15.45:0/3756149882 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdcc00cd7c0 0x7fdcc00cdc00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fdcb8009e50 tx=0x7fdcb800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d0a1d2bb1dc6fd server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:00.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.070+0000 7fdcb7fff700 1 -- 172.21.15.45:0/3756149882 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb800e070 con 0x7fdcc00cd7c0 2023-11-28T12:08:00.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.070+0000 7fdcb7fff700 1 -- 172.21.15.45:0/3756149882 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcb800b910 con 0x7fdcc00cd7c0 2023-11-28T12:08:00.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.070+0000 7fdcb7fff700 1 -- 172.21.15.45:0/3756149882 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb800bcc0 con 0x7fdcc00cd7c0 2023-11-28T12:08:00.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.070+0000 7fdcc77ff700 1 -- 172.21.15.45:0/3756149882 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdcc00cd7c0 msgr2=0x7fdcc00cdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:00.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.070+0000 7fdcc77ff700 1 --2- 172.21.15.45:0/3756149882 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdcc00cd7c0 0x7fdcc00cdc00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fdcb8009e50 tx=0x7fdcb800b330 comp rx=0 tx=0).stop 2023-11-28T12:08:00.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.070+0000 7fdcc77ff700 1 -- 172.21.15.45:0/3756149882 shutdown_connections 2023-11-28T12:08:00.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.070+0000 7fdcc77ff700 1 --2- 172.21.15.45:0/3756149882 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdcc00cd7c0 0x7fdcc00cdc00 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:00.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.070+0000 7fdcc77ff700 1 --2- 172.21.15.45:0/3756149882 >> v2:172.21.15.152:3300/0 conn(0x7fdcc015c9b0 0x7fdcc00b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:00.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.070+0000 7fdcc77ff700 1 -- 172.21.15.45:0/3756149882 >> 172.21.15.45:0/3756149882 conn(0x7fdcc0072600 msgr2=0x7fdcc00cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:00.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.070+0000 7fdcc77ff700 1 -- 172.21.15.45:0/3756149882 shutdown_connections 2023-11-28T12:08:00.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.070+0000 7fdcc77ff700 1 -- 172.21.15.45:0/3756149882 wait complete. 2023-11-28T12:08:00.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.072+0000 7fdcc77ff700 1 Processor -- start 2023-11-28T12:08:00.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.072+0000 7fdcc77ff700 1 -- start start 2023-11-28T12:08:00.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.073+0000 7fdcc77ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdcc00cd7c0 0x7fdcc01f2660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:00.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.073+0000 7fdcc77ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdcc015c9b0 0x7fdcc00c9860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:00.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.073+0000 7fdcc77ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdcc0161340 0x7fdcc0156740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:00.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.073+0000 7fdcc77ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc0159240 con 0x7fdcc00cd7c0 2023-11-28T12:08:00.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.073+0000 7fdcc77ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc0159520 con 0x7fdcc0161340 2023-11-28T12:08:00.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.073+0000 7fdcc77ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc0159800 con 0x7fdcc015c9b0 2023-11-28T12:08:00.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.073+0000 7fdcc559b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdcc00cd7c0 0x7fdcc01f2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:00.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.073+0000 7fdcc559b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdcc00cd7c0 0x7fdcc01f2660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55596/0 (socket says 172.21.15.45:55596) 2023-11-28T12:08:00.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.073+0000 7fdcc559b700 1 -- 172.21.15.45:0/1031745819 learned_addr learned my addr 172.21.15.45:0/1031745819 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:00.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.073+0000 7fdcc5d9c700 1 --2- 172.21.15.45:0/1031745819 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdcc0161340 0x7fdcc0156740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:00.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.073+0000 7fdcc4d9a700 1 --2- 172.21.15.45:0/1031745819 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdcc015c9b0 0x7fdcc00c9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:00.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.074+0000 7fdcc559b700 1 -- 172.21.15.45:0/1031745819 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdcc015c9b0 msgr2=0x7fdcc00c9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:00.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.074+0000 7fdcc559b700 1 --2- 172.21.15.45:0/1031745819 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdcc015c9b0 0x7fdcc00c9860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:00.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.074+0000 7fdcc559b700 1 -- 172.21.15.45:0/1031745819 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdcc0161340 msgr2=0x7fdcc0156740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:00.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.074+0000 7fdcc559b700 1 --2- 172.21.15.45:0/1031745819 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdcc0161340 0x7fdcc0156740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:00.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.074+0000 7fdcc559b700 1 -- 172.21.15.45:0/1031745819 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcbc0094a0 con 0x7fdcc00cd7c0 2023-11-28T12:08:00.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.074+0000 7fdcc4d9a700 1 --2- 172.21.15.45:0/1031745819 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdcc015c9b0 0x7fdcc00c9860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:08:00.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.074+0000 7fdcc559b700 1 --2- 172.21.15.45:0/1031745819 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdcc00cd7c0 0x7fdcc01f2660 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc00ebe0 tx=0x7fdcbc00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:00.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.074+0000 7fdcb5ffb700 1 -- 172.21.15.45:0/1031745819 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcbc00c850 con 0x7fdcc00cd7c0 2023-11-28T12:08:00.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.074+0000 7fdcb5ffb700 1 -- 172.21.15.45:0/1031745819 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcbc00c9b0 con 0x7fdcc00cd7c0 2023-11-28T12:08:00.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.074+0000 7fdcb5ffb700 1 -- 172.21.15.45:0/1031745819 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcbc00cd40 con 0x7fdcc00cd7c0 2023-11-28T12:08:00.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.074+0000 7fdcc77ff700 1 -- 172.21.15.45:0/1031745819 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcb8009b30 con 0x7fdcc00cd7c0 2023-11-28T12:08:00.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.074+0000 7fdcc77ff700 1 -- 172.21.15.45:0/1031745819 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcc00d1300 con 0x7fdcc00cd7c0 2023-11-28T12:08:00.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.075+0000 7fdcc77ff700 1 -- 172.21.15.45:0/1031745819 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcc01578c0 con 0x7fdcc00cd7c0 2023-11-28T12:08:00.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.076+0000 7fdcb5ffb700 1 -- 172.21.15.45:0/1031745819 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fdcbc019030 con 0x7fdcc00cd7c0 2023-11-28T12:08:00.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.077+0000 7fdcb5ffb700 1 --2- 172.21.15.45:0/1031745819 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fdca40682f0 0x7fdca406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:00.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.077+0000 7fdcb5ffb700 1 -- 172.21.15.45:0/1031745819 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdcbc085d00 con 0x7fdcc00cd7c0 2023-11-28T12:08:00.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.078+0000 7fdcc4d9a700 1 --2- 172.21.15.45:0/1031745819 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fdca40682f0 0x7fdca406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:00.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.078+0000 7fdcc4d9a700 1 --2- 172.21.15.45:0/1031745819 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fdca40682f0 0x7fdca406a7a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fdcc0157d00 tx=0x7fdcb0007ca0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:00.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.081+0000 7fdcb5ffb700 1 -- 172.21.15.45:0/1031745819 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fdcbc052470 con 0x7fdcc00cd7c0 2023-11-28T12:08:00.133 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T12:08:00.139 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T12:08:00.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.300+0000 7fdcc77ff700 1 -- 172.21.15.45:0/1031745819 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fdcc00d15e0 con 0x7fdcc00cd7c0 2023-11-28T12:08:00.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.300+0000 7fdcb5ffb700 1 -- 172.21.15.45:0/1031745819 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v34) v1 ==== 80+0+0 (secure 0 0 0) 0x7fdcbc00cea0 con 0x7fdcc00cd7c0 2023-11-28T12:08:00.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.302+0000 7fdcc77ff700 1 -- 172.21.15.45:0/1031745819 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fdca40682f0 msgr2=0x7fdca406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:00.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.302+0000 7fdcc77ff700 1 --2- 172.21.15.45:0/1031745819 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fdca40682f0 0x7fdca406a7a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fdcc0157d00 tx=0x7fdcb0007ca0 comp rx=0 tx=0).stop 2023-11-28T12:08:00.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.302+0000 7fdcc77ff700 1 -- 172.21.15.45:0/1031745819 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdcc00cd7c0 msgr2=0x7fdcc01f2660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:00.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.302+0000 7fdcc77ff700 1 --2- 172.21.15.45:0/1031745819 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdcc00cd7c0 0x7fdcc01f2660 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc00ebe0 tx=0x7fdcbc00eef0 comp rx=0 tx=0).stop 2023-11-28T12:08:00.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.302+0000 7fdcc77ff700 1 -- 172.21.15.45:0/1031745819 shutdown_connections 2023-11-28T12:08:00.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.302+0000 7fdcc77ff700 1 --2- 172.21.15.45:0/1031745819 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fdca40682f0 0x7fdca406a7a0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:00.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.302+0000 7fdcc77ff700 1 --2- 172.21.15.45:0/1031745819 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdcc0161340 0x7fdcc0156740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:00.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.302+0000 7fdcc77ff700 1 --2- 172.21.15.45:0/1031745819 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdcc00cd7c0 0x7fdcc01f2660 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:00.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.302+0000 7fdcc77ff700 1 --2- 172.21.15.45:0/1031745819 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdcc015c9b0 0x7fdcc00c9860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:00.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.302+0000 7fdcc77ff700 1 -- 172.21.15.45:0/1031745819 >> 172.21.15.45:0/1031745819 conn(0x7fdcc0072600 msgr2=0x7fdcc015f2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:00.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.302+0000 7fdcc77ff700 1 -- 172.21.15.45:0/1031745819 shutdown_connections 2023-11-28T12:08:00.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.303+0000 7fdcc77ff700 1 -- 172.21.15.45:0/1031745819 wait complete. 2023-11-28T12:08:00.307 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-11-28T12:08:00.322 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-28T12:08:00.322 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:08:00.322 DEBUG:teuthology.orchestra.run.smithi045:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-11-28T12:08:00.434 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi045.front.sepia.ceph.com 2023-11-28T12:08:00.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:08:00.434 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-28T12:08:00.494 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T12:08:00.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.697+0000 7f37887ff700 1 Processor -- start 2023-11-28T12:08:00.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.697+0000 7f37887ff700 1 -- start start 2023-11-28T12:08:00.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.698+0000 7f37887ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3780161340 0x7f37800d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:00.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.698+0000 7f37887ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f37800d2320 0x7f37800cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:00.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.698+0000 7f37887ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37800d1950 con 0x7f378015c9b0 2023-11-28T12:08:00.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.698+0000 7f37887ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37800b5800 con 0x7f3780161340 2023-11-28T12:08:00.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.698+0000 7f37887ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37800b5300 con 0x7f37800d2320 2023-11-28T12:08:00.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.698+0000 7f3785d9a700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3780161340 0x7f37800d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:00.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.698+0000 7f378659b700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f378015c9b0 0x7f37800b4bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:35248/0 (socket says 172.21.15.45:35248) 2023-11-28T12:08:00.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.698+0000 7f378659b700 1 -- 172.21.15.45:0/3929827647 learned_addr learned my addr 172.21.15.45:0/3929827647 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:08:00.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.699+0000 7f3786d9c700 1 --2- 172.21.15.45:0/3929827647 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f37800d2320 0x7f37800cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:00.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.699+0000 7f3785d9a700 1 -- 172.21.15.45:0/3929827647 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f37800d2320 msgr2=0x7f37800cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:00.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.699+0000 7f3785d9a700 1 --2- 172.21.15.45:0/3929827647 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f37800d2320 0x7f37800cd7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:00.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.699+0000 7f3785d9a700 1 -- 172.21.15.45:0/3929827647 >> v1:172.21.15.45:6789/0 conn(0x7f378015c9b0 legacy=0x7f37800b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:00.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.699+0000 7f3785d9a700 1 -- 172.21.15.45:0/3929827647 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37800b5520 con 0x7f3780161340 2023-11-28T12:08:00.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.699+0000 7f3786d9c700 1 --2- 172.21.15.45:0/3929827647 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f37800d2320 0x7f37800cd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:08:00.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.699+0000 7f3785599700 1 -- 172.21.15.45:0/3929827647 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1239827258 0 0) 0x7f37800d1950 con 0x7f378015c9b0 2023-11-28T12:08:00.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.699+0000 7f3785d9a700 1 --2- 172.21.15.45:0/3929827647 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3780161340 0x7f37800d1de0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f3770009840 tx=0x7f3770009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94ca103e68be259 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:00.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.699+0000 7f3785599700 1 -- 172.21.15.45:0/3929827647 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3770011830 con 0x7f3780161340 2023-11-28T12:08:00.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.699+0000 7f3785599700 1 -- 172.21.15.45:0/3929827647 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3770011990 con 0x7f3780161340 2023-11-28T12:08:00.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.699+0000 7f3785599700 1 -- 172.21.15.45:0/3929827647 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3770011d20 con 0x7f3780161340 2023-11-28T12:08:00.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.700+0000 7f37887ff700 1 -- 172.21.15.45:0/3929827647 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3780161340 msgr2=0x7f37800d1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:00.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.700+0000 7f37887ff700 1 --2- 172.21.15.45:0/3929827647 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3780161340 0x7f37800d1de0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f3770009840 tx=0x7f3770009b50 comp rx=0 tx=0).stop 2023-11-28T12:08:00.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.700+0000 7f37887ff700 1 -- 172.21.15.45:0/3929827647 shutdown_connections 2023-11-28T12:08:00.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.700+0000 7f37887ff700 1 --2- 172.21.15.45:0/3929827647 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f37800d2320 0x7f37800cd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:00.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.700+0000 7f37887ff700 1 --2- 172.21.15.45:0/3929827647 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3780161340 0x7f37800d1de0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:00.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.700+0000 7f37887ff700 1 -- 172.21.15.45:0/3929827647 >> 172.21.15.45:0/3929827647 conn(0x7f3780072600 msgr2=0x7f37800cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:00.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.700+0000 7f37887ff700 1 -- 172.21.15.45:0/3929827647 shutdown_connections 2023-11-28T12:08:00.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.700+0000 7f37887ff700 1 -- 172.21.15.45:0/3929827647 wait complete. 2023-11-28T12:08:00.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.702+0000 7f37887ff700 1 Processor -- start 2023-11-28T12:08:00.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.702+0000 7f37887ff700 1 -- start start 2023-11-28T12:08:00.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.703+0000 7f37887ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f37800d2320 0x7f37800c87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:00.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.703+0000 7f37887ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f378015c9b0 0x7f37800c76f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:00.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.703+0000 7f37887ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3780161340 0x7f378014d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:00.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.703+0000 7f37887ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37800c95c0 con 0x7f378015c9b0 2023-11-28T12:08:00.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.703+0000 7f37887ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37800c6ca0 con 0x7f3780161340 2023-11-28T12:08:00.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.703+0000 7f37887ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37800c9000 con 0x7f37800d2320 2023-11-28T12:08:00.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.703+0000 7f3785d9a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f378015c9b0 0x7f37800c76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:00.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.703+0000 7f3785d9a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f378015c9b0 0x7f37800c76f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55616/0 (socket says 172.21.15.45:55616) 2023-11-28T12:08:00.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.703+0000 7f3785d9a700 1 -- 172.21.15.45:0/200031767 learned_addr learned my addr 172.21.15.45:0/200031767 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:00.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.703+0000 7f3785d9a700 1 -- 172.21.15.45:0/200031767 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f37800d2320 msgr2=0x7f37800c87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:00.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.703+0000 7f3785d9a700 1 --2- 172.21.15.45:0/200031767 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f37800d2320 0x7f37800c87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:00.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.704+0000 7f3785d9a700 1 -- 172.21.15.45:0/200031767 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3780161340 msgr2=0x7f378014d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:00.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.704+0000 7f3785d9a700 1 --2- 172.21.15.45:0/200031767 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3780161340 0x7f378014d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:00.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.704+0000 7f3785d9a700 1 -- 172.21.15.45:0/200031767 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37700094a0 con 0x7f378015c9b0 2023-11-28T12:08:00.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.704+0000 7f3785d9a700 1 --2- 172.21.15.45:0/200031767 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f378015c9b0 0x7f37800c76f0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f37800675d0 tx=0x7f3770004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:00.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.704+0000 7f3776ffd700 1 -- 172.21.15.45:0/200031767 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37700036a0 con 0x7f378015c9b0 2023-11-28T12:08:00.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.704+0000 7f3776ffd700 1 -- 172.21.15.45:0/200031767 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f377001f070 con 0x7f378015c9b0 2023-11-28T12:08:00.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.704+0000 7f3776ffd700 1 -- 172.21.15.45:0/200031767 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3770003a40 con 0x7f378015c9b0 2023-11-28T12:08:00.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.704+0000 7f37887ff700 1 -- 172.21.15.45:0/200031767 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37800d15e0 con 0x7f378015c9b0 2023-11-28T12:08:00.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.704+0000 7f37887ff700 1 -- 172.21.15.45:0/200031767 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37800d1300 con 0x7f378015c9b0 2023-11-28T12:08:00.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.705+0000 7f37887ff700 1 -- 172.21.15.45:0/200031767 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f378015cd80 con 0x7f378015c9b0 2023-11-28T12:08:00.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.706+0000 7f3776ffd700 1 -- 172.21.15.45:0/200031767 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f377000f050 con 0x7f378015c9b0 2023-11-28T12:08:00.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.708+0000 7f3776ffd700 1 --2- 172.21.15.45:0/200031767 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f37640682f0 0x7f376406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:00.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.708+0000 7f3776ffd700 1 -- 172.21.15.45:0/200031767 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3770021070 con 0x7f378015c9b0 2023-11-28T12:08:00.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.708+0000 7f378659b700 1 --2- 172.21.15.45:0/200031767 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f37640682f0 0x7f376406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:00.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.709+0000 7f378659b700 1 --2- 172.21.15.45:0/200031767 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f37640682f0 0x7f376406a7a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f377c001610 tx=0x7f377c0079f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:00.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.712+0000 7f3776ffd700 1 -- 172.21.15.45:0/200031767 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f3770053fb0 con 0x7f378015c9b0 2023-11-28T12:08:00.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.960+0000 7f37887ff700 1 -- 172.21.15.45:0/200031767 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f37800745c0 con 0x7f378015c9b0 2023-11-28T12:08:00.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.960+0000 7f3776ffd700 1 -- 172.21.15.45:0/200031767 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4654 (secure 0 0 0) 0x7f37700575d0 con 0x7f378015c9b0 2023-11-28T12:08:00.962 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:08:00.962 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4805,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1232749056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1232749056},{"type":"v1","addr":"172.21.15.152:6837","nonce":1232749056}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4996,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/1358094304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":1358094304},{"type":"v1","addr":"172.21.15.45:6835","nonce":1358094304}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4999,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6836/2035520444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6835","nonce":2035520444},{"type":"v1","addr":"172.21.15.152:6836","nonce":2035520444}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T12:07:41.650740+0000","modified":"2023-11-28T12:07:44.849447+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5061},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5061":{"gid":5061,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.45:6834/2964277738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2964277738},{"type":"v1","addr":"172.21.15.45:6834","nonce":2964277738}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-28T12:08:00.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.962+0000 7f37887ff700 1 -- 172.21.15.45:0/200031767 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f37640682f0 msgr2=0x7f376406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:00.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.962+0000 7f37887ff700 1 --2- 172.21.15.45:0/200031767 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f37640682f0 0x7f376406a7a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f377c001610 tx=0x7f377c0079f0 comp rx=0 tx=0).stop 2023-11-28T12:08:00.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.962+0000 7f37887ff700 1 -- 172.21.15.45:0/200031767 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f378015c9b0 msgr2=0x7f37800c76f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:00.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.962+0000 7f37887ff700 1 --2- 172.21.15.45:0/200031767 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f378015c9b0 0x7f37800c76f0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f37800675d0 tx=0x7f3770004750 comp rx=0 tx=0).stop 2023-11-28T12:08:00.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.962+0000 7f37887ff700 1 -- 172.21.15.45:0/200031767 shutdown_connections 2023-11-28T12:08:00.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.962+0000 7f37887ff700 1 --2- 172.21.15.45:0/200031767 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f37640682f0 0x7f376406a7a0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:00.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.962+0000 7f37887ff700 1 --2- 172.21.15.45:0/200031767 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3780161340 0x7f378014d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:00.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.962+0000 7f37887ff700 1 --2- 172.21.15.45:0/200031767 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f37800d2320 0x7f37800c87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:00.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.962+0000 7f37887ff700 1 --2- 172.21.15.45:0/200031767 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f378015c9b0 0x7f37800c76f0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:00.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.962+0000 7f37887ff700 1 -- 172.21.15.45:0/200031767 >> 172.21.15.45:0/200031767 conn(0x7f3780072600 msgr2=0x7f37800b6e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:00.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.963+0000 7f37887ff700 1 -- 172.21.15.45:0/200031767 shutdown_connections 2023-11-28T12:08:00.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:00.963+0000 7f37887ff700 1 -- 172.21.15.45:0/200031767 wait complete. 2023-11-28T12:08:00.965 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 16 2023-11-28T12:08:00.982 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2023-11-28T12:08:01.216 INFO:teuthology.orchestra.run.smithi045.stdout:{"message":"","return_code":0} 2023-11-28T12:08:01.217 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2023-11-28T12:08:01.217 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T12:08:01.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:01.420+0000 7f52f0bff700 1 Processor -- start 2023-11-28T12:08:01.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:01.420+0000 7f52f0bff700 1 -- start start 2023-11-28T12:08:01.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:01.421+0000 7f52f0bff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f52ec15c9b0 0x7f52ec0b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:01.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:01.421+0000 7f52f0bff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f52ec0cd7c0 0x7f52ec0cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:01.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:01.421+0000 7f52f0bff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52ec0d1950 con 0x7f52ec161340 2023-11-28T12:08:01.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:01.422+0000 7f52f0bff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52ec0b5800 con 0x7f52ec15c9b0 2023-11-28T12:08:01.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:01.422+0000 7f52f0bff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52ec0ce140 con 0x7f52ec0cd7c0 2023-11-28T12:08:01.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:01.422+0000 7f52ea59c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f52ec15c9b0 0x7f52ec0b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:01.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:01.422+0000 7f52e9d9b700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f52ec161340 0x7f52ec0d1de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:35250/0 (socket says 172.21.15.45:35250) 2023-11-28T12:08:01.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:01.422+0000 7f52e9d9b700 1 -- 172.21.15.45:0/923344199 learned_addr learned my addr 172.21.15.45:0/923344199 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:08:01.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:01.422+0000 7f52ea59c700 1 --2- 172.21.15.45:0/923344199 >> v2:172.21.15.45:3300/0 conn(0x7f52ec15c9b0 0x7f52ec0b4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55628/0 (socket says 172.21.15.45:55628) 2023-11-28T12:08:01.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:01.422+0000 7f52ead9d700 1 --2- 172.21.15.45:0/923344199 >> v2:172.21.15.152:3300/0 conn(0x7f52ec0cd7c0 0x7f52ec0cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:01.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:01.422+0000 7f52ea59c700 1 -- 172.21.15.45:0/923344199 >> v2:172.21.15.152:3300/0 conn(0x7f52ec0cd7c0 msgr2=0x7f52ec0cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:01.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:01.422+0000 7f52ea59c700 1 --2- 172.21.15.45:0/923344199 >> v2:172.21.15.152:3300/0 conn(0x7f52ec0cd7c0 0x7f52ec0cdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:01.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:01.422+0000 7f52ea59c700 1 -- 172.21.15.45:0/923344199 >> v1:172.21.15.45:6789/0 conn(0x7f52ec161340 legacy=0x7f52ec0d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:01.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:01.422+0000 7f52ea59c700 1 -- 172.21.15.45:0/923344199 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52ec0d24f0 con 0x7f52ec15c9b0 2023-11-28T12:08:01.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:01.422+0000 7f52e959a700 1 -- 172.21.15.45:0/923344199 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3634601236 0 0) 0x7f52ec0d1950 con 0x7f52ec161340 2023-11-28T12:08:01.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:01.423+0000 7f52ea59c700 1 --2- 172.21.15.45:0/923344199 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52ec15c9b0 0x7f52ec0b4bf0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f52ec06c170 tx=0x7f52dc009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6c2a5f08f316563 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:01.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:01.423+0000 7f52e959a700 1 -- 172.21.15.45:0/923344199 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52dc011830 con 0x7f52ec15c9b0 2023-11-28T12:08:01.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:01.423+0000 7f52e959a700 1 -- 172.21.15.45:0/923344199 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52dc011990 con 0x7f52ec15c9b0 2023-11-28T12:08:01.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:01.423+0000 7f52e959a700 1 -- 172.21.15.45:0/923344199 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52dc011d20 con 0x7f52ec15c9b0 2023-11-28T12:08:01.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:01.423+0000 7f52f0bff700 1 -- 172.21.15.45:0/923344199 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52ec15c9b0 msgr2=0x7f52ec0b4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:01.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:01.423+0000 7f52f0bff700 1 --2- 172.21.15.45:0/923344199 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52ec15c9b0 0x7f52ec0b4bf0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f52ec06c170 tx=0x7f52dc009b20 comp rx=0 tx=0).stop 2023-11-28T12:08:01.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:01.423+0000 7f52f0bff700 1 -- 172.21.15.45:0/923344199 shutdown_connections 2023-11-28T12:08:01.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:01.423+0000 7f52f0bff700 1 --2- 172.21.15.45:0/923344199 >> v2:172.21.15.152:3300/0 conn(0x7f52ec0cd7c0 0x7f52ec0cdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:01.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:01.423+0000 7f52f0bff700 1 --2- 172.21.15.45:0/923344199 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52ec15c9b0 0x7f52ec0b4bf0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:01.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:01.423+0000 7f52f0bff700 1 -- 172.21.15.45:0/923344199 >> 172.21.15.45:0/923344199 conn(0x7f52ec072600 msgr2=0x7f52ec0cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:01.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:01.423+0000 7f52f0bff700 1 -- 172.21.15.45:0/923344199 shutdown_connections 2023-11-28T12:08:01.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:01.423+0000 7f52f0bff700 1 -- 172.21.15.45:0/923344199 wait complete. 2023-11-28T12:08:01.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:01.425+0000 7f52f0bff700 1 Processor -- start 2023-11-28T12:08:01.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:01.425+0000 7f52f0bff700 1 -- start start 2023-11-28T12:08:01.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:01.426+0000 7f52f0bff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52ec0cd7c0 0x7f52ec154260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:01.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:01.426+0000 7f52f0bff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52ec15c9b0 0x7f52ec1f24f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:01.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:01.426+0000 7f52f0bff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f52ec161340 0x7f52ec15e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:01.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:01.426+0000 7f52f0bff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52ec0cc130 con 0x7f52ec0cd7c0 2023-11-28T12:08:01.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:01.426+0000 7f52f0bff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52ec1547a0 con 0x7f52ec15c9b0 2023-11-28T12:08:01.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:01.426+0000 7f52f0bff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52ec0cb800 con 0x7f52ec161340 2023-11-28T12:08:01.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:01.426+0000 7f52ea59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52ec0cd7c0 0x7f52ec154260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:01.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:01.427+0000 7f52ea59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52ec0cd7c0 0x7f52ec154260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55632/0 (socket says 172.21.15.45:55632) 2023-11-28T12:08:01.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:01.427+0000 7f52ea59c700 1 -- 172.21.15.45:0/1440212776 learned_addr learned my addr 172.21.15.45:0/1440212776 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:01.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:01.427+0000 7f52ea59c700 1 -- 172.21.15.45:0/1440212776 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f52ec161340 msgr2=0x7f52ec15e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:01.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:01.427+0000 7f52ea59c700 1 --2- 172.21.15.45:0/1440212776 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f52ec161340 0x7f52ec15e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:01.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:01.427+0000 7f52ea59c700 1 -- 172.21.15.45:0/1440212776 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52ec15c9b0 msgr2=0x7f52ec1f24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:01.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:01.427+0000 7f52e9d9b700 1 --2- 172.21.15.45:0/1440212776 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52ec15c9b0 0x7f52ec1f24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:01.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:01.427+0000 7f52ea59c700 1 --2- 172.21.15.45:0/1440212776 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52ec15c9b0 0x7f52ec1f24f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:01.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:01.427+0000 7f52ea59c700 1 -- 172.21.15.45:0/1440212776 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52dc0094a0 con 0x7f52ec0cd7c0 2023-11-28T12:08:01.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:01.427+0000 7f52e9d9b700 1 --2- 172.21.15.45:0/1440212776 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52ec15c9b0 0x7f52ec1f24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:08:01.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:01.427+0000 7f52ea59c700 1 --2- 172.21.15.45:0/1440212776 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52ec0cd7c0 0x7f52ec154260 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f52dc014040 tx=0x7f52dc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:01.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:01.427+0000 7f52daffd700 1 -- 172.21.15.45:0/1440212776 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52dc0038a0 con 0x7f52ec0cd7c0 2023-11-28T12:08:01.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:01.427+0000 7f52daffd700 1 -- 172.21.15.45:0/1440212776 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52dc01e070 con 0x7f52ec0cd7c0 2023-11-28T12:08:01.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:01.428+0000 7f52daffd700 1 -- 172.21.15.45:0/1440212776 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52dc003c20 con 0x7f52ec0cd7c0 2023-11-28T12:08:01.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:01.428+0000 7f52f0bff700 1 -- 172.21.15.45:0/1440212776 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52ec0d1300 con 0x7f52ec0cd7c0 2023-11-28T12:08:01.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:01.428+0000 7f52f0bff700 1 -- 172.21.15.45:0/1440212776 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52ec0b5520 con 0x7f52ec0cd7c0 2023-11-28T12:08:01.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:01.429+0000 7f52f0bff700 1 -- 172.21.15.45:0/1440212776 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52ec0d15e0 con 0x7f52ec0cd7c0 2023-11-28T12:08:01.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:01.430+0000 7f52daffd700 1 -- 172.21.15.45:0/1440212776 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f52dc00f050 con 0x7f52ec0cd7c0 2023-11-28T12:08:01.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:01.430+0000 7f52daffd700 1 --2- 172.21.15.45:0/1440212776 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f52cc0682f0 0x7f52cc06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:01.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:01.431+0000 7f52daffd700 1 -- 172.21.15.45:0/1440212776 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f52dc086ce0 con 0x7f52ec0cd7c0 2023-11-28T12:08:01.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:01.431+0000 7f52e9d9b700 1 --2- 172.21.15.45:0/1440212776 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f52cc0682f0 0x7f52cc06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:01.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:01.431+0000 7f52e9d9b700 1 --2- 172.21.15.45:0/1440212776 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f52cc0682f0 0x7f52cc06a7a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f52e0007fd0 tx=0x7f52e0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:01.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:01.435+0000 7f52daffd700 1 -- 172.21.15.45:0/1440212776 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f52dc053450 con 0x7f52ec0cd7c0 2023-11-28T12:08:01.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:01.683+0000 7f52f0bff700 1 -- 172.21.15.45:0/1440212776 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f52ec0745c0 con 0x7f52ec0cd7c0 2023-11-28T12:08:01.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:01.684+0000 7f52daffd700 1 -- 172.21.15.45:0/1440212776 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4654 (secure 0 0 0) 0x7f52dc015090 con 0x7f52ec0cd7c0 2023-11-28T12:08:01.685 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:08:01.685 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4805,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1232749056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1232749056},{"type":"v1","addr":"172.21.15.152:6837","nonce":1232749056}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4996,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/1358094304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":1358094304},{"type":"v1","addr":"172.21.15.45:6835","nonce":1358094304}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4999,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6836/2035520444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6835","nonce":2035520444},{"type":"v1","addr":"172.21.15.152:6836","nonce":2035520444}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T12:07:41.650740+0000","modified":"2023-11-28T12:07:44.849447+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5061},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5061":{"gid":5061,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.45:6834/2964277738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2964277738},{"type":"v1","addr":"172.21.15.45:6834","nonce":2964277738}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-28T12:08:01.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:01.686+0000 7f52f0bff700 1 -- 172.21.15.45:0/1440212776 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f52cc0682f0 msgr2=0x7f52cc06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:01.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:01.686+0000 7f52f0bff700 1 --2- 172.21.15.45:0/1440212776 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f52cc0682f0 0x7f52cc06a7a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f52e0007fd0 tx=0x7f52e0009040 comp rx=0 tx=0).stop 2023-11-28T12:08:01.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:01.686+0000 7f52f0bff700 1 -- 172.21.15.45:0/1440212776 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52ec0cd7c0 msgr2=0x7f52ec154260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:01.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:01.686+0000 7f52f0bff700 1 --2- 172.21.15.45:0/1440212776 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52ec0cd7c0 0x7f52ec154260 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f52dc014040 tx=0x7f52dc004750 comp rx=0 tx=0).stop 2023-11-28T12:08:01.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:01.686+0000 7f52f0bff700 1 -- 172.21.15.45:0/1440212776 shutdown_connections 2023-11-28T12:08:01.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:01.686+0000 7f52f0bff700 1 --2- 172.21.15.45:0/1440212776 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f52cc0682f0 0x7f52cc06a7a0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:01.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:01.686+0000 7f52f0bff700 1 --2- 172.21.15.45:0/1440212776 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f52ec161340 0x7f52ec15e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:01.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:01.686+0000 7f52f0bff700 1 --2- 172.21.15.45:0/1440212776 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52ec0cd7c0 0x7f52ec154260 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:01.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:01.686+0000 7f52f0bff700 1 --2- 172.21.15.45:0/1440212776 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f52ec15c9b0 0x7f52ec1f24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:01.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:01.686+0000 7f52f0bff700 1 -- 172.21.15.45:0/1440212776 >> 172.21.15.45:0/1440212776 conn(0x7f52ec072600 msgr2=0x7f52ec0b5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:01.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:01.686+0000 7f52f0bff700 1 -- 172.21.15.45:0/1440212776 shutdown_connections 2023-11-28T12:08:01.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:01.686+0000 7f52f0bff700 1 -- 172.21.15.45:0/1440212776 wait complete. 2023-11-28T12:08:01.689 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 16 2023-11-28T12:08:01.705 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json tag path /parentdir mytag 2023-11-28T12:08:01.933 INFO:teuthology.orchestra.run.smithi045.stdout:{"return_code":0,"scrub_tag":"mytag","mode":"asynchronous"} 2023-11-28T12:08:01.934 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mode": "asynchronous", "return_code": 0, "scrub_tag": "mytag" } 2023-11-28T12:08:11.935 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getxattr 10000000000.00000000 scrub_tag 2023-11-28T12:08:12.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.031+0000 7ff6ee1990c0 1 Processor -- start 2023-11-28T12:08:12.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.032+0000 7ff6ee1990c0 1 -- start start 2023-11-28T12:08:12.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.032+0000 7ff6ee1990c0 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6c8003b80 0x5557e56c4260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:12.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.032+0000 7ff6ee1990c0 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5557e5759a20 0x5557e56803b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:12.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.032+0000 7ff6ee1990c0 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x5557e5750200 0x5557e56808f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:12.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.032+0000 7ff6ee1990c0 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557e5626000 con 0x7ff6c8003b80 2023-11-28T12:08:12.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.032+0000 7ff6ee1990c0 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557e55b8fe0 con 0x5557e5759a20 2023-11-28T12:08:12.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.032+0000 7ff6ee1990c0 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x5557e567f7a0 con 0x5557e5750200 2023-11-28T12:08:12.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.033+0000 7ff6df79b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6c8003b80 0x5557e56c4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:12.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.033+0000 7ff6df79b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6c8003b80 0x5557e56c4260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48534/0 (socket says 172.21.15.45:48534) 2023-11-28T12:08:12.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.033+0000 7ff6df79b700 1 -- 172.21.15.45:0/3931107575 learned_addr learned my addr 172.21.15.45:0/3931107575 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:12.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.033+0000 7ff6dff9c700 1 --2- 172.21.15.45:0/3931107575 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x5557e5750200 0x5557e56808f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:12.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.033+0000 7ff6def9a700 1 --2- 172.21.15.45:0/3931107575 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5557e5759a20 0x5557e56803b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:12.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.033+0000 7ff6df79b700 1 -- 172.21.15.45:0/3931107575 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x5557e5750200 msgr2=0x5557e56808f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:12.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.033+0000 7ff6df79b700 1 --2- 172.21.15.45:0/3931107575 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x5557e5750200 0x5557e56808f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:12.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.033+0000 7ff6df79b700 1 -- 172.21.15.45:0/3931107575 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5557e5759a20 msgr2=0x5557e56803b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:12.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.033+0000 7ff6df79b700 1 --2- 172.21.15.45:0/3931107575 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5557e5759a20 0x5557e56803b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:12.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.033+0000 7ff6df79b700 1 -- 172.21.15.45:0/3931107575 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5557e55d1360 con 0x7ff6c8003b80 2023-11-28T12:08:12.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.033+0000 7ff6df79b700 1 --2- 172.21.15.45:0/3931107575 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6c8003b80 0x5557e56c4260 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7ff6d000d3f0 tx=0x7ff6d0001760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5638be1cf5b12a6c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:12.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.034+0000 7ff6ddf98700 1 -- 172.21.15.45:0/3931107575 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d000dd10 con 0x7ff6c8003b80 2023-11-28T12:08:12.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.034+0000 7ff6ddf98700 1 -- 172.21.15.45:0/3931107575 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6d000de70 con 0x7ff6c8003b80 2023-11-28T12:08:12.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.034+0000 7ff6ddf98700 1 -- 172.21.15.45:0/3931107575 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d000f650 con 0x7ff6c8003b80 2023-11-28T12:08:12.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.034+0000 7ff6ee1990c0 1 -- 172.21.15.45:0/3931107575 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6c8003b80 msgr2=0x5557e56c4260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:12.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.034+0000 7ff6ee1990c0 1 --2- 172.21.15.45:0/3931107575 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6c8003b80 0x5557e56c4260 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7ff6d000d3f0 tx=0x7ff6d0001760 comp rx=0 tx=0).stop 2023-11-28T12:08:12.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.034+0000 7ff6ee1990c0 1 -- 172.21.15.45:0/3931107575 shutdown_connections 2023-11-28T12:08:12.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.034+0000 7ff6ee1990c0 1 --2- 172.21.15.45:0/3931107575 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x5557e5750200 0x5557e56808f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:12.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.034+0000 7ff6ee1990c0 1 --2- 172.21.15.45:0/3931107575 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6c8003b80 0x5557e56c4260 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:12.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.034+0000 7ff6ee1990c0 1 --2- 172.21.15.45:0/3931107575 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5557e5759a20 0x5557e56803b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:12.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.034+0000 7ff6ee1990c0 1 -- 172.21.15.45:0/3931107575 >> 172.21.15.45:0/3931107575 conn(0x5557e56ca890 msgr2=0x5557e5759250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:12.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.034+0000 7ff6ee1990c0 1 -- 172.21.15.45:0/3931107575 shutdown_connections 2023-11-28T12:08:12.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.034+0000 7ff6ee1990c0 1 -- 172.21.15.45:0/3931107575 wait complete. 2023-11-28T12:08:12.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.035+0000 7ff6ee1990c0 1 Processor -- start 2023-11-28T12:08:12.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.036+0000 7ff6ee1990c0 1 -- start start 2023-11-28T12:08:12.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.036+0000 7ff6ee1990c0 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5557e5750200 0x5557e57eca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:12.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.036+0000 7ff6ee1990c0 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5557e5759a20 0x5557e5751ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:12.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.036+0000 7ff6ee1990c0 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff6c8003b80 0x5557e574f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:12.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.036+0000 7ff6ee1990c0 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557e57ecfb0 con 0x5557e5750200 2023-11-28T12:08:12.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.036+0000 7ff6ee1990c0 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557e57528c0 con 0x5557e5759a20 2023-11-28T12:08:12.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.036+0000 7ff6ee1990c0 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x5557e5752530 con 0x7ff6c8003b80 2023-11-28T12:08:12.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.037+0000 7ff6df79b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5557e5750200 0x5557e57eca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:12.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.037+0000 7ff6df79b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5557e5750200 0x5557e57eca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48544/0 (socket says 172.21.15.45:48544) 2023-11-28T12:08:12.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.037+0000 7ff6df79b700 1 -- 172.21.15.45:0/3798446438 learned_addr learned my addr 172.21.15.45:0/3798446438 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:12.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.037+0000 7ff6def9a700 1 --2- 172.21.15.45:0/3798446438 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5557e5759a20 0x5557e5751ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:12.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.037+0000 7ff6dff9c700 1 --2- 172.21.15.45:0/3798446438 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff6c8003b80 0x5557e574f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:12.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.037+0000 7ff6df79b700 1 -- 172.21.15.45:0/3798446438 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff6c8003b80 msgr2=0x5557e574f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:12.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.037+0000 7ff6df79b700 1 --2- 172.21.15.45:0/3798446438 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff6c8003b80 0x5557e574f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:12.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.037+0000 7ff6df79b700 1 -- 172.21.15.45:0/3798446438 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5557e5759a20 msgr2=0x5557e5751ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:12.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.037+0000 7ff6df79b700 1 --2- 172.21.15.45:0/3798446438 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5557e5759a20 0x5557e5751ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:12.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.037+0000 7ff6df79b700 1 -- 172.21.15.45:0/3798446438 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5557e55d1120 con 0x5557e5750200 2023-11-28T12:08:12.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.038+0000 7ff6df79b700 1 --2- 172.21.15.45:0/3798446438 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5557e5750200 0x5557e57eca70 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ff6d000d9e0 tx=0x7ff6d0001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:12.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.038+0000 7ff6dcf96700 1 -- 172.21.15.45:0/3798446438 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d0001a90 con 0x5557e5750200 2023-11-28T12:08:12.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.038+0000 7ff6dcf96700 1 -- 172.21.15.45:0/3798446438 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6d0001760 con 0x5557e5750200 2023-11-28T12:08:12.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.038+0000 7ff6dcf96700 1 -- 172.21.15.45:0/3798446438 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d00198b0 con 0x5557e5750200 2023-11-28T12:08:12.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.038+0000 7ff6ee1990c0 1 -- 172.21.15.45:0/3798446438 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5557e575ae50 con 0x5557e5750200 2023-11-28T12:08:12.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.038+0000 7ff6ee1990c0 1 -- 172.21.15.45:0/3798446438 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5557e55c4830 con 0x5557e5750200 2023-11-28T12:08:12.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.040+0000 7ff6dcf96700 1 -- 172.21.15.45:0/3798446438 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7ff6d0019a10 con 0x5557e5750200 2023-11-28T12:08:12.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.041+0000 7ff6dcf96700 1 --2- 172.21.15.45:0/3798446438 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7ff6cc066c10 0x7ff6cc0690c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:12.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.041+0000 7ff6dcf96700 1 -- 172.21.15.45:0/3798446438 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff6d0086920 con 0x5557e5750200 2023-11-28T12:08:12.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.041+0000 7ff6ee1990c0 1 --2- 172.21.15.45:0/3798446438 >> [v2:172.21.15.152:6824/116097,v1:172.21.15.152:6825/116097] conn(0x5557e5680e60 0x5557e5752d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:12.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.041+0000 7ff6ee1990c0 1 -- 172.21.15.45:0/3798446438 --> [v2:172.21.15.152:6824/116097,v1:172.21.15.152:6825/116097] -- osd_op(unknown.0.0:1 5.10 5:0cf6ad0f:::10000000000.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x5557e5753290 con 0x5557e5680e60 2023-11-28T12:08:12.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.041+0000 7ff6def9a700 1 --2- 172.21.15.45:0/3798446438 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7ff6cc066c10 0x7ff6cc0690c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:12.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.041+0000 7ff6dff9c700 1 --2- 172.21.15.45:0/3798446438 >> [v2:172.21.15.152:6824/116097,v1:172.21.15.152:6825/116097] conn(0x5557e5680e60 0x5557e5752d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:12.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.042+0000 7ff6def9a700 1 --2- 172.21.15.45:0/3798446438 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7ff6cc066c10 0x7ff6cc0690c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x5557e56ca110 tx=0x7ff6d400c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:12.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.042+0000 7ff6dff9c700 1 --2- 172.21.15.45:0/3798446438 >> [v2:172.21.15.152:6824/116097,v1:172.21.15.152:6825/116097] conn(0x5557e5680e60 0x5557e5752d50 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:12.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.043+0000 7ff6dff9c700 1 -- 172.21.15.45:0/3798446438 <== osd.7 v2:172.21.15.152:6824/116097 1 ==== osd_op_reply(1 10000000000.00000000 [getxattr (9) out=9b] v0'0 uv11 ondisk = 0) v8 ==== 164+0+9 (crc 0 0 0) 0x7ff6d8006020 con 0x5557e5680e60 2023-11-28T12:08:12.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.043+0000 7ff6ee1990c0 1 -- 172.21.15.45:0/3798446438 >> [v2:172.21.15.152:6824/116097,v1:172.21.15.152:6825/116097] conn(0x5557e5680e60 msgr2=0x5557e5752d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:12.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.043+0000 7ff6ee1990c0 1 --2- 172.21.15.45:0/3798446438 >> [v2:172.21.15.152:6824/116097,v1:172.21.15.152:6825/116097] conn(0x5557e5680e60 0x5557e5752d50 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:12.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.043+0000 7ff6ee1990c0 1 -- 172.21.15.45:0/3798446438 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7ff6cc066c10 msgr2=0x7ff6cc0690c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:12.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.043+0000 7ff6ee1990c0 1 --2- 172.21.15.45:0/3798446438 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7ff6cc066c10 0x7ff6cc0690c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x5557e56ca110 tx=0x7ff6d400c040 comp rx=0 tx=0).stop 2023-11-28T12:08:12.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.043+0000 7ff6ee1990c0 1 -- 172.21.15.45:0/3798446438 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5557e5750200 msgr2=0x5557e57eca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:12.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.043+0000 7ff6ee1990c0 1 --2- 172.21.15.45:0/3798446438 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5557e5750200 0x5557e57eca70 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ff6d000d9e0 tx=0x7ff6d0001a00 comp rx=0 tx=0).stop 2023-11-28T12:08:12.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.043+0000 7ff6dff9c700 1 -- 172.21.15.45:0/3798446438 reap_dead start 2023-11-28T12:08:12.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.043+0000 7ff6ee1990c0 1 -- 172.21.15.45:0/3798446438 shutdown_connections 2023-11-28T12:08:12.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.043+0000 7ff6ee1990c0 1 -- 172.21.15.45:0/3798446438 >> 172.21.15.45:0/3798446438 conn(0x5557e56ca890 msgr2=0x5557e56c4260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:12.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.043+0000 7ff6ee1990c0 1 -- 172.21.15.45:0/3798446438 shutdown_connections 2023-11-28T12:08:12.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.043+0000 7ff6ee1990c0 1 -- 172.21.15.45:0/3798446438 wait complete. 2023-11-28T12:08:12.049 INFO:teuthology.orchestra.run.smithi045.stdout:mytag 2023-11-28T12:08:12.050 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getxattr 10000000001.00000000 scrub_tag 2023-11-28T12:08:12.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.139+0000 7f4a022750c0 1 Processor -- start 2023-11-28T12:08:12.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.139+0000 7f4a022750c0 1 -- start start 2023-11-28T12:08:12.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.140+0000 7f4a022750c0 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558cb0e11510 0x558cb0eed3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:12.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.140+0000 7f4a022750c0 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558cb0e125b0 0x558cb0e14200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:12.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.140+0000 7f4a022750c0 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x558cb0e57c00 0x558cb0e5ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:12.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.140+0000 7f4a022750c0 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cb0dba000 con 0x558cb0e125b0 2023-11-28T12:08:12.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.140+0000 7f4a022750c0 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cb0d4cfe0 con 0x558cb0e11510 2023-11-28T12:08:12.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.140+0000 7f4a022750c0 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x558cb0e14f20 con 0x558cb0e57c00 2023-11-28T12:08:12.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.140+0000 7f49f319a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558cb0e125b0 0x558cb0e14200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:12.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.140+0000 7f49f319a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558cb0e125b0 0x558cb0e14200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48554/0 (socket says 172.21.15.45:48554) 2023-11-28T12:08:12.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.140+0000 7f49f319a700 1 -- 172.21.15.45:0/2742290202 learned_addr learned my addr 172.21.15.45:0/2742290202 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:12.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.140+0000 7f49f399b700 1 --2- 172.21.15.45:0/2742290202 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558cb0e11510 0x558cb0eed3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:12.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.141+0000 7f49f419c700 1 --2- 172.21.15.45:0/2742290202 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x558cb0e57c00 0x558cb0e5ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:12.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.141+0000 7f49f319a700 1 -- 172.21.15.45:0/2742290202 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x558cb0e57c00 msgr2=0x558cb0e5ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:12.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.141+0000 7f49f319a700 1 --2- 172.21.15.45:0/2742290202 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x558cb0e57c00 0x558cb0e5ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:12.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.141+0000 7f49f319a700 1 -- 172.21.15.45:0/2742290202 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558cb0e11510 msgr2=0x558cb0eed3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:12.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.141+0000 7f49f319a700 1 --2- 172.21.15.45:0/2742290202 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558cb0e11510 0x558cb0eed3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:12.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.141+0000 7f49f319a700 1 -- 172.21.15.45:0/2742290202 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e4005d20 con 0x558cb0e125b0 2023-11-28T12:08:12.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.141+0000 7f49f399b700 1 --2- 172.21.15.45:0/2742290202 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558cb0e11510 0x558cb0eed3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:08:12.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.141+0000 7f49f319a700 1 --2- 172.21.15.45:0/2742290202 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558cb0e125b0 0x558cb0e14200 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f49e8001de0 tx=0x7f49e800b4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71407da4bcf17d1c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:12.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.141+0000 7f49f2198700 1 -- 172.21.15.45:0/2742290202 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e8014070 con 0x558cb0e125b0 2023-11-28T12:08:12.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.141+0000 7f49f2198700 1 -- 172.21.15.45:0/2742290202 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49e8008030 con 0x558cb0e125b0 2023-11-28T12:08:12.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.141+0000 7f49f2198700 1 -- 172.21.15.45:0/2742290202 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e800bdf0 con 0x558cb0e125b0 2023-11-28T12:08:12.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.142+0000 7f4a022750c0 1 -- 172.21.15.45:0/2742290202 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558cb0e125b0 msgr2=0x558cb0e14200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:12.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.142+0000 7f4a022750c0 1 --2- 172.21.15.45:0/2742290202 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558cb0e125b0 0x558cb0e14200 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f49e8001de0 tx=0x7f49e800b4c0 comp rx=0 tx=0).stop 2023-11-28T12:08:12.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.142+0000 7f4a022750c0 1 -- 172.21.15.45:0/2742290202 shutdown_connections 2023-11-28T12:08:12.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.142+0000 7f4a022750c0 1 --2- 172.21.15.45:0/2742290202 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558cb0e11510 0x558cb0eed3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:12.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.142+0000 7f4a022750c0 1 --2- 172.21.15.45:0/2742290202 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x558cb0e57c00 0x558cb0e5ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:12.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.142+0000 7f4a022750c0 1 --2- 172.21.15.45:0/2742290202 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558cb0e125b0 0x558cb0e14200 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:12.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.142+0000 7f4a022750c0 1 -- 172.21.15.45:0/2742290202 >> 172.21.15.45:0/2742290202 conn(0x558cb0e5e890 msgr2=0x558cb0e58040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:12.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.142+0000 7f4a022750c0 1 -- 172.21.15.45:0/2742290202 shutdown_connections 2023-11-28T12:08:12.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.142+0000 7f4a022750c0 1 -- 172.21.15.45:0/2742290202 wait complete. 2023-11-28T12:08:12.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.143+0000 7f4a022750c0 1 Processor -- start 2023-11-28T12:08:12.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.143+0000 7f4a022750c0 1 -- start start 2023-11-28T12:08:12.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.144+0000 7f4a022750c0 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558cb0e11510 0x558cb0edb480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:12.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.144+0000 7f4a022750c0 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x558cb0e125b0 0x558cb0e44380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:12.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.144+0000 7f4a022750c0 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558cb0e57c00 0x558cb0f802a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:12.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.144+0000 7f4a022750c0 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cb0eecb60 con 0x558cb0e57c00 2023-11-28T12:08:12.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.144+0000 7f4a022750c0 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cb0f807e0 con 0x558cb0e11510 2023-11-28T12:08:12.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.144+0000 7f4a022750c0 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x558cb0edb2a0 con 0x558cb0e125b0 2023-11-28T12:08:12.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.144+0000 7f49f419c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558cb0e57c00 0x558cb0f802a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:12.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.144+0000 7f49f419c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558cb0e57c00 0x558cb0f802a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48568/0 (socket says 172.21.15.45:48568) 2023-11-28T12:08:12.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.144+0000 7f49f419c700 1 -- 172.21.15.45:0/741430543 learned_addr learned my addr 172.21.15.45:0/741430543 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:12.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.144+0000 7f49f319a700 1 --2- 172.21.15.45:0/741430543 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x558cb0e125b0 0x558cb0e44380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:12.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.144+0000 7f49f399b700 1 --2- 172.21.15.45:0/741430543 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558cb0e11510 0x558cb0edb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:12.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.144+0000 7f49f419c700 1 -- 172.21.15.45:0/741430543 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x558cb0e125b0 msgr2=0x558cb0e44380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:12.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.144+0000 7f49f419c700 1 --2- 172.21.15.45:0/741430543 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x558cb0e125b0 0x558cb0e44380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:12.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.144+0000 7f49f419c700 1 -- 172.21.15.45:0/741430543 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558cb0e11510 msgr2=0x558cb0edb480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:12.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.144+0000 7f49f419c700 1 --2- 172.21.15.45:0/741430543 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558cb0e11510 0x558cb0edb480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:12.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.144+0000 7f49f419c700 1 -- 172.21.15.45:0/741430543 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e800a040 con 0x558cb0e57c00 2023-11-28T12:08:12.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.144+0000 7f49f399b700 1 --2- 172.21.15.45:0/741430543 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x558cb0e11510 0x558cb0edb480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:08:12.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.144+0000 7f49f319a700 1 --2- 172.21.15.45:0/741430543 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x558cb0e125b0 0x558cb0e44380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:08:12.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.145+0000 7f49f419c700 1 --2- 172.21.15.45:0/741430543 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558cb0e57c00 0x558cb0f802a0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f49ec004fb0 tx=0x7f49ec00d4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:12.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.145+0000 7f49f1196700 1 -- 172.21.15.45:0/741430543 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49ec00de30 con 0x558cb0e57c00 2023-11-28T12:08:12.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.145+0000 7f49f1196700 1 -- 172.21.15.45:0/741430543 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49ec013480 con 0x558cb0e57c00 2023-11-28T12:08:12.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.145+0000 7f4a022750c0 1 -- 172.21.15.45:0/741430543 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558cb0d58830 con 0x558cb0e57c00 2023-11-28T12:08:12.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.145+0000 7f49f1196700 1 -- 172.21.15.45:0/741430543 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49ec013830 con 0x558cb0e57c00 2023-11-28T12:08:12.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.145+0000 7f4a022750c0 1 -- 172.21.15.45:0/741430543 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558cb0d65360 con 0x558cb0e57c00 2023-11-28T12:08:12.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.147+0000 7f49f1196700 1 -- 172.21.15.45:0/741430543 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f49ec01a030 con 0x558cb0e57c00 2023-11-28T12:08:12.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.148+0000 7f49f1196700 1 --2- 172.21.15.45:0/741430543 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f49e0066c10 0x7f49e00690c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:12.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.148+0000 7f49f1196700 1 -- 172.21.15.45:0/741430543 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f49ec083fe0 con 0x558cb0e57c00 2023-11-28T12:08:12.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.148+0000 7f4a022750c0 1 --2- 172.21.15.45:0/741430543 >> [v2:172.21.15.152:6815/116093,v1:172.21.15.152:6817/116093] conn(0x558cb0e3e330 0x558cb0e3f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:12.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.148+0000 7f4a022750c0 1 -- 172.21.15.45:0/741430543 --> [v2:172.21.15.152:6815/116093,v1:172.21.15.152:6817/116093] -- osd_op(unknown.0.0:1 5.7 5:e2e07930:::10000000001.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x558cb0f760d0 con 0x558cb0e3e330 2023-11-28T12:08:12.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.148+0000 7f49f399b700 1 --2- 172.21.15.45:0/741430543 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f49e0066c10 0x7f49e00690c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:12.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.148+0000 7f49f319a700 1 --2- 172.21.15.45:0/741430543 >> [v2:172.21.15.152:6815/116093,v1:172.21.15.152:6817/116093] conn(0x558cb0e3e330 0x558cb0e3f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:12.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.149+0000 7f49f319a700 1 --2- 172.21.15.45:0/741430543 >> [v2:172.21.15.152:6815/116093,v1:172.21.15.152:6817/116093] conn(0x558cb0e3e330 0x558cb0e3f0d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:12.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.149+0000 7f49f399b700 1 --2- 172.21.15.45:0/741430543 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f49e0066c10 0x7f49e00690c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f49e400a440 tx=0x7f49e400e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:12.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.149+0000 7f49f319a700 1 -- 172.21.15.45:0/741430543 <== osd.5 v2:172.21.15.152:6815/116093 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (9) out=9b] v0'0 uv5 ondisk = 0) v8 ==== 164+0+9 (crc 0 0 0) 0x7f49e8016070 con 0x558cb0e3e330 2023-11-28T12:08:12.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.149+0000 7f4a022750c0 1 -- 172.21.15.45:0/741430543 >> [v2:172.21.15.152:6815/116093,v1:172.21.15.152:6817/116093] conn(0x558cb0e3e330 msgr2=0x558cb0e3f0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:12.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.149+0000 7f4a022750c0 1 --2- 172.21.15.45:0/741430543 >> [v2:172.21.15.152:6815/116093,v1:172.21.15.152:6817/116093] conn(0x558cb0e3e330 0x558cb0e3f0d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:12.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.150+0000 7f4a022750c0 1 -- 172.21.15.45:0/741430543 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f49e0066c10 msgr2=0x7f49e00690c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:12.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.150+0000 7f4a022750c0 1 --2- 172.21.15.45:0/741430543 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f49e0066c10 0x7f49e00690c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f49e400a440 tx=0x7f49e400e000 comp rx=0 tx=0).stop 2023-11-28T12:08:12.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.150+0000 7f4a022750c0 1 -- 172.21.15.45:0/741430543 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558cb0e57c00 msgr2=0x558cb0f802a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:12.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.150+0000 7f4a022750c0 1 --2- 172.21.15.45:0/741430543 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558cb0e57c00 0x558cb0f802a0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f49ec004fb0 tx=0x7f49ec00d4f0 comp rx=0 tx=0).stop 2023-11-28T12:08:12.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.150+0000 7f49f419c700 1 -- 172.21.15.45:0/741430543 reap_dead start 2023-11-28T12:08:12.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.150+0000 7f4a022750c0 1 -- 172.21.15.45:0/741430543 shutdown_connections 2023-11-28T12:08:12.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.150+0000 7f4a022750c0 1 -- 172.21.15.45:0/741430543 >> 172.21.15.45:0/741430543 conn(0x558cb0e5e890 msgr2=0x558cb0e58000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:12.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.150+0000 7f4a022750c0 1 -- 172.21.15.45:0/741430543 shutdown_connections 2023-11-28T12:08:12.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.150+0000 7f4a022750c0 1 -- 172.21.15.45:0/741430543 wait complete. 2023-11-28T12:08:12.158 INFO:teuthology.orchestra.run.smithi045.stdout:mytag 2023-11-28T12:08:12.159 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001f7.00000000 scrub_tag 2023-11-28T12:08:12.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.246+0000 7feeb12980c0 1 Processor -- start 2023-11-28T12:08:12.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.246+0000 7feeb12980c0 1 -- start start 2023-11-28T12:08:12.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.247+0000 7feeb12980c0 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55978e792510 0x55978e85c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:12.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.247+0000 7feeb12980c0 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55978e7935b0 0x55978e86e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:12.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.247+0000 7feeb12980c0 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55978e7d8c00 0x55978e7da090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:12.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.247+0000 7feeb12980c0 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55978e7df310 con 0x55978e792510 2023-11-28T12:08:12.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.247+0000 7feeb12980c0 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55978e86eca0 con 0x55978e7d8c00 2023-11-28T12:08:12.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.247+0000 7feeb12980c0 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x55978e86ea30 con 0x55978e7935b0 2023-11-28T12:08:12.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.247+0000 7feea299b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55978e792510 0x55978e85c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:12.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.247+0000 7feea299b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55978e792510 0x55978e85c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48586/0 (socket says 172.21.15.45:48586) 2023-11-28T12:08:12.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.247+0000 7feea299b700 1 -- 172.21.15.45:0/4262319016 learned_addr learned my addr 172.21.15.45:0/4262319016 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:12.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.247+0000 7feea219a700 1 --2- 172.21.15.45:0/4262319016 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55978e7935b0 0x55978e86e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:12.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.247+0000 7feea319c700 1 --2- 172.21.15.45:0/4262319016 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55978e7d8c00 0x55978e7da090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:12.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.247+0000 7feea299b700 1 -- 172.21.15.45:0/4262319016 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55978e7935b0 msgr2=0x55978e86e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:12.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.247+0000 7feea299b700 1 --2- 172.21.15.45:0/4262319016 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55978e7935b0 0x55978e86e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:12.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.247+0000 7feea299b700 1 -- 172.21.15.45:0/4262319016 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55978e7d8c00 msgr2=0x55978e7da090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:12.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.247+0000 7feea299b700 1 --2- 172.21.15.45:0/4262319016 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55978e7d8c00 0x55978e7da090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:12.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.247+0000 7feea299b700 1 -- 172.21.15.45:0/4262319016 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee98005de0 con 0x55978e792510 2023-11-28T12:08:12.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.248+0000 7feea299b700 1 --2- 172.21.15.45:0/4262319016 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55978e792510 0x55978e85c7c0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fee9400a770 tx=0x7fee9400aa80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62bb41bedcc72a15 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:12.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.248+0000 7feea1198700 1 -- 172.21.15.45:0/4262319016 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9400f070 con 0x55978e792510 2023-11-28T12:08:12.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.248+0000 7feea1198700 1 -- 172.21.15.45:0/4262319016 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee94008520 con 0x55978e792510 2023-11-28T12:08:12.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.248+0000 7feea1198700 1 -- 172.21.15.45:0/4262319016 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee940088b0 con 0x55978e792510 2023-11-28T12:08:12.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.248+0000 7feeb12980c0 1 -- 172.21.15.45:0/4262319016 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55978e792510 msgr2=0x55978e85c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:12.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.248+0000 7feeb12980c0 1 --2- 172.21.15.45:0/4262319016 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55978e792510 0x55978e85c7c0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fee9400a770 tx=0x7fee9400aa80 comp rx=0 tx=0).stop 2023-11-28T12:08:12.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.249+0000 7feeb12980c0 1 -- 172.21.15.45:0/4262319016 shutdown_connections 2023-11-28T12:08:12.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.249+0000 7feeb12980c0 1 --2- 172.21.15.45:0/4262319016 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55978e7d8c00 0x55978e7da090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:12.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.249+0000 7feeb12980c0 1 --2- 172.21.15.45:0/4262319016 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55978e792510 0x55978e85c7c0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:12.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.249+0000 7feeb12980c0 1 --2- 172.21.15.45:0/4262319016 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55978e7935b0 0x55978e86e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:12.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.249+0000 7feeb12980c0 1 -- 172.21.15.45:0/4262319016 >> 172.21.15.45:0/4262319016 conn(0x55978e7df890 msgr2=0x55978e865370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:12.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.249+0000 7feeb12980c0 1 -- 172.21.15.45:0/4262319016 shutdown_connections 2023-11-28T12:08:12.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.249+0000 7feeb12980c0 1 -- 172.21.15.45:0/4262319016 wait complete. 2023-11-28T12:08:12.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.249+0000 7feeb12980c0 1 Processor -- start 2023-11-28T12:08:12.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.250+0000 7feeb12980c0 1 -- start start 2023-11-28T12:08:12.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.250+0000 7feeb12980c0 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55978e792510 0x55978e85b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:12.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.250+0000 7feeb12980c0 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55978e7935b0 0x55978e859350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:12.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.250+0000 7feeb12980c0 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55978e7d8c00 0x55978e7d9e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:12.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.250+0000 7feeb12980c0 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55978e85aec0 con 0x55978e7935b0 2023-11-28T12:08:12.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.250+0000 7feeb12980c0 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55978e85b480 con 0x55978e7d8c00 2023-11-28T12:08:12.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.250+0000 7feeb12980c0 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x55978e86e650 con 0x55978e792510 2023-11-28T12:08:12.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.251+0000 7feea219a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55978e7935b0 0x55978e859350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:12.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.251+0000 7feea219a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55978e7935b0 0x55978e859350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48596/0 (socket says 172.21.15.45:48596) 2023-11-28T12:08:12.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.251+0000 7feea219a700 1 -- 172.21.15.45:0/200703251 learned_addr learned my addr 172.21.15.45:0/200703251 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:12.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.251+0000 7feea299b700 1 --2- 172.21.15.45:0/200703251 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55978e792510 0x55978e85b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:12.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.251+0000 7feea219a700 1 -- 172.21.15.45:0/200703251 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55978e792510 msgr2=0x55978e85b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:12.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.251+0000 7feea319c700 1 --2- 172.21.15.45:0/200703251 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55978e7d8c00 0x55978e7d9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:12.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.251+0000 7feea219a700 1 --2- 172.21.15.45:0/200703251 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55978e792510 0x55978e85b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:12.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.251+0000 7feea219a700 1 -- 172.21.15.45:0/200703251 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55978e7d8c00 msgr2=0x55978e7d9e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:12.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.251+0000 7feea219a700 1 --2- 172.21.15.45:0/200703251 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55978e7d8c00 0x55978e7d9e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:12.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.251+0000 7feea219a700 1 -- 172.21.15.45:0/200703251 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee9400a420 con 0x55978e7935b0 2023-11-28T12:08:12.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.251+0000 7feea299b700 1 --2- 172.21.15.45:0/200703251 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55978e792510 0x55978e85b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:08:12.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.251+0000 7feea319c700 1 --2- 172.21.15.45:0/200703251 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55978e7d8c00 0x55978e7d9e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:08:12.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.251+0000 7feea219a700 1 --2- 172.21.15.45:0/200703251 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55978e7935b0 0x55978e859350 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fee9800a4f0 tx=0x7fee98002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:12.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.252+0000 7fee8bfff700 1 -- 172.21.15.45:0/200703251 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9801d630 con 0x55978e7935b0 2023-11-28T12:08:12.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.252+0000 7fee8bfff700 1 -- 172.21.15.45:0/200703251 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee9801d7b0 con 0x55978e7935b0 2023-11-28T12:08:12.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.252+0000 7feeb12980c0 1 -- 172.21.15.45:0/200703251 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55978e7004f0 con 0x55978e7935b0 2023-11-28T12:08:12.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.252+0000 7fee8bfff700 1 -- 172.21.15.45:0/200703251 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9801db60 con 0x55978e7935b0 2023-11-28T12:08:12.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.252+0000 7feeb12980c0 1 -- 172.21.15.45:0/200703251 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55978e6e6120 con 0x55978e7935b0 2023-11-28T12:08:12.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.254+0000 7fee8bfff700 1 -- 172.21.15.45:0/200703251 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fee9802d070 con 0x55978e7935b0 2023-11-28T12:08:12.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.255+0000 7fee8bfff700 1 --2- 172.21.15.45:0/200703251 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fee90066c10 0x7fee900690c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:12.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.255+0000 7fee8bfff700 1 -- 172.21.15.45:0/200703251 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fee98085c40 con 0x55978e7935b0 2023-11-28T12:08:12.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.255+0000 7feea299b700 1 --2- 172.21.15.45:0/200703251 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fee90066c10 0x7fee900690c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:12.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.255+0000 7feeb12980c0 1 --2- 172.21.15.45:0/200703251 >> [v2:172.21.15.152:6815/116093,v1:172.21.15.152:6817/116093] conn(0x55978e85cda0 0x55978e85d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:12.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.255+0000 7feeb12980c0 1 -- 172.21.15.45:0/200703251 --> [v2:172.21.15.152:6815/116093,v1:172.21.15.152:6817/116093] -- osd_op(unknown.0.0:1 6.36 6:6fe38dc2:::100000001f7.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55978e90df00 con 0x55978e85cda0 2023-11-28T12:08:12.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.255+0000 7feea319c700 1 --2- 172.21.15.45:0/200703251 >> [v2:172.21.15.152:6815/116093,v1:172.21.15.152:6817/116093] conn(0x55978e85cda0 0x55978e85d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:12.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.256+0000 7feea299b700 1 --2- 172.21.15.45:0/200703251 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fee90066c10 0x7fee900690c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fee9400a770 tx=0x7fee94012000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:12.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.256+0000 7feea319c700 1 --2- 172.21.15.45:0/200703251 >> [v2:172.21.15.152:6815/116093,v1:172.21.15.152:6817/116093] conn(0x55978e85cda0 0x55978e85d1c0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:12.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.256+0000 7feea319c700 1 -- 172.21.15.45:0/200703251 <== osd.5 v2:172.21.15.152:6815/116093 1 ==== osd_op_reply(1 100000001f7.00000000 [getxattr (9) out=9b] v0'0 uv17 ondisk = 0) v8 ==== 164+0+9 (crc 0 0 0) 0x7fee9c00d690 con 0x55978e85cda0 2023-11-28T12:08:12.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.256+0000 7feeb12980c0 1 -- 172.21.15.45:0/200703251 >> [v2:172.21.15.152:6815/116093,v1:172.21.15.152:6817/116093] conn(0x55978e85cda0 msgr2=0x55978e85d1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:12.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.256+0000 7feeb12980c0 1 --2- 172.21.15.45:0/200703251 >> [v2:172.21.15.152:6815/116093,v1:172.21.15.152:6817/116093] conn(0x55978e85cda0 0x55978e85d1c0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:12.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.257+0000 7feeb12980c0 1 -- 172.21.15.45:0/200703251 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fee90066c10 msgr2=0x7fee900690c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:12.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.257+0000 7feeb12980c0 1 --2- 172.21.15.45:0/200703251 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fee90066c10 0x7fee900690c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fee9400a770 tx=0x7fee94012000 comp rx=0 tx=0).stop 2023-11-28T12:08:12.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.257+0000 7feeb12980c0 1 -- 172.21.15.45:0/200703251 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55978e7935b0 msgr2=0x55978e859350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:12.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.257+0000 7feeb12980c0 1 --2- 172.21.15.45:0/200703251 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55978e7935b0 0x55978e859350 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fee9800a4f0 tx=0x7fee98002fb0 comp rx=0 tx=0).stop 2023-11-28T12:08:12.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.257+0000 7feea319c700 1 -- 172.21.15.45:0/200703251 reap_dead start 2023-11-28T12:08:12.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.257+0000 7feeb12980c0 1 -- 172.21.15.45:0/200703251 shutdown_connections 2023-11-28T12:08:12.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.257+0000 7feeb12980c0 1 -- 172.21.15.45:0/200703251 >> 172.21.15.45:0/200703251 conn(0x55978e7df890 msgr2=0x55978e865370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:12.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.257+0000 7feeb12980c0 1 -- 172.21.15.45:0/200703251 shutdown_connections 2023-11-28T12:08:12.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.257+0000 7feeb12980c0 1 -- 172.21.15.45:0/200703251 wait complete. 2023-11-28T12:08:12.262 INFO:teuthology.orchestra.run.smithi045.stdout:mytag 2023-11-28T12:08:12.263 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001f8.00000000 scrub_tag 2023-11-28T12:08:12.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.352+0000 7f38ae05f0c0 1 Processor -- start 2023-11-28T12:08:12.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.352+0000 7f38ae05f0c0 1 -- start start 2023-11-28T12:08:12.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.353+0000 7f38ae05f0c0 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55766e3edac0 0x55766e47b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:12.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.353+0000 7f38ae05f0c0 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55766e3f2590 0x55766e4827e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:12.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.353+0000 7f38ae05f0c0 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55766e3f3f00 0x55766e482d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:12.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.353+0000 7f38ae05f0c0 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55766e351000 con 0x55766e3f2590 2023-11-28T12:08:12.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.353+0000 7f38ae05f0c0 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55766e2e3fe0 con 0x55766e3f3f00 2023-11-28T12:08:12.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.353+0000 7f38ae05f0c0 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x55766e3ee3c0 con 0x55766e3edac0 2023-11-28T12:08:12.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.354+0000 7f389f19a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55766e3f2590 0x55766e4827e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:12.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.354+0000 7f389f19a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55766e3f2590 0x55766e4827e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48610/0 (socket says 172.21.15.45:48610) 2023-11-28T12:08:12.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.354+0000 7f389f19a700 1 -- 172.21.15.45:0/1648297623 learned_addr learned my addr 172.21.15.45:0/1648297623 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:12.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.354+0000 7f389f99b700 1 --2- 172.21.15.45:0/1648297623 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55766e3edac0 0x55766e47b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:12.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.354+0000 7f38a019c700 1 --2- 172.21.15.45:0/1648297623 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55766e3f3f00 0x55766e482d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:12.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.354+0000 7f389f19a700 1 -- 172.21.15.45:0/1648297623 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55766e3edac0 msgr2=0x55766e47b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:12.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.354+0000 7f389f19a700 1 --2- 172.21.15.45:0/1648297623 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55766e3edac0 0x55766e47b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:12.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.354+0000 7f389f19a700 1 -- 172.21.15.45:0/1648297623 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55766e3f3f00 msgr2=0x55766e482d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:12.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.354+0000 7f389f19a700 1 --2- 172.21.15.45:0/1648297623 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55766e3f3f00 0x55766e482d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:12.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.354+0000 7f389f19a700 1 -- 172.21.15.45:0/1648297623 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3894005d20 con 0x55766e3f2590 2023-11-28T12:08:12.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.354+0000 7f389f99b700 1 --2- 172.21.15.45:0/1648297623 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55766e3edac0 0x55766e47b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:08:12.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.354+0000 7f389f19a700 1 --2- 172.21.15.45:0/1648297623 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55766e3f2590 0x55766e4827e0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f389400af40 tx=0x7f389400d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=887d32f7854a4a2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:12.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.354+0000 7f389e198700 1 -- 172.21.15.45:0/1648297623 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3894005b10 con 0x55766e3f2590 2023-11-28T12:08:12.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.355+0000 7f389e198700 1 -- 172.21.15.45:0/1648297623 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3894008d10 con 0x55766e3f2590 2023-11-28T12:08:12.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.355+0000 7f389e198700 1 -- 172.21.15.45:0/1648297623 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3894008b60 con 0x55766e3f2590 2023-11-28T12:08:12.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.355+0000 7f38ae05f0c0 1 -- 172.21.15.45:0/1648297623 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55766e3f2590 msgr2=0x55766e4827e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:12.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.355+0000 7f38ae05f0c0 1 --2- 172.21.15.45:0/1648297623 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55766e3f2590 0x55766e4827e0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f389400af40 tx=0x7f389400d000 comp rx=0 tx=0).stop 2023-11-28T12:08:12.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.355+0000 7f38ae05f0c0 1 -- 172.21.15.45:0/1648297623 shutdown_connections 2023-11-28T12:08:12.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.355+0000 7f38ae05f0c0 1 --2- 172.21.15.45:0/1648297623 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55766e3f3f00 0x55766e482d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:12.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.355+0000 7f38ae05f0c0 1 --2- 172.21.15.45:0/1648297623 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55766e3edac0 0x55766e47b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:12.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.355+0000 7f38ae05f0c0 1 --2- 172.21.15.45:0/1648297623 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55766e3f2590 0x55766e4827e0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:12.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.355+0000 7f38ae05f0c0 1 -- 172.21.15.45:0/1648297623 >> 172.21.15.45:0/1648297623 conn(0x55766e3f1230 msgr2=0x55766e3ac470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:12.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.355+0000 7f38ae05f0c0 1 -- 172.21.15.45:0/1648297623 shutdown_connections 2023-11-28T12:08:12.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.355+0000 7f38ae05f0c0 1 -- 172.21.15.45:0/1648297623 wait complete. 2023-11-28T12:08:12.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.356+0000 7f38ae05f0c0 1 Processor -- start 2023-11-28T12:08:12.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.356+0000 7f38ae05f0c0 1 -- start start 2023-11-28T12:08:12.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.357+0000 7f38ae05f0c0 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55766e3edac0 0x55766e475520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:12.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.357+0000 7f38ae05f0c0 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55766e3f2590 0x55766e51a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:12.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.357+0000 7f38ae05f0c0 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55766e3f3f00 0x55766e51a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:12.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.357+0000 7f38ae05f0c0 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55766e480950 con 0x55766e3edac0 2023-11-28T12:08:12.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.357+0000 7f38ae05f0c0 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55766e51b0d0 con 0x55766e3f3f00 2023-11-28T12:08:12.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.357+0000 7f38ae05f0c0 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x55766e51aba0 con 0x55766e3f2590 2023-11-28T12:08:12.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.357+0000 7f389f99b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55766e3edac0 0x55766e475520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:12.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.357+0000 7f389f99b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55766e3edac0 0x55766e475520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48620/0 (socket says 172.21.15.45:48620) 2023-11-28T12:08:12.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.357+0000 7f389f99b700 1 -- 172.21.15.45:0/453087176 learned_addr learned my addr 172.21.15.45:0/453087176 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:12.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.357+0000 7f389f19a700 1 --2- 172.21.15.45:0/453087176 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55766e3f2590 0x55766e51a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:12.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.357+0000 7f38a019c700 1 --2- 172.21.15.45:0/453087176 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55766e3f3f00 0x55766e51a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:12.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.358+0000 7f389f99b700 1 -- 172.21.15.45:0/453087176 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55766e3f2590 msgr2=0x55766e51a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:12.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.358+0000 7f389f99b700 1 --2- 172.21.15.45:0/453087176 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55766e3f2590 0x55766e51a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:12.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.358+0000 7f389f99b700 1 -- 172.21.15.45:0/453087176 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55766e3f3f00 msgr2=0x55766e51a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:12.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.358+0000 7f389f99b700 1 --2- 172.21.15.45:0/453087176 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55766e3f3f00 0x55766e51a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:12.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.358+0000 7f389f99b700 1 -- 172.21.15.45:0/453087176 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55766e2fc120 con 0x55766e3edac0 2023-11-28T12:08:12.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.358+0000 7f389f99b700 1 --2- 172.21.15.45:0/453087176 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55766e3edac0 0x55766e475520 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f389000dd80 tx=0x7f389000b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:12.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.358+0000 7f389d196700 1 -- 172.21.15.45:0/453087176 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f389000bc00 con 0x55766e3edac0 2023-11-28T12:08:12.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.358+0000 7f389d196700 1 -- 172.21.15.45:0/453087176 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f389000a040 con 0x55766e3edac0 2023-11-28T12:08:12.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.358+0000 7f38ae05f0c0 1 -- 172.21.15.45:0/453087176 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55766e2ef830 con 0x55766e3edac0 2023-11-28T12:08:12.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.358+0000 7f389d196700 1 -- 172.21.15.45:0/453087176 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3890011460 con 0x55766e3edac0 2023-11-28T12:08:12.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.358+0000 7f38ae05f0c0 1 -- 172.21.15.45:0/453087176 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55766e2fc360 con 0x55766e3edac0 2023-11-28T12:08:12.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.361+0000 7f389d196700 1 -- 172.21.15.45:0/453087176 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f3890021070 con 0x55766e3edac0 2023-11-28T12:08:12.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.361+0000 7f389d196700 1 --2- 172.21.15.45:0/453087176 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f388c066c10 0x7f388c0690c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:12.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.361+0000 7f389d196700 1 -- 172.21.15.45:0/453087176 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3890009050 con 0x55766e3edac0 2023-11-28T12:08:12.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.362+0000 7f389f19a700 1 --2- 172.21.15.45:0/453087176 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f388c066c10 0x7f388c0690c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:12.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.362+0000 7f38ae05f0c0 1 --2- 172.21.15.45:0/453087176 >> [v2:172.21.15.152:6815/116093,v1:172.21.15.152:6817/116093] conn(0x55766e3f3400 0x55766e3d8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:12.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.362+0000 7f38ae05f0c0 1 -- 172.21.15.45:0/453087176 --> [v2:172.21.15.152:6815/116093,v1:172.21.15.152:6817/116093] -- osd_op(unknown.0.0:1 6.19 6:997b7129:::100000001f8.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55766e475fe0 con 0x55766e3f3400 2023-11-28T12:08:12.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.362+0000 7f38a019c700 1 --2- 172.21.15.45:0/453087176 >> [v2:172.21.15.152:6815/116093,v1:172.21.15.152:6817/116093] conn(0x55766e3f3400 0x55766e3d8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:12.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.362+0000 7f389f19a700 1 --2- 172.21.15.45:0/453087176 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f388c066c10 0x7f388c0690c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f389400a870 tx=0x7f3894008000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:12.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.363+0000 7f38a019c700 1 --2- 172.21.15.45:0/453087176 >> [v2:172.21.15.152:6815/116093,v1:172.21.15.152:6817/116093] conn(0x55766e3f3400 0x55766e3d8520 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:12.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.363+0000 7f38a019c700 1 -- 172.21.15.45:0/453087176 <== osd.5 v2:172.21.15.152:6815/116093 1 ==== osd_op_reply(1 100000001f8.00000000 [getxattr (9) out=9b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+9 (crc 0 0 0) 0x7f38980018d0 con 0x55766e3f3400 2023-11-28T12:08:12.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.363+0000 7f38ae05f0c0 1 -- 172.21.15.45:0/453087176 >> [v2:172.21.15.152:6815/116093,v1:172.21.15.152:6817/116093] conn(0x55766e3f3400 msgr2=0x55766e3d8520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:12.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.363+0000 7f38ae05f0c0 1 --2- 172.21.15.45:0/453087176 >> [v2:172.21.15.152:6815/116093,v1:172.21.15.152:6817/116093] conn(0x55766e3f3400 0x55766e3d8520 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:12.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.363+0000 7f38ae05f0c0 1 -- 172.21.15.45:0/453087176 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f388c066c10 msgr2=0x7f388c0690c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:12.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.363+0000 7f38ae05f0c0 1 --2- 172.21.15.45:0/453087176 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f388c066c10 0x7f388c0690c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f389400a870 tx=0x7f3894008000 comp rx=0 tx=0).stop 2023-11-28T12:08:12.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.363+0000 7f38ae05f0c0 1 -- 172.21.15.45:0/453087176 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55766e3edac0 msgr2=0x55766e475520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:12.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.363+0000 7f38ae05f0c0 1 --2- 172.21.15.45:0/453087176 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55766e3edac0 0x55766e475520 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f389000dd80 tx=0x7f389000b4a0 comp rx=0 tx=0).stop 2023-11-28T12:08:12.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.363+0000 7f38a019c700 1 -- 172.21.15.45:0/453087176 reap_dead start 2023-11-28T12:08:12.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.364+0000 7f38ae05f0c0 1 -- 172.21.15.45:0/453087176 shutdown_connections 2023-11-28T12:08:12.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.364+0000 7f38ae05f0c0 1 -- 172.21.15.45:0/453087176 >> 172.21.15.45:0/453087176 conn(0x55766e3f1230 msgr2=0x55766e3ac470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:12.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.364+0000 7f38ae05f0c0 1 -- 172.21.15.45:0/453087176 shutdown_connections 2023-11-28T12:08:12.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.364+0000 7f38ae05f0c0 1 -- 172.21.15.45:0/453087176 wait complete. 2023-11-28T12:08:12.369 INFO:teuthology.orchestra.run.smithi045.stdout:mytag 2023-11-28T12:08:12.369 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000002.00000000 scrub_tag 2023-11-28T12:08:12.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.457+0000 7f3c01fcc0c0 1 Processor -- start 2023-11-28T12:08:12.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.457+0000 7f3c01fcc0c0 1 -- start start 2023-11-28T12:08:12.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.458+0000 7f3c01fcc0c0 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55844d17b510 0x55844d1c8200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:12.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.458+0000 7f3c01fcc0c0 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55844d17c5b0 0x55844d245190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:12.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.458+0000 7f3c01fcc0c0 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55844d1c1c00 0x55844d1c2310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:12.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.458+0000 7f3c01fcc0c0 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55844d0b6fe0 con 0x55844d17b510 2023-11-28T12:08:12.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.458+0000 7f3c01fcc0c0 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55844d1c8740 con 0x55844d17c5b0 2023-11-28T12:08:12.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.458+0000 7f3c01fcc0c0 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x55844d2456d0 con 0x55844d1c1c00 2023-11-28T12:08:12.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.458+0000 7f3bf359b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55844d17b510 0x55844d1c8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:12.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.458+0000 7f3bf359b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55844d17b510 0x55844d1c8200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48628/0 (socket says 172.21.15.45:48628) 2023-11-28T12:08:12.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.458+0000 7f3bf359b700 1 -- 172.21.15.45:0/3149574546 learned_addr learned my addr 172.21.15.45:0/3149574546 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:12.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.459+0000 7f3bf3d9c700 1 --2- 172.21.15.45:0/3149574546 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55844d1c1c00 0x55844d1c2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:12.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.459+0000 7f3bf2d9a700 1 --2- 172.21.15.45:0/3149574546 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55844d17c5b0 0x55844d245190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:12.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.459+0000 7f3bf359b700 1 -- 172.21.15.45:0/3149574546 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55844d1c1c00 msgr2=0x55844d1c2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:12.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.459+0000 7f3bf359b700 1 --2- 172.21.15.45:0/3149574546 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55844d1c1c00 0x55844d1c2310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:12.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.459+0000 7f3bf359b700 1 -- 172.21.15.45:0/3149574546 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55844d17c5b0 msgr2=0x55844d245190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:12.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.459+0000 7f3bf359b700 1 --2- 172.21.15.45:0/3149574546 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55844d17c5b0 0x55844d245190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:12.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.459+0000 7f3bf359b700 1 -- 172.21.15.45:0/3149574546 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3be4005de0 con 0x55844d17b510 2023-11-28T12:08:12.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.459+0000 7f3bf359b700 1 --2- 172.21.15.45:0/3149574546 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55844d17b510 0x55844d1c8200 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f3be400a4f0 tx=0x7f3be400d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d49d02ffcdf800a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:12.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.459+0000 7f3bf1d98700 1 -- 172.21.15.45:0/3149574546 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be4008ce0 con 0x55844d17b510 2023-11-28T12:08:12.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.459+0000 7f3bf1d98700 1 -- 172.21.15.45:0/3149574546 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3be4008e40 con 0x55844d17b510 2023-11-28T12:08:12.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.459+0000 7f3bf1d98700 1 -- 172.21.15.45:0/3149574546 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be401c670 con 0x55844d17b510 2023-11-28T12:08:12.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.460+0000 7f3c01fcc0c0 1 -- 172.21.15.45:0/3149574546 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55844d17b510 msgr2=0x55844d1c8200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:12.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.460+0000 7f3c01fcc0c0 1 --2- 172.21.15.45:0/3149574546 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55844d17b510 0x55844d1c8200 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f3be400a4f0 tx=0x7f3be400d000 comp rx=0 tx=0).stop 2023-11-28T12:08:12.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.460+0000 7f3c01fcc0c0 1 -- 172.21.15.45:0/3149574546 shutdown_connections 2023-11-28T12:08:12.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.460+0000 7f3c01fcc0c0 1 --2- 172.21.15.45:0/3149574546 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55844d1c1c00 0x55844d1c2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:12.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.460+0000 7f3c01fcc0c0 1 --2- 172.21.15.45:0/3149574546 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55844d17b510 0x55844d1c8200 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:12.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.460+0000 7f3c01fcc0c0 1 --2- 172.21.15.45:0/3149574546 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55844d17c5b0 0x55844d245190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:12.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.460+0000 7f3c01fcc0c0 1 -- 172.21.15.45:0/3149574546 >> 172.21.15.45:0/3149574546 conn(0x55844d1c8890 msgr2=0x55844d17e6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:12.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.460+0000 7f3c01fcc0c0 1 -- 172.21.15.45:0/3149574546 shutdown_connections 2023-11-28T12:08:12.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.460+0000 7f3c01fcc0c0 1 -- 172.21.15.45:0/3149574546 wait complete. 2023-11-28T12:08:12.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.461+0000 7f3c01fcc0c0 1 Processor -- start 2023-11-28T12:08:12.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.461+0000 7f3c01fcc0c0 1 -- start start 2023-11-28T12:08:12.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.462+0000 7f3c01fcc0c0 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55844d17b510 0x55844d2443f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:12.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.462+0000 7f3c01fcc0c0 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55844d17c5b0 0x55844d2439d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:12.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.462+0000 7f3c01fcc0c0 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55844d1c1c00 0x55844d1ae140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:12.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.462+0000 7f3c01fcc0c0 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55844d1adcb0 con 0x55844d17b510 2023-11-28T12:08:12.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.462+0000 7f3c01fcc0c0 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55844d243f10 con 0x55844d17c5b0 2023-11-28T12:08:12.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.462+0000 7f3c01fcc0c0 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x55844d1ad380 con 0x55844d1c1c00 2023-11-28T12:08:12.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.462+0000 7f3bf359b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55844d17b510 0x55844d2443f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:12.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.462+0000 7f3bf359b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55844d17b510 0x55844d2443f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48640/0 (socket says 172.21.15.45:48640) 2023-11-28T12:08:12.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.462+0000 7f3bf359b700 1 -- 172.21.15.45:0/2734875555 learned_addr learned my addr 172.21.15.45:0/2734875555 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:12.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.462+0000 7f3bf3d9c700 1 --2- 172.21.15.45:0/2734875555 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55844d1c1c00 0x55844d1ae140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:12.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.462+0000 7f3bf2d9a700 1 --2- 172.21.15.45:0/2734875555 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55844d17c5b0 0x55844d2439d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:12.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.462+0000 7f3bf359b700 1 -- 172.21.15.45:0/2734875555 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55844d1c1c00 msgr2=0x55844d1ae140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:12.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.462+0000 7f3bf359b700 1 --2- 172.21.15.45:0/2734875555 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55844d1c1c00 0x55844d1ae140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:12.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.462+0000 7f3bf359b700 1 -- 172.21.15.45:0/2734875555 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55844d17c5b0 msgr2=0x55844d2439d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:12.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.462+0000 7f3bf359b700 1 --2- 172.21.15.45:0/2734875555 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55844d17c5b0 0x55844d2439d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:12.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.462+0000 7f3bf359b700 1 -- 172.21.15.45:0/2734875555 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55844d0e94f0 con 0x55844d17b510 2023-11-28T12:08:12.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.463+0000 7f3bf359b700 1 --2- 172.21.15.45:0/2734875555 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55844d17b510 0x55844d2443f0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f3be4014040 tx=0x7f3be4003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:12.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.463+0000 7f3bf0d96700 1 -- 172.21.15.45:0/2734875555 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be401cdd0 con 0x55844d17b510 2023-11-28T12:08:12.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.463+0000 7f3bf0d96700 1 -- 172.21.15.45:0/2734875555 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3be402f420 con 0x55844d17b510 2023-11-28T12:08:12.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.463+0000 7f3bf0d96700 1 -- 172.21.15.45:0/2734875555 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be402f7d0 con 0x55844d17b510 2023-11-28T12:08:12.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.463+0000 7f3c01fcc0c0 1 -- 172.21.15.45:0/2734875555 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55844d0cf120 con 0x55844d17b510 2023-11-28T12:08:12.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.463+0000 7f3c01fcc0c0 1 -- 172.21.15.45:0/2734875555 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55844d0c2830 con 0x55844d17b510 2023-11-28T12:08:12.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.465+0000 7f3bf0d96700 1 -- 172.21.15.45:0/2734875555 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f3be4036070 con 0x55844d17b510 2023-11-28T12:08:12.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.466+0000 7f3bf0d96700 1 --2- 172.21.15.45:0/2734875555 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f3be0066c10 0x7f3be00690c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:12.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.466+0000 7f3bf0d96700 1 -- 172.21.15.45:0/2734875555 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3be4087920 con 0x55844d17b510 2023-11-28T12:08:12.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.466+0000 7f3bf2d9a700 1 --2- 172.21.15.45:0/2734875555 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f3be0066c10 0x7f3be00690c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:12.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.466+0000 7f3c01fcc0c0 1 --2- 172.21.15.45:0/2734875555 >> [v2:172.21.15.152:6824/116097,v1:172.21.15.152:6825/116097] conn(0x55844d247570 0x55844d2ea690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:12.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.466+0000 7f3c01fcc0c0 1 -- 172.21.15.45:0/2734875555 --> [v2:172.21.15.152:6824/116097,v1:172.21.15.152:6825/116097] -- osd_op(unknown.0.0:1 6.12 6:4bec3886:::10000000002.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55844d2eabd0 con 0x55844d247570 2023-11-28T12:08:12.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.467+0000 7f3bf3d9c700 1 --2- 172.21.15.45:0/2734875555 >> [v2:172.21.15.152:6824/116097,v1:172.21.15.152:6825/116097] conn(0x55844d247570 0x55844d2ea690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:12.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.467+0000 7f3bf2d9a700 1 --2- 172.21.15.45:0/2734875555 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f3be0066c10 0x7f3be00690c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x55844d2edb90 tx=0x7f3be8003630 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:12.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.467+0000 7f3bf3d9c700 1 --2- 172.21.15.45:0/2734875555 >> [v2:172.21.15.152:6824/116097,v1:172.21.15.152:6825/116097] conn(0x55844d247570 0x55844d2ea690 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:12.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.468+0000 7f3bf3d9c700 1 -- 172.21.15.45:0/2734875555 <== osd.7 v2:172.21.15.152:6824/116097 1 ==== osd_op_reply(1 10000000002.00000000 [getxattr] v0'0 uv0 ondisk = -61 ((61) No data available)) v8 ==== 164+0+0 (crc 0 0 0) 0x7f3bec00d6c0 con 0x55844d247570 2023-11-28T12:08:12.473 INFO:teuthology.orchestra.run.smithi045.stderr:error getting xattr cephfs_data/10000000002.00000000/scrub_tag: (61) No data available 2023-11-28T12:08:12.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.468+0000 7f3c01fcc0c0 1 -- 172.21.15.45:0/2734875555 >> [v2:172.21.15.152:6824/116097,v1:172.21.15.152:6825/116097] conn(0x55844d247570 msgr2=0x55844d2ea690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:12.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.468+0000 7f3c01fcc0c0 1 --2- 172.21.15.45:0/2734875555 >> [v2:172.21.15.152:6824/116097,v1:172.21.15.152:6825/116097] conn(0x55844d247570 0x55844d2ea690 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:12.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.468+0000 7f3c01fcc0c0 1 -- 172.21.15.45:0/2734875555 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f3be0066c10 msgr2=0x7f3be00690c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:12.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.468+0000 7f3c01fcc0c0 1 --2- 172.21.15.45:0/2734875555 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f3be0066c10 0x7f3be00690c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x55844d2edb90 tx=0x7f3be8003630 comp rx=0 tx=0).stop 2023-11-28T12:08:12.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.468+0000 7f3c01fcc0c0 1 -- 172.21.15.45:0/2734875555 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55844d17b510 msgr2=0x55844d2443f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:12.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.468+0000 7f3c01fcc0c0 1 --2- 172.21.15.45:0/2734875555 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55844d17b510 0x55844d2443f0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f3be4014040 tx=0x7f3be4003020 comp rx=0 tx=0).stop 2023-11-28T12:08:12.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.468+0000 7f3bf3d9c700 1 -- 172.21.15.45:0/2734875555 reap_dead start 2023-11-28T12:08:12.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.468+0000 7f3c01fcc0c0 1 -- 172.21.15.45:0/2734875555 shutdown_connections 2023-11-28T12:08:12.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.468+0000 7f3c01fcc0c0 1 -- 172.21.15.45:0/2734875555 >> 172.21.15.45:0/2734875555 conn(0x55844d1c8890 msgr2=0x55844d1a7fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:12.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.468+0000 7f3c01fcc0c0 1 -- 172.21.15.45:0/2734875555 shutdown_connections 2023-11-28T12:08:12.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:12.468+0000 7f3c01fcc0c0 1 -- 172.21.15.45:0/2734875555 wait complete. 2023-11-28T12:08:12.474 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T12:08:12.475 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-28T12:08:12.475 DEBUG:teuthology.orchestra.run.smithi045:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T12:08:12.564 DEBUG:teuthology.orchestra.run.smithi152:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T12:08:12.677 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-28T12:08:12.677 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T12:08:12.677 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T12:08:12.725 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16351388k,nr_inodes=4087847,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=41,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3276240k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-11-28T12:08:12.725 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-11-28T12:08:12.725 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T12:08:12.773 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16348296k,nr_inodes=4087074,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=41,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275620k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-11-28T12:08:12.774 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T12:08:12.774 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T12:08:12.820 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16351388k,nr_inodes=4087847,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=41,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3276240k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-11-28T12:08:12.820 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-11-28T12:08:12.821 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T12:08:12.867 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16348296k,nr_inodes=4087074,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=41,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275620k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-11-28T12:08:12.867 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T12:08:13.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.070+0000 7f39e47ff700 1 Processor -- start 2023-11-28T12:08:13.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.070+0000 7f39e47ff700 1 -- start start 2023-11-28T12:08:13.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.072+0000 7f39e47ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f39dc15c9b0 0x7f39dc0b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:13.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.072+0000 7f39e47ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f39dc161340 0x7f39dc0d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:13.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.072+0000 7f39e47ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39dc0d1950 con 0x7f39dc0d2320 2023-11-28T12:08:13.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.072+0000 7f39e47ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39dc0b5800 con 0x7f39dc15c9b0 2023-11-28T12:08:13.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.072+0000 7f39e47ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39dc0b5520 con 0x7f39dc161340 2023-11-28T12:08:13.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.072+0000 7f39e2d9c700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f39dc0d2320 0x7f39dc0cd7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44270/0 (socket says 172.21.15.45:44270) 2023-11-28T12:08:13.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.072+0000 7f39e2d9c700 1 -- 172.21.15.45:0/4200672410 learned_addr learned my addr 172.21.15.45:0/4200672410 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:08:13.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.072+0000 7f39e259b700 1 --2- 172.21.15.45:0/4200672410 >> v2:172.21.15.152:3300/0 conn(0x7f39dc15c9b0 0x7f39dc0b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:13.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.072+0000 7f39e1d9a700 1 --2- 172.21.15.45:0/4200672410 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f39dc161340 0x7f39dc0d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:13.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.072+0000 7f39e1599700 1 -- 172.21.15.45:0/4200672410 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1972712437 0 0) 0x7f39dc0d1950 con 0x7f39dc0d2320 2023-11-28T12:08:13.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.072+0000 7f39e1599700 1 -- 172.21.15.45:0/4200672410 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39c80035b0 con 0x7f39dc0d2320 2023-11-28T12:08:13.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.072+0000 7f39e259b700 1 -- 172.21.15.45:0/4200672410 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f39dc161340 msgr2=0x7f39dc0d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:13.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.072+0000 7f39e259b700 1 --2- 172.21.15.45:0/4200672410 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f39dc161340 0x7f39dc0d1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:13.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.072+0000 7f39e259b700 1 -- 172.21.15.45:0/4200672410 >> v1:172.21.15.45:6789/0 conn(0x7f39dc0d2320 legacy=0x7f39dc0cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:13.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.072+0000 7f39e259b700 1 -- 172.21.15.45:0/4200672410 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39dc0d1300 con 0x7f39dc15c9b0 2023-11-28T12:08:13.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.072+0000 7f39e1d9a700 1 --2- 172.21.15.45:0/4200672410 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f39dc161340 0x7f39dc0d1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:08:13.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.073+0000 7f39e259b700 1 --2- 172.21.15.45:0/4200672410 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f39dc15c9b0 0x7f39dc0b4bf0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f39d8009840 tx=0x7f39d8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a1c8257a2f21878 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:13.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.073+0000 7f39e1599700 1 -- 172.21.15.45:0/4200672410 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d8011830 con 0x7f39dc15c9b0 2023-11-28T12:08:13.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.073+0000 7f39e1599700 1 -- 172.21.15.45:0/4200672410 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39d8011990 con 0x7f39dc15c9b0 2023-11-28T12:08:13.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.073+0000 7f39e1599700 1 -- 172.21.15.45:0/4200672410 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d8011d20 con 0x7f39dc15c9b0 2023-11-28T12:08:13.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.073+0000 7f39e47ff700 1 -- 172.21.15.45:0/4200672410 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f39dc15c9b0 msgr2=0x7f39dc0b4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:13.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.073+0000 7f39e47ff700 1 --2- 172.21.15.45:0/4200672410 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f39dc15c9b0 0x7f39dc0b4bf0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f39d8009840 tx=0x7f39d8009b50 comp rx=0 tx=0).stop 2023-11-28T12:08:13.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.074+0000 7f39e47ff700 1 -- 172.21.15.45:0/4200672410 shutdown_connections 2023-11-28T12:08:13.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.074+0000 7f39e47ff700 1 --2- 172.21.15.45:0/4200672410 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f39dc15c9b0 0x7f39dc0b4bf0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:13.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.074+0000 7f39e47ff700 1 --2- 172.21.15.45:0/4200672410 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f39dc161340 0x7f39dc0d1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:13.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.074+0000 7f39e47ff700 1 -- 172.21.15.45:0/4200672410 >> 172.21.15.45:0/4200672410 conn(0x7f39dc072600 msgr2=0x7f39dc0cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:13.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.074+0000 7f39e47ff700 1 -- 172.21.15.45:0/4200672410 shutdown_connections 2023-11-28T12:08:13.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.074+0000 7f39e47ff700 1 -- 172.21.15.45:0/4200672410 wait complete. 2023-11-28T12:08:13.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.075+0000 7f39e47ff700 1 Processor -- start 2023-11-28T12:08:13.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.075+0000 7f39e47ff700 1 -- start start 2023-11-28T12:08:13.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.076+0000 7f39e47ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39dc0d2320 0x7f39dc0c5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:13.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.076+0000 7f39e47ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f39dc15c9b0 0x7f39dc159900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:13.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.076+0000 7f39e47ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f39dc161340 0x7f39dc159e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:13.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.076+0000 7f39e47ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39dc156410 con 0x7f39dc0d2320 2023-11-28T12:08:13.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.076+0000 7f39e47ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39dc0c6410 con 0x7f39dc161340 2023-11-28T12:08:13.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.076+0000 7f39e47ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39dc155800 con 0x7f39dc15c9b0 2023-11-28T12:08:13.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.077+0000 7f39e259b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39dc0d2320 0x7f39dc0c5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:13.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.077+0000 7f39e259b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39dc0d2320 0x7f39dc0c5ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48644/0 (socket says 172.21.15.45:48644) 2023-11-28T12:08:13.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.077+0000 7f39e259b700 1 -- 172.21.15.45:0/3279252101 learned_addr learned my addr 172.21.15.45:0/3279252101 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:13.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.077+0000 7f39e1d9a700 1 --2- 172.21.15.45:0/3279252101 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f39dc15c9b0 0x7f39dc159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:13.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.077+0000 7f39e2d9c700 1 --2- 172.21.15.45:0/3279252101 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f39dc161340 0x7f39dc159e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:13.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.077+0000 7f39e259b700 1 -- 172.21.15.45:0/3279252101 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f39dc15c9b0 msgr2=0x7f39dc159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:13.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.077+0000 7f39e259b700 1 --2- 172.21.15.45:0/3279252101 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f39dc15c9b0 0x7f39dc159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:13.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.077+0000 7f39e259b700 1 -- 172.21.15.45:0/3279252101 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f39dc161340 msgr2=0x7f39dc159e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:13.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.077+0000 7f39e259b700 1 --2- 172.21.15.45:0/3279252101 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f39dc161340 0x7f39dc159e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:13.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.077+0000 7f39e259b700 1 -- 172.21.15.45:0/3279252101 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39cc0094a0 con 0x7f39dc0d2320 2023-11-28T12:08:13.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.077+0000 7f39e259b700 1 --2- 172.21.15.45:0/3279252101 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39dc0d2320 0x7f39dc0c5ed0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f39d80090b0 tx=0x7f39d8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:13.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.078+0000 7f39d2ffd700 1 -- 172.21.15.45:0/3279252101 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d8004590 con 0x7f39dc0d2320 2023-11-28T12:08:13.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.078+0000 7f39d2ffd700 1 -- 172.21.15.45:0/3279252101 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39d801f070 con 0x7f39dc0d2320 2023-11-28T12:08:13.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.078+0000 7f39d2ffd700 1 -- 172.21.15.45:0/3279252101 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d80038e0 con 0x7f39dc0d2320 2023-11-28T12:08:13.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.078+0000 7f39e47ff700 1 -- 172.21.15.45:0/3279252101 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39d80094a0 con 0x7f39dc0d2320 2023-11-28T12:08:13.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.078+0000 7f39e47ff700 1 -- 172.21.15.45:0/3279252101 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39dc0b5130 con 0x7f39dc0d2320 2023-11-28T12:08:13.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.079+0000 7f39e47ff700 1 -- 172.21.15.45:0/3279252101 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39dc0d15e0 con 0x7f39dc0d2320 2023-11-28T12:08:13.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.080+0000 7f39d2ffd700 1 -- 172.21.15.45:0/3279252101 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f39d800f050 con 0x7f39dc0d2320 2023-11-28T12:08:13.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.080+0000 7f39d2ffd700 1 --2- 172.21.15.45:0/3279252101 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f39c00682f0 0x7f39c006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:13.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.081+0000 7f39d2ffd700 1 -- 172.21.15.45:0/3279252101 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f39d8021070 con 0x7f39dc0d2320 2023-11-28T12:08:13.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.081+0000 7f39e1d9a700 1 --2- 172.21.15.45:0/3279252101 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f39c00682f0 0x7f39c006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:13.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.081+0000 7f39e1d9a700 1 --2- 172.21.15.45:0/3279252101 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f39c00682f0 0x7f39c006a7a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f39dc157cd0 tx=0x7f39cc009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:13.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.085+0000 7f39d2ffd700 1 -- 172.21.15.45:0/3279252101 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f39d8053c60 con 0x7f39dc0d2320 2023-11-28T12:08:13.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.332+0000 7f39e47ff700 1 -- 172.21.15.45:0/3279252101 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f39dc0b52c0 con 0x7f39dc0d2320 2023-11-28T12:08:13.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.333+0000 7f39d2ffd700 1 -- 172.21.15.45:0/3279252101 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4654 (secure 0 0 0) 0x7f39d8057280 con 0x7f39dc0d2320 2023-11-28T12:08:13.335 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:08:13.335 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4805,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1232749056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1232749056},{"type":"v1","addr":"172.21.15.152:6837","nonce":1232749056}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4996,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/1358094304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":1358094304},{"type":"v1","addr":"172.21.15.45:6835","nonce":1358094304}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4999,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6836/2035520444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6835","nonce":2035520444},{"type":"v1","addr":"172.21.15.152:6836","nonce":2035520444}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T12:07:41.650740+0000","modified":"2023-11-28T12:07:44.849447+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5061},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5061":{"gid":5061,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.45:6834/2964277738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2964277738},{"type":"v1","addr":"172.21.15.45:6834","nonce":2964277738}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-28T12:08:13.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.335+0000 7f39e47ff700 1 -- 172.21.15.45:0/3279252101 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f39c00682f0 msgr2=0x7f39c006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:13.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.335+0000 7f39e47ff700 1 --2- 172.21.15.45:0/3279252101 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f39c00682f0 0x7f39c006a7a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f39dc157cd0 tx=0x7f39cc009210 comp rx=0 tx=0).stop 2023-11-28T12:08:13.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.335+0000 7f39e47ff700 1 -- 172.21.15.45:0/3279252101 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39dc0d2320 msgr2=0x7f39dc0c5ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:13.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.335+0000 7f39e47ff700 1 --2- 172.21.15.45:0/3279252101 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39dc0d2320 0x7f39dc0c5ed0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f39d80090b0 tx=0x7f39d8004750 comp rx=0 tx=0).stop 2023-11-28T12:08:13.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.336+0000 7f39e47ff700 1 -- 172.21.15.45:0/3279252101 shutdown_connections 2023-11-28T12:08:13.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.336+0000 7f39e47ff700 1 --2- 172.21.15.45:0/3279252101 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f39c00682f0 0x7f39c006a7a0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:13.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.336+0000 7f39e47ff700 1 --2- 172.21.15.45:0/3279252101 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f39dc161340 0x7f39dc159e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:13.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.336+0000 7f39e47ff700 1 --2- 172.21.15.45:0/3279252101 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39dc0d2320 0x7f39dc0c5ed0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:13.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.336+0000 7f39e47ff700 1 --2- 172.21.15.45:0/3279252101 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f39dc15c9b0 0x7f39dc159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:13.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.336+0000 7f39e47ff700 1 -- 172.21.15.45:0/3279252101 >> 172.21.15.45:0/3279252101 conn(0x7f39dc072600 msgr2=0x7f39dc06b210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:13.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.336+0000 7f39e47ff700 1 -- 172.21.15.45:0/3279252101 shutdown_connections 2023-11-28T12:08:13.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.336+0000 7f39e47ff700 1 -- 172.21.15.45:0/3279252101 wait complete. 2023-11-28T12:08:13.339 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 16 2023-11-28T12:08:13.356 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T12:08:13.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.558+0000 7fabd2fff700 1 Processor -- start 2023-11-28T12:08:13.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.558+0000 7fabd2fff700 1 -- start start 2023-11-28T12:08:13.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.559+0000 7fabd2fff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fabcc15c9b0 0x7fabcc0b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:13.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.559+0000 7fabd2fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fabcc161340 0x7fabcc0d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:13.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.559+0000 7fabd2fff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fabcc0d2320 0x7fabcc0cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:13.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.559+0000 7fabd2fff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabcc0b5800 con 0x7fabcc161340 2023-11-28T12:08:13.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.559+0000 7fabd2fff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabcc0d1950 con 0x7fabcc0d2320 2023-11-28T12:08:13.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.559+0000 7fabd2fff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabcc0b5520 con 0x7fabcc15c9b0 2023-11-28T12:08:13.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.560+0000 7fabcbfff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fabcc161340 0x7fabcc0d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:13.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.560+0000 7fabcbfff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fabcc161340 0x7fabcc0d1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48656/0 (socket says 172.21.15.45:48656) 2023-11-28T12:08:13.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.560+0000 7fabcbfff700 1 -- 172.21.15.45:0/536852923 learned_addr learned my addr 172.21.15.45:0/536852923 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:13.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.560+0000 7fabd159c700 1 --2- 172.21.15.45:0/536852923 >> v2:172.21.15.152:3300/0 conn(0x7fabcc0d2320 0x7fabcc0cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:13.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.560+0000 7fabd0d9b700 1 --2- 172.21.15.45:0/536852923 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fabcc15c9b0 0x7fabcc0b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:13.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.560+0000 7fabcbfff700 1 -- 172.21.15.45:0/536852923 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fabcc15c9b0 msgr2=0x7fabcc0b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:13.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.560+0000 7fabcbfff700 1 --2- 172.21.15.45:0/536852923 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fabcc15c9b0 0x7fabcc0b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:13.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.560+0000 7fabcbfff700 1 -- 172.21.15.45:0/536852923 >> v2:172.21.15.152:3300/0 conn(0x7fabcc0d2320 msgr2=0x7fabcc0cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:13.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.560+0000 7fabcbfff700 1 --2- 172.21.15.45:0/536852923 >> v2:172.21.15.152:3300/0 conn(0x7fabcc0d2320 0x7fabcc0cd7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:13.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.560+0000 7fabcbfff700 1 -- 172.21.15.45:0/536852923 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabcc0d1300 con 0x7fabcc161340 2023-11-28T12:08:13.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.560+0000 7fabcbfff700 1 --2- 172.21.15.45:0/536852923 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fabcc161340 0x7fabcc0d1de0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fabcc08c4d0 tx=0x7fabb8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=428d628a964ca666 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:13.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.561+0000 7fabcb7fe700 1 -- 172.21.15.45:0/536852923 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb8011830 con 0x7fabcc161340 2023-11-28T12:08:13.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.561+0000 7fabcb7fe700 1 -- 172.21.15.45:0/536852923 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabb8011990 con 0x7fabcc161340 2023-11-28T12:08:13.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.561+0000 7fabcb7fe700 1 -- 172.21.15.45:0/536852923 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb8011d20 con 0x7fabcc161340 2023-11-28T12:08:13.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.561+0000 7fabd2fff700 1 -- 172.21.15.45:0/536852923 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fabcc161340 msgr2=0x7fabcc0d1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:13.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.561+0000 7fabd2fff700 1 --2- 172.21.15.45:0/536852923 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fabcc161340 0x7fabcc0d1de0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fabcc08c4d0 tx=0x7fabb8009bd0 comp rx=0 tx=0).stop 2023-11-28T12:08:13.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.561+0000 7fabd2fff700 1 -- 172.21.15.45:0/536852923 shutdown_connections 2023-11-28T12:08:13.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.561+0000 7fabd2fff700 1 --2- 172.21.15.45:0/536852923 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fabcc15c9b0 0x7fabcc0b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:13.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.561+0000 7fabd2fff700 1 --2- 172.21.15.45:0/536852923 >> v2:172.21.15.152:3300/0 conn(0x7fabcc0d2320 0x7fabcc0cd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:13.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.561+0000 7fabd2fff700 1 --2- 172.21.15.45:0/536852923 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fabcc161340 0x7fabcc0d1de0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:13.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.561+0000 7fabd2fff700 1 -- 172.21.15.45:0/536852923 >> 172.21.15.45:0/536852923 conn(0x7fabcc072600 msgr2=0x7fabcc0cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:13.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.561+0000 7fabd2fff700 1 -- 172.21.15.45:0/536852923 shutdown_connections 2023-11-28T12:08:13.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.561+0000 7fabd2fff700 1 -- 172.21.15.45:0/536852923 wait complete. 2023-11-28T12:08:13.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.563+0000 7fabd2fff700 1 Processor -- start 2023-11-28T12:08:13.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.563+0000 7fabd2fff700 1 -- start start 2023-11-28T12:08:13.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.564+0000 7fabd2fff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fabcc0d2320 0x7fabcc1f6d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:13.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.564+0000 7fabd2fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fabcc15c9b0 0x7fabcc156240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:13.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.564+0000 7fabd2fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fabcc161340 0x7fabcc1543f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:13.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.564+0000 7fabd2fff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabcc154930 con 0x7fabcc15c9b0 2023-11-28T12:08:13.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.564+0000 7fabd2fff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabcc1f6900 con 0x7fabcc161340 2023-11-28T12:08:13.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.564+0000 7fabd2fff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabcc156940 con 0x7fabcc0d2320 2023-11-28T12:08:13.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.564+0000 7fabcbfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fabcc15c9b0 0x7fabcc156240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:13.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.564+0000 7fabcbfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fabcc15c9b0 0x7fabcc156240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48660/0 (socket says 172.21.15.45:48660) 2023-11-28T12:08:13.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.564+0000 7fabcbfff700 1 -- 172.21.15.45:0/2740803009 learned_addr learned my addr 172.21.15.45:0/2740803009 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:13.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.565+0000 7fabd0d9b700 1 --2- 172.21.15.45:0/2740803009 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fabcc0d2320 0x7fabcc1f6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:13.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.565+0000 7fabd159c700 1 --2- 172.21.15.45:0/2740803009 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fabcc161340 0x7fabcc1543f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:13.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.565+0000 7fabcbfff700 1 -- 172.21.15.45:0/2740803009 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fabcc0d2320 msgr2=0x7fabcc1f6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:13.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.565+0000 7fabcbfff700 1 --2- 172.21.15.45:0/2740803009 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fabcc0d2320 0x7fabcc1f6d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:13.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.565+0000 7fabcbfff700 1 -- 172.21.15.45:0/2740803009 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fabcc161340 msgr2=0x7fabcc1543f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:13.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.565+0000 7fabcbfff700 1 --2- 172.21.15.45:0/2740803009 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fabcc161340 0x7fabcc1543f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:13.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.565+0000 7fabcbfff700 1 -- 172.21.15.45:0/2740803009 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabb8009550 con 0x7fabcc15c9b0 2023-11-28T12:08:13.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.565+0000 7fabcbfff700 1 --2- 172.21.15.45:0/2740803009 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fabcc15c9b0 0x7fabcc156240 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fabb8000c00 tx=0x7fabb8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:13.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.565+0000 7fabc97fa700 1 -- 172.21.15.45:0/2740803009 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb8004240 con 0x7fabcc15c9b0 2023-11-28T12:08:13.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.565+0000 7fabc97fa700 1 -- 172.21.15.45:0/2740803009 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabb801f070 con 0x7fabcc15c9b0 2023-11-28T12:08:13.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.565+0000 7fabd2fff700 1 -- 172.21.15.45:0/2740803009 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabcc0b5130 con 0x7fabcc15c9b0 2023-11-28T12:08:13.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.565+0000 7fabc97fa700 1 -- 172.21.15.45:0/2740803009 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb80036a0 con 0x7fabcc15c9b0 2023-11-28T12:08:13.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.566+0000 7fabd2fff700 1 -- 172.21.15.45:0/2740803009 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabcc0d15e0 con 0x7fabcc15c9b0 2023-11-28T12:08:13.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.567+0000 7fabd2fff700 1 -- 172.21.15.45:0/2740803009 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabcc0b52c0 con 0x7fabcc15c9b0 2023-11-28T12:08:13.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.567+0000 7fabc97fa700 1 -- 172.21.15.45:0/2740803009 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fabb802a020 con 0x7fabcc15c9b0 2023-11-28T12:08:13.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.569+0000 7fabc97fa700 1 --2- 172.21.15.45:0/2740803009 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fabb00682f0 0x7fabb006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:13.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.569+0000 7fabc97fa700 1 -- 172.21.15.45:0/2740803009 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fabb8086fe0 con 0x7fabcc15c9b0 2023-11-28T12:08:13.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.569+0000 7fabd0d9b700 1 --2- 172.21.15.45:0/2740803009 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fabb00682f0 0x7fabb006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:13.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.570+0000 7fabd0d9b700 1 --2- 172.21.15.45:0/2740803009 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fabb00682f0 0x7fabb006a7a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fabc0009ac0 tx=0x7fabc0009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:13.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.572+0000 7fabc97fa700 1 -- 172.21.15.45:0/2740803009 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fabb80b85e0 con 0x7fabcc15c9b0 2023-11-28T12:08:13.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.778+0000 7fabd2fff700 1 -- 172.21.15.45:0/2740803009 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fabcc0745c0 con 0x7fabcc15c9b0 2023-11-28T12:08:13.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.779+0000 7fabc97fa700 1 -- 172.21.15.45:0/2740803009 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+17921 (secure 0 0 0) 0x7fabb8015020 con 0x7fabcc15c9b0 2023-11-28T12:08:13.781 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:08:13.781 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":34,"fsid":"bd7c37f1-f7c6-4778-b845-52cf2aa6e366","created":"2023-11-28T12:06:09.045075+0000","modified":"2023-11-28T12:07:42.653488+0000","last_up_change":"2023-11-28T12:06:21.282227+0000","last_in_change":"2023-11-28T12:06:12.560924+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T12:06:21.807108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T12:06:22.491009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-28T12:07:39.383009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-28T12:07:40.658112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d0cdd8a-87fd-4f2c-91bd-47bdfa661905","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":115843},{"type":"v1","addr":"172.21.15.45:6808","nonce":115843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":115843},{"type":"v1","addr":"172.21.15.45:6811","nonce":115843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":115843},{"type":"v1","addr":"172.21.15.45:6815","nonce":115843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":115843},{"type":"v1","addr":"172.21.15.45:6813","nonce":115843}]},"public_addr":"172.21.15.45:6808/115843","cluster_addr":"172.21.15.45:6811/115843","heartbeat_back_addr":"172.21.15.45:6815/115843","heartbeat_front_addr":"172.21.15.45:6813/115843","state":["exists","up"]},{"osd":1,"uuid":"c5de4ebd-9ec5-40b3-9caa-9b706fab4c76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":115842},{"type":"v1","addr":"172.21.15.45:6801","nonce":115842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":115842},{"type":"v1","addr":"172.21.15.45:6803","nonce":115842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6807","nonce":115842},{"type":"v1","addr":"172.21.15.45:6809","nonce":115842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":115842},{"type":"v1","addr":"172.21.15.45:6805","nonce":115842}]},"public_addr":"172.21.15.45:6801/115842","cluster_addr":"172.21.15.45:6803/115842","heartbeat_back_addr":"172.21.15.45:6809/115842","heartbeat_front_addr":"172.21.15.45:6805/115842","state":["exists","up"]},{"osd":2,"uuid":"9f4b36b2-65d2-40e7-9fe6-a2991afa71c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":115850},{"type":"v1","addr":"172.21.15.45:6819","nonce":115850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":115850},{"type":"v1","addr":"172.21.15.45:6823","nonce":115850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":115850},{"type":"v1","addr":"172.21.15.45:6831","nonce":115850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":115850},{"type":"v1","addr":"172.21.15.45:6828","nonce":115850}]},"public_addr":"172.21.15.45:6819/115850","cluster_addr":"172.21.15.45:6823/115850","heartbeat_back_addr":"172.21.15.45:6831/115850","heartbeat_front_addr":"172.21.15.45:6828/115850","state":["exists","up"]},{"osd":3,"uuid":"6fe7ef05-4e0d-426c-bf94-44b51d4d550b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":115848},{"type":"v1","addr":"172.21.15.45:6818","nonce":115848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":115848},{"type":"v1","addr":"172.21.15.45:6822","nonce":115848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6827","nonce":115848},{"type":"v1","addr":"172.21.15.45:6829","nonce":115848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":115848},{"type":"v1","addr":"172.21.15.45:6825","nonce":115848}]},"public_addr":"172.21.15.45:6818/115848","cluster_addr":"172.21.15.45:6822/115848","heartbeat_back_addr":"172.21.15.45:6829/115848","heartbeat_front_addr":"172.21.15.45:6825/115848","state":["exists","up"]},{"osd":4,"uuid":"fa403c08-d8a1-4a3a-8384-cb465c1a654c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":116092},{"type":"v1","addr":"172.21.15.152:6801","nonce":116092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":116092},{"type":"v1","addr":"172.21.15.152:6803","nonce":116092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":116092},{"type":"v1","addr":"172.21.15.152:6807","nonce":116092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":116092},{"type":"v1","addr":"172.21.15.152:6805","nonce":116092}]},"public_addr":"172.21.15.152:6801/116092","cluster_addr":"172.21.15.152:6803/116092","heartbeat_back_addr":"172.21.15.152:6807/116092","heartbeat_front_addr":"172.21.15.152:6805/116092","state":["exists","up"]},{"osd":5,"uuid":"399fc450-39fa-43a6-bf80-0b8bcb41bd95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6815","nonce":116093},{"type":"v1","addr":"172.21.15.152:6817","nonce":116093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":116093},{"type":"v1","addr":"172.21.15.152:6819","nonce":116093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":116093},{"type":"v1","addr":"172.21.15.152:6823","nonce":116093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":116093},{"type":"v1","addr":"172.21.15.152:6821","nonce":116093}]},"public_addr":"172.21.15.152:6817/116093","cluster_addr":"172.21.15.152:6819/116093","heartbeat_back_addr":"172.21.15.152:6823/116093","heartbeat_front_addr":"172.21.15.152:6821/116093","state":["exists","up"]},{"osd":6,"uuid":"e59a4017-2d23-4627-836b-e25b2d3ddaaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":116094},{"type":"v1","addr":"172.21.15.152:6809","nonce":116094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":116094},{"type":"v1","addr":"172.21.15.152:6811","nonce":116094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":116094},{"type":"v1","addr":"172.21.15.152:6816","nonce":116094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":116094},{"type":"v1","addr":"172.21.15.152:6813","nonce":116094}]},"public_addr":"172.21.15.152:6809/116094","cluster_addr":"172.21.15.152:6811/116094","heartbeat_back_addr":"172.21.15.152:6816/116094","heartbeat_front_addr":"172.21.15.152:6813/116094","state":["exists","up"]},{"osd":7,"uuid":"8d7f9d4b-bf08-4670-8591-388c0f012a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":116097},{"type":"v1","addr":"172.21.15.152:6825","nonce":116097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":116097},{"type":"v1","addr":"172.21.15.152:6827","nonce":116097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":116097},{"type":"v1","addr":"172.21.15.152:6831","nonce":116097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":116097},{"type":"v1","addr":"172.21.15.152:6829","nonce":116097}]},"public_addr":"172.21.15.152:6825/116097","cluster_addr":"172.21.15.152:6827/116097","heartbeat_back_addr":"172.21.15.152:6831/116097","heartbeat_front_addr":"172.21.15.152:6829/116097","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.937710+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.865423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.159434+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.913090+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.131647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.966255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.972583+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.177209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T12:08:13.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.781+0000 7fabd2fff700 1 -- 172.21.15.45:0/2740803009 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fabb00682f0 msgr2=0x7fabb006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:13.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.781+0000 7fabd2fff700 1 --2- 172.21.15.45:0/2740803009 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fabb00682f0 0x7fabb006a7a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fabc0009ac0 tx=0x7fabc0009210 comp rx=0 tx=0).stop 2023-11-28T12:08:13.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.781+0000 7fabd2fff700 1 -- 172.21.15.45:0/2740803009 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fabcc15c9b0 msgr2=0x7fabcc156240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:13.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.781+0000 7fabd2fff700 1 --2- 172.21.15.45:0/2740803009 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fabcc15c9b0 0x7fabcc156240 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fabb8000c00 tx=0x7fabb8004750 comp rx=0 tx=0).stop 2023-11-28T12:08:13.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.781+0000 7fabd2fff700 1 -- 172.21.15.45:0/2740803009 shutdown_connections 2023-11-28T12:08:13.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.781+0000 7fabd2fff700 1 --2- 172.21.15.45:0/2740803009 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fabb00682f0 0x7fabb006a7a0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:13.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.781+0000 7fabd2fff700 1 --2- 172.21.15.45:0/2740803009 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fabcc161340 0x7fabcc1543f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:13.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.781+0000 7fabd2fff700 1 --2- 172.21.15.45:0/2740803009 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fabcc0d2320 0x7fabcc1f6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:13.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.781+0000 7fabd2fff700 1 --2- 172.21.15.45:0/2740803009 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fabcc15c9b0 0x7fabcc156240 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:13.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.781+0000 7fabd2fff700 1 -- 172.21.15.45:0/2740803009 >> 172.21.15.45:0/2740803009 conn(0x7fabcc072600 msgr2=0x7fabcc06a900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:13.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.781+0000 7fabd2fff700 1 -- 172.21.15.45:0/2740803009 shutdown_connections 2023-11-28T12:08:13.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:13.781+0000 7fabd2fff700 1 -- 172.21.15.45:0/2740803009 wait complete. 2023-11-28T12:08:13.801 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-28T12:06:21.807108+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-28T12:06:22.491009+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T12:07:39.383009+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T12:07:40.658112+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T12:08:13.802 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T12:08:14.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.007+0000 7f0d963ff700 1 Processor -- start 2023-11-28T12:08:14.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.007+0000 7f0d963ff700 1 -- start start 2023-11-28T12:08:14.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.008+0000 7f0d963ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f0d9015c9b0 0x7f0d900b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:14.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.008+0000 7f0d963ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0d900cd7c0 0x7f0d900cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:14.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.008+0000 7f0d963ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d900d1950 con 0x7f0d90161340 2023-11-28T12:08:14.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.008+0000 7f0d963ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d900b5800 con 0x7f0d9015c9b0 2023-11-28T12:08:14.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.008+0000 7f0d963ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d900ce140 con 0x7f0d900cd7c0 2023-11-28T12:08:14.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.009+0000 7f0d8f7fe700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f0d90161340 0x7f0d900d1de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44284/0 (socket says 172.21.15.45:44284) 2023-11-28T12:08:14.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.009+0000 7f0d8f7fe700 1 -- 172.21.15.45:0/586257746 learned_addr learned my addr 172.21.15.45:0/586257746 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:08:14.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.009+0000 7f0d9499c700 1 --2- 172.21.15.45:0/586257746 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0d900cd7c0 0x7f0d900cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:14.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.009+0000 7f0d8ffff700 1 --2- 172.21.15.45:0/586257746 >> v2:172.21.15.152:3300/0 conn(0x7f0d9015c9b0 0x7f0d900b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:14.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.009+0000 7f0d8effd700 1 -- 172.21.15.45:0/586257746 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3027969109 0 0) 0x7f0d900d1950 con 0x7f0d90161340 2023-11-28T12:08:14.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.009+0000 7f0d8effd700 1 -- 172.21.15.45:0/586257746 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d780035b0 con 0x7f0d90161340 2023-11-28T12:08:14.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.009+0000 7f0d9499c700 1 -- 172.21.15.45:0/586257746 >> v2:172.21.15.152:3300/0 conn(0x7f0d9015c9b0 msgr2=0x7f0d900b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:14.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.009+0000 7f0d9499c700 1 --2- 172.21.15.45:0/586257746 >> v2:172.21.15.152:3300/0 conn(0x7f0d9015c9b0 0x7f0d900b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:14.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.009+0000 7f0d9499c700 1 -- 172.21.15.45:0/586257746 >> v1:172.21.15.45:6789/0 conn(0x7f0d90161340 legacy=0x7f0d900d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:14.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.009+0000 7f0d9499c700 1 -- 172.21.15.45:0/586257746 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d900d24f0 con 0x7f0d900cd7c0 2023-11-28T12:08:14.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.010+0000 7f0d9499c700 1 --2- 172.21.15.45:0/586257746 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0d900cd7c0 0x7f0d900cdc00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0d88009d90 tx=0x7f0d8800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=689fc1e7fe6978a0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:14.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.010+0000 7f0d8effd700 1 -- 172.21.15.45:0/586257746 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d8800e070 con 0x7f0d900cd7c0 2023-11-28T12:08:14.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.010+0000 7f0d8effd700 1 -- 172.21.15.45:0/586257746 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d8800bb20 con 0x7f0d900cd7c0 2023-11-28T12:08:14.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.010+0000 7f0d8effd700 1 -- 172.21.15.45:0/586257746 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d88012430 con 0x7f0d900cd7c0 2023-11-28T12:08:14.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.010+0000 7f0d963ff700 1 -- 172.21.15.45:0/586257746 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0d900cd7c0 msgr2=0x7f0d900cdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:14.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.010+0000 7f0d963ff700 1 --2- 172.21.15.45:0/586257746 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0d900cd7c0 0x7f0d900cdc00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0d88009d90 tx=0x7f0d8800b330 comp rx=0 tx=0).stop 2023-11-28T12:08:14.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.011+0000 7f0d963ff700 1 -- 172.21.15.45:0/586257746 shutdown_connections 2023-11-28T12:08:14.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.011+0000 7f0d963ff700 1 --2- 172.21.15.45:0/586257746 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0d900cd7c0 0x7f0d900cdc00 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:14.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.011+0000 7f0d963ff700 1 --2- 172.21.15.45:0/586257746 >> v2:172.21.15.152:3300/0 conn(0x7f0d9015c9b0 0x7f0d900b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:14.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.011+0000 7f0d963ff700 1 -- 172.21.15.45:0/586257746 >> 172.21.15.45:0/586257746 conn(0x7f0d90072600 msgr2=0x7f0d900cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:14.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.011+0000 7f0d963ff700 1 -- 172.21.15.45:0/586257746 shutdown_connections 2023-11-28T12:08:14.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.011+0000 7f0d963ff700 1 -- 172.21.15.45:0/586257746 wait complete. 2023-11-28T12:08:14.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.012+0000 7f0d963ff700 1 Processor -- start 2023-11-28T12:08:14.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.013+0000 7f0d963ff700 1 -- start start 2023-11-28T12:08:14.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.013+0000 7f0d963ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d900cd7c0 0x7f0d901f36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:14.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.014+0000 7f0d963ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d9015c9b0 0x7f0d901576c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:14.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.014+0000 7f0d963ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0d90161340 0x7f0d9006abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:14.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.014+0000 7f0d963ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d90157c00 con 0x7f0d900cd7c0 2023-11-28T12:08:14.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.014+0000 7f0d963ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d900c7ab0 con 0x7f0d9015c9b0 2023-11-28T12:08:14.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.014+0000 7f0d963ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d900c7d90 con 0x7f0d90161340 2023-11-28T12:08:14.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.014+0000 7f0d8ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d900cd7c0 0x7f0d901f36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:14.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.014+0000 7f0d8ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d900cd7c0 0x7f0d901f36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48670/0 (socket says 172.21.15.45:48670) 2023-11-28T12:08:14.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.014+0000 7f0d8ffff700 1 -- 172.21.15.45:0/1169204586 learned_addr learned my addr 172.21.15.45:0/1169204586 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:14.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.014+0000 7f0d9499c700 1 --2- 172.21.15.45:0/1169204586 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0d90161340 0x7f0d9006abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:14.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.014+0000 7f0d8f7fe700 1 --2- 172.21.15.45:0/1169204586 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d9015c9b0 0x7f0d901576c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:14.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.014+0000 7f0d8ffff700 1 -- 172.21.15.45:0/1169204586 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0d90161340 msgr2=0x7f0d9006abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:14.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.014+0000 7f0d8ffff700 1 --2- 172.21.15.45:0/1169204586 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0d90161340 0x7f0d9006abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:14.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.014+0000 7f0d8ffff700 1 -- 172.21.15.45:0/1169204586 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d9015c9b0 msgr2=0x7f0d901576c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:14.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.014+0000 7f0d8ffff700 1 --2- 172.21.15.45:0/1169204586 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d9015c9b0 0x7f0d901576c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:14.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.014+0000 7f0d8ffff700 1 -- 172.21.15.45:0/1169204586 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d88009a70 con 0x7f0d900cd7c0 2023-11-28T12:08:14.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.014+0000 7f0d8f7fe700 1 --2- 172.21.15.45:0/1169204586 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d9015c9b0 0x7f0d901576c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:08:14.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.015+0000 7f0d8ffff700 1 --2- 172.21.15.45:0/1169204586 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d900cd7c0 0x7f0d901f36f0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f0d8000e870 tx=0x7f0d8000eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:14.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.015+0000 7f0d8cff9700 1 -- 172.21.15.45:0/1169204586 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d80009590 con 0x7f0d900cd7c0 2023-11-28T12:08:14.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.015+0000 7f0d8cff9700 1 -- 172.21.15.45:0/1169204586 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d80013680 con 0x7f0d900cd7c0 2023-11-28T12:08:14.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.015+0000 7f0d963ff700 1 -- 172.21.15.45:0/1169204586 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d900d1300 con 0x7f0d900cd7c0 2023-11-28T12:08:14.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.015+0000 7f0d8cff9700 1 -- 172.21.15.45:0/1169204586 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d800139f0 con 0x7f0d900cd7c0 2023-11-28T12:08:14.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.015+0000 7f0d963ff700 1 -- 172.21.15.45:0/1169204586 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d900b5520 con 0x7f0d900cd7c0 2023-11-28T12:08:14.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.016+0000 7f0d963ff700 1 -- 172.21.15.45:0/1169204586 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d900d15e0 con 0x7f0d900cd7c0 2023-11-28T12:08:14.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.017+0000 7f0d8cff9700 1 -- 172.21.15.45:0/1169204586 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f0d80019030 con 0x7f0d900cd7c0 2023-11-28T12:08:14.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.018+0000 7f0d8cff9700 1 --2- 172.21.15.45:0/1169204586 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f0d7c0682f0 0x7f0d7c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:14.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.018+0000 7f0d8cff9700 1 -- 172.21.15.45:0/1169204586 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0d80085b80 con 0x7f0d900cd7c0 2023-11-28T12:08:14.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.019+0000 7f0d8f7fe700 1 --2- 172.21.15.45:0/1169204586 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f0d7c0682f0 0x7f0d7c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:14.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.020+0000 7f0d8f7fe700 1 --2- 172.21.15.45:0/1169204586 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f0d7c0682f0 0x7f0d7c06a7a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0d901f36a0 tx=0x7f0d84009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:14.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.023+0000 7f0d8cff9700 1 -- 172.21.15.45:0/1169204586 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f0d80052290 con 0x7f0d900cd7c0 2023-11-28T12:08:14.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.226+0000 7f0d963ff700 1 -- 172.21.15.45:0/1169204586 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0d900745c0 con 0x7f0d900cd7c0 2023-11-28T12:08:14.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.227+0000 7f0d8cff9700 1 -- 172.21.15.45:0/1169204586 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v34) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0d80017020 con 0x7f0d900cd7c0 2023-11-28T12:08:14.229 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-11-28T12:08:14.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.229+0000 7f0d963ff700 1 -- 172.21.15.45:0/1169204586 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f0d7c0682f0 msgr2=0x7f0d7c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:14.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.229+0000 7f0d963ff700 1 --2- 172.21.15.45:0/1169204586 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f0d7c0682f0 0x7f0d7c06a7a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0d901f36a0 tx=0x7f0d84009040 comp rx=0 tx=0).stop 2023-11-28T12:08:14.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.229+0000 7f0d963ff700 1 -- 172.21.15.45:0/1169204586 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d900cd7c0 msgr2=0x7f0d901f36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:14.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.229+0000 7f0d963ff700 1 --2- 172.21.15.45:0/1169204586 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d900cd7c0 0x7f0d901f36f0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f0d8000e870 tx=0x7f0d8000eb80 comp rx=0 tx=0).stop 2023-11-28T12:08:14.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.229+0000 7f0d963ff700 1 -- 172.21.15.45:0/1169204586 shutdown_connections 2023-11-28T12:08:14.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.229+0000 7f0d963ff700 1 --2- 172.21.15.45:0/1169204586 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f0d7c0682f0 0x7f0d7c06a7a0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:14.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.229+0000 7f0d963ff700 1 --2- 172.21.15.45:0/1169204586 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0d90161340 0x7f0d9006abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:14.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.229+0000 7f0d963ff700 1 --2- 172.21.15.45:0/1169204586 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d900cd7c0 0x7f0d901f36f0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:14.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.229+0000 7f0d963ff700 1 --2- 172.21.15.45:0/1169204586 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d9015c9b0 0x7f0d901576c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:14.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.229+0000 7f0d963ff700 1 -- 172.21.15.45:0/1169204586 >> 172.21.15.45:0/1169204586 conn(0x7f0d90072600 msgr2=0x7f0d9015a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:14.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.229+0000 7f0d963ff700 1 -- 172.21.15.45:0/1169204586 shutdown_connections 2023-11-28T12:08:14.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.229+0000 7f0d963ff700 1 -- 172.21.15.45:0/1169204586 wait complete. 2023-11-28T12:08:14.249 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T12:08:14.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.455+0000 7f4eb33ff700 1 Processor -- start 2023-11-28T12:08:14.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.455+0000 7f4eb33ff700 1 -- start start 2023-11-28T12:08:14.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.456+0000 7f4eb33ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4eac161340 0x7f4eac0d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:14.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.456+0000 7f4eb33ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4eac0d1950 con 0x7f4eac15c9b0 2023-11-28T12:08:14.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.456+0000 7f4eb33ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4eac0b5520 con 0x7f4eac0d2320 2023-11-28T12:08:14.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.456+0000 7f4eb33ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4eac0b5800 con 0x7f4eac161340 2023-11-28T12:08:14.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.456+0000 7f4eb099a700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4eac161340 0x7f4eac0d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:14.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.456+0000 7f4eb119b700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f4eac15c9b0 0x7f4eac0b4bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44286/0 (socket says 172.21.15.45:44286) 2023-11-28T12:08:14.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.456+0000 7f4eb119b700 1 -- 172.21.15.45:0/2384935341 learned_addr learned my addr 172.21.15.45:0/2384935341 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:08:14.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.457+0000 7f4eb099a700 1 -- 172.21.15.45:0/2384935341 >> v1:172.21.15.152:6789/0 conn(0x7f4eac0d2320 legacy=0x7f4eac0cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:14.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.457+0000 7f4eb099a700 1 -- 172.21.15.45:0/2384935341 >> v1:172.21.15.45:6789/0 conn(0x7f4eac15c9b0 legacy=0x7f4eac0b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:14.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.457+0000 7f4eb099a700 1 -- 172.21.15.45:0/2384935341 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eac0d1300 con 0x7f4eac161340 2023-11-28T12:08:14.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.457+0000 7f4ea3fff700 1 -- 172.21.15.45:0/2384935341 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2118744050 0 0) 0x7f4eac0d1950 con 0x7f4eac15c9b0 2023-11-28T12:08:14.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.457+0000 7f4eb099a700 1 --2- 172.21.15.45:0/2384935341 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4eac161340 0x7f4eac0d1de0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c009840 tx=0x7f4e9c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63820d5f507128c6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:14.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.457+0000 7f4ea3fff700 1 -- 172.21.15.45:0/2384935341 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e9c011830 con 0x7f4eac161340 2023-11-28T12:08:14.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.457+0000 7f4ea3fff700 1 -- 172.21.15.45:0/2384935341 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e9c011990 con 0x7f4eac161340 2023-11-28T12:08:14.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.457+0000 7f4ea3fff700 1 -- 172.21.15.45:0/2384935341 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e9c011d20 con 0x7f4eac161340 2023-11-28T12:08:14.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.458+0000 7f4eb33ff700 1 -- 172.21.15.45:0/2384935341 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4eac161340 msgr2=0x7f4eac0d1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:14.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.458+0000 7f4eb33ff700 1 --2- 172.21.15.45:0/2384935341 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4eac161340 0x7f4eac0d1de0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c009840 tx=0x7f4e9c009b50 comp rx=0 tx=0).stop 2023-11-28T12:08:14.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.458+0000 7f4eb33ff700 1 -- 172.21.15.45:0/2384935341 shutdown_connections 2023-11-28T12:08:14.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.458+0000 7f4eb33ff700 1 --2- 172.21.15.45:0/2384935341 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4eac161340 0x7f4eac0d1de0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:14.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.458+0000 7f4eb33ff700 1 -- 172.21.15.45:0/2384935341 >> 172.21.15.45:0/2384935341 conn(0x7f4eac072600 msgr2=0x7f4eac0cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:14.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.458+0000 7f4eb33ff700 1 -- 172.21.15.45:0/2384935341 shutdown_connections 2023-11-28T12:08:14.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.458+0000 7f4eb33ff700 1 -- 172.21.15.45:0/2384935341 wait complete. 2023-11-28T12:08:14.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.460+0000 7f4eb33ff700 1 Processor -- start 2023-11-28T12:08:14.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.460+0000 7f4eb33ff700 1 -- start start 2023-11-28T12:08:14.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.461+0000 7f4eb33ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4eac0d2320 0x7f4eac06ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:14.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.461+0000 7f4eb33ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4eac15c9b0 0x7f4eac14a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:14.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.461+0000 7f4eb33ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4eac161340 0x7f4eac14a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:14.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.461+0000 7f4eb33ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eac1e82a0 con 0x7f4eac15c9b0 2023-11-28T12:08:14.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.461+0000 7f4eb33ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eac1e7200 con 0x7f4eac161340 2023-11-28T12:08:14.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.461+0000 7f4eb33ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4eac1e74e0 con 0x7f4eac0d2320 2023-11-28T12:08:14.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.461+0000 7f4eb099a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4eac15c9b0 0x7f4eac14a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:14.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.461+0000 7f4eb099a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4eac15c9b0 0x7f4eac14a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48692/0 (socket says 172.21.15.45:48692) 2023-11-28T12:08:14.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.461+0000 7f4eb099a700 1 -- 172.21.15.45:0/465992157 learned_addr learned my addr 172.21.15.45:0/465992157 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:14.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.461+0000 7f4eb119b700 1 --2- 172.21.15.45:0/465992157 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4eac0d2320 0x7f4eac06ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:14.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.461+0000 7f4eb199c700 1 --2- 172.21.15.45:0/465992157 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4eac161340 0x7f4eac14a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:14.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.462+0000 7f4eb099a700 1 -- 172.21.15.45:0/465992157 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4eac0d2320 msgr2=0x7f4eac06ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:14.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.462+0000 7f4eb099a700 1 --2- 172.21.15.45:0/465992157 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4eac0d2320 0x7f4eac06ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:14.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.462+0000 7f4eb099a700 1 -- 172.21.15.45:0/465992157 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4eac161340 msgr2=0x7f4eac14a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:14.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.462+0000 7f4eb099a700 1 --2- 172.21.15.45:0/465992157 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4eac161340 0x7f4eac14a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:14.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.462+0000 7f4eb099a700 1 -- 172.21.15.45:0/465992157 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e9c0094a0 con 0x7f4eac15c9b0 2023-11-28T12:08:14.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.462+0000 7f4eb199c700 1 --2- 172.21.15.45:0/465992157 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4eac161340 0x7f4eac14a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:08:14.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.462+0000 7f4eb099a700 1 --2- 172.21.15.45:0/465992157 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4eac15c9b0 0x7f4eac14a150 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c014040 tx=0x7f4e9c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:14.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.462+0000 7f4ea1ffb700 1 -- 172.21.15.45:0/465992157 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e9c01a8d0 con 0x7f4eac15c9b0 2023-11-28T12:08:14.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.462+0000 7f4ea1ffb700 1 -- 172.21.15.45:0/465992157 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e9c01aa50 con 0x7f4eac15c9b0 2023-11-28T12:08:14.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.462+0000 7f4ea1ffb700 1 -- 172.21.15.45:0/465992157 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e9c01ae00 con 0x7f4eac15c9b0 2023-11-28T12:08:14.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.462+0000 7f4eb33ff700 1 -- 172.21.15.45:0/465992157 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4eac15cd80 con 0x7f4eac15c9b0 2023-11-28T12:08:14.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.462+0000 7f4eb33ff700 1 -- 172.21.15.45:0/465992157 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4eac0d15e0 con 0x7f4eac15c9b0 2023-11-28T12:08:14.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.463+0000 7f4eb33ff700 1 -- 172.21.15.45:0/465992157 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4eac15cf10 con 0x7f4eac15c9b0 2023-11-28T12:08:14.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.464+0000 7f4ea1ffb700 1 -- 172.21.15.45:0/465992157 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f4e9c00f050 con 0x7f4eac15c9b0 2023-11-28T12:08:14.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.465+0000 7f4ea1ffb700 1 --2- 172.21.15.45:0/465992157 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f4e900682f0 0x7f4e9006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:14.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.465+0000 7f4ea1ffb700 1 -- 172.21.15.45:0/465992157 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4e9c086e30 con 0x7f4eac15c9b0 2023-11-28T12:08:14.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.466+0000 7f4eb119b700 1 --2- 172.21.15.45:0/465992157 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f4e900682f0 0x7f4e9006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:14.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.466+0000 7f4eb119b700 1 --2- 172.21.15.45:0/465992157 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f4e900682f0 0x7f4e9006a7a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4ea8007b10 tx=0x7f4ea8007a60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:14.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.469+0000 7f4ea1ffb700 1 -- 172.21.15.45:0/465992157 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f4e9c0535a0 con 0x7f4eac15c9b0 2023-11-28T12:08:14.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.668+0000 7f4eb33ff700 1 -- 172.21.15.45:0/465992157 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4eac066d60 con 0x7f4eac15c9b0 2023-11-28T12:08:14.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.668+0000 7f4ea1ffb700 1 -- 172.21.15.45:0/465992157 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v34) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4e9c029020 con 0x7f4eac15c9b0 2023-11-28T12:08:14.670 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-11-28T12:08:14.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.670+0000 7f4eb33ff700 1 -- 172.21.15.45:0/465992157 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f4e900682f0 msgr2=0x7f4e9006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:14.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.670+0000 7f4eb33ff700 1 --2- 172.21.15.45:0/465992157 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f4e900682f0 0x7f4e9006a7a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4ea8007b10 tx=0x7f4ea8007a60 comp rx=0 tx=0).stop 2023-11-28T12:08:14.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.670+0000 7f4eb33ff700 1 -- 172.21.15.45:0/465992157 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4eac15c9b0 msgr2=0x7f4eac14a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:14.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.670+0000 7f4eb33ff700 1 --2- 172.21.15.45:0/465992157 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4eac15c9b0 0x7f4eac14a150 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c014040 tx=0x7f4e9c004750 comp rx=0 tx=0).stop 2023-11-28T12:08:14.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.671+0000 7f4eb33ff700 1 -- 172.21.15.45:0/465992157 shutdown_connections 2023-11-28T12:08:14.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.671+0000 7f4eb33ff700 1 --2- 172.21.15.45:0/465992157 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f4e900682f0 0x7f4e9006a7a0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:14.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.671+0000 7f4eb33ff700 1 --2- 172.21.15.45:0/465992157 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4eac161340 0x7f4eac14a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:14.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.671+0000 7f4eb33ff700 1 --2- 172.21.15.45:0/465992157 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4eac0d2320 0x7f4eac06ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:14.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.671+0000 7f4eb33ff700 1 --2- 172.21.15.45:0/465992157 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4eac15c9b0 0x7f4eac14a150 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:14.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.671+0000 7f4eb33ff700 1 -- 172.21.15.45:0/465992157 >> 172.21.15.45:0/465992157 conn(0x7f4eac072600 msgr2=0x7f4eac0b6f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:14.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.671+0000 7f4eb33ff700 1 -- 172.21.15.45:0/465992157 shutdown_connections 2023-11-28T12:08:14.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.671+0000 7f4eb33ff700 1 -- 172.21.15.45:0/465992157 wait complete. 2023-11-28T12:08:14.690 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T12:08:14.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.894+0000 7f0aebfff700 1 Processor -- start 2023-11-28T12:08:14.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.895+0000 7f0aebfff700 1 -- start start 2023-11-28T12:08:14.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.896+0000 7f0aebfff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f0ae4161340 0x7f0ae40d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:14.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.896+0000 7f0aebfff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0ae40d2320 0x7f0ae40cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:14.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.896+0000 7f0aebfff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ae40d1950 con 0x7f0ae415c9b0 2023-11-28T12:08:14.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.896+0000 7f0aebfff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ae40b5800 con 0x7f0ae40d2320 2023-11-28T12:08:14.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.896+0000 7f0aebfff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ae40b5300 con 0x7f0ae4161340 2023-11-28T12:08:14.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.896+0000 7f0aea59c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0ae40d2320 0x7f0ae40cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:14.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.896+0000 7f0aea59c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0ae40d2320 0x7f0ae40cd7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48698/0 (socket says 172.21.15.45:48698) 2023-11-28T12:08:14.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.896+0000 7f0aea59c700 1 -- 172.21.15.45:0/462768118 learned_addr learned my addr 172.21.15.45:0/462768118 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:14.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.896+0000 7f0ae959a700 1 --2- 172.21.15.45:0/462768118 >> v2:172.21.15.152:3300/0 conn(0x7f0ae4161340 0x7f0ae40d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:14.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.897+0000 7f0aea59c700 1 -- 172.21.15.45:0/462768118 >> v2:172.21.15.152:3300/0 conn(0x7f0ae4161340 msgr2=0x7f0ae40d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:14.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.897+0000 7f0aea59c700 1 --2- 172.21.15.45:0/462768118 >> v2:172.21.15.152:3300/0 conn(0x7f0ae4161340 0x7f0ae40d1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:14.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.897+0000 7f0aea59c700 1 -- 172.21.15.45:0/462768118 >> v1:172.21.15.152:6789/0 conn(0x7f0ae415c9b0 legacy=0x7f0ae40b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:14.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.897+0000 7f0aea59c700 1 -- 172.21.15.45:0/462768118 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ae40b5520 con 0x7f0ae40d2320 2023-11-28T12:08:14.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.897+0000 7f0ae959a700 1 --2- 172.21.15.45:0/462768118 >> v2:172.21.15.152:3300/0 conn(0x7f0ae4161340 0x7f0ae40d1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:08:14.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.897+0000 7f0aea59c700 1 --2- 172.21.15.45:0/462768118 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ae40d2320 0x7f0ae40cd7c0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f0ae40685c0 tx=0x7f0adc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15531c62318cf380 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:14.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.897+0000 7f0ae8d99700 1 -- 172.21.15.45:0/462768118 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0adc00e070 con 0x7f0ae40d2320 2023-11-28T12:08:14.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.897+0000 7f0ae8d99700 1 -- 172.21.15.45:0/462768118 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0adc00b980 con 0x7f0ae40d2320 2023-11-28T12:08:14.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.897+0000 7f0ae8d99700 1 -- 172.21.15.45:0/462768118 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0adc00bd30 con 0x7f0ae40d2320 2023-11-28T12:08:14.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.898+0000 7f0aebfff700 1 -- 172.21.15.45:0/462768118 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ae40d2320 msgr2=0x7f0ae40cd7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:14.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.898+0000 7f0aebfff700 1 --2- 172.21.15.45:0/462768118 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ae40d2320 0x7f0ae40cd7c0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f0ae40685c0 tx=0x7f0adc00b330 comp rx=0 tx=0).stop 2023-11-28T12:08:14.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.898+0000 7f0aebfff700 1 -- 172.21.15.45:0/462768118 shutdown_connections 2023-11-28T12:08:14.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.898+0000 7f0aebfff700 1 --2- 172.21.15.45:0/462768118 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ae40d2320 0x7f0ae40cd7c0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:14.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.898+0000 7f0aebfff700 1 --2- 172.21.15.45:0/462768118 >> v2:172.21.15.152:3300/0 conn(0x7f0ae4161340 0x7f0ae40d1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:14.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.898+0000 7f0aebfff700 1 -- 172.21.15.45:0/462768118 >> 172.21.15.45:0/462768118 conn(0x7f0ae4072600 msgr2=0x7f0ae40cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:14.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.898+0000 7f0aebfff700 1 -- 172.21.15.45:0/462768118 shutdown_connections 2023-11-28T12:08:14.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.898+0000 7f0aebfff700 1 -- 172.21.15.45:0/462768118 wait complete. 2023-11-28T12:08:14.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.900+0000 7f0aebfff700 1 Processor -- start 2023-11-28T12:08:14.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.900+0000 7f0aebfff700 1 -- start start 2023-11-28T12:08:14.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.901+0000 7f0aebfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ae40d2320 0x7f0ae414e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:14.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.901+0000 7f0aebfff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0ae415c9b0 0x7f0ae41596d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:14.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.901+0000 7f0aebfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ae4161340 0x7f0ae4159c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:14.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.901+0000 7f0aebfff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae41e69c0 con 0x7f0ae4161340 2023-11-28T12:08:14.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.901+0000 7f0aebfff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae4157c90 con 0x7f0ae40d2320 2023-11-28T12:08:14.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.901+0000 7f0aebfff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae40c8a60 con 0x7f0ae415c9b0 2023-11-28T12:08:14.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.901+0000 7f0aea59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ae4161340 0x7f0ae4159c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:14.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.901+0000 7f0aea59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ae4161340 0x7f0ae4159c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48712/0 (socket says 172.21.15.45:48712) 2023-11-28T12:08:14.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.901+0000 7f0aea59c700 1 -- 172.21.15.45:0/841316486 learned_addr learned my addr 172.21.15.45:0/841316486 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:14.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.901+0000 7f0ae9d9b700 1 --2- 172.21.15.45:0/841316486 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ae40d2320 0x7f0ae414e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:14.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.901+0000 7f0ae959a700 1 --2- 172.21.15.45:0/841316486 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0ae415c9b0 0x7f0ae41596d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:14.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.902+0000 7f0aea59c700 1 -- 172.21.15.45:0/841316486 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0ae415c9b0 msgr2=0x7f0ae41596d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:14.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.902+0000 7f0aea59c700 1 --2- 172.21.15.45:0/841316486 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0ae415c9b0 0x7f0ae41596d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:14.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.902+0000 7f0aea59c700 1 -- 172.21.15.45:0/841316486 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ae40d2320 msgr2=0x7f0ae414e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:14.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.902+0000 7f0aea59c700 1 --2- 172.21.15.45:0/841316486 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ae40d2320 0x7f0ae414e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:14.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.902+0000 7f0aea59c700 1 -- 172.21.15.45:0/841316486 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0adc009b30 con 0x7f0ae4161340 2023-11-28T12:08:14.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.902+0000 7f0aea59c700 1 --2- 172.21.15.45:0/841316486 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ae4161340 0x7f0ae4159c10 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f0adc012000 tx=0x7f0adc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:14.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.902+0000 7f0ada7fc700 1 -- 172.21.15.45:0/841316486 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0adc0092e0 con 0x7f0ae4161340 2023-11-28T12:08:14.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.902+0000 7f0ada7fc700 1 -- 172.21.15.45:0/841316486 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0adc004960 con 0x7f0ae4161340 2023-11-28T12:08:14.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.902+0000 7f0ada7fc700 1 -- 172.21.15.45:0/841316486 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0adc01b670 con 0x7f0ae4161340 2023-11-28T12:08:14.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.902+0000 7f0aebfff700 1 -- 172.21.15.45:0/841316486 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ae40d15e0 con 0x7f0ae4161340 2023-11-28T12:08:14.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.902+0000 7f0aebfff700 1 -- 172.21.15.45:0/841316486 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ae40d1300 con 0x7f0ae4161340 2023-11-28T12:08:14.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.903+0000 7f0ac7fff700 1 -- 172.21.15.45:0/841316486 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ac00052f0 con 0x7f0ae4161340 2023-11-28T12:08:14.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.904+0000 7f0ada7fc700 1 -- 172.21.15.45:0/841316486 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f0adc021030 con 0x7f0ae4161340 2023-11-28T12:08:14.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.905+0000 7f0ada7fc700 1 --2- 172.21.15.45:0/841316486 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f0ac80682f0 0x7f0ac806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:14.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.905+0000 7f0ada7fc700 1 -- 172.21.15.45:0/841316486 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0adc087250 con 0x7f0ae4161340 2023-11-28T12:08:14.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.906+0000 7f0ae9d9b700 1 --2- 172.21.15.45:0/841316486 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f0ac80682f0 0x7f0ac806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:14.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.906+0000 7f0ae9d9b700 1 --2- 172.21.15.45:0/841316486 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f0ac80682f0 0x7f0ac806a7a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0ae0001620 tx=0x7f0ae0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:14.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:14.909+0000 7f0ada7fc700 1 -- 172.21.15.45:0/841316486 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f0adc0539c0 con 0x7f0ae4161340 2023-11-28T12:08:15.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.110+0000 7f0ac7fff700 1 -- 172.21.15.45:0/841316486 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0ac0005b20 con 0x7f0ae4161340 2023-11-28T12:08:15.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.110+0000 7f0ada7fc700 1 -- 172.21.15.45:0/841316486 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v34) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0adc056fe0 con 0x7f0ae4161340 2023-11-28T12:08:15.112 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-11-28T12:08:15.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.112+0000 7f0ac7fff700 1 -- 172.21.15.45:0/841316486 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f0ac80682f0 msgr2=0x7f0ac806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:15.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.112+0000 7f0ac7fff700 1 --2- 172.21.15.45:0/841316486 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f0ac80682f0 0x7f0ac806a7a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0ae0001620 tx=0x7f0ae0009040 comp rx=0 tx=0).stop 2023-11-28T12:08:15.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.112+0000 7f0ac7fff700 1 -- 172.21.15.45:0/841316486 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ae4161340 msgr2=0x7f0ae4159c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:15.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.112+0000 7f0ac7fff700 1 --2- 172.21.15.45:0/841316486 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ae4161340 0x7f0ae4159c10 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f0adc012000 tx=0x7f0adc004ad0 comp rx=0 tx=0).stop 2023-11-28T12:08:15.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.113+0000 7f0ac7fff700 1 -- 172.21.15.45:0/841316486 shutdown_connections 2023-11-28T12:08:15.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.113+0000 7f0ac7fff700 1 --2- 172.21.15.45:0/841316486 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f0ac80682f0 0x7f0ac806a7a0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:15.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.113+0000 7f0ac7fff700 1 --2- 172.21.15.45:0/841316486 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ae40d2320 0x7f0ae414e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:15.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.113+0000 7f0ac7fff700 1 --2- 172.21.15.45:0/841316486 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ae4161340 0x7f0ae4159c10 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:15.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.113+0000 7f0ac7fff700 1 --2- 172.21.15.45:0/841316486 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0ae415c9b0 0x7f0ae41596d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:15.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.113+0000 7f0ac7fff700 1 -- 172.21.15.45:0/841316486 >> 172.21.15.45:0/841316486 conn(0x7f0ae4072600 msgr2=0x7f0ae415a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:15.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.113+0000 7f0ac7fff700 1 -- 172.21.15.45:0/841316486 shutdown_connections 2023-11-28T12:08:15.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.113+0000 7f0ac7fff700 1 -- 172.21.15.45:0/841316486 wait complete. 2023-11-28T12:08:15.133 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T12:08:15.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.337+0000 7f1dde9ff700 1 Processor -- start 2023-11-28T12:08:15.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.337+0000 7f1dde9ff700 1 -- start start 2023-11-28T12:08:15.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.338+0000 7f1dde9ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f1dd80d01b0 0x7f1dd80d0c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:15.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.338+0000 7f1dde9ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1dd80b16d0 0x7f1dd80d1160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:15.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.339+0000 7f1dde9ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dd80b0230 con 0x7f1dd80b20b0 2023-11-28T12:08:15.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.339+0000 7f1dde9ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dd815cec0 con 0x7f1dd80b16d0 2023-11-28T12:08:15.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.339+0000 7f1dde9ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dd80b4570 con 0x7f1dd80d01b0 2023-11-28T12:08:15.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.339+0000 7f1ddcf9c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1dd80b16d0 0x7f1dd80d1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:15.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.339+0000 7f1ddcf9c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1dd80b16d0 0x7f1dd80d1160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48724/0 (socket says 172.21.15.45:48724) 2023-11-28T12:08:15.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.339+0000 7f1ddcf9c700 1 -- 172.21.15.45:0/4182024811 learned_addr learned my addr 172.21.15.45:0/4182024811 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:15.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.339+0000 7f1dd7fff700 1 --2- 172.21.15.45:0/4182024811 >> v2:172.21.15.152:3300/0 conn(0x7f1dd80d01b0 0x7f1dd80d0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:15.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.339+0000 7f1ddcf9c700 1 -- 172.21.15.45:0/4182024811 >> v2:172.21.15.152:3300/0 conn(0x7f1dd80d01b0 msgr2=0x7f1dd80d0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:15.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.339+0000 7f1ddcf9c700 1 --2- 172.21.15.45:0/4182024811 >> v2:172.21.15.152:3300/0 conn(0x7f1dd80d01b0 0x7f1dd80d0c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:15.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.339+0000 7f1ddcf9c700 1 -- 172.21.15.45:0/4182024811 >> v1:172.21.15.152:6789/0 conn(0x7f1dd80b20b0 legacy=0x7f1dd80b29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:15.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.339+0000 7f1ddcf9c700 1 -- 172.21.15.45:0/4182024811 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dd80b4850 con 0x7f1dd80b16d0 2023-11-28T12:08:15.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.340+0000 7f1ddcf9c700 1 --2- 172.21.15.45:0/4182024811 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1dd80b16d0 0x7f1dd80d1160 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f1dd80b5bb0 tx=0x7f1dd000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=781d4672b384f9b2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:15.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.340+0000 7f1dd6ffd700 1 -- 172.21.15.45:0/4182024811 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd000e070 con 0x7f1dd80b16d0 2023-11-28T12:08:15.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.340+0000 7f1dd6ffd700 1 -- 172.21.15.45:0/4182024811 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dd000b910 con 0x7f1dd80b16d0 2023-11-28T12:08:15.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.340+0000 7f1dd6ffd700 1 -- 172.21.15.45:0/4182024811 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd000bcc0 con 0x7f1dd80b16d0 2023-11-28T12:08:15.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.340+0000 7f1dde9ff700 1 -- 172.21.15.45:0/4182024811 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1dd80b16d0 msgr2=0x7f1dd80d1160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:15.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.340+0000 7f1dde9ff700 1 --2- 172.21.15.45:0/4182024811 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1dd80b16d0 0x7f1dd80d1160 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f1dd80b5bb0 tx=0x7f1dd000b330 comp rx=0 tx=0).stop 2023-11-28T12:08:15.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.341+0000 7f1dde9ff700 1 -- 172.21.15.45:0/4182024811 shutdown_connections 2023-11-28T12:08:15.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.341+0000 7f1dde9ff700 1 --2- 172.21.15.45:0/4182024811 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1dd80b16d0 0x7f1dd80d1160 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:15.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.341+0000 7f1dde9ff700 1 --2- 172.21.15.45:0/4182024811 >> v2:172.21.15.152:3300/0 conn(0x7f1dd80d01b0 0x7f1dd80d0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:15.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.341+0000 7f1dde9ff700 1 -- 172.21.15.45:0/4182024811 >> 172.21.15.45:0/4182024811 conn(0x7f1dd809c3f0 msgr2=0x7f1dd80d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:15.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.341+0000 7f1dde9ff700 1 -- 172.21.15.45:0/4182024811 shutdown_connections 2023-11-28T12:08:15.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.341+0000 7f1dde9ff700 1 -- 172.21.15.45:0/4182024811 wait complete. 2023-11-28T12:08:15.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.342+0000 7f1dde9ff700 1 Processor -- start 2023-11-28T12:08:15.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.343+0000 7f1dde9ff700 1 -- start start 2023-11-28T12:08:15.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.343+0000 7f1dde9ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1dd80b16d0 0x7f1dd8156a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:15.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.344+0000 7f1dde9ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1dd80b20b0 0x7f1dd80b3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:15.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.344+0000 7f1dde9ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1dd80d01b0 0x7f1dd81f1990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:15.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.344+0000 7f1dde9ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd81537c0 con 0x7f1dd80b16d0 2023-11-28T12:08:15.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.344+0000 7f1dde9ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd8156220 con 0x7f1dd80d01b0 2023-11-28T12:08:15.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.344+0000 7f1dde9ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd8156500 con 0x7f1dd80b20b0 2023-11-28T12:08:15.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.344+0000 7f1dd7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1dd80b16d0 0x7f1dd8156a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:15.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.344+0000 7f1dd7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1dd80b16d0 0x7f1dd8156a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48736/0 (socket says 172.21.15.45:48736) 2023-11-28T12:08:15.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.344+0000 7f1dd7fff700 1 -- 172.21.15.45:0/3695511519 learned_addr learned my addr 172.21.15.45:0/3695511519 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:15.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.344+0000 7f1dd77fe700 1 --2- 172.21.15.45:0/3695511519 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1dd80b20b0 0x7f1dd80b3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:15.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.344+0000 7f1ddcf9c700 1 --2- 172.21.15.45:0/3695511519 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1dd80d01b0 0x7f1dd81f1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:15.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.344+0000 7f1dd7fff700 1 -- 172.21.15.45:0/3695511519 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1dd80b20b0 msgr2=0x7f1dd80b3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:15.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.344+0000 7f1dd7fff700 1 --2- 172.21.15.45:0/3695511519 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1dd80b20b0 0x7f1dd80b3a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:15.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.344+0000 7f1dd7fff700 1 -- 172.21.15.45:0/3695511519 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1dd80d01b0 msgr2=0x7f1dd81f1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:15.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.344+0000 7f1dd7fff700 1 --2- 172.21.15.45:0/3695511519 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1dd80d01b0 0x7f1dd81f1990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:15.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.344+0000 7f1dd7fff700 1 -- 172.21.15.45:0/3695511519 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dd0009b30 con 0x7f1dd80b16d0 2023-11-28T12:08:15.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.344+0000 7f1dd7fff700 1 --2- 172.21.15.45:0/3695511519 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1dd80b16d0 0x7f1dd8156a20 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f1dc800e870 tx=0x7f1dc800ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:15.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.345+0000 7f1dd4ff9700 1 -- 172.21.15.45:0/3695511519 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc8009590 con 0x7f1dd80b16d0 2023-11-28T12:08:15.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.345+0000 7f1dd4ff9700 1 -- 172.21.15.45:0/3695511519 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dc800ee70 con 0x7f1dd80b16d0 2023-11-28T12:08:15.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.345+0000 7f1dde9ff700 1 -- 172.21.15.45:0/3695511519 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dd80afec0 con 0x7f1dd80b16d0 2023-11-28T12:08:15.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.345+0000 7f1dd4ff9700 1 -- 172.21.15.45:0/3695511519 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc800ca50 con 0x7f1dd80b16d0 2023-11-28T12:08:15.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.345+0000 7f1dde9ff700 1 -- 172.21.15.45:0/3695511519 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dd80afbe0 con 0x7f1dd80b16d0 2023-11-28T12:08:15.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.346+0000 7f1dde9ff700 1 -- 172.21.15.45:0/3695511519 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dd80b2600 con 0x7f1dd80b16d0 2023-11-28T12:08:15.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.347+0000 7f1dd4ff9700 1 -- 172.21.15.45:0/3695511519 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f1dc8019030 con 0x7f1dd80b16d0 2023-11-28T12:08:15.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.348+0000 7f1dd4ff9700 1 --2- 172.21.15.45:0/3695511519 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f1dc40682f0 0x7f1dc406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:15.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.348+0000 7f1dd4ff9700 1 -- 172.21.15.45:0/3695511519 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1dc8085c10 con 0x7f1dd80b16d0 2023-11-28T12:08:15.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.348+0000 7f1dd77fe700 1 --2- 172.21.15.45:0/3695511519 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f1dc40682f0 0x7f1dc406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:15.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.349+0000 7f1dd77fe700 1 --2- 172.21.15.45:0/3695511519 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f1dc40682f0 0x7f1dc406a7a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1dd806c140 tx=0x7f1dcc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:15.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.352+0000 7f1dd4ff9700 1 -- 172.21.15.45:0/3695511519 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f1dc8052380 con 0x7f1dd80b16d0 2023-11-28T12:08:15.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.553+0000 7f1dde9ff700 1 -- 172.21.15.45:0/3695511519 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1dd8154020 con 0x7f1dd80b16d0 2023-11-28T12:08:15.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.553+0000 7f1dd4ff9700 1 -- 172.21.15.45:0/3695511519 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v34) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1dc8017020 con 0x7f1dd80b16d0 2023-11-28T12:08:15.555 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-11-28T12:08:15.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.555+0000 7f1dde9ff700 1 -- 172.21.15.45:0/3695511519 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f1dc40682f0 msgr2=0x7f1dc406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:15.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.555+0000 7f1dde9ff700 1 --2- 172.21.15.45:0/3695511519 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f1dc40682f0 0x7f1dc406a7a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1dd806c140 tx=0x7f1dcc009040 comp rx=0 tx=0).stop 2023-11-28T12:08:15.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.555+0000 7f1dde9ff700 1 -- 172.21.15.45:0/3695511519 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1dd80b16d0 msgr2=0x7f1dd8156a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:15.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.555+0000 7f1dde9ff700 1 --2- 172.21.15.45:0/3695511519 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1dd80b16d0 0x7f1dd8156a20 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f1dc800e870 tx=0x7f1dc800ec30 comp rx=0 tx=0).stop 2023-11-28T12:08:15.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.556+0000 7f1dde9ff700 1 -- 172.21.15.45:0/3695511519 shutdown_connections 2023-11-28T12:08:15.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.556+0000 7f1dde9ff700 1 --2- 172.21.15.45:0/3695511519 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f1dc40682f0 0x7f1dc406a7a0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:15.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.556+0000 7f1dde9ff700 1 --2- 172.21.15.45:0/3695511519 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1dd80d01b0 0x7f1dd81f1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:15.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.556+0000 7f1dde9ff700 1 --2- 172.21.15.45:0/3695511519 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1dd80b16d0 0x7f1dd8156a20 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:15.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.556+0000 7f1dde9ff700 1 --2- 172.21.15.45:0/3695511519 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1dd80b20b0 0x7f1dd80b3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:15.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.556+0000 7f1dde9ff700 1 -- 172.21.15.45:0/3695511519 >> 172.21.15.45:0/3695511519 conn(0x7f1dd809c3f0 msgr2=0x7f1dd80d16d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:15.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.556+0000 7f1dde9ff700 1 -- 172.21.15.45:0/3695511519 shutdown_connections 2023-11-28T12:08:15.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.556+0000 7f1dde9ff700 1 -- 172.21.15.45:0/3695511519 wait complete. 2023-11-28T12:08:15.575 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T12:08:15.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.776+0000 7fa96cfff700 1 Processor -- start 2023-11-28T12:08:15.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.776+0000 7fa96cfff700 1 -- start start 2023-11-28T12:08:15.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.777+0000 7fa96cfff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa968161340 0x7fa9680d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:15.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.777+0000 7fa96cfff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa9680d2320 0x7fa9680cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:15.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.777+0000 7fa96cfff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9680d1950 con 0x7fa96815c9b0 2023-11-28T12:08:15.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.777+0000 7fa96cfff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9680b5800 con 0x7fa9680d2320 2023-11-28T12:08:15.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.777+0000 7fa96cfff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9680b5300 con 0x7fa968161340 2023-11-28T12:08:15.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.777+0000 7fa966d9d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa9680d2320 0x7fa9680cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:15.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.777+0000 7fa966d9d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa9680d2320 0x7fa9680cd7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48742/0 (socket says 172.21.15.45:48742) 2023-11-28T12:08:15.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.777+0000 7fa966d9d700 1 -- 172.21.15.45:0/2864458563 learned_addr learned my addr 172.21.15.45:0/2864458563 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:15.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.777+0000 7fa95ffff700 1 --2- 172.21.15.45:0/2864458563 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa968161340 0x7fa9680d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:15.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.778+0000 7fa966d9d700 1 -- 172.21.15.45:0/2864458563 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa968161340 msgr2=0x7fa9680d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:15.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.778+0000 7fa966d9d700 1 --2- 172.21.15.45:0/2864458563 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa968161340 0x7fa9680d1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:15.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.778+0000 7fa966d9d700 1 -- 172.21.15.45:0/2864458563 >> v1:172.21.15.152:6789/0 conn(0x7fa96815c9b0 legacy=0x7fa9680b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:15.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.778+0000 7fa966d9d700 1 -- 172.21.15.45:0/2864458563 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9680b5520 con 0x7fa9680d2320 2023-11-28T12:08:15.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.778+0000 7fa966d9d700 1 --2- 172.21.15.45:0/2864458563 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9680d2320 0x7fa9680cd7c0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fa960009e80 tx=0x7fa96000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9d73a967b355288 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:15.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.778+0000 7fa965d9b700 1 -- 172.21.15.45:0/2864458563 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa96000e070 con 0x7fa9680d2320 2023-11-28T12:08:15.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.778+0000 7fa965d9b700 1 -- 172.21.15.45:0/2864458563 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa96000b8d0 con 0x7fa9680d2320 2023-11-28T12:08:15.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.778+0000 7fa965d9b700 1 -- 172.21.15.45:0/2864458563 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa96000bc80 con 0x7fa9680d2320 2023-11-28T12:08:15.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.779+0000 7fa96cfff700 1 -- 172.21.15.45:0/2864458563 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9680d2320 msgr2=0x7fa9680cd7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:15.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.779+0000 7fa96cfff700 1 --2- 172.21.15.45:0/2864458563 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9680d2320 0x7fa9680cd7c0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fa960009e80 tx=0x7fa96000b330 comp rx=0 tx=0).stop 2023-11-28T12:08:15.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.779+0000 7fa96cfff700 1 -- 172.21.15.45:0/2864458563 shutdown_connections 2023-11-28T12:08:15.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.779+0000 7fa96cfff700 1 --2- 172.21.15.45:0/2864458563 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9680d2320 0x7fa9680cd7c0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:15.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.779+0000 7fa96cfff700 1 --2- 172.21.15.45:0/2864458563 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa968161340 0x7fa9680d1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:15.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.779+0000 7fa96cfff700 1 -- 172.21.15.45:0/2864458563 >> 172.21.15.45:0/2864458563 conn(0x7fa968072600 msgr2=0x7fa9680cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:15.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.779+0000 7fa96cfff700 1 -- 172.21.15.45:0/2864458563 shutdown_connections 2023-11-28T12:08:15.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.779+0000 7fa96cfff700 1 -- 172.21.15.45:0/2864458563 wait complete. 2023-11-28T12:08:15.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.781+0000 7fa96cfff700 1 Processor -- start 2023-11-28T12:08:15.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.781+0000 7fa96cfff700 1 -- start start 2023-11-28T12:08:15.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.782+0000 7fa96cfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa9680d2320 0x7fa968150690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:15.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.782+0000 7fa96cfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa96815c9b0 0x7fa96814fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:15.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.782+0000 7fa96cfff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa968161340 0x7fa9681e7630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:15.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.782+0000 7fa96cfff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9681e7e80 con 0x7fa96815c9b0 2023-11-28T12:08:15.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.782+0000 7fa96cfff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9680c85b0 con 0x7fa9680d2320 2023-11-28T12:08:15.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.782+0000 7fa96cfff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9680c8890 con 0x7fa968161340 2023-11-28T12:08:15.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.782+0000 7fa95ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa96815c9b0 0x7fa96814fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:15.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.782+0000 7fa95ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa96815c9b0 0x7fa96814fed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48752/0 (socket says 172.21.15.45:48752) 2023-11-28T12:08:15.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.782+0000 7fa95ffff700 1 -- 172.21.15.45:0/3933035503 learned_addr learned my addr 172.21.15.45:0/3933035503 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:15.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.782+0000 7fa96659c700 1 --2- 172.21.15.45:0/3933035503 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa9680d2320 0x7fa968150690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:15.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.782+0000 7fa966d9d700 1 --2- 172.21.15.45:0/3933035503 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa968161340 0x7fa9681e7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:15.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.782+0000 7fa95ffff700 1 -- 172.21.15.45:0/3933035503 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa968161340 msgr2=0x7fa9681e7630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:15.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.782+0000 7fa95ffff700 1 --2- 172.21.15.45:0/3933035503 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa968161340 0x7fa9681e7630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:15.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.782+0000 7fa95ffff700 1 -- 172.21.15.45:0/3933035503 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa9680d2320 msgr2=0x7fa968150690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:15.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.782+0000 7fa95ffff700 1 --2- 172.21.15.45:0/3933035503 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa9680d2320 0x7fa968150690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:15.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.782+0000 7fa95ffff700 1 -- 172.21.15.45:0/3933035503 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa960009b30 con 0x7fa96815c9b0 2023-11-28T12:08:15.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.782+0000 7fa96659c700 1 --2- 172.21.15.45:0/3933035503 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa9680d2320 0x7fa968150690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:08:15.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.783+0000 7fa95ffff700 1 --2- 172.21.15.45:0/3933035503 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa96815c9b0 0x7fa96814fed0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fa95000e9b0 tx=0x7fa95000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:15.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.783+0000 7fa95effd700 1 -- 172.21.15.45:0/3933035503 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa950009710 con 0x7fa96815c9b0 2023-11-28T12:08:15.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.783+0000 7fa95effd700 1 -- 172.21.15.45:0/3933035503 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa95000c850 con 0x7fa96815c9b0 2023-11-28T12:08:15.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.783+0000 7fa96cfff700 1 -- 172.21.15.45:0/3933035503 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9680d15e0 con 0x7fa96815c9b0 2023-11-28T12:08:15.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.783+0000 7fa95effd700 1 -- 172.21.15.45:0/3933035503 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa95000cbc0 con 0x7fa96815c9b0 2023-11-28T12:08:15.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.783+0000 7fa96cfff700 1 -- 172.21.15.45:0/3933035503 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9680d1300 con 0x7fa96815c9b0 2023-11-28T12:08:15.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.784+0000 7fa96cfff700 1 -- 172.21.15.45:0/3933035503 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa96815cd80 con 0x7fa96815c9b0 2023-11-28T12:08:15.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.785+0000 7fa95effd700 1 -- 172.21.15.45:0/3933035503 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fa950019030 con 0x7fa96815c9b0 2023-11-28T12:08:15.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.786+0000 7fa95effd700 1 --2- 172.21.15.45:0/3933035503 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fa9480682f0 0x7fa94806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:15.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.786+0000 7fa95effd700 1 -- 172.21.15.45:0/3933035503 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa950085d90 con 0x7fa96815c9b0 2023-11-28T12:08:15.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.786+0000 7fa96659c700 1 --2- 172.21.15.45:0/3933035503 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fa9480682f0 0x7fa94806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:15.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.787+0000 7fa96659c700 1 --2- 172.21.15.45:0/3933035503 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fa9480682f0 0x7fa94806a7a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa958000f60 tx=0x7fa958009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:15.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:15.790+0000 7fa95effd700 1 -- 172.21.15.45:0/3933035503 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fa950052500 con 0x7fa96815c9b0 2023-11-28T12:08:16.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.035+0000 7fa96cfff700 1 -- 172.21.15.45:0/3933035503 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa9680c8ee0 con 0x7fa96815c9b0 2023-11-28T12:08:16.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.035+0000 7fa95effd700 1 -- 172.21.15.45:0/3933035503 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4654 (secure 0 0 0) 0x7fa950021090 con 0x7fa96815c9b0 2023-11-28T12:08:16.037 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:08:16.038 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4805,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1232749056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1232749056},{"type":"v1","addr":"172.21.15.152:6837","nonce":1232749056}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4996,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/1358094304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":1358094304},{"type":"v1","addr":"172.21.15.45:6835","nonce":1358094304}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4999,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6836/2035520444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6835","nonce":2035520444},{"type":"v1","addr":"172.21.15.152:6836","nonce":2035520444}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T12:07:41.650740+0000","modified":"2023-11-28T12:07:44.849447+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5061},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5061":{"gid":5061,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.45:6834/2964277738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2964277738},{"type":"v1","addr":"172.21.15.45:6834","nonce":2964277738}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-28T12:08:16.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.038+0000 7fa96cfff700 1 -- 172.21.15.45:0/3933035503 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fa9480682f0 msgr2=0x7fa94806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:16.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.038+0000 7fa96cfff700 1 --2- 172.21.15.45:0/3933035503 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fa9480682f0 0x7fa94806a7a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa958000f60 tx=0x7fa958009040 comp rx=0 tx=0).stop 2023-11-28T12:08:16.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.038+0000 7fa96cfff700 1 -- 172.21.15.45:0/3933035503 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa96815c9b0 msgr2=0x7fa96814fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:16.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.038+0000 7fa96cfff700 1 --2- 172.21.15.45:0/3933035503 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa96815c9b0 0x7fa96814fed0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fa95000e9b0 tx=0x7fa95000ed70 comp rx=0 tx=0).stop 2023-11-28T12:08:16.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.038+0000 7fa96cfff700 1 -- 172.21.15.45:0/3933035503 shutdown_connections 2023-11-28T12:08:16.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.038+0000 7fa96cfff700 1 --2- 172.21.15.45:0/3933035503 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fa9480682f0 0x7fa94806a7a0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:16.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.038+0000 7fa96cfff700 1 --2- 172.21.15.45:0/3933035503 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa9680d2320 0x7fa968150690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:16.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.038+0000 7fa96cfff700 1 --2- 172.21.15.45:0/3933035503 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa968161340 0x7fa9681e7630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:16.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.038+0000 7fa96cfff700 1 --2- 172.21.15.45:0/3933035503 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa96815c9b0 0x7fa96814fed0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:16.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.038+0000 7fa96cfff700 1 -- 172.21.15.45:0/3933035503 >> 172.21.15.45:0/3933035503 conn(0x7fa968072600 msgr2=0x7fa9680b5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:16.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.038+0000 7fa96cfff700 1 -- 172.21.15.45:0/3933035503 shutdown_connections 2023-11-28T12:08:16.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.038+0000 7fa96cfff700 1 -- 172.21.15.45:0/3933035503 wait complete. 2023-11-28T12:08:16.041 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 16 2023-11-28T12:08:16.057 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T12:08:16.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.259+0000 7ff1d3bff700 1 Processor -- start 2023-11-28T12:08:16.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.260+0000 7ff1d3bff700 1 -- start start 2023-11-28T12:08:16.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.261+0000 7ff1d3bff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff1cc0cd7c0 0x7ff1cc0cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:16.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.261+0000 7ff1d3bff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1cc0d1950 con 0x7ff1cc161340 2023-11-28T12:08:16.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.261+0000 7ff1d3bff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1cc0ce140 con 0x7ff1cc15c9b0 2023-11-28T12:08:16.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.261+0000 7ff1d3bff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1cc0b5800 con 0x7ff1cc0cd7c0 2023-11-28T12:08:16.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.261+0000 7ff1d119a700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ff1cc161340 0x7ff1cc0d1de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44294/0 (socket says 172.21.15.45:44294) 2023-11-28T12:08:16.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.261+0000 7ff1d119a700 1 -- 172.21.15.45:0/3657144191 learned_addr learned my addr 172.21.15.45:0/3657144191 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:08:16.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.261+0000 7ff1d219c700 1 --2- 172.21.15.45:0/3657144191 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff1cc0cd7c0 0x7ff1cc0cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:16.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.262+0000 7ff1d0999700 1 -- 172.21.15.45:0/3657144191 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1343826693 0 0) 0x7ff1cc0d1950 con 0x7ff1cc161340 2023-11-28T12:08:16.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.262+0000 7ff1d0999700 1 -- 172.21.15.45:0/3657144191 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1b80035b0 con 0x7ff1cc161340 2023-11-28T12:08:16.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.262+0000 7ff1d0999700 1 -- 172.21.15.45:0/3657144191 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2933353491 0 0) 0x7ff1cc0ce140 con 0x7ff1cc15c9b0 2023-11-28T12:08:16.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.262+0000 7ff1d0999700 1 -- 172.21.15.45:0/3657144191 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1cc0d1950 con 0x7ff1cc15c9b0 2023-11-28T12:08:16.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.262+0000 7ff1d219c700 1 -- 172.21.15.45:0/3657144191 >> v1:172.21.15.152:6789/0 conn(0x7ff1cc15c9b0 legacy=0x7ff1cc0b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:16.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.262+0000 7ff1d219c700 1 -- 172.21.15.45:0/3657144191 >> v1:172.21.15.45:6789/0 conn(0x7ff1cc161340 legacy=0x7ff1cc0d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:16.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.262+0000 7ff1d219c700 1 -- 172.21.15.45:0/3657144191 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1cc0d24f0 con 0x7ff1cc0cd7c0 2023-11-28T12:08:16.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.262+0000 7ff1d219c700 1 --2- 172.21.15.45:0/3657144191 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff1cc0cd7c0 0x7ff1cc0cdc00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff1c4009dc0 tx=0x7ff1c400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f21d4ae6f9d7996 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:16.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.262+0000 7ff1d0999700 1 -- 172.21.15.45:0/3657144191 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c400e070 con 0x7ff1cc0cd7c0 2023-11-28T12:08:16.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.263+0000 7ff1d0999700 1 -- 172.21.15.45:0/3657144191 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1c400bb20 con 0x7ff1cc0cd7c0 2023-11-28T12:08:16.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.263+0000 7ff1d0999700 1 -- 172.21.15.45:0/3657144191 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c4012430 con 0x7ff1cc0cd7c0 2023-11-28T12:08:16.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.263+0000 7ff1d3bff700 1 -- 172.21.15.45:0/3657144191 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff1cc0cd7c0 msgr2=0x7ff1cc0cdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:16.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.263+0000 7ff1d3bff700 1 --2- 172.21.15.45:0/3657144191 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff1cc0cd7c0 0x7ff1cc0cdc00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff1c4009dc0 tx=0x7ff1c400b330 comp rx=0 tx=0).stop 2023-11-28T12:08:16.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.263+0000 7ff1d3bff700 1 -- 172.21.15.45:0/3657144191 shutdown_connections 2023-11-28T12:08:16.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.263+0000 7ff1d3bff700 1 --2- 172.21.15.45:0/3657144191 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff1cc0cd7c0 0x7ff1cc0cdc00 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:16.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.263+0000 7ff1d3bff700 1 -- 172.21.15.45:0/3657144191 >> 172.21.15.45:0/3657144191 conn(0x7ff1cc072600 msgr2=0x7ff1cc0cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:16.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.263+0000 7ff1d3bff700 1 -- 172.21.15.45:0/3657144191 shutdown_connections 2023-11-28T12:08:16.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.263+0000 7ff1d3bff700 1 -- 172.21.15.45:0/3657144191 wait complete. 2023-11-28T12:08:16.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.265+0000 7ff1d3bff700 1 Processor -- start 2023-11-28T12:08:16.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.265+0000 7ff1d3bff700 1 -- start start 2023-11-28T12:08:16.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.266+0000 7ff1d3bff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1cc0cd7c0 0x7ff1cc14a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:16.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.266+0000 7ff1d3bff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff1cc15c9b0 0x7ff1cc1f2d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:16.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.266+0000 7ff1d3bff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff1cc161340 0x7ff1cc0cac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:16.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.266+0000 7ff1d3bff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1cc0cd0f0 con 0x7ff1cc0cd7c0 2023-11-28T12:08:16.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.266+0000 7ff1d3bff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1cc14aa50 con 0x7ff1cc15c9b0 2023-11-28T12:08:16.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.266+0000 7ff1d3bff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1cc1f3570 con 0x7ff1cc161340 2023-11-28T12:08:16.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.266+0000 7ff1d199b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1cc0cd7c0 0x7ff1cc14a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:16.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.266+0000 7ff1d199b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1cc0cd7c0 0x7ff1cc14a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48758/0 (socket says 172.21.15.45:48758) 2023-11-28T12:08:16.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.266+0000 7ff1d199b700 1 -- 172.21.15.45:0/3622773282 learned_addr learned my addr 172.21.15.45:0/3622773282 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:16.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.267+0000 7ff1d219c700 1 --2- 172.21.15.45:0/3622773282 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff1cc161340 0x7ff1cc0cac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:16.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.267+0000 7ff1d119a700 1 --2- 172.21.15.45:0/3622773282 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff1cc15c9b0 0x7ff1cc1f2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:16.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.267+0000 7ff1d199b700 1 -- 172.21.15.45:0/3622773282 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff1cc161340 msgr2=0x7ff1cc0cac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:16.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.267+0000 7ff1d199b700 1 --2- 172.21.15.45:0/3622773282 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff1cc161340 0x7ff1cc0cac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:16.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.267+0000 7ff1d199b700 1 -- 172.21.15.45:0/3622773282 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff1cc15c9b0 msgr2=0x7ff1cc1f2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:16.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.267+0000 7ff1d199b700 1 --2- 172.21.15.45:0/3622773282 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff1cc15c9b0 0x7ff1cc1f2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:16.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.267+0000 7ff1d199b700 1 -- 172.21.15.45:0/3622773282 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1c4009a70 con 0x7ff1cc0cd7c0 2023-11-28T12:08:16.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.267+0000 7ff1d199b700 1 --2- 172.21.15.45:0/3622773282 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1cc0cd7c0 0x7ff1cc14a510 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7ff1c800c500 tx=0x7ff1c800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:16.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.267+0000 7ff1c27fc700 1 -- 172.21.15.45:0/3622773282 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c80052d0 con 0x7ff1cc0cd7c0 2023-11-28T12:08:16.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.267+0000 7ff1c27fc700 1 -- 172.21.15.45:0/3622773282 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1c8005450 con 0x7ff1cc0cd7c0 2023-11-28T12:08:16.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.267+0000 7ff1d3bff700 1 -- 172.21.15.45:0/3622773282 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1cc0d1300 con 0x7ff1cc0cd7c0 2023-11-28T12:08:16.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.267+0000 7ff1c27fc700 1 -- 172.21.15.45:0/3622773282 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c80038c0 con 0x7ff1cc0cd7c0 2023-11-28T12:08:16.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.268+0000 7ff1d3bff700 1 -- 172.21.15.45:0/3622773282 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1cc0b5520 con 0x7ff1cc0cd7c0 2023-11-28T12:08:16.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.269+0000 7ff1d3bff700 1 -- 172.21.15.45:0/3622773282 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1cc0d15e0 con 0x7ff1cc0cd7c0 2023-11-28T12:08:16.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.269+0000 7ff1c27fc700 1 -- 172.21.15.45:0/3622773282 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7ff1c8019030 con 0x7ff1cc0cd7c0 2023-11-28T12:08:16.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.272+0000 7ff1c27fc700 1 --2- 172.21.15.45:0/3622773282 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7ff1b00682f0 0x7ff1b006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:16.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.272+0000 7ff1c27fc700 1 -- 172.21.15.45:0/3622773282 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff1c8084ee0 con 0x7ff1cc0cd7c0 2023-11-28T12:08:16.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.272+0000 7ff1d119a700 1 --2- 172.21.15.45:0/3622773282 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7ff1b00682f0 0x7ff1b006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:16.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.272+0000 7ff1d119a700 1 --2- 172.21.15.45:0/3622773282 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7ff1b00682f0 0x7ff1b006a7a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc007fd0 tx=0x7ff1bc007dc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:16.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.276+0000 7ff1c27fc700 1 -- 172.21.15.45:0/3622773282 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7ff1c8051740 con 0x7ff1cc0cd7c0 2023-11-28T12:08:16.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.479+0000 7ff1d3bff700 1 -- 172.21.15.45:0/3622773282 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff1cc0745c0 con 0x7ff1cc0cd7c0 2023-11-28T12:08:16.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.480+0000 7ff1c27fc700 1 -- 172.21.15.45:0/3622773282 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+17921 (secure 0 0 0) 0x7ff1c8017090 con 0x7ff1cc0cd7c0 2023-11-28T12:08:16.482 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:08:16.482 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":34,"fsid":"bd7c37f1-f7c6-4778-b845-52cf2aa6e366","created":"2023-11-28T12:06:09.045075+0000","modified":"2023-11-28T12:07:42.653488+0000","last_up_change":"2023-11-28T12:06:21.282227+0000","last_in_change":"2023-11-28T12:06:12.560924+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T12:06:21.807108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T12:06:22.491009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-28T12:07:39.383009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-28T12:07:40.658112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d0cdd8a-87fd-4f2c-91bd-47bdfa661905","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":115843},{"type":"v1","addr":"172.21.15.45:6808","nonce":115843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":115843},{"type":"v1","addr":"172.21.15.45:6811","nonce":115843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":115843},{"type":"v1","addr":"172.21.15.45:6815","nonce":115843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":115843},{"type":"v1","addr":"172.21.15.45:6813","nonce":115843}]},"public_addr":"172.21.15.45:6808/115843","cluster_addr":"172.21.15.45:6811/115843","heartbeat_back_addr":"172.21.15.45:6815/115843","heartbeat_front_addr":"172.21.15.45:6813/115843","state":["exists","up"]},{"osd":1,"uuid":"c5de4ebd-9ec5-40b3-9caa-9b706fab4c76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":115842},{"type":"v1","addr":"172.21.15.45:6801","nonce":115842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":115842},{"type":"v1","addr":"172.21.15.45:6803","nonce":115842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6807","nonce":115842},{"type":"v1","addr":"172.21.15.45:6809","nonce":115842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":115842},{"type":"v1","addr":"172.21.15.45:6805","nonce":115842}]},"public_addr":"172.21.15.45:6801/115842","cluster_addr":"172.21.15.45:6803/115842","heartbeat_back_addr":"172.21.15.45:6809/115842","heartbeat_front_addr":"172.21.15.45:6805/115842","state":["exists","up"]},{"osd":2,"uuid":"9f4b36b2-65d2-40e7-9fe6-a2991afa71c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":115850},{"type":"v1","addr":"172.21.15.45:6819","nonce":115850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":115850},{"type":"v1","addr":"172.21.15.45:6823","nonce":115850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":115850},{"type":"v1","addr":"172.21.15.45:6831","nonce":115850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":115850},{"type":"v1","addr":"172.21.15.45:6828","nonce":115850}]},"public_addr":"172.21.15.45:6819/115850","cluster_addr":"172.21.15.45:6823/115850","heartbeat_back_addr":"172.21.15.45:6831/115850","heartbeat_front_addr":"172.21.15.45:6828/115850","state":["exists","up"]},{"osd":3,"uuid":"6fe7ef05-4e0d-426c-bf94-44b51d4d550b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":115848},{"type":"v1","addr":"172.21.15.45:6818","nonce":115848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":115848},{"type":"v1","addr":"172.21.15.45:6822","nonce":115848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6827","nonce":115848},{"type":"v1","addr":"172.21.15.45:6829","nonce":115848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":115848},{"type":"v1","addr":"172.21.15.45:6825","nonce":115848}]},"public_addr":"172.21.15.45:6818/115848","cluster_addr":"172.21.15.45:6822/115848","heartbeat_back_addr":"172.21.15.45:6829/115848","heartbeat_front_addr":"172.21.15.45:6825/115848","state":["exists","up"]},{"osd":4,"uuid":"fa403c08-d8a1-4a3a-8384-cb465c1a654c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":116092},{"type":"v1","addr":"172.21.15.152:6801","nonce":116092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":116092},{"type":"v1","addr":"172.21.15.152:6803","nonce":116092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":116092},{"type":"v1","addr":"172.21.15.152:6807","nonce":116092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":116092},{"type":"v1","addr":"172.21.15.152:6805","nonce":116092}]},"public_addr":"172.21.15.152:6801/116092","cluster_addr":"172.21.15.152:6803/116092","heartbeat_back_addr":"172.21.15.152:6807/116092","heartbeat_front_addr":"172.21.15.152:6805/116092","state":["exists","up"]},{"osd":5,"uuid":"399fc450-39fa-43a6-bf80-0b8bcb41bd95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6815","nonce":116093},{"type":"v1","addr":"172.21.15.152:6817","nonce":116093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":116093},{"type":"v1","addr":"172.21.15.152:6819","nonce":116093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":116093},{"type":"v1","addr":"172.21.15.152:6823","nonce":116093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":116093},{"type":"v1","addr":"172.21.15.152:6821","nonce":116093}]},"public_addr":"172.21.15.152:6817/116093","cluster_addr":"172.21.15.152:6819/116093","heartbeat_back_addr":"172.21.15.152:6823/116093","heartbeat_front_addr":"172.21.15.152:6821/116093","state":["exists","up"]},{"osd":6,"uuid":"e59a4017-2d23-4627-836b-e25b2d3ddaaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":116094},{"type":"v1","addr":"172.21.15.152:6809","nonce":116094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":116094},{"type":"v1","addr":"172.21.15.152:6811","nonce":116094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":116094},{"type":"v1","addr":"172.21.15.152:6816","nonce":116094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":116094},{"type":"v1","addr":"172.21.15.152:6813","nonce":116094}]},"public_addr":"172.21.15.152:6809/116094","cluster_addr":"172.21.15.152:6811/116094","heartbeat_back_addr":"172.21.15.152:6816/116094","heartbeat_front_addr":"172.21.15.152:6813/116094","state":["exists","up"]},{"osd":7,"uuid":"8d7f9d4b-bf08-4670-8591-388c0f012a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":116097},{"type":"v1","addr":"172.21.15.152:6825","nonce":116097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":116097},{"type":"v1","addr":"172.21.15.152:6827","nonce":116097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":116097},{"type":"v1","addr":"172.21.15.152:6831","nonce":116097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":116097},{"type":"v1","addr":"172.21.15.152:6829","nonce":116097}]},"public_addr":"172.21.15.152:6825/116097","cluster_addr":"172.21.15.152:6827/116097","heartbeat_back_addr":"172.21.15.152:6831/116097","heartbeat_front_addr":"172.21.15.152:6829/116097","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.937710+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.865423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.159434+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.913090+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.131647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.966255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.972583+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.177209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T12:08:16.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.483+0000 7ff1d3bff700 1 -- 172.21.15.45:0/3622773282 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7ff1b00682f0 msgr2=0x7ff1b006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:16.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.483+0000 7ff1d3bff700 1 --2- 172.21.15.45:0/3622773282 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7ff1b00682f0 0x7ff1b006a7a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc007fd0 tx=0x7ff1bc007dc0 comp rx=0 tx=0).stop 2023-11-28T12:08:16.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.483+0000 7ff1d3bff700 1 -- 172.21.15.45:0/3622773282 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1cc0cd7c0 msgr2=0x7ff1cc14a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:16.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.483+0000 7ff1d3bff700 1 --2- 172.21.15.45:0/3622773282 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1cc0cd7c0 0x7ff1cc14a510 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7ff1c800c500 tx=0x7ff1c800c810 comp rx=0 tx=0).stop 2023-11-28T12:08:16.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.483+0000 7ff1d3bff700 1 -- 172.21.15.45:0/3622773282 shutdown_connections 2023-11-28T12:08:16.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.483+0000 7ff1d3bff700 1 --2- 172.21.15.45:0/3622773282 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7ff1b00682f0 0x7ff1b006a7a0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:16.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.483+0000 7ff1d3bff700 1 --2- 172.21.15.45:0/3622773282 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff1cc161340 0x7ff1cc0cac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:16.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.483+0000 7ff1d3bff700 1 --2- 172.21.15.45:0/3622773282 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1cc0cd7c0 0x7ff1cc14a510 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:16.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.483+0000 7ff1d3bff700 1 --2- 172.21.15.45:0/3622773282 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff1cc15c9b0 0x7ff1cc1f2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:16.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.483+0000 7ff1d3bff700 1 -- 172.21.15.45:0/3622773282 >> 172.21.15.45:0/3622773282 conn(0x7ff1cc072600 msgr2=0x7ff1cc0d1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:16.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.483+0000 7ff1d3bff700 1 -- 172.21.15.45:0/3622773282 shutdown_connections 2023-11-28T12:08:16.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.483+0000 7ff1d3bff700 1 -- 172.21.15.45:0/3622773282 wait complete. 2023-11-28T12:08:16.503 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-28T12:08:16.503 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T12:08:16.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.706+0000 7f59e6fff700 1 Processor -- start 2023-11-28T12:08:16.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.706+0000 7f59e6fff700 1 -- start start 2023-11-28T12:08:16.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.707+0000 7f59e6fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f59e015c9b0 0x7f59e00b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:16.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.707+0000 7f59e6fff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f59e0161340 0x7f59e00d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:16.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.707+0000 7f59e6fff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f59e00d2320 0x7f59e00cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:16.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.707+0000 7f59e6fff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59e00b5800 con 0x7f59e015c9b0 2023-11-28T12:08:16.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.707+0000 7f59e6fff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59e00d1950 con 0x7f59e00d2320 2023-11-28T12:08:16.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.707+0000 7f59e6fff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59e00b5520 con 0x7f59e0161340 2023-11-28T12:08:16.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.707+0000 7f59e4d9b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f59e015c9b0 0x7f59e00b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:16.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.707+0000 7f59e4d9b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f59e015c9b0 0x7f59e00b4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48768/0 (socket says 172.21.15.45:48768) 2023-11-28T12:08:16.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.707+0000 7f59e4d9b700 1 -- 172.21.15.45:0/219516094 learned_addr learned my addr 172.21.15.45:0/219516094 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:16.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.708+0000 7f59e559c700 1 --2- 172.21.15.45:0/219516094 >> v2:172.21.15.152:3300/0 conn(0x7f59e00d2320 0x7f59e00cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:16.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.708+0000 7f59dffff700 1 --2- 172.21.15.45:0/219516094 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f59e0161340 0x7f59e00d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:16.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.708+0000 7f59e4d9b700 1 -- 172.21.15.45:0/219516094 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f59e0161340 msgr2=0x7f59e00d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:16.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.708+0000 7f59e4d9b700 1 --2- 172.21.15.45:0/219516094 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f59e0161340 0x7f59e00d1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:16.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.708+0000 7f59e4d9b700 1 -- 172.21.15.45:0/219516094 >> v2:172.21.15.152:3300/0 conn(0x7f59e00d2320 msgr2=0x7f59e00cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:16.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.708+0000 7f59e4d9b700 1 --2- 172.21.15.45:0/219516094 >> v2:172.21.15.152:3300/0 conn(0x7f59e00d2320 0x7f59e00cd7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:16.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.708+0000 7f59e4d9b700 1 -- 172.21.15.45:0/219516094 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59e00d1300 con 0x7f59e015c9b0 2023-11-28T12:08:16.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.708+0000 7f59e4d9b700 1 --2- 172.21.15.45:0/219516094 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59e015c9b0 0x7f59e00b4bf0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f59e008c4d0 tx=0x7f59d400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6498bd953d68823 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:16.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.708+0000 7f59df7fe700 1 -- 172.21.15.45:0/219516094 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d400e070 con 0x7f59e015c9b0 2023-11-28T12:08:16.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.708+0000 7f59df7fe700 1 -- 172.21.15.45:0/219516094 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59d400b9c0 con 0x7f59e015c9b0 2023-11-28T12:08:16.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.708+0000 7f59df7fe700 1 -- 172.21.15.45:0/219516094 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d400bd70 con 0x7f59e015c9b0 2023-11-28T12:08:16.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.709+0000 7f59e6fff700 1 -- 172.21.15.45:0/219516094 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59e015c9b0 msgr2=0x7f59e00b4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:16.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.709+0000 7f59e6fff700 1 --2- 172.21.15.45:0/219516094 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59e015c9b0 0x7f59e00b4bf0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f59e008c4d0 tx=0x7f59d400b330 comp rx=0 tx=0).stop 2023-11-28T12:08:16.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.709+0000 7f59e6fff700 1 -- 172.21.15.45:0/219516094 shutdown_connections 2023-11-28T12:08:16.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.709+0000 7f59e6fff700 1 --2- 172.21.15.45:0/219516094 >> v2:172.21.15.152:3300/0 conn(0x7f59e00d2320 0x7f59e00cd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:16.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.709+0000 7f59e6fff700 1 --2- 172.21.15.45:0/219516094 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59e015c9b0 0x7f59e00b4bf0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:16.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.709+0000 7f59e6fff700 1 --2- 172.21.15.45:0/219516094 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f59e0161340 0x7f59e00d1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:16.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.709+0000 7f59e6fff700 1 -- 172.21.15.45:0/219516094 >> 172.21.15.45:0/219516094 conn(0x7f59e0072600 msgr2=0x7f59e00cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:16.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.709+0000 7f59e6fff700 1 -- 172.21.15.45:0/219516094 shutdown_connections 2023-11-28T12:08:16.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.709+0000 7f59e6fff700 1 -- 172.21.15.45:0/219516094 wait complete. 2023-11-28T12:08:16.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.712+0000 7f59e6fff700 1 Processor -- start 2023-11-28T12:08:16.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.712+0000 7f59e6fff700 1 -- start start 2023-11-28T12:08:16.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.713+0000 7f59e6fff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f59e00d2320 0x7f59e014fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:16.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.713+0000 7f59e6fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59e015c9b0 0x7f59e01e6a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:16.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.713+0000 7f59e6fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59e0161340 0x7f59e01e6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:16.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.713+0000 7f59e6fff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59e01501f0 con 0x7f59e0161340 2023-11-28T12:08:16.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.713+0000 7f59e6fff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59e01e89d0 con 0x7f59e015c9b0 2023-11-28T12:08:16.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.713+0000 7f59e6fff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59e01e8130 con 0x7f59e00d2320 2023-11-28T12:08:16.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.713+0000 7f59e559c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59e0161340 0x7f59e01e6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:16.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.713+0000 7f59e559c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59e0161340 0x7f59e01e6fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48782/0 (socket says 172.21.15.45:48782) 2023-11-28T12:08:16.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.713+0000 7f59e559c700 1 -- 172.21.15.45:0/907643754 learned_addr learned my addr 172.21.15.45:0/907643754 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:16.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.713+0000 7f59e4d9b700 1 --2- 172.21.15.45:0/907643754 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f59e00d2320 0x7f59e014fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:16.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.713+0000 7f59dffff700 1 --2- 172.21.15.45:0/907643754 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59e015c9b0 0x7f59e01e6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:16.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.713+0000 7f59e559c700 1 -- 172.21.15.45:0/907643754 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f59e00d2320 msgr2=0x7f59e014fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:16.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.713+0000 7f59e559c700 1 --2- 172.21.15.45:0/907643754 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f59e00d2320 0x7f59e014fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:16.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.713+0000 7f59e559c700 1 -- 172.21.15.45:0/907643754 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59e015c9b0 msgr2=0x7f59e01e6a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:16.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.713+0000 7f59e559c700 1 --2- 172.21.15.45:0/907643754 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59e015c9b0 0x7f59e01e6a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:16.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.713+0000 7f59e559c700 1 -- 172.21.15.45:0/907643754 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59d4009b30 con 0x7f59e0161340 2023-11-28T12:08:16.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.713+0000 7f59e559c700 1 --2- 172.21.15.45:0/907643754 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59e0161340 0x7f59e01e6fc0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f59d800d5d0 tx=0x7f59d800d8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:16.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.713+0000 7f59dd7fa700 1 -- 172.21.15.45:0/907643754 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d80125f0 con 0x7f59e0161340 2023-11-28T12:08:16.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.713+0000 7f59dd7fa700 1 -- 172.21.15.45:0/907643754 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59d8012750 con 0x7f59e0161340 2023-11-28T12:08:16.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.713+0000 7f59dd7fa700 1 -- 172.21.15.45:0/907643754 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d8012b00 con 0x7f59e0161340 2023-11-28T12:08:16.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.713+0000 7f59e6fff700 1 -- 172.21.15.45:0/907643754 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59e00b5130 con 0x7f59e0161340 2023-11-28T12:08:16.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.713+0000 7f59e6fff700 1 -- 172.21.15.45:0/907643754 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59e00d15e0 con 0x7f59e0161340 2023-11-28T12:08:16.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.715+0000 7f59e6fff700 1 -- 172.21.15.45:0/907643754 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59e00b52c0 con 0x7f59e0161340 2023-11-28T12:08:16.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.715+0000 7f59dd7fa700 1 -- 172.21.15.45:0/907643754 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f59d8012c60 con 0x7f59e0161340 2023-11-28T12:08:16.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.717+0000 7f59dd7fa700 1 --2- 172.21.15.45:0/907643754 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f59c40682f0 0x7f59c406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:16.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.717+0000 7f59dd7fa700 1 -- 172.21.15.45:0/907643754 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f59d8085f00 con 0x7f59e0161340 2023-11-28T12:08:16.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.719+0000 7f59e4d9b700 1 --2- 172.21.15.45:0/907643754 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f59c40682f0 0x7f59c406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:16.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.719+0000 7f59e4d9b700 1 --2- 172.21.15.45:0/907643754 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f59c40682f0 0x7f59c406a7a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f59d400b370 tx=0x7f59d4009000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:16.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.721+0000 7f59dd7fa700 1 -- 172.21.15.45:0/907643754 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f59d8052670 con 0x7f59e0161340 2023-11-28T12:08:16.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.969+0000 7f59e6fff700 1 -- 172.21.15.45:0/907643754 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f59e00745c0 con 0x7f59e0161340 2023-11-28T12:08:16.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.969+0000 7f59dd7fa700 1 -- 172.21.15.45:0/907643754 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4654 (secure 0 0 0) 0x7f59d8055c90 con 0x7f59e0161340 2023-11-28T12:08:16.973 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:08:16.973 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4805,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1232749056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1232749056},{"type":"v1","addr":"172.21.15.152:6837","nonce":1232749056}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4996,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/1358094304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":1358094304},{"type":"v1","addr":"172.21.15.45:6835","nonce":1358094304}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4999,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6836/2035520444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6835","nonce":2035520444},{"type":"v1","addr":"172.21.15.152:6836","nonce":2035520444}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T12:07:41.650740+0000","modified":"2023-11-28T12:07:44.849447+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5061},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5061":{"gid":5061,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.45:6834/2964277738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2964277738},{"type":"v1","addr":"172.21.15.45:6834","nonce":2964277738}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-28T12:08:16.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.972+0000 7f59e6fff700 1 -- 172.21.15.45:0/907643754 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f59c40682f0 msgr2=0x7f59c406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:16.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.972+0000 7f59e6fff700 1 --2- 172.21.15.45:0/907643754 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f59c40682f0 0x7f59c406a7a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f59d400b370 tx=0x7f59d4009000 comp rx=0 tx=0).stop 2023-11-28T12:08:16.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.972+0000 7f59e6fff700 1 -- 172.21.15.45:0/907643754 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59e0161340 msgr2=0x7f59e01e6fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:16.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.972+0000 7f59e6fff700 1 --2- 172.21.15.45:0/907643754 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59e0161340 0x7f59e01e6fc0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f59d800d5d0 tx=0x7f59d800d8e0 comp rx=0 tx=0).stop 2023-11-28T12:08:16.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.972+0000 7f59e6fff700 1 -- 172.21.15.45:0/907643754 shutdown_connections 2023-11-28T12:08:16.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.972+0000 7f59e6fff700 1 --2- 172.21.15.45:0/907643754 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f59c40682f0 0x7f59c406a7a0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:16.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.972+0000 7f59e6fff700 1 --2- 172.21.15.45:0/907643754 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59e0161340 0x7f59e01e6fc0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:16.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.972+0000 7f59e6fff700 1 --2- 172.21.15.45:0/907643754 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f59e00d2320 0x7f59e014fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:16.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.972+0000 7f59e6fff700 1 --2- 172.21.15.45:0/907643754 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59e015c9b0 0x7f59e01e6a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:16.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.972+0000 7f59e6fff700 1 -- 172.21.15.45:0/907643754 >> 172.21.15.45:0/907643754 conn(0x7f59e0072600 msgr2=0x7f59e015cf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:16.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.972+0000 7f59e6fff700 1 -- 172.21.15.45:0/907643754 shutdown_connections 2023-11-28T12:08:16.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:16.972+0000 7f59e6fff700 1 -- 172.21.15.45:0/907643754 wait complete. 2023-11-28T12:08:16.975 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 16 2023-11-28T12:08:16.991 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T12:08:17.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.194+0000 7fad9e9ff700 1 Processor -- start 2023-11-28T12:08:17.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.195+0000 7fad9e9ff700 1 -- start start 2023-11-28T12:08:17.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.196+0000 7fad9e9ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fad980cd7c0 0x7fad980cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:17.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.196+0000 7fad9e9ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad980d1950 con 0x7fad98161340 2023-11-28T12:08:17.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.196+0000 7fad9e9ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad980ce140 con 0x7fad9815c9b0 2023-11-28T12:08:17.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.196+0000 7fad9e9ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad980b5800 con 0x7fad980cd7c0 2023-11-28T12:08:17.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.196+0000 7fad977fe700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fad98161340 0x7fad980d1de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44302/0 (socket says 172.21.15.45:44302) 2023-11-28T12:08:17.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.196+0000 7fad977fe700 1 -- 172.21.15.45:0/1498368102 learned_addr learned my addr 172.21.15.45:0/1498368102 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:08:17.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.196+0000 7fad9cf9c700 1 --2- 172.21.15.45:0/1498368102 >> v2:172.21.15.152:3300/0 conn(0x7fad980cd7c0 0x7fad980cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:17.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.196+0000 7fad96ffd700 1 -- 172.21.15.45:0/1498368102 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1380460359 0 0) 0x7fad980d1950 con 0x7fad98161340 2023-11-28T12:08:17.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.196+0000 7fad96ffd700 1 -- 172.21.15.45:0/1498368102 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad800035b0 con 0x7fad98161340 2023-11-28T12:08:17.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.197+0000 7fad96ffd700 1 -- 172.21.15.45:0/1498368102 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1020945511 0 0) 0x7fad800035b0 con 0x7fad98161340 2023-11-28T12:08:17.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.197+0000 7fad96ffd700 1 -- 172.21.15.45:0/1498368102 >> v2:172.21.15.152:3300/0 conn(0x7fad980cd7c0 msgr2=0x7fad980cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:17.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.197+0000 7fad96ffd700 1 --2- 172.21.15.45:0/1498368102 >> v2:172.21.15.152:3300/0 conn(0x7fad980cd7c0 0x7fad980cdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:17.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.197+0000 7fad96ffd700 1 -- 172.21.15.45:0/1498368102 >> v1:172.21.15.152:6789/0 conn(0x7fad9815c9b0 legacy=0x7fad980b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:17.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.197+0000 7fad96ffd700 1 -- 172.21.15.45:0/1498368102 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad980d24f0 con 0x7fad98161340 2023-11-28T12:08:17.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.197+0000 7fad96ffd700 1 -- 172.21.15.45:0/1498368102 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3460218165 0 0) 0x7fad8c001670 con 0x7fad98161340 2023-11-28T12:08:17.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.197+0000 7fad96ffd700 1 -- 172.21.15.45:0/1498368102 >> v1:172.21.15.45:6789/0 conn(0x7fad98161340 legacy=0x7fad980d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:17.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.197+0000 7fad96ffd700 1 --2- 172.21.15.45:0/1498368102 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad80003a00 0x7fad80003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:17.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.197+0000 7fad96ffd700 1 --2- 172.21.15.45:0/1498368102 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fad80004850 0x7fad80004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:17.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.197+0000 7fad96ffd700 1 --2- 172.21.15.45:0/1498368102 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fad80005200 0x7fad8000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:17.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.197+0000 7fad96ffd700 1 -- 172.21.15.45:0/1498368102 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad980b5800 con 0x7fad80005200 2023-11-28T12:08:17.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.197+0000 7fad96ffd700 1 -- 172.21.15.45:0/1498368102 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad8000c110 con 0x7fad80003a00 2023-11-28T12:08:17.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.197+0000 7fad96ffd700 1 -- 172.21.15.45:0/1498368102 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad8000c2d0 con 0x7fad80004850 2023-11-28T12:08:17.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.197+0000 7fad9cf9c700 1 --2- 172.21.15.45:0/1498368102 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fad80005200 0x7fad8000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:17.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.197+0000 7fad977fe700 1 --2- 172.21.15.45:0/1498368102 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fad80004850 0x7fad80004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:17.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.197+0000 7fad97fff700 1 --2- 172.21.15.45:0/1498368102 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad80003a00 0x7fad80003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:17.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.198+0000 7fad9cf9c700 1 -- 172.21.15.45:0/1498368102 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fad80004850 msgr2=0x7fad80004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:17.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.198+0000 7fad9cf9c700 1 --2- 172.21.15.45:0/1498368102 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fad80004850 0x7fad80004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:17.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.198+0000 7fad9cf9c700 1 -- 172.21.15.45:0/1498368102 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad80003a00 msgr2=0x7fad80003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:17.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.198+0000 7fad9cf9c700 1 --2- 172.21.15.45:0/1498368102 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad80003a00 0x7fad80003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:17.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.198+0000 7fad9cf9c700 1 -- 172.21.15.45:0/1498368102 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad800035b0 con 0x7fad80005200 2023-11-28T12:08:17.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.198+0000 7fad97fff700 1 --2- 172.21.15.45:0/1498368102 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad80003a00 0x7fad80003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:08:17.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.198+0000 7fad9cf9c700 1 -- 172.21.15.45:0/1498368102 reap_dead start 2023-11-28T12:08:17.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.198+0000 7fad9cf9c700 1 --2- 172.21.15.45:0/1498368102 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fad80005200 0x7fad8000ba10 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fad90009fc0 tx=0x7fad80005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9367c28eb48fcd15 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:17.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.198+0000 7fad96ffd700 1 -- 172.21.15.45:0/1498368102 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad90003a20 con 0x7fad80005200 2023-11-28T12:08:17.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.198+0000 7fad96ffd700 1 -- 172.21.15.45:0/1498368102 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad9000f040 con 0x7fad80005200 2023-11-28T12:08:17.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.199+0000 7fad96ffd700 1 -- 172.21.15.45:0/1498368102 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad90003de0 con 0x7fad80005200 2023-11-28T12:08:17.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.199+0000 7fad9e9ff700 1 -- 172.21.15.45:0/1498368102 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fad80005200 msgr2=0x7fad8000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:17.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.199+0000 7fad9e9ff700 1 --2- 172.21.15.45:0/1498368102 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fad80005200 0x7fad8000ba10 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fad90009fc0 tx=0x7fad80005880 comp rx=0 tx=0).stop 2023-11-28T12:08:17.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.199+0000 7fad9e9ff700 1 -- 172.21.15.45:0/1498368102 shutdown_connections 2023-11-28T12:08:17.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.199+0000 7fad9e9ff700 1 --2- 172.21.15.45:0/1498368102 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fad80005200 0x7fad8000ba10 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:17.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.199+0000 7fad9e9ff700 1 -- 172.21.15.45:0/1498368102 >> 172.21.15.45:0/1498368102 conn(0x7fad98072600 msgr2=0x7fad980cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:17.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.199+0000 7fad9e9ff700 1 -- 172.21.15.45:0/1498368102 shutdown_connections 2023-11-28T12:08:17.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.199+0000 7fad9e9ff700 1 -- 172.21.15.45:0/1498368102 wait complete. 2023-11-28T12:08:17.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.201+0000 7fad9e9ff700 1 Processor -- start 2023-11-28T12:08:17.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.201+0000 7fad9e9ff700 1 -- start start 2023-11-28T12:08:17.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.202+0000 7fad9e9ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad80005200 0x7fad9814d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:17.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.202+0000 7fad9e9ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fad980ca240 0x7fad980ccf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:17.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.202+0000 7fad9e9ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fad981f29a0 0x7fad9815ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:17.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.202+0000 7fad9e9ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad980cd630 con 0x7fad980ca240 2023-11-28T12:08:17.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.202+0000 7fad9e9ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad980ca6b0 con 0x7fad80005200 2023-11-28T12:08:17.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.202+0000 7fad9e9ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad98157aa0 con 0x7fad981f29a0 2023-11-28T12:08:17.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.202+0000 7fad977fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fad980ca240 0x7fad980ccf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:17.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.203+0000 7fad977fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fad980ca240 0x7fad980ccf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48812/0 (socket says 172.21.15.45:48812) 2023-11-28T12:08:17.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.203+0000 7fad977fe700 1 -- 172.21.15.45:0/1980875839 learned_addr learned my addr 172.21.15.45:0/1980875839 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:17.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.203+0000 7fad97fff700 1 --2- 172.21.15.45:0/1980875839 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad80005200 0x7fad9814d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:17.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.203+0000 7fad9cf9c700 1 --2- 172.21.15.45:0/1980875839 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fad981f29a0 0x7fad9815ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:17.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.203+0000 7fad977fe700 1 -- 172.21.15.45:0/1980875839 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fad981f29a0 msgr2=0x7fad9815ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:17.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.203+0000 7fad977fe700 1 --2- 172.21.15.45:0/1980875839 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fad981f29a0 0x7fad9815ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:17.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.203+0000 7fad977fe700 1 -- 172.21.15.45:0/1980875839 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad80005200 msgr2=0x7fad9814d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:17.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.203+0000 7fad977fe700 1 --2- 172.21.15.45:0/1980875839 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad80005200 0x7fad9814d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:17.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.203+0000 7fad977fe700 1 -- 172.21.15.45:0/1980875839 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad980d1300 con 0x7fad980ca240 2023-11-28T12:08:17.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.203+0000 7fad977fe700 1 --2- 172.21.15.45:0/1980875839 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fad980ca240 0x7fad980ccf50 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fad8c00ead0 tx=0x7fad8c00ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:17.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.203+0000 7fad94ff9700 1 -- 172.21.15.45:0/1980875839 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad8c005e50 con 0x7fad980ca240 2023-11-28T12:08:17.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.203+0000 7fad94ff9700 1 -- 172.21.15.45:0/1980875839 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad8c00c7e0 con 0x7fad980ca240 2023-11-28T12:08:17.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.203+0000 7fad9e9ff700 1 -- 172.21.15.45:0/1980875839 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad980b5520 con 0x7fad980ca240 2023-11-28T12:08:17.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.203+0000 7fad94ff9700 1 -- 172.21.15.45:0/1980875839 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad8c00cb90 con 0x7fad980ca240 2023-11-28T12:08:17.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.204+0000 7fad9e9ff700 1 -- 172.21.15.45:0/1980875839 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad980d15e0 con 0x7fad980ca240 2023-11-28T12:08:17.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.204+0000 7fad9e9ff700 1 -- 172.21.15.45:0/1980875839 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad980d0600 con 0x7fad980ca240 2023-11-28T12:08:17.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.205+0000 7fad94ff9700 1 -- 172.21.15.45:0/1980875839 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fad8c00ccf0 con 0x7fad980ca240 2023-11-28T12:08:17.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.206+0000 7fad94ff9700 1 --2- 172.21.15.45:0/1980875839 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fad840682f0 0x7fad8406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:17.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.206+0000 7fad94ff9700 1 -- 172.21.15.45:0/1980875839 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fad8c085d20 con 0x7fad980ca240 2023-11-28T12:08:17.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.207+0000 7fad97fff700 1 --2- 172.21.15.45:0/1980875839 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fad840682f0 0x7fad8406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:17.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.207+0000 7fad97fff700 1 --2- 172.21.15.45:0/1980875839 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fad840682f0 0x7fad8406a7a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fad88005530 tx=0x7fad88009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:17.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.210+0000 7fad94ff9700 1 -- 172.21.15.45:0/1980875839 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fad8c052490 con 0x7fad980ca240 2023-11-28T12:08:17.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.462+0000 7fad9e9ff700 1 -- 172.21.15.45:0/1980875839 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fad980745c0 con 0x7fad980ca240 2023-11-28T12:08:17.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.462+0000 7fad94ff9700 1 -- 172.21.15.45:0/1980875839 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4654 (secure 0 0 0) 0x7fad8c055ab0 con 0x7fad980ca240 2023-11-28T12:08:17.463 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:08:17.463 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4805,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1232749056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1232749056},{"type":"v1","addr":"172.21.15.152:6837","nonce":1232749056}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4996,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/1358094304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":1358094304},{"type":"v1","addr":"172.21.15.45:6835","nonce":1358094304}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4999,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6836/2035520444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6835","nonce":2035520444},{"type":"v1","addr":"172.21.15.152:6836","nonce":2035520444}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T12:07:41.650740+0000","modified":"2023-11-28T12:07:44.849447+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5061},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5061":{"gid":5061,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.45:6834/2964277738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2964277738},{"type":"v1","addr":"172.21.15.45:6834","nonce":2964277738}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-28T12:08:17.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.465+0000 7fad9e9ff700 1 -- 172.21.15.45:0/1980875839 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fad840682f0 msgr2=0x7fad8406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:17.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.465+0000 7fad9e9ff700 1 --2- 172.21.15.45:0/1980875839 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fad840682f0 0x7fad8406a7a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fad88005530 tx=0x7fad88009040 comp rx=0 tx=0).stop 2023-11-28T12:08:17.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.465+0000 7fad9e9ff700 1 -- 172.21.15.45:0/1980875839 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fad980ca240 msgr2=0x7fad980ccf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:17.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.465+0000 7fad9e9ff700 1 --2- 172.21.15.45:0/1980875839 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fad980ca240 0x7fad980ccf50 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fad8c00ead0 tx=0x7fad8c00ee90 comp rx=0 tx=0).stop 2023-11-28T12:08:17.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.465+0000 7fad9e9ff700 1 -- 172.21.15.45:0/1980875839 shutdown_connections 2023-11-28T12:08:17.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.465+0000 7fad9e9ff700 1 --2- 172.21.15.45:0/1980875839 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fad840682f0 0x7fad8406a7a0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:17.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.465+0000 7fad9e9ff700 1 --2- 172.21.15.45:0/1980875839 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fad80005200 0x7fad9814d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:17.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.465+0000 7fad9e9ff700 1 --2- 172.21.15.45:0/1980875839 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fad981f29a0 0x7fad9815ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:17.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.465+0000 7fad9e9ff700 1 --2- 172.21.15.45:0/1980875839 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fad980ca240 0x7fad980ccf50 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:17.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.465+0000 7fad9e9ff700 1 -- 172.21.15.45:0/1980875839 >> 172.21.15.45:0/1980875839 conn(0x7fad98072600 msgr2=0x7fad980b8690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:17.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.465+0000 7fad9e9ff700 1 -- 172.21.15.45:0/1980875839 shutdown_connections 2023-11-28T12:08:17.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.465+0000 7fad9e9ff700 1 -- 172.21.15.45:0/1980875839 wait complete. 2023-11-28T12:08:17.467 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 16 2023-11-28T12:08:17.484 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T12:08:17.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.687+0000 7f95fe9ff700 1 Processor -- start 2023-11-28T12:08:17.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.687+0000 7f95fe9ff700 1 -- start start 2023-11-28T12:08:17.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.688+0000 7f95fe9ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f95f815c9b0 0x7f95f80b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:17.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.688+0000 7f95fe9ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f95f8161340 0x7f95f80d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:17.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.688+0000 7f95fe9ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95f80d1950 con 0x7f95f80d2320 2023-11-28T12:08:17.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.688+0000 7f95fe9ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95f80b5800 con 0x7f95f8161340 2023-11-28T12:08:17.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.688+0000 7f95fe9ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95f80b5520 con 0x7f95f815c9b0 2023-11-28T12:08:17.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.688+0000 7f95effff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f95f8161340 0x7f95f80d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:17.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.688+0000 7f95fcf9c700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f95f80d2320 0x7f95f80cd7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44312/0 (socket says 172.21.15.45:44312) 2023-11-28T12:08:17.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.688+0000 7f95fcf9c700 1 -- 172.21.15.45:0/2759361180 learned_addr learned my addr 172.21.15.45:0/2759361180 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:08:17.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.689+0000 7f95f7fff700 1 --2- 172.21.15.45:0/2759361180 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f95f815c9b0 0x7f95f80b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:17.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.689+0000 7f95f77fe700 1 -- 172.21.15.45:0/2759361180 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2042637163 0 0) 0x7f95f80d1950 con 0x7f95f80d2320 2023-11-28T12:08:17.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.689+0000 7f95effff700 1 -- 172.21.15.45:0/2759361180 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f95f815c9b0 msgr2=0x7f95f80b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:17.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.689+0000 7f95effff700 1 --2- 172.21.15.45:0/2759361180 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f95f815c9b0 0x7f95f80b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:17.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.689+0000 7f95effff700 1 -- 172.21.15.45:0/2759361180 >> v1:172.21.15.45:6789/0 conn(0x7f95f80d2320 legacy=0x7f95f80cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:17.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.689+0000 7f95effff700 1 -- 172.21.15.45:0/2759361180 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95f80d1300 con 0x7f95f8161340 2023-11-28T12:08:17.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.689+0000 7f95effff700 1 --2- 172.21.15.45:0/2759361180 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95f8161340 0x7f95f80d1de0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f95e0009840 tx=0x7f95e0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=465235b1653e66e4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:17.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.689+0000 7f95f77fe700 1 -- 172.21.15.45:0/2759361180 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e0011830 con 0x7f95f8161340 2023-11-28T12:08:17.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.689+0000 7f95f77fe700 1 -- 172.21.15.45:0/2759361180 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95e0011990 con 0x7f95f8161340 2023-11-28T12:08:17.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.689+0000 7f95f77fe700 1 -- 172.21.15.45:0/2759361180 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e0011d20 con 0x7f95f8161340 2023-11-28T12:08:17.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.690+0000 7f95fe9ff700 1 -- 172.21.15.45:0/2759361180 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95f8161340 msgr2=0x7f95f80d1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:17.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.690+0000 7f95fe9ff700 1 --2- 172.21.15.45:0/2759361180 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95f8161340 0x7f95f80d1de0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f95e0009840 tx=0x7f95e0009b50 comp rx=0 tx=0).stop 2023-11-28T12:08:17.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.690+0000 7f95fe9ff700 1 -- 172.21.15.45:0/2759361180 shutdown_connections 2023-11-28T12:08:17.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.690+0000 7f95fe9ff700 1 --2- 172.21.15.45:0/2759361180 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f95f815c9b0 0x7f95f80b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:17.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.690+0000 7f95fe9ff700 1 --2- 172.21.15.45:0/2759361180 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95f8161340 0x7f95f80d1de0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:17.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.690+0000 7f95fe9ff700 1 -- 172.21.15.45:0/2759361180 >> 172.21.15.45:0/2759361180 conn(0x7f95f8072600 msgr2=0x7f95f80cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:17.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.690+0000 7f95fe9ff700 1 -- 172.21.15.45:0/2759361180 shutdown_connections 2023-11-28T12:08:17.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.690+0000 7f95fe9ff700 1 -- 172.21.15.45:0/2759361180 wait complete. 2023-11-28T12:08:17.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.692+0000 7f95fe9ff700 1 Processor -- start 2023-11-28T12:08:17.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.692+0000 7f95fe9ff700 1 -- start start 2023-11-28T12:08:17.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.693+0000 7f95fe9ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95f80d2320 0x7f95f80c6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:17.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.693+0000 7f95fe9ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f95f815c9b0 0x7f95f80c5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:17.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.693+0000 7f95fe9ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f95f8161340 0x7f95f815ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:17.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.693+0000 7f95fe9ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f81f27e0 con 0x7f95f80d2320 2023-11-28T12:08:17.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.693+0000 7f95fe9ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f80c86f0 con 0x7f95f8161340 2023-11-28T12:08:17.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.693+0000 7f95fe9ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95f81f2a20 con 0x7f95f815c9b0 2023-11-28T12:08:17.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.693+0000 7f95f7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95f80d2320 0x7f95f80c6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:17.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.693+0000 7f95f7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95f80d2320 0x7f95f80c6ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48830/0 (socket says 172.21.15.45:48830) 2023-11-28T12:08:17.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.693+0000 7f95f7fff700 1 -- 172.21.15.45:0/332234052 learned_addr learned my addr 172.21.15.45:0/332234052 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:17.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.693+0000 7f95effff700 1 --2- 172.21.15.45:0/332234052 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f95f815c9b0 0x7f95f80c5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:17.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.694+0000 7f95fcf9c700 1 --2- 172.21.15.45:0/332234052 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f95f8161340 0x7f95f815ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:17.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.694+0000 7f95f7fff700 1 -- 172.21.15.45:0/332234052 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f95f815c9b0 msgr2=0x7f95f80c5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:17.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.694+0000 7f95f7fff700 1 --2- 172.21.15.45:0/332234052 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f95f815c9b0 0x7f95f80c5eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:17.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.694+0000 7f95f7fff700 1 -- 172.21.15.45:0/332234052 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f95f8161340 msgr2=0x7f95f815ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:17.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.694+0000 7f95f7fff700 1 --2- 172.21.15.45:0/332234052 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f95f8161340 0x7f95f815ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:17.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.694+0000 7f95f7fff700 1 -- 172.21.15.45:0/332234052 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95e00094a0 con 0x7f95f80d2320 2023-11-28T12:08:17.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.694+0000 7f95fcf9c700 1 --2- 172.21.15.45:0/332234052 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f95f8161340 0x7f95f815ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:08:17.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.694+0000 7f95f7fff700 1 --2- 172.21.15.45:0/332234052 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95f80d2320 0x7f95f80c6ca0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f95e800d800 tx=0x7f95e800dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:17.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.694+0000 7f95f57fa700 1 -- 172.21.15.45:0/332234052 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e80125f0 con 0x7f95f80d2320 2023-11-28T12:08:17.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.694+0000 7f95f57fa700 1 -- 172.21.15.45:0/332234052 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95e8012750 con 0x7f95f80d2320 2023-11-28T12:08:17.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.694+0000 7f95f57fa700 1 -- 172.21.15.45:0/332234052 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e8012b00 con 0x7f95f80d2320 2023-11-28T12:08:17.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.694+0000 7f95fe9ff700 1 -- 172.21.15.45:0/332234052 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95f80b5130 con 0x7f95f80d2320 2023-11-28T12:08:17.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.694+0000 7f95fe9ff700 1 -- 172.21.15.45:0/332234052 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95f80d15e0 con 0x7f95f80d2320 2023-11-28T12:08:17.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.695+0000 7f95fe9ff700 1 -- 172.21.15.45:0/332234052 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95f80b52c0 con 0x7f95f80d2320 2023-11-28T12:08:17.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.696+0000 7f95f57fa700 1 -- 172.21.15.45:0/332234052 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f95e8012c60 con 0x7f95f80d2320 2023-11-28T12:08:17.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.697+0000 7f95f57fa700 1 --2- 172.21.15.45:0/332234052 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f95d80682f0 0x7f95d806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:17.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.697+0000 7f95f57fa700 1 -- 172.21.15.45:0/332234052 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f95e8086270 con 0x7f95f80d2320 2023-11-28T12:08:17.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.698+0000 7f95effff700 1 --2- 172.21.15.45:0/332234052 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f95d80682f0 0x7f95d806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:17.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.698+0000 7f95effff700 1 --2- 172.21.15.45:0/332234052 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f95d80682f0 0x7f95d806a7a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f95e00090b0 tx=0x7f95e0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:17.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.701+0000 7f95f57fa700 1 -- 172.21.15.45:0/332234052 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f95e80529e0 con 0x7f95f80d2320 2023-11-28T12:08:17.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.907+0000 7f95fe9ff700 1 -- 172.21.15.45:0/332234052 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f95f80745c0 con 0x7f95f80d2320 2023-11-28T12:08:17.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.908+0000 7f95f57fa700 1 -- 172.21.15.45:0/332234052 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+17921 (secure 0 0 0) 0x7f95e8056000 con 0x7f95f80d2320 2023-11-28T12:08:17.909 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:08:17.909 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":34,"fsid":"bd7c37f1-f7c6-4778-b845-52cf2aa6e366","created":"2023-11-28T12:06:09.045075+0000","modified":"2023-11-28T12:07:42.653488+0000","last_up_change":"2023-11-28T12:06:21.282227+0000","last_in_change":"2023-11-28T12:06:12.560924+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T12:06:21.807108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T12:06:22.491009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-11-28T12:07:39.383009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-11-28T12:07:40.658112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d0cdd8a-87fd-4f2c-91bd-47bdfa661905","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":115843},{"type":"v1","addr":"172.21.15.45:6808","nonce":115843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":115843},{"type":"v1","addr":"172.21.15.45:6811","nonce":115843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":115843},{"type":"v1","addr":"172.21.15.45:6815","nonce":115843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":115843},{"type":"v1","addr":"172.21.15.45:6813","nonce":115843}]},"public_addr":"172.21.15.45:6808/115843","cluster_addr":"172.21.15.45:6811/115843","heartbeat_back_addr":"172.21.15.45:6815/115843","heartbeat_front_addr":"172.21.15.45:6813/115843","state":["exists","up"]},{"osd":1,"uuid":"c5de4ebd-9ec5-40b3-9caa-9b706fab4c76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":115842},{"type":"v1","addr":"172.21.15.45:6801","nonce":115842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":115842},{"type":"v1","addr":"172.21.15.45:6803","nonce":115842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6807","nonce":115842},{"type":"v1","addr":"172.21.15.45:6809","nonce":115842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":115842},{"type":"v1","addr":"172.21.15.45:6805","nonce":115842}]},"public_addr":"172.21.15.45:6801/115842","cluster_addr":"172.21.15.45:6803/115842","heartbeat_back_addr":"172.21.15.45:6809/115842","heartbeat_front_addr":"172.21.15.45:6805/115842","state":["exists","up"]},{"osd":2,"uuid":"9f4b36b2-65d2-40e7-9fe6-a2991afa71c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":115850},{"type":"v1","addr":"172.21.15.45:6819","nonce":115850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":115850},{"type":"v1","addr":"172.21.15.45:6823","nonce":115850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":115850},{"type":"v1","addr":"172.21.15.45:6831","nonce":115850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":115850},{"type":"v1","addr":"172.21.15.45:6828","nonce":115850}]},"public_addr":"172.21.15.45:6819/115850","cluster_addr":"172.21.15.45:6823/115850","heartbeat_back_addr":"172.21.15.45:6831/115850","heartbeat_front_addr":"172.21.15.45:6828/115850","state":["exists","up"]},{"osd":3,"uuid":"6fe7ef05-4e0d-426c-bf94-44b51d4d550b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":115848},{"type":"v1","addr":"172.21.15.45:6818","nonce":115848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":115848},{"type":"v1","addr":"172.21.15.45:6822","nonce":115848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6827","nonce":115848},{"type":"v1","addr":"172.21.15.45:6829","nonce":115848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":115848},{"type":"v1","addr":"172.21.15.45:6825","nonce":115848}]},"public_addr":"172.21.15.45:6818/115848","cluster_addr":"172.21.15.45:6822/115848","heartbeat_back_addr":"172.21.15.45:6829/115848","heartbeat_front_addr":"172.21.15.45:6825/115848","state":["exists","up"]},{"osd":4,"uuid":"fa403c08-d8a1-4a3a-8384-cb465c1a654c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":116092},{"type":"v1","addr":"172.21.15.152:6801","nonce":116092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":116092},{"type":"v1","addr":"172.21.15.152:6803","nonce":116092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":116092},{"type":"v1","addr":"172.21.15.152:6807","nonce":116092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":116092},{"type":"v1","addr":"172.21.15.152:6805","nonce":116092}]},"public_addr":"172.21.15.152:6801/116092","cluster_addr":"172.21.15.152:6803/116092","heartbeat_back_addr":"172.21.15.152:6807/116092","heartbeat_front_addr":"172.21.15.152:6805/116092","state":["exists","up"]},{"osd":5,"uuid":"399fc450-39fa-43a6-bf80-0b8bcb41bd95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6815","nonce":116093},{"type":"v1","addr":"172.21.15.152:6817","nonce":116093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":116093},{"type":"v1","addr":"172.21.15.152:6819","nonce":116093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":116093},{"type":"v1","addr":"172.21.15.152:6823","nonce":116093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":116093},{"type":"v1","addr":"172.21.15.152:6821","nonce":116093}]},"public_addr":"172.21.15.152:6817/116093","cluster_addr":"172.21.15.152:6819/116093","heartbeat_back_addr":"172.21.15.152:6823/116093","heartbeat_front_addr":"172.21.15.152:6821/116093","state":["exists","up"]},{"osd":6,"uuid":"e59a4017-2d23-4627-836b-e25b2d3ddaaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":116094},{"type":"v1","addr":"172.21.15.152:6809","nonce":116094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":116094},{"type":"v1","addr":"172.21.15.152:6811","nonce":116094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":116094},{"type":"v1","addr":"172.21.15.152:6816","nonce":116094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":116094},{"type":"v1","addr":"172.21.15.152:6813","nonce":116094}]},"public_addr":"172.21.15.152:6809/116094","cluster_addr":"172.21.15.152:6811/116094","heartbeat_back_addr":"172.21.15.152:6816/116094","heartbeat_front_addr":"172.21.15.152:6813/116094","state":["exists","up"]},{"osd":7,"uuid":"8d7f9d4b-bf08-4670-8591-388c0f012a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":116097},{"type":"v1","addr":"172.21.15.152:6825","nonce":116097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":116097},{"type":"v1","addr":"172.21.15.152:6827","nonce":116097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":116097},{"type":"v1","addr":"172.21.15.152:6831","nonce":116097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":116097},{"type":"v1","addr":"172.21.15.152:6829","nonce":116097}]},"public_addr":"172.21.15.152:6825/116097","cluster_addr":"172.21.15.152:6827/116097","heartbeat_back_addr":"172.21.15.152:6831/116097","heartbeat_front_addr":"172.21.15.152:6829/116097","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.937710+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.865423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.159434+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.913090+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.131647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.966255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.972583+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.177209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T12:08:17.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.911+0000 7f95fe9ff700 1 -- 172.21.15.45:0/332234052 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f95d80682f0 msgr2=0x7f95d806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:17.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.911+0000 7f95fe9ff700 1 --2- 172.21.15.45:0/332234052 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f95d80682f0 0x7f95d806a7a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f95e00090b0 tx=0x7f95e0008030 comp rx=0 tx=0).stop 2023-11-28T12:08:17.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.911+0000 7f95fe9ff700 1 -- 172.21.15.45:0/332234052 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95f80d2320 msgr2=0x7f95f80c6ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:17.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.911+0000 7f95fe9ff700 1 --2- 172.21.15.45:0/332234052 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95f80d2320 0x7f95f80c6ca0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f95e800d800 tx=0x7f95e800dbc0 comp rx=0 tx=0).stop 2023-11-28T12:08:17.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.911+0000 7f95fe9ff700 1 -- 172.21.15.45:0/332234052 shutdown_connections 2023-11-28T12:08:17.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.911+0000 7f95fe9ff700 1 --2- 172.21.15.45:0/332234052 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f95d80682f0 0x7f95d806a7a0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:17.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.911+0000 7f95fe9ff700 1 --2- 172.21.15.45:0/332234052 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f95f8161340 0x7f95f815ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:17.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.911+0000 7f95fe9ff700 1 --2- 172.21.15.45:0/332234052 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95f80d2320 0x7f95f80c6ca0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:17.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.911+0000 7f95fe9ff700 1 --2- 172.21.15.45:0/332234052 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f95f815c9b0 0x7f95f80c5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:17.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.911+0000 7f95fe9ff700 1 -- 172.21.15.45:0/332234052 >> 172.21.15.45:0/332234052 conn(0x7f95f8072600 msgr2=0x7f95f815cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:17.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.911+0000 7f95fe9ff700 1 -- 172.21.15.45:0/332234052 shutdown_connections 2023-11-28T12:08:17.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:17.911+0000 7f95fe9ff700 1 -- 172.21.15.45:0/332234052 wait complete. 2023-11-28T12:08:17.930 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-28T12:08:18.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:18.135+0000 7fb1511ff700 1 Processor -- start 2023-11-28T12:08:18.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:18.136+0000 7fb1511ff700 1 -- start start 2023-11-28T12:08:18.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:18.137+0000 7fb1511ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb14c15c9b0 0x7fb14c0b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:18.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:18.137+0000 7fb1511ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb14c0cd7c0 0x7fb14c0cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:18.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:18.137+0000 7fb1511ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb14c0d1950 con 0x7fb14c161340 2023-11-28T12:08:18.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:18.137+0000 7fb1511ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb14c0b5800 con 0x7fb14c15c9b0 2023-11-28T12:08:18.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:18.137+0000 7fb1511ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb14c0ce140 con 0x7fb14c0cd7c0 2023-11-28T12:08:18.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:18.137+0000 7fb14ad9d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb14c15c9b0 0x7fb14c0b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:18.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:18.137+0000 7fb14a59c700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fb14c161340 0x7fb14c0d1de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44316/0 (socket says 172.21.15.45:44316) 2023-11-28T12:08:18.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:18.137+0000 7fb14a59c700 1 -- 172.21.15.45:0/4105108278 learned_addr learned my addr 172.21.15.45:0/4105108278 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:08:18.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:18.137+0000 7fb14b59e700 1 --2- 172.21.15.45:0/4105108278 >> v2:172.21.15.152:3300/0 conn(0x7fb14c0cd7c0 0x7fb14c0cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:18.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:18.137+0000 7fb14ad9d700 1 -- 172.21.15.45:0/4105108278 >> v2:172.21.15.152:3300/0 conn(0x7fb14c0cd7c0 msgr2=0x7fb14c0cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:18.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:18.137+0000 7fb14ad9d700 1 --2- 172.21.15.45:0/4105108278 >> v2:172.21.15.152:3300/0 conn(0x7fb14c0cd7c0 0x7fb14c0cdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:18.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:18.137+0000 7fb14ad9d700 1 -- 172.21.15.45:0/4105108278 >> v1:172.21.15.45:6789/0 conn(0x7fb14c161340 legacy=0x7fb14c0d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:18.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:18.137+0000 7fb14ad9d700 1 -- 172.21.15.45:0/4105108278 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb14c0d24f0 con 0x7fb14c15c9b0 2023-11-28T12:08:18.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:18.137+0000 7fb149d9b700 1 -- 172.21.15.45:0/4105108278 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2539521394 0 0) 0x7fb14c0d1950 con 0x7fb14c161340 2023-11-28T12:08:18.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:18.138+0000 7fb14ad9d700 1 --2- 172.21.15.45:0/4105108278 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb14c15c9b0 0x7fb14c0b4bf0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fb14c06c170 tx=0x7fb13c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f292d5c541f7ea server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:18.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:18.138+0000 7fb149d9b700 1 -- 172.21.15.45:0/4105108278 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13c011830 con 0x7fb14c15c9b0 2023-11-28T12:08:18.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:18.138+0000 7fb149d9b700 1 -- 172.21.15.45:0/4105108278 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb13c011990 con 0x7fb14c15c9b0 2023-11-28T12:08:18.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:18.138+0000 7fb149d9b700 1 -- 172.21.15.45:0/4105108278 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13c011d20 con 0x7fb14c15c9b0 2023-11-28T12:08:18.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:18.138+0000 7fb1511ff700 1 -- 172.21.15.45:0/4105108278 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb14c15c9b0 msgr2=0x7fb14c0b4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:18.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:18.138+0000 7fb1511ff700 1 --2- 172.21.15.45:0/4105108278 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb14c15c9b0 0x7fb14c0b4bf0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fb14c06c170 tx=0x7fb13c009b20 comp rx=0 tx=0).stop 2023-11-28T12:08:18.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:18.139+0000 7fb1511ff700 1 -- 172.21.15.45:0/4105108278 shutdown_connections 2023-11-28T12:08:18.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:18.139+0000 7fb1511ff700 1 --2- 172.21.15.45:0/4105108278 >> v2:172.21.15.152:3300/0 conn(0x7fb14c0cd7c0 0x7fb14c0cdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:18.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:18.139+0000 7fb1511ff700 1 --2- 172.21.15.45:0/4105108278 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb14c15c9b0 0x7fb14c0b4bf0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:18.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:18.139+0000 7fb1511ff700 1 -- 172.21.15.45:0/4105108278 >> 172.21.15.45:0/4105108278 conn(0x7fb14c072600 msgr2=0x7fb14c0cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:18.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:18.139+0000 7fb1511ff700 1 -- 172.21.15.45:0/4105108278 shutdown_connections 2023-11-28T12:08:18.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:18.139+0000 7fb1511ff700 1 -- 172.21.15.45:0/4105108278 wait complete. 2023-11-28T12:08:18.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:18.140+0000 7fb1511ff700 1 Processor -- start 2023-11-28T12:08:18.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:18.141+0000 7fb1511ff700 1 -- start start 2023-11-28T12:08:18.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:18.141+0000 7fb1511ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb14c0cd7c0 0x7fb14c143200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:18.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:18.141+0000 7fb1511ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb14c15c9b0 0x7fb14c1e8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:18.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:18.141+0000 7fb1511ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb14c161340 0x7fb14c1e6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:18.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:18.141+0000 7fb1511ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb14c15d350 con 0x7fb14c0cd7c0 2023-11-28T12:08:18.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:18.141+0000 7fb1511ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb14c0c7750 con 0x7fb14c15c9b0 2023-11-28T12:08:18.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:18.141+0000 7fb1511ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb14c15d5a0 con 0x7fb14c161340 2023-11-28T12:08:18.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:18.142+0000 7fb14ad9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb14c0cd7c0 0x7fb14c143200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:18.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:18.142+0000 7fb14ad9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb14c0cd7c0 0x7fb14c143200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48858/0 (socket says 172.21.15.45:48858) 2023-11-28T12:08:18.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:18.142+0000 7fb14ad9d700 1 -- 172.21.15.45:0/4186702891 learned_addr learned my addr 172.21.15.45:0/4186702891 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:18.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:18.142+0000 7fb14ad9d700 1 -- 172.21.15.45:0/4186702891 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb14c161340 msgr2=0x7fb14c1e6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:18.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:18.142+0000 7fb14ad9d700 1 --2- 172.21.15.45:0/4186702891 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb14c161340 0x7fb14c1e6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:18.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:18.142+0000 7fb14ad9d700 1 -- 172.21.15.45:0/4186702891 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb14c15c9b0 msgr2=0x7fb14c1e8ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:18.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:18.142+0000 7fb14ad9d700 1 --2- 172.21.15.45:0/4186702891 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb14c15c9b0 0x7fb14c1e8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:18.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:18.142+0000 7fb14ad9d700 1 -- 172.21.15.45:0/4186702891 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb13c0094a0 con 0x7fb14c0cd7c0 2023-11-28T12:08:18.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:18.142+0000 7fb14ad9d700 1 --2- 172.21.15.45:0/4186702891 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb14c0cd7c0 0x7fb14c143200 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fb13c014040 tx=0x7fb13c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:18.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:18.143+0000 7fb1337fe700 1 -- 172.21.15.45:0/4186702891 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13c0038a0 con 0x7fb14c0cd7c0 2023-11-28T12:08:18.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:18.143+0000 7fb1337fe700 1 -- 172.21.15.45:0/4186702891 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb13c01e070 con 0x7fb14c0cd7c0 2023-11-28T12:08:18.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:18.143+0000 7fb1337fe700 1 -- 172.21.15.45:0/4186702891 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13c003c20 con 0x7fb14c0cd7c0 2023-11-28T12:08:18.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:18.143+0000 7fb1511ff700 1 -- 172.21.15.45:0/4186702891 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb14c0d1300 con 0x7fb14c0cd7c0 2023-11-28T12:08:18.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:18.143+0000 7fb1511ff700 1 -- 172.21.15.45:0/4186702891 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb14c0b5520 con 0x7fb14c0cd7c0 2023-11-28T12:08:18.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:18.144+0000 7fb1511ff700 1 -- 172.21.15.45:0/4186702891 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb14c0d15e0 con 0x7fb14c0cd7c0 2023-11-28T12:08:18.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:18.145+0000 7fb1337fe700 1 -- 172.21.15.45:0/4186702891 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fb13c00f050 con 0x7fb14c0cd7c0 2023-11-28T12:08:18.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:18.145+0000 7fb1337fe700 1 --2- 172.21.15.45:0/4186702891 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb1380682c0 0x7fb13806a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:18.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:18.146+0000 7fb1337fe700 1 -- 172.21.15.45:0/4186702891 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6091+0+0 (secure 0 0 0) 0x7fb13c086de0 con 0x7fb14c0cd7c0 2023-11-28T12:08:18.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:18.146+0000 7fb14a59c700 1 --2- 172.21.15.45:0/4186702891 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb1380682c0 0x7fb13806a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:18.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:18.147+0000 7fb14a59c700 1 --2- 172.21.15.45:0/4186702891 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb1380682c0 0x7fb13806a770 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb140001610 tx=0x7fb1400079f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:18.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:18.150+0000 7fb1337fe700 1 -- 172.21.15.45:0/4186702891 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fb13c053530 con 0x7fb14c0cd7c0 2023-11-28T12:08:18.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:18.398+0000 7fb1511ff700 1 -- 172.21.15.45:0/4186702891 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fb14c0d2af0 con 0x7fb14c0cd7c0 2023-11-28T12:08:18.937 INFO:tasks.ceph.mon.a.smithi045.stderr:2023-11-28T12:08:18.937+0000 7fe5533f9700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-28T12:08:18.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:18.946+0000 7fb1337fe700 1 -- 172.21.15.45:0/4186702891 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v17) v1 ==== 161+0+0 (secure 0 0 0) 0x7fb13c015090 con 0x7fb14c0cd7c0 2023-11-28T12:08:18.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:18.949+0000 7fb1511ff700 1 -- 172.21.15.45:0/4186702891 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb1380682c0 msgr2=0x7fb13806a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:18.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:18.949+0000 7fb1511ff700 1 --2- 172.21.15.45:0/4186702891 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb1380682c0 0x7fb13806a770 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb140001610 tx=0x7fb1400079f0 comp rx=0 tx=0).stop 2023-11-28T12:08:18.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:18.949+0000 7fb1511ff700 1 -- 172.21.15.45:0/4186702891 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb14c0cd7c0 msgr2=0x7fb14c143200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:18.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:18.949+0000 7fb1511ff700 1 --2- 172.21.15.45:0/4186702891 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb14c0cd7c0 0x7fb14c143200 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fb13c014040 tx=0x7fb13c004750 comp rx=0 tx=0).stop 2023-11-28T12:08:18.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:18.949+0000 7fb1511ff700 1 -- 172.21.15.45:0/4186702891 shutdown_connections 2023-11-28T12:08:18.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:18.949+0000 7fb1511ff700 1 --2- 172.21.15.45:0/4186702891 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb1380682c0 0x7fb13806a770 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:18.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:18.949+0000 7fb1511ff700 1 --2- 172.21.15.45:0/4186702891 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb14c161340 0x7fb14c1e6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:18.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:18.949+0000 7fb1511ff700 1 --2- 172.21.15.45:0/4186702891 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb14c0cd7c0 0x7fb14c143200 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:18.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:18.949+0000 7fb1511ff700 1 --2- 172.21.15.45:0/4186702891 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb14c15c9b0 0x7fb14c1e8ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:18.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:18.949+0000 7fb1511ff700 1 -- 172.21.15.45:0/4186702891 >> 172.21.15.45:0/4186702891 conn(0x7fb14c072600 msgr2=0x7fb14c06a900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:18.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:18.950+0000 7fb1511ff700 1 -- 172.21.15.45:0/4186702891 shutdown_connections 2023-11-28T12:08:18.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:18.950+0000 7fb1511ff700 1 -- 172.21.15.45:0/4186702891 wait complete. 2023-11-28T12:08:18.951 INFO:teuthology.orchestra.run.smithi045.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-28T12:08:18.962 INFO:tasks.ceph.mds.a.smithi045.stderr: -7346> 2023-11-28T12:07:43.107+0000 7f23b53f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-28T12:08:18.972 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-28T12:08:19.021 INFO:tasks.ceph.mds.a.smithi045.stdout:starting mds.a at 2023-11-28T12:08:19.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:19.184+0000 7f79ea1ff700 1 Processor -- start 2023-11-28T12:08:19.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:19.184+0000 7f79ea1ff700 1 -- start start 2023-11-28T12:08:19.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:19.186+0000 7f79ea1ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f79e415c9b0 0x7f79e40b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:19.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:19.186+0000 7f79ea1ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f79e40cd7c0 0x7f79e40cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:19.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:19.186+0000 7f79ea1ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79e40d1950 con 0x7f79e4161340 2023-11-28T12:08:19.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:19.186+0000 7f79ea1ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79e40b5800 con 0x7f79e40cd7c0 2023-11-28T12:08:19.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:19.186+0000 7f79ea1ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79e40ce140 con 0x7f79e415c9b0 2023-11-28T12:08:19.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:19.186+0000 7f79e3fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f79e40cd7c0 0x7f79e40cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:19.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:19.186+0000 7f79e3fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f79e40cd7c0 0x7f79e40cdc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48880/0 (socket says 172.21.15.45:48880) 2023-11-28T12:08:19.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:19.186+0000 7f79e3fff700 1 -- 172.21.15.45:0/909650953 learned_addr learned my addr 172.21.15.45:0/909650953 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:19.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:19.186+0000 7f79e37fe700 1 --2- 172.21.15.45:0/909650953 >> v2:172.21.15.152:3300/0 conn(0x7f79e415c9b0 0x7f79e40b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:19.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:19.186+0000 7f79e3fff700 1 -- 172.21.15.45:0/909650953 >> v2:172.21.15.152:3300/0 conn(0x7f79e415c9b0 msgr2=0x7f79e40b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:19.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:19.186+0000 7f79e3fff700 1 --2- 172.21.15.45:0/909650953 >> v2:172.21.15.152:3300/0 conn(0x7f79e415c9b0 0x7f79e40b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:19.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:19.186+0000 7f79e3fff700 1 -- 172.21.15.45:0/909650953 >> v1:172.21.15.152:6789/0 conn(0x7f79e4161340 legacy=0x7f79e40d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:19.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:19.186+0000 7f79e3fff700 1 -- 172.21.15.45:0/909650953 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e40d24f0 con 0x7f79e40cd7c0 2023-11-28T12:08:19.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:19.187+0000 7f79e3fff700 1 --2- 172.21.15.45:0/909650953 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79e40cd7c0 0x7f79e40cdc00 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f79e4067460 tx=0x7f79dc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3419e4d2cf94d6bc server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:19.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:19.187+0000 7f79e27fc700 1 -- 172.21.15.45:0/909650953 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79dc00e070 con 0x7f79e40cd7c0 2023-11-28T12:08:19.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:19.187+0000 7f79e27fc700 1 -- 172.21.15.45:0/909650953 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79dc003a20 con 0x7f79e40cd7c0 2023-11-28T12:08:19.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:19.187+0000 7f79e27fc700 1 -- 172.21.15.45:0/909650953 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79dc003dd0 con 0x7f79e40cd7c0 2023-11-28T12:08:19.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:19.187+0000 7f79ea1ff700 1 -- 172.21.15.45:0/909650953 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79e40cd7c0 msgr2=0x7f79e40cdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:19.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:19.187+0000 7f79ea1ff700 1 --2- 172.21.15.45:0/909650953 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79e40cd7c0 0x7f79e40cdc00 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f79e4067460 tx=0x7f79dc00b330 comp rx=0 tx=0).stop 2023-11-28T12:08:19.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:19.188+0000 7f79ea1ff700 1 -- 172.21.15.45:0/909650953 shutdown_connections 2023-11-28T12:08:19.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:19.188+0000 7f79ea1ff700 1 --2- 172.21.15.45:0/909650953 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79e40cd7c0 0x7f79e40cdc00 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:19.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:19.188+0000 7f79ea1ff700 1 --2- 172.21.15.45:0/909650953 >> v2:172.21.15.152:3300/0 conn(0x7f79e415c9b0 0x7f79e40b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:19.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:19.188+0000 7f79ea1ff700 1 -- 172.21.15.45:0/909650953 >> 172.21.15.45:0/909650953 conn(0x7f79e4072600 msgr2=0x7f79e40cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:19.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:19.188+0000 7f79ea1ff700 1 -- 172.21.15.45:0/909650953 shutdown_connections 2023-11-28T12:08:19.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:19.188+0000 7f79ea1ff700 1 -- 172.21.15.45:0/909650953 wait complete. 2023-11-28T12:08:19.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:19.190+0000 7f79ea1ff700 1 Processor -- start 2023-11-28T12:08:19.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:19.190+0000 7f79ea1ff700 1 -- start start 2023-11-28T12:08:19.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:19.191+0000 7f79ea1ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79e40cd7c0 0x7f79e4154590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:19.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:19.191+0000 7f79ea1ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79e415c9b0 0x7f79e40c6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:19.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:19.191+0000 7f79ea1ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f79e4161340 0x7f79e415eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:19.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:19.191+0000 7f79ea1ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e41f25f0 con 0x7f79e415c9b0 2023-11-28T12:08:19.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:19.191+0000 7f79ea1ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e40c8460 con 0x7f79e40cd7c0 2023-11-28T12:08:19.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:19.192+0000 7f79ea1ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79e40c7640 con 0x7f79e4161340 2023-11-28T12:08:19.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:19.192+0000 7f79e2ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79e415c9b0 0x7f79e40c6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:19.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:19.192+0000 7f79e2ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79e415c9b0 0x7f79e40c6ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48894/0 (socket says 172.21.15.45:48894) 2023-11-28T12:08:19.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:19.192+0000 7f79e2ffd700 1 -- 172.21.15.45:0/4065083670 learned_addr learned my addr 172.21.15.45:0/4065083670 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:19.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:19.192+0000 7f79e37fe700 1 --2- 172.21.15.45:0/4065083670 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79e40cd7c0 0x7f79e4154590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:19.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:19.192+0000 7f79e3fff700 1 --2- 172.21.15.45:0/4065083670 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f79e4161340 0x7f79e415eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:19.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:19.192+0000 7f79e2ffd700 1 -- 172.21.15.45:0/4065083670 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f79e4161340 msgr2=0x7f79e415eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:19.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:19.192+0000 7f79e2ffd700 1 --2- 172.21.15.45:0/4065083670 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f79e4161340 0x7f79e415eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:19.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:19.192+0000 7f79e2ffd700 1 -- 172.21.15.45:0/4065083670 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79e40cd7c0 msgr2=0x7f79e4154590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:19.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:19.192+0000 7f79e2ffd700 1 --2- 172.21.15.45:0/4065083670 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79e40cd7c0 0x7f79e4154590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:19.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:19.192+0000 7f79e2ffd700 1 -- 172.21.15.45:0/4065083670 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79dc009b30 con 0x7f79e415c9b0 2023-11-28T12:08:19.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:19.192+0000 7f79e37fe700 1 --2- 172.21.15.45:0/4065083670 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79e40cd7c0 0x7f79e4154590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:08:19.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:19.193+0000 7f79e2ffd700 1 --2- 172.21.15.45:0/4065083670 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79e415c9b0 0x7f79e40c6ca0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f79d800b4a0 tx=0x7f79d800b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:19.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:19.193+0000 7f79cbfff700 1 -- 172.21.15.45:0/4065083670 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d8011830 con 0x7f79e415c9b0 2023-11-28T12:08:19.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:19.193+0000 7f79cbfff700 1 -- 172.21.15.45:0/4065083670 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79d8011990 con 0x7f79e415c9b0 2023-11-28T12:08:19.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:19.193+0000 7f79cbfff700 1 -- 172.21.15.45:0/4065083670 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d8011d40 con 0x7f79e415c9b0 2023-11-28T12:08:19.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:19.193+0000 7f79ea1ff700 1 -- 172.21.15.45:0/4065083670 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79e40d1300 con 0x7f79e415c9b0 2023-11-28T12:08:19.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:19.193+0000 7f79ea1ff700 1 -- 172.21.15.45:0/4065083670 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79e40b5520 con 0x7f79e415c9b0 2023-11-28T12:08:19.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:19.194+0000 7f79ea1ff700 1 -- 172.21.15.45:0/4065083670 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79e40d15e0 con 0x7f79e415c9b0 2023-11-28T12:08:19.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:19.195+0000 7f79cbfff700 1 -- 172.21.15.45:0/4065083670 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f79d800f050 con 0x7f79e415c9b0 2023-11-28T12:08:19.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:19.196+0000 7f79cbfff700 1 --2- 172.21.15.45:0/4065083670 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f79d00682f0 0x7f79d006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:19.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:19.196+0000 7f79cbfff700 1 -- 172.21.15.45:0/4065083670 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f79d80858e0 con 0x7f79e415c9b0 2023-11-28T12:08:19.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:19.197+0000 7f79e37fe700 1 --2- 172.21.15.45:0/4065083670 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f79d00682f0 0x7f79d006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:19.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:19.197+0000 7f79e37fe700 1 --2- 172.21.15.45:0/4065083670 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f79d00682f0 0x7f79d006a7a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f79e41f5af0 tx=0x7f79d4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:19.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:19.201+0000 7f79cbfff700 1 -- 172.21.15.45:0/4065083670 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f79d8051f70 con 0x7f79e415c9b0 2023-11-28T12:08:19.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:19.446+0000 7f79ea1ff700 1 -- 172.21.15.45:0/4065083670 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f79e415cd80 con 0x7f79e415c9b0 2023-11-28T12:08:19.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:19.948+0000 7f79cbfff700 1 -- 172.21.15.45:0/4065083670 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v18) v1 ==== 104+0+0 (secure 0 0 0) 0x7f79d8055590 con 0x7f79e415c9b0 2023-11-28T12:08:19.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:19.951+0000 7f79ea1ff700 1 -- 172.21.15.45:0/4065083670 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f79d00682f0 msgr2=0x7f79d006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:19.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:19.951+0000 7f79ea1ff700 1 --2- 172.21.15.45:0/4065083670 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f79d00682f0 0x7f79d006a7a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f79e41f5af0 tx=0x7f79d4008040 comp rx=0 tx=0).stop 2023-11-28T12:08:19.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:19.951+0000 7f79ea1ff700 1 -- 172.21.15.45:0/4065083670 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79e415c9b0 msgr2=0x7f79e40c6ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:19.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:19.951+0000 7f79ea1ff700 1 --2- 172.21.15.45:0/4065083670 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79e415c9b0 0x7f79e40c6ca0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f79d800b4a0 tx=0x7f79d800b7b0 comp rx=0 tx=0).stop 2023-11-28T12:08:19.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:19.951+0000 7f79ea1ff700 1 -- 172.21.15.45:0/4065083670 shutdown_connections 2023-11-28T12:08:19.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:19.951+0000 7f79ea1ff700 1 --2- 172.21.15.45:0/4065083670 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f79d00682f0 0x7f79d006a7a0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:19.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:19.951+0000 7f79ea1ff700 1 --2- 172.21.15.45:0/4065083670 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79e40cd7c0 0x7f79e4154590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:19.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:19.951+0000 7f79ea1ff700 1 --2- 172.21.15.45:0/4065083670 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f79e4161340 0x7f79e415eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:19.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:19.951+0000 7f79ea1ff700 1 --2- 172.21.15.45:0/4065083670 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79e415c9b0 0x7f79e40c6ca0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:19.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:19.951+0000 7f79ea1ff700 1 -- 172.21.15.45:0/4065083670 >> 172.21.15.45:0/4065083670 conn(0x7f79e4072600 msgr2=0x7f79e40b5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:19.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:19.951+0000 7f79ea1ff700 1 -- 172.21.15.45:0/4065083670 shutdown_connections 2023-11-28T12:08:19.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:19.951+0000 7f79ea1ff700 1 -- 172.21.15.45:0/4065083670 wait complete. 2023-11-28T12:08:19.971 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-28T12:08:20.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:20.181+0000 7f9532fff700 1 Processor -- start 2023-11-28T12:08:20.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:20.181+0000 7f9532fff700 1 -- start start 2023-11-28T12:08:20.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:20.182+0000 7f9532fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f952c15a760 0x7f952c161200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:20.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:20.183+0000 7f9532fff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f952c15dc30 0x7f952c0b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:20.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:20.183+0000 7f9532fff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f952c15e0a0 con 0x7f952c0cd7c0 2023-11-28T12:08:20.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:20.183+0000 7f9532fff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f952c15ab30 con 0x7f952c15a760 2023-11-28T12:08:20.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:20.183+0000 7f9532fff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f952c160d70 con 0x7f952c15dc30 2023-11-28T12:08:20.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:20.183+0000 7f9530d9b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f952c15a760 0x7f952c161200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:20.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:20.183+0000 7f9530d9b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f952c15a760 0x7f952c161200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48900/0 (socket says 172.21.15.45:48900) 2023-11-28T12:08:20.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:20.183+0000 7f9530d9b700 1 -- 172.21.15.45:0/4173603148 learned_addr learned my addr 172.21.15.45:0/4173603148 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:20.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:20.183+0000 7f952bfff700 1 --2- 172.21.15.45:0/4173603148 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f952c15dc30 0x7f952c0b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:20.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:20.183+0000 7f9530d9b700 1 -- 172.21.15.45:0/4173603148 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f952c15dc30 msgr2=0x7f952c0b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:20.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:20.183+0000 7f9530d9b700 1 --2- 172.21.15.45:0/4173603148 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f952c15dc30 0x7f952c0b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:20.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:20.183+0000 7f9530d9b700 1 -- 172.21.15.45:0/4173603148 >> v1:172.21.15.152:6789/0 conn(0x7f952c0cd7c0 legacy=0x7f952c0d0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:20.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:20.183+0000 7f9530d9b700 1 -- 172.21.15.45:0/4173603148 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f952c0b5130 con 0x7f952c15a760 2023-11-28T12:08:20.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:20.183+0000 7f952bfff700 1 --2- 172.21.15.45:0/4173603148 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f952c15dc30 0x7f952c0b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:08:20.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:20.184+0000 7f9530d9b700 1 --2- 172.21.15.45:0/4173603148 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f952c15a760 0x7f952c161200 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f95200098f0 tx=0x7f9520009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9d1ca8f914fce5e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:20.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:20.184+0000 7f952b7fe700 1 -- 172.21.15.45:0/4173603148 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f952000b8a0 con 0x7f952c15a760 2023-11-28T12:08:20.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:20.184+0000 7f952b7fe700 1 -- 172.21.15.45:0/4173603148 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f952000ba00 con 0x7f952c15a760 2023-11-28T12:08:20.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:20.184+0000 7f952b7fe700 1 -- 172.21.15.45:0/4173603148 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f952000bd90 con 0x7f952c15a760 2023-11-28T12:08:20.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:20.184+0000 7f9532fff700 1 -- 172.21.15.45:0/4173603148 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f952c15a760 msgr2=0x7f952c161200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:20.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:20.184+0000 7f9532fff700 1 --2- 172.21.15.45:0/4173603148 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f952c15a760 0x7f952c161200 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f95200098f0 tx=0x7f9520009c00 comp rx=0 tx=0).stop 2023-11-28T12:08:20.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:20.185+0000 7f9532fff700 1 -- 172.21.15.45:0/4173603148 shutdown_connections 2023-11-28T12:08:20.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:20.185+0000 7f9532fff700 1 --2- 172.21.15.45:0/4173603148 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f952c15a760 0x7f952c161200 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:20.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:20.185+0000 7f9532fff700 1 --2- 172.21.15.45:0/4173603148 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f952c15dc30 0x7f952c0b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:20.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:20.185+0000 7f9532fff700 1 -- 172.21.15.45:0/4173603148 >> 172.21.15.45:0/4173603148 conn(0x7f952c072620 msgr2=0x7f952c0cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:20.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:20.185+0000 7f9532fff700 1 -- 172.21.15.45:0/4173603148 shutdown_connections 2023-11-28T12:08:20.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:20.185+0000 7f9532fff700 1 -- 172.21.15.45:0/4173603148 wait complete. 2023-11-28T12:08:20.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:20.186+0000 7f9532fff700 1 Processor -- start 2023-11-28T12:08:20.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:20.187+0000 7f9532fff700 1 -- start start 2023-11-28T12:08:20.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:20.188+0000 7f9532fff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f952c0cd7c0 0x7f952c1f6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:20.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:20.188+0000 7f9532fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f952c15a760 0x7f952c1f1d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:20.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:20.188+0000 7f9532fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f952c15dc30 0x7f952c0d0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:20.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:20.188+0000 7f9532fff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f952c0b62f0 con 0x7f952c15a760 2023-11-28T12:08:20.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:20.188+0000 7f9532fff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f952c1f69c0 con 0x7f952c15dc30 2023-11-28T12:08:20.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:20.188+0000 7f9532fff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f952c0b8840 con 0x7f952c0cd7c0 2023-11-28T12:08:20.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:20.188+0000 7f952bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f952c15a760 0x7f952c1f1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:20.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:20.188+0000 7f952bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f952c15a760 0x7f952c1f1d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48906/0 (socket says 172.21.15.45:48906) 2023-11-28T12:08:20.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:20.188+0000 7f952bfff700 1 -- 172.21.15.45:0/2296750292 learned_addr learned my addr 172.21.15.45:0/2296750292 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:20.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:20.188+0000 7f9530d9b700 1 --2- 172.21.15.45:0/2296750292 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f952c0cd7c0 0x7f952c1f6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:20.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:20.188+0000 7f953159c700 1 --2- 172.21.15.45:0/2296750292 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f952c15dc30 0x7f952c0d0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:20.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:20.188+0000 7f952bfff700 1 -- 172.21.15.45:0/2296750292 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f952c0cd7c0 msgr2=0x7f952c1f6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:20.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:20.188+0000 7f952bfff700 1 --2- 172.21.15.45:0/2296750292 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f952c0cd7c0 0x7f952c1f6480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:20.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:20.188+0000 7f952bfff700 1 -- 172.21.15.45:0/2296750292 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f952c15dc30 msgr2=0x7f952c0d0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:20.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:20.188+0000 7f952bfff700 1 --2- 172.21.15.45:0/2296750292 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f952c15dc30 0x7f952c0d0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:20.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:20.188+0000 7f952bfff700 1 -- 172.21.15.45:0/2296750292 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9520009550 con 0x7f952c15a760 2023-11-28T12:08:20.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:20.188+0000 7f953159c700 1 --2- 172.21.15.45:0/2296750292 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f952c15dc30 0x7f952c0d0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:08:20.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:20.189+0000 7f952bfff700 1 --2- 172.21.15.45:0/2296750292 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f952c15a760 0x7f952c1f1d60 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f951800c7f0 tx=0x7f951800cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:20.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:20.189+0000 7f95297fa700 1 -- 172.21.15.45:0/2296750292 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9518011800 con 0x7f952c15a760 2023-11-28T12:08:20.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:20.189+0000 7f95297fa700 1 -- 172.21.15.45:0/2296750292 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9518011960 con 0x7f952c15a760 2023-11-28T12:08:20.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:20.189+0000 7f95297fa700 1 -- 172.21.15.45:0/2296750292 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9518011d10 con 0x7f952c15a760 2023-11-28T12:08:20.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:20.189+0000 7f9532fff700 1 -- 172.21.15.45:0/2296750292 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f952c0b5670 con 0x7f952c15a760 2023-11-28T12:08:20.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:20.189+0000 7f9532fff700 1 -- 172.21.15.45:0/2296750292 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f952c0b5390 con 0x7f952c15a760 2023-11-28T12:08:20.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:20.190+0000 7f9532fff700 1 -- 172.21.15.45:0/2296750292 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f952c160720 con 0x7f952c15a760 2023-11-28T12:08:20.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:20.191+0000 7f95297fa700 1 -- 172.21.15.45:0/2296750292 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f9518021070 con 0x7f952c15a760 2023-11-28T12:08:20.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:20.192+0000 7f95297fa700 1 --2- 172.21.15.45:0/2296750292 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f95100682f0 0x7f951006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:20.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:20.192+0000 7f95297fa700 1 -- 172.21.15.45:0/2296750292 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f9518085c50 con 0x7f952c15a760 2023-11-28T12:08:20.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:20.193+0000 7f9530d9b700 1 --2- 172.21.15.45:0/2296750292 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f95100682f0 0x7f951006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:20.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:20.193+0000 7f9530d9b700 1 --2- 172.21.15.45:0/2296750292 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f95100682f0 0x7f951006a7a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9520009c40 tx=0x7f9520008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:20.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:20.196+0000 7f95297fa700 1 -- 172.21.15.45:0/2296750292 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f9518052340 con 0x7f952c15a760 2023-11-28T12:08:20.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:20.402+0000 7f9532fff700 1 -- 172.21.15.45:0/2296750292 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f952c0d08a0 con 0x7f952c15a760 2023-11-28T12:08:20.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:20.952+0000 7f95297fa700 1 -- 172.21.15.45:0/2296750292 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v37) v1 ==== 181+0+0 (secure 0 0 0) 0x7f9518055960 con 0x7f952c15a760 2023-11-28T12:08:20.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:20.956+0000 7f9532fff700 1 -- 172.21.15.45:0/2296750292 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f95100682f0 msgr2=0x7f951006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:20.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:20.956+0000 7f9532fff700 1 --2- 172.21.15.45:0/2296750292 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f95100682f0 0x7f951006a7a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9520009c40 tx=0x7f9520008030 comp rx=0 tx=0).stop 2023-11-28T12:08:20.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:20.957+0000 7f9532fff700 1 -- 172.21.15.45:0/2296750292 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f952c15a760 msgr2=0x7f952c1f1d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:20.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:20.957+0000 7f9532fff700 1 --2- 172.21.15.45:0/2296750292 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f952c15a760 0x7f952c1f1d60 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f951800c7f0 tx=0x7f951800cbb0 comp rx=0 tx=0).stop 2023-11-28T12:08:20.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:20.957+0000 7f9532fff700 1 -- 172.21.15.45:0/2296750292 shutdown_connections 2023-11-28T12:08:20.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:20.957+0000 7f9532fff700 1 --2- 172.21.15.45:0/2296750292 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f95100682f0 0x7f951006a7a0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:20.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:20.957+0000 7f9532fff700 1 --2- 172.21.15.45:0/2296750292 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f952c15dc30 0x7f952c0d0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:20.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:20.957+0000 7f9532fff700 1 --2- 172.21.15.45:0/2296750292 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f952c0cd7c0 0x7f952c1f6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:20.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:20.957+0000 7f9532fff700 1 --2- 172.21.15.45:0/2296750292 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f952c15a760 0x7f952c1f1d60 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:20.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:20.957+0000 7f9532fff700 1 -- 172.21.15.45:0/2296750292 >> 172.21.15.45:0/2296750292 conn(0x7f952c072620 msgr2=0x7f952c15d170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:20.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:20.957+0000 7f9532fff700 1 -- 172.21.15.45:0/2296750292 shutdown_connections 2023-11-28T12:08:20.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:20.957+0000 7f9532fff700 1 -- 172.21.15.45:0/2296750292 wait complete. 2023-11-28T12:08:20.960 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' removed 2023-11-28T12:08:20.979 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-28T12:08:21.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:21.191+0000 7efc943ff700 1 Processor -- start 2023-11-28T12:08:21.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:21.191+0000 7efc943ff700 1 -- start start 2023-11-28T12:08:21.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:21.193+0000 7efc943ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7efc8c0cded0 0x7efc8c161200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:21.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:21.193+0000 7efc943ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc8c160d70 con 0x7efc8c15dc30 2023-11-28T12:08:21.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:21.193+0000 7efc943ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc8c0b5390 con 0x7efc8c15a760 2023-11-28T12:08:21.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:21.193+0000 7efc943ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc8c15e0d0 con 0x7efc8c0cded0 2023-11-28T12:08:21.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:21.193+0000 7efc9299c700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7efc8c15dc30 0x7efc8c0d0d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44342/0 (socket says 172.21.15.45:44342) 2023-11-28T12:08:21.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:21.193+0000 7efc9299c700 1 -- 172.21.15.45:0/1478587653 learned_addr learned my addr 172.21.15.45:0/1478587653 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:08:21.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:21.193+0000 7efc9199a700 1 --2- 172.21.15.45:0/1478587653 >> v2:172.21.15.152:3300/0 conn(0x7efc8c0cded0 0x7efc8c161200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:21.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:21.193+0000 7efc91199700 1 -- 172.21.15.45:0/1478587653 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 702077264 0 0) 0x7efc8c160d70 con 0x7efc8c15dc30 2023-11-28T12:08:21.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:21.193+0000 7efc91199700 1 -- 172.21.15.45:0/1478587653 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc780035b0 con 0x7efc8c15dc30 2023-11-28T12:08:21.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:21.194+0000 7efc9199a700 1 -- 172.21.15.45:0/1478587653 >> v1:172.21.15.152:6789/0 conn(0x7efc8c15a760 legacy=0x7efc8c0cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:21.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:21.194+0000 7efc9199a700 1 -- 172.21.15.45:0/1478587653 >> v1:172.21.15.45:6789/0 conn(0x7efc8c15dc30 legacy=0x7efc8c0d0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:21.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:21.194+0000 7efc9199a700 1 -- 172.21.15.45:0/1478587653 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc8c0b5670 con 0x7efc8c0cded0 2023-11-28T12:08:21.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:21.194+0000 7efc9199a700 1 --2- 172.21.15.45:0/1478587653 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efc8c0cded0 0x7efc8c161200 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7efc7c009840 tx=0x7efc7c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c57d50b2368d68d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:21.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:21.194+0000 7efc91199700 1 -- 172.21.15.45:0/1478587653 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc7c011830 con 0x7efc8c0cded0 2023-11-28T12:08:21.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:21.194+0000 7efc91199700 1 -- 172.21.15.45:0/1478587653 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc7c011990 con 0x7efc8c0cded0 2023-11-28T12:08:21.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:21.194+0000 7efc91199700 1 -- 172.21.15.45:0/1478587653 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc7c011d00 con 0x7efc8c0cded0 2023-11-28T12:08:21.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:21.195+0000 7efc943ff700 1 -- 172.21.15.45:0/1478587653 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efc8c0cded0 msgr2=0x7efc8c161200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:21.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:21.195+0000 7efc943ff700 1 --2- 172.21.15.45:0/1478587653 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efc8c0cded0 0x7efc8c161200 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7efc7c009840 tx=0x7efc7c009b50 comp rx=0 tx=0).stop 2023-11-28T12:08:21.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:21.195+0000 7efc943ff700 1 -- 172.21.15.45:0/1478587653 shutdown_connections 2023-11-28T12:08:21.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:21.195+0000 7efc943ff700 1 --2- 172.21.15.45:0/1478587653 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efc8c0cded0 0x7efc8c161200 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:21.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:21.195+0000 7efc943ff700 1 -- 172.21.15.45:0/1478587653 >> 172.21.15.45:0/1478587653 conn(0x7efc8c072620 msgr2=0x7efc8c0cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:21.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:21.195+0000 7efc943ff700 1 -- 172.21.15.45:0/1478587653 shutdown_connections 2023-11-28T12:08:21.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:21.195+0000 7efc943ff700 1 -- 172.21.15.45:0/1478587653 wait complete. 2023-11-28T12:08:21.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:21.197+0000 7efc943ff700 1 Processor -- start 2023-11-28T12:08:21.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:21.197+0000 7efc943ff700 1 -- start start 2023-11-28T12:08:21.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:21.198+0000 7efc943ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efc8c0cded0 0x7efc8c1576a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:21.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:21.198+0000 7efc943ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc8c15a760 0x7efc8c0b68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:21.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:21.198+0000 7efc943ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7efc8c15dc30 0x7efc8c0b6030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:21.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:21.198+0000 7efc943ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc8c0b7200 con 0x7efc8c15a760 2023-11-28T12:08:21.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:21.198+0000 7efc943ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc8c0b6570 con 0x7efc8c0cded0 2023-11-28T12:08:21.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:21.198+0000 7efc943ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc8c0b6f20 con 0x7efc8c15dc30 2023-11-28T12:08:21.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:21.198+0000 7efc9199a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc8c15a760 0x7efc8c0b68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:21.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:21.198+0000 7efc9199a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc8c15a760 0x7efc8c0b68b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48912/0 (socket says 172.21.15.45:48912) 2023-11-28T12:08:21.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:21.198+0000 7efc9199a700 1 -- 172.21.15.45:0/773498879 learned_addr learned my addr 172.21.15.45:0/773498879 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:21.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:21.198+0000 7efc9219b700 1 --2- 172.21.15.45:0/773498879 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efc8c0cded0 0x7efc8c1576a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:21.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:21.198+0000 7efc9299c700 1 --2- 172.21.15.45:0/773498879 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7efc8c15dc30 0x7efc8c0b6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:21.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:21.199+0000 7efc9199a700 1 -- 172.21.15.45:0/773498879 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7efc8c15dc30 msgr2=0x7efc8c0b6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:21.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:21.199+0000 7efc9199a700 1 --2- 172.21.15.45:0/773498879 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7efc8c15dc30 0x7efc8c0b6030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:21.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:21.199+0000 7efc9199a700 1 -- 172.21.15.45:0/773498879 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efc8c0cded0 msgr2=0x7efc8c1576a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:21.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:21.199+0000 7efc9199a700 1 --2- 172.21.15.45:0/773498879 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efc8c0cded0 0x7efc8c1576a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:21.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:21.199+0000 7efc9199a700 1 -- 172.21.15.45:0/773498879 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc7c0094a0 con 0x7efc8c15a760 2023-11-28T12:08:21.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:21.199+0000 7efc9299c700 1 --2- 172.21.15.45:0/773498879 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7efc8c15dc30 0x7efc8c0b6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:08:21.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:21.199+0000 7efc9199a700 1 --2- 172.21.15.45:0/773498879 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc8c15a760 0x7efc8c0b68b0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7efc7c009b90 tx=0x7efc7c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:21.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:21.199+0000 7efc82ffd700 1 -- 172.21.15.45:0/773498879 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc7c0036a0 con 0x7efc8c15a760 2023-11-28T12:08:21.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:21.199+0000 7efc82ffd700 1 -- 172.21.15.45:0/773498879 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc7c01f070 con 0x7efc8c15a760 2023-11-28T12:08:21.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:21.199+0000 7efc82ffd700 1 -- 172.21.15.45:0/773498879 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc7c003a00 con 0x7efc8c15a760 2023-11-28T12:08:21.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:21.199+0000 7efc943ff700 1 -- 172.21.15.45:0/773498879 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc8c160a00 con 0x7efc8c15a760 2023-11-28T12:08:21.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:21.199+0000 7efc943ff700 1 -- 172.21.15.45:0/773498879 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc8c160720 con 0x7efc8c15a760 2023-11-28T12:08:21.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:21.201+0000 7efc943ff700 1 -- 172.21.15.45:0/773498879 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc8c0b4bf0 con 0x7efc8c15a760 2023-11-28T12:08:21.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:21.202+0000 7efc82ffd700 1 -- 172.21.15.45:0/773498879 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7efc7c00f050 con 0x7efc8c15a760 2023-11-28T12:08:21.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:21.202+0000 7efc82ffd700 1 --2- 172.21.15.45:0/773498879 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7efc700682f0 0x7efc7006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:21.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:21.202+0000 7efc82ffd700 1 -- 172.21.15.45:0/773498879 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5739+0+0 (secure 0 0 0) 0x7efc7c021070 con 0x7efc8c15a760 2023-11-28T12:08:21.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:21.203+0000 7efc9219b700 1 --2- 172.21.15.45:0/773498879 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7efc700682f0 0x7efc7006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:21.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:21.204+0000 7efc9219b700 1 --2- 172.21.15.45:0/773498879 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7efc700682f0 0x7efc7006a7a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7efc88000f60 tx=0x7efc88009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:21.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:21.207+0000 7efc82ffd700 1 -- 172.21.15.45:0/773498879 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7efc7c053e40 con 0x7efc8c15a760 2023-11-28T12:08:21.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:21.405+0000 7efc943ff700 1 -- 172.21.15.45:0/773498879 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7efc8c04e620 con 0x7efc8c15a760 2023-11-28T12:08:21.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:21.961+0000 7efc82ffd700 1 -- 172.21.15.45:0/773498879 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v38) v1 ==== 169+0+0 (secure 0 0 0) 0x7efc7c025ed0 con 0x7efc8c15a760 2023-11-28T12:08:21.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:21.964+0000 7efc943ff700 1 -- 172.21.15.45:0/773498879 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7efc700682f0 msgr2=0x7efc7006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:21.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:21.964+0000 7efc943ff700 1 --2- 172.21.15.45:0/773498879 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7efc700682f0 0x7efc7006a7a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7efc88000f60 tx=0x7efc88009040 comp rx=0 tx=0).stop 2023-11-28T12:08:21.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:21.964+0000 7efc943ff700 1 -- 172.21.15.45:0/773498879 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc8c15a760 msgr2=0x7efc8c0b68b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:21.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:21.964+0000 7efc943ff700 1 --2- 172.21.15.45:0/773498879 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc8c15a760 0x7efc8c0b68b0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7efc7c009b90 tx=0x7efc7c004750 comp rx=0 tx=0).stop 2023-11-28T12:08:21.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:21.964+0000 7efc943ff700 1 -- 172.21.15.45:0/773498879 shutdown_connections 2023-11-28T12:08:21.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:21.964+0000 7efc943ff700 1 --2- 172.21.15.45:0/773498879 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7efc700682f0 0x7efc7006a7a0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:21.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:21.964+0000 7efc943ff700 1 --2- 172.21.15.45:0/773498879 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efc8c0cded0 0x7efc8c1576a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:21.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:21.964+0000 7efc943ff700 1 --2- 172.21.15.45:0/773498879 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7efc8c15dc30 0x7efc8c0b6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:21.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:21.964+0000 7efc943ff700 1 --2- 172.21.15.45:0/773498879 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc8c15a760 0x7efc8c0b68b0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:21.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:21.964+0000 7efc943ff700 1 -- 172.21.15.45:0/773498879 >> 172.21.15.45:0/773498879 conn(0x7efc8c072620 msgr2=0x7efc8c15f6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:21.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:21.964+0000 7efc943ff700 1 -- 172.21.15.45:0/773498879 shutdown_connections 2023-11-28T12:08:21.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:21.964+0000 7efc943ff700 1 -- 172.21.15.45:0/773498879 wait complete. 2023-11-28T12:08:21.966 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' removed 2023-11-28T12:08:21.985 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-28T12:08:22.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.206+0000 7f79befff700 1 Processor -- start 2023-11-28T12:08:22.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.206+0000 7f79befff700 1 -- start start 2023-11-28T12:08:22.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.207+0000 7f79befff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f79b815c9b0 0x7f79b80b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:22.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.207+0000 7f79befff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79b80d1950 con 0x7f79b80cd7c0 2023-11-28T12:08:22.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.207+0000 7f79befff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79b80d24f0 con 0x7f79b8161340 2023-11-28T12:08:22.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.207+0000 7f79befff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79b80b5800 con 0x7f79b815c9b0 2023-11-28T12:08:22.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.208+0000 7f79bd59c700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f79b80cd7c0 0x7f79b80b5fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:52578/0 (socket says 172.21.15.45:52578) 2023-11-28T12:08:22.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.208+0000 7f79bd59c700 1 -- 172.21.15.45:0/390081583 learned_addr learned my addr 172.21.15.45:0/390081583 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:08:22.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.208+0000 7f79bcd9b700 1 --2- 172.21.15.45:0/390081583 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f79b815c9b0 0x7f79b80b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:22.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.208+0000 7f79b77fe700 1 -- 172.21.15.45:0/390081583 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3656307305 0 0) 0x7f79b80d1950 con 0x7f79b80cd7c0 2023-11-28T12:08:22.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.208+0000 7f79b77fe700 1 -- 172.21.15.45:0/390081583 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79a80035b0 con 0x7f79b80cd7c0 2023-11-28T12:08:22.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.208+0000 7f79b77fe700 1 -- 172.21.15.45:0/390081583 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2189030977 0 0) 0x7f79b80d24f0 con 0x7f79b8161340 2023-11-28T12:08:22.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.208+0000 7f79b77fe700 1 -- 172.21.15.45:0/390081583 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79b80d1950 con 0x7f79b8161340 2023-11-28T12:08:22.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.208+0000 7f79bcd9b700 1 -- 172.21.15.45:0/390081583 >> v1:172.21.15.152:6789/0 conn(0x7f79b8161340 legacy=0x7f79b80d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:22.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.208+0000 7f79bcd9b700 1 -- 172.21.15.45:0/390081583 >> v1:172.21.15.45:6789/0 conn(0x7f79b80cd7c0 legacy=0x7f79b80b5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:22.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.208+0000 7f79bcd9b700 1 -- 172.21.15.45:0/390081583 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79b80b5520 con 0x7f79b815c9b0 2023-11-28T12:08:22.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.209+0000 7f79bcd9b700 1 --2- 172.21.15.45:0/390081583 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f79b815c9b0 0x7f79b80b4bf0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f79ac009870 tx=0x7f79ac009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6122e1f1edb59030 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:22.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.209+0000 7f79b77fe700 1 -- 172.21.15.45:0/390081583 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79ac011830 con 0x7f79b815c9b0 2023-11-28T12:08:22.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.209+0000 7f79b77fe700 1 -- 172.21.15.45:0/390081583 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79ac011990 con 0x7f79b815c9b0 2023-11-28T12:08:22.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.209+0000 7f79b77fe700 1 -- 172.21.15.45:0/390081583 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79ac011d20 con 0x7f79b815c9b0 2023-11-28T12:08:22.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.209+0000 7f79befff700 1 -- 172.21.15.45:0/390081583 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f79b815c9b0 msgr2=0x7f79b80b4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:22.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.209+0000 7f79befff700 1 --2- 172.21.15.45:0/390081583 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f79b815c9b0 0x7f79b80b4bf0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f79ac009870 tx=0x7f79ac009b80 comp rx=0 tx=0).stop 2023-11-28T12:08:22.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.210+0000 7f79befff700 1 -- 172.21.15.45:0/390081583 shutdown_connections 2023-11-28T12:08:22.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.210+0000 7f79befff700 1 --2- 172.21.15.45:0/390081583 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f79b815c9b0 0x7f79b80b4bf0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:22.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.210+0000 7f79befff700 1 -- 172.21.15.45:0/390081583 >> 172.21.15.45:0/390081583 conn(0x7f79b8072600 msgr2=0x7f79b80cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:22.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.210+0000 7f79befff700 1 -- 172.21.15.45:0/390081583 shutdown_connections 2023-11-28T12:08:22.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.210+0000 7f79befff700 1 -- 172.21.15.45:0/390081583 wait complete. 2023-11-28T12:08:22.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.211+0000 7f79befff700 1 Processor -- start 2023-11-28T12:08:22.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.212+0000 7f79befff700 1 -- start start 2023-11-28T12:08:22.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.212+0000 7f79befff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f79b80cd7c0 0x7f79b80c8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:22.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.212+0000 7f79befff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79b815c9b0 0x7f79b81576c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:22.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.212+0000 7f79befff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79b8161340 0x7f79b81e7620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:22.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.212+0000 7f79befff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79b80c9af0 con 0x7f79b815c9b0 2023-11-28T12:08:22.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.213+0000 7f79befff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79b8157c00 con 0x7f79b8161340 2023-11-28T12:08:22.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.213+0000 7f79befff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79b80c8f70 con 0x7f79b80cd7c0 2023-11-28T12:08:22.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.213+0000 7f79b7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79b815c9b0 0x7f79b81576c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:22.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.213+0000 7f79b7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79b815c9b0 0x7f79b81576c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54306/0 (socket says 172.21.15.45:54306) 2023-11-28T12:08:22.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.213+0000 7f79b7fff700 1 -- 172.21.15.45:0/820756254 learned_addr learned my addr 172.21.15.45:0/820756254 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:22.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.213+0000 7f79bd59c700 1 --2- 172.21.15.45:0/820756254 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79b8161340 0x7f79b81e7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:22.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.213+0000 7f79bcd9b700 1 --2- 172.21.15.45:0/820756254 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f79b80cd7c0 0x7f79b80c8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:22.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.213+0000 7f79b7fff700 1 -- 172.21.15.45:0/820756254 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f79b80cd7c0 msgr2=0x7f79b80c8990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:22.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.213+0000 7f79b7fff700 1 --2- 172.21.15.45:0/820756254 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f79b80cd7c0 0x7f79b80c8990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:22.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.213+0000 7f79b7fff700 1 -- 172.21.15.45:0/820756254 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79b8161340 msgr2=0x7f79b81e7620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:22.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.213+0000 7f79b7fff700 1 --2- 172.21.15.45:0/820756254 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79b8161340 0x7f79b81e7620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:22.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.213+0000 7f79b7fff700 1 -- 172.21.15.45:0/820756254 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79ac0094a0 con 0x7f79b815c9b0 2023-11-28T12:08:22.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.213+0000 7f79b7fff700 1 --2- 172.21.15.45:0/820756254 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79b815c9b0 0x7f79b81576c0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f79a400c530 tx=0x7f79a400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:22.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.214+0000 7f79b57fa700 1 -- 172.21.15.45:0/820756254 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a40052d0 con 0x7f79b815c9b0 2023-11-28T12:08:22.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.214+0000 7f79b57fa700 1 -- 172.21.15.45:0/820756254 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79a4005450 con 0x7f79b815c9b0 2023-11-28T12:08:22.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.214+0000 7f79befff700 1 -- 172.21.15.45:0/820756254 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79b80d15e0 con 0x7f79b815c9b0 2023-11-28T12:08:22.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.214+0000 7f79b57fa700 1 -- 172.21.15.45:0/820756254 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a40038c0 con 0x7f79b815c9b0 2023-11-28T12:08:22.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.214+0000 7f79befff700 1 -- 172.21.15.45:0/820756254 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79b80d1300 con 0x7f79b815c9b0 2023-11-28T12:08:22.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.215+0000 7f79befff700 1 -- 172.21.15.45:0/820756254 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79b80b5130 con 0x7f79b815c9b0 2023-11-28T12:08:22.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.216+0000 7f79b57fa700 1 -- 172.21.15.45:0/820756254 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f79a4019030 con 0x7f79b815c9b0 2023-11-28T12:08:22.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.217+0000 7f79b57fa700 1 --2- 172.21.15.45:0/820756254 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f799c0682f0 0x7f799c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:22.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.217+0000 7f79b57fa700 1 -- 172.21.15.45:0/820756254 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f79a4084dd0 con 0x7f79b815c9b0 2023-11-28T12:08:22.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.218+0000 7f79bcd9b700 1 --2- 172.21.15.45:0/820756254 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f799c0682f0 0x7f799c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:22.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.218+0000 7f79bcd9b700 1 --2- 172.21.15.45:0/820756254 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f799c0682f0 0x7f799c06a7a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f79ac0097c0 tx=0x7f79ac01c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:22.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.221+0000 7f79b57fa700 1 -- 172.21.15.45:0/820756254 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f79a4051860 con 0x7f79b815c9b0 2023-11-28T12:08:22.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.424+0000 7f79befff700 1 -- 172.21.15.45:0/820756254 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f79b80745c0 con 0x7f79b815c9b0 2023-11-28T12:08:22.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.428+0000 7f79b57fa700 1 -- 172.21.15.45:0/820756254 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f79a4054e80 con 0x7f79b815c9b0 2023-11-28T12:08:22.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.431+0000 7f79befff700 1 -- 172.21.15.45:0/820756254 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f799c0682f0 msgr2=0x7f799c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:22.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.431+0000 7f79befff700 1 --2- 172.21.15.45:0/820756254 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f799c0682f0 0x7f799c06a7a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f79ac0097c0 tx=0x7f79ac01c040 comp rx=0 tx=0).stop 2023-11-28T12:08:22.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.431+0000 7f79befff700 1 -- 172.21.15.45:0/820756254 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79b815c9b0 msgr2=0x7f79b81576c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:22.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.431+0000 7f79befff700 1 --2- 172.21.15.45:0/820756254 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79b815c9b0 0x7f79b81576c0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f79a400c530 tx=0x7f79a400c8f0 comp rx=0 tx=0).stop 2023-11-28T12:08:22.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.431+0000 7f79befff700 1 -- 172.21.15.45:0/820756254 shutdown_connections 2023-11-28T12:08:22.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.431+0000 7f79befff700 1 --2- 172.21.15.45:0/820756254 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f799c0682f0 0x7f799c06a7a0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:22.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.431+0000 7f79befff700 1 --2- 172.21.15.45:0/820756254 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79b8161340 0x7f79b81e7620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:22.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.431+0000 7f79befff700 1 --2- 172.21.15.45:0/820756254 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f79b80cd7c0 0x7f79b80c8990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:22.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.431+0000 7f79befff700 1 --2- 172.21.15.45:0/820756254 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79b815c9b0 0x7f79b81576c0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:22.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.431+0000 7f79befff700 1 -- 172.21.15.45:0/820756254 >> 172.21.15.45:0/820756254 conn(0x7f79b8072600 msgr2=0x7f79b80b7160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:22.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.431+0000 7f79befff700 1 -- 172.21.15.45:0/820756254 shutdown_connections 2023-11-28T12:08:22.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.431+0000 7f79befff700 1 -- 172.21.15.45:0/820756254 wait complete. 2023-11-28T12:08:22.450 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag' 2023-11-28T12:08:22.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.653+0000 7fd4dc3ff700 1 Processor -- start 2023-11-28T12:08:22.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.653+0000 7fd4dc3ff700 1 -- start start 2023-11-28T12:08:22.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.654+0000 7fd4dc3ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fd4d415c9b0 0x7fd4d40b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:22.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.654+0000 7fd4dc3ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4d40d1950 con 0x7fd4d40cd7c0 2023-11-28T12:08:22.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.654+0000 7fd4dc3ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4d40d24f0 con 0x7fd4d4161340 2023-11-28T12:08:22.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.654+0000 7fd4dc3ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4d40b5800 con 0x7fd4d415c9b0 2023-11-28T12:08:22.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.655+0000 7fd4da99c700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fd4d40cd7c0 0x7fd4d40b5fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:52592/0 (socket says 172.21.15.45:52592) 2023-11-28T12:08:22.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.655+0000 7fd4da99c700 1 -- 172.21.15.45:0/2199766482 learned_addr learned my addr 172.21.15.45:0/2199766482 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:08:22.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.655+0000 7fd4da19b700 1 --2- 172.21.15.45:0/2199766482 >> v2:172.21.15.152:3300/0 conn(0x7fd4d415c9b0 0x7fd4d40b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:22.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.655+0000 7fd4d9199700 1 -- 172.21.15.45:0/2199766482 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 225677947 0 0) 0x7fd4d40d1950 con 0x7fd4d40cd7c0 2023-11-28T12:08:22.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.655+0000 7fd4d9199700 1 -- 172.21.15.45:0/2199766482 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4c00035b0 con 0x7fd4d40cd7c0 2023-11-28T12:08:22.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.655+0000 7fd4d9199700 1 -- 172.21.15.45:0/2199766482 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1733132895 0 0) 0x7fd4d40d24f0 con 0x7fd4d4161340 2023-11-28T12:08:22.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.655+0000 7fd4d9199700 1 -- 172.21.15.45:0/2199766482 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4d40d1950 con 0x7fd4d4161340 2023-11-28T12:08:22.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.655+0000 7fd4d9199700 1 -- 172.21.15.45:0/2199766482 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1931340709 0 0) 0x7fd4c00035b0 con 0x7fd4d40cd7c0 2023-11-28T12:08:22.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.655+0000 7fd4d9199700 1 -- 172.21.15.45:0/2199766482 >> v2:172.21.15.152:3300/0 conn(0x7fd4d415c9b0 msgr2=0x7fd4d40b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:22.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.655+0000 7fd4d9199700 1 --2- 172.21.15.45:0/2199766482 >> v2:172.21.15.152:3300/0 conn(0x7fd4d415c9b0 0x7fd4d40b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:22.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.655+0000 7fd4d9199700 1 -- 172.21.15.45:0/2199766482 >> v1:172.21.15.152:6789/0 conn(0x7fd4d4161340 legacy=0x7fd4d40d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:22.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.655+0000 7fd4d9199700 1 -- 172.21.15.45:0/2199766482 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4d40b5520 con 0x7fd4d40cd7c0 2023-11-28T12:08:22.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.655+0000 7fd4d9199700 1 -- 172.21.15.45:0/2199766482 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3460218165 0 0) 0x7fd4cc0019f0 con 0x7fd4d40cd7c0 2023-11-28T12:08:22.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.655+0000 7fd4da19b700 1 --2- 172.21.15.45:0/2199766482 >> v2:172.21.15.152:3300/0 conn(0x7fd4d415c9b0 0x7fd4d40b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:08:22.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.656+0000 7fd4d9199700 1 -- 172.21.15.45:0/2199766482 >> v1:172.21.15.45:6789/0 conn(0x7fd4d40cd7c0 legacy=0x7fd4d40b5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:22.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.656+0000 7fd4d9199700 1 --2- 172.21.15.45:0/2199766482 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd4c0003be0 0x7fd4c0003fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:22.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.656+0000 7fd4d9199700 1 --2- 172.21.15.45:0/2199766482 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4c0004850 0x7fd4c0004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:22.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.656+0000 7fd4d9199700 1 --2- 172.21.15.45:0/2199766482 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4c0005250 0x7fd4c000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:22.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.656+0000 7fd4d9199700 1 -- 172.21.15.45:0/2199766482 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d40b5800 con 0x7fd4c0004850 2023-11-28T12:08:22.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.656+0000 7fd4d9199700 1 -- 172.21.15.45:0/2199766482 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c000c160 con 0x7fd4c0005250 2023-11-28T12:08:22.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.656+0000 7fd4d9199700 1 -- 172.21.15.45:0/2199766482 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c000c320 con 0x7fd4c0003be0 2023-11-28T12:08:22.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.656+0000 7fd4d999a700 1 --2- 172.21.15.45:0/2199766482 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4c0004850 0x7fd4c0004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:22.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.656+0000 7fd4da99c700 1 --2- 172.21.15.45:0/2199766482 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4c0005250 0x7fd4c000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:22.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.656+0000 7fd4da19b700 1 --2- 172.21.15.45:0/2199766482 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd4c0003be0 0x7fd4c0003fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:22.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.656+0000 7fd4d999a700 1 -- 172.21.15.45:0/2199766482 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd4c0003be0 msgr2=0x7fd4c0003fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:22.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.656+0000 7fd4d999a700 1 --2- 172.21.15.45:0/2199766482 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd4c0003be0 0x7fd4c0003fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:22.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.656+0000 7fd4d999a700 1 -- 172.21.15.45:0/2199766482 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4c0005250 msgr2=0x7fd4c000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:22.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.656+0000 7fd4d999a700 1 --2- 172.21.15.45:0/2199766482 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4c0005250 0x7fd4c000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:22.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.656+0000 7fd4d999a700 1 -- 172.21.15.45:0/2199766482 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4c00035b0 con 0x7fd4c0004850 2023-11-28T12:08:22.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.656+0000 7fd4da99c700 1 -- 172.21.15.45:0/2199766482 reap_dead start 2023-11-28T12:08:22.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.656+0000 7fd4d999a700 1 --2- 172.21.15.45:0/2199766482 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4c0004850 0x7fd4c0004cc0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fd4c4007fd0 tx=0x7fd4c0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61828112f7c7731c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:22.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.657+0000 7fd4d9199700 1 -- 172.21.15.45:0/2199766482 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4c4001430 con 0x7fd4c0004850 2023-11-28T12:08:22.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.657+0000 7fd4d9199700 1 -- 172.21.15.45:0/2199766482 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4c40052f0 con 0x7fd4c0004850 2023-11-28T12:08:22.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.657+0000 7fd4d9199700 1 -- 172.21.15.45:0/2199766482 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4c4001d40 con 0x7fd4c0004850 2023-11-28T12:08:22.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.657+0000 7fd4dc3ff700 1 -- 172.21.15.45:0/2199766482 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4c0004850 msgr2=0x7fd4c0004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:22.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.657+0000 7fd4dc3ff700 1 --2- 172.21.15.45:0/2199766482 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4c0004850 0x7fd4c0004cc0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fd4c4007fd0 tx=0x7fd4c0005880 comp rx=0 tx=0).stop 2023-11-28T12:08:22.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.657+0000 7fd4dc3ff700 1 -- 172.21.15.45:0/2199766482 shutdown_connections 2023-11-28T12:08:22.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.657+0000 7fd4dc3ff700 1 --2- 172.21.15.45:0/2199766482 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4c0004850 0x7fd4c0004cc0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:22.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.657+0000 7fd4dc3ff700 1 -- 172.21.15.45:0/2199766482 >> 172.21.15.45:0/2199766482 conn(0x7fd4d4072600 msgr2=0x7fd4d40cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:22.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.657+0000 7fd4dc3ff700 1 -- 172.21.15.45:0/2199766482 shutdown_connections 2023-11-28T12:08:22.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.657+0000 7fd4dc3ff700 1 -- 172.21.15.45:0/2199766482 wait complete. 2023-11-28T12:08:22.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.659+0000 7fd4dc3ff700 1 Processor -- start 2023-11-28T12:08:22.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.659+0000 7fd4dc3ff700 1 -- start start 2023-11-28T12:08:22.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.660+0000 7fd4dc3ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd4c0004850 0x7fd4d41e7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:22.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.660+0000 7fd4dc3ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4d41e7690 0x7fd4d40cb430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:22.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.660+0000 7fd4dc3ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4d40cb970 0x7fd4d4149ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:22.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.660+0000 7fd4dc3ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d40ccd30 con 0x7fd4d40cb970 2023-11-28T12:08:22.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.660+0000 7fd4dc3ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d40cc0b0 con 0x7fd4d41e7690 2023-11-28T12:08:22.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.660+0000 7fd4dc3ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d40cc390 con 0x7fd4c0004850 2023-11-28T12:08:22.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.660+0000 7fd4da99c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4d40cb970 0x7fd4d4149ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:22.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.661+0000 7fd4da99c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4d40cb970 0x7fd4d4149ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54330/0 (socket says 172.21.15.45:54330) 2023-11-28T12:08:22.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.661+0000 7fd4da99c700 1 -- 172.21.15.45:0/3880439073 learned_addr learned my addr 172.21.15.45:0/3880439073 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:22.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.661+0000 7fd4da19b700 1 --2- 172.21.15.45:0/3880439073 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd4c0004850 0x7fd4d41e7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:22.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.661+0000 7fd4d999a700 1 --2- 172.21.15.45:0/3880439073 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4d41e7690 0x7fd4d40cb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:22.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.661+0000 7fd4da99c700 1 -- 172.21.15.45:0/3880439073 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd4c0004850 msgr2=0x7fd4d41e7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:22.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.661+0000 7fd4da99c700 1 --2- 172.21.15.45:0/3880439073 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd4c0004850 0x7fd4d41e7150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:22.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.661+0000 7fd4da99c700 1 -- 172.21.15.45:0/3880439073 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4d41e7690 msgr2=0x7fd4d40cb430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:22.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.661+0000 7fd4da99c700 1 --2- 172.21.15.45:0/3880439073 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4d41e7690 0x7fd4d40cb430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:22.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.661+0000 7fd4da99c700 1 -- 172.21.15.45:0/3880439073 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4d40d15e0 con 0x7fd4d40cb970 2023-11-28T12:08:22.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.661+0000 7fd4da19b700 1 --2- 172.21.15.45:0/3880439073 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd4c0004850 0x7fd4d41e7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:08:22.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.661+0000 7fd4da99c700 1 --2- 172.21.15.45:0/3880439073 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4d40cb970 0x7fd4d4149ec0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fd4d406bbb0 tx=0x7fd4cc007c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:22.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.661+0000 7fd4caffd700 1 -- 172.21.15.45:0/3880439073 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4cc00eac0 con 0x7fd4d40cb970 2023-11-28T12:08:22.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.661+0000 7fd4caffd700 1 -- 172.21.15.45:0/3880439073 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4cc00ec20 con 0x7fd4d40cb970 2023-11-28T12:08:22.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.661+0000 7fd4caffd700 1 -- 172.21.15.45:0/3880439073 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4cc013420 con 0x7fd4d40cb970 2023-11-28T12:08:22.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.661+0000 7fd4dc3ff700 1 -- 172.21.15.45:0/3880439073 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4d40d1300 con 0x7fd4d40cb970 2023-11-28T12:08:22.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.662+0000 7fd4dc3ff700 1 -- 172.21.15.45:0/3880439073 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4d415cd80 con 0x7fd4d40cb970 2023-11-28T12:08:22.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.663+0000 7fd4dc3ff700 1 -- 172.21.15.45:0/3880439073 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4d40cce70 con 0x7fd4d40cb970 2023-11-28T12:08:22.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.664+0000 7fd4caffd700 1 -- 172.21.15.45:0/3880439073 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fd4cc013580 con 0x7fd4d40cb970 2023-11-28T12:08:22.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.664+0000 7fd4caffd700 1 --2- 172.21.15.45:0/3880439073 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fd4b80682f0 0x7fd4b806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:22.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.664+0000 7fd4caffd700 1 -- 172.21.15.45:0/3880439073 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fd4cc086150 con 0x7fd4d40cb970 2023-11-28T12:08:22.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.665+0000 7fd4da19b700 1 --2- 172.21.15.45:0/3880439073 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fd4b80682f0 0x7fd4b806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:22.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.666+0000 7fd4da19b700 1 --2- 172.21.15.45:0/3880439073 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fd4b80682f0 0x7fd4b806a7a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd4d0009ca0 tx=0x7fd4d0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:22.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.668+0000 7fd4caffd700 1 -- 172.21.15.45:0/3880439073 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fd4d40cce70 con 0x7fd4d40cb970 2023-11-28T12:08:22.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.950+0000 7fd4dc3ff700 1 -- 172.21.15.45:0/3880439073 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]} v 0) v1 -- 0x7fd4d40cce70 con 0x7fd4d40cb970 2023-11-28T12:08:22.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.964+0000 7fd4caffd700 1 -- 172.21.15.45:0/3880439073 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]}]=0 v115) v1 ==== 142+0+0 (secure 0 0 0) 0x7fd4d40cce70 con 0x7fd4d40cb970 2023-11-28T12:08:22.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.966+0000 7fd4dc3ff700 1 -- 172.21.15.45:0/3880439073 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fd4b80682f0 msgr2=0x7fd4b806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:22.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.966+0000 7fd4dc3ff700 1 --2- 172.21.15.45:0/3880439073 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fd4b80682f0 0x7fd4b806a7a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd4d0009ca0 tx=0x7fd4d0008040 comp rx=0 tx=0).stop 2023-11-28T12:08:22.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.966+0000 7fd4dc3ff700 1 -- 172.21.15.45:0/3880439073 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4d40cb970 msgr2=0x7fd4d4149ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:22.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.966+0000 7fd4dc3ff700 1 --2- 172.21.15.45:0/3880439073 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4d40cb970 0x7fd4d4149ec0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fd4d406bbb0 tx=0x7fd4cc007c90 comp rx=0 tx=0).stop 2023-11-28T12:08:22.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.966+0000 7fd4dc3ff700 1 -- 172.21.15.45:0/3880439073 shutdown_connections 2023-11-28T12:08:22.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.966+0000 7fd4dc3ff700 1 --2- 172.21.15.45:0/3880439073 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fd4b80682f0 0x7fd4b806a7a0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:22.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.966+0000 7fd4dc3ff700 1 --2- 172.21.15.45:0/3880439073 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4d40cb970 0x7fd4d4149ec0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:22.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.966+0000 7fd4dc3ff700 1 --2- 172.21.15.45:0/3880439073 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd4c0004850 0x7fd4d41e7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:22.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.966+0000 7fd4dc3ff700 1 --2- 172.21.15.45:0/3880439073 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4d41e7690 0x7fd4d40cb430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:22.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.966+0000 7fd4dc3ff700 1 -- 172.21.15.45:0/3880439073 >> 172.21.15.45:0/3880439073 conn(0x7fd4d4072600 msgr2=0x7fd4d40cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:22.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.967+0000 7fd4dc3ff700 1 -- 172.21.15.45:0/3880439073 shutdown_connections 2023-11-28T12:08:22.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:22.967+0000 7fd4dc3ff700 1 -- 172.21.15.45:0/3880439073 wait complete. 2023-11-28T12:08:22.985 INFO:tasks.cephfs_test_runner:test_apply_tag (tasks.cephfs.test_forward_scrub.TestForwardScrub) ... ok 2023-11-28T12:08:22.986 INFO:tasks.cephfs_test_runner:Starting test: test_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) That the MDS can repair an inodes backtrace in the data pool 2023-11-28T12:08:22.986 INFO:tasks.cephfs_test_runner:test_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2023-11-28T12:08:22.986 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair' 2023-11-28T12:08:23.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.188+0000 7f63911ff700 1 Processor -- start 2023-11-28T12:08:23.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.189+0000 7f63911ff700 1 -- start start 2023-11-28T12:08:23.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.190+0000 7f63911ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f638c15c9b0 0x7f638c0b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:23.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.190+0000 7f63911ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f638c0cd7c0 0x7f638c0cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:23.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.190+0000 7f63911ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f638c0d1950 con 0x7f638c161340 2023-11-28T12:08:23.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.190+0000 7f63911ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f638c0b5800 con 0x7f638c15c9b0 2023-11-28T12:08:23.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.190+0000 7f63911ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f638c0ce140 con 0x7f638c0cd7c0 2023-11-28T12:08:23.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.190+0000 7f6383fff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f638c161340 0x7f638c0d1de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:52596/0 (socket says 172.21.15.45:52596) 2023-11-28T12:08:23.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.190+0000 7f6383fff700 1 -- 172.21.15.45:0/4092373582 learned_addr learned my addr 172.21.15.45:0/4092373582 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:08:23.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.190+0000 7f638ad9d700 1 --2- 172.21.15.45:0/4092373582 >> v2:172.21.15.152:3300/0 conn(0x7f638c15c9b0 0x7f638c0b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:23.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.190+0000 7f638b59e700 1 --2- 172.21.15.45:0/4092373582 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f638c0cd7c0 0x7f638c0cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:23.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.191+0000 7f638a59c700 1 -- 172.21.15.45:0/4092373582 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3492365963 0 0) 0x7f638c0d1950 con 0x7f638c161340 2023-11-28T12:08:23.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.191+0000 7f638a59c700 1 -- 172.21.15.45:0/4092373582 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63780035b0 con 0x7f638c161340 2023-11-28T12:08:23.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.191+0000 7f638a59c700 1 -- 172.21.15.45:0/4092373582 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 315736314 0 0) 0x7f63780035b0 con 0x7f638c161340 2023-11-28T12:08:23.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.191+0000 7f638a59c700 1 -- 172.21.15.45:0/4092373582 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f638c0cd7c0 msgr2=0x7f638c0cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:23.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.191+0000 7f638a59c700 1 --2- 172.21.15.45:0/4092373582 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f638c0cd7c0 0x7f638c0cdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:23.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.191+0000 7f638a59c700 1 -- 172.21.15.45:0/4092373582 >> v2:172.21.15.152:3300/0 conn(0x7f638c15c9b0 msgr2=0x7f638c0b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:23.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.191+0000 7f638a59c700 1 --2- 172.21.15.45:0/4092373582 >> v2:172.21.15.152:3300/0 conn(0x7f638c15c9b0 0x7f638c0b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:23.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.191+0000 7f638a59c700 1 -- 172.21.15.45:0/4092373582 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f638c0d24f0 con 0x7f638c161340 2023-11-28T12:08:23.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.191+0000 7f638a59c700 1 -- 172.21.15.45:0/4092373582 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3460218165 0 0) 0x7f6374001670 con 0x7f638c161340 2023-11-28T12:08:23.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.191+0000 7f638ad9d700 1 --2- 172.21.15.45:0/4092373582 >> v2:172.21.15.152:3300/0 conn(0x7f638c15c9b0 0x7f638c0b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:08:23.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.191+0000 7f638a59c700 1 -- 172.21.15.45:0/4092373582 >> v1:172.21.15.45:6789/0 conn(0x7f638c161340 legacy=0x7f638c0d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:23.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.191+0000 7f638a59c700 1 --2- 172.21.15.45:0/4092373582 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6378003a00 0x7f6378003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:23.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.191+0000 7f638a59c700 1 --2- 172.21.15.45:0/4092373582 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6378004430 0x7f63780048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:23.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.191+0000 7f638a59c700 1 --2- 172.21.15.45:0/4092373582 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f638c0cd7c0 0x7f6378005060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:23.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.191+0000 7f638a59c700 1 -- 172.21.15.45:0/4092373582 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f638c0b5800 con 0x7f6378003a00 2023-11-28T12:08:23.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.191+0000 7f638a59c700 1 -- 172.21.15.45:0/4092373582 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f638c0ce140 con 0x7f6378004430 2023-11-28T12:08:23.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.191+0000 7f638a59c700 1 -- 172.21.15.45:0/4092373582 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f637800ba10 con 0x7f638c0cd7c0 2023-11-28T12:08:23.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.191+0000 7f638ad9d700 1 --2- 172.21.15.45:0/4092373582 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6378003a00 0x7f6378003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:23.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.192+0000 7f638b59e700 1 --2- 172.21.15.45:0/4092373582 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f638c0cd7c0 0x7f6378005060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:23.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.192+0000 7f6383fff700 1 --2- 172.21.15.45:0/4092373582 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6378004430 0x7f63780048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:23.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.192+0000 7f638ad9d700 1 -- 172.21.15.45:0/4092373582 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f638c0cd7c0 msgr2=0x7f6378005060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:23.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.192+0000 7f638ad9d700 1 --2- 172.21.15.45:0/4092373582 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f638c0cd7c0 0x7f6378005060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:23.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.192+0000 7f638ad9d700 1 -- 172.21.15.45:0/4092373582 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6378004430 msgr2=0x7f63780048f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:23.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.192+0000 7f638ad9d700 1 --2- 172.21.15.45:0/4092373582 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6378004430 0x7f63780048f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:23.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.192+0000 7f638ad9d700 1 -- 172.21.15.45:0/4092373582 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63780035b0 con 0x7f6378003a00 2023-11-28T12:08:23.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.192+0000 7f6383fff700 1 --2- 172.21.15.45:0/4092373582 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6378004430 0x7f63780048f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:08:23.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.192+0000 7f638ad9d700 1 --2- 172.21.15.45:0/4092373582 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6378003a00 0x7f6378003e10 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f637c009d60 tx=0x7f6378005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20d5a25b4fd62448 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:23.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.192+0000 7f638a59c700 1 -- 172.21.15.45:0/4092373582 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f637c00e9a0 con 0x7f6378003a00 2023-11-28T12:08:23.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.192+0000 7f638a59c700 1 -- 172.21.15.45:0/4092373582 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f637c00eb00 con 0x7f6378003a00 2023-11-28T12:08:23.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.192+0000 7f638a59c700 1 -- 172.21.15.45:0/4092373582 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f637c00eeb0 con 0x7f6378003a00 2023-11-28T12:08:23.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.193+0000 7f63911ff700 1 -- 172.21.15.45:0/4092373582 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6378003a00 msgr2=0x7f6378003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:23.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.193+0000 7f63911ff700 1 --2- 172.21.15.45:0/4092373582 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6378003a00 0x7f6378003e10 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f637c009d60 tx=0x7f6378005880 comp rx=0 tx=0).stop 2023-11-28T12:08:23.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.193+0000 7f638b59e700 1 -- 172.21.15.45:0/4092373582 reap_dead start 2023-11-28T12:08:23.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.193+0000 7f63911ff700 1 -- 172.21.15.45:0/4092373582 shutdown_connections 2023-11-28T12:08:23.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.193+0000 7f63911ff700 1 -- 172.21.15.45:0/4092373582 >> 172.21.15.45:0/4092373582 conn(0x7f638c072600 msgr2=0x7f638c0cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:23.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.193+0000 7f63911ff700 1 -- 172.21.15.45:0/4092373582 shutdown_connections 2023-11-28T12:08:23.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.193+0000 7f63911ff700 1 -- 172.21.15.45:0/4092373582 wait complete. 2023-11-28T12:08:23.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.195+0000 7f63911ff700 1 Processor -- start 2023-11-28T12:08:23.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.195+0000 7f63911ff700 1 -- start start 2023-11-28T12:08:23.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.196+0000 7f63911ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6378003a00 0x7f638c0c5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:23.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.196+0000 7f63911ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f638c0c88b0 0x7f638c0c6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:23.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.196+0000 7f63911ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f638c0c71e0 0x7f638c0b5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:23.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.196+0000 7f63911ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f638c0c8490 con 0x7f6378003a00 2023-11-28T12:08:23.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.196+0000 7f63911ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f638c157c30 con 0x7f638c0c71e0 2023-11-28T12:08:23.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.196+0000 7f63911ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f638c0c7810 con 0x7f638c0c88b0 2023-11-28T12:08:23.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.196+0000 7f638ad9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6378003a00 0x7f638c0c5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:23.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.196+0000 7f638ad9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6378003a00 0x7f638c0c5eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54352/0 (socket says 172.21.15.45:54352) 2023-11-28T12:08:23.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.196+0000 7f638ad9d700 1 -- 172.21.15.45:0/3456620638 learned_addr learned my addr 172.21.15.45:0/3456620638 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:23.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.196+0000 7f6383fff700 1 --2- 172.21.15.45:0/3456620638 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f638c0c88b0 0x7f638c0c6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:23.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.196+0000 7f638b59e700 1 --2- 172.21.15.45:0/3456620638 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f638c0c71e0 0x7f638c0b5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:23.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.197+0000 7f638ad9d700 1 -- 172.21.15.45:0/3456620638 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f638c0c88b0 msgr2=0x7f638c0c6ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:23.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.197+0000 7f638ad9d700 1 --2- 172.21.15.45:0/3456620638 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f638c0c88b0 0x7f638c0c6ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:23.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.197+0000 7f638ad9d700 1 -- 172.21.15.45:0/3456620638 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f638c0c71e0 msgr2=0x7f638c0b5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:23.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.197+0000 7f638ad9d700 1 --2- 172.21.15.45:0/3456620638 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f638c0c71e0 0x7f638c0b5fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:23.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.197+0000 7f638ad9d700 1 -- 172.21.15.45:0/3456620638 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f638c0d1300 con 0x7f6378003a00 2023-11-28T12:08:23.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.197+0000 7f638ad9d700 1 --2- 172.21.15.45:0/3456620638 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6378003a00 0x7f638c0c5eb0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f637c0090b0 tx=0x7f637c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:23.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.197+0000 7f63837fe700 1 -- 172.21.15.45:0/3456620638 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f637c006e60 con 0x7f6378003a00 2023-11-28T12:08:23.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.197+0000 7f63837fe700 1 -- 172.21.15.45:0/3456620638 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f637c003ab0 con 0x7f6378003a00 2023-11-28T12:08:23.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.197+0000 7f63911ff700 1 -- 172.21.15.45:0/3456620638 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f638c0b5520 con 0x7f6378003a00 2023-11-28T12:08:23.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.197+0000 7f63837fe700 1 -- 172.21.15.45:0/3456620638 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f637c003e60 con 0x7f6378003a00 2023-11-28T12:08:23.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.197+0000 7f63911ff700 1 -- 172.21.15.45:0/3456620638 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f638c0d15e0 con 0x7f6378003a00 2023-11-28T12:08:23.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.199+0000 7f63911ff700 1 -- 172.21.15.45:0/3456620638 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f638c0c75e0 con 0x7f6378003a00 2023-11-28T12:08:23.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.199+0000 7f63837fe700 1 -- 172.21.15.45:0/3456620638 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f637c019030 con 0x7f6378003a00 2023-11-28T12:08:23.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.200+0000 7f63837fe700 1 --2- 172.21.15.45:0/3456620638 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f636c0682f0 0x7f636c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:23.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.200+0000 7f63837fe700 1 -- 172.21.15.45:0/3456620638 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f637c087280 con 0x7f6378003a00 2023-11-28T12:08:23.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.201+0000 7f6383fff700 1 --2- 172.21.15.45:0/3456620638 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f636c0682f0 0x7f636c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:23.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.201+0000 7f6383fff700 1 --2- 172.21.15.45:0/3456620638 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f636c0682f0 0x7f636c06a7a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f638c1e7840 tx=0x7f6374007040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:23.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.205+0000 7f63837fe700 1 -- 172.21.15.45:0/3456620638 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f637c053c90 con 0x7f6378003a00 2023-11-28T12:08:23.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.492+0000 7f63911ff700 1 -- 172.21.15.45:0/3456620638 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]} v 0) v1 -- 0x7f638c0c8700 con 0x7f6378003a00 2023-11-28T12:08:23.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.966+0000 7f63837fe700 1 -- 172.21.15.45:0/3456620638 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]}]=0 v116) v1 ==== 152+0+0 (secure 0 0 0) 0x7f637c0572b0 con 0x7f6378003a00 2023-11-28T12:08:23.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.969+0000 7f63911ff700 1 -- 172.21.15.45:0/3456620638 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f636c0682f0 msgr2=0x7f636c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:23.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.969+0000 7f63911ff700 1 --2- 172.21.15.45:0/3456620638 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f636c0682f0 0x7f636c06a7a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f638c1e7840 tx=0x7f6374007040 comp rx=0 tx=0).stop 2023-11-28T12:08:23.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.969+0000 7f63911ff700 1 -- 172.21.15.45:0/3456620638 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6378003a00 msgr2=0x7f638c0c5eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:23.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.969+0000 7f63911ff700 1 --2- 172.21.15.45:0/3456620638 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6378003a00 0x7f638c0c5eb0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f637c0090b0 tx=0x7f637c0047c0 comp rx=0 tx=0).stop 2023-11-28T12:08:23.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.969+0000 7f63911ff700 1 -- 172.21.15.45:0/3456620638 shutdown_connections 2023-11-28T12:08:23.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.969+0000 7f63911ff700 1 --2- 172.21.15.45:0/3456620638 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f636c0682f0 0x7f636c06a7a0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:23.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.969+0000 7f63911ff700 1 --2- 172.21.15.45:0/3456620638 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f638c0c71e0 0x7f638c0b5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:23.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.969+0000 7f63911ff700 1 --2- 172.21.15.45:0/3456620638 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6378003a00 0x7f638c0c5eb0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:23.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.969+0000 7f63911ff700 1 --2- 172.21.15.45:0/3456620638 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f638c0c88b0 0x7f638c0c6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:23.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.969+0000 7f63911ff700 1 -- 172.21.15.45:0/3456620638 >> 172.21.15.45:0/3456620638 conn(0x7f638c072600 msgr2=0x7f638c15aed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:23.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.969+0000 7f63911ff700 1 -- 172.21.15.45:0/3456620638 shutdown_connections 2023-11-28T12:08:23.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:23.969+0000 7f63911ff700 1 -- 172.21.15.45:0/3456620638 wait complete. 2023-11-28T12:08:23.990 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-28T12:08:24.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:24.198+0000 7fb0507ff700 1 Processor -- start 2023-11-28T12:08:24.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:24.199+0000 7fb0507ff700 1 -- start start 2023-11-28T12:08:24.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:24.200+0000 7fb0507ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb04815c9b0 0x7fb0480b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:24.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:24.200+0000 7fb0507ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb048161340 0x7fb0480d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:24.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:24.200+0000 7fb0507ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0480d1950 con 0x7fb0480d2320 2023-11-28T12:08:24.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:24.200+0000 7fb0507ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0480b5800 con 0x7fb048161340 2023-11-28T12:08:24.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:24.200+0000 7fb0507ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0480b5520 con 0x7fb04815c9b0 2023-11-28T12:08:24.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:24.201+0000 7fb04dd9a700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb048161340 0x7fb0480d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:24.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:24.201+0000 7fb04e59b700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb04815c9b0 0x7fb0480b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:24.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:24.201+0000 7fb04dd9a700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb048161340 0x7fb0480d1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.45:39556/0 (socket says 172.21.15.45:39556) 2023-11-28T12:08:24.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:24.201+0000 7fb04ed9c700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fb0480d2320 0x7fb0480cd7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.45:54836/0 (socket says 172.21.15.45:54836) 2023-11-28T12:08:24.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:24.201+0000 7fb04dd9a700 1 -- 172.21.15.45:0/2373621382 learned_addr learned my addr 172.21.15.45:0/2373621382 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:24.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:24.201+0000 7fb04e59b700 1 -- 172.21.15.45:0/2373621382 >> v2:172.21.15.152:3300/0 conn(0x7fb048161340 msgr2=0x7fb0480d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:24.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:24.201+0000 7fb04e59b700 1 --2- 172.21.15.45:0/2373621382 >> v2:172.21.15.152:3300/0 conn(0x7fb048161340 0x7fb0480d1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:24.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:24.201+0000 7fb04e59b700 1 -- 172.21.15.45:0/2373621382 >> v1:172.21.15.152:6789/0 conn(0x7fb0480d2320 legacy=0x7fb0480cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:24.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:24.201+0000 7fb04e59b700 1 -- 172.21.15.45:0/2373621382 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0480d1300 con 0x7fb04815c9b0 2023-11-28T12:08:24.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:24.201+0000 7fb04dd9a700 1 --2- 172.21.15.45:0/2373621382 >> v2:172.21.15.152:3300/0 conn(0x7fb048161340 0x7fb0480d1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:08:24.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:24.202+0000 7fb04e59b700 1 --2- 172.21.15.45:0/2373621382 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb04815c9b0 0x7fb0480b4bf0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb044009840 tx=0x7fb044009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c8c3272be582fa6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:24.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:24.202+0000 7fb04d599700 1 -- 172.21.15.45:0/2373621382 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb044011830 con 0x7fb04815c9b0 2023-11-28T12:08:24.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:24.202+0000 7fb04d599700 1 -- 172.21.15.45:0/2373621382 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb044011990 con 0x7fb04815c9b0 2023-11-28T12:08:24.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:24.202+0000 7fb04d599700 1 -- 172.21.15.45:0/2373621382 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb044011d20 con 0x7fb04815c9b0 2023-11-28T12:08:24.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:24.203+0000 7fb0507ff700 1 -- 172.21.15.45:0/2373621382 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb04815c9b0 msgr2=0x7fb0480b4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:24.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:24.203+0000 7fb0507ff700 1 --2- 172.21.15.45:0/2373621382 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb04815c9b0 0x7fb0480b4bf0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb044009840 tx=0x7fb044009b50 comp rx=0 tx=0).stop 2023-11-28T12:08:24.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:24.203+0000 7fb0507ff700 1 -- 172.21.15.45:0/2373621382 shutdown_connections 2023-11-28T12:08:24.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:24.203+0000 7fb0507ff700 1 --2- 172.21.15.45:0/2373621382 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb04815c9b0 0x7fb0480b4bf0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:24.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:24.203+0000 7fb0507ff700 1 --2- 172.21.15.45:0/2373621382 >> v2:172.21.15.152:3300/0 conn(0x7fb048161340 0x7fb0480d1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:24.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:24.203+0000 7fb0507ff700 1 -- 172.21.15.45:0/2373621382 >> 172.21.15.45:0/2373621382 conn(0x7fb048072600 msgr2=0x7fb0480cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:24.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:24.203+0000 7fb0507ff700 1 -- 172.21.15.45:0/2373621382 shutdown_connections 2023-11-28T12:08:24.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:24.203+0000 7fb0507ff700 1 -- 172.21.15.45:0/2373621382 wait complete. 2023-11-28T12:08:24.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:24.205+0000 7fb0507ff700 1 Processor -- start 2023-11-28T12:08:24.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:24.205+0000 7fb0507ff700 1 -- start start 2023-11-28T12:08:24.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:24.206+0000 7fb0507ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb0480d2320 0x7fb048151180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:24.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:24.206+0000 7fb0507ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb04815c9b0 0x7fb048153170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:24.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:24.206+0000 7fb0507ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb048161340 0x7fb0481536b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:24.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:24.206+0000 7fb0507ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0480c6e40 con 0x7fb04815c9b0 2023-11-28T12:08:24.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:24.206+0000 7fb0507ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0480c8fa0 con 0x7fb048161340 2023-11-28T12:08:24.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:24.206+0000 7fb0507ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0480c91f0 con 0x7fb0480d2320 2023-11-28T12:08:24.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:24.206+0000 7fb04dd9a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb04815c9b0 0x7fb048153170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:24.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:24.206+0000 7fb04dd9a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb04815c9b0 0x7fb048153170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54368/0 (socket says 172.21.15.45:54368) 2023-11-28T12:08:24.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:24.206+0000 7fb04dd9a700 1 -- 172.21.15.45:0/3299942629 learned_addr learned my addr 172.21.15.45:0/3299942629 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:24.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:24.206+0000 7fb04e59b700 1 --2- 172.21.15.45:0/3299942629 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb0480d2320 0x7fb048151180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:24.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:24.206+0000 7fb04ed9c700 1 --2- 172.21.15.45:0/3299942629 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb048161340 0x7fb0481536b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:24.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:24.207+0000 7fb04dd9a700 1 -- 172.21.15.45:0/3299942629 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb0480d2320 msgr2=0x7fb048151180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:24.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:24.207+0000 7fb04dd9a700 1 --2- 172.21.15.45:0/3299942629 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb0480d2320 0x7fb048151180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:24.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:24.207+0000 7fb04dd9a700 1 -- 172.21.15.45:0/3299942629 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb048161340 msgr2=0x7fb0481536b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:24.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:24.207+0000 7fb04dd9a700 1 --2- 172.21.15.45:0/3299942629 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb048161340 0x7fb0481536b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:24.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:24.207+0000 7fb04dd9a700 1 -- 172.21.15.45:0/3299942629 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb038009550 con 0x7fb04815c9b0 2023-11-28T12:08:24.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:24.207+0000 7fb04dd9a700 1 --2- 172.21.15.45:0/3299942629 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb04815c9b0 0x7fb048153170 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fb03800ebe0 tx=0x7fb03800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:24.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:24.207+0000 7fb03effd700 1 -- 172.21.15.45:0/3299942629 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03800c850 con 0x7fb04815c9b0 2023-11-28T12:08:24.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:24.207+0000 7fb03effd700 1 -- 172.21.15.45:0/3299942629 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb03800c9b0 con 0x7fb04815c9b0 2023-11-28T12:08:24.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:24.207+0000 7fb0507ff700 1 -- 172.21.15.45:0/3299942629 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0440094a0 con 0x7fb04815c9b0 2023-11-28T12:08:24.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:24.207+0000 7fb03effd700 1 -- 172.21.15.45:0/3299942629 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03800cd20 con 0x7fb04815c9b0 2023-11-28T12:08:24.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:24.207+0000 7fb0507ff700 1 -- 172.21.15.45:0/3299942629 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0480b5130 con 0x7fb04815c9b0 2023-11-28T12:08:24.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:24.208+0000 7fb0507ff700 1 -- 172.21.15.45:0/3299942629 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0480d15e0 con 0x7fb04815c9b0 2023-11-28T12:08:24.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:24.209+0000 7fb03effd700 1 -- 172.21.15.45:0/3299942629 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fb038023070 con 0x7fb04815c9b0 2023-11-28T12:08:24.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:24.210+0000 7fb03effd700 1 --2- 172.21.15.45:0/3299942629 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb02c0682f0 0x7fb02c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:24.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:24.210+0000 7fb03effd700 1 -- 172.21.15.45:0/3299942629 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fb038085ce0 con 0x7fb04815c9b0 2023-11-28T12:08:24.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:24.211+0000 7fb04e59b700 1 --2- 172.21.15.45:0/3299942629 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb02c0682f0 0x7fb02c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:24.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:24.211+0000 7fb04e59b700 1 --2- 172.21.15.45:0/3299942629 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb02c0682f0 0x7fb02c06a7a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb044000c00 tx=0x7fb04401c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:24.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:24.215+0000 7fb03effd700 1 -- 172.21.15.45:0/3299942629 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fb03808a070 con 0x7fb04815c9b0 2023-11-28T12:08:24.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:24.415+0000 7fb0507ff700 1 -- 172.21.15.45:0/3299942629 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fb0480b52c0 con 0x7fb04815c9b0 2023-11-28T12:08:24.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:24.419+0000 7fb03effd700 1 -- 172.21.15.45:0/3299942629 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb038052840 con 0x7fb04815c9b0 2023-11-28T12:08:24.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:24.421+0000 7fb0507ff700 1 -- 172.21.15.45:0/3299942629 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb02c0682f0 msgr2=0x7fb02c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:24.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:24.421+0000 7fb0507ff700 1 --2- 172.21.15.45:0/3299942629 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb02c0682f0 0x7fb02c06a7a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb044000c00 tx=0x7fb04401c040 comp rx=0 tx=0).stop 2023-11-28T12:08:24.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:24.421+0000 7fb0507ff700 1 -- 172.21.15.45:0/3299942629 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb04815c9b0 msgr2=0x7fb048153170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:24.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:24.421+0000 7fb0507ff700 1 --2- 172.21.15.45:0/3299942629 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb04815c9b0 0x7fb048153170 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fb03800ebe0 tx=0x7fb03800eef0 comp rx=0 tx=0).stop 2023-11-28T12:08:24.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:24.421+0000 7fb0507ff700 1 -- 172.21.15.45:0/3299942629 shutdown_connections 2023-11-28T12:08:24.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:24.421+0000 7fb0507ff700 1 --2- 172.21.15.45:0/3299942629 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb02c0682f0 0x7fb02c06a7a0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:24.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:24.421+0000 7fb0507ff700 1 --2- 172.21.15.45:0/3299942629 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb048161340 0x7fb0481536b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:24.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:24.421+0000 7fb0507ff700 1 --2- 172.21.15.45:0/3299942629 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb0480d2320 0x7fb048151180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:24.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:24.421+0000 7fb0507ff700 1 --2- 172.21.15.45:0/3299942629 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb04815c9b0 0x7fb048153170 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:24.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:24.421+0000 7fb0507ff700 1 -- 172.21.15.45:0/3299942629 >> 172.21.15.45:0/3299942629 conn(0x7fb048072600 msgr2=0x7fb048159cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:24.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:24.421+0000 7fb0507ff700 1 -- 172.21.15.45:0/3299942629 shutdown_connections 2023-11-28T12:08:24.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:24.421+0000 7fb0507ff700 1 -- 172.21.15.45:0/3299942629 wait complete. 2023-11-28T12:08:24.440 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-28T12:08:24.440 DEBUG:teuthology.orchestra.run.smithi045:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T12:08:24.528 DEBUG:teuthology.orchestra.run.smithi152:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T12:08:24.626 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-28T12:08:24.626 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T12:08:24.626 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T12:08:24.673 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16351388k,nr_inodes=4087847,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=41,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3276240k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-11-28T12:08:24.673 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-11-28T12:08:24.673 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T12:08:24.721 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16348296k,nr_inodes=4087074,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=41,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275620k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-11-28T12:08:24.721 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T12:08:24.721 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T12:08:24.768 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16351388k,nr_inodes=4087847,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=41,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3276240k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-11-28T12:08:24.768 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-11-28T12:08:24.769 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T12:08:24.816 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16348296k,nr_inodes=4087074,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=41,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275620k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-11-28T12:08:24.816 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-28T12:08:24.817 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T12:08:25.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.020+0000 7f9f753ff700 1 Processor -- start 2023-11-28T12:08:25.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.020+0000 7f9f753ff700 1 -- start start 2023-11-28T12:08:25.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.021+0000 7f9f753ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9f7015c9b0 0x7f9f700b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:25.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.021+0000 7f9f753ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f9f70161340 0x7f9f700d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:25.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.021+0000 7f9f753ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f700d1950 con 0x7f9f700d2320 2023-11-28T12:08:25.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.021+0000 7f9f753ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f700b5800 con 0x7f9f70161340 2023-11-28T12:08:25.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.021+0000 7f9f753ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f700b5520 con 0x7f9f7015c9b0 2023-11-28T12:08:25.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.022+0000 7f9f6effd700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9f7015c9b0 0x7f9f700b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:25.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.022+0000 7f9f67fff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f9f70161340 0x7f9f700d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:25.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.022+0000 7f9f6effd700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9f7015c9b0 0x7f9f700b4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.45:55512/0 (socket says 172.21.15.45:55512) 2023-11-28T12:08:25.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.022+0000 7f9f6effd700 1 -- 172.21.15.45:0/2651644182 learned_addr learned my addr 172.21.15.45:0/2651644182 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:25.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.022+0000 7f9f6effd700 1 -- 172.21.15.45:0/2651644182 >> v2:172.21.15.152:3300/0 conn(0x7f9f70161340 msgr2=0x7f9f700d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:25.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.022+0000 7f9f6effd700 1 --2- 172.21.15.45:0/2651644182 >> v2:172.21.15.152:3300/0 conn(0x7f9f70161340 0x7f9f700d1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:25.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.022+0000 7f9f6effd700 1 -- 172.21.15.45:0/2651644182 >> v1:172.21.15.152:6789/0 conn(0x7f9f700d2320 legacy=0x7f9f700cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:25.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.022+0000 7f9f6effd700 1 -- 172.21.15.45:0/2651644182 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f700d1300 con 0x7f9f7015c9b0 2023-11-28T12:08:25.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.023+0000 7f9f6effd700 1 --2- 172.21.15.45:0/2651644182 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9f7015c9b0 0x7f9f700b4bf0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9f600098f0 tx=0x7f9f60009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8843d0c017a9a85 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:25.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.023+0000 7f9f6e7fc700 1 -- 172.21.15.45:0/2651644182 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f60011830 con 0x7f9f7015c9b0 2023-11-28T12:08:25.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.023+0000 7f9f6e7fc700 1 -- 172.21.15.45:0/2651644182 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f60011990 con 0x7f9f7015c9b0 2023-11-28T12:08:25.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.023+0000 7f9f6e7fc700 1 -- 172.21.15.45:0/2651644182 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f60011d20 con 0x7f9f7015c9b0 2023-11-28T12:08:25.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.023+0000 7f9f753ff700 1 -- 172.21.15.45:0/2651644182 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9f7015c9b0 msgr2=0x7f9f700b4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:25.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.023+0000 7f9f753ff700 1 --2- 172.21.15.45:0/2651644182 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9f7015c9b0 0x7f9f700b4bf0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9f600098f0 tx=0x7f9f60009c00 comp rx=0 tx=0).stop 2023-11-28T12:08:25.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.024+0000 7f9f753ff700 1 -- 172.21.15.45:0/2651644182 shutdown_connections 2023-11-28T12:08:25.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.024+0000 7f9f753ff700 1 --2- 172.21.15.45:0/2651644182 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9f7015c9b0 0x7f9f700b4bf0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:25.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.024+0000 7f9f753ff700 1 --2- 172.21.15.45:0/2651644182 >> v2:172.21.15.152:3300/0 conn(0x7f9f70161340 0x7f9f700d1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:25.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.024+0000 7f9f753ff700 1 -- 172.21.15.45:0/2651644182 >> 172.21.15.45:0/2651644182 conn(0x7f9f70072600 msgr2=0x7f9f700cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:25.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.024+0000 7f9f753ff700 1 -- 172.21.15.45:0/2651644182 shutdown_connections 2023-11-28T12:08:25.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.024+0000 7f9f753ff700 1 -- 172.21.15.45:0/2651644182 wait complete. 2023-11-28T12:08:25.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.025+0000 7f9f753ff700 1 Processor -- start 2023-11-28T12:08:25.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.026+0000 7f9f753ff700 1 -- start start 2023-11-28T12:08:25.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.026+0000 7f9f753ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9f700d2320 0x7f9f70155410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:25.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.026+0000 7f9f753ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f7015c9b0 0x7f9f70158ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:25.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.027+0000 7f9f753ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9f70161340 0x7f9f70159020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:25.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.027+0000 7f9f753ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f701f5d30 con 0x7f9f7015c9b0 2023-11-28T12:08:25.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.027+0000 7f9f753ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f701f6010 con 0x7f9f700d2320 2023-11-28T12:08:25.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.027+0000 7f9f753ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f701f62f0 con 0x7f9f70161340 2023-11-28T12:08:25.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.027+0000 7f9f67fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f7015c9b0 0x7f9f70158ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:25.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.027+0000 7f9f67fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f7015c9b0 0x7f9f70158ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54370/0 (socket says 172.21.15.45:54370) 2023-11-28T12:08:25.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.027+0000 7f9f67fff700 1 -- 172.21.15.45:0/2571521636 learned_addr learned my addr 172.21.15.45:0/2571521636 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:25.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.027+0000 7f9f6effd700 1 --2- 172.21.15.45:0/2571521636 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9f700d2320 0x7f9f70155410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:25.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.027+0000 7f9f6f7fe700 1 --2- 172.21.15.45:0/2571521636 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9f70161340 0x7f9f70159020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:25.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.027+0000 7f9f67fff700 1 -- 172.21.15.45:0/2571521636 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9f70161340 msgr2=0x7f9f70159020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:25.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.027+0000 7f9f67fff700 1 --2- 172.21.15.45:0/2571521636 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9f70161340 0x7f9f70159020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:25.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.027+0000 7f9f67fff700 1 -- 172.21.15.45:0/2571521636 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9f700d2320 msgr2=0x7f9f70155410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:25.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.027+0000 7f9f67fff700 1 --2- 172.21.15.45:0/2571521636 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9f700d2320 0x7f9f70155410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:25.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.027+0000 7f9f67fff700 1 -- 172.21.15.45:0/2571521636 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f60009550 con 0x7f9f7015c9b0 2023-11-28T12:08:25.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.027+0000 7f9f6f7fe700 1 --2- 172.21.15.45:0/2571521636 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9f70161340 0x7f9f70159020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:08:25.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.028+0000 7f9f67fff700 1 --2- 172.21.15.45:0/2571521636 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f7015c9b0 0x7f9f70158ae0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f9f5800e9b0 tx=0x7f9f5800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:25.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.028+0000 7f9f677fe700 1 -- 172.21.15.45:0/2571521636 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f58009710 con 0x7f9f7015c9b0 2023-11-28T12:08:25.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.028+0000 7f9f677fe700 1 -- 172.21.15.45:0/2571521636 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f5800c850 con 0x7f9f7015c9b0 2023-11-28T12:08:25.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.028+0000 7f9f677fe700 1 -- 172.21.15.45:0/2571521636 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f5800cbc0 con 0x7f9f7015c9b0 2023-11-28T12:08:25.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.028+0000 7f9f753ff700 1 -- 172.21.15.45:0/2571521636 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f700b5130 con 0x7f9f7015c9b0 2023-11-28T12:08:25.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.028+0000 7f9f753ff700 1 -- 172.21.15.45:0/2571521636 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f700d15e0 con 0x7f9f7015c9b0 2023-11-28T12:08:25.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.029+0000 7f9f753ff700 1 -- 172.21.15.45:0/2571521636 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f700b52c0 con 0x7f9f7015c9b0 2023-11-28T12:08:25.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.030+0000 7f9f677fe700 1 -- 172.21.15.45:0/2571521636 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f9f58019030 con 0x7f9f7015c9b0 2023-11-28T12:08:25.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.031+0000 7f9f677fe700 1 --2- 172.21.15.45:0/2571521636 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f9f50068320 0x7f9f5006a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:25.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.031+0000 7f9f677fe700 1 -- 172.21.15.45:0/2571521636 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f9f58085990 con 0x7f9f7015c9b0 2023-11-28T12:08:25.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.031+0000 7f9f6effd700 1 --2- 172.21.15.45:0/2571521636 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f9f50068320 0x7f9f5006a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:25.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.032+0000 7f9f6effd700 1 --2- 172.21.15.45:0/2571521636 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f9f50068320 0x7f9f5006a7d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9f60009c40 tx=0x7f9f60008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:25.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.035+0000 7f9f677fe700 1 -- 172.21.15.45:0/2571521636 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f9f58052420 con 0x7f9f7015c9b0 2023-11-28T12:08:25.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.285+0000 7f9f753ff700 1 -- 172.21.15.45:0/2571521636 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9f700745c0 con 0x7f9f7015c9b0 2023-11-28T12:08:25.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.285+0000 7f9f677fe700 1 -- 172.21.15.45:0/2571521636 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+3535 (secure 0 0 0) 0x7f9f58021de0 con 0x7f9f7015c9b0 2023-11-28T12:08:25.286 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:08:25.286 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":18,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4805,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1232749056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1232749056},{"type":"v1","addr":"172.21.15.152:6837","nonce":1232749056}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4996,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/1358094304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":1358094304},{"type":"v1","addr":"172.21.15.45:6835","nonce":1358094304}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4999,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6836/2035520444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6835","nonce":2035520444},{"type":"v1","addr":"172.21.15.152:6836","nonce":2035520444}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5481,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/2732501407","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":2732501407},{"type":"v1","addr":"172.21.15.45:6834","nonce":2732501407}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[]} 2023-11-28T12:08:25.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.288+0000 7f9f753ff700 1 -- 172.21.15.45:0/2571521636 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f9f50068320 msgr2=0x7f9f5006a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:25.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.288+0000 7f9f753ff700 1 --2- 172.21.15.45:0/2571521636 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f9f50068320 0x7f9f5006a7d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9f60009c40 tx=0x7f9f60008030 comp rx=0 tx=0).stop 2023-11-28T12:08:25.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.288+0000 7f9f753ff700 1 -- 172.21.15.45:0/2571521636 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f7015c9b0 msgr2=0x7f9f70158ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:25.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.288+0000 7f9f753ff700 1 --2- 172.21.15.45:0/2571521636 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f7015c9b0 0x7f9f70158ae0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f9f5800e9b0 tx=0x7f9f5800ecc0 comp rx=0 tx=0).stop 2023-11-28T12:08:25.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.288+0000 7f9f753ff700 1 -- 172.21.15.45:0/2571521636 shutdown_connections 2023-11-28T12:08:25.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.288+0000 7f9f753ff700 1 --2- 172.21.15.45:0/2571521636 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f9f50068320 0x7f9f5006a7d0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:25.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.288+0000 7f9f753ff700 1 --2- 172.21.15.45:0/2571521636 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9f700d2320 0x7f9f70155410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:25.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.288+0000 7f9f753ff700 1 --2- 172.21.15.45:0/2571521636 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9f70161340 0x7f9f70159020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:25.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.288+0000 7f9f753ff700 1 --2- 172.21.15.45:0/2571521636 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f7015c9b0 0x7f9f70158ae0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:25.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.288+0000 7f9f753ff700 1 -- 172.21.15.45:0/2571521636 >> 172.21.15.45:0/2571521636 conn(0x7f9f70072600 msgr2=0x7f9f7015cd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:25.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.288+0000 7f9f753ff700 1 -- 172.21.15.45:0/2571521636 shutdown_connections 2023-11-28T12:08:25.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.288+0000 7f9f753ff700 1 -- 172.21.15.45:0/2571521636 wait complete. 2023-11-28T12:08:25.290 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 18 2023-11-28T12:08:25.307 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-28T12:08:25.308 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-28T12:08:25.308 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-28T12:08:25.308 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T12:08:25.308 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-28T12:08:25.308 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-28T12:08:25.308 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-28T12:08:25.308 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T12:08:25.309 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-28T12:08:25.309 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-28T12:08:25.309 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-28T12:08:25.309 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T12:08:25.309 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-28T12:08:25.309 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-28T12:08:25.309 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-28T12:08:25.310 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T12:08:25.322 INFO:tasks.ceph.mds.a:Stopped 2023-11-28T12:08:25.322 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-28T12:08:25.323 INFO:tasks.ceph.mds.c:Stopped 2023-11-28T12:08:25.323 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-28T12:08:25.324 INFO:tasks.ceph.mds.b:Stopped 2023-11-28T12:08:25.324 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-28T12:08:25.325 INFO:tasks.ceph.mds.d:Stopped 2023-11-28T12:08:25.326 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-28T12:08:25.367 INFO:tasks.ceph.mds.a:Started 2023-11-28T12:08:25.367 DEBUG:teuthology.parallel:result is None 2023-11-28T12:08:25.370 INFO:tasks.ceph.mds.c:Started 2023-11-28T12:08:25.370 DEBUG:teuthology.parallel:result is None 2023-11-28T12:08:25.370 INFO:tasks.ceph.mds.b:Started 2023-11-28T12:08:25.371 DEBUG:teuthology.parallel:result is None 2023-11-28T12:08:25.374 INFO:tasks.ceph.mds.d:Started 2023-11-28T12:08:25.377 DEBUG:teuthology.parallel:result is None 2023-11-28T12:08:25.377 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-28T12:08:25.517 INFO:tasks.ceph.mds.b.smithi152.stdout:starting mds.b at 2023-11-28T12:08:25.519 INFO:tasks.ceph.mds.d.smithi152.stdout:starting mds.d at 2023-11-28T12:08:25.523 INFO:tasks.ceph.mds.a.smithi045.stdout:starting mds.a at 2023-11-28T12:08:25.525 INFO:tasks.ceph.mds.c.smithi045.stdout:starting mds.c at 2023-11-28T12:08:25.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.595+0000 7f23487ff700 1 Processor -- start 2023-11-28T12:08:25.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.595+0000 7f23487ff700 1 -- start start 2023-11-28T12:08:25.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.596+0000 7f23487ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f23400d01b0 0x7f23400d0c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:25.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.596+0000 7f23487ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f23400b20b0 0x7f23400d1160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:25.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.596+0000 7f23487ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f23400b29b0 0x7f23400b2e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:25.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.596+0000 7f23487ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f234015cec0 con 0x7f23400d01b0 2023-11-28T12:08:25.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.596+0000 7f23487ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23400b0230 con 0x7f23400b29b0 2023-11-28T12:08:25.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.596+0000 7f23487ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23400b4570 con 0x7f23400b20b0 2023-11-28T12:08:25.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.596+0000 7f234659b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f23400d01b0 0x7f23400d0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:25.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.596+0000 7f234659b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f23400d01b0 0x7f23400d0c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54420/0 (socket says 172.21.15.45:54420) 2023-11-28T12:08:25.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.596+0000 7f234659b700 1 -- 172.21.15.45:0/2623053972 learned_addr learned my addr 172.21.15.45:0/2623053972 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:25.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.596+0000 7f2345d9a700 1 --2- 172.21.15.45:0/2623053972 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f23400b20b0 0x7f23400d1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:25.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.597+0000 7f2346d9c700 1 --2- 172.21.15.45:0/2623053972 >> v2:172.21.15.152:3300/0 conn(0x7f23400b29b0 0x7f23400b2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:25.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.597+0000 7f234659b700 1 -- 172.21.15.45:0/2623053972 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f23400b20b0 msgr2=0x7f23400d1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:25.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.597+0000 7f234659b700 1 --2- 172.21.15.45:0/2623053972 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f23400b20b0 0x7f23400d1160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:25.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.597+0000 7f234659b700 1 -- 172.21.15.45:0/2623053972 >> v2:172.21.15.152:3300/0 conn(0x7f23400b29b0 msgr2=0x7f23400b2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:25.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.597+0000 7f234659b700 1 --2- 172.21.15.45:0/2623053972 >> v2:172.21.15.152:3300/0 conn(0x7f23400b29b0 0x7f23400b2e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:25.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.597+0000 7f234659b700 1 -- 172.21.15.45:0/2623053972 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23400b4850 con 0x7f23400d01b0 2023-11-28T12:08:25.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.597+0000 7f234659b700 1 --2- 172.21.15.45:0/2623053972 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23400d01b0 0x7f23400d0c20 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f2340066e80 tx=0x7f233c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b1767110e823dd3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:25.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.597+0000 7f2345599700 1 -- 172.21.15.45:0/2623053972 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233c00b870 con 0x7f23400d01b0 2023-11-28T12:08:25.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.597+0000 7f2345599700 1 -- 172.21.15.45:0/2623053972 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f233c00b9d0 con 0x7f23400d01b0 2023-11-28T12:08:25.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.597+0000 7f2345599700 1 -- 172.21.15.45:0/2623053972 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233c00bd60 con 0x7f23400d01b0 2023-11-28T12:08:25.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.598+0000 7f23487ff700 1 -- 172.21.15.45:0/2623053972 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23400d01b0 msgr2=0x7f23400d0c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:25.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.598+0000 7f23487ff700 1 --2- 172.21.15.45:0/2623053972 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23400d01b0 0x7f23400d0c20 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f2340066e80 tx=0x7f233c009bd0 comp rx=0 tx=0).stop 2023-11-28T12:08:25.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.598+0000 7f23487ff700 1 -- 172.21.15.45:0/2623053972 shutdown_connections 2023-11-28T12:08:25.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.598+0000 7f23487ff700 1 --2- 172.21.15.45:0/2623053972 >> v2:172.21.15.152:3300/0 conn(0x7f23400b29b0 0x7f23400b2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:25.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.598+0000 7f23487ff700 1 --2- 172.21.15.45:0/2623053972 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23400d01b0 0x7f23400d0c20 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:25.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.598+0000 7f23487ff700 1 --2- 172.21.15.45:0/2623053972 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f23400b20b0 0x7f23400d1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:25.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.598+0000 7f23487ff700 1 -- 172.21.15.45:0/2623053972 >> 172.21.15.45:0/2623053972 conn(0x7f234009c3f0 msgr2=0x7f23400d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:25.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.598+0000 7f23487ff700 1 -- 172.21.15.45:0/2623053972 shutdown_connections 2023-11-28T12:08:25.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.598+0000 7f23487ff700 1 -- 172.21.15.45:0/2623053972 wait complete. 2023-11-28T12:08:25.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.600+0000 7f23487ff700 1 Processor -- start 2023-11-28T12:08:25.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.600+0000 7f23487ff700 1 -- start start 2023-11-28T12:08:25.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.601+0000 7f23487ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f23400b20b0 0x7f23400b63c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:25.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.601+0000 7f23487ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f23400b29b0 0x7f23400ca390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:25.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.601+0000 7f23487ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23400d01b0 0x7f23400c9500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:25.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.601+0000 7f23487ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23401e51b0 con 0x7f23400d01b0 2023-11-28T12:08:25.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.601+0000 7f23487ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23400cd020 con 0x7f23400b20b0 2023-11-28T12:08:25.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.601+0000 7f23487ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23400cd300 con 0x7f23400b29b0 2023-11-28T12:08:25.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.601+0000 7f2346d9c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23400d01b0 0x7f23400c9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:25.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.601+0000 7f2346d9c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23400d01b0 0x7f23400c9500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54424/0 (socket says 172.21.15.45:54424) 2023-11-28T12:08:25.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.601+0000 7f2346d9c700 1 -- 172.21.15.45:0/2966116666 learned_addr learned my addr 172.21.15.45:0/2966116666 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:25.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.601+0000 7f2345d9a700 1 --2- 172.21.15.45:0/2966116666 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f23400b29b0 0x7f23400ca390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:25.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.602+0000 7f234659b700 1 --2- 172.21.15.45:0/2966116666 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f23400b20b0 0x7f23400b63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:25.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.602+0000 7f2346d9c700 1 -- 172.21.15.45:0/2966116666 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f23400b29b0 msgr2=0x7f23400ca390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:25.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.602+0000 7f2346d9c700 1 --2- 172.21.15.45:0/2966116666 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f23400b29b0 0x7f23400ca390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:25.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.602+0000 7f2346d9c700 1 -- 172.21.15.45:0/2966116666 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f23400b20b0 msgr2=0x7f23400b63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:25.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.602+0000 7f2346d9c700 1 --2- 172.21.15.45:0/2966116666 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f23400b20b0 0x7f23400b63c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:25.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.602+0000 7f2346d9c700 1 -- 172.21.15.45:0/2966116666 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f233c009550 con 0x7f23400d01b0 2023-11-28T12:08:25.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.602+0000 7f2345d9a700 1 --2- 172.21.15.45:0/2966116666 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f23400b29b0 0x7f23400ca390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:08:25.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.602+0000 7f2346d9c700 1 --2- 172.21.15.45:0/2966116666 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23400d01b0 0x7f23400c9500 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f2338007e40 tx=0x7f233800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:25.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.602+0000 7f2336ffd700 1 -- 172.21.15.45:0/2966116666 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233800eea0 con 0x7f23400d01b0 2023-11-28T12:08:25.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.602+0000 7f2336ffd700 1 -- 172.21.15.45:0/2966116666 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2338014420 con 0x7f23400d01b0 2023-11-28T12:08:25.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.602+0000 7f2336ffd700 1 -- 172.21.15.45:0/2966116666 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23380147b0 con 0x7f23400d01b0 2023-11-28T12:08:25.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.602+0000 7f23487ff700 1 -- 172.21.15.45:0/2966116666 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23400afec0 con 0x7f23400d01b0 2023-11-28T12:08:25.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.602+0000 7f23487ff700 1 -- 172.21.15.45:0/2966116666 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23400afbe0 con 0x7f23400d01b0 2023-11-28T12:08:25.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.603+0000 7f23487ff700 1 -- 172.21.15.45:0/2966116666 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23400b2600 con 0x7f23400d01b0 2023-11-28T12:08:25.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.604+0000 7f2336ffd700 1 -- 172.21.15.45:0/2966116666 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f2338012050 con 0x7f23400d01b0 2023-11-28T12:08:25.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.605+0000 7f2336ffd700 1 --2- 172.21.15.45:0/2966116666 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f23240682f0 0x7f232406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:25.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.605+0000 7f2336ffd700 1 -- 172.21.15.45:0/2966116666 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f2338086130 con 0x7f23400d01b0 2023-11-28T12:08:25.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.605+0000 7f234659b700 1 --2- 172.21.15.45:0/2966116666 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f23240682f0 0x7f232406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:25.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.606+0000 7f234659b700 1 --2- 172.21.15.45:0/2966116666 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f23240682f0 0x7f232406a7a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f233c014040 tx=0x7f233c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:25.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.609+0000 7f2336ffd700 1 -- 172.21.15.45:0/2966116666 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f2338052bc0 con 0x7f23400d01b0 2023-11-28T12:08:25.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:25.827+0000 7f23487ff700 1 -- 172.21.15.45:0/2966116666 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f2340068690 con 0x7f23400d01b0 2023-11-28T12:08:26.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:26.562+0000 7f2336ffd700 1 -- 172.21.15.45:0/2966116666 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v43) v1 ==== 97+0+0 (secure 0 0 0) 0x7f23380561e0 con 0x7f23400d01b0 2023-11-28T12:08:26.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:26.566+0000 7f23487ff700 1 -- 172.21.15.45:0/2966116666 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f23240682f0 msgr2=0x7f232406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:26.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:26.566+0000 7f23487ff700 1 --2- 172.21.15.45:0/2966116666 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f23240682f0 0x7f232406a7a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f233c014040 tx=0x7f233c008030 comp rx=0 tx=0).stop 2023-11-28T12:08:26.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:26.566+0000 7f23487ff700 1 -- 172.21.15.45:0/2966116666 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23400d01b0 msgr2=0x7f23400c9500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:26.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:26.566+0000 7f23487ff700 1 --2- 172.21.15.45:0/2966116666 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23400d01b0 0x7f23400c9500 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f2338007e40 tx=0x7f233800e3c0 comp rx=0 tx=0).stop 2023-11-28T12:08:26.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:26.566+0000 7f23487ff700 1 -- 172.21.15.45:0/2966116666 shutdown_connections 2023-11-28T12:08:26.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:26.566+0000 7f23487ff700 1 --2- 172.21.15.45:0/2966116666 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f23240682f0 0x7f232406a7a0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:26.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:26.566+0000 7f23487ff700 1 --2- 172.21.15.45:0/2966116666 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f23400b20b0 0x7f23400b63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:26.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:26.566+0000 7f23487ff700 1 --2- 172.21.15.45:0/2966116666 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23400d01b0 0x7f23400c9500 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:26.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:26.566+0000 7f23487ff700 1 --2- 172.21.15.45:0/2966116666 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f23400b29b0 0x7f23400ca390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:26.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:26.566+0000 7f23487ff700 1 -- 172.21.15.45:0/2966116666 >> 172.21.15.45:0/2966116666 conn(0x7f234009c3f0 msgr2=0x7f23400d2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:26.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:26.566+0000 7f23487ff700 1 -- 172.21.15.45:0/2966116666 shutdown_connections 2023-11-28T12:08:26.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:26.566+0000 7f23487ff700 1 -- 172.21.15.45:0/2966116666 wait complete. 2023-11-28T12:08:26.570 INFO:teuthology.orchestra.run.smithi045.stderr: removed all blocklist entries 2023-11-28T12:08:26.588 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-28T12:08:26.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:26.795+0000 7fe9173ff700 1 Processor -- start 2023-11-28T12:08:26.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:26.795+0000 7fe9173ff700 1 -- start start 2023-11-28T12:08:26.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:26.796+0000 7fe9173ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe910161340 0x7fe9100d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:26.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:26.796+0000 7fe9173ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9100d1950 con 0x7fe91015c9b0 2023-11-28T12:08:26.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:26.796+0000 7fe9173ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9100b5520 con 0x7fe9100d2320 2023-11-28T12:08:26.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:26.796+0000 7fe9173ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9100b5800 con 0x7fe910161340 2023-11-28T12:08:26.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:26.796+0000 7fe91519b700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fe91015c9b0 0x7fe9100b4bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:52618/0 (socket says 172.21.15.45:52618) 2023-11-28T12:08:26.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:26.796+0000 7fe91519b700 1 -- 172.21.15.45:0/3025716936 learned_addr learned my addr 172.21.15.45:0/3025716936 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:08:26.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:26.797+0000 7fe91499a700 1 --2- 172.21.15.45:0/3025716936 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe910161340 0x7fe9100d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:26.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:26.797+0000 7fe907fff700 1 -- 172.21.15.45:0/3025716936 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3379673031 0 0) 0x7fe9100d1950 con 0x7fe91015c9b0 2023-11-28T12:08:26.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:26.797+0000 7fe907fff700 1 -- 172.21.15.45:0/3025716936 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8fc0035b0 con 0x7fe91015c9b0 2023-11-28T12:08:26.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:26.797+0000 7fe907fff700 1 -- 172.21.15.45:0/3025716936 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3609458018 0 0) 0x7fe9100b5520 con 0x7fe9100d2320 2023-11-28T12:08:26.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:26.797+0000 7fe907fff700 1 -- 172.21.15.45:0/3025716936 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9100d1950 con 0x7fe9100d2320 2023-11-28T12:08:26.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:26.797+0000 7fe907fff700 1 -- 172.21.15.45:0/3025716936 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2479915097 0 0) 0x7fe8fc0035b0 con 0x7fe91015c9b0 2023-11-28T12:08:26.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:26.797+0000 7fe907fff700 1 -- 172.21.15.45:0/3025716936 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe910161340 msgr2=0x7fe9100d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:26.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:26.797+0000 7fe907fff700 1 --2- 172.21.15.45:0/3025716936 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe910161340 0x7fe9100d1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:26.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:26.797+0000 7fe907fff700 1 -- 172.21.15.45:0/3025716936 >> v1:172.21.15.152:6789/0 conn(0x7fe9100d2320 legacy=0x7fe9100cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:26.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:26.797+0000 7fe907fff700 1 -- 172.21.15.45:0/3025716936 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9100d1300 con 0x7fe91015c9b0 2023-11-28T12:08:26.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:26.797+0000 7fe907fff700 1 -- 172.21.15.45:0/3025716936 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3460218165 0 0) 0x7fe90c001670 con 0x7fe91015c9b0 2023-11-28T12:08:26.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:26.797+0000 7fe907fff700 1 -- 172.21.15.45:0/3025716936 >> v1:172.21.15.45:6789/0 conn(0x7fe91015c9b0 legacy=0x7fe9100b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:26.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:26.797+0000 7fe907fff700 1 --2- 172.21.15.45:0/3025716936 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe8fc003bc0 0x7fe8fc003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:26.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:26.797+0000 7fe907fff700 1 --2- 172.21.15.45:0/3025716936 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8fc004850 0x7fe8fc004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:26.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:26.797+0000 7fe907fff700 1 --2- 172.21.15.45:0/3025716936 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe910161340 0x7fe8fc005260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:26.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:26.797+0000 7fe907fff700 1 -- 172.21.15.45:0/3025716936 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9100b5800 con 0x7fe8fc004850 2023-11-28T12:08:26.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:26.797+0000 7fe907fff700 1 -- 172.21.15.45:0/3025716936 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8fc00bba0 con 0x7fe8fc003bc0 2023-11-28T12:08:26.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:26.797+0000 7fe907fff700 1 -- 172.21.15.45:0/3025716936 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8fc00bd60 con 0x7fe910161340 2023-11-28T12:08:26.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:26.798+0000 7fe91499a700 1 --2- 172.21.15.45:0/3025716936 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8fc004850 0x7fe8fc004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:26.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:26.798+0000 7fe91519b700 1 --2- 172.21.15.45:0/3025716936 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe8fc003bc0 0x7fe8fc003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:26.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:26.798+0000 7fe91599c700 1 --2- 172.21.15.45:0/3025716936 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe910161340 0x7fe8fc005260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:26.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:26.798+0000 7fe91499a700 1 -- 172.21.15.45:0/3025716936 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe910161340 msgr2=0x7fe8fc005260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:26.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:26.798+0000 7fe91499a700 1 --2- 172.21.15.45:0/3025716936 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe910161340 0x7fe8fc005260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:26.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:26.798+0000 7fe91499a700 1 -- 172.21.15.45:0/3025716936 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe8fc003bc0 msgr2=0x7fe8fc003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:26.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:26.798+0000 7fe91499a700 1 --2- 172.21.15.45:0/3025716936 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe8fc003bc0 0x7fe8fc003fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:26.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:26.798+0000 7fe91499a700 1 -- 172.21.15.45:0/3025716936 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8fc0035b0 con 0x7fe8fc004850 2023-11-28T12:08:26.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:26.798+0000 7fe91499a700 1 --2- 172.21.15.45:0/3025716936 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8fc004850 0x7fe8fc004cc0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fe900009b60 tx=0x7fe8fc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7402b2dcea8d50d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:26.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:26.798+0000 7fe907fff700 1 -- 172.21.15.45:0/3025716936 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe90000e6c0 con 0x7fe8fc004850 2023-11-28T12:08:26.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:26.798+0000 7fe907fff700 1 -- 172.21.15.45:0/3025716936 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe90000e820 con 0x7fe8fc004850 2023-11-28T12:08:26.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:26.798+0000 7fe907fff700 1 -- 172.21.15.45:0/3025716936 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe90000eb90 con 0x7fe8fc004850 2023-11-28T12:08:26.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:26.799+0000 7fe9173ff700 1 -- 172.21.15.45:0/3025716936 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8fc004850 msgr2=0x7fe8fc004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:26.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:26.799+0000 7fe9173ff700 1 --2- 172.21.15.45:0/3025716936 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8fc004850 0x7fe8fc004cc0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fe900009b60 tx=0x7fe8fc005880 comp rx=0 tx=0).stop 2023-11-28T12:08:26.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:26.799+0000 7fe91599c700 1 -- 172.21.15.45:0/3025716936 reap_dead start 2023-11-28T12:08:26.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:26.799+0000 7fe9173ff700 1 -- 172.21.15.45:0/3025716936 shutdown_connections 2023-11-28T12:08:26.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:26.799+0000 7fe9173ff700 1 -- 172.21.15.45:0/3025716936 >> 172.21.15.45:0/3025716936 conn(0x7fe910072600 msgr2=0x7fe9100cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:26.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:26.799+0000 7fe9173ff700 1 -- 172.21.15.45:0/3025716936 shutdown_connections 2023-11-28T12:08:26.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:26.799+0000 7fe9173ff700 1 -- 172.21.15.45:0/3025716936 wait complete. 2023-11-28T12:08:26.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:26.801+0000 7fe9173ff700 1 Processor -- start 2023-11-28T12:08:26.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:26.801+0000 7fe9173ff700 1 -- start start 2023-11-28T12:08:26.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:26.802+0000 7fe9173ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe8fc004850 0x7fe9101e6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:26.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:26.802+0000 7fe9173ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe9101572b0 0x7fe9101e7b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:26.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:26.802+0000 7fe9173ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe91006ab70 0x7fe910156760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:26.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:26.802+0000 7fe9173ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe910157ae0 con 0x7fe91006ab70 2023-11-28T12:08:26.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:26.802+0000 7fe9173ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9101e6ab0 con 0x7fe8fc004850 2023-11-28T12:08:26.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:26.802+0000 7fe9173ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9101e6d90 con 0x7fe9101572b0 2023-11-28T12:08:26.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:26.802+0000 7fe91599c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe91006ab70 0x7fe910156760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:26.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:26.802+0000 7fe91599c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe91006ab70 0x7fe910156760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54440/0 (socket says 172.21.15.45:54440) 2023-11-28T12:08:26.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:26.802+0000 7fe91599c700 1 -- 172.21.15.45:0/2641372385 learned_addr learned my addr 172.21.15.45:0/2641372385 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:26.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:26.802+0000 7fe91519b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe8fc004850 0x7fe9101e6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:26.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:26.802+0000 7fe91499a700 1 --2- 172.21.15.45:0/2641372385 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe9101572b0 0x7fe9101e7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:26.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:26.803+0000 7fe91599c700 1 -- 172.21.15.45:0/2641372385 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe9101572b0 msgr2=0x7fe9101e7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:26.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:26.803+0000 7fe91599c700 1 --2- 172.21.15.45:0/2641372385 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe9101572b0 0x7fe9101e7b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:26.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:26.803+0000 7fe91599c700 1 -- 172.21.15.45:0/2641372385 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe8fc004850 msgr2=0x7fe9101e6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:26.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:26.803+0000 7fe91599c700 1 --2- 172.21.15.45:0/2641372385 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe8fc004850 0x7fe9101e6420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:26.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:26.803+0000 7fe91599c700 1 -- 172.21.15.45:0/2641372385 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe91015cd80 con 0x7fe91006ab70 2023-11-28T12:08:26.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:26.803+0000 7fe91599c700 1 --2- 172.21.15.45:0/2641372385 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe91006ab70 0x7fe910156760 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fe9100685c0 tx=0x7fe90800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:26.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:26.803+0000 7fe905ffb700 1 -- 172.21.15.45:0/2641372385 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe908003c10 con 0x7fe91006ab70 2023-11-28T12:08:26.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:26.803+0000 7fe905ffb700 1 -- 172.21.15.45:0/2641372385 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe908003d90 con 0x7fe91006ab70 2023-11-28T12:08:26.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:26.803+0000 7fe9173ff700 1 -- 172.21.15.45:0/2641372385 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9100d15e0 con 0x7fe91006ab70 2023-11-28T12:08:26.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:26.803+0000 7fe905ffb700 1 -- 172.21.15.45:0/2641372385 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe908005310 con 0x7fe91006ab70 2023-11-28T12:08:26.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:26.803+0000 7fe9173ff700 1 -- 172.21.15.45:0/2641372385 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe91015cf10 con 0x7fe91006ab70 2023-11-28T12:08:26.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:26.804+0000 7fe9173ff700 1 -- 172.21.15.45:0/2641372385 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9100745c0 con 0x7fe91006ab70 2023-11-28T12:08:26.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:26.805+0000 7fe905ffb700 1 -- 172.21.15.45:0/2641372385 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fe908005470 con 0x7fe91006ab70 2023-11-28T12:08:26.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:26.806+0000 7fe905ffb700 1 --2- 172.21.15.45:0/2641372385 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fe8f40682f0 0x7fe8f406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:26.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:26.806+0000 7fe905ffb700 1 -- 172.21.15.45:0/2641372385 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fe908085bd0 con 0x7fe91006ab70 2023-11-28T12:08:26.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:26.807+0000 7fe91519b700 1 --2- 172.21.15.45:0/2641372385 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fe8f40682f0 0x7fe8f406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:26.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:26.807+0000 7fe91519b700 1 --2- 172.21.15.45:0/2641372385 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fe8f40682f0 0x7fe8f406a7a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe90c001eb0 tx=0x7fe90c000fe0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:26.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:26.810+0000 7fe905ffb700 1 -- 172.21.15.45:0/2641372385 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fe908052690 con 0x7fe91006ab70 2023-11-28T12:08:27.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.095+0000 7fe9173ff700 1 -- 172.21.15.45:0/2641372385 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fe9100d08a0 con 0x7fe91006ab70 2023-11-28T12:08:27.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.095+0000 7fe905ffb700 1 -- 172.21.15.45:0/2641372385 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v11) v1 ==== 80+0+5298 (secure 0 0 0) 0x7fe908055cb0 con 0x7fe91006ab70 2023-11-28T12:08:27.096 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:08:27.096 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-11-28T12:08:27.096 INFO:teuthology.orchestra.run.smithi045.stdout: "auth_dump": [ 2023-11-28T12:08:27.096 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T12:08:27.097 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.a", 2023-11-28T12:08:27.097 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQCN12VlhJ1iEBAAPwejLipJZQnV/6P7L6lA8g==", 2023-11-28T12:08:27.097 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T12:08:27.097 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-11-28T12:08:27.097 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-11-28T12:08:27.097 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-11-28T12:08:27.097 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-11-28T12:08:27.097 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T12:08:27.097 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T12:08:27.097 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T12:08:27.098 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.b", 2023-11-28T12:08:27.098 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQCN12Vlr6poKRAAtFhus9UGFZrdPX+6WU116A==", 2023-11-28T12:08:27.098 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T12:08:27.098 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-11-28T12:08:27.098 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-11-28T12:08:27.098 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-11-28T12:08:27.098 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-11-28T12:08:27.098 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T12:08:27.098 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T12:08:27.098 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T12:08:27.098 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.c", 2023-11-28T12:08:27.099 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQCN12Vlaxs2HRAA/rYFx19h5UmFvkpiAxDjKg==", 2023-11-28T12:08:27.099 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T12:08:27.099 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-11-28T12:08:27.099 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-11-28T12:08:27.099 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-11-28T12:08:27.099 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-11-28T12:08:27.099 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T12:08:27.099 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T12:08:27.099 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T12:08:27.099 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.d", 2023-11-28T12:08:27.099 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQCN12Vl46tjNRAA367PN+mS4wxerzI5vuXgCA==", 2023-11-28T12:08:27.099 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T12:08:27.099 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-11-28T12:08:27.100 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-11-28T12:08:27.100 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-11-28T12:08:27.100 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-11-28T12:08:27.100 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T12:08:27.100 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T12:08:27.100 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T12:08:27.100 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.0", 2023-11-28T12:08:27.100 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQCQ12Vl8522AhAAJv4sFjazwIQ5obUUGqgJ+g==", 2023-11-28T12:08:27.100 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T12:08:27.100 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-11-28T12:08:27.100 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-11-28T12:08:27.100 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-11-28T12:08:27.101 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T12:08:27.101 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T12:08:27.101 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T12:08:27.101 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.1", 2023-11-28T12:08:27.101 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQCT12VlPhVZCBAAS04ENEYS51RMXl904XaeNQ==", 2023-11-28T12:08:27.101 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T12:08:27.101 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-11-28T12:08:27.101 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-11-28T12:08:27.101 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-11-28T12:08:27.101 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T12:08:27.101 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T12:08:27.101 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T12:08:27.101 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.2", 2023-11-28T12:08:27.102 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQCW12Vl5RaxDBAA3n4GyG47l/H5wINInjSqWQ==", 2023-11-28T12:08:27.102 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T12:08:27.102 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-11-28T12:08:27.102 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-11-28T12:08:27.102 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-11-28T12:08:27.102 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T12:08:27.102 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T12:08:27.102 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T12:08:27.102 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.3", 2023-11-28T12:08:27.102 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQCZ12VloTQ4EBAAU8iRvrISZn7x8FfYJj6vOA==", 2023-11-28T12:08:27.102 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T12:08:27.103 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-11-28T12:08:27.103 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-11-28T12:08:27.103 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-11-28T12:08:27.103 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T12:08:27.103 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T12:08:27.103 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T12:08:27.103 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.4", 2023-11-28T12:08:27.103 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQCf12VlJs4aKxAA75OrLomZU+ZLWe6qj+CoJw==", 2023-11-28T12:08:27.103 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T12:08:27.103 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-11-28T12:08:27.103 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-11-28T12:08:27.103 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-11-28T12:08:27.103 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T12:08:27.104 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T12:08:27.104 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T12:08:27.104 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.5", 2023-11-28T12:08:27.104 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQCi12VlQkuxLxAAlT0F37mAouzhrSRKRD78MQ==", 2023-11-28T12:08:27.104 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T12:08:27.104 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-11-28T12:08:27.104 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-11-28T12:08:27.104 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-11-28T12:08:27.104 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T12:08:27.104 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T12:08:27.104 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T12:08:27.104 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.6", 2023-11-28T12:08:27.105 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQCl12Vl2OfDMxAAV9LEr55YsDldXYXahMy9Rg==", 2023-11-28T12:08:27.105 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T12:08:27.105 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-11-28T12:08:27.105 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-11-28T12:08:27.105 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-11-28T12:08:27.105 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T12:08:27.105 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T12:08:27.105 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T12:08:27.105 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.7", 2023-11-28T12:08:27.105 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQCo12VldQCsNxAALZb33rZWI6sXmHBWJlPX0g==", 2023-11-28T12:08:27.105 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T12:08:27.105 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-11-28T12:08:27.105 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-11-28T12:08:27.106 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-11-28T12:08:27.106 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T12:08:27.106 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T12:08:27.106 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T12:08:27.106 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.0", 2023-11-28T12:08:27.106 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQCO12VljkopBBAAR62fve9Sjku9pqyTv1pQXg==", 2023-11-28T12:08:27.106 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T12:08:27.106 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-11-28T12:08:27.106 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow r", 2023-11-28T12:08:27.106 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rw pool=cephfs_data" 2023-11-28T12:08:27.106 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T12:08:27.106 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T12:08:27.106 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T12:08:27.107 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.1", 2023-11-28T12:08:27.107 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQCO12Vl1B+WExAAEsX9UkIk23pAuPUuKpyIIg==", 2023-11-28T12:08:27.107 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T12:08:27.107 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-11-28T12:08:27.107 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow r", 2023-11-28T12:08:27.107 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow rw", 2023-11-28T12:08:27.107 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rwx" 2023-11-28T12:08:27.107 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T12:08:27.107 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T12:08:27.107 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T12:08:27.107 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.2", 2023-11-28T12:08:27.107 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQCO12Vl3HDpCxAA4joXCEwKG9hndZHR0vziiw==", 2023-11-28T12:08:27.108 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T12:08:27.108 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-11-28T12:08:27.108 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow r", 2023-11-28T12:08:27.108 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow rw", 2023-11-28T12:08:27.108 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rwx" 2023-11-28T12:08:27.108 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T12:08:27.108 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T12:08:27.108 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T12:08:27.108 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.3", 2023-11-28T12:08:27.108 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQCO12VlqGtSGxAAWLALZhfUpjq0VBH/ACtOSA==", 2023-11-28T12:08:27.108 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T12:08:27.108 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-11-28T12:08:27.109 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow r", 2023-11-28T12:08:27.109 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow rw", 2023-11-28T12:08:27.109 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rwx" 2023-11-28T12:08:27.109 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T12:08:27.109 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T12:08:27.109 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T12:08:27.109 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.admin", 2023-11-28T12:08:27.109 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQCM12VlaZq7FBAATQ9oiWZS9FzJAahvR3R41g==", 2023-11-28T12:08:27.109 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T12:08:27.109 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-11-28T12:08:27.109 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-11-28T12:08:27.109 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-11-28T12:08:27.109 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-11-28T12:08:27.110 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T12:08:27.110 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T12:08:27.110 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T12:08:27.110 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mgr.x", 2023-11-28T12:08:27.110 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQCN12VlWJ4LCBAAY0cfxIlr/nfBfr8TP7L96w==", 2023-11-28T12:08:27.110 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T12:08:27.110 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-11-28T12:08:27.110 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile mgr", 2023-11-28T12:08:27.110 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-11-28T12:08:27.110 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T12:08:27.110 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T12:08:27.110 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T12:08:27.111 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mgr.y", 2023-11-28T12:08:27.111 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQCM12VlY8eOOxAAR6xl4mDL9yOV6aeCuYBojQ==", 2023-11-28T12:08:27.111 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T12:08:27.111 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-11-28T12:08:27.111 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile mgr", 2023-11-28T12:08:27.111 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-11-28T12:08:27.111 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T12:08:27.111 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T12:08:27.111 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-11-28T12:08:27.111 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-11-28T12:08:27.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.097+0000 7fe9173ff700 1 -- 172.21.15.45:0/2641372385 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fe8f40682f0 msgr2=0x7fe8f406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:27.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.097+0000 7fe9173ff700 1 --2- 172.21.15.45:0/2641372385 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fe8f40682f0 0x7fe8f406a7a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe90c001eb0 tx=0x7fe90c000fe0 comp rx=0 tx=0).stop 2023-11-28T12:08:27.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.097+0000 7fe9173ff700 1 -- 172.21.15.45:0/2641372385 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe91006ab70 msgr2=0x7fe910156760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:27.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.097+0000 7fe9173ff700 1 --2- 172.21.15.45:0/2641372385 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe91006ab70 0x7fe910156760 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fe9100685c0 tx=0x7fe90800ee70 comp rx=0 tx=0).stop 2023-11-28T12:08:27.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.097+0000 7fe9173ff700 1 -- 172.21.15.45:0/2641372385 shutdown_connections 2023-11-28T12:08:27.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.097+0000 7fe9173ff700 1 --2- 172.21.15.45:0/2641372385 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fe8f40682f0 0x7fe8f406a7a0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:27.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.097+0000 7fe9173ff700 1 --2- 172.21.15.45:0/2641372385 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe8fc004850 0x7fe9101e6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:27.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.097+0000 7fe9173ff700 1 --2- 172.21.15.45:0/2641372385 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe91006ab70 0x7fe910156760 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:27.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.097+0000 7fe9173ff700 1 --2- 172.21.15.45:0/2641372385 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe9101572b0 0x7fe9101e7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:27.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.097+0000 7fe9173ff700 1 -- 172.21.15.45:0/2641372385 >> 172.21.15.45:0/2641372385 conn(0x7fe910072600 msgr2=0x7fe9100b5ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:27.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.098+0000 7fe9173ff700 1 -- 172.21.15.45:0/2641372385 shutdown_connections 2023-11-28T12:08:27.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.098+0000 7fe9173ff700 1 -- 172.21.15.45:0/2641372385 wait complete. 2023-11-28T12:08:27.116 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T12:08:27.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.319+0000 7fd5e35ff700 1 Processor -- start 2023-11-28T12:08:27.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.319+0000 7fd5e35ff700 1 -- start start 2023-11-28T12:08:27.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.320+0000 7fd5e35ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd5dc161340 0x7fd5dc0d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:27.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.320+0000 7fd5e35ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5dc0d1950 con 0x7fd5dc0d2320 2023-11-28T12:08:27.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.320+0000 7fd5e35ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5dc0b5520 con 0x7fd5dc15c9b0 2023-11-28T12:08:27.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.320+0000 7fd5e35ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5dc0b5800 con 0x7fd5dc161340 2023-11-28T12:08:27.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.320+0000 7fd5e1b9c700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fd5dc0d2320 0x7fd5dc0cd7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:52628/0 (socket says 172.21.15.45:52628) 2023-11-28T12:08:27.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.320+0000 7fd5e1b9c700 1 -- 172.21.15.45:0/3440303758 learned_addr learned my addr 172.21.15.45:0/3440303758 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:08:27.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.320+0000 7fd5e0b9a700 1 --2- 172.21.15.45:0/3440303758 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd5dc161340 0x7fd5dc0d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:27.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.321+0000 7fd5d3fff700 1 -- 172.21.15.45:0/3440303758 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1354518669 0 0) 0x7fd5dc0d1950 con 0x7fd5dc0d2320 2023-11-28T12:08:27.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.321+0000 7fd5d3fff700 1 -- 172.21.15.45:0/3440303758 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5c80035b0 con 0x7fd5dc0d2320 2023-11-28T12:08:27.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.321+0000 7fd5d3fff700 1 -- 172.21.15.45:0/3440303758 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4038333457 0 0) 0x7fd5dc0b5520 con 0x7fd5dc15c9b0 2023-11-28T12:08:27.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.321+0000 7fd5d3fff700 1 -- 172.21.15.45:0/3440303758 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5dc0d1950 con 0x7fd5dc15c9b0 2023-11-28T12:08:27.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.321+0000 7fd5e0b9a700 1 -- 172.21.15.45:0/3440303758 >> v1:172.21.15.152:6789/0 conn(0x7fd5dc15c9b0 legacy=0x7fd5dc0b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:27.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.321+0000 7fd5e0b9a700 1 -- 172.21.15.45:0/3440303758 >> v1:172.21.15.45:6789/0 conn(0x7fd5dc0d2320 legacy=0x7fd5dc0cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:27.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.321+0000 7fd5e0b9a700 1 -- 172.21.15.45:0/3440303758 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5dc0d1300 con 0x7fd5dc161340 2023-11-28T12:08:27.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.321+0000 7fd5e0b9a700 1 --2- 172.21.15.45:0/3440303758 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd5dc161340 0x7fd5dc0d1de0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc009870 tx=0x7fd5cc009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad1cd8944d2d5730 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:27.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.322+0000 7fd5d3fff700 1 -- 172.21.15.45:0/3440303758 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5cc011830 con 0x7fd5dc161340 2023-11-28T12:08:27.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.322+0000 7fd5d3fff700 1 -- 172.21.15.45:0/3440303758 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5cc011990 con 0x7fd5dc161340 2023-11-28T12:08:27.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.322+0000 7fd5d3fff700 1 -- 172.21.15.45:0/3440303758 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5cc011d20 con 0x7fd5dc161340 2023-11-28T12:08:27.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.322+0000 7fd5e35ff700 1 -- 172.21.15.45:0/3440303758 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd5dc161340 msgr2=0x7fd5dc0d1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:27.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.322+0000 7fd5e35ff700 1 --2- 172.21.15.45:0/3440303758 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd5dc161340 0x7fd5dc0d1de0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc009870 tx=0x7fd5cc009b80 comp rx=0 tx=0).stop 2023-11-28T12:08:27.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.322+0000 7fd5e35ff700 1 -- 172.21.15.45:0/3440303758 shutdown_connections 2023-11-28T12:08:27.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.322+0000 7fd5e35ff700 1 --2- 172.21.15.45:0/3440303758 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd5dc161340 0x7fd5dc0d1de0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:27.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.322+0000 7fd5e35ff700 1 -- 172.21.15.45:0/3440303758 >> 172.21.15.45:0/3440303758 conn(0x7fd5dc072600 msgr2=0x7fd5dc0cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:27.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.322+0000 7fd5e35ff700 1 -- 172.21.15.45:0/3440303758 shutdown_connections 2023-11-28T12:08:27.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.322+0000 7fd5e35ff700 1 -- 172.21.15.45:0/3440303758 wait complete. 2023-11-28T12:08:27.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.324+0000 7fd5e35ff700 1 Processor -- start 2023-11-28T12:08:27.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.324+0000 7fd5e35ff700 1 -- start start 2023-11-28T12:08:27.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.325+0000 7fd5e35ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5dc0d2320 0x7fd5dc0c76b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:27.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.325+0000 7fd5e35ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5dc15c9b0 0x7fd5dc156160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:27.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.325+0000 7fd5e35ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd5dc161340 0x7fd5dc142520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:27.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.325+0000 7fd5e35ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5dc0c6ca0 con 0x7fd5dc0d2320 2023-11-28T12:08:27.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.325+0000 7fd5e35ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5dc142fc0 con 0x7fd5dc15c9b0 2023-11-28T12:08:27.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.325+0000 7fd5e35ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5dc1432a0 con 0x7fd5dc161340 2023-11-28T12:08:27.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.325+0000 7fd5e139b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5dc0d2320 0x7fd5dc0c76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:27.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.325+0000 7fd5e139b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5dc0d2320 0x7fd5dc0c76b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54454/0 (socket says 172.21.15.45:54454) 2023-11-28T12:08:27.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.325+0000 7fd5e139b700 1 -- 172.21.15.45:0/2674814699 learned_addr learned my addr 172.21.15.45:0/2674814699 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:27.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.326+0000 7fd5e0b9a700 1 --2- 172.21.15.45:0/2674814699 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5dc15c9b0 0x7fd5dc156160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:27.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.326+0000 7fd5e1b9c700 1 --2- 172.21.15.45:0/2674814699 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd5dc161340 0x7fd5dc142520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:27.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.326+0000 7fd5e139b700 1 -- 172.21.15.45:0/2674814699 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd5dc161340 msgr2=0x7fd5dc142520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:27.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.326+0000 7fd5e139b700 1 --2- 172.21.15.45:0/2674814699 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd5dc161340 0x7fd5dc142520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:27.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.326+0000 7fd5e139b700 1 -- 172.21.15.45:0/2674814699 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5dc15c9b0 msgr2=0x7fd5dc156160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:27.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.326+0000 7fd5e139b700 1 --2- 172.21.15.45:0/2674814699 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5dc15c9b0 0x7fd5dc156160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:27.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.326+0000 7fd5e139b700 1 -- 172.21.15.45:0/2674814699 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5cc0094a0 con 0x7fd5dc0d2320 2023-11-28T12:08:27.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.326+0000 7fd5e1b9c700 1 --2- 172.21.15.45:0/2674814699 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd5dc161340 0x7fd5dc142520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:08:27.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.326+0000 7fd5e139b700 1 --2- 172.21.15.45:0/2674814699 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5dc0d2320 0x7fd5dc0c76b0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fd5d800c520 tx=0x7fd5d800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:27.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.326+0000 7fd5d1ffb700 1 -- 172.21.15.45:0/2674814699 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d80052d0 con 0x7fd5dc0d2320 2023-11-28T12:08:27.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.326+0000 7fd5d1ffb700 1 -- 172.21.15.45:0/2674814699 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5d8005430 con 0x7fd5dc0d2320 2023-11-28T12:08:27.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.326+0000 7fd5e35ff700 1 -- 172.21.15.45:0/2674814699 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5dc15cd80 con 0x7fd5dc0d2320 2023-11-28T12:08:27.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.326+0000 7fd5d1ffb700 1 -- 172.21.15.45:0/2674814699 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d80038a0 con 0x7fd5dc0d2320 2023-11-28T12:08:27.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.327+0000 7fd5e35ff700 1 -- 172.21.15.45:0/2674814699 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5dc0d15e0 con 0x7fd5dc0d2320 2023-11-28T12:08:27.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.327+0000 7fd5e35ff700 1 -- 172.21.15.45:0/2674814699 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5dc15cf10 con 0x7fd5dc0d2320 2023-11-28T12:08:27.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.328+0000 7fd5d1ffb700 1 -- 172.21.15.45:0/2674814699 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fd5d8019030 con 0x7fd5dc0d2320 2023-11-28T12:08:27.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.329+0000 7fd5d1ffb700 1 --2- 172.21.15.45:0/2674814699 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fd5c00682f0 0x7fd5c006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:27.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.329+0000 7fd5d1ffb700 1 -- 172.21.15.45:0/2674814699 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fd5d8084da0 con 0x7fd5dc0d2320 2023-11-28T12:08:27.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.330+0000 7fd5e0b9a700 1 --2- 172.21.15.45:0/2674814699 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fd5c00682f0 0x7fd5c006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:27.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.330+0000 7fd5e0b9a700 1 --2- 172.21.15.45:0/2674814699 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fd5c00682f0 0x7fd5c006a7a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc0097c0 tx=0x7fd5cc01c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:27.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.333+0000 7fd5d1ffb700 1 -- 172.21.15.45:0/2674814699 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fd5d8051860 con 0x7fd5dc0d2320 2023-11-28T12:08:27.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.537+0000 7fd5e35ff700 1 -- 172.21.15.45:0/2674814699 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd5dc143460 con 0x7fd5dc0d2320 2023-11-28T12:08:27.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.538+0000 7fd5d1ffb700 1 -- 172.21.15.45:0/2674814699 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+14209 (secure 0 0 0) 0x7fd5d8054e80 con 0x7fd5dc0d2320 2023-11-28T12:08:27.539 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:08:27.539 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":43,"fsid":"bd7c37f1-f7c6-4778-b845-52cf2aa6e366","created":"2023-11-28T12:06:09.045075+0000","modified":"2023-11-28T12:08:26.558843+0000","last_up_change":"2023-11-28T12:06:21.282227+0000","last_in_change":"2023-11-28T12:06:12.560924+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T12:06:21.807108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T12:06:22.491009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d0cdd8a-87fd-4f2c-91bd-47bdfa661905","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":115843},{"type":"v1","addr":"172.21.15.45:6808","nonce":115843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":115843},{"type":"v1","addr":"172.21.15.45:6811","nonce":115843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":115843},{"type":"v1","addr":"172.21.15.45:6815","nonce":115843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":115843},{"type":"v1","addr":"172.21.15.45:6813","nonce":115843}]},"public_addr":"172.21.15.45:6808/115843","cluster_addr":"172.21.15.45:6811/115843","heartbeat_back_addr":"172.21.15.45:6815/115843","heartbeat_front_addr":"172.21.15.45:6813/115843","state":["exists","up"]},{"osd":1,"uuid":"c5de4ebd-9ec5-40b3-9caa-9b706fab4c76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":115842},{"type":"v1","addr":"172.21.15.45:6801","nonce":115842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":115842},{"type":"v1","addr":"172.21.15.45:6803","nonce":115842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6807","nonce":115842},{"type":"v1","addr":"172.21.15.45:6809","nonce":115842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":115842},{"type":"v1","addr":"172.21.15.45:6805","nonce":115842}]},"public_addr":"172.21.15.45:6801/115842","cluster_addr":"172.21.15.45:6803/115842","heartbeat_back_addr":"172.21.15.45:6809/115842","heartbeat_front_addr":"172.21.15.45:6805/115842","state":["exists","up"]},{"osd":2,"uuid":"9f4b36b2-65d2-40e7-9fe6-a2991afa71c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":115850},{"type":"v1","addr":"172.21.15.45:6819","nonce":115850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":115850},{"type":"v1","addr":"172.21.15.45:6823","nonce":115850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":115850},{"type":"v1","addr":"172.21.15.45:6831","nonce":115850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":115850},{"type":"v1","addr":"172.21.15.45:6828","nonce":115850}]},"public_addr":"172.21.15.45:6819/115850","cluster_addr":"172.21.15.45:6823/115850","heartbeat_back_addr":"172.21.15.45:6831/115850","heartbeat_front_addr":"172.21.15.45:6828/115850","state":["exists","up"]},{"osd":3,"uuid":"6fe7ef05-4e0d-426c-bf94-44b51d4d550b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":115848},{"type":"v1","addr":"172.21.15.45:6818","nonce":115848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":115848},{"type":"v1","addr":"172.21.15.45:6822","nonce":115848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6827","nonce":115848},{"type":"v1","addr":"172.21.15.45:6829","nonce":115848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":115848},{"type":"v1","addr":"172.21.15.45:6825","nonce":115848}]},"public_addr":"172.21.15.45:6818/115848","cluster_addr":"172.21.15.45:6822/115848","heartbeat_back_addr":"172.21.15.45:6829/115848","heartbeat_front_addr":"172.21.15.45:6825/115848","state":["exists","up"]},{"osd":4,"uuid":"fa403c08-d8a1-4a3a-8384-cb465c1a654c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":116092},{"type":"v1","addr":"172.21.15.152:6801","nonce":116092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":116092},{"type":"v1","addr":"172.21.15.152:6803","nonce":116092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":116092},{"type":"v1","addr":"172.21.15.152:6807","nonce":116092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":116092},{"type":"v1","addr":"172.21.15.152:6805","nonce":116092}]},"public_addr":"172.21.15.152:6801/116092","cluster_addr":"172.21.15.152:6803/116092","heartbeat_back_addr":"172.21.15.152:6807/116092","heartbeat_front_addr":"172.21.15.152:6805/116092","state":["exists","up"]},{"osd":5,"uuid":"399fc450-39fa-43a6-bf80-0b8bcb41bd95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6815","nonce":116093},{"type":"v1","addr":"172.21.15.152:6817","nonce":116093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":116093},{"type":"v1","addr":"172.21.15.152:6819","nonce":116093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":116093},{"type":"v1","addr":"172.21.15.152:6823","nonce":116093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":116093},{"type":"v1","addr":"172.21.15.152:6821","nonce":116093}]},"public_addr":"172.21.15.152:6817/116093","cluster_addr":"172.21.15.152:6819/116093","heartbeat_back_addr":"172.21.15.152:6823/116093","heartbeat_front_addr":"172.21.15.152:6821/116093","state":["exists","up"]},{"osd":6,"uuid":"e59a4017-2d23-4627-836b-e25b2d3ddaaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":116094},{"type":"v1","addr":"172.21.15.152:6809","nonce":116094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":116094},{"type":"v1","addr":"172.21.15.152:6811","nonce":116094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":116094},{"type":"v1","addr":"172.21.15.152:6816","nonce":116094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":116094},{"type":"v1","addr":"172.21.15.152:6813","nonce":116094}]},"public_addr":"172.21.15.152:6809/116094","cluster_addr":"172.21.15.152:6811/116094","heartbeat_back_addr":"172.21.15.152:6816/116094","heartbeat_front_addr":"172.21.15.152:6813/116094","state":["exists","up"]},{"osd":7,"uuid":"8d7f9d4b-bf08-4670-8591-388c0f012a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":116097},{"type":"v1","addr":"172.21.15.152:6825","nonce":116097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":116097},{"type":"v1","addr":"172.21.15.152:6827","nonce":116097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":116097},{"type":"v1","addr":"172.21.15.152:6831","nonce":116097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":116097},{"type":"v1","addr":"172.21.15.152:6829","nonce":116097}]},"public_addr":"172.21.15.152:6825/116097","cluster_addr":"172.21.15.152:6827/116097","heartbeat_back_addr":"172.21.15.152:6831/116097","heartbeat_front_addr":"172.21.15.152:6829/116097","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.937710+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.865423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.159434+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.913090+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.131647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.966255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.972583+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.177209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T12:08:27.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.540+0000 7fd5e35ff700 1 -- 172.21.15.45:0/2674814699 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fd5c00682f0 msgr2=0x7fd5c006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:27.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.540+0000 7fd5e35ff700 1 --2- 172.21.15.45:0/2674814699 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fd5c00682f0 0x7fd5c006a7a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc0097c0 tx=0x7fd5cc01c040 comp rx=0 tx=0).stop 2023-11-28T12:08:27.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.540+0000 7fd5e35ff700 1 -- 172.21.15.45:0/2674814699 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5dc0d2320 msgr2=0x7fd5dc0c76b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:27.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.540+0000 7fd5e35ff700 1 --2- 172.21.15.45:0/2674814699 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5dc0d2320 0x7fd5dc0c76b0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fd5d800c520 tx=0x7fd5d800c830 comp rx=0 tx=0).stop 2023-11-28T12:08:27.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.540+0000 7fd5e35ff700 1 -- 172.21.15.45:0/2674814699 shutdown_connections 2023-11-28T12:08:27.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.540+0000 7fd5e35ff700 1 --2- 172.21.15.45:0/2674814699 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fd5c00682f0 0x7fd5c006a7a0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:27.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.540+0000 7fd5e35ff700 1 --2- 172.21.15.45:0/2674814699 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd5dc161340 0x7fd5dc142520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:27.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.540+0000 7fd5e35ff700 1 --2- 172.21.15.45:0/2674814699 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5dc0d2320 0x7fd5dc0c76b0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:27.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.540+0000 7fd5e35ff700 1 --2- 172.21.15.45:0/2674814699 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5dc15c9b0 0x7fd5dc156160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:27.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.540+0000 7fd5e35ff700 1 -- 172.21.15.45:0/2674814699 >> 172.21.15.45:0/2674814699 conn(0x7fd5dc072600 msgr2=0x7fd5dc0b6240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:27.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.540+0000 7fd5e35ff700 1 -- 172.21.15.45:0/2674814699 shutdown_connections 2023-11-28T12:08:27.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.540+0000 7fd5e35ff700 1 -- 172.21.15.45:0/2674814699 wait complete. 2023-11-28T12:08:27.560 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-28T12:06:21.807108+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-28T12:06:22.491009+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T12:08:27.561 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T12:08:27.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.767+0000 7f66083ff700 1 Processor -- start 2023-11-28T12:08:27.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.767+0000 7f66083ff700 1 -- start start 2023-11-28T12:08:27.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.768+0000 7f66083ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6600161340 0x7f66000d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:27.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.768+0000 7f66083ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f66000d2320 0x7f66000cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:27.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.768+0000 7f66083ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66000d1950 con 0x7f660015c9b0 2023-11-28T12:08:27.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.768+0000 7f66083ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66000b5800 con 0x7f6600161340 2023-11-28T12:08:27.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.768+0000 7f66083ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66000b5300 con 0x7f66000d2320 2023-11-28T12:08:27.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.769+0000 7f660599a700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6600161340 0x7f66000d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:27.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.769+0000 7f660599a700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6600161340 0x7f66000d1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54462/0 (socket says 172.21.15.45:54462) 2023-11-28T12:08:27.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.769+0000 7f660599a700 1 -- 172.21.15.45:0/3212756747 learned_addr learned my addr 172.21.15.45:0/3212756747 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:27.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.769+0000 7f660699c700 1 --2- 172.21.15.45:0/3212756747 >> v2:172.21.15.152:3300/0 conn(0x7f66000d2320 0x7f66000cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:27.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.769+0000 7f660599a700 1 -- 172.21.15.45:0/3212756747 >> v2:172.21.15.152:3300/0 conn(0x7f66000d2320 msgr2=0x7f66000cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:27.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.769+0000 7f660599a700 1 --2- 172.21.15.45:0/3212756747 >> v2:172.21.15.152:3300/0 conn(0x7f66000d2320 0x7f66000cd7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:27.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.769+0000 7f660599a700 1 -- 172.21.15.45:0/3212756747 >> v1:172.21.15.152:6789/0 conn(0x7f660015c9b0 legacy=0x7f66000b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:27.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.769+0000 7f660599a700 1 -- 172.21.15.45:0/3212756747 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66000b5520 con 0x7f6600161340 2023-11-28T12:08:27.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.769+0000 7f660699c700 1 --2- 172.21.15.45:0/3212756747 >> v2:172.21.15.152:3300/0 conn(0x7f66000d2320 0x7f66000cd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:08:27.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.769+0000 7f660599a700 1 --2- 172.21.15.45:0/3212756747 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6600161340 0x7f66000d1de0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f660006c170 tx=0x7f65f0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fc76f17fd8029a8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:27.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.770+0000 7f6605199700 1 -- 172.21.15.45:0/3212756747 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f0004230 con 0x7f6600161340 2023-11-28T12:08:27.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.770+0000 7f6605199700 1 -- 172.21.15.45:0/3212756747 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65f0004390 con 0x7f6600161340 2023-11-28T12:08:27.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.770+0000 7f6605199700 1 -- 172.21.15.45:0/3212756747 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f00036a0 con 0x7f6600161340 2023-11-28T12:08:27.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.770+0000 7f66083ff700 1 -- 172.21.15.45:0/3212756747 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6600161340 msgr2=0x7f66000d1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:27.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.770+0000 7f66083ff700 1 --2- 172.21.15.45:0/3212756747 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6600161340 0x7f66000d1de0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f660006c170 tx=0x7f65f0009c00 comp rx=0 tx=0).stop 2023-11-28T12:08:27.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.770+0000 7f66083ff700 1 -- 172.21.15.45:0/3212756747 shutdown_connections 2023-11-28T12:08:27.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.770+0000 7f66083ff700 1 --2- 172.21.15.45:0/3212756747 >> v2:172.21.15.152:3300/0 conn(0x7f66000d2320 0x7f66000cd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:27.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.770+0000 7f66083ff700 1 --2- 172.21.15.45:0/3212756747 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6600161340 0x7f66000d1de0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:27.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.770+0000 7f66083ff700 1 -- 172.21.15.45:0/3212756747 >> 172.21.15.45:0/3212756747 conn(0x7f6600072600 msgr2=0x7f66000cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:27.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.770+0000 7f66083ff700 1 -- 172.21.15.45:0/3212756747 shutdown_connections 2023-11-28T12:08:27.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.770+0000 7f66083ff700 1 -- 172.21.15.45:0/3212756747 wait complete. 2023-11-28T12:08:27.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.772+0000 7f66083ff700 1 Processor -- start 2023-11-28T12:08:27.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.772+0000 7f66083ff700 1 -- start start 2023-11-28T12:08:27.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.773+0000 7f66083ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f66000d2320 0x7f66000c87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:27.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.773+0000 7f66083ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f660015c9b0 0x7f66000c6640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:27.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.773+0000 7f66083ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6600161340 0x7f66000c6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:27.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.773+0000 7f66083ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66000c7720 con 0x7f66000d2320 2023-11-28T12:08:27.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.773+0000 7f66083ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66000c7a00 con 0x7f660015c9b0 2023-11-28T12:08:27.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.773+0000 7f66083ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66000c7ce0 con 0x7f6600161340 2023-11-28T12:08:27.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.773+0000 7f660619b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f66000d2320 0x7f66000c87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:27.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.773+0000 7f660619b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f66000d2320 0x7f66000c87c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54476/0 (socket says 172.21.15.45:54476) 2023-11-28T12:08:27.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.773+0000 7f660619b700 1 -- 172.21.15.45:0/252879437 learned_addr learned my addr 172.21.15.45:0/252879437 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:27.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.773+0000 7f660599a700 1 --2- 172.21.15.45:0/252879437 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f660015c9b0 0x7f66000c6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:27.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.773+0000 7f660699c700 1 --2- 172.21.15.45:0/252879437 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6600161340 0x7f66000c6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:27.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.774+0000 7f660619b700 1 -- 172.21.15.45:0/252879437 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6600161340 msgr2=0x7f66000c6ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:27.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.774+0000 7f660619b700 1 --2- 172.21.15.45:0/252879437 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6600161340 0x7f66000c6ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:27.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.774+0000 7f660619b700 1 -- 172.21.15.45:0/252879437 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f660015c9b0 msgr2=0x7f66000c6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:27.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.774+0000 7f660619b700 1 --2- 172.21.15.45:0/252879437 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f660015c9b0 0x7f66000c6640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:27.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.774+0000 7f660619b700 1 -- 172.21.15.45:0/252879437 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65f0009550 con 0x7f66000d2320 2023-11-28T12:08:27.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.774+0000 7f660619b700 1 --2- 172.21.15.45:0/252879437 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f66000d2320 0x7f66000c87c0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f65fc00b4a0 tx=0x7f65fc00b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:27.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.774+0000 7f65f6ffd700 1 -- 172.21.15.45:0/252879437 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65fc011830 con 0x7f66000d2320 2023-11-28T12:08:27.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.774+0000 7f65f6ffd700 1 -- 172.21.15.45:0/252879437 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65fc011990 con 0x7f66000d2320 2023-11-28T12:08:27.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.774+0000 7f65f6ffd700 1 -- 172.21.15.45:0/252879437 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65fc011d40 con 0x7f66000d2320 2023-11-28T12:08:27.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.774+0000 7f66083ff700 1 -- 172.21.15.45:0/252879437 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66000d15e0 con 0x7f66000d2320 2023-11-28T12:08:27.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.774+0000 7f66083ff700 1 -- 172.21.15.45:0/252879437 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66000d1300 con 0x7f66000d2320 2023-11-28T12:08:27.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.775+0000 7f66083ff700 1 -- 172.21.15.45:0/252879437 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f660015cd80 con 0x7f66000d2320 2023-11-28T12:08:27.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.776+0000 7f65f6ffd700 1 -- 172.21.15.45:0/252879437 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f65fc00f050 con 0x7f66000d2320 2023-11-28T12:08:27.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.777+0000 7f65f6ffd700 1 --2- 172.21.15.45:0/252879437 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f65e40682f0 0x7f65e406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:27.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.777+0000 7f65f6ffd700 1 -- 172.21.15.45:0/252879437 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f65fc085430 con 0x7f66000d2320 2023-11-28T12:08:27.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.778+0000 7f660599a700 1 --2- 172.21.15.45:0/252879437 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f65e40682f0 0x7f65e406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:27.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.778+0000 7f660599a700 1 --2- 172.21.15.45:0/252879437 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f65e40682f0 0x7f65e406a7a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f65f0009870 tx=0x7f65f0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:27.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.781+0000 7f65f6ffd700 1 -- 172.21.15.45:0/252879437 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f65fc051ef0 con 0x7f66000d2320 2023-11-28T12:08:27.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.981+0000 7f66083ff700 1 -- 172.21.15.45:0/252879437 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f66000745c0 con 0x7f66000d2320 2023-11-28T12:08:27.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.981+0000 7f65f6ffd700 1 -- 172.21.15.45:0/252879437 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v43) v1 ==== 92+0+10 (secure 0 0 0) 0x7f65fc055510 con 0x7f66000d2320 2023-11-28T12:08:27.982 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-11-28T12:08:27.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.984+0000 7f66083ff700 1 -- 172.21.15.45:0/252879437 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f65e40682f0 msgr2=0x7f65e406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:27.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.984+0000 7f66083ff700 1 --2- 172.21.15.45:0/252879437 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f65e40682f0 0x7f65e406a7a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f65f0009870 tx=0x7f65f0008030 comp rx=0 tx=0).stop 2023-11-28T12:08:27.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.984+0000 7f66083ff700 1 -- 172.21.15.45:0/252879437 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f66000d2320 msgr2=0x7f66000c87c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:27.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.984+0000 7f66083ff700 1 --2- 172.21.15.45:0/252879437 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f66000d2320 0x7f66000c87c0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f65fc00b4a0 tx=0x7f65fc00b7b0 comp rx=0 tx=0).stop 2023-11-28T12:08:27.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.984+0000 7f66083ff700 1 -- 172.21.15.45:0/252879437 shutdown_connections 2023-11-28T12:08:27.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.984+0000 7f66083ff700 1 --2- 172.21.15.45:0/252879437 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f65e40682f0 0x7f65e406a7a0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:27.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.984+0000 7f66083ff700 1 --2- 172.21.15.45:0/252879437 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6600161340 0x7f66000c6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:27.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.984+0000 7f66083ff700 1 --2- 172.21.15.45:0/252879437 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f66000d2320 0x7f66000c87c0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:27.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.984+0000 7f66083ff700 1 --2- 172.21.15.45:0/252879437 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f660015c9b0 0x7f66000c6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:27.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.984+0000 7f66083ff700 1 -- 172.21.15.45:0/252879437 >> 172.21.15.45:0/252879437 conn(0x7f6600072600 msgr2=0x7f66000b8570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:27.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.984+0000 7f66083ff700 1 -- 172.21.15.45:0/252879437 shutdown_connections 2023-11-28T12:08:27.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:27.984+0000 7f66083ff700 1 -- 172.21.15.45:0/252879437 wait complete. 2023-11-28T12:08:28.005 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T12:08:28.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.213+0000 7fb9cd1ff700 1 Processor -- start 2023-11-28T12:08:28.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.213+0000 7fb9cd1ff700 1 -- start start 2023-11-28T12:08:28.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.214+0000 7fb9cd1ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb9c815c9b0 0x7fb9c80b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:28.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.214+0000 7fb9cd1ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb9c80cd7c0 0x7fb9c80cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:28.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.214+0000 7fb9cd1ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9c80d1950 con 0x7fb9c8161340 2023-11-28T12:08:28.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.214+0000 7fb9cd1ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9c80b5800 con 0x7fb9c80cd7c0 2023-11-28T12:08:28.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.214+0000 7fb9cd1ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9c80ce140 con 0x7fb9c815c9b0 2023-11-28T12:08:28.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.215+0000 7fb9c759e700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb9c80cd7c0 0x7fb9c80cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:28.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.215+0000 7fb9c759e700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb9c80cd7c0 0x7fb9c80cdc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54492/0 (socket says 172.21.15.45:54492) 2023-11-28T12:08:28.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.215+0000 7fb9c759e700 1 -- 172.21.15.45:0/126968023 learned_addr learned my addr 172.21.15.45:0/126968023 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:28.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.215+0000 7fb9c659c700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fb9c8161340 0x7fb9c80d1de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:52638/0 (socket says 172.21.15.45:52638) 2023-11-28T12:08:28.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.215+0000 7fb9c6d9d700 1 --2- 172.21.15.45:0/126968023 >> v2:172.21.15.152:3300/0 conn(0x7fb9c815c9b0 0x7fb9c80b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:28.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.215+0000 7fb9c759e700 1 -- 172.21.15.45:0/126968023 >> v2:172.21.15.152:3300/0 conn(0x7fb9c815c9b0 msgr2=0x7fb9c80b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:28.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.215+0000 7fb9c759e700 1 --2- 172.21.15.45:0/126968023 >> v2:172.21.15.152:3300/0 conn(0x7fb9c815c9b0 0x7fb9c80b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:28.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.215+0000 7fb9c759e700 1 -- 172.21.15.45:0/126968023 >> v1:172.21.15.45:6789/0 conn(0x7fb9c8161340 legacy=0x7fb9c80d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:28.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.215+0000 7fb9c759e700 1 -- 172.21.15.45:0/126968023 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9c80d24f0 con 0x7fb9c80cd7c0 2023-11-28T12:08:28.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.215+0000 7fb9c5d9b700 1 -- 172.21.15.45:0/126968023 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 910235469 0 0) 0x7fb9c80d1950 con 0x7fb9c8161340 2023-11-28T12:08:28.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.215+0000 7fb9c759e700 1 --2- 172.21.15.45:0/126968023 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb9c80cd7c0 0x7fb9c80cdc00 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fb9c8067460 tx=0x7fb9c000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14c1446f65e32dac server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:28.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.216+0000 7fb9c5d9b700 1 -- 172.21.15.45:0/126968023 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9c000e070 con 0x7fb9c80cd7c0 2023-11-28T12:08:28.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.216+0000 7fb9c5d9b700 1 -- 172.21.15.45:0/126968023 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9c000b910 con 0x7fb9c80cd7c0 2023-11-28T12:08:28.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.216+0000 7fb9c5d9b700 1 -- 172.21.15.45:0/126968023 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9c000bcc0 con 0x7fb9c80cd7c0 2023-11-28T12:08:28.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.216+0000 7fb9cd1ff700 1 -- 172.21.15.45:0/126968023 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb9c80cd7c0 msgr2=0x7fb9c80cdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:28.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.216+0000 7fb9cd1ff700 1 --2- 172.21.15.45:0/126968023 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb9c80cd7c0 0x7fb9c80cdc00 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fb9c8067460 tx=0x7fb9c000b330 comp rx=0 tx=0).stop 2023-11-28T12:08:28.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.216+0000 7fb9cd1ff700 1 -- 172.21.15.45:0/126968023 shutdown_connections 2023-11-28T12:08:28.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.216+0000 7fb9cd1ff700 1 --2- 172.21.15.45:0/126968023 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb9c80cd7c0 0x7fb9c80cdc00 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:28.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.216+0000 7fb9cd1ff700 1 --2- 172.21.15.45:0/126968023 >> v2:172.21.15.152:3300/0 conn(0x7fb9c815c9b0 0x7fb9c80b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:28.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.216+0000 7fb9cd1ff700 1 -- 172.21.15.45:0/126968023 >> 172.21.15.45:0/126968023 conn(0x7fb9c8072600 msgr2=0x7fb9c80cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:28.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.216+0000 7fb9cd1ff700 1 -- 172.21.15.45:0/126968023 shutdown_connections 2023-11-28T12:08:28.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.216+0000 7fb9cd1ff700 1 -- 172.21.15.45:0/126968023 wait complete. 2023-11-28T12:08:28.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.218+0000 7fb9cd1ff700 1 Processor -- start 2023-11-28T12:08:28.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.218+0000 7fb9cd1ff700 1 -- start start 2023-11-28T12:08:28.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.219+0000 7fb9cd1ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb9c80cd7c0 0x7fb9c81e8450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:28.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.219+0000 7fb9cd1ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb9c815c9b0 0x7fb9c81576c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:28.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.219+0000 7fb9cd1ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb9c8161340 0x7fb9c80c7660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:28.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.219+0000 7fb9cd1ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c80c7ba0 con 0x7fb9c80cd7c0 2023-11-28T12:08:28.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.219+0000 7fb9cd1ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c80c7e50 con 0x7fb9c815c9b0 2023-11-28T12:08:28.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.219+0000 7fb9cd1ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c80c8130 con 0x7fb9c8161340 2023-11-28T12:08:28.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.219+0000 7fb9c6d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb9c80cd7c0 0x7fb9c81e8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:28.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.219+0000 7fb9c6d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb9c80cd7c0 0x7fb9c81e8450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54504/0 (socket says 172.21.15.45:54504) 2023-11-28T12:08:28.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.219+0000 7fb9c6d9d700 1 -- 172.21.15.45:0/320736950 learned_addr learned my addr 172.21.15.45:0/320736950 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:28.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.220+0000 7fb9c659c700 1 --2- 172.21.15.45:0/320736950 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb9c815c9b0 0x7fb9c81576c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:28.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.220+0000 7fb9c759e700 1 --2- 172.21.15.45:0/320736950 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb9c8161340 0x7fb9c80c7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:28.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.220+0000 7fb9c6d9d700 1 -- 172.21.15.45:0/320736950 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb9c8161340 msgr2=0x7fb9c80c7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:28.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.220+0000 7fb9c6d9d700 1 --2- 172.21.15.45:0/320736950 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb9c8161340 0x7fb9c80c7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:28.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.220+0000 7fb9c6d9d700 1 -- 172.21.15.45:0/320736950 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb9c815c9b0 msgr2=0x7fb9c81576c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:28.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.220+0000 7fb9c6d9d700 1 --2- 172.21.15.45:0/320736950 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb9c815c9b0 0x7fb9c81576c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:28.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.220+0000 7fb9c6d9d700 1 -- 172.21.15.45:0/320736950 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9c0009b30 con 0x7fb9c80cd7c0 2023-11-28T12:08:28.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.220+0000 7fb9c659c700 1 --2- 172.21.15.45:0/320736950 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb9c815c9b0 0x7fb9c81576c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:08:28.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.220+0000 7fb9c759e700 1 --2- 172.21.15.45:0/320736950 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb9c8161340 0x7fb9c80c7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:08:28.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.220+0000 7fb9c6d9d700 1 --2- 172.21.15.45:0/320736950 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb9c80cd7c0 0x7fb9c81e8450 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fb9b800e870 tx=0x7fb9b800ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:28.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.220+0000 7fb9af7fe700 1 -- 172.21.15.45:0/320736950 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b8009590 con 0x7fb9c80cd7c0 2023-11-28T12:08:28.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.220+0000 7fb9af7fe700 1 -- 172.21.15.45:0/320736950 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9b800ee70 con 0x7fb9c80cd7c0 2023-11-28T12:08:28.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.220+0000 7fb9af7fe700 1 -- 172.21.15.45:0/320736950 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b800ca50 con 0x7fb9c80cd7c0 2023-11-28T12:08:28.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.220+0000 7fb9cd1ff700 1 -- 172.21.15.45:0/320736950 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9c80d1300 con 0x7fb9c80cd7c0 2023-11-28T12:08:28.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.220+0000 7fb9cd1ff700 1 -- 172.21.15.45:0/320736950 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9c80b5520 con 0x7fb9c80cd7c0 2023-11-28T12:08:28.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.222+0000 7fb9cd1ff700 1 -- 172.21.15.45:0/320736950 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9c80d15e0 con 0x7fb9c80cd7c0 2023-11-28T12:08:28.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.223+0000 7fb9af7fe700 1 -- 172.21.15.45:0/320736950 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fb9b8019030 con 0x7fb9c80cd7c0 2023-11-28T12:08:28.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.223+0000 7fb9af7fe700 1 --2- 172.21.15.45:0/320736950 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb9b40682f0 0x7fb9b406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:28.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.223+0000 7fb9af7fe700 1 -- 172.21.15.45:0/320736950 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fb9b8085740 con 0x7fb9c80cd7c0 2023-11-28T12:08:28.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.224+0000 7fb9c659c700 1 --2- 172.21.15.45:0/320736950 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb9b40682f0 0x7fb9b406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:28.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.225+0000 7fb9c659c700 1 --2- 172.21.15.45:0/320736950 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb9b40682f0 0x7fb9b406a7a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc007fd0 tx=0x7fb9bc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:28.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.227+0000 7fb9af7fe700 1 -- 172.21.15.45:0/320736950 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fb9b80522f0 con 0x7fb9c80cd7c0 2023-11-28T12:08:28.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.429+0000 7fb9cd1ff700 1 -- 172.21.15.45:0/320736950 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb9c80ca5b0 con 0x7fb9c80cd7c0 2023-11-28T12:08:28.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.430+0000 7fb9af7fe700 1 -- 172.21.15.45:0/320736950 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v43) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb9b8055910 con 0x7fb9c80cd7c0 2023-11-28T12:08:28.430 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-11-28T12:08:28.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.432+0000 7fb9cd1ff700 1 -- 172.21.15.45:0/320736950 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb9b40682f0 msgr2=0x7fb9b406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:28.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.432+0000 7fb9cd1ff700 1 --2- 172.21.15.45:0/320736950 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb9b40682f0 0x7fb9b406a7a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc007fd0 tx=0x7fb9bc009040 comp rx=0 tx=0).stop 2023-11-28T12:08:28.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.432+0000 7fb9cd1ff700 1 -- 172.21.15.45:0/320736950 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb9c80cd7c0 msgr2=0x7fb9c81e8450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:28.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.432+0000 7fb9cd1ff700 1 --2- 172.21.15.45:0/320736950 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb9c80cd7c0 0x7fb9c81e8450 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fb9b800e870 tx=0x7fb9b800ec30 comp rx=0 tx=0).stop 2023-11-28T12:08:28.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.432+0000 7fb9cd1ff700 1 -- 172.21.15.45:0/320736950 shutdown_connections 2023-11-28T12:08:28.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.432+0000 7fb9cd1ff700 1 --2- 172.21.15.45:0/320736950 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb9b40682f0 0x7fb9b406a7a0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:28.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.432+0000 7fb9cd1ff700 1 --2- 172.21.15.45:0/320736950 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb9c8161340 0x7fb9c80c7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:28.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.432+0000 7fb9cd1ff700 1 --2- 172.21.15.45:0/320736950 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb9c80cd7c0 0x7fb9c81e8450 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:28.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.432+0000 7fb9cd1ff700 1 --2- 172.21.15.45:0/320736950 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb9c815c9b0 0x7fb9c81576c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:28.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.432+0000 7fb9cd1ff700 1 -- 172.21.15.45:0/320736950 >> 172.21.15.45:0/320736950 conn(0x7fb9c8072600 msgr2=0x7fb9c80b5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:28.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.432+0000 7fb9cd1ff700 1 -- 172.21.15.45:0/320736950 shutdown_connections 2023-11-28T12:08:28.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.432+0000 7fb9cd1ff700 1 -- 172.21.15.45:0/320736950 wait complete. 2023-11-28T12:08:28.451 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-28T12:08:28.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.654+0000 7fa3c09ff700 1 Processor -- start 2023-11-28T12:08:28.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.654+0000 7fa3c09ff700 1 -- start start 2023-11-28T12:08:28.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.655+0000 7fa3c09ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fa3bc15c9b0 0x7fa3bc0b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:28.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.656+0000 7fa3c09ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3bc0d1950 con 0x7fa3bc0cd7c0 2023-11-28T12:08:28.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.656+0000 7fa3c09ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3bc0d24f0 con 0x7fa3bc161340 2023-11-28T12:08:28.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.656+0000 7fa3c09ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3bc0b5800 con 0x7fa3bc15c9b0 2023-11-28T12:08:28.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.656+0000 7fa3bad9d700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fa3bc0cd7c0 0x7fa3bc0b5fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:52654/0 (socket says 172.21.15.45:52654) 2023-11-28T12:08:28.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.656+0000 7fa3bad9d700 1 -- 172.21.15.45:0/5586487 learned_addr learned my addr 172.21.15.45:0/5586487 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:08:28.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.656+0000 7fa3ba59c700 1 --2- 172.21.15.45:0/5586487 >> v2:172.21.15.152:3300/0 conn(0x7fa3bc15c9b0 0x7fa3bc0b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:28.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.656+0000 7fa3b9d9b700 1 -- 172.21.15.45:0/5586487 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1097384277 0 0) 0x7fa3bc0d1950 con 0x7fa3bc0cd7c0 2023-11-28T12:08:28.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.656+0000 7fa3b9d9b700 1 -- 172.21.15.45:0/5586487 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3a80035b0 con 0x7fa3bc0cd7c0 2023-11-28T12:08:28.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.656+0000 7fa3ba59c700 1 -- 172.21.15.45:0/5586487 >> v1:172.21.15.152:6789/0 conn(0x7fa3bc161340 legacy=0x7fa3bc0d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:28.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.656+0000 7fa3ba59c700 1 -- 172.21.15.45:0/5586487 >> v1:172.21.15.45:6789/0 conn(0x7fa3bc0cd7c0 legacy=0x7fa3bc0b5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:28.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.656+0000 7fa3ba59c700 1 -- 172.21.15.45:0/5586487 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3bc0b5520 con 0x7fa3bc15c9b0 2023-11-28T12:08:28.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.657+0000 7fa3ba59c700 1 --2- 172.21.15.45:0/5586487 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3bc15c9b0 0x7fa3bc0b4bf0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac009840 tx=0x7fa3ac009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8b5bdfdc4c5649d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:28.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.657+0000 7fa3b9d9b700 1 -- 172.21.15.45:0/5586487 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3ac011830 con 0x7fa3bc15c9b0 2023-11-28T12:08:28.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.657+0000 7fa3b9d9b700 1 -- 172.21.15.45:0/5586487 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3ac011990 con 0x7fa3bc15c9b0 2023-11-28T12:08:28.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.657+0000 7fa3b9d9b700 1 -- 172.21.15.45:0/5586487 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3ac011d20 con 0x7fa3bc15c9b0 2023-11-28T12:08:28.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.658+0000 7fa3c09ff700 1 -- 172.21.15.45:0/5586487 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3bc15c9b0 msgr2=0x7fa3bc0b4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:28.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.658+0000 7fa3c09ff700 1 --2- 172.21.15.45:0/5586487 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3bc15c9b0 0x7fa3bc0b4bf0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac009840 tx=0x7fa3ac009b50 comp rx=0 tx=0).stop 2023-11-28T12:08:28.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.658+0000 7fa3c09ff700 1 -- 172.21.15.45:0/5586487 shutdown_connections 2023-11-28T12:08:28.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.658+0000 7fa3c09ff700 1 --2- 172.21.15.45:0/5586487 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3bc15c9b0 0x7fa3bc0b4bf0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:28.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.658+0000 7fa3c09ff700 1 -- 172.21.15.45:0/5586487 >> 172.21.15.45:0/5586487 conn(0x7fa3bc072600 msgr2=0x7fa3bc0cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:28.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.658+0000 7fa3c09ff700 1 -- 172.21.15.45:0/5586487 shutdown_connections 2023-11-28T12:08:28.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.658+0000 7fa3c09ff700 1 -- 172.21.15.45:0/5586487 wait complete. 2023-11-28T12:08:28.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.659+0000 7fa3c09ff700 1 Processor -- start 2023-11-28T12:08:28.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.660+0000 7fa3c09ff700 1 -- start start 2023-11-28T12:08:28.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.661+0000 7fa3c09ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3bc0cd7c0 0x7fa3bc14a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:28.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.661+0000 7fa3c09ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3bc15c9b0 0x7fa3bc14ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:28.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.661+0000 7fa3c09ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa3bc161340 0x7fa3bc0ccd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:28.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.661+0000 7fa3c09ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3bc14ab30 con 0x7fa3bc15c9b0 2023-11-28T12:08:28.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.661+0000 7fa3c09ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3bc0c9070 con 0x7fa3bc0cd7c0 2023-11-28T12:08:28.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.661+0000 7fa3c09ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3bc0c8460 con 0x7fa3bc161340 2023-11-28T12:08:28.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.661+0000 7fa3b3fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3bc15c9b0 0x7fa3bc14ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:28.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.661+0000 7fa3b3fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3bc15c9b0 0x7fa3bc14ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54508/0 (socket says 172.21.15.45:54508) 2023-11-28T12:08:28.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.661+0000 7fa3b3fff700 1 -- 172.21.15.45:0/3861954543 learned_addr learned my addr 172.21.15.45:0/3861954543 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:28.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.661+0000 7fa3ba59c700 1 --2- 172.21.15.45:0/3861954543 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3bc0cd7c0 0x7fa3bc14a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:28.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.661+0000 7fa3bad9d700 1 --2- 172.21.15.45:0/3861954543 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa3bc161340 0x7fa3bc0ccd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:28.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.661+0000 7fa3b3fff700 1 -- 172.21.15.45:0/3861954543 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa3bc161340 msgr2=0x7fa3bc0ccd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:28.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.661+0000 7fa3b3fff700 1 --2- 172.21.15.45:0/3861954543 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa3bc161340 0x7fa3bc0ccd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:28.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.661+0000 7fa3b3fff700 1 -- 172.21.15.45:0/3861954543 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3bc0cd7c0 msgr2=0x7fa3bc14a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:28.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.661+0000 7fa3b3fff700 1 --2- 172.21.15.45:0/3861954543 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3bc0cd7c0 0x7fa3bc14a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:28.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.661+0000 7fa3b3fff700 1 -- 172.21.15.45:0/3861954543 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3ac0094a0 con 0x7fa3bc15c9b0 2023-11-28T12:08:28.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.661+0000 7fa3ba59c700 1 --2- 172.21.15.45:0/3861954543 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3bc0cd7c0 0x7fa3bc14a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:08:28.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.661+0000 7fa3bad9d700 1 --2- 172.21.15.45:0/3861954543 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa3bc161340 0x7fa3bc0ccd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:08:28.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.662+0000 7fa3b3fff700 1 --2- 172.21.15.45:0/3861954543 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3bc15c9b0 0x7fa3bc14ada0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fa3a400c510 tx=0x7fa3a400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:28.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.662+0000 7fa3b2ffd700 1 -- 172.21.15.45:0/3861954543 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a40052d0 con 0x7fa3bc15c9b0 2023-11-28T12:08:28.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.662+0000 7fa3b2ffd700 1 -- 172.21.15.45:0/3861954543 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3a4005430 con 0x7fa3bc15c9b0 2023-11-28T12:08:28.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.662+0000 7fa3b2ffd700 1 -- 172.21.15.45:0/3861954543 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a40038c0 con 0x7fa3bc15c9b0 2023-11-28T12:08:28.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.662+0000 7fa3c09ff700 1 -- 172.21.15.45:0/3861954543 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3bc0d15e0 con 0x7fa3bc15c9b0 2023-11-28T12:08:28.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.662+0000 7fa3c09ff700 1 -- 172.21.15.45:0/3861954543 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3bc0d1300 con 0x7fa3bc15c9b0 2023-11-28T12:08:28.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.663+0000 7fa3c09ff700 1 -- 172.21.15.45:0/3861954543 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3bc06b0d0 con 0x7fa3bc15c9b0 2023-11-28T12:08:28.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.664+0000 7fa3b2ffd700 1 -- 172.21.15.45:0/3861954543 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fa3a4019030 con 0x7fa3bc15c9b0 2023-11-28T12:08:28.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.665+0000 7fa3b2ffd700 1 --2- 172.21.15.45:0/3861954543 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fa39c0682f0 0x7fa39c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:28.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.665+0000 7fa3b2ffd700 1 -- 172.21.15.45:0/3861954543 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fa3a4084da0 con 0x7fa3bc15c9b0 2023-11-28T12:08:28.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.666+0000 7fa3ba59c700 1 --2- 172.21.15.45:0/3861954543 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fa39c0682f0 0x7fa39c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:28.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.666+0000 7fa3ba59c700 1 --2- 172.21.15.45:0/3861954543 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fa39c0682f0 0x7fa39c06a7a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac000c00 tx=0x7fa3ac008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:28.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.669+0000 7fa3b2ffd700 1 -- 172.21.15.45:0/3861954543 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fa3a4051860 con 0x7fa3bc15c9b0 2023-11-28T12:08:28.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.873+0000 7fa3c09ff700 1 -- 172.21.15.45:0/3861954543 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fa3bc0745c0 con 0x7fa3bc15c9b0 2023-11-28T12:08:28.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.873+0000 7fa3b2ffd700 1 -- 172.21.15.45:0/3861954543 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v43) v1 ==== 84+0+126 (secure 0 0 0) 0x7fa3a4054e80 con 0x7fa3bc15c9b0 2023-11-28T12:08:28.874 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:08:28.874 INFO:teuthology.orchestra.run.smithi045.stdout:[ 2023-11-28T12:08:28.874 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T12:08:28.874 INFO:teuthology.orchestra.run.smithi045.stdout: "poolnum": 1, 2023-11-28T12:08:28.874 INFO:teuthology.orchestra.run.smithi045.stdout: "poolname": "rbd" 2023-11-28T12:08:28.874 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T12:08:28.874 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T12:08:28.874 INFO:teuthology.orchestra.run.smithi045.stdout: "poolnum": 2, 2023-11-28T12:08:28.875 INFO:teuthology.orchestra.run.smithi045.stdout: "poolname": ".mgr" 2023-11-28T12:08:28.875 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T12:08:28.875 INFO:teuthology.orchestra.run.smithi045.stdout:] 2023-11-28T12:08:28.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.876+0000 7fa3c09ff700 1 -- 172.21.15.45:0/3861954543 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fa39c0682f0 msgr2=0x7fa39c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:28.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.876+0000 7fa3c09ff700 1 --2- 172.21.15.45:0/3861954543 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fa39c0682f0 0x7fa39c06a7a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac000c00 tx=0x7fa3ac008030 comp rx=0 tx=0).stop 2023-11-28T12:08:28.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.876+0000 7fa3c09ff700 1 -- 172.21.15.45:0/3861954543 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3bc15c9b0 msgr2=0x7fa3bc14ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:28.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.876+0000 7fa3c09ff700 1 --2- 172.21.15.45:0/3861954543 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3bc15c9b0 0x7fa3bc14ada0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fa3a400c510 tx=0x7fa3a400c8d0 comp rx=0 tx=0).stop 2023-11-28T12:08:28.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.876+0000 7fa3c09ff700 1 -- 172.21.15.45:0/3861954543 shutdown_connections 2023-11-28T12:08:28.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.876+0000 7fa3c09ff700 1 --2- 172.21.15.45:0/3861954543 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fa39c0682f0 0x7fa39c06a7a0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:28.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.876+0000 7fa3c09ff700 1 --2- 172.21.15.45:0/3861954543 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3bc0cd7c0 0x7fa3bc14a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:28.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.876+0000 7fa3c09ff700 1 --2- 172.21.15.45:0/3861954543 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa3bc161340 0x7fa3bc0ccd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:28.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.876+0000 7fa3c09ff700 1 --2- 172.21.15.45:0/3861954543 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3bc15c9b0 0x7fa3bc14ada0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:28.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.876+0000 7fa3c09ff700 1 -- 172.21.15.45:0/3861954543 >> 172.21.15.45:0/3861954543 conn(0x7fa3bc072600 msgr2=0x7fa3bc0b8600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:28.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.876+0000 7fa3c09ff700 1 -- 172.21.15.45:0/3861954543 shutdown_connections 2023-11-28T12:08:28.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:28.876+0000 7fa3c09ff700 1 -- 172.21.15.45:0/3861954543 wait complete. 2023-11-28T12:08:28.894 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-28T12:08:28.894 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-28T12:08:29.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:29.102+0000 7f72075ff700 1 Processor -- start 2023-11-28T12:08:29.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:29.102+0000 7f72075ff700 1 -- start start 2023-11-28T12:08:29.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:29.103+0000 7f72075ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f720015a760 0x7f7200161200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:29.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:29.103+0000 7f72075ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f720015dc30 0x7f72000b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:29.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:29.103+0000 7f72075ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f720015e0a0 con 0x7f72000cd7c0 2023-11-28T12:08:29.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:29.103+0000 7f72075ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f720015ab30 con 0x7f720015a760 2023-11-28T12:08:29.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:29.103+0000 7f72075ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7200160d70 con 0x7f720015dc30 2023-11-28T12:08:29.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:29.103+0000 7f720539b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f720015a760 0x7f7200161200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:29.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:29.103+0000 7f720539b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f720015a760 0x7f7200161200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54514/0 (socket says 172.21.15.45:54514) 2023-11-28T12:08:29.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:29.103+0000 7f720539b700 1 -- 172.21.15.45:0/695057431 learned_addr learned my addr 172.21.15.45:0/695057431 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:29.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:29.103+0000 7f7204b9a700 1 --2- 172.21.15.45:0/695057431 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f720015dc30 0x7f72000b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:29.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:29.104+0000 7f720539b700 1 -- 172.21.15.45:0/695057431 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f720015dc30 msgr2=0x7f72000b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:29.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:29.104+0000 7f720539b700 1 --2- 172.21.15.45:0/695057431 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f720015dc30 0x7f72000b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:29.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:29.104+0000 7f720539b700 1 -- 172.21.15.45:0/695057431 >> v1:172.21.15.152:6789/0 conn(0x7f72000cd7c0 legacy=0x7f72000d0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:29.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:29.104+0000 7f720539b700 1 -- 172.21.15.45:0/695057431 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72000b5130 con 0x7f720015a760 2023-11-28T12:08:29.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:29.104+0000 7f720539b700 1 --2- 172.21.15.45:0/695057431 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f720015a760 0x7f7200161200 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f71fc0098f0 tx=0x7f71fc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=760f96ac1a9e181 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:29.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:29.104+0000 7f71f7fff700 1 -- 172.21.15.45:0/695057431 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71fc00b8a0 con 0x7f720015a760 2023-11-28T12:08:29.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:29.104+0000 7f71f7fff700 1 -- 172.21.15.45:0/695057431 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71fc00ba00 con 0x7f720015a760 2023-11-28T12:08:29.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:29.104+0000 7f71f7fff700 1 -- 172.21.15.45:0/695057431 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71fc00bd90 con 0x7f720015a760 2023-11-28T12:08:29.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:29.105+0000 7f72075ff700 1 -- 172.21.15.45:0/695057431 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f720015a760 msgr2=0x7f7200161200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:29.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:29.105+0000 7f72075ff700 1 --2- 172.21.15.45:0/695057431 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f720015a760 0x7f7200161200 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f71fc0098f0 tx=0x7f71fc009c00 comp rx=0 tx=0).stop 2023-11-28T12:08:29.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:29.105+0000 7f72075ff700 1 -- 172.21.15.45:0/695057431 shutdown_connections 2023-11-28T12:08:29.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:29.105+0000 7f72075ff700 1 --2- 172.21.15.45:0/695057431 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f720015a760 0x7f7200161200 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:29.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:29.105+0000 7f72075ff700 1 --2- 172.21.15.45:0/695057431 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f720015dc30 0x7f72000b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:29.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:29.105+0000 7f72075ff700 1 -- 172.21.15.45:0/695057431 >> 172.21.15.45:0/695057431 conn(0x7f7200072620 msgr2=0x7f72000cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:29.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:29.105+0000 7f72075ff700 1 -- 172.21.15.45:0/695057431 shutdown_connections 2023-11-28T12:08:29.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:29.105+0000 7f72075ff700 1 -- 172.21.15.45:0/695057431 wait complete. 2023-11-28T12:08:29.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:29.107+0000 7f72075ff700 1 Processor -- start 2023-11-28T12:08:29.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:29.107+0000 7f72075ff700 1 -- start start 2023-11-28T12:08:29.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:29.108+0000 7f72075ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72000cd7c0 0x7f7200155610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:29.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:29.108+0000 7f72075ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f720015a760 0x7f7200155ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:29.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:29.108+0000 7f72075ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f720015dc30 0x7f72000c9250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:29.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:29.108+0000 7f72075ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72000c8dc0 con 0x7f72000cd7c0 2023-11-28T12:08:29.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:29.108+0000 7f72075ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72000c81b0 con 0x7f720015a760 2023-11-28T12:08:29.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:29.108+0000 7f72075ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72000c8490 con 0x7f720015dc30 2023-11-28T12:08:29.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:29.108+0000 7f720539b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72000cd7c0 0x7f7200155610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:29.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:29.108+0000 7f720539b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72000cd7c0 0x7f7200155610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54526/0 (socket says 172.21.15.45:54526) 2023-11-28T12:08:29.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:29.108+0000 7f720539b700 1 -- 172.21.15.45:0/2827764529 learned_addr learned my addr 172.21.15.45:0/2827764529 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:29.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:29.108+0000 7f7204b9a700 1 --2- 172.21.15.45:0/2827764529 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f720015a760 0x7f7200155ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:29.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:29.108+0000 7f7205b9c700 1 --2- 172.21.15.45:0/2827764529 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f720015dc30 0x7f72000c9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:29.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:29.108+0000 7f720539b700 1 -- 172.21.15.45:0/2827764529 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f720015dc30 msgr2=0x7f72000c9250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:29.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:29.108+0000 7f720539b700 1 --2- 172.21.15.45:0/2827764529 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f720015dc30 0x7f72000c9250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:29.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:29.108+0000 7f720539b700 1 -- 172.21.15.45:0/2827764529 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f720015a760 msgr2=0x7f7200155ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:29.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:29.108+0000 7f720539b700 1 --2- 172.21.15.45:0/2827764529 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f720015a760 0x7f7200155ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:29.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:29.108+0000 7f720539b700 1 -- 172.21.15.45:0/2827764529 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71fc009550 con 0x7f72000cd7c0 2023-11-28T12:08:29.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:29.109+0000 7f720539b700 1 --2- 172.21.15.45:0/2827764529 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72000cd7c0 0x7f7200155610 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f71fc000c00 tx=0x7f71fc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:29.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:29.109+0000 7f71f5ffb700 1 -- 172.21.15.45:0/2827764529 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71fc004380 con 0x7f72000cd7c0 2023-11-28T12:08:29.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:29.109+0000 7f71f5ffb700 1 -- 172.21.15.45:0/2827764529 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71fc01f070 con 0x7f72000cd7c0 2023-11-28T12:08:29.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:29.109+0000 7f72075ff700 1 -- 172.21.15.45:0/2827764529 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72000b5670 con 0x7f72000cd7c0 2023-11-28T12:08:29.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:29.109+0000 7f71f5ffb700 1 -- 172.21.15.45:0/2827764529 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71fc0036a0 con 0x7f72000cd7c0 2023-11-28T12:08:29.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:29.109+0000 7f72075ff700 1 -- 172.21.15.45:0/2827764529 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72000b5390 con 0x7f72000cd7c0 2023-11-28T12:08:29.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:29.110+0000 7f72075ff700 1 -- 172.21.15.45:0/2827764529 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7200160720 con 0x7f72000cd7c0 2023-11-28T12:08:29.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:29.111+0000 7f71f5ffb700 1 -- 172.21.15.45:0/2827764529 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f71fc02a020 con 0x7f72000cd7c0 2023-11-28T12:08:29.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:29.112+0000 7f71f5ffb700 1 --2- 172.21.15.45:0/2827764529 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f71e40682f0 0x7f71e406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:29.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:29.112+0000 7f71f5ffb700 1 -- 172.21.15.45:0/2827764529 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f71fc086f00 con 0x7f72000cd7c0 2023-11-28T12:08:29.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:29.113+0000 7f7204b9a700 1 --2- 172.21.15.45:0/2827764529 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f71e40682f0 0x7f71e406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:29.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:29.113+0000 7f7204b9a700 1 --2- 172.21.15.45:0/2827764529 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f71e40682f0 0x7f71e406a7a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7200159bd0 tx=0x7f71f0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:29.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:29.117+0000 7f71f5ffb700 1 -- 172.21.15.45:0/2827764529 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f71fc0539c0 con 0x7f72000cd7c0 2023-11-28T12:08:29.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:29.323+0000 7f72075ff700 1 -- 172.21.15.45:0/2827764529 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f72000c90a0 con 0x7f72000cd7c0 2023-11-28T12:08:29.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:29.862+0000 7f71f5ffb700 1 -- 172.21.15.45:0/2827764529 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v44) v1 ==== 138+0+0 (secure 0 0 0) 0x7f71fc056fe0 con 0x7f72000cd7c0 2023-11-28T12:08:29.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:29.867+0000 7f72075ff700 1 -- 172.21.15.45:0/2827764529 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f71e40682f0 msgr2=0x7f71e406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:29.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:29.867+0000 7f72075ff700 1 --2- 172.21.15.45:0/2827764529 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f71e40682f0 0x7f71e406a7a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7200159bd0 tx=0x7f71f0008040 comp rx=0 tx=0).stop 2023-11-28T12:08:29.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:29.867+0000 7f72075ff700 1 -- 172.21.15.45:0/2827764529 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72000cd7c0 msgr2=0x7f7200155610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:29.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:29.867+0000 7f72075ff700 1 --2- 172.21.15.45:0/2827764529 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72000cd7c0 0x7f7200155610 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f71fc000c00 tx=0x7f71fc004750 comp rx=0 tx=0).stop 2023-11-28T12:08:29.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:29.867+0000 7f72075ff700 1 -- 172.21.15.45:0/2827764529 shutdown_connections 2023-11-28T12:08:29.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:29.867+0000 7f72075ff700 1 --2- 172.21.15.45:0/2827764529 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f71e40682f0 0x7f71e406a7a0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:29.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:29.867+0000 7f72075ff700 1 --2- 172.21.15.45:0/2827764529 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f720015dc30 0x7f72000c9250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:29.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:29.867+0000 7f72075ff700 1 --2- 172.21.15.45:0/2827764529 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72000cd7c0 0x7f7200155610 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:29.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:29.867+0000 7f72075ff700 1 --2- 172.21.15.45:0/2827764529 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f720015a760 0x7f7200155ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:29.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:29.867+0000 7f72075ff700 1 -- 172.21.15.45:0/2827764529 >> 172.21.15.45:0/2827764529 conn(0x7f7200072620 msgr2=0x7f720015d400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:29.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:29.869+0000 7f72075ff700 1 -- 172.21.15.45:0/2827764529 shutdown_connections 2023-11-28T12:08:29.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:29.869+0000 7f72075ff700 1 -- 172.21.15.45:0/2827764529 wait complete. 2023-11-28T12:08:29.872 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' created 2023-11-28T12:08:29.892 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-28T12:08:30.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:30.105+0000 7f20be1ff700 1 Processor -- start 2023-11-28T12:08:30.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:30.105+0000 7f20be1ff700 1 -- start start 2023-11-28T12:08:30.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:30.106+0000 7f20be1ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f20b80b0d80 0x7f20b815add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:30.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:30.106+0000 7f20be1ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20b815e1a0 con 0x7f20b8070c50 2023-11-28T12:08:30.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:30.106+0000 7f20be1ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20b80cb180 con 0x7f20b8158200 2023-11-28T12:08:30.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:30.106+0000 7f20be1ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20b815f070 con 0x7f20b80b0d80 2023-11-28T12:08:30.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:30.106+0000 7f20b6ffd700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f20b8070c50 0x7f20b80b0670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:52670/0 (socket says 172.21.15.45:52670) 2023-11-28T12:08:30.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:30.106+0000 7f20b6ffd700 1 -- 172.21.15.45:0/691863455 learned_addr learned my addr 172.21.15.45:0/691863455 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:08:30.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:30.106+0000 7f20b7fff700 1 --2- 172.21.15.45:0/691863455 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f20b80b0d80 0x7f20b815add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:30.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:30.107+0000 7f20b67fc700 1 -- 172.21.15.45:0/691863455 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2397600703 0 0) 0x7f20b815e1a0 con 0x7f20b8070c50 2023-11-28T12:08:30.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:30.107+0000 7f20b67fc700 1 -- 172.21.15.45:0/691863455 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20a00035b0 con 0x7f20b8070c50 2023-11-28T12:08:30.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:30.107+0000 7f20b67fc700 1 -- 172.21.15.45:0/691863455 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1271341547 0 0) 0x7f20b80cb180 con 0x7f20b8158200 2023-11-28T12:08:30.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:30.107+0000 7f20b67fc700 1 -- 172.21.15.45:0/691863455 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20b815e1a0 con 0x7f20b8158200 2023-11-28T12:08:30.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:30.107+0000 7f20b7fff700 1 -- 172.21.15.45:0/691863455 >> v1:172.21.15.152:6789/0 conn(0x7f20b8158200 legacy=0x7f20b80caa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:30.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:30.107+0000 7f20b7fff700 1 -- 172.21.15.45:0/691863455 >> v1:172.21.15.45:6789/0 conn(0x7f20b8070c50 legacy=0x7f20b80b0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:30.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:30.107+0000 7f20b7fff700 1 -- 172.21.15.45:0/691863455 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20b80710f0 con 0x7f20b80b0d80 2023-11-28T12:08:30.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:30.107+0000 7f20b7fff700 1 --2- 172.21.15.45:0/691863455 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f20b80b0d80 0x7f20b815add0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f20b0009dc0 tx=0x7f20b000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa8c7bf4b00cae4e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:30.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:30.108+0000 7f20b67fc700 1 -- 172.21.15.45:0/691863455 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b000e070 con 0x7f20b80b0d80 2023-11-28T12:08:30.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:30.108+0000 7f20b67fc700 1 -- 172.21.15.45:0/691863455 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20b000bb20 con 0x7f20b80b0d80 2023-11-28T12:08:30.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:30.108+0000 7f20b67fc700 1 -- 172.21.15.45:0/691863455 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b0012430 con 0x7f20b80b0d80 2023-11-28T12:08:30.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:30.108+0000 7f20be1ff700 1 -- 172.21.15.45:0/691863455 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f20b80b0d80 msgr2=0x7f20b815add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:30.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:30.108+0000 7f20be1ff700 1 --2- 172.21.15.45:0/691863455 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f20b80b0d80 0x7f20b815add0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f20b0009dc0 tx=0x7f20b000b330 comp rx=0 tx=0).stop 2023-11-28T12:08:30.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:30.108+0000 7f20be1ff700 1 -- 172.21.15.45:0/691863455 shutdown_connections 2023-11-28T12:08:30.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:30.108+0000 7f20be1ff700 1 --2- 172.21.15.45:0/691863455 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f20b80b0d80 0x7f20b815add0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:30.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:30.108+0000 7f20be1ff700 1 -- 172.21.15.45:0/691863455 >> 172.21.15.45:0/691863455 conn(0x7f20b80cb670 msgr2=0x7f20b80cba70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:30.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:30.108+0000 7f20be1ff700 1 -- 172.21.15.45:0/691863455 shutdown_connections 2023-11-28T12:08:30.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:30.108+0000 7f20be1ff700 1 -- 172.21.15.45:0/691863455 wait complete. 2023-11-28T12:08:30.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:30.111+0000 7f20be1ff700 1 Processor -- start 2023-11-28T12:08:30.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:30.111+0000 7f20be1ff700 1 -- start start 2023-11-28T12:08:30.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:30.112+0000 7f20be1ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f20b8070c50 0x7f20b80c4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:30.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:30.112+0000 7f20be1ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f20b80b0d80 0x7f20b80c7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:30.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:30.112+0000 7f20be1ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f20b8158200 0x7f20b80c8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:30.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:30.112+0000 7f20be1ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20b80c78d0 con 0x7f20b80b0d80 2023-11-28T12:08:30.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:30.112+0000 7f20be1ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20b80af8c0 con 0x7f20b8158200 2023-11-28T12:08:30.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:30.112+0000 7f20be1ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20b80af5e0 con 0x7f20b8070c50 2023-11-28T12:08:30.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:30.112+0000 7f20b6ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f20b80b0d80 0x7f20b80c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:30.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:30.113+0000 7f20b6ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f20b80b0d80 0x7f20b80c7cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54540/0 (socket says 172.21.15.45:54540) 2023-11-28T12:08:30.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:30.113+0000 7f20b6ffd700 1 -- 172.21.15.45:0/2736303593 learned_addr learned my addr 172.21.15.45:0/2736303593 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:30.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:30.113+0000 7f20b77fe700 1 --2- 172.21.15.45:0/2736303593 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f20b8070c50 0x7f20b80c4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:30.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:30.113+0000 7f20b7fff700 1 --2- 172.21.15.45:0/2736303593 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f20b8158200 0x7f20b80c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:30.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:30.113+0000 7f20b6ffd700 1 -- 172.21.15.45:0/2736303593 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f20b8070c50 msgr2=0x7f20b80c4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:30.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:30.113+0000 7f20b6ffd700 1 --2- 172.21.15.45:0/2736303593 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f20b8070c50 0x7f20b80c4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:30.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:30.113+0000 7f20b6ffd700 1 -- 172.21.15.45:0/2736303593 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f20b8158200 msgr2=0x7f20b80c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:30.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:30.113+0000 7f20b6ffd700 1 --2- 172.21.15.45:0/2736303593 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f20b8158200 0x7f20b80c8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:30.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:30.113+0000 7f20b6ffd700 1 -- 172.21.15.45:0/2736303593 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20b0009a70 con 0x7f20b80b0d80 2023-11-28T12:08:30.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:30.113+0000 7f20b6ffd700 1 --2- 172.21.15.45:0/2736303593 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f20b80b0d80 0x7f20b80c7cf0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f20ac001eb0 tx=0x7f20ac00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:30.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:30.113+0000 7f209ffff700 1 -- 172.21.15.45:0/2736303593 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20ac005d70 con 0x7f20b80b0d80 2023-11-28T12:08:30.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:30.113+0000 7f209ffff700 1 -- 172.21.15.45:0/2736303593 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20ac0070d0 con 0x7f20b80b0d80 2023-11-28T12:08:30.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:30.113+0000 7f209ffff700 1 -- 172.21.15.45:0/2736303593 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20ac007460 con 0x7f20b80b0d80 2023-11-28T12:08:30.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:30.113+0000 7f20be1ff700 1 -- 172.21.15.45:0/2736303593 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20b815e3f0 con 0x7f20b80b0d80 2023-11-28T12:08:30.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:30.114+0000 7f20be1ff700 1 -- 172.21.15.45:0/2736303593 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20b81585d0 con 0x7f20b80b0d80 2023-11-28T12:08:30.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:30.115+0000 7f20be1ff700 1 -- 172.21.15.45:0/2736303593 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20b815e6d0 con 0x7f20b80b0d80 2023-11-28T12:08:30.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:30.117+0000 7f209ffff700 1 -- 172.21.15.45:0/2736303593 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f20ac019030 con 0x7f20b80b0d80 2023-11-28T12:08:30.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:30.118+0000 7f209ffff700 1 --2- 172.21.15.45:0/2736303593 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f20a40682f0 0x7f20a406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:30.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:30.118+0000 7f209ffff700 1 -- 172.21.15.45:0/2736303593 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f20ac085350 con 0x7f20b80b0d80 2023-11-28T12:08:30.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:30.118+0000 7f20b77fe700 1 --2- 172.21.15.45:0/2736303593 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f20a40682f0 0x7f20a406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:30.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:30.119+0000 7f20b77fe700 1 --2- 172.21.15.45:0/2736303593 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f20a40682f0 0x7f20a406a7a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f20a80011e0 tx=0x7f20a8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:30.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:30.121+0000 7f209ffff700 1 -- 172.21.15.45:0/2736303593 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f20ac051d20 con 0x7f20b80b0d80 2023-11-28T12:08:30.247 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T12:08:30.253 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T12:08:30.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:30.333+0000 7f20be1ff700 1 -- 172.21.15.45:0/2736303593 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f20b806fd60 con 0x7f20b80b0d80 2023-11-28T12:08:30.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:30.870+0000 7f209ffff700 1 -- 172.21.15.45:0/2736303593 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v45) v1 ==== 170+0+0 (secure 0 0 0) 0x7f20ac055340 con 0x7f20b80b0d80 2023-11-28T12:08:30.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:30.883+0000 7f20be1ff700 1 -- 172.21.15.45:0/2736303593 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f20a40682f0 msgr2=0x7f20a406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:30.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:30.883+0000 7f20be1ff700 1 --2- 172.21.15.45:0/2736303593 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f20a40682f0 0x7f20a406a7a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f20a80011e0 tx=0x7f20a8009040 comp rx=0 tx=0).stop 2023-11-28T12:08:30.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:30.883+0000 7f20be1ff700 1 -- 172.21.15.45:0/2736303593 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f20b80b0d80 msgr2=0x7f20b80c7cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:30.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:30.883+0000 7f20be1ff700 1 --2- 172.21.15.45:0/2736303593 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f20b80b0d80 0x7f20b80c7cf0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f20ac001eb0 tx=0x7f20ac00c860 comp rx=0 tx=0).stop 2023-11-28T12:08:30.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:30.884+0000 7f20be1ff700 1 -- 172.21.15.45:0/2736303593 shutdown_connections 2023-11-28T12:08:30.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:30.884+0000 7f20be1ff700 1 --2- 172.21.15.45:0/2736303593 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f20a40682f0 0x7f20a406a7a0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:30.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:30.884+0000 7f20be1ff700 1 --2- 172.21.15.45:0/2736303593 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f20b8158200 0x7f20b80c8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:30.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:30.884+0000 7f20be1ff700 1 --2- 172.21.15.45:0/2736303593 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f20b8070c50 0x7f20b80c4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:30.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:30.884+0000 7f20be1ff700 1 --2- 172.21.15.45:0/2736303593 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f20b80b0d80 0x7f20b80c7cf0 secure :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f20ac001eb0 tx=0x7f20ac00c860 comp rx=0 tx=0).stop 2023-11-28T12:08:30.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:30.884+0000 7f20be1ff700 1 -- 172.21.15.45:0/2736303593 >> 172.21.15.45:0/2736303593 conn(0x7f20b80cb670 msgr2=0x7f20b80ca730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:30.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:30.885+0000 7f20be1ff700 1 -- 172.21.15.45:0/2736303593 shutdown_connections 2023-11-28T12:08:30.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:30.885+0000 7f20be1ff700 1 -- 172.21.15.45:0/2736303593 wait complete. 2023-11-28T12:08:30.888 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' created 2023-11-28T12:08:30.918 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-28T12:08:31.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.128+0000 7f266e1ff700 1 Processor -- start 2023-11-28T12:08:31.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.128+0000 7f266e1ff700 1 -- start start 2023-11-28T12:08:31.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.129+0000 7f266e1ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f266815c9b0 0x7f26680b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:31.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.129+0000 7f266e1ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2668161340 0x7f26680d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:31.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.129+0000 7f266e1ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26680d1950 con 0x7f26680d2320 2023-11-28T12:08:31.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.129+0000 7f266e1ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26680b5800 con 0x7f2668161340 2023-11-28T12:08:31.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.129+0000 7f266e1ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26680b5520 con 0x7f266815c9b0 2023-11-28T12:08:31.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.129+0000 7f2666ffd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2668161340 0x7f26680d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:31.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.130+0000 7f2667fff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f26680d2320 0x7f26680cd7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:52682/0 (socket says 172.21.15.45:52682) 2023-11-28T12:08:31.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.130+0000 7f2667fff700 1 -- 172.21.15.45:0/1050942326 learned_addr learned my addr 172.21.15.45:0/1050942326 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:08:31.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.130+0000 7f26677fe700 1 --2- 172.21.15.45:0/1050942326 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f266815c9b0 0x7f26680b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:31.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.130+0000 7f2666ffd700 1 -- 172.21.15.45:0/1050942326 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f266815c9b0 msgr2=0x7f26680b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:31.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.130+0000 7f2666ffd700 1 --2- 172.21.15.45:0/1050942326 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f266815c9b0 0x7f26680b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:31.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.130+0000 7f2666ffd700 1 -- 172.21.15.45:0/1050942326 >> v1:172.21.15.45:6789/0 conn(0x7f26680d2320 legacy=0x7f26680cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:31.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.130+0000 7f2666ffd700 1 -- 172.21.15.45:0/1050942326 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26680d1300 con 0x7f2668161340 2023-11-28T12:08:31.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.130+0000 7f26667fc700 1 -- 172.21.15.45:0/1050942326 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3676233368 0 0) 0x7f26680d1950 con 0x7f26680d2320 2023-11-28T12:08:31.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.130+0000 7f2666ffd700 1 --2- 172.21.15.45:0/1050942326 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2668161340 0x7f26680d1de0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f265c009840 tx=0x7f265c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d23f7ac3c22f30cf server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:31.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.131+0000 7f26667fc700 1 -- 172.21.15.45:0/1050942326 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f265c011830 con 0x7f2668161340 2023-11-28T12:08:31.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.131+0000 7f26667fc700 1 -- 172.21.15.45:0/1050942326 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f265c011990 con 0x7f2668161340 2023-11-28T12:08:31.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.131+0000 7f26667fc700 1 -- 172.21.15.45:0/1050942326 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f265c011d20 con 0x7f2668161340 2023-11-28T12:08:31.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.131+0000 7f266e1ff700 1 -- 172.21.15.45:0/1050942326 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2668161340 msgr2=0x7f26680d1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:31.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.131+0000 7f266e1ff700 1 --2- 172.21.15.45:0/1050942326 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2668161340 0x7f26680d1de0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f265c009840 tx=0x7f265c009b50 comp rx=0 tx=0).stop 2023-11-28T12:08:31.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.131+0000 7f266e1ff700 1 -- 172.21.15.45:0/1050942326 shutdown_connections 2023-11-28T12:08:31.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.131+0000 7f266e1ff700 1 --2- 172.21.15.45:0/1050942326 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f266815c9b0 0x7f26680b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:31.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.131+0000 7f266e1ff700 1 --2- 172.21.15.45:0/1050942326 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2668161340 0x7f26680d1de0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:31.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.131+0000 7f266e1ff700 1 -- 172.21.15.45:0/1050942326 >> 172.21.15.45:0/1050942326 conn(0x7f2668072600 msgr2=0x7f26680cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:31.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.131+0000 7f266e1ff700 1 -- 172.21.15.45:0/1050942326 shutdown_connections 2023-11-28T12:08:31.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.131+0000 7f266e1ff700 1 -- 172.21.15.45:0/1050942326 wait complete. 2023-11-28T12:08:31.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.133+0000 7f266e1ff700 1 Processor -- start 2023-11-28T12:08:31.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.133+0000 7f266e1ff700 1 -- start start 2023-11-28T12:08:31.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.134+0000 7f266e1ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26680d2320 0x7f2668150900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:31.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.134+0000 7f266e1ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f266815c9b0 0x7f26681e6e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:31.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.134+0000 7f266e1ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2668161340 0x7f26681f22a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:31.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.134+0000 7f266e1ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26681f3310 con 0x7f26680d2320 2023-11-28T12:08:31.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.134+0000 7f266e1ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2668150e40 con 0x7f266815c9b0 2023-11-28T12:08:31.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.134+0000 7f266e1ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26681f2d50 con 0x7f2668161340 2023-11-28T12:08:31.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.134+0000 7f26677fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26680d2320 0x7f2668150900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:31.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.134+0000 7f26677fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26680d2320 0x7f2668150900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54562/0 (socket says 172.21.15.45:54562) 2023-11-28T12:08:31.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.134+0000 7f26677fe700 1 -- 172.21.15.45:0/3342322914 learned_addr learned my addr 172.21.15.45:0/3342322914 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:31.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.135+0000 7f2667fff700 1 --2- 172.21.15.45:0/3342322914 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2668161340 0x7f26681f22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:31.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.135+0000 7f2666ffd700 1 --2- 172.21.15.45:0/3342322914 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f266815c9b0 0x7f26681e6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:31.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.135+0000 7f26677fe700 1 -- 172.21.15.45:0/3342322914 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2668161340 msgr2=0x7f26681f22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:31.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.135+0000 7f26677fe700 1 --2- 172.21.15.45:0/3342322914 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2668161340 0x7f26681f22a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:31.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.135+0000 7f26677fe700 1 -- 172.21.15.45:0/3342322914 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f266815c9b0 msgr2=0x7f26681e6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:31.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.135+0000 7f26677fe700 1 --2- 172.21.15.45:0/3342322914 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f266815c9b0 0x7f26681e6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:31.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.135+0000 7f26677fe700 1 -- 172.21.15.45:0/3342322914 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f265c0094a0 con 0x7f26680d2320 2023-11-28T12:08:31.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.135+0000 7f2666ffd700 1 --2- 172.21.15.45:0/3342322914 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f266815c9b0 0x7f26681e6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:08:31.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.135+0000 7f2667fff700 1 --2- 172.21.15.45:0/3342322914 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2668161340 0x7f26681f22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:08:31.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.135+0000 7f26677fe700 1 --2- 172.21.15.45:0/3342322914 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26680d2320 0x7f2668150900 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f265800e870 tx=0x7f265800ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:31.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.135+0000 7f264ffff700 1 -- 172.21.15.45:0/3342322914 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2658009590 con 0x7f26680d2320 2023-11-28T12:08:31.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.136+0000 7f264ffff700 1 -- 172.21.15.45:0/3342322914 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f265800ee70 con 0x7f26680d2320 2023-11-28T12:08:31.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.136+0000 7f266e1ff700 1 -- 172.21.15.45:0/3342322914 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26680b5130 con 0x7f26680d2320 2023-11-28T12:08:31.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.136+0000 7f264ffff700 1 -- 172.21.15.45:0/3342322914 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f265800ca50 con 0x7f26680d2320 2023-11-28T12:08:31.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.136+0000 7f266e1ff700 1 -- 172.21.15.45:0/3342322914 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26680d15e0 con 0x7f26680d2320 2023-11-28T12:08:31.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.137+0000 7f266e1ff700 1 -- 172.21.15.45:0/3342322914 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26680b52c0 con 0x7f26680d2320 2023-11-28T12:08:31.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.138+0000 7f264ffff700 1 -- 172.21.15.45:0/3342322914 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f2658019030 con 0x7f26680d2320 2023-11-28T12:08:31.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.138+0000 7f264ffff700 1 --2- 172.21.15.45:0/3342322914 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f26540682f0 0x7f265406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:31.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.139+0000 7f264ffff700 1 -- 172.21.15.45:0/3342322914 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f2658085c00 con 0x7f26680d2320 2023-11-28T12:08:31.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.139+0000 7f2666ffd700 1 --2- 172.21.15.45:0/3342322914 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f26540682f0 0x7f265406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:31.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.140+0000 7f2666ffd700 1 --2- 172.21.15.45:0/3342322914 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f26540682f0 0x7f265406a7a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f2668160220 tx=0x7f265c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:31.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.143+0000 7f264ffff700 1 -- 172.21.15.45:0/3342322914 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f26580523d0 con 0x7f26680d2320 2023-11-28T12:08:31.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.390+0000 7f266e1ff700 1 -- 172.21.15.45:0/3342322914 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f26681e6c50 con 0x7f26680d2320 2023-11-28T12:08:31.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.396+0000 7f264ffff700 1 -- 172.21.15.45:0/3342322914 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 7 and data pool 8 v20) v1 ==== 172+0+0 (secure 0 0 0) 0x7f26580170c0 con 0x7f26680d2320 2023-11-28T12:08:31.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.402+0000 7f266e1ff700 1 -- 172.21.15.45:0/3342322914 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f26540682f0 msgr2=0x7f265406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:31.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.402+0000 7f266e1ff700 1 --2- 172.21.15.45:0/3342322914 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f26540682f0 0x7f265406a7a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f2668160220 tx=0x7f265c008030 comp rx=0 tx=0).stop 2023-11-28T12:08:31.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.402+0000 7f266e1ff700 1 -- 172.21.15.45:0/3342322914 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26680d2320 msgr2=0x7f2668150900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:31.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.402+0000 7f266e1ff700 1 --2- 172.21.15.45:0/3342322914 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26680d2320 0x7f2668150900 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f265800e870 tx=0x7f265800ec30 comp rx=0 tx=0).stop 2023-11-28T12:08:31.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.407+0000 7f266e1ff700 1 -- 172.21.15.45:0/3342322914 shutdown_connections 2023-11-28T12:08:31.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.407+0000 7f266e1ff700 1 --2- 172.21.15.45:0/3342322914 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f26540682f0 0x7f265406a7a0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:31.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.407+0000 7f266e1ff700 1 --2- 172.21.15.45:0/3342322914 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2668161340 0x7f26681f22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:31.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.408+0000 7f266e1ff700 1 --2- 172.21.15.45:0/3342322914 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26680d2320 0x7f2668150900 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:31.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.408+0000 7f266e1ff700 1 --2- 172.21.15.45:0/3342322914 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f266815c9b0 0x7f26681e6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:31.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.408+0000 7f266e1ff700 1 -- 172.21.15.45:0/3342322914 >> 172.21.15.45:0/3342322914 conn(0x7f2668072600 msgr2=0x7f266815cd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:31.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.408+0000 7f266e1ff700 1 -- 172.21.15.45:0/3342322914 shutdown_connections 2023-11-28T12:08:31.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.409+0000 7f266e1ff700 1 -- 172.21.15.45:0/3342322914 wait complete. 2023-11-28T12:08:31.415 INFO:teuthology.orchestra.run.smithi045.stderr:new fs with metadata pool 7 and data pool 8 2023-11-28T12:08:31.447 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T12:08:31.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.650+0000 7f4dbcbff700 1 Processor -- start 2023-11-28T12:08:31.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.650+0000 7f4dbcbff700 1 -- start start 2023-11-28T12:08:31.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.651+0000 7f4dbcbff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4db8161340 0x7f4db80d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:31.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.651+0000 7f4dbcbff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4db80d2320 0x7f4db80cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:31.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.651+0000 7f4dbcbff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4db80d1950 con 0x7f4db815c9b0 2023-11-28T12:08:31.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.651+0000 7f4dbcbff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4db80b5800 con 0x7f4db80d2320 2023-11-28T12:08:31.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.651+0000 7f4dbcbff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4db80b5300 con 0x7f4db8161340 2023-11-28T12:08:31.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.652+0000 7f4db6d9d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4db80d2320 0x7f4db80cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:31.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.652+0000 7f4db6d9d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4db80d2320 0x7f4db80cd7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54566/0 (socket says 172.21.15.45:54566) 2023-11-28T12:08:31.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.652+0000 7f4db6d9d700 1 -- 172.21.15.45:0/509476631 learned_addr learned my addr 172.21.15.45:0/509476631 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:31.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.652+0000 7f4db5d9b700 1 --2- 172.21.15.45:0/509476631 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4db8161340 0x7f4db80d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:31.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.652+0000 7f4db6d9d700 1 -- 172.21.15.45:0/509476631 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4db8161340 msgr2=0x7f4db80d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:31.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.652+0000 7f4db6d9d700 1 --2- 172.21.15.45:0/509476631 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4db8161340 0x7f4db80d1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:31.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.652+0000 7f4db6d9d700 1 -- 172.21.15.45:0/509476631 >> v1:172.21.15.152:6789/0 conn(0x7f4db815c9b0 legacy=0x7f4db80b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:31.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.652+0000 7f4db6d9d700 1 -- 172.21.15.45:0/509476631 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4db80b5520 con 0x7f4db80d2320 2023-11-28T12:08:31.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.652+0000 7f4db6d9d700 1 --2- 172.21.15.45:0/509476631 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4db80d2320 0x7f4db80cd7c0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f4db0009e80 tx=0x7f4db000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6fc7bed5869c82a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:31.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.653+0000 7f4db559a700 1 -- 172.21.15.45:0/509476631 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db000e070 con 0x7f4db80d2320 2023-11-28T12:08:31.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.653+0000 7f4db559a700 1 -- 172.21.15.45:0/509476631 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db000b8d0 con 0x7f4db80d2320 2023-11-28T12:08:31.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.653+0000 7f4db559a700 1 -- 172.21.15.45:0/509476631 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db000bc80 con 0x7f4db80d2320 2023-11-28T12:08:31.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.653+0000 7f4dbcbff700 1 -- 172.21.15.45:0/509476631 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4db80d2320 msgr2=0x7f4db80cd7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:31.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.653+0000 7f4dbcbff700 1 --2- 172.21.15.45:0/509476631 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4db80d2320 0x7f4db80cd7c0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f4db0009e80 tx=0x7f4db000b330 comp rx=0 tx=0).stop 2023-11-28T12:08:31.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.653+0000 7f4dbcbff700 1 -- 172.21.15.45:0/509476631 shutdown_connections 2023-11-28T12:08:31.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.653+0000 7f4dbcbff700 1 --2- 172.21.15.45:0/509476631 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4db80d2320 0x7f4db80cd7c0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:31.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.653+0000 7f4dbcbff700 1 --2- 172.21.15.45:0/509476631 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4db8161340 0x7f4db80d1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:31.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.653+0000 7f4dbcbff700 1 -- 172.21.15.45:0/509476631 >> 172.21.15.45:0/509476631 conn(0x7f4db8072600 msgr2=0x7f4db80cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:31.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.653+0000 7f4dbcbff700 1 -- 172.21.15.45:0/509476631 shutdown_connections 2023-11-28T12:08:31.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.653+0000 7f4dbcbff700 1 -- 172.21.15.45:0/509476631 wait complete. 2023-11-28T12:08:31.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.655+0000 7f4dbcbff700 1 Processor -- start 2023-11-28T12:08:31.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.655+0000 7f4dbcbff700 1 -- start start 2023-11-28T12:08:31.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.656+0000 7f4dbcbff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4db80d2320 0x7f4db81e8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:31.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.656+0000 7f4dbcbff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4db815c9b0 0x7f4db81e65e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:31.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.656+0000 7f4dbcbff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4db8161340 0x7f4db80c5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:31.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.656+0000 7f4dbcbff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4db80c8110 con 0x7f4db80d2320 2023-11-28T12:08:31.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.656+0000 7f4dbcbff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4db80c7490 con 0x7f4db8161340 2023-11-28T12:08:31.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.656+0000 7f4dbcbff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4db80c7770 con 0x7f4db815c9b0 2023-11-28T12:08:31.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.656+0000 7f4db659c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4db80d2320 0x7f4db81e8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:31.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.656+0000 7f4db659c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4db80d2320 0x7f4db81e8530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54570/0 (socket says 172.21.15.45:54570) 2023-11-28T12:08:31.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.656+0000 7f4db659c700 1 -- 172.21.15.45:0/2923888825 learned_addr learned my addr 172.21.15.45:0/2923888825 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:31.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.656+0000 7f4db5d9b700 1 --2- 172.21.15.45:0/2923888825 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4db815c9b0 0x7f4db81e65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:31.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.656+0000 7f4db6d9d700 1 --2- 172.21.15.45:0/2923888825 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4db8161340 0x7f4db80c5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:31.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.657+0000 7f4db659c700 1 -- 172.21.15.45:0/2923888825 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4db815c9b0 msgr2=0x7f4db81e65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:31.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.657+0000 7f4db659c700 1 --2- 172.21.15.45:0/2923888825 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4db815c9b0 0x7f4db81e65e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:31.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.657+0000 7f4db659c700 1 -- 172.21.15.45:0/2923888825 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4db8161340 msgr2=0x7f4db80c5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:31.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.657+0000 7f4db659c700 1 --2- 172.21.15.45:0/2923888825 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4db8161340 0x7f4db80c5e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:31.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.657+0000 7f4db659c700 1 -- 172.21.15.45:0/2923888825 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4db0009b30 con 0x7f4db80d2320 2023-11-28T12:08:31.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.657+0000 7f4db659c700 1 --2- 172.21.15.45:0/2923888825 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4db80d2320 0x7f4db81e8530 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f4da800c450 tx=0x7f4da800c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:31.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.657+0000 7f4da6ffd700 1 -- 172.21.15.45:0/2923888825 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da80052d0 con 0x7f4db80d2320 2023-11-28T12:08:31.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.657+0000 7f4da6ffd700 1 -- 172.21.15.45:0/2923888825 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4da8005430 con 0x7f4db80d2320 2023-11-28T12:08:31.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.657+0000 7f4dbcbff700 1 -- 172.21.15.45:0/2923888825 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4db80d15e0 con 0x7f4db80d2320 2023-11-28T12:08:31.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.657+0000 7f4da6ffd700 1 -- 172.21.15.45:0/2923888825 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da80038c0 con 0x7f4db80d2320 2023-11-28T12:08:31.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.658+0000 7f4dbcbff700 1 -- 172.21.15.45:0/2923888825 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4db80d1300 con 0x7f4db80d2320 2023-11-28T12:08:31.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.658+0000 7f4dbcbff700 1 -- 172.21.15.45:0/2923888825 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4db815cd80 con 0x7f4db80d2320 2023-11-28T12:08:31.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.659+0000 7f4da6ffd700 1 -- 172.21.15.45:0/2923888825 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f4da8019030 con 0x7f4db80d2320 2023-11-28T12:08:31.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.660+0000 7f4da6ffd700 1 --2- 172.21.15.45:0/2923888825 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f4d980682f0 0x7f4d9806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:31.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.660+0000 7f4da6ffd700 1 -- 172.21.15.45:0/2923888825 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4da8084e30 con 0x7f4db80d2320 2023-11-28T12:08:31.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.661+0000 7f4db5d9b700 1 --2- 172.21.15.45:0/2923888825 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f4d980682f0 0x7f4d9806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:31.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.661+0000 7f4db5d9b700 1 --2- 172.21.15.45:0/2923888825 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f4d980682f0 0x7f4d9806a7a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4db80b4b80 tx=0x7f4dac009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:31.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.664+0000 7f4da6ffd700 1 -- 172.21.15.45:0/2923888825 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f4da8051690 con 0x7f4db80d2320 2023-11-28T12:08:31.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.869+0000 7f4dbcbff700 1 -- 172.21.15.45:0/2923888825 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4db80c8250 con 0x7f4db80d2320 2023-11-28T12:08:31.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.872+0000 7f4da6ffd700 1 -- 172.21.15.45:0/2923888825 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+17934 (secure 0 0 0) 0x7f4db80c8250 con 0x7f4db80d2320 2023-11-28T12:08:31.873 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:08:31.873 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":46,"fsid":"bd7c37f1-f7c6-4778-b845-52cf2aa6e366","created":"2023-11-28T12:06:09.045075+0000","modified":"2023-11-28T12:08:31.391444+0000","last_up_change":"2023-11-28T12:06:21.282227+0000","last_in_change":"2023-11-28T12:06:12.560924+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T12:06:21.807108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T12:06:22.491009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-11-28T12:08:29.364957+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-11-28T12:08:30.374968+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d0cdd8a-87fd-4f2c-91bd-47bdfa661905","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":115843},{"type":"v1","addr":"172.21.15.45:6808","nonce":115843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":115843},{"type":"v1","addr":"172.21.15.45:6811","nonce":115843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":115843},{"type":"v1","addr":"172.21.15.45:6815","nonce":115843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":115843},{"type":"v1","addr":"172.21.15.45:6813","nonce":115843}]},"public_addr":"172.21.15.45:6808/115843","cluster_addr":"172.21.15.45:6811/115843","heartbeat_back_addr":"172.21.15.45:6815/115843","heartbeat_front_addr":"172.21.15.45:6813/115843","state":["exists","up"]},{"osd":1,"uuid":"c5de4ebd-9ec5-40b3-9caa-9b706fab4c76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":115842},{"type":"v1","addr":"172.21.15.45:6801","nonce":115842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":115842},{"type":"v1","addr":"172.21.15.45:6803","nonce":115842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6807","nonce":115842},{"type":"v1","addr":"172.21.15.45:6809","nonce":115842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":115842},{"type":"v1","addr":"172.21.15.45:6805","nonce":115842}]},"public_addr":"172.21.15.45:6801/115842","cluster_addr":"172.21.15.45:6803/115842","heartbeat_back_addr":"172.21.15.45:6809/115842","heartbeat_front_addr":"172.21.15.45:6805/115842","state":["exists","up"]},{"osd":2,"uuid":"9f4b36b2-65d2-40e7-9fe6-a2991afa71c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":115850},{"type":"v1","addr":"172.21.15.45:6819","nonce":115850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":115850},{"type":"v1","addr":"172.21.15.45:6823","nonce":115850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":115850},{"type":"v1","addr":"172.21.15.45:6831","nonce":115850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":115850},{"type":"v1","addr":"172.21.15.45:6828","nonce":115850}]},"public_addr":"172.21.15.45:6819/115850","cluster_addr":"172.21.15.45:6823/115850","heartbeat_back_addr":"172.21.15.45:6831/115850","heartbeat_front_addr":"172.21.15.45:6828/115850","state":["exists","up"]},{"osd":3,"uuid":"6fe7ef05-4e0d-426c-bf94-44b51d4d550b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":115848},{"type":"v1","addr":"172.21.15.45:6818","nonce":115848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":115848},{"type":"v1","addr":"172.21.15.45:6822","nonce":115848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6827","nonce":115848},{"type":"v1","addr":"172.21.15.45:6829","nonce":115848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":115848},{"type":"v1","addr":"172.21.15.45:6825","nonce":115848}]},"public_addr":"172.21.15.45:6818/115848","cluster_addr":"172.21.15.45:6822/115848","heartbeat_back_addr":"172.21.15.45:6829/115848","heartbeat_front_addr":"172.21.15.45:6825/115848","state":["exists","up"]},{"osd":4,"uuid":"fa403c08-d8a1-4a3a-8384-cb465c1a654c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":116092},{"type":"v1","addr":"172.21.15.152:6801","nonce":116092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":116092},{"type":"v1","addr":"172.21.15.152:6803","nonce":116092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":116092},{"type":"v1","addr":"172.21.15.152:6807","nonce":116092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":116092},{"type":"v1","addr":"172.21.15.152:6805","nonce":116092}]},"public_addr":"172.21.15.152:6801/116092","cluster_addr":"172.21.15.152:6803/116092","heartbeat_back_addr":"172.21.15.152:6807/116092","heartbeat_front_addr":"172.21.15.152:6805/116092","state":["exists","up"]},{"osd":5,"uuid":"399fc450-39fa-43a6-bf80-0b8bcb41bd95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6815","nonce":116093},{"type":"v1","addr":"172.21.15.152:6817","nonce":116093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":116093},{"type":"v1","addr":"172.21.15.152:6819","nonce":116093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":116093},{"type":"v1","addr":"172.21.15.152:6823","nonce":116093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":116093},{"type":"v1","addr":"172.21.15.152:6821","nonce":116093}]},"public_addr":"172.21.15.152:6817/116093","cluster_addr":"172.21.15.152:6819/116093","heartbeat_back_addr":"172.21.15.152:6823/116093","heartbeat_front_addr":"172.21.15.152:6821/116093","state":["exists","up"]},{"osd":6,"uuid":"e59a4017-2d23-4627-836b-e25b2d3ddaaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":116094},{"type":"v1","addr":"172.21.15.152:6809","nonce":116094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":116094},{"type":"v1","addr":"172.21.15.152:6811","nonce":116094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":116094},{"type":"v1","addr":"172.21.15.152:6816","nonce":116094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":116094},{"type":"v1","addr":"172.21.15.152:6813","nonce":116094}]},"public_addr":"172.21.15.152:6809/116094","cluster_addr":"172.21.15.152:6811/116094","heartbeat_back_addr":"172.21.15.152:6816/116094","heartbeat_front_addr":"172.21.15.152:6813/116094","state":["exists","up"]},{"osd":7,"uuid":"8d7f9d4b-bf08-4670-8591-388c0f012a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":116097},{"type":"v1","addr":"172.21.15.152:6825","nonce":116097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":116097},{"type":"v1","addr":"172.21.15.152:6827","nonce":116097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":116097},{"type":"v1","addr":"172.21.15.152:6831","nonce":116097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":116097},{"type":"v1","addr":"172.21.15.152:6829","nonce":116097}]},"public_addr":"172.21.15.152:6825/116097","cluster_addr":"172.21.15.152:6827/116097","heartbeat_back_addr":"172.21.15.152:6831/116097","heartbeat_front_addr":"172.21.15.152:6829/116097","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.937710+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.865423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.159434+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.913090+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.131647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.966255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.972583+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.177209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T12:08:31.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.874+0000 7f4dbcbff700 1 -- 172.21.15.45:0/2923888825 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f4d980682f0 msgr2=0x7f4d9806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:31.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.874+0000 7f4dbcbff700 1 --2- 172.21.15.45:0/2923888825 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f4d980682f0 0x7f4d9806a7a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4db80b4b80 tx=0x7f4dac009210 comp rx=0 tx=0).stop 2023-11-28T12:08:31.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.874+0000 7f4dbcbff700 1 -- 172.21.15.45:0/2923888825 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4db80d2320 msgr2=0x7f4db81e8530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:31.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.874+0000 7f4dbcbff700 1 --2- 172.21.15.45:0/2923888825 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4db80d2320 0x7f4db81e8530 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f4da800c450 tx=0x7f4da800c760 comp rx=0 tx=0).stop 2023-11-28T12:08:31.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.874+0000 7f4dbcbff700 1 -- 172.21.15.45:0/2923888825 shutdown_connections 2023-11-28T12:08:31.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.874+0000 7f4dbcbff700 1 --2- 172.21.15.45:0/2923888825 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f4d980682f0 0x7f4d9806a7a0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:31.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.874+0000 7f4dbcbff700 1 --2- 172.21.15.45:0/2923888825 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4db8161340 0x7f4db80c5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:31.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.874+0000 7f4dbcbff700 1 --2- 172.21.15.45:0/2923888825 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4db80d2320 0x7f4db81e8530 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:31.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.874+0000 7f4dbcbff700 1 --2- 172.21.15.45:0/2923888825 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4db815c9b0 0x7f4db81e65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:31.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.874+0000 7f4dbcbff700 1 -- 172.21.15.45:0/2923888825 >> 172.21.15.45:0/2923888825 conn(0x7f4db8072600 msgr2=0x7f4db815bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:31.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.875+0000 7f4dbcbff700 1 -- 172.21.15.45:0/2923888825 shutdown_connections 2023-11-28T12:08:31.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:31.875+0000 7f4dbcbff700 1 -- 172.21.15.45:0/2923888825 wait complete. 2023-11-28T12:08:31.893 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T12:08:32.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.096+0000 7f444d5ff700 1 Processor -- start 2023-11-28T12:08:32.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.097+0000 7f444d5ff700 1 -- start start 2023-11-28T12:08:32.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.098+0000 7f444d5ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4448161340 0x7f44480d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:32.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.099+0000 7f444d5ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f44480d2320 0x7f44480cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:32.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.099+0000 7f444d5ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44480d1950 con 0x7f444815c9b0 2023-11-28T12:08:32.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.099+0000 7f444d5ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44480b5800 con 0x7f4448161340 2023-11-28T12:08:32.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.099+0000 7f444d5ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44480b5300 con 0x7f44480d2320 2023-11-28T12:08:32.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.099+0000 7f44467fc700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4448161340 0x7f44480d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:32.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.099+0000 7f44467fc700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4448161340 0x7f44480d1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59646/0 (socket says 172.21.15.45:59646) 2023-11-28T12:08:32.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.099+0000 7f44467fc700 1 -- 172.21.15.45:0/701985770 learned_addr learned my addr 172.21.15.45:0/701985770 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:32.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.099+0000 7f4446ffd700 1 --1- 172.21.15.45:0/701985770 >> v1:172.21.15.45:6789/0 conn(0x7f444815c9b0 0x7f44480b4bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:42880/0 (socket says 172.21.15.45:42880) 2023-11-28T12:08:32.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.099+0000 7f44477fe700 1 --2- 172.21.15.45:0/701985770 >> v2:172.21.15.152:3300/0 conn(0x7f44480d2320 0x7f44480cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:32.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.099+0000 7f44467fc700 1 -- 172.21.15.45:0/701985770 >> v2:172.21.15.152:3300/0 conn(0x7f44480d2320 msgr2=0x7f44480cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:32.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.099+0000 7f44467fc700 1 --2- 172.21.15.45:0/701985770 >> v2:172.21.15.152:3300/0 conn(0x7f44480d2320 0x7f44480cd7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:32.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.099+0000 7f44467fc700 1 -- 172.21.15.45:0/701985770 >> v1:172.21.15.45:6789/0 conn(0x7f444815c9b0 legacy=0x7f44480b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:32.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.099+0000 7f44467fc700 1 -- 172.21.15.45:0/701985770 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44480b5520 con 0x7f4448161340 2023-11-28T12:08:32.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.100+0000 7f44467fc700 1 --2- 172.21.15.45:0/701985770 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4448161340 0x7f44480d1de0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f444806c170 tx=0x7f443c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34f88e8380c73625 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:32.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.100+0000 7f4445ffb700 1 -- 172.21.15.45:0/701985770 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f443c00b860 con 0x7f4448161340 2023-11-28T12:08:32.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.100+0000 7f4445ffb700 1 -- 172.21.15.45:0/701985770 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f443c00b9c0 con 0x7f4448161340 2023-11-28T12:08:32.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.100+0000 7f4445ffb700 1 -- 172.21.15.45:0/701985770 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f443c00bd50 con 0x7f4448161340 2023-11-28T12:08:32.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.100+0000 7f444d5ff700 1 -- 172.21.15.45:0/701985770 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4448161340 msgr2=0x7f44480d1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:32.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.100+0000 7f444d5ff700 1 --2- 172.21.15.45:0/701985770 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4448161340 0x7f44480d1de0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f444806c170 tx=0x7f443c009c00 comp rx=0 tx=0).stop 2023-11-28T12:08:32.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.100+0000 7f444d5ff700 1 -- 172.21.15.45:0/701985770 shutdown_connections 2023-11-28T12:08:32.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.100+0000 7f444d5ff700 1 --2- 172.21.15.45:0/701985770 >> v2:172.21.15.152:3300/0 conn(0x7f44480d2320 0x7f44480cd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:32.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.100+0000 7f444d5ff700 1 --2- 172.21.15.45:0/701985770 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4448161340 0x7f44480d1de0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:32.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.100+0000 7f444d5ff700 1 -- 172.21.15.45:0/701985770 >> 172.21.15.45:0/701985770 conn(0x7f4448072600 msgr2=0x7f44480cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:32.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.100+0000 7f444d5ff700 1 -- 172.21.15.45:0/701985770 shutdown_connections 2023-11-28T12:08:32.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.100+0000 7f444d5ff700 1 -- 172.21.15.45:0/701985770 wait complete. 2023-11-28T12:08:32.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.102+0000 7f444d5ff700 1 Processor -- start 2023-11-28T12:08:32.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.102+0000 7f444d5ff700 1 -- start start 2023-11-28T12:08:32.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.103+0000 7f444d5ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44480d2320 0x7f4448150cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:32.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.103+0000 7f444d5ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f444815c9b0 0x7f44481e7750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:32.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.103+0000 7f444d5ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4448161340 0x7f4448156230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:32.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.103+0000 7f444d5ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44481547e0 con 0x7f44480d2320 2023-11-28T12:08:32.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.103+0000 7f444d5ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44481e6460 con 0x7f444815c9b0 2023-11-28T12:08:32.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.103+0000 7f444d5ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44481e72c0 con 0x7f4448161340 2023-11-28T12:08:32.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.103+0000 7f4446ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44480d2320 0x7f4448150cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:32.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.104+0000 7f4446ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44480d2320 0x7f4448150cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59654/0 (socket says 172.21.15.45:59654) 2023-11-28T12:08:32.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.104+0000 7f4446ffd700 1 -- 172.21.15.45:0/2145973991 learned_addr learned my addr 172.21.15.45:0/2145973991 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:32.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.104+0000 7f44467fc700 1 --2- 172.21.15.45:0/2145973991 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f444815c9b0 0x7f44481e7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:32.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.104+0000 7f44477fe700 1 --2- 172.21.15.45:0/2145973991 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4448161340 0x7f4448156230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:32.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.104+0000 7f4446ffd700 1 -- 172.21.15.45:0/2145973991 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4448161340 msgr2=0x7f4448156230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:32.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.104+0000 7f4446ffd700 1 --2- 172.21.15.45:0/2145973991 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4448161340 0x7f4448156230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:32.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.104+0000 7f4446ffd700 1 -- 172.21.15.45:0/2145973991 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f444815c9b0 msgr2=0x7f44481e7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:32.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.104+0000 7f4446ffd700 1 --2- 172.21.15.45:0/2145973991 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f444815c9b0 0x7f44481e7750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:32.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.104+0000 7f4446ffd700 1 -- 172.21.15.45:0/2145973991 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f443c009550 con 0x7f44480d2320 2023-11-28T12:08:32.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.104+0000 7f4446ffd700 1 --2- 172.21.15.45:0/2145973991 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44480d2320 0x7f4448150cc0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f443800c530 tx=0x7f443800c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:32.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.104+0000 7f442f7fe700 1 -- 172.21.15.45:0/2145973991 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f443800cea0 con 0x7f44480d2320 2023-11-28T12:08:32.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.105+0000 7f442f7fe700 1 -- 172.21.15.45:0/2145973991 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4438005cb0 con 0x7f44480d2320 2023-11-28T12:08:32.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.105+0000 7f444d5ff700 1 -- 172.21.15.45:0/2145973991 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44480d15e0 con 0x7f44480d2320 2023-11-28T12:08:32.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.105+0000 7f442f7fe700 1 -- 172.21.15.45:0/2145973991 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44380072d0 con 0x7f44480d2320 2023-11-28T12:08:32.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.105+0000 7f444d5ff700 1 -- 172.21.15.45:0/2145973991 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44480d1300 con 0x7f44480d2320 2023-11-28T12:08:32.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.106+0000 7f444d5ff700 1 -- 172.21.15.45:0/2145973991 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f444815cd80 con 0x7f44480d2320 2023-11-28T12:08:32.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.107+0000 7f442f7fe700 1 -- 172.21.15.45:0/2145973991 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f4438019030 con 0x7f44480d2320 2023-11-28T12:08:32.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.108+0000 7f442f7fe700 1 --2- 172.21.15.45:0/2145973991 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f44340682f0 0x7f443406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:32.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.108+0000 7f442f7fe700 1 -- 172.21.15.45:0/2145973991 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4438084e80 con 0x7f44480d2320 2023-11-28T12:08:32.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.108+0000 7f44467fc700 1 --2- 172.21.15.45:0/2145973991 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f44340682f0 0x7f443406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:32.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.109+0000 7f44467fc700 1 --2- 172.21.15.45:0/2145973991 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f44340682f0 0x7f443406a7a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f443c000c00 tx=0x7f443c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:32.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.112+0000 7f442f7fe700 1 -- 172.21.15.45:0/2145973991 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f443804b5e0 con 0x7f44480d2320 2023-11-28T12:08:32.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.315+0000 7f444d5ff700 1 -- 172.21.15.45:0/2145973991 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f444815d0c0 con 0x7f44480d2320 2023-11-28T12:08:32.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.317+0000 7f442f7fe700 1 -- 172.21.15.45:0/2145973991 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+17934 (secure 0 0 0) 0x7f4438017020 con 0x7f44480d2320 2023-11-28T12:08:32.317 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:08:32.318 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":46,"fsid":"bd7c37f1-f7c6-4778-b845-52cf2aa6e366","created":"2023-11-28T12:06:09.045075+0000","modified":"2023-11-28T12:08:31.391444+0000","last_up_change":"2023-11-28T12:06:21.282227+0000","last_in_change":"2023-11-28T12:06:12.560924+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T12:06:21.807108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T12:06:22.491009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-11-28T12:08:29.364957+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-11-28T12:08:30.374968+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d0cdd8a-87fd-4f2c-91bd-47bdfa661905","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":115843},{"type":"v1","addr":"172.21.15.45:6808","nonce":115843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":115843},{"type":"v1","addr":"172.21.15.45:6811","nonce":115843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":115843},{"type":"v1","addr":"172.21.15.45:6815","nonce":115843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":115843},{"type":"v1","addr":"172.21.15.45:6813","nonce":115843}]},"public_addr":"172.21.15.45:6808/115843","cluster_addr":"172.21.15.45:6811/115843","heartbeat_back_addr":"172.21.15.45:6815/115843","heartbeat_front_addr":"172.21.15.45:6813/115843","state":["exists","up"]},{"osd":1,"uuid":"c5de4ebd-9ec5-40b3-9caa-9b706fab4c76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":115842},{"type":"v1","addr":"172.21.15.45:6801","nonce":115842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":115842},{"type":"v1","addr":"172.21.15.45:6803","nonce":115842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6807","nonce":115842},{"type":"v1","addr":"172.21.15.45:6809","nonce":115842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":115842},{"type":"v1","addr":"172.21.15.45:6805","nonce":115842}]},"public_addr":"172.21.15.45:6801/115842","cluster_addr":"172.21.15.45:6803/115842","heartbeat_back_addr":"172.21.15.45:6809/115842","heartbeat_front_addr":"172.21.15.45:6805/115842","state":["exists","up"]},{"osd":2,"uuid":"9f4b36b2-65d2-40e7-9fe6-a2991afa71c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":115850},{"type":"v1","addr":"172.21.15.45:6819","nonce":115850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":115850},{"type":"v1","addr":"172.21.15.45:6823","nonce":115850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":115850},{"type":"v1","addr":"172.21.15.45:6831","nonce":115850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":115850},{"type":"v1","addr":"172.21.15.45:6828","nonce":115850}]},"public_addr":"172.21.15.45:6819/115850","cluster_addr":"172.21.15.45:6823/115850","heartbeat_back_addr":"172.21.15.45:6831/115850","heartbeat_front_addr":"172.21.15.45:6828/115850","state":["exists","up"]},{"osd":3,"uuid":"6fe7ef05-4e0d-426c-bf94-44b51d4d550b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":115848},{"type":"v1","addr":"172.21.15.45:6818","nonce":115848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":115848},{"type":"v1","addr":"172.21.15.45:6822","nonce":115848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6827","nonce":115848},{"type":"v1","addr":"172.21.15.45:6829","nonce":115848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":115848},{"type":"v1","addr":"172.21.15.45:6825","nonce":115848}]},"public_addr":"172.21.15.45:6818/115848","cluster_addr":"172.21.15.45:6822/115848","heartbeat_back_addr":"172.21.15.45:6829/115848","heartbeat_front_addr":"172.21.15.45:6825/115848","state":["exists","up"]},{"osd":4,"uuid":"fa403c08-d8a1-4a3a-8384-cb465c1a654c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":116092},{"type":"v1","addr":"172.21.15.152:6801","nonce":116092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":116092},{"type":"v1","addr":"172.21.15.152:6803","nonce":116092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":116092},{"type":"v1","addr":"172.21.15.152:6807","nonce":116092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":116092},{"type":"v1","addr":"172.21.15.152:6805","nonce":116092}]},"public_addr":"172.21.15.152:6801/116092","cluster_addr":"172.21.15.152:6803/116092","heartbeat_back_addr":"172.21.15.152:6807/116092","heartbeat_front_addr":"172.21.15.152:6805/116092","state":["exists","up"]},{"osd":5,"uuid":"399fc450-39fa-43a6-bf80-0b8bcb41bd95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6815","nonce":116093},{"type":"v1","addr":"172.21.15.152:6817","nonce":116093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":116093},{"type":"v1","addr":"172.21.15.152:6819","nonce":116093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":116093},{"type":"v1","addr":"172.21.15.152:6823","nonce":116093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":116093},{"type":"v1","addr":"172.21.15.152:6821","nonce":116093}]},"public_addr":"172.21.15.152:6817/116093","cluster_addr":"172.21.15.152:6819/116093","heartbeat_back_addr":"172.21.15.152:6823/116093","heartbeat_front_addr":"172.21.15.152:6821/116093","state":["exists","up"]},{"osd":6,"uuid":"e59a4017-2d23-4627-836b-e25b2d3ddaaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":116094},{"type":"v1","addr":"172.21.15.152:6809","nonce":116094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":116094},{"type":"v1","addr":"172.21.15.152:6811","nonce":116094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":116094},{"type":"v1","addr":"172.21.15.152:6816","nonce":116094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":116094},{"type":"v1","addr":"172.21.15.152:6813","nonce":116094}]},"public_addr":"172.21.15.152:6809/116094","cluster_addr":"172.21.15.152:6811/116094","heartbeat_back_addr":"172.21.15.152:6816/116094","heartbeat_front_addr":"172.21.15.152:6813/116094","state":["exists","up"]},{"osd":7,"uuid":"8d7f9d4b-bf08-4670-8591-388c0f012a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":116097},{"type":"v1","addr":"172.21.15.152:6825","nonce":116097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":116097},{"type":"v1","addr":"172.21.15.152:6827","nonce":116097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":116097},{"type":"v1","addr":"172.21.15.152:6831","nonce":116097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":116097},{"type":"v1","addr":"172.21.15.152:6829","nonce":116097}]},"public_addr":"172.21.15.152:6825/116097","cluster_addr":"172.21.15.152:6827/116097","heartbeat_back_addr":"172.21.15.152:6831/116097","heartbeat_front_addr":"172.21.15.152:6829/116097","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.937710+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.865423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.159434+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.913090+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.131647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.966255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.972583+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.177209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T12:08:32.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.319+0000 7f444d5ff700 1 -- 172.21.15.45:0/2145973991 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f44340682f0 msgr2=0x7f443406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:32.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.319+0000 7f444d5ff700 1 --2- 172.21.15.45:0/2145973991 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f44340682f0 0x7f443406a7a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f443c000c00 tx=0x7f443c008030 comp rx=0 tx=0).stop 2023-11-28T12:08:32.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.319+0000 7f444d5ff700 1 -- 172.21.15.45:0/2145973991 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44480d2320 msgr2=0x7f4448150cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:32.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.319+0000 7f444d5ff700 1 --2- 172.21.15.45:0/2145973991 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44480d2320 0x7f4448150cc0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f443800c530 tx=0x7f443800c840 comp rx=0 tx=0).stop 2023-11-28T12:08:32.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.319+0000 7f444d5ff700 1 -- 172.21.15.45:0/2145973991 shutdown_connections 2023-11-28T12:08:32.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.319+0000 7f444d5ff700 1 --2- 172.21.15.45:0/2145973991 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f44340682f0 0x7f443406a7a0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:32.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.319+0000 7f444d5ff700 1 --2- 172.21.15.45:0/2145973991 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4448161340 0x7f4448156230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:32.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.319+0000 7f444d5ff700 1 --2- 172.21.15.45:0/2145973991 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44480d2320 0x7f4448150cc0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:32.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.319+0000 7f444d5ff700 1 --2- 172.21.15.45:0/2145973991 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f444815c9b0 0x7f44481e7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:32.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.319+0000 7f444d5ff700 1 -- 172.21.15.45:0/2145973991 >> 172.21.15.45:0/2145973991 conn(0x7f4448072600 msgr2=0x7f44480b6dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:32.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.319+0000 7f444d5ff700 1 -- 172.21.15.45:0/2145973991 shutdown_connections 2023-11-28T12:08:32.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.319+0000 7f444d5ff700 1 -- 172.21.15.45:0/2145973991 wait complete. 2023-11-28T12:08:32.339 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-28T12:08:32.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.547+0000 7f7e32dff700 1 Processor -- start 2023-11-28T12:08:32.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.547+0000 7f7e32dff700 1 -- start start 2023-11-28T12:08:32.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.548+0000 7f7e32dff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f7e2c15c9b0 0x7f7e2c0b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:32.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.548+0000 7f7e32dff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7e2c161340 0x7f7e2c0d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:32.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.548+0000 7f7e32dff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e2c0d1950 con 0x7f7e2c0d2320 2023-11-28T12:08:32.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.548+0000 7f7e32dff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e2c0b5800 con 0x7f7e2c161340 2023-11-28T12:08:32.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.548+0000 7f7e32dff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e2c0b5520 con 0x7f7e2c15c9b0 2023-11-28T12:08:32.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.549+0000 7f7e2bfff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7e2c161340 0x7f7e2c0d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:32.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.549+0000 7f7e2bfff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7e2c161340 0x7f7e2c0d1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59658/0 (socket says 172.21.15.45:59658) 2023-11-28T12:08:32.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.549+0000 7f7e2bfff700 1 -- 172.21.15.45:0/3881063340 learned_addr learned my addr 172.21.15.45:0/3881063340 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:32.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.549+0000 7f7e2bfff700 1 -- 172.21.15.45:0/3881063340 >> v2:172.21.15.152:3300/0 conn(0x7f7e2c15c9b0 msgr2=0x7f7e2c0b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:32.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.549+0000 7f7e30b9b700 1 --2- 172.21.15.45:0/3881063340 >> v2:172.21.15.152:3300/0 conn(0x7f7e2c15c9b0 0x7f7e2c0b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:32.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.549+0000 7f7e2bfff700 1 --2- 172.21.15.45:0/3881063340 >> v2:172.21.15.152:3300/0 conn(0x7f7e2c15c9b0 0x7f7e2c0b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:32.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.549+0000 7f7e2bfff700 1 -- 172.21.15.45:0/3881063340 >> v1:172.21.15.152:6789/0 conn(0x7f7e2c0d2320 legacy=0x7f7e2c0cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:32.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.549+0000 7f7e2bfff700 1 -- 172.21.15.45:0/3881063340 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e2c0d1300 con 0x7f7e2c161340 2023-11-28T12:08:32.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.549+0000 7f7e30b9b700 1 --2- 172.21.15.45:0/3881063340 >> v2:172.21.15.152:3300/0 conn(0x7f7e2c15c9b0 0x7f7e2c0b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:08:32.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.550+0000 7f7e2bfff700 1 --2- 172.21.15.45:0/3881063340 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e2c161340 0x7f7e2c0d1de0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c067460 tx=0x7f7e18009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1863d97e255072a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:32.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.550+0000 7f7e2b7fe700 1 -- 172.21.15.45:0/3881063340 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e18004230 con 0x7f7e2c161340 2023-11-28T12:08:32.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.550+0000 7f7e2b7fe700 1 -- 172.21.15.45:0/3881063340 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e18004390 con 0x7f7e2c161340 2023-11-28T12:08:32.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.550+0000 7f7e2b7fe700 1 -- 172.21.15.45:0/3881063340 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e180036a0 con 0x7f7e2c161340 2023-11-28T12:08:32.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.550+0000 7f7e32dff700 1 -- 172.21.15.45:0/3881063340 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e2c161340 msgr2=0x7f7e2c0d1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:32.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.550+0000 7f7e32dff700 1 --2- 172.21.15.45:0/3881063340 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e2c161340 0x7f7e2c0d1de0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c067460 tx=0x7f7e18009bd0 comp rx=0 tx=0).stop 2023-11-28T12:08:32.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.550+0000 7f7e32dff700 1 -- 172.21.15.45:0/3881063340 shutdown_connections 2023-11-28T12:08:32.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.550+0000 7f7e32dff700 1 --2- 172.21.15.45:0/3881063340 >> v2:172.21.15.152:3300/0 conn(0x7f7e2c15c9b0 0x7f7e2c0b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:32.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.550+0000 7f7e32dff700 1 --2- 172.21.15.45:0/3881063340 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e2c161340 0x7f7e2c0d1de0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:32.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.550+0000 7f7e32dff700 1 -- 172.21.15.45:0/3881063340 >> 172.21.15.45:0/3881063340 conn(0x7f7e2c072600 msgr2=0x7f7e2c0cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:32.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.551+0000 7f7e32dff700 1 -- 172.21.15.45:0/3881063340 shutdown_connections 2023-11-28T12:08:32.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.551+0000 7f7e32dff700 1 -- 172.21.15.45:0/3881063340 wait complete. 2023-11-28T12:08:32.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.552+0000 7f7e32dff700 1 Processor -- start 2023-11-28T12:08:32.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.553+0000 7f7e32dff700 1 -- start start 2023-11-28T12:08:32.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.553+0000 7f7e32dff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e2c0d2320 0x7f7e2c14da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:32.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.553+0000 7f7e32dff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7e2c15c9b0 0x7f7e2c14df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:32.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.554+0000 7f7e32dff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7e2c161340 0x7f7e2c1f63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:32.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.554+0000 7f7e32dff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2c156190 con 0x7f7e2c0d2320 2023-11-28T12:08:32.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.554+0000 7f7e32dff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2c155630 con 0x7f7e2c15c9b0 2023-11-28T12:08:32.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.554+0000 7f7e32dff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2c1558f0 con 0x7f7e2c161340 2023-11-28T12:08:32.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.554+0000 7f7e30b9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e2c0d2320 0x7f7e2c14da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:32.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.554+0000 7f7e30b9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e2c0d2320 0x7f7e2c14da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59674/0 (socket says 172.21.15.45:59674) 2023-11-28T12:08:32.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.554+0000 7f7e30b9b700 1 -- 172.21.15.45:0/2738352449 learned_addr learned my addr 172.21.15.45:0/2738352449 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:32.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.554+0000 7f7e2bfff700 1 --2- 172.21.15.45:0/2738352449 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7e2c15c9b0 0x7f7e2c14df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:32.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.554+0000 7f7e3139c700 1 --2- 172.21.15.45:0/2738352449 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7e2c161340 0x7f7e2c1f63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:32.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.554+0000 7f7e30b9b700 1 -- 172.21.15.45:0/2738352449 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7e2c161340 msgr2=0x7f7e2c1f63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:32.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.554+0000 7f7e30b9b700 1 --2- 172.21.15.45:0/2738352449 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7e2c161340 0x7f7e2c1f63e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:32.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.554+0000 7f7e30b9b700 1 -- 172.21.15.45:0/2738352449 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7e2c15c9b0 msgr2=0x7f7e2c14df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:32.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.554+0000 7f7e30b9b700 1 --2- 172.21.15.45:0/2738352449 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7e2c15c9b0 0x7f7e2c14df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:32.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.554+0000 7f7e30b9b700 1 -- 172.21.15.45:0/2738352449 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e18009550 con 0x7f7e2c0d2320 2023-11-28T12:08:32.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.554+0000 7f7e2bfff700 1 --2- 172.21.15.45:0/2738352449 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7e2c15c9b0 0x7f7e2c14df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:08:32.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.554+0000 7f7e30b9b700 1 --2- 172.21.15.45:0/2738352449 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e2c0d2320 0x7f7e2c14da20 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f7e2000c750 tx=0x7f7e2000cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:32.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.555+0000 7f7e297fa700 1 -- 172.21.15.45:0/2738352449 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e20011800 con 0x7f7e2c0d2320 2023-11-28T12:08:32.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.555+0000 7f7e297fa700 1 -- 172.21.15.45:0/2738352449 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e20011960 con 0x7f7e2c0d2320 2023-11-28T12:08:32.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.555+0000 7f7e32dff700 1 -- 172.21.15.45:0/2738352449 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e2c0b5130 con 0x7f7e2c0d2320 2023-11-28T12:08:32.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.555+0000 7f7e297fa700 1 -- 172.21.15.45:0/2738352449 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e20011cd0 con 0x7f7e2c0d2320 2023-11-28T12:08:32.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.555+0000 7f7e32dff700 1 -- 172.21.15.45:0/2738352449 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e2c0d15e0 con 0x7f7e2c0d2320 2023-11-28T12:08:32.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.556+0000 7f7e32dff700 1 -- 172.21.15.45:0/2738352449 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e2c0b52c0 con 0x7f7e2c0d2320 2023-11-28T12:08:32.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.557+0000 7f7e297fa700 1 -- 172.21.15.45:0/2738352449 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f7e20020070 con 0x7f7e2c0d2320 2023-11-28T12:08:32.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.558+0000 7f7e297fa700 1 --2- 172.21.15.45:0/2738352449 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f7e100682f0 0x7f7e1006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:32.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.558+0000 7f7e297fa700 1 -- 172.21.15.45:0/2738352449 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7e20085c30 con 0x7f7e2c0d2320 2023-11-28T12:08:32.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.559+0000 7f7e2bfff700 1 --2- 172.21.15.45:0/2738352449 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f7e100682f0 0x7f7e1006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:32.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.560+0000 7f7e2bfff700 1 --2- 172.21.15.45:0/2738352449 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f7e100682f0 0x7f7e1006a7a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f7e18009130 tx=0x7f7e18008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:32.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.562+0000 7f7e297fa700 1 -- 172.21.15.45:0/2738352449 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f7e200523a0 con 0x7f7e2c0d2320 2023-11-28T12:08:32.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:32.811+0000 7f7e32dff700 1 -- 172.21.15.45:0/2738352449 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f7e2c0b8fa0 con 0x7f7e2c0d2320 2023-11-28T12:08:33.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:33.402+0000 7f7e297fa700 1 -- 172.21.15.45:0/2738352449 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v23) v1 ==== 118+0+0 (secure 0 0 0) 0x7f7e2001e0b0 con 0x7f7e2c0d2320 2023-11-28T12:08:33.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:33.405+0000 7f7e32dff700 1 -- 172.21.15.45:0/2738352449 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f7e100682f0 msgr2=0x7f7e1006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:33.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:33.405+0000 7f7e32dff700 1 --2- 172.21.15.45:0/2738352449 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f7e100682f0 0x7f7e1006a7a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f7e18009130 tx=0x7f7e18008030 comp rx=0 tx=0).stop 2023-11-28T12:08:33.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:33.405+0000 7f7e32dff700 1 -- 172.21.15.45:0/2738352449 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e2c0d2320 msgr2=0x7f7e2c14da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:33.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:33.405+0000 7f7e32dff700 1 --2- 172.21.15.45:0/2738352449 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e2c0d2320 0x7f7e2c14da20 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f7e2000c750 tx=0x7f7e2000cb10 comp rx=0 tx=0).stop 2023-11-28T12:08:33.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:33.406+0000 7f7e32dff700 1 -- 172.21.15.45:0/2738352449 shutdown_connections 2023-11-28T12:08:33.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:33.406+0000 7f7e32dff700 1 --2- 172.21.15.45:0/2738352449 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f7e100682f0 0x7f7e1006a7a0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:33.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:33.406+0000 7f7e32dff700 1 --2- 172.21.15.45:0/2738352449 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7e2c161340 0x7f7e2c1f63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:33.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:33.406+0000 7f7e32dff700 1 --2- 172.21.15.45:0/2738352449 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e2c0d2320 0x7f7e2c14da20 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:33.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:33.406+0000 7f7e32dff700 1 --2- 172.21.15.45:0/2738352449 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7e2c15c9b0 0x7f7e2c14df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:33.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:33.406+0000 7f7e32dff700 1 -- 172.21.15.45:0/2738352449 >> 172.21.15.45:0/2738352449 conn(0x7f7e2c072600 msgr2=0x7f7e2c15d020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:33.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:33.406+0000 7f7e32dff700 1 -- 172.21.15.45:0/2738352449 shutdown_connections 2023-11-28T12:08:33.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:33.406+0000 7f7e32dff700 1 -- 172.21.15.45:0/2738352449 wait complete. 2023-11-28T12:08:33.427 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-28T12:08:33.427 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-28T12:08:33.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:33.638+0000 7f05d99ff700 1 Processor -- start 2023-11-28T12:08:33.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:33.638+0000 7f05d99ff700 1 -- start start 2023-11-28T12:08:33.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:33.639+0000 7f05d99ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f05d4161340 0x7f05d40d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:33.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:33.639+0000 7f05d99ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05d40d1950 con 0x7f05d40d2320 2023-11-28T12:08:33.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:33.639+0000 7f05d99ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05d40b5520 con 0x7f05d415c9b0 2023-11-28T12:08:33.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:33.639+0000 7f05d99ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05d40b5800 con 0x7f05d4161340 2023-11-28T12:08:33.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:33.639+0000 7f05d37fe700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f05d40d2320 0x7f05d40cd7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:42888/0 (socket says 172.21.15.45:42888) 2023-11-28T12:08:33.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:33.639+0000 7f05d37fe700 1 -- 172.21.15.45:0/4107719946 learned_addr learned my addr 172.21.15.45:0/4107719946 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:08:33.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:33.639+0000 7f05d27fc700 1 --2- 172.21.15.45:0/4107719946 >> v2:172.21.15.152:3300/0 conn(0x7f05d4161340 0x7f05d40d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:33.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:33.640+0000 7f05d1ffb700 1 -- 172.21.15.45:0/4107719946 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2595924727 0 0) 0x7f05d40d1950 con 0x7f05d40d2320 2023-11-28T12:08:33.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:33.640+0000 7f05d1ffb700 1 -- 172.21.15.45:0/4107719946 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05bc0035b0 con 0x7f05d40d2320 2023-11-28T12:08:33.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:33.640+0000 7f05d1ffb700 1 -- 172.21.15.45:0/4107719946 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2560601536 0 0) 0x7f05d40b5520 con 0x7f05d415c9b0 2023-11-28T12:08:33.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:33.640+0000 7f05d1ffb700 1 -- 172.21.15.45:0/4107719946 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05d40d1950 con 0x7f05d415c9b0 2023-11-28T12:08:33.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:33.640+0000 7f05d27fc700 1 -- 172.21.15.45:0/4107719946 >> v1:172.21.15.152:6789/0 conn(0x7f05d415c9b0 legacy=0x7f05d40b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:33.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:33.640+0000 7f05d27fc700 1 -- 172.21.15.45:0/4107719946 >> v1:172.21.15.45:6789/0 conn(0x7f05d40d2320 legacy=0x7f05d40cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:33.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:33.640+0000 7f05d27fc700 1 -- 172.21.15.45:0/4107719946 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05d40d1300 con 0x7f05d4161340 2023-11-28T12:08:33.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:33.640+0000 7f05d27fc700 1 --2- 172.21.15.45:0/4107719946 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f05d4161340 0x7f05d40d1de0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f05c8009840 tx=0x7f05c8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e70509f5db914091 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:33.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:33.641+0000 7f05d1ffb700 1 -- 172.21.15.45:0/4107719946 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c8011830 con 0x7f05d4161340 2023-11-28T12:08:33.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:33.641+0000 7f05d1ffb700 1 -- 172.21.15.45:0/4107719946 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05c8011990 con 0x7f05d4161340 2023-11-28T12:08:33.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:33.641+0000 7f05d1ffb700 1 -- 172.21.15.45:0/4107719946 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c8011d20 con 0x7f05d4161340 2023-11-28T12:08:33.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:33.641+0000 7f05d99ff700 1 -- 172.21.15.45:0/4107719946 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f05d4161340 msgr2=0x7f05d40d1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:33.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:33.641+0000 7f05d99ff700 1 --2- 172.21.15.45:0/4107719946 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f05d4161340 0x7f05d40d1de0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f05c8009840 tx=0x7f05c8009b50 comp rx=0 tx=0).stop 2023-11-28T12:08:33.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:33.641+0000 7f05d99ff700 1 -- 172.21.15.45:0/4107719946 shutdown_connections 2023-11-28T12:08:33.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:33.641+0000 7f05d99ff700 1 --2- 172.21.15.45:0/4107719946 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f05d4161340 0x7f05d40d1de0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:33.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:33.641+0000 7f05d99ff700 1 -- 172.21.15.45:0/4107719946 >> 172.21.15.45:0/4107719946 conn(0x7f05d4072600 msgr2=0x7f05d40cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:33.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:33.641+0000 7f05d99ff700 1 -- 172.21.15.45:0/4107719946 shutdown_connections 2023-11-28T12:08:33.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:33.641+0000 7f05d99ff700 1 -- 172.21.15.45:0/4107719946 wait complete. 2023-11-28T12:08:33.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:33.643+0000 7f05d99ff700 1 Processor -- start 2023-11-28T12:08:33.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:33.643+0000 7f05d99ff700 1 -- start start 2023-11-28T12:08:33.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:33.644+0000 7f05d99ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f05d40d2320 0x7f05d414d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:33.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:33.644+0000 7f05d99ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05d415c9b0 0x7f05d415aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:33.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:33.644+0000 7f05d99ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f05d4161340 0x7f05d415afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:33.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:33.644+0000 7f05d99ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d41f3df0 con 0x7f05d415c9b0 2023-11-28T12:08:33.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:33.644+0000 7f05d99ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d41f38f0 con 0x7f05d40d2320 2023-11-28T12:08:33.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:33.644+0000 7f05d99ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05d41f2fc0 con 0x7f05d4161340 2023-11-28T12:08:33.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:33.644+0000 7f05d27fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05d415c9b0 0x7f05d415aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:33.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:33.644+0000 7f05d27fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05d415c9b0 0x7f05d415aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59684/0 (socket says 172.21.15.45:59684) 2023-11-28T12:08:33.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:33.644+0000 7f05d27fc700 1 -- 172.21.15.45:0/3354833275 learned_addr learned my addr 172.21.15.45:0/3354833275 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:33.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:33.645+0000 7f05d37fe700 1 --2- 172.21.15.45:0/3354833275 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f05d4161340 0x7f05d415afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:33.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:33.645+0000 7f05d27fc700 1 -- 172.21.15.45:0/3354833275 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f05d4161340 msgr2=0x7f05d415afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:33.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:33.645+0000 7f05d27fc700 1 --2- 172.21.15.45:0/3354833275 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f05d4161340 0x7f05d415afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:33.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:33.645+0000 7f05d2ffd700 1 --2- 172.21.15.45:0/3354833275 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f05d40d2320 0x7f05d414d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:33.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:33.645+0000 7f05d27fc700 1 -- 172.21.15.45:0/3354833275 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f05d40d2320 msgr2=0x7f05d414d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:33.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:33.645+0000 7f05d27fc700 1 --2- 172.21.15.45:0/3354833275 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f05d40d2320 0x7f05d414d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:33.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:33.645+0000 7f05d27fc700 1 -- 172.21.15.45:0/3354833275 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05c80094a0 con 0x7f05d415c9b0 2023-11-28T12:08:33.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:33.645+0000 7f05d37fe700 1 --2- 172.21.15.45:0/3354833275 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f05d4161340 0x7f05d415afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:08:33.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:33.645+0000 7f05d2ffd700 1 --2- 172.21.15.45:0/3354833275 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f05d40d2320 0x7f05d414d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:08:33.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:33.645+0000 7f05d27fc700 1 --2- 172.21.15.45:0/3354833275 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05d415c9b0 0x7f05d415aaa0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f05c8014040 tx=0x7f05c8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:33.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:33.645+0000 7f05bbfff700 1 -- 172.21.15.45:0/3354833275 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c801a860 con 0x7f05d415c9b0 2023-11-28T12:08:33.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:33.645+0000 7f05bbfff700 1 -- 172.21.15.45:0/3354833275 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05c801a9c0 con 0x7f05d415c9b0 2023-11-28T12:08:33.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:33.645+0000 7f05d99ff700 1 -- 172.21.15.45:0/3354833275 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05d415cd80 con 0x7f05d415c9b0 2023-11-28T12:08:33.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:33.645+0000 7f05bbfff700 1 -- 172.21.15.45:0/3354833275 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c801ad30 con 0x7f05d415c9b0 2023-11-28T12:08:33.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:33.646+0000 7f05d99ff700 1 -- 172.21.15.45:0/3354833275 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05d40d15e0 con 0x7f05d415c9b0 2023-11-28T12:08:33.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:33.647+0000 7f05d99ff700 1 -- 172.21.15.45:0/3354833275 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05d415cf10 con 0x7f05d415c9b0 2023-11-28T12:08:33.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:33.647+0000 7f05bbfff700 1 -- 172.21.15.45:0/3354833275 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f05c800f050 con 0x7f05d415c9b0 2023-11-28T12:08:33.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:33.649+0000 7f05bbfff700 1 --2- 172.21.15.45:0/3354833275 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f05c00682f0 0x7f05c006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:33.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:33.649+0000 7f05bbfff700 1 -- 172.21.15.45:0/3354833275 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f05c8086ba0 con 0x7f05d415c9b0 2023-11-28T12:08:33.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:33.649+0000 7f05d2ffd700 1 --2- 172.21.15.45:0/3354833275 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f05c00682f0 0x7f05c006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:33.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:33.650+0000 7f05d2ffd700 1 --2- 172.21.15.45:0/3354833275 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f05c00682f0 0x7f05c006a7a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f05c40011e0 tx=0x7f05c4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:33.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:33.653+0000 7f05bbfff700 1 -- 172.21.15.45:0/3354833275 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f05c80533c0 con 0x7f05d415c9b0 2023-11-28T12:08:33.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:33.899+0000 7f05d99ff700 1 -- 172.21.15.45:0/3354833275 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f05d41f3a60 con 0x7f05d415c9b0 2023-11-28T12:08:34.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:34.881+0000 7f05bbfff700 1 -- 172.21.15.45:0/3354833275 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v24) v1 ==== 122+0+0 (secure 0 0 0) 0x7f05c80290c0 con 0x7f05d415c9b0 2023-11-28T12:08:34.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:34.884+0000 7f05d99ff700 1 -- 172.21.15.45:0/3354833275 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f05c00682f0 msgr2=0x7f05c006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:34.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:34.884+0000 7f05d99ff700 1 --2- 172.21.15.45:0/3354833275 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f05c00682f0 0x7f05c006a7a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f05c40011e0 tx=0x7f05c4009040 comp rx=0 tx=0).stop 2023-11-28T12:08:34.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:34.884+0000 7f05d99ff700 1 -- 172.21.15.45:0/3354833275 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05d415c9b0 msgr2=0x7f05d415aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:34.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:34.884+0000 7f05d99ff700 1 --2- 172.21.15.45:0/3354833275 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05d415c9b0 0x7f05d415aaa0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f05c8014040 tx=0x7f05c8004750 comp rx=0 tx=0).stop 2023-11-28T12:08:34.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:34.884+0000 7f05d99ff700 1 -- 172.21.15.45:0/3354833275 shutdown_connections 2023-11-28T12:08:34.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:34.884+0000 7f05d99ff700 1 --2- 172.21.15.45:0/3354833275 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f05c00682f0 0x7f05c006a7a0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:34.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:34.884+0000 7f05d99ff700 1 --2- 172.21.15.45:0/3354833275 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f05d40d2320 0x7f05d414d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:34.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:34.884+0000 7f05d99ff700 1 --2- 172.21.15.45:0/3354833275 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f05d4161340 0x7f05d415afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:34.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:34.884+0000 7f05d99ff700 1 --2- 172.21.15.45:0/3354833275 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05d415c9b0 0x7f05d415aaa0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:34.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:34.884+0000 7f05d99ff700 1 -- 172.21.15.45:0/3354833275 >> 172.21.15.45:0/3354833275 conn(0x7f05d4072600 msgr2=0x7f05d40b8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:34.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:34.885+0000 7f05d99ff700 1 -- 172.21.15.45:0/3354833275 shutdown_connections 2023-11-28T12:08:34.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:34.885+0000 7f05d99ff700 1 -- 172.21.15.45:0/3354833275 wait complete. 2023-11-28T12:08:34.906 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-28T12:08:34.906 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T12:08:35.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.115+0000 7fe64cfff700 1 Processor -- start 2023-11-28T12:08:35.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.115+0000 7fe64cfff700 1 -- start start 2023-11-28T12:08:35.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.117+0000 7fe64cfff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe648161340 0x7fe6480d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:35.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.117+0000 7fe64cfff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6480d1950 con 0x7fe64815c9b0 2023-11-28T12:08:35.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.117+0000 7fe64cfff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6480b5520 con 0x7fe6480d2320 2023-11-28T12:08:35.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.117+0000 7fe64cfff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6480b5800 con 0x7fe648161340 2023-11-28T12:08:35.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.117+0000 7fe64659c700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fe64815c9b0 0x7fe6480b4bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:42896/0 (socket says 172.21.15.45:42896) 2023-11-28T12:08:35.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.117+0000 7fe64659c700 1 -- 172.21.15.45:0/1447086743 learned_addr learned my addr 172.21.15.45:0/1447086743 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:08:35.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.117+0000 7fe63ffff700 1 --2- 172.21.15.45:0/1447086743 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe648161340 0x7fe6480d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:35.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.117+0000 7fe645d9b700 1 -- 172.21.15.45:0/1447086743 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2257701392 0 0) 0x7fe6480d1950 con 0x7fe64815c9b0 2023-11-28T12:08:35.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.117+0000 7fe645d9b700 1 -- 172.21.15.45:0/1447086743 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6340035b0 con 0x7fe64815c9b0 2023-11-28T12:08:35.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.118+0000 7fe645d9b700 1 -- 172.21.15.45:0/1447086743 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2653329797 0 0) 0x7fe6480b5520 con 0x7fe6480d2320 2023-11-28T12:08:35.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.118+0000 7fe645d9b700 1 -- 172.21.15.45:0/1447086743 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6480d1950 con 0x7fe6480d2320 2023-11-28T12:08:35.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.118+0000 7fe645d9b700 1 -- 172.21.15.45:0/1447086743 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2304401066 0 0) 0x7fe6340035b0 con 0x7fe64815c9b0 2023-11-28T12:08:35.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.118+0000 7fe645d9b700 1 -- 172.21.15.45:0/1447086743 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe648161340 msgr2=0x7fe6480d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:35.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.118+0000 7fe645d9b700 1 --2- 172.21.15.45:0/1447086743 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe648161340 0x7fe6480d1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:35.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.118+0000 7fe645d9b700 1 -- 172.21.15.45:0/1447086743 >> v1:172.21.15.152:6789/0 conn(0x7fe6480d2320 legacy=0x7fe6480cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:35.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.118+0000 7fe645d9b700 1 -- 172.21.15.45:0/1447086743 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6480d1300 con 0x7fe64815c9b0 2023-11-28T12:08:35.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.118+0000 7fe645d9b700 1 -- 172.21.15.45:0/1447086743 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3460218165 0 0) 0x7fe638001670 con 0x7fe64815c9b0 2023-11-28T12:08:35.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.118+0000 7fe63ffff700 1 --2- 172.21.15.45:0/1447086743 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe648161340 0x7fe6480d1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:08:35.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.118+0000 7fe645d9b700 1 -- 172.21.15.45:0/1447086743 >> v1:172.21.15.45:6789/0 conn(0x7fe64815c9b0 legacy=0x7fe6480b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:35.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.118+0000 7fe645d9b700 1 --2- 172.21.15.45:0/1447086743 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe634003bc0 0x7fe634003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:35.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.118+0000 7fe645d9b700 1 --2- 172.21.15.45:0/1447086743 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe648161340 0x7fe634004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:35.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.118+0000 7fe645d9b700 1 --2- 172.21.15.45:0/1447086743 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe634004d90 0x7fe634005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:35.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.118+0000 7fe645d9b700 1 -- 172.21.15.45:0/1447086743 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6480b5800 con 0x7fe634004d90 2023-11-28T12:08:35.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.118+0000 7fe645d9b700 1 -- 172.21.15.45:0/1447086743 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe63400bb10 con 0x7fe634003bc0 2023-11-28T12:08:35.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.118+0000 7fe645d9b700 1 -- 172.21.15.45:0/1447086743 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe63400bcd0 con 0x7fe648161340 2023-11-28T12:08:35.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.118+0000 7fe646d9d700 1 --2- 172.21.15.45:0/1447086743 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe634004d90 0x7fe634005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:35.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.118+0000 7fe64659c700 1 --2- 172.21.15.45:0/1447086743 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe634003bc0 0x7fe634003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:35.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.118+0000 7fe63ffff700 1 --2- 172.21.15.45:0/1447086743 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe648161340 0x7fe634004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:35.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.119+0000 7fe646d9d700 1 -- 172.21.15.45:0/1447086743 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe648161340 msgr2=0x7fe634004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:35.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.119+0000 7fe646d9d700 1 --2- 172.21.15.45:0/1447086743 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe648161340 0x7fe634004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:35.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.119+0000 7fe646d9d700 1 -- 172.21.15.45:0/1447086743 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe634003bc0 msgr2=0x7fe634003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:35.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.119+0000 7fe646d9d700 1 --2- 172.21.15.45:0/1447086743 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe634003bc0 0x7fe634003fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:35.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.119+0000 7fe646d9d700 1 -- 172.21.15.45:0/1447086743 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6300094a0 con 0x7fe634004d90 2023-11-28T12:08:35.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.119+0000 7fe646d9d700 1 --2- 172.21.15.45:0/1447086743 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe634004d90 0x7fe634005200 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fe64000c2f0 tx=0x7fe634005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61069c3a6dde4e2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:35.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.119+0000 7fe645d9b700 1 -- 172.21.15.45:0/1447086743 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe640001f30 con 0x7fe634004d90 2023-11-28T12:08:35.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.119+0000 7fe645d9b700 1 -- 172.21.15.45:0/1447086743 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe64000ce90 con 0x7fe634004d90 2023-11-28T12:08:35.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.119+0000 7fe645d9b700 1 -- 172.21.15.45:0/1447086743 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe640003c40 con 0x7fe634004d90 2023-11-28T12:08:35.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.120+0000 7fe64cfff700 1 -- 172.21.15.45:0/1447086743 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe634004d90 msgr2=0x7fe634005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:35.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.120+0000 7fe64cfff700 1 --2- 172.21.15.45:0/1447086743 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe634004d90 0x7fe634005200 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fe64000c2f0 tx=0x7fe634005880 comp rx=0 tx=0).stop 2023-11-28T12:08:35.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.120+0000 7fe646d9d700 1 -- 172.21.15.45:0/1447086743 reap_dead start 2023-11-28T12:08:35.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.120+0000 7fe64cfff700 1 -- 172.21.15.45:0/1447086743 shutdown_connections 2023-11-28T12:08:35.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.120+0000 7fe64cfff700 1 -- 172.21.15.45:0/1447086743 >> 172.21.15.45:0/1447086743 conn(0x7fe648072600 msgr2=0x7fe6480cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:35.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.120+0000 7fe64cfff700 1 -- 172.21.15.45:0/1447086743 shutdown_connections 2023-11-28T12:08:35.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.120+0000 7fe64cfff700 1 -- 172.21.15.45:0/1447086743 wait complete. 2023-11-28T12:08:35.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.122+0000 7fe64cfff700 1 Processor -- start 2023-11-28T12:08:35.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.122+0000 7fe64cfff700 1 -- start start 2023-11-28T12:08:35.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.123+0000 7fe64cfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe634004d90 0x7fe64814a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:35.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.123+0000 7fe64cfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6480ca240 0x7fe6480c8f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:35.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.123+0000 7fe64cfff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe64814ada0 0x7fe64815a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:35.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.123+0000 7fe64cfff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6480cb3c0 con 0x7fe6480ca240 2023-11-28T12:08:35.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.123+0000 7fe64cfff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6480ca7b0 con 0x7fe634004d90 2023-11-28T12:08:35.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.123+0000 7fe64cfff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6480caa90 con 0x7fe64814ada0 2023-11-28T12:08:35.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.123+0000 7fe63ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6480ca240 0x7fe6480c8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:35.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.123+0000 7fe63ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6480ca240 0x7fe6480c8f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59694/0 (socket says 172.21.15.45:59694) 2023-11-28T12:08:35.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.123+0000 7fe63ffff700 1 -- 172.21.15.45:0/2957122993 learned_addr learned my addr 172.21.15.45:0/2957122993 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:35.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.123+0000 7fe64659c700 1 --2- 172.21.15.45:0/2957122993 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe634004d90 0x7fe64814a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:35.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.123+0000 7fe646d9d700 1 --2- 172.21.15.45:0/2957122993 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe64814ada0 0x7fe64815a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:35.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.123+0000 7fe63ffff700 1 -- 172.21.15.45:0/2957122993 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe64814ada0 msgr2=0x7fe64815a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:35.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.123+0000 7fe63ffff700 1 --2- 172.21.15.45:0/2957122993 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe64814ada0 0x7fe64815a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:35.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.123+0000 7fe63ffff700 1 -- 172.21.15.45:0/2957122993 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe634004d90 msgr2=0x7fe64814a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:35.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.123+0000 7fe63ffff700 1 --2- 172.21.15.45:0/2957122993 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe634004d90 0x7fe64814a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:35.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.123+0000 7fe63ffff700 1 -- 172.21.15.45:0/2957122993 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe64815cd80 con 0x7fe6480ca240 2023-11-28T12:08:35.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.124+0000 7fe63ffff700 1 --2- 172.21.15.45:0/2957122993 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6480ca240 0x7fe6480c8f40 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fe630011cd0 tx=0x7fe630009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:35.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.124+0000 7fe63effd700 1 -- 172.21.15.45:0/2957122993 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63000fa00 con 0x7fe6480ca240 2023-11-28T12:08:35.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.124+0000 7fe63effd700 1 -- 172.21.15.45:0/2957122993 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe63000fb60 con 0x7fe6480ca240 2023-11-28T12:08:35.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.124+0000 7fe63effd700 1 -- 172.21.15.45:0/2957122993 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe630004020 con 0x7fe6480ca240 2023-11-28T12:08:35.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.124+0000 7fe64cfff700 1 -- 172.21.15.45:0/2957122993 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6480d15e0 con 0x7fe6480ca240 2023-11-28T12:08:35.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.124+0000 7fe64cfff700 1 -- 172.21.15.45:0/2957122993 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe64815cf10 con 0x7fe6480ca240 2023-11-28T12:08:35.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.125+0000 7fe64cfff700 1 -- 172.21.15.45:0/2957122993 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6480745c0 con 0x7fe6480ca240 2023-11-28T12:08:35.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.126+0000 7fe63effd700 1 -- 172.21.15.45:0/2957122993 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fe630024070 con 0x7fe6480ca240 2023-11-28T12:08:35.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.127+0000 7fe63effd700 1 --2- 172.21.15.45:0/2957122993 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fe6280682f0 0x7fe62806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:35.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.127+0000 7fe63effd700 1 -- 172.21.15.45:0/2957122993 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe630086240 con 0x7fe6480ca240 2023-11-28T12:08:35.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.128+0000 7fe64659c700 1 --2- 172.21.15.45:0/2957122993 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fe6280682f0 0x7fe62806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:35.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.129+0000 7fe64659c700 1 --2- 172.21.15.45:0/2957122993 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fe6280682f0 0x7fe62806a7a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe638001eb0 tx=0x7fe638001040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:35.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.132+0000 7fe63effd700 1 -- 172.21.15.45:0/2957122993 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fe630052920 con 0x7fe6480ca240 2023-11-28T12:08:35.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.379+0000 7fe64cfff700 1 -- 172.21.15.45:0/2957122993 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe6480d08a0 con 0x7fe6480ca240 2023-11-28T12:08:35.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.379+0000 7fe63effd700 1 -- 172.21.15.45:0/2957122993 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4651 (secure 0 0 0) 0x7fe630022070 con 0x7fe6480ca240 2023-11-28T12:08:35.380 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:08:35.381 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5398,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6836/2532875180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":2532875180},{"type":"v1","addr":"172.21.15.152:6836","nonce":2532875180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5404,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/930111917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6835","nonce":930111917},{"type":"v1","addr":"172.21.15.152:6837","nonce":930111917}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5547,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/1974473454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1974473454},{"type":"v1","addr":"172.21.15.45:6834","nonce":1974473454}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T12:08:31.391914+0000","modified":"2023-11-28T12:08:34.873102+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5550},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5550":{"gid":5550,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/1281816633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":1281816633},{"type":"v1","addr":"172.21.15.45:6835","nonce":1281816633}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-28T12:08:35.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.381+0000 7fe64cfff700 1 -- 172.21.15.45:0/2957122993 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fe6280682f0 msgr2=0x7fe62806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:35.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.381+0000 7fe64cfff700 1 --2- 172.21.15.45:0/2957122993 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fe6280682f0 0x7fe62806a7a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe638001eb0 tx=0x7fe638001040 comp rx=0 tx=0).stop 2023-11-28T12:08:35.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.381+0000 7fe64cfff700 1 -- 172.21.15.45:0/2957122993 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6480ca240 msgr2=0x7fe6480c8f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:35.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.381+0000 7fe64cfff700 1 --2- 172.21.15.45:0/2957122993 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6480ca240 0x7fe6480c8f40 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fe630011cd0 tx=0x7fe630009ed0 comp rx=0 tx=0).stop 2023-11-28T12:08:35.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.381+0000 7fe64cfff700 1 -- 172.21.15.45:0/2957122993 shutdown_connections 2023-11-28T12:08:35.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.381+0000 7fe64cfff700 1 --2- 172.21.15.45:0/2957122993 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fe6280682f0 0x7fe62806a7a0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:35.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.381+0000 7fe64cfff700 1 --2- 172.21.15.45:0/2957122993 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe634004d90 0x7fe64814a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:35.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.381+0000 7fe64cfff700 1 --2- 172.21.15.45:0/2957122993 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe64814ada0 0x7fe64815a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:35.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.381+0000 7fe64cfff700 1 --2- 172.21.15.45:0/2957122993 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6480ca240 0x7fe6480c8f40 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:35.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.381+0000 7fe64cfff700 1 -- 172.21.15.45:0/2957122993 >> 172.21.15.45:0/2957122993 conn(0x7fe648072600 msgr2=0x7fe6480b8010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:35.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.382+0000 7fe64cfff700 1 -- 172.21.15.45:0/2957122993 shutdown_connections 2023-11-28T12:08:35.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.382+0000 7fe64cfff700 1 -- 172.21.15.45:0/2957122993 wait complete. 2023-11-28T12:08:35.385 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 24 2023-11-28T12:08:35.401 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T12:08:35.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.604+0000 7fb9dc3ff700 1 Processor -- start 2023-11-28T12:08:35.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.604+0000 7fb9dc3ff700 1 -- start start 2023-11-28T12:08:35.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.605+0000 7fb9dc3ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb9d40cd7c0 0x7fb9d40cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:35.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.605+0000 7fb9dc3ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9d40d1950 con 0x7fb9d4161340 2023-11-28T12:08:35.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.605+0000 7fb9dc3ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9d40ce140 con 0x7fb9d415c9b0 2023-11-28T12:08:35.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.605+0000 7fb9dc3ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d40b5800 con 0x7fb9d40cd7c0 2023-11-28T12:08:35.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.605+0000 7fb9d999a700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fb9d4161340 0x7fb9d40d1de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:42910/0 (socket says 172.21.15.45:42910) 2023-11-28T12:08:35.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.605+0000 7fb9d999a700 1 -- 172.21.15.45:0/4087712047 learned_addr learned my addr 172.21.15.45:0/4087712047 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:08:35.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.606+0000 7fb9da99c700 1 --2- 172.21.15.45:0/4087712047 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb9d40cd7c0 0x7fb9d40cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:35.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.606+0000 7fb9d9199700 1 -- 172.21.15.45:0/4087712047 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1962957275 0 0) 0x7fb9d40d1950 con 0x7fb9d4161340 2023-11-28T12:08:35.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.606+0000 7fb9d9199700 1 -- 172.21.15.45:0/4087712047 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9c00035b0 con 0x7fb9d4161340 2023-11-28T12:08:35.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.606+0000 7fb9d9199700 1 -- 172.21.15.45:0/4087712047 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1740961638 0 0) 0x7fb9d40ce140 con 0x7fb9d415c9b0 2023-11-28T12:08:35.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.606+0000 7fb9d9199700 1 -- 172.21.15.45:0/4087712047 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9d40d1950 con 0x7fb9d415c9b0 2023-11-28T12:08:35.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.606+0000 7fb9d9199700 1 -- 172.21.15.45:0/4087712047 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 341973203 0 0) 0x7fb9c00035b0 con 0x7fb9d4161340 2023-11-28T12:08:35.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.606+0000 7fb9d9199700 1 -- 172.21.15.45:0/4087712047 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb9d40cd7c0 msgr2=0x7fb9d40cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:35.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.606+0000 7fb9d9199700 1 --2- 172.21.15.45:0/4087712047 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb9d40cd7c0 0x7fb9d40cdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:35.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.606+0000 7fb9d9199700 1 -- 172.21.15.45:0/4087712047 >> v1:172.21.15.152:6789/0 conn(0x7fb9d415c9b0 legacy=0x7fb9d40b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:35.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.606+0000 7fb9d9199700 1 -- 172.21.15.45:0/4087712047 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9d40d24f0 con 0x7fb9d4161340 2023-11-28T12:08:35.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.606+0000 7fb9d9199700 1 -- 172.21.15.45:0/4087712047 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3460218165 0 0) 0x7fb9c4001670 con 0x7fb9d4161340 2023-11-28T12:08:35.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.606+0000 7fb9d9199700 1 -- 172.21.15.45:0/4087712047 >> v1:172.21.15.45:6789/0 conn(0x7fb9d4161340 legacy=0x7fb9d40d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:35.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.606+0000 7fb9d9199700 1 --2- 172.21.15.45:0/4087712047 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb9c0003bc0 0x7fb9c0003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:35.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.606+0000 7fb9d9199700 1 --2- 172.21.15.45:0/4087712047 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb9d40cd7c0 0x7fb9c0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:35.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.606+0000 7fb9d9199700 1 --2- 172.21.15.45:0/4087712047 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb9c0004d90 0x7fb9c0005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:35.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.606+0000 7fb9d9199700 1 -- 172.21.15.45:0/4087712047 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d40b5800 con 0x7fb9c0003bc0 2023-11-28T12:08:35.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.606+0000 7fb9d9199700 1 -- 172.21.15.45:0/4087712047 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c000bb40 con 0x7fb9c0004d90 2023-11-28T12:08:35.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.606+0000 7fb9d9199700 1 -- 172.21.15.45:0/4087712047 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c000bd00 con 0x7fb9d40cd7c0 2023-11-28T12:08:35.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.606+0000 7fb9da19b700 1 --2- 172.21.15.45:0/4087712047 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb9c0003bc0 0x7fb9c0003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:35.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.607+0000 7fb9d999a700 1 --2- 172.21.15.45:0/4087712047 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb9d40cd7c0 0x7fb9c0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:35.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.607+0000 7fb9da99c700 1 --2- 172.21.15.45:0/4087712047 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb9c0004d90 0x7fb9c0005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:35.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.607+0000 7fb9da19b700 1 -- 172.21.15.45:0/4087712047 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb9d40cd7c0 msgr2=0x7fb9c0004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:35.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.607+0000 7fb9da19b700 1 --2- 172.21.15.45:0/4087712047 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb9d40cd7c0 0x7fb9c0004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:35.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.607+0000 7fb9da19b700 1 -- 172.21.15.45:0/4087712047 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb9c0004d90 msgr2=0x7fb9c0005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:35.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.607+0000 7fb9da19b700 1 --2- 172.21.15.45:0/4087712047 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb9c0004d90 0x7fb9c0005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:35.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.607+0000 7fb9da19b700 1 -- 172.21.15.45:0/4087712047 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9c00035b0 con 0x7fb9c0003bc0 2023-11-28T12:08:35.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.607+0000 7fb9da19b700 1 --2- 172.21.15.45:0/4087712047 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb9c0003bc0 0x7fb9c0003fb0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fb9d0001940 tx=0x7fb9c0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=785b44567e5bc834 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:35.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.607+0000 7fb9d9199700 1 -- 172.21.15.45:0/4087712047 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d0001430 con 0x7fb9c0003bc0 2023-11-28T12:08:35.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.607+0000 7fb9d9199700 1 -- 172.21.15.45:0/4087712047 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9d0001d70 con 0x7fb9c0003bc0 2023-11-28T12:08:35.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.607+0000 7fb9d9199700 1 -- 172.21.15.45:0/4087712047 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d0005510 con 0x7fb9c0003bc0 2023-11-28T12:08:35.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.608+0000 7fb9dc3ff700 1 -- 172.21.15.45:0/4087712047 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb9c0003bc0 msgr2=0x7fb9c0003fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:35.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.608+0000 7fb9dc3ff700 1 --2- 172.21.15.45:0/4087712047 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb9c0003bc0 0x7fb9c0003fb0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fb9d0001940 tx=0x7fb9c0005880 comp rx=0 tx=0).stop 2023-11-28T12:08:35.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.608+0000 7fb9da99c700 1 -- 172.21.15.45:0/4087712047 reap_dead start 2023-11-28T12:08:35.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.608+0000 7fb9dc3ff700 1 -- 172.21.15.45:0/4087712047 shutdown_connections 2023-11-28T12:08:35.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.608+0000 7fb9dc3ff700 1 -- 172.21.15.45:0/4087712047 >> 172.21.15.45:0/4087712047 conn(0x7fb9d4072600 msgr2=0x7fb9d40cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:35.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.608+0000 7fb9dc3ff700 1 -- 172.21.15.45:0/4087712047 shutdown_connections 2023-11-28T12:08:35.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.608+0000 7fb9dc3ff700 1 -- 172.21.15.45:0/4087712047 wait complete. 2023-11-28T12:08:35.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.610+0000 7fb9dc3ff700 1 Processor -- start 2023-11-28T12:08:35.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.610+0000 7fb9dc3ff700 1 -- start start 2023-11-28T12:08:35.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.611+0000 7fb9dc3ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb9c0003bc0 0x7fb9d41e6e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:35.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.611+0000 7fb9dc3ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb9d41e69b0 0x7fb9d41575c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:35.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.611+0000 7fb9dc3ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb9d415e350 0x7fb9d415e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:35.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.611+0000 7fb9dc3ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d415ed30 con 0x7fb9c0003bc0 2023-11-28T12:08:35.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.611+0000 7fb9dc3ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d40cc250 con 0x7fb9d415e350 2023-11-28T12:08:35.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.611+0000 7fb9dc3ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d41e7470 con 0x7fb9d41e69b0 2023-11-28T12:08:35.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.611+0000 7fb9da19b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb9c0003bc0 0x7fb9d41e6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:35.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.611+0000 7fb9da19b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb9c0003bc0 0x7fb9d41e6e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59702/0 (socket says 172.21.15.45:59702) 2023-11-28T12:08:35.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.611+0000 7fb9da19b700 1 -- 172.21.15.45:0/339070295 learned_addr learned my addr 172.21.15.45:0/339070295 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:35.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.612+0000 7fb9da19b700 1 -- 172.21.15.45:0/339070295 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb9d41e69b0 msgr2=0x7fb9d41575c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:35.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.612+0000 7fb9da19b700 1 --2- 172.21.15.45:0/339070295 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb9d41e69b0 0x7fb9d41575c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:35.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.612+0000 7fb9da19b700 1 -- 172.21.15.45:0/339070295 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb9d415e350 msgr2=0x7fb9d415e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:35.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.612+0000 7fb9da99c700 1 --2- 172.21.15.45:0/339070295 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb9d415e350 0x7fb9d415e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:35.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.612+0000 7fb9da19b700 1 --2- 172.21.15.45:0/339070295 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb9d415e350 0x7fb9d415e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:35.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.612+0000 7fb9da19b700 1 -- 172.21.15.45:0/339070295 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9d40d1300 con 0x7fb9c0003bc0 2023-11-28T12:08:35.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.612+0000 7fb9da99c700 1 --2- 172.21.15.45:0/339070295 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb9d415e350 0x7fb9d415e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:08:35.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.612+0000 7fb9da19b700 1 --2- 172.21.15.45:0/339070295 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb9c0003bc0 0x7fb9d41e6e90 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fb9c000bb10 tx=0x7fb9d00012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:35.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.612+0000 7fb9caffd700 1 -- 172.21.15.45:0/339070295 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d0006c70 con 0x7fb9c0003bc0 2023-11-28T12:08:35.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.612+0000 7fb9caffd700 1 -- 172.21.15.45:0/339070295 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9d0006dd0 con 0x7fb9c0003bc0 2023-11-28T12:08:35.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.612+0000 7fb9dc3ff700 1 -- 172.21.15.45:0/339070295 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9d40b5520 con 0x7fb9c0003bc0 2023-11-28T12:08:35.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.612+0000 7fb9caffd700 1 -- 172.21.15.45:0/339070295 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d0007260 con 0x7fb9c0003bc0 2023-11-28T12:08:35.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.612+0000 7fb9dc3ff700 1 -- 172.21.15.45:0/339070295 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9d40d15e0 con 0x7fb9c0003bc0 2023-11-28T12:08:35.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.613+0000 7fb9dc3ff700 1 -- 172.21.15.45:0/339070295 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9d40745c0 con 0x7fb9c0003bc0 2023-11-28T12:08:35.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.614+0000 7fb9caffd700 1 -- 172.21.15.45:0/339070295 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fb9d002e070 con 0x7fb9c0003bc0 2023-11-28T12:08:35.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.615+0000 7fb9caffd700 1 --2- 172.21.15.45:0/339070295 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb9b80682f0 0x7fb9b806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:35.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.615+0000 7fb9caffd700 1 -- 172.21.15.45:0/339070295 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb9d0086cb0 con 0x7fb9c0003bc0 2023-11-28T12:08:35.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.616+0000 7fb9d999a700 1 --2- 172.21.15.45:0/339070295 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb9b80682f0 0x7fb9b806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:35.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.616+0000 7fb9d999a700 1 --2- 172.21.15.45:0/339070295 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb9b80682f0 0x7fb9b806a7a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb9d41e6750 tx=0x7fb9c4001140 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:35.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.620+0000 7fb9caffd700 1 -- 172.21.15.45:0/339070295 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fb9d0053420 con 0x7fb9c0003bc0 2023-11-28T12:08:35.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.819+0000 7fb9dc3ff700 1 -- 172.21.15.45:0/339070295 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb9d40d08a0 con 0x7fb9c0003bc0 2023-11-28T12:08:35.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.820+0000 7fb9caffd700 1 -- 172.21.15.45:0/339070295 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+17921 (secure 0 0 0) 0x7fb9d0017090 con 0x7fb9c0003bc0 2023-11-28T12:08:35.821 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:08:35.821 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":47,"fsid":"bd7c37f1-f7c6-4778-b845-52cf2aa6e366","created":"2023-11-28T12:06:09.045075+0000","modified":"2023-11-28T12:08:32.394210+0000","last_up_change":"2023-11-28T12:06:21.282227+0000","last_in_change":"2023-11-28T12:06:12.560924+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T12:06:21.807108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T12:06:22.491009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-11-28T12:08:29.364957+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-11-28T12:08:30.374968+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d0cdd8a-87fd-4f2c-91bd-47bdfa661905","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":115843},{"type":"v1","addr":"172.21.15.45:6808","nonce":115843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":115843},{"type":"v1","addr":"172.21.15.45:6811","nonce":115843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":115843},{"type":"v1","addr":"172.21.15.45:6815","nonce":115843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":115843},{"type":"v1","addr":"172.21.15.45:6813","nonce":115843}]},"public_addr":"172.21.15.45:6808/115843","cluster_addr":"172.21.15.45:6811/115843","heartbeat_back_addr":"172.21.15.45:6815/115843","heartbeat_front_addr":"172.21.15.45:6813/115843","state":["exists","up"]},{"osd":1,"uuid":"c5de4ebd-9ec5-40b3-9caa-9b706fab4c76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":115842},{"type":"v1","addr":"172.21.15.45:6801","nonce":115842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":115842},{"type":"v1","addr":"172.21.15.45:6803","nonce":115842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6807","nonce":115842},{"type":"v1","addr":"172.21.15.45:6809","nonce":115842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":115842},{"type":"v1","addr":"172.21.15.45:6805","nonce":115842}]},"public_addr":"172.21.15.45:6801/115842","cluster_addr":"172.21.15.45:6803/115842","heartbeat_back_addr":"172.21.15.45:6809/115842","heartbeat_front_addr":"172.21.15.45:6805/115842","state":["exists","up"]},{"osd":2,"uuid":"9f4b36b2-65d2-40e7-9fe6-a2991afa71c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":115850},{"type":"v1","addr":"172.21.15.45:6819","nonce":115850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":115850},{"type":"v1","addr":"172.21.15.45:6823","nonce":115850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":115850},{"type":"v1","addr":"172.21.15.45:6831","nonce":115850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":115850},{"type":"v1","addr":"172.21.15.45:6828","nonce":115850}]},"public_addr":"172.21.15.45:6819/115850","cluster_addr":"172.21.15.45:6823/115850","heartbeat_back_addr":"172.21.15.45:6831/115850","heartbeat_front_addr":"172.21.15.45:6828/115850","state":["exists","up"]},{"osd":3,"uuid":"6fe7ef05-4e0d-426c-bf94-44b51d4d550b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":115848},{"type":"v1","addr":"172.21.15.45:6818","nonce":115848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":115848},{"type":"v1","addr":"172.21.15.45:6822","nonce":115848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6827","nonce":115848},{"type":"v1","addr":"172.21.15.45:6829","nonce":115848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":115848},{"type":"v1","addr":"172.21.15.45:6825","nonce":115848}]},"public_addr":"172.21.15.45:6818/115848","cluster_addr":"172.21.15.45:6822/115848","heartbeat_back_addr":"172.21.15.45:6829/115848","heartbeat_front_addr":"172.21.15.45:6825/115848","state":["exists","up"]},{"osd":4,"uuid":"fa403c08-d8a1-4a3a-8384-cb465c1a654c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":116092},{"type":"v1","addr":"172.21.15.152:6801","nonce":116092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":116092},{"type":"v1","addr":"172.21.15.152:6803","nonce":116092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":116092},{"type":"v1","addr":"172.21.15.152:6807","nonce":116092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":116092},{"type":"v1","addr":"172.21.15.152:6805","nonce":116092}]},"public_addr":"172.21.15.152:6801/116092","cluster_addr":"172.21.15.152:6803/116092","heartbeat_back_addr":"172.21.15.152:6807/116092","heartbeat_front_addr":"172.21.15.152:6805/116092","state":["exists","up"]},{"osd":5,"uuid":"399fc450-39fa-43a6-bf80-0b8bcb41bd95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6815","nonce":116093},{"type":"v1","addr":"172.21.15.152:6817","nonce":116093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":116093},{"type":"v1","addr":"172.21.15.152:6819","nonce":116093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":116093},{"type":"v1","addr":"172.21.15.152:6823","nonce":116093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":116093},{"type":"v1","addr":"172.21.15.152:6821","nonce":116093}]},"public_addr":"172.21.15.152:6817/116093","cluster_addr":"172.21.15.152:6819/116093","heartbeat_back_addr":"172.21.15.152:6823/116093","heartbeat_front_addr":"172.21.15.152:6821/116093","state":["exists","up"]},{"osd":6,"uuid":"e59a4017-2d23-4627-836b-e25b2d3ddaaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":116094},{"type":"v1","addr":"172.21.15.152:6809","nonce":116094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":116094},{"type":"v1","addr":"172.21.15.152:6811","nonce":116094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":116094},{"type":"v1","addr":"172.21.15.152:6816","nonce":116094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":116094},{"type":"v1","addr":"172.21.15.152:6813","nonce":116094}]},"public_addr":"172.21.15.152:6809/116094","cluster_addr":"172.21.15.152:6811/116094","heartbeat_back_addr":"172.21.15.152:6816/116094","heartbeat_front_addr":"172.21.15.152:6813/116094","state":["exists","up"]},{"osd":7,"uuid":"8d7f9d4b-bf08-4670-8591-388c0f012a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":116097},{"type":"v1","addr":"172.21.15.152:6825","nonce":116097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":116097},{"type":"v1","addr":"172.21.15.152:6827","nonce":116097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":116097},{"type":"v1","addr":"172.21.15.152:6831","nonce":116097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":116097},{"type":"v1","addr":"172.21.15.152:6829","nonce":116097}]},"public_addr":"172.21.15.152:6825/116097","cluster_addr":"172.21.15.152:6827/116097","heartbeat_back_addr":"172.21.15.152:6831/116097","heartbeat_front_addr":"172.21.15.152:6829/116097","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.937710+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.865423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.159434+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.913090+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.131647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.966255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.972583+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.177209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T12:08:35.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.822+0000 7fb9dc3ff700 1 -- 172.21.15.45:0/339070295 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb9b80682f0 msgr2=0x7fb9b806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:35.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.822+0000 7fb9dc3ff700 1 --2- 172.21.15.45:0/339070295 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb9b80682f0 0x7fb9b806a7a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb9d41e6750 tx=0x7fb9c4001140 comp rx=0 tx=0).stop 2023-11-28T12:08:35.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.822+0000 7fb9dc3ff700 1 -- 172.21.15.45:0/339070295 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb9c0003bc0 msgr2=0x7fb9d41e6e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:35.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.822+0000 7fb9dc3ff700 1 --2- 172.21.15.45:0/339070295 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb9c0003bc0 0x7fb9d41e6e90 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fb9c000bb10 tx=0x7fb9d00012d0 comp rx=0 tx=0).stop 2023-11-28T12:08:35.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.822+0000 7fb9dc3ff700 1 -- 172.21.15.45:0/339070295 shutdown_connections 2023-11-28T12:08:35.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.822+0000 7fb9dc3ff700 1 --2- 172.21.15.45:0/339070295 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb9b80682f0 0x7fb9b806a7a0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:35.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.822+0000 7fb9dc3ff700 1 --2- 172.21.15.45:0/339070295 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb9d415e350 0x7fb9d415e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:35.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.822+0000 7fb9dc3ff700 1 --2- 172.21.15.45:0/339070295 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb9c0003bc0 0x7fb9d41e6e90 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:35.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.822+0000 7fb9dc3ff700 1 --2- 172.21.15.45:0/339070295 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb9d41e69b0 0x7fb9d41575c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:35.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.822+0000 7fb9dc3ff700 1 -- 172.21.15.45:0/339070295 >> 172.21.15.45:0/339070295 conn(0x7fb9d4072600 msgr2=0x7fb9d40b82c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:35.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.823+0000 7fb9dc3ff700 1 -- 172.21.15.45:0/339070295 shutdown_connections 2023-11-28T12:08:35.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:35.823+0000 7fb9dc3ff700 1 -- 172.21.15.45:0/339070295 wait complete. 2023-11-28T12:08:35.842 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-28T12:08:35.842 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T12:08:36.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.048+0000 7f37a3fff700 1 Processor -- start 2023-11-28T12:08:36.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.048+0000 7f37a3fff700 1 -- start start 2023-11-28T12:08:36.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.049+0000 7f37a3fff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f379c15c9b0 0x7f379c0b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:36.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.049+0000 7f37a3fff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f379c161340 0x7f379c0d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:36.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.049+0000 7f37a3fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f379c0d2320 0x7f379c0cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:36.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.049+0000 7f37a3fff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f379c0b5800 con 0x7f379c0d2320 2023-11-28T12:08:36.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.049+0000 7f37a3fff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f379c0d1950 con 0x7f379c161340 2023-11-28T12:08:36.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.049+0000 7f37a3fff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f379c0b5520 con 0x7f379c15c9b0 2023-11-28T12:08:36.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.050+0000 7f37a259c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f379c0d2320 0x7f379c0cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:36.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.050+0000 7f37a259c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f379c0d2320 0x7f379c0cd7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59710/0 (socket says 172.21.15.45:59710) 2023-11-28T12:08:36.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.050+0000 7f37a259c700 1 -- 172.21.15.45:0/2718895325 learned_addr learned my addr 172.21.15.45:0/2718895325 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:36.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.050+0000 7f37a159a700 1 --2- 172.21.15.45:0/2718895325 >> v2:172.21.15.152:3300/0 conn(0x7f379c161340 0x7f379c0d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:36.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.050+0000 7f37a1d9b700 1 --2- 172.21.15.45:0/2718895325 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f379c15c9b0 0x7f379c0b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:36.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.050+0000 7f37a259c700 1 -- 172.21.15.45:0/2718895325 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f379c15c9b0 msgr2=0x7f379c0b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:36.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.050+0000 7f37a259c700 1 --2- 172.21.15.45:0/2718895325 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f379c15c9b0 0x7f379c0b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:36.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.050+0000 7f37a259c700 1 -- 172.21.15.45:0/2718895325 >> v2:172.21.15.152:3300/0 conn(0x7f379c161340 msgr2=0x7f379c0d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:36.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.050+0000 7f37a259c700 1 --2- 172.21.15.45:0/2718895325 >> v2:172.21.15.152:3300/0 conn(0x7f379c161340 0x7f379c0d1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:36.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.050+0000 7f37a259c700 1 -- 172.21.15.45:0/2718895325 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f379c0d1300 con 0x7f379c0d2320 2023-11-28T12:08:36.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.050+0000 7f37a259c700 1 --2- 172.21.15.45:0/2718895325 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f379c0d2320 0x7f379c0cd7c0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f379c06bc00 tx=0x7f3794009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6636d3801a155417 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:36.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.051+0000 7f37a0d99700 1 -- 172.21.15.45:0/2718895325 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f379400b870 con 0x7f379c0d2320 2023-11-28T12:08:36.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.051+0000 7f37a0d99700 1 -- 172.21.15.45:0/2718895325 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f379400b9d0 con 0x7f379c0d2320 2023-11-28T12:08:36.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.051+0000 7f37a0d99700 1 -- 172.21.15.45:0/2718895325 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f379400bd60 con 0x7f379c0d2320 2023-11-28T12:08:36.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.051+0000 7f37a3fff700 1 -- 172.21.15.45:0/2718895325 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f379c0d2320 msgr2=0x7f379c0cd7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:36.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.051+0000 7f37a3fff700 1 --2- 172.21.15.45:0/2718895325 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f379c0d2320 0x7f379c0cd7c0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f379c06bc00 tx=0x7f3794009bd0 comp rx=0 tx=0).stop 2023-11-28T12:08:36.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.051+0000 7f37a3fff700 1 -- 172.21.15.45:0/2718895325 shutdown_connections 2023-11-28T12:08:36.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.051+0000 7f37a3fff700 1 --2- 172.21.15.45:0/2718895325 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f379c15c9b0 0x7f379c0b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:36.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.051+0000 7f37a3fff700 1 --2- 172.21.15.45:0/2718895325 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f379c0d2320 0x7f379c0cd7c0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:36.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.051+0000 7f37a3fff700 1 --2- 172.21.15.45:0/2718895325 >> v2:172.21.15.152:3300/0 conn(0x7f379c161340 0x7f379c0d1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:36.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.051+0000 7f37a3fff700 1 -- 172.21.15.45:0/2718895325 >> 172.21.15.45:0/2718895325 conn(0x7f379c072600 msgr2=0x7f379c0cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:36.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.051+0000 7f37a3fff700 1 -- 172.21.15.45:0/2718895325 shutdown_connections 2023-11-28T12:08:36.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.052+0000 7f37a3fff700 1 -- 172.21.15.45:0/2718895325 wait complete. 2023-11-28T12:08:36.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.053+0000 7f37a3fff700 1 Processor -- start 2023-11-28T12:08:36.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.053+0000 7f37a3fff700 1 -- start start 2023-11-28T12:08:36.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.054+0000 7f37a3fff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f379c0d2320 0x7f379c150800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:36.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.054+0000 7f37a3fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f379c15c9b0 0x7f379c153eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:36.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.054+0000 7f37a3fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f379c161340 0x7f379c15a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:36.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.054+0000 7f37a3fff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f379c0c8b30 con 0x7f379c161340 2023-11-28T12:08:36.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.054+0000 7f37a3fff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f379c0c8220 con 0x7f379c15c9b0 2023-11-28T12:08:36.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.054+0000 7f37a3fff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f379c150d40 con 0x7f379c0d2320 2023-11-28T12:08:36.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.054+0000 7f37a259c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f379c161340 0x7f379c15a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:36.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.055+0000 7f37a259c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f379c161340 0x7f379c15a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59724/0 (socket says 172.21.15.45:59724) 2023-11-28T12:08:36.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.055+0000 7f37a259c700 1 -- 172.21.15.45:0/3232266466 learned_addr learned my addr 172.21.15.45:0/3232266466 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:36.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.055+0000 7f37a159a700 1 --2- 172.21.15.45:0/3232266466 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f379c15c9b0 0x7f379c153eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:36.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.055+0000 7f37a1d9b700 1 --2- 172.21.15.45:0/3232266466 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f379c0d2320 0x7f379c150800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:36.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.055+0000 7f37a259c700 1 -- 172.21.15.45:0/3232266466 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f379c0d2320 msgr2=0x7f379c150800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:36.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.055+0000 7f37a259c700 1 --2- 172.21.15.45:0/3232266466 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f379c0d2320 0x7f379c150800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:36.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.055+0000 7f37a259c700 1 -- 172.21.15.45:0/3232266466 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f379c15c9b0 msgr2=0x7f379c153eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:36.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.055+0000 7f37a259c700 1 --2- 172.21.15.45:0/3232266466 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f379c15c9b0 0x7f379c153eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:36.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.055+0000 7f37a259c700 1 -- 172.21.15.45:0/3232266466 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3794009550 con 0x7f379c161340 2023-11-28T12:08:36.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.055+0000 7f37a1d9b700 1 --2- 172.21.15.45:0/3232266466 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f379c0d2320 0x7f379c150800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:08:36.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.055+0000 7f37a259c700 1 --2- 172.21.15.45:0/3232266466 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f379c161340 0x7f379c15a660 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f3794009c10 tx=0x7f3794004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:36.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.056+0000 7f37927fc700 1 -- 172.21.15.45:0/3232266466 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3794004310 con 0x7f379c161340 2023-11-28T12:08:36.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.056+0000 7f37927fc700 1 -- 172.21.15.45:0/3232266466 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f379401e070 con 0x7f379c161340 2023-11-28T12:08:36.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.056+0000 7f37a3fff700 1 -- 172.21.15.45:0/3232266466 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f379c0b5130 con 0x7f379c161340 2023-11-28T12:08:36.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.056+0000 7f37927fc700 1 -- 172.21.15.45:0/3232266466 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37940036a0 con 0x7f379c161340 2023-11-28T12:08:36.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.056+0000 7f37a3fff700 1 -- 172.21.15.45:0/3232266466 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f379c0d15e0 con 0x7f379c161340 2023-11-28T12:08:36.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.057+0000 7f37a3fff700 1 -- 172.21.15.45:0/3232266466 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f379c0b52c0 con 0x7f379c161340 2023-11-28T12:08:36.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.058+0000 7f37927fc700 1 -- 172.21.15.45:0/3232266466 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f3794029020 con 0x7f379c161340 2023-11-28T12:08:36.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.059+0000 7f37927fc700 1 --2- 172.21.15.45:0/3232266466 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f37800682f0 0x7f378006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:36.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.059+0000 7f37927fc700 1 -- 172.21.15.45:0/3232266466 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3794086df0 con 0x7f379c161340 2023-11-28T12:08:36.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.059+0000 7f37a1d9b700 1 --2- 172.21.15.45:0/3232266466 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f37800682f0 0x7f378006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:36.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.060+0000 7f37a1d9b700 1 --2- 172.21.15.45:0/3232266466 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f37800682f0 0x7f378006a7a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f3798009b20 tx=0x7f3798003a60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:36.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.063+0000 7f37927fc700 1 -- 172.21.15.45:0/3232266466 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f3794053560 con 0x7f379c161340 2023-11-28T12:08:36.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.264+0000 7f37a3fff700 1 -- 172.21.15.45:0/3232266466 --> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f379c0672b0 con 0x7f37800682f0 2023-11-28T12:08:36.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.274+0000 7f37927fc700 1 -- 172.21.15.45:0/3232266466 <== mgr.4100 v2:172.21.15.152:6832/115389 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311074 (secure 0 0 0) 0x7f379c0672b0 con 0x7f37800682f0 2023-11-28T12:08:36.279 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:08:36.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.279+0000 7f37a3fff700 1 -- 172.21.15.45:0/3232266466 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f37800682f0 msgr2=0x7f378006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:36.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.279+0000 7f37a3fff700 1 --2- 172.21.15.45:0/3232266466 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f37800682f0 0x7f378006a7a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f3798009b20 tx=0x7f3798003a60 comp rx=0 tx=0).stop 2023-11-28T12:08:36.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.279+0000 7f37a3fff700 1 -- 172.21.15.45:0/3232266466 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f379c161340 msgr2=0x7f379c15a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:36.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.279+0000 7f37a3fff700 1 --2- 172.21.15.45:0/3232266466 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f379c161340 0x7f379c15a660 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f3794009c10 tx=0x7f3794004750 comp rx=0 tx=0).stop 2023-11-28T12:08:36.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.279+0000 7f37a3fff700 1 -- 172.21.15.45:0/3232266466 shutdown_connections 2023-11-28T12:08:36.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.279+0000 7f37a3fff700 1 --2- 172.21.15.45:0/3232266466 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f37800682f0 0x7f378006a7a0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:36.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.279+0000 7f37a3fff700 1 --2- 172.21.15.45:0/3232266466 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f379c161340 0x7f379c15a660 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:36.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.279+0000 7f37a3fff700 1 --2- 172.21.15.45:0/3232266466 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f379c0d2320 0x7f379c150800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:36.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.279+0000 7f37a3fff700 1 --2- 172.21.15.45:0/3232266466 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f379c15c9b0 0x7f379c153eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:36.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.279+0000 7f37a3fff700 1 -- 172.21.15.45:0/3232266466 >> 172.21.15.45:0/3232266466 conn(0x7f379c072600 msgr2=0x7f379c15d000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:36.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.279+0000 7f37a3fff700 1 -- 172.21.15.45:0/3232266466 shutdown_connections 2023-11-28T12:08:36.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.279+0000 7f37a3fff700 1 -- 172.21.15.45:0/3232266466 wait complete. 2023-11-28T12:08:36.283 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-11-28T12:08:36.298 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":107,"stamp":"2023-11-28T12:08:34.456112+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":30,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":89096,"kb_used_data":5256,"kb_used_omap":0,"kb_used_meta":83776,"kb_avail":754885624,"statfs":{"total":773094113280,"available":773002878976,"internally_reserved":0,"allocated":5382144,"data_stored":2969942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":85786624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.593554"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.416963+0000","last_change":"2023-11-28T12:08:31.411889+0000","last_active":"2023-11-28T12:08:31.416963+0000","last_peered":"2023-11-28T12:08:31.416963+0000","last_clean":"2023-11-28T12:08:31.416963+0000","last_became_active":"2023-11-28T12:08:31.411637+0000","last_became_peered":"2023-11-28T12:08:31.411637+0000","last_unstale":"2023-11-28T12:08:31.416963+0000","last_undegraded":"2023-11-28T12:08:31.416963+0000","last_fullsized":"2023-11-28T12:08:31.416963+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:40:54.842854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.419854+0000","last_change":"2023-11-28T12:08:31.415154+0000","last_active":"2023-11-28T12:08:31.419854+0000","last_peered":"2023-11-28T12:08:31.419854+0000","last_clean":"2023-11-28T12:08:31.419854+0000","last_became_active":"2023-11-28T12:08:31.414223+0000","last_became_peered":"2023-11-28T12:08:31.414223+0000","last_unstale":"2023-11-28T12:08:31.419854+0000","last_undegraded":"2023-11-28T12:08:31.419854+0000","last_fullsized":"2023-11-28T12:08:31.419854+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:52:43.776270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.436209+0000","last_change":"2023-11-28T12:08:31.426400+0000","last_active":"2023-11-28T12:08:31.436209+0000","last_peered":"2023-11-28T12:08:31.436209+0000","last_clean":"2023-11-28T12:08:31.436209+0000","last_became_active":"2023-11-28T12:08:31.425927+0000","last_became_peered":"2023-11-28T12:08:31.425927+0000","last_unstale":"2023-11-28T12:08:31.436209+0000","last_undegraded":"2023-11-28T12:08:31.436209+0000","last_fullsized":"2023-11-28T12:08:31.436209+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:41:50.583641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.432526+0000","last_change":"2023-11-28T12:08:31.427419+0000","last_active":"2023-11-28T12:08:31.432526+0000","last_peered":"2023-11-28T12:08:31.432526+0000","last_clean":"2023-11-28T12:08:31.432526+0000","last_became_active":"2023-11-28T12:08:31.427030+0000","last_became_peered":"2023-11-28T12:08:31.427030+0000","last_unstale":"2023-11-28T12:08:31.432526+0000","last_undegraded":"2023-11-28T12:08:31.432526+0000","last_fullsized":"2023-11-28T12:08:31.432526+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:48:30.989278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.422560+0000","last_change":"2023-11-28T12:08:31.414532+0000","last_active":"2023-11-28T12:08:31.422560+0000","last_peered":"2023-11-28T12:08:31.422560+0000","last_clean":"2023-11-28T12:08:31.422560+0000","last_became_active":"2023-11-28T12:08:31.414241+0000","last_became_peered":"2023-11-28T12:08:31.414241+0000","last_unstale":"2023-11-28T12:08:31.422560+0000","last_undegraded":"2023-11-28T12:08:31.422560+0000","last_fullsized":"2023-11-28T12:08:31.422560+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:25:20.920288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.418958+0000","last_change":"2023-11-28T12:08:31.416815+0000","last_active":"2023-11-28T12:08:31.418958+0000","last_peered":"2023-11-28T12:08:31.418958+0000","last_clean":"2023-11-28T12:08:31.418958+0000","last_became_active":"2023-11-28T12:08:31.415898+0000","last_became_peered":"2023-11-28T12:08:31.415898+0000","last_unstale":"2023-11-28T12:08:31.418958+0000","last_undegraded":"2023-11-28T12:08:31.418958+0000","last_fullsized":"2023-11-28T12:08:31.418958+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:53:19.332201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.435649+0000","last_change":"2023-11-28T12:08:31.422584+0000","last_active":"2023-11-28T12:08:31.435649+0000","last_peered":"2023-11-28T12:08:31.435649+0000","last_clean":"2023-11-28T12:08:31.435649+0000","last_became_active":"2023-11-28T12:08:31.422330+0000","last_became_peered":"2023-11-28T12:08:31.422330+0000","last_unstale":"2023-11-28T12:08:31.435649+0000","last_undegraded":"2023-11-28T12:08:31.435649+0000","last_fullsized":"2023-11-28T12:08:31.435649+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:15:00.988809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.426129+0000","last_change":"2023-11-28T12:08:31.418496+0000","last_active":"2023-11-28T12:08:31.426129+0000","last_peered":"2023-11-28T12:08:31.426129+0000","last_clean":"2023-11-28T12:08:31.426129+0000","last_became_active":"2023-11-28T12:08:31.418174+0000","last_became_peered":"2023-11-28T12:08:31.418174+0000","last_unstale":"2023-11-28T12:08:31.426129+0000","last_undegraded":"2023-11-28T12:08:31.426129+0000","last_fullsized":"2023-11-28T12:08:31.426129+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:36:46.042850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.432231+0000","last_change":"2023-11-28T12:08:31.428730+0000","last_active":"2023-11-28T12:08:31.432231+0000","last_peered":"2023-11-28T12:08:31.432231+0000","last_clean":"2023-11-28T12:08:31.432231+0000","last_became_active":"2023-11-28T12:08:31.428461+0000","last_became_peered":"2023-11-28T12:08:31.428461+0000","last_unstale":"2023-11-28T12:08:31.432231+0000","last_undegraded":"2023-11-28T12:08:31.432231+0000","last_fullsized":"2023-11-28T12:08:31.432231+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:46:20.961979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.423205+0000","last_change":"2023-11-28T12:08:31.421320+0000","last_active":"2023-11-28T12:08:31.423205+0000","last_peered":"2023-11-28T12:08:31.423205+0000","last_clean":"2023-11-28T12:08:31.423205+0000","last_became_active":"2023-11-28T12:08:31.421064+0000","last_became_peered":"2023-11-28T12:08:31.421064+0000","last_unstale":"2023-11-28T12:08:31.423205+0000","last_undegraded":"2023-11-28T12:08:31.423205+0000","last_fullsized":"2023-11-28T12:08:31.423205+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:26:21.456316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.422469+0000","last_change":"2023-11-28T12:08:31.420016+0000","last_active":"2023-11-28T12:08:31.422469+0000","last_peered":"2023-11-28T12:08:31.422469+0000","last_clean":"2023-11-28T12:08:31.422469+0000","last_became_active":"2023-11-28T12:08:31.419491+0000","last_became_peered":"2023-11-28T12:08:31.419491+0000","last_unstale":"2023-11-28T12:08:31.422469+0000","last_undegraded":"2023-11-28T12:08:31.422469+0000","last_fullsized":"2023-11-28T12:08:31.422469+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:38:24.187496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.431303+0000","last_change":"2023-11-28T12:08:31.428012+0000","last_active":"2023-11-28T12:08:31.431303+0000","last_peered":"2023-11-28T12:08:31.431303+0000","last_clean":"2023-11-28T12:08:31.431303+0000","last_became_active":"2023-11-28T12:08:31.424940+0000","last_became_peered":"2023-11-28T12:08:31.424940+0000","last_unstale":"2023-11-28T12:08:31.431303+0000","last_undegraded":"2023-11-28T12:08:31.431303+0000","last_fullsized":"2023-11-28T12:08:31.431303+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:47:24.478600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.427510+0000","last_change":"2023-11-28T12:08:31.424025+0000","last_active":"2023-11-28T12:08:31.427510+0000","last_peered":"2023-11-28T12:08:31.427510+0000","last_clean":"2023-11-28T12:08:31.427510+0000","last_became_active":"2023-11-28T12:08:31.423749+0000","last_became_peered":"2023-11-28T12:08:31.423749+0000","last_unstale":"2023-11-28T12:08:31.427510+0000","last_undegraded":"2023-11-28T12:08:31.427510+0000","last_fullsized":"2023-11-28T12:08:31.427510+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:35:36.691841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.428241+0000","last_change":"2023-11-28T12:08:31.417955+0000","last_active":"2023-11-28T12:08:31.428241+0000","last_peered":"2023-11-28T12:08:31.428241+0000","last_clean":"2023-11-28T12:08:31.428241+0000","last_became_active":"2023-11-28T12:08:31.417577+0000","last_became_peered":"2023-11-28T12:08:31.417577+0000","last_unstale":"2023-11-28T12:08:31.428241+0000","last_undegraded":"2023-11-28T12:08:31.428241+0000","last_fullsized":"2023-11-28T12:08:31.428241+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:45:26.304856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.412479+0000","last_change":"2023-11-28T12:08:31.407807+0000","last_active":"2023-11-28T12:08:31.412479+0000","last_peered":"2023-11-28T12:08:31.412479+0000","last_clean":"2023-11-28T12:08:31.412479+0000","last_became_active":"2023-11-28T12:08:31.406313+0000","last_became_peered":"2023-11-28T12:08:31.406313+0000","last_unstale":"2023-11-28T12:08:31.412479+0000","last_undegraded":"2023-11-28T12:08:31.412479+0000","last_fullsized":"2023-11-28T12:08:31.412479+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:49:15.864164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.419820+0000","last_change":"2023-11-28T12:08:31.419119+0000","last_active":"2023-11-28T12:08:31.419820+0000","last_peered":"2023-11-28T12:08:31.419820+0000","last_clean":"2023-11-28T12:08:31.419820+0000","last_became_active":"2023-11-28T12:08:31.418680+0000","last_became_peered":"2023-11-28T12:08:31.418680+0000","last_unstale":"2023-11-28T12:08:31.419820+0000","last_undegraded":"2023-11-28T12:08:31.419820+0000","last_fullsized":"2023-11-28T12:08:31.419820+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:36:07.372204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.435591+0000","last_change":"2023-11-28T12:08:31.422062+0000","last_active":"2023-11-28T12:08:31.435591+0000","last_peered":"2023-11-28T12:08:31.435591+0000","last_clean":"2023-11-28T12:08:31.435591+0000","last_became_active":"2023-11-28T12:08:31.421620+0000","last_became_peered":"2023-11-28T12:08:31.421620+0000","last_unstale":"2023-11-28T12:08:31.435591+0000","last_undegraded":"2023-11-28T12:08:31.435591+0000","last_fullsized":"2023-11-28T12:08:31.435591+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:51:41.950131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.419874+0000","last_change":"2023-11-28T12:08:31.415406+0000","last_active":"2023-11-28T12:08:31.419874+0000","last_peered":"2023-11-28T12:08:31.419874+0000","last_clean":"2023-11-28T12:08:31.419874+0000","last_became_active":"2023-11-28T12:08:31.414772+0000","last_became_peered":"2023-11-28T12:08:31.414772+0000","last_unstale":"2023-11-28T12:08:31.419874+0000","last_undegraded":"2023-11-28T12:08:31.419874+0000","last_fullsized":"2023-11-28T12:08:31.419874+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:53:27.068927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.436192+0000","last_change":"2023-11-28T12:08:31.426200+0000","last_active":"2023-11-28T12:08:31.436192+0000","last_peered":"2023-11-28T12:08:31.436192+0000","last_clean":"2023-11-28T12:08:31.436192+0000","last_became_active":"2023-11-28T12:08:31.425600+0000","last_became_peered":"2023-11-28T12:08:31.425600+0000","last_unstale":"2023-11-28T12:08:31.436192+0000","last_undegraded":"2023-11-28T12:08:31.436192+0000","last_fullsized":"2023-11-28T12:08:31.436192+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:47:24.969667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.420281+0000","last_change":"2023-11-28T12:08:31.412577+0000","last_active":"2023-11-28T12:08:31.420281+0000","last_peered":"2023-11-28T12:08:31.420281+0000","last_clean":"2023-11-28T12:08:31.420281+0000","last_became_active":"2023-11-28T12:08:31.412298+0000","last_became_peered":"2023-11-28T12:08:31.412298+0000","last_unstale":"2023-11-28T12:08:31.420281+0000","last_undegraded":"2023-11-28T12:08:31.420281+0000","last_fullsized":"2023-11-28T12:08:31.420281+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:17:04.004236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.419978+0000","last_change":"2023-11-28T12:08:31.409775+0000","last_active":"2023-11-28T12:08:31.419978+0000","last_peered":"2023-11-28T12:08:31.419978+0000","last_clean":"2023-11-28T12:08:31.419978+0000","last_became_active":"2023-11-28T12:08:31.409467+0000","last_became_peered":"2023-11-28T12:08:31.409467+0000","last_unstale":"2023-11-28T12:08:31.419978+0000","last_undegraded":"2023-11-28T12:08:31.419978+0000","last_fullsized":"2023-11-28T12:08:31.419978+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:40:40.363195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.431194+0000","last_change":"2023-11-28T12:08:31.427447+0000","last_active":"2023-11-28T12:08:31.431194+0000","last_peered":"2023-11-28T12:08:31.431194+0000","last_clean":"2023-11-28T12:08:31.431194+0000","last_became_active":"2023-11-28T12:08:31.426911+0000","last_became_peered":"2023-11-28T12:08:31.426911+0000","last_unstale":"2023-11-28T12:08:31.431194+0000","last_undegraded":"2023-11-28T12:08:31.431194+0000","last_fullsized":"2023-11-28T12:08:31.431194+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:51:57.572624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.428376+0000","last_change":"2023-11-28T12:08:31.414257+0000","last_active":"2023-11-28T12:08:31.428376+0000","last_peered":"2023-11-28T12:08:31.428376+0000","last_clean":"2023-11-28T12:08:31.428376+0000","last_became_active":"2023-11-28T12:08:31.413965+0000","last_became_peered":"2023-11-28T12:08:31.413965+0000","last_unstale":"2023-11-28T12:08:31.428376+0000","last_undegraded":"2023-11-28T12:08:31.428376+0000","last_fullsized":"2023-11-28T12:08:31.428376+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:39:07.341993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.427134+0000","last_change":"2023-11-28T12:08:31.419380+0000","last_active":"2023-11-28T12:08:31.427134+0000","last_peered":"2023-11-28T12:08:31.427134+0000","last_clean":"2023-11-28T12:08:31.427134+0000","last_became_active":"2023-11-28T12:08:31.418301+0000","last_became_peered":"2023-11-28T12:08:31.418301+0000","last_unstale":"2023-11-28T12:08:31.427134+0000","last_undegraded":"2023-11-28T12:08:31.427134+0000","last_fullsized":"2023-11-28T12:08:31.427134+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:36:46.042850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.436899+0000","last_change":"2023-11-28T12:08:31.434974+0000","last_active":"2023-11-28T12:08:31.436899+0000","last_peered":"2023-11-28T12:08:31.436899+0000","last_clean":"2023-11-28T12:08:31.436899+0000","last_became_active":"2023-11-28T12:08:31.434757+0000","last_became_peered":"2023-11-28T12:08:31.434757+0000","last_unstale":"2023-11-28T12:08:31.436899+0000","last_undegraded":"2023-11-28T12:08:31.436899+0000","last_fullsized":"2023-11-28T12:08:31.436899+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:33:18.485327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.432329+0000","last_change":"2023-11-28T12:08:31.429685+0000","last_active":"2023-11-28T12:08:31.432329+0000","last_peered":"2023-11-28T12:08:31.432329+0000","last_clean":"2023-11-28T12:08:31.432329+0000","last_became_active":"2023-11-28T12:08:31.429391+0000","last_became_peered":"2023-11-28T12:08:31.429391+0000","last_unstale":"2023-11-28T12:08:31.432329+0000","last_undegraded":"2023-11-28T12:08:31.432329+0000","last_fullsized":"2023-11-28T12:08:31.432329+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:46:19.524019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.434341+0000","last_change":"2023-11-28T12:08:31.432889+0000","last_active":"2023-11-28T12:08:31.434341+0000","last_peered":"2023-11-28T12:08:31.434341+0000","last_clean":"2023-11-28T12:08:31.434341+0000","last_became_active":"2023-11-28T12:08:31.432588+0000","last_became_peered":"2023-11-28T12:08:31.432588+0000","last_unstale":"2023-11-28T12:08:31.434341+0000","last_undegraded":"2023-11-28T12:08:31.434341+0000","last_fullsized":"2023-11-28T12:08:31.434341+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:48:58.460869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.421053+0000","last_change":"2023-11-28T12:08:31.417348+0000","last_active":"2023-11-28T12:08:31.421053+0000","last_peered":"2023-11-28T12:08:31.421053+0000","last_clean":"2023-11-28T12:08:31.421053+0000","last_became_active":"2023-11-28T12:08:31.417043+0000","last_became_peered":"2023-11-28T12:08:31.417043+0000","last_unstale":"2023-11-28T12:08:31.421053+0000","last_undegraded":"2023-11-28T12:08:31.421053+0000","last_fullsized":"2023-11-28T12:08:31.421053+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:38:47.446743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.435520+0000","last_change":"2023-11-28T12:08:31.421323+0000","last_active":"2023-11-28T12:08:31.435520+0000","last_peered":"2023-11-28T12:08:31.435520+0000","last_clean":"2023-11-28T12:08:31.435520+0000","last_became_active":"2023-11-28T12:08:31.421074+0000","last_became_peered":"2023-11-28T12:08:31.421074+0000","last_unstale":"2023-11-28T12:08:31.435520+0000","last_undegraded":"2023-11-28T12:08:31.435520+0000","last_fullsized":"2023-11-28T12:08:31.435520+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:14:30.799554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.416672+0000","last_change":"2023-11-28T12:08:31.411310+0000","last_active":"2023-11-28T12:08:31.416672+0000","last_peered":"2023-11-28T12:08:31.416672+0000","last_clean":"2023-11-28T12:08:31.416672+0000","last_became_active":"2023-11-28T12:08:31.410976+0000","last_became_peered":"2023-11-28T12:08:31.410976+0000","last_unstale":"2023-11-28T12:08:31.416672+0000","last_undegraded":"2023-11-28T12:08:31.416672+0000","last_fullsized":"2023-11-28T12:08:31.416672+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:50:07.890432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.428951+0000","last_change":"2023-11-28T12:08:31.418063+0000","last_active":"2023-11-28T12:08:31.428951+0000","last_peered":"2023-11-28T12:08:31.428951+0000","last_clean":"2023-11-28T12:08:31.428951+0000","last_became_active":"2023-11-28T12:08:31.417788+0000","last_became_peered":"2023-11-28T12:08:31.417788+0000","last_unstale":"2023-11-28T12:08:31.428951+0000","last_undegraded":"2023-11-28T12:08:31.428951+0000","last_fullsized":"2023-11-28T12:08:31.428951+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:46:19.524019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.430196+0000","last_change":"2023-11-28T12:08:31.427702+0000","last_active":"2023-11-28T12:08:31.430196+0000","last_peered":"2023-11-28T12:08:31.430196+0000","last_clean":"2023-11-28T12:08:31.430196+0000","last_became_active":"2023-11-28T12:08:31.427170+0000","last_became_peered":"2023-11-28T12:08:31.427170+0000","last_unstale":"2023-11-28T12:08:31.430196+0000","last_undegraded":"2023-11-28T12:08:31.430196+0000","last_fullsized":"2023-11-28T12:08:31.430196+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:54:44.440250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.419654+0000","last_change":"2023-11-28T12:08:31.414564+0000","last_active":"2023-11-28T12:08:31.419654+0000","last_peered":"2023-11-28T12:08:31.419654+0000","last_clean":"2023-11-28T12:08:31.419654+0000","last_became_active":"2023-11-28T12:08:31.414279+0000","last_became_peered":"2023-11-28T12:08:31.414279+0000","last_unstale":"2023-11-28T12:08:31.419654+0000","last_undegraded":"2023-11-28T12:08:31.419654+0000","last_fullsized":"2023-11-28T12:08:31.419654+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:52:27.427485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"46'4","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.425401+0000","last_change":"2023-11-28T12:08:30.891019+0000","last_active":"2023-11-28T12:08:31.425401+0000","last_peered":"2023-11-28T12:08:31.425401+0000","last_clean":"2023-11-28T12:08:31.425401+0000","last_became_active":"2023-11-28T12:08:30.890448+0000","last_became_peered":"2023-11-28T12:08:30.890448+0000","last_unstale":"2023-11-28T12:08:31.425401+0000","last_undegraded":"2023-11-28T12:08:31.425401+0000","last_fullsized":"2023-11-28T12:08:31.425401+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_clean_scrub_stamp":"2023-11-28T12:08:29.858720+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:38:23.184241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.418778+0000","last_change":"2023-11-28T12:08:31.412654+0000","last_active":"2023-11-28T12:08:31.418778+0000","last_peered":"2023-11-28T12:08:31.418778+0000","last_clean":"2023-11-28T12:08:31.418778+0000","last_became_active":"2023-11-28T12:08:31.412390+0000","last_became_peered":"2023-11-28T12:08:31.412390+0000","last_unstale":"2023-11-28T12:08:31.418778+0000","last_undegraded":"2023-11-28T12:08:31.418778+0000","last_fullsized":"2023-11-28T12:08:31.418778+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:13:35.402766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"46'1","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.427198+0000","last_change":"2023-11-28T12:08:30.897694+0000","last_active":"2023-11-28T12:08:31.427198+0000","last_peered":"2023-11-28T12:08:31.427198+0000","last_clean":"2023-11-28T12:08:31.427198+0000","last_became_active":"2023-11-28T12:08:30.897378+0000","last_became_peered":"2023-11-28T12:08:30.897378+0000","last_unstale":"2023-11-28T12:08:31.427198+0000","last_undegraded":"2023-11-28T12:08:31.427198+0000","last_fullsized":"2023-11-28T12:08:31.427198+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_clean_scrub_stamp":"2023-11-28T12:08:29.858720+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:13:25.938388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.420204+0000","last_change":"2023-11-28T12:08:31.410860+0000","last_active":"2023-11-28T12:08:31.420204+0000","last_peered":"2023-11-28T12:08:31.420204+0000","last_clean":"2023-11-28T12:08:31.420204+0000","last_became_active":"2023-11-28T12:08:31.410585+0000","last_became_peered":"2023-11-28T12:08:31.410585+0000","last_unstale":"2023-11-28T12:08:31.420204+0000","last_undegraded":"2023-11-28T12:08:31.420204+0000","last_fullsized":"2023-11-28T12:08:31.420204+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:19:44.186674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"46'2","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.420014+0000","last_change":"2023-11-28T12:08:30.890294+0000","last_active":"2023-11-28T12:08:31.420014+0000","last_peered":"2023-11-28T12:08:31.420014+0000","last_clean":"2023-11-28T12:08:31.420014+0000","last_became_active":"2023-11-28T12:08:30.889889+0000","last_became_peered":"2023-11-28T12:08:30.889889+0000","last_unstale":"2023-11-28T12:08:31.420014+0000","last_undegraded":"2023-11-28T12:08:31.420014+0000","last_fullsized":"2023-11-28T12:08:31.420014+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_clean_scrub_stamp":"2023-11-28T12:08:29.858720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:49:17.471742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.428668+0000","last_change":"2023-11-28T12:08:31.420634+0000","last_active":"2023-11-28T12:08:31.428668+0000","last_peered":"2023-11-28T12:08:31.428668+0000","last_clean":"2023-11-28T12:08:31.428668+0000","last_became_active":"2023-11-28T12:08:31.420350+0000","last_became_peered":"2023-11-28T12:08:31.420350+0000","last_unstale":"2023-11-28T12:08:31.428668+0000","last_undegraded":"2023-11-28T12:08:31.428668+0000","last_fullsized":"2023-11-28T12:08:31.428668+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:51:41.950131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"46'2","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.431766+0000","last_change":"2023-11-28T12:08:30.900474+0000","last_active":"2023-11-28T12:08:31.431766+0000","last_peered":"2023-11-28T12:08:31.431766+0000","last_clean":"2023-11-28T12:08:31.431766+0000","last_became_active":"2023-11-28T12:08:30.900127+0000","last_became_peered":"2023-11-28T12:08:30.900127+0000","last_unstale":"2023-11-28T12:08:31.431766+0000","last_undegraded":"2023-11-28T12:08:31.431766+0000","last_fullsized":"2023-11-28T12:08:31.431766+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_clean_scrub_stamp":"2023-11-28T12:08:29.858720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:38:46.443488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.427297+0000","last_change":"2023-11-28T12:08:31.424114+0000","last_active":"2023-11-28T12:08:31.427297+0000","last_peered":"2023-11-28T12:08:31.427297+0000","last_clean":"2023-11-28T12:08:31.427297+0000","last_became_active":"2023-11-28T12:08:31.423800+0000","last_became_peered":"2023-11-28T12:08:31.423800+0000","last_unstale":"2023-11-28T12:08:31.427297+0000","last_undegraded":"2023-11-28T12:08:31.427297+0000","last_fullsized":"2023-11-28T12:08:31.427297+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:48:30.989278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"46'1","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.427838+0000","last_change":"2023-11-28T12:08:30.883232+0000","last_active":"2023-11-28T12:08:31.427838+0000","last_peered":"2023-11-28T12:08:31.427838+0000","last_clean":"2023-11-28T12:08:31.427838+0000","last_became_active":"2023-11-28T12:08:30.882905+0000","last_became_peered":"2023-11-28T12:08:30.882905+0000","last_unstale":"2023-11-28T12:08:31.427838+0000","last_undegraded":"2023-11-28T12:08:31.427838+0000","last_fullsized":"2023-11-28T12:08:31.427838+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_clean_scrub_stamp":"2023-11-28T12:08:29.858720+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:35:35.688586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.413894+0000","last_change":"2023-11-28T12:08:31.408899+0000","last_active":"2023-11-28T12:08:31.413894+0000","last_peered":"2023-11-28T12:08:31.413894+0000","last_clean":"2023-11-28T12:08:31.413894+0000","last_became_active":"2023-11-28T12:08:31.408610+0000","last_became_peered":"2023-11-28T12:08:31.408610+0000","last_unstale":"2023-11-28T12:08:31.413894+0000","last_undegraded":"2023-11-28T12:08:31.413894+0000","last_fullsized":"2023-11-28T12:08:31.413894+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:30:18.131628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"46'1","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.424856+0000","last_change":"2023-11-28T12:08:30.889019+0000","last_active":"2023-11-28T12:08:31.424856+0000","last_peered":"2023-11-28T12:08:31.424856+0000","last_clean":"2023-11-28T12:08:31.424856+0000","last_became_active":"2023-11-28T12:08:30.888790+0000","last_became_peered":"2023-11-28T12:08:30.888790+0000","last_unstale":"2023-11-28T12:08:31.424856+0000","last_undegraded":"2023-11-28T12:08:31.424856+0000","last_fullsized":"2023-11-28T12:08:31.424856+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_clean_scrub_stamp":"2023-11-28T12:08:29.858720+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:40:53.839598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.432346+0000","last_change":"2023-11-28T12:08:31.429325+0000","last_active":"2023-11-28T12:08:31.432346+0000","last_peered":"2023-11-28T12:08:31.432346+0000","last_clean":"2023-11-28T12:08:31.432346+0000","last_became_active":"2023-11-28T12:08:31.429064+0000","last_became_peered":"2023-11-28T12:08:31.429064+0000","last_unstale":"2023-11-28T12:08:31.432346+0000","last_undegraded":"2023-11-28T12:08:31.432346+0000","last_fullsized":"2023-11-28T12:08:31.432346+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:54:52.666260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.400203+0000","last_change":"2023-11-28T12:08:30.890799+0000","last_active":"2023-11-28T12:08:31.400203+0000","last_peered":"2023-11-28T12:08:31.400203+0000","last_clean":"2023-11-28T12:08:31.400203+0000","last_became_active":"2023-11-28T12:08:30.890480+0000","last_became_peered":"2023-11-28T12:08:30.890480+0000","last_unstale":"2023-11-28T12:08:31.400203+0000","last_undegraded":"2023-11-28T12:08:31.400203+0000","last_fullsized":"2023-11-28T12:08:31.400203+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_clean_scrub_stamp":"2023-11-28T12:08:29.858720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:14:15.838121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.426630+0000","last_change":"2023-11-28T12:08:31.423374+0000","last_active":"2023-11-28T12:08:31.426630+0000","last_peered":"2023-11-28T12:08:31.426630+0000","last_clean":"2023-11-28T12:08:31.426630+0000","last_became_active":"2023-11-28T12:08:31.423029+0000","last_became_peered":"2023-11-28T12:08:31.423029+0000","last_unstale":"2023-11-28T12:08:31.426630+0000","last_undegraded":"2023-11-28T12:08:31.426630+0000","last_fullsized":"2023-11-28T12:08:31.426630+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:35:06.199339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.403054+0000","last_change":"2023-11-28T12:08:30.889152+0000","last_active":"2023-11-28T12:08:31.403054+0000","last_peered":"2023-11-28T12:08:31.403054+0000","last_clean":"2023-11-28T12:08:31.403054+0000","last_became_active":"2023-11-28T12:08:30.888908+0000","last_became_peered":"2023-11-28T12:08:30.888908+0000","last_unstale":"2023-11-28T12:08:31.403054+0000","last_undegraded":"2023-11-28T12:08:31.403054+0000","last_fullsized":"2023-11-28T12:08:31.403054+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_clean_scrub_stamp":"2023-11-28T12:08:29.858720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:36:06.368948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.432857+0000","last_change":"2023-11-28T12:08:31.428509+0000","last_active":"2023-11-28T12:08:31.432857+0000","last_peered":"2023-11-28T12:08:31.432857+0000","last_clean":"2023-11-28T12:08:31.432857+0000","last_became_active":"2023-11-28T12:08:31.428291+0000","last_became_peered":"2023-11-28T12:08:31.428291+0000","last_unstale":"2023-11-28T12:08:31.432857+0000","last_undegraded":"2023-11-28T12:08:31.432857+0000","last_fullsized":"2023-11-28T12:08:31.432857+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:50:07.890432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.400902+0000","last_change":"2023-11-28T12:08:30.887549+0000","last_active":"2023-11-28T12:08:31.400902+0000","last_peered":"2023-11-28T12:08:31.400902+0000","last_clean":"2023-11-28T12:08:31.400902+0000","last_became_active":"2023-11-28T12:08:30.887247+0000","last_became_peered":"2023-11-28T12:08:30.887247+0000","last_unstale":"2023-11-28T12:08:31.400902+0000","last_undegraded":"2023-11-28T12:08:31.400902+0000","last_fullsized":"2023-11-28T12:08:31.400902+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_clean_scrub_stamp":"2023-11-28T12:08:29.858720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:40:53.839598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.424448+0000","last_change":"2023-11-28T12:08:31.420891+0000","last_active":"2023-11-28T12:08:31.424448+0000","last_peered":"2023-11-28T12:08:31.424448+0000","last_clean":"2023-11-28T12:08:31.424448+0000","last_became_active":"2023-11-28T12:08:31.420545+0000","last_became_peered":"2023-11-28T12:08:31.420545+0000","last_unstale":"2023-11-28T12:08:31.424448+0000","last_undegraded":"2023-11-28T12:08:31.424448+0000","last_fullsized":"2023-11-28T12:08:31.424448+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:35:36.691841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.404194+0000","last_change":"2023-11-28T12:08:30.885319+0000","last_active":"2023-11-28T12:08:31.404194+0000","last_peered":"2023-11-28T12:08:31.404194+0000","last_clean":"2023-11-28T12:08:31.404194+0000","last_became_active":"2023-11-28T12:08:30.884801+0000","last_became_peered":"2023-11-28T12:08:30.884801+0000","last_unstale":"2023-11-28T12:08:31.404194+0000","last_undegraded":"2023-11-28T12:08:31.404194+0000","last_fullsized":"2023-11-28T12:08:31.404194+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_clean_scrub_stamp":"2023-11-28T12:08:29.858720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:07:35.201596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.428221+0000","last_change":"2023-11-28T12:08:31.416594+0000","last_active":"2023-11-28T12:08:31.428221+0000","last_peered":"2023-11-28T12:08:31.428221+0000","last_clean":"2023-11-28T12:08:31.428221+0000","last_became_active":"2023-11-28T12:08:31.416302+0000","last_became_peered":"2023-11-28T12:08:31.416302+0000","last_unstale":"2023-11-28T12:08:31.428221+0000","last_undegraded":"2023-11-28T12:08:31.428221+0000","last_fullsized":"2023-11-28T12:08:31.428221+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:46:20.961979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"46'3","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.419754+0000","last_change":"2023-11-28T12:08:30.886671+0000","last_active":"2023-11-28T12:08:31.419754+0000","last_peered":"2023-11-28T12:08:31.419754+0000","last_clean":"2023-11-28T12:08:31.419754+0000","last_became_active":"2023-11-28T12:08:30.886248+0000","last_became_peered":"2023-11-28T12:08:30.886248+0000","last_unstale":"2023-11-28T12:08:31.419754+0000","last_undegraded":"2023-11-28T12:08:31.419754+0000","last_fullsized":"2023-11-28T12:08:31.419754+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_clean_scrub_stamp":"2023-11-28T12:08:29.858720+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:36:06.368948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.425163+0000","last_change":"2023-11-28T12:08:31.420536+0000","last_active":"2023-11-28T12:08:31.425163+0000","last_peered":"2023-11-28T12:08:31.425163+0000","last_clean":"2023-11-28T12:08:31.425163+0000","last_became_active":"2023-11-28T12:08:31.420184+0000","last_became_peered":"2023-11-28T12:08:31.420184+0000","last_unstale":"2023-11-28T12:08:31.425163+0000","last_undegraded":"2023-11-28T12:08:31.425163+0000","last_fullsized":"2023-11-28T12:08:31.425163+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:49:30.518586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"46'6","reported_seq":16,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.435419+0000","last_change":"2023-11-28T12:08:30.897850+0000","last_active":"2023-11-28T12:08:31.435419+0000","last_peered":"2023-11-28T12:08:31.435419+0000","last_clean":"2023-11-28T12:08:31.435419+0000","last_became_active":"2023-11-28T12:08:30.895990+0000","last_became_peered":"2023-11-28T12:08:30.895990+0000","last_unstale":"2023-11-28T12:08:31.435419+0000","last_undegraded":"2023-11-28T12:08:31.435419+0000","last_fullsized":"2023-11-28T12:08:31.435419+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_clean_scrub_stamp":"2023-11-28T12:08:29.858720+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:19:36.189829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.420663+0000","last_change":"2023-11-28T12:08:31.412494+0000","last_active":"2023-11-28T12:08:31.420663+0000","last_peered":"2023-11-28T12:08:31.420663+0000","last_clean":"2023-11-28T12:08:31.420663+0000","last_became_active":"2023-11-28T12:08:31.412213+0000","last_became_peered":"2023-11-28T12:08:31.412213+0000","last_unstale":"2023-11-28T12:08:31.420663+0000","last_undegraded":"2023-11-28T12:08:31.420663+0000","last_fullsized":"2023-11-28T12:08:31.420663+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:56:23.042466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"46'2","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.425952+0000","last_change":"2023-11-28T12:08:30.898610+0000","last_active":"2023-11-28T12:08:31.425952+0000","last_peered":"2023-11-28T12:08:31.425952+0000","last_clean":"2023-11-28T12:08:31.425952+0000","last_became_active":"2023-11-28T12:08:30.896112+0000","last_became_peered":"2023-11-28T12:08:30.896112+0000","last_unstale":"2023-11-28T12:08:31.425952+0000","last_undegraded":"2023-11-28T12:08:31.425952+0000","last_fullsized":"2023-11-28T12:08:31.425952+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_clean_scrub_stamp":"2023-11-28T12:08:29.858720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:40:53.839598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.434093+0000","last_change":"2023-11-28T12:08:31.420815+0000","last_active":"2023-11-28T12:08:31.434093+0000","last_peered":"2023-11-28T12:08:31.434093+0000","last_clean":"2023-11-28T12:08:31.434093+0000","last_became_active":"2023-11-28T12:08:31.420584+0000","last_became_peered":"2023-11-28T12:08:31.420584+0000","last_unstale":"2023-11-28T12:08:31.434093+0000","last_undegraded":"2023-11-28T12:08:31.434093+0000","last_fullsized":"2023-11-28T12:08:31.434093+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:22:18.182535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.400415+0000","last_change":"2023-11-28T12:08:30.888041+0000","last_active":"2023-11-28T12:08:31.400415+0000","last_peered":"2023-11-28T12:08:31.400415+0000","last_clean":"2023-11-28T12:08:31.400415+0000","last_became_active":"2023-11-28T12:08:30.886410+0000","last_became_peered":"2023-11-28T12:08:30.886410+0000","last_unstale":"2023-11-28T12:08:31.400415+0000","last_undegraded":"2023-11-28T12:08:31.400415+0000","last_fullsized":"2023-11-28T12:08:31.400415+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_clean_scrub_stamp":"2023-11-28T12:08:29.858720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:36:36.670276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.432309+0000","last_change":"2023-11-28T12:08:31.427069+0000","last_active":"2023-11-28T12:08:31.432309+0000","last_peered":"2023-11-28T12:08:31.432309+0000","last_clean":"2023-11-28T12:08:31.432309+0000","last_became_active":"2023-11-28T12:08:31.426836+0000","last_became_peered":"2023-11-28T12:08:31.426836+0000","last_unstale":"2023-11-28T12:08:31.432309+0000","last_undegraded":"2023-11-28T12:08:31.432309+0000","last_fullsized":"2023-11-28T12:08:31.432309+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:35:06.199339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.398049+0000","last_change":"2023-11-28T12:08:30.888321+0000","last_active":"2023-11-28T12:08:31.398049+0000","last_peered":"2023-11-28T12:08:31.398049+0000","last_clean":"2023-11-28T12:08:31.398049+0000","last_became_active":"2023-11-28T12:08:30.888002+0000","last_became_peered":"2023-11-28T12:08:30.888002+0000","last_unstale":"2023-11-28T12:08:31.398049+0000","last_undegraded":"2023-11-28T12:08:31.398049+0000","last_fullsized":"2023-11-28T12:08:31.398049+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_clean_scrub_stamp":"2023-11-28T12:08:29.858720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:53:18.328945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.435611+0000","last_change":"2023-11-28T12:08:31.422264+0000","last_active":"2023-11-28T12:08:31.435611+0000","last_peered":"2023-11-28T12:08:31.435611+0000","last_clean":"2023-11-28T12:08:31.435611+0000","last_became_active":"2023-11-28T12:08:31.421991+0000","last_became_peered":"2023-11-28T12:08:31.421991+0000","last_unstale":"2023-11-28T12:08:31.435611+0000","last_undegraded":"2023-11-28T12:08:31.435611+0000","last_fullsized":"2023-11-28T12:08:31.435611+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:21:25.365383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"46'8","reported_seq":18,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.427018+0000","last_change":"2023-11-28T12:08:30.897784+0000","last_active":"2023-11-28T12:08:31.427018+0000","last_peered":"2023-11-28T12:08:31.427018+0000","last_clean":"2023-11-28T12:08:31.427018+0000","last_became_active":"2023-11-28T12:08:30.897431+0000","last_became_peered":"2023-11-28T12:08:30.897431+0000","last_unstale":"2023-11-28T12:08:31.427018+0000","last_undegraded":"2023-11-28T12:08:31.427018+0000","last_fullsized":"2023-11-28T12:08:31.427018+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_clean_scrub_stamp":"2023-11-28T12:08:29.858720+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:56:22.039211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.430987+0000","last_change":"2023-11-28T12:08:31.426350+0000","last_active":"2023-11-28T12:08:31.430987+0000","last_peered":"2023-11-28T12:08:31.430987+0000","last_clean":"2023-11-28T12:08:31.430987+0000","last_became_active":"2023-11-28T12:08:31.426011+0000","last_became_peered":"2023-11-28T12:08:31.426011+0000","last_unstale":"2023-11-28T12:08:31.430987+0000","last_undegraded":"2023-11-28T12:08:31.430987+0000","last_fullsized":"2023-11-28T12:08:31.430987+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:12:43.260621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"46'1","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.434531+0000","last_change":"2023-11-28T12:08:30.902749+0000","last_active":"2023-11-28T12:08:31.434531+0000","last_peered":"2023-11-28T12:08:31.434531+0000","last_clean":"2023-11-28T12:08:31.434531+0000","last_became_active":"2023-11-28T12:08:30.902412+0000","last_became_peered":"2023-11-28T12:08:30.902412+0000","last_unstale":"2023-11-28T12:08:31.434531+0000","last_undegraded":"2023-11-28T12:08:31.434531+0000","last_fullsized":"2023-11-28T12:08:31.434531+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_clean_scrub_stamp":"2023-11-28T12:08:29.858720+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:56:22.039211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.434367+0000","last_change":"2023-11-28T12:08:31.432744+0000","last_active":"2023-11-28T12:08:31.434367+0000","last_peered":"2023-11-28T12:08:31.434367+0000","last_clean":"2023-11-28T12:08:31.434367+0000","last_became_active":"2023-11-28T12:08:31.432508+0000","last_became_peered":"2023-11-28T12:08:31.432508+0000","last_unstale":"2023-11-28T12:08:31.434367+0000","last_undegraded":"2023-11-28T12:08:31.434367+0000","last_fullsized":"2023-11-28T12:08:31.434367+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:13:35.402766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"46'2","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.428271+0000","last_change":"2023-11-28T12:08:30.892945+0000","last_active":"2023-11-28T12:08:31.428271+0000","last_peered":"2023-11-28T12:08:31.428271+0000","last_clean":"2023-11-28T12:08:31.428271+0000","last_became_active":"2023-11-28T12:08:30.890649+0000","last_became_peered":"2023-11-28T12:08:30.890649+0000","last_unstale":"2023-11-28T12:08:31.428271+0000","last_undegraded":"2023-11-28T12:08:31.428271+0000","last_fullsized":"2023-11-28T12:08:31.428271+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_clean_scrub_stamp":"2023-11-28T12:08:29.858720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:57:16.696314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.427310+0000","last_change":"2023-11-28T12:08:31.424129+0000","last_active":"2023-11-28T12:08:31.427310+0000","last_peered":"2023-11-28T12:08:31.427310+0000","last_clean":"2023-11-28T12:08:31.427310+0000","last_became_active":"2023-11-28T12:08:31.423803+0000","last_became_peered":"2023-11-28T12:08:31.423803+0000","last_unstale":"2023-11-28T12:08:31.427310+0000","last_undegraded":"2023-11-28T12:08:31.427310+0000","last_fullsized":"2023-11-28T12:08:31.427310+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:30:18.131628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"46'1","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.425871+0000","last_change":"2023-11-28T12:08:30.887553+0000","last_active":"2023-11-28T12:08:31.425871+0000","last_peered":"2023-11-28T12:08:31.425871+0000","last_clean":"2023-11-28T12:08:31.425871+0000","last_became_active":"2023-11-28T12:08:30.887202+0000","last_became_peered":"2023-11-28T12:08:30.887202+0000","last_unstale":"2023-11-28T12:08:31.425871+0000","last_undegraded":"2023-11-28T12:08:31.425871+0000","last_fullsized":"2023-11-28T12:08:31.425871+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_clean_scrub_stamp":"2023-11-28T12:08:29.858720+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:32:30.993995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.418162+0000","last_change":"2023-11-28T12:08:31.415000+0000","last_active":"2023-11-28T12:08:31.418162+0000","last_peered":"2023-11-28T12:08:31.418162+0000","last_clean":"2023-11-28T12:08:31.418162+0000","last_became_active":"2023-11-28T12:08:31.414684+0000","last_became_peered":"2023-11-28T12:08:31.414684+0000","last_unstale":"2023-11-28T12:08:31.418162+0000","last_undegraded":"2023-11-28T12:08:31.418162+0000","last_fullsized":"2023-11-28T12:08:31.418162+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:42:08.563353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.401199+0000","last_change":"2023-11-28T12:08:30.900439+0000","last_active":"2023-11-28T12:08:31.401199+0000","last_peered":"2023-11-28T12:08:31.401199+0000","last_clean":"2023-11-28T12:08:31.401199+0000","last_became_active":"2023-11-28T12:08:30.900113+0000","last_became_peered":"2023-11-28T12:08:30.900113+0000","last_unstale":"2023-11-28T12:08:31.401199+0000","last_undegraded":"2023-11-28T12:08:31.401199+0000","last_fullsized":"2023-11-28T12:08:31.401199+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_clean_scrub_stamp":"2023-11-28T12:08:29.858720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:49:17.471742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.424472+0000","last_change":"2023-11-28T12:08:31.420556+0000","last_active":"2023-11-28T12:08:31.424472+0000","last_peered":"2023-11-28T12:08:31.424472+0000","last_clean":"2023-11-28T12:08:31.424472+0000","last_became_active":"2023-11-28T12:08:31.417300+0000","last_became_peered":"2023-11-28T12:08:31.417300+0000","last_unstale":"2023-11-28T12:08:31.424472+0000","last_undegraded":"2023-11-28T12:08:31.424472+0000","last_fullsized":"2023-11-28T12:08:31.424472+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:07:36.204852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"46'2","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.413786+0000","last_change":"2023-11-28T12:08:30.887383+0000","last_active":"2023-11-28T12:08:31.413786+0000","last_peered":"2023-11-28T12:08:31.413786+0000","last_clean":"2023-11-28T12:08:31.413786+0000","last_became_active":"2023-11-28T12:08:30.887080+0000","last_became_peered":"2023-11-28T12:08:30.887080+0000","last_unstale":"2023-11-28T12:08:31.413786+0000","last_undegraded":"2023-11-28T12:08:31.413786+0000","last_fullsized":"2023-11-28T12:08:31.413786+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_clean_scrub_stamp":"2023-11-28T12:08:29.858720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:33:16.828884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.420239+0000","last_change":"2023-11-28T12:08:31.412097+0000","last_active":"2023-11-28T12:08:31.420239+0000","last_peered":"2023-11-28T12:08:31.420239+0000","last_clean":"2023-11-28T12:08:31.420239+0000","last_became_active":"2023-11-28T12:08:31.411793+0000","last_became_peered":"2023-11-28T12:08:31.411793+0000","last_unstale":"2023-11-28T12:08:31.420239+0000","last_undegraded":"2023-11-28T12:08:31.420239+0000","last_fullsized":"2023-11-28T12:08:31.420239+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:28:34.376054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.409434+0000","last_change":"2023-11-28T12:08:30.890005+0000","last_active":"2023-11-28T12:08:31.409434+0000","last_peered":"2023-11-28T12:08:31.409434+0000","last_clean":"2023-11-28T12:08:31.409434+0000","last_became_active":"2023-11-28T12:08:30.889409+0000","last_became_peered":"2023-11-28T12:08:30.889409+0000","last_unstale":"2023-11-28T12:08:31.409434+0000","last_undegraded":"2023-11-28T12:08:31.409434+0000","last_fullsized":"2023-11-28T12:08:31.409434+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_clean_scrub_stamp":"2023-11-28T12:08:29.858720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:35:35.688586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.426686+0000","last_change":"2023-11-28T12:08:31.416598+0000","last_active":"2023-11-28T12:08:31.426686+0000","last_peered":"2023-11-28T12:08:31.426686+0000","last_clean":"2023-11-28T12:08:31.426686+0000","last_became_active":"2023-11-28T12:08:31.416247+0000","last_became_peered":"2023-11-28T12:08:31.416247+0000","last_unstale":"2023-11-28T12:08:31.426686+0000","last_undegraded":"2023-11-28T12:08:31.426686+0000","last_fullsized":"2023-11-28T12:08:31.426686+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:53:27.068927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.403032+0000","last_change":"2023-11-28T12:08:30.883964+0000","last_active":"2023-11-28T12:08:31.403032+0000","last_peered":"2023-11-28T12:08:31.403032+0000","last_clean":"2023-11-28T12:08:31.403032+0000","last_became_active":"2023-11-28T12:08:30.883438+0000","last_became_peered":"2023-11-28T12:08:30.883438+0000","last_unstale":"2023-11-28T12:08:31.403032+0000","last_undegraded":"2023-11-28T12:08:31.403032+0000","last_fullsized":"2023-11-28T12:08:31.403032+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_clean_scrub_stamp":"2023-11-28T12:08:29.858720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:07:35.201596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.431160+0000","last_change":"2023-11-28T12:08:31.429492+0000","last_active":"2023-11-28T12:08:31.431160+0000","last_peered":"2023-11-28T12:08:31.431160+0000","last_clean":"2023-11-28T12:08:31.431160+0000","last_became_active":"2023-11-28T12:08:31.429162+0000","last_became_peered":"2023-11-28T12:08:31.429162+0000","last_unstale":"2023-11-28T12:08:31.431160+0000","last_undegraded":"2023-11-28T12:08:31.431160+0000","last_fullsized":"2023-11-28T12:08:31.431160+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:08:46.484468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.399769+0000","last_change":"2023-11-28T12:08:30.883689+0000","last_active":"2023-11-28T12:08:31.399769+0000","last_peered":"2023-11-28T12:08:31.399769+0000","last_clean":"2023-11-28T12:08:31.399769+0000","last_became_active":"2023-11-28T12:08:30.882857+0000","last_became_peered":"2023-11-28T12:08:30.882857+0000","last_unstale":"2023-11-28T12:08:31.399769+0000","last_undegraded":"2023-11-28T12:08:31.399769+0000","last_fullsized":"2023-11-28T12:08:31.399769+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_clean_scrub_stamp":"2023-11-28T12:08:29.858720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:43:52.916822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.436746+0000","last_change":"2023-11-28T12:08:31.435018+0000","last_active":"2023-11-28T12:08:31.436746+0000","last_peered":"2023-11-28T12:08:31.436746+0000","last_clean":"2023-11-28T12:08:31.436746+0000","last_became_active":"2023-11-28T12:08:31.434752+0000","last_became_peered":"2023-11-28T12:08:31.434752+0000","last_unstale":"2023-11-28T12:08:31.436746+0000","last_undegraded":"2023-11-28T12:08:31.436746+0000","last_fullsized":"2023-11-28T12:08:31.436746+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:25:37.130663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.411874+0000","last_change":"2023-11-28T12:08:30.898570+0000","last_active":"2023-11-28T12:08:31.411874+0000","last_peered":"2023-11-28T12:08:31.411874+0000","last_clean":"2023-11-28T12:08:31.411874+0000","last_became_active":"2023-11-28T12:08:30.898301+0000","last_became_peered":"2023-11-28T12:08:30.898301+0000","last_unstale":"2023-11-28T12:08:31.411874+0000","last_undegraded":"2023-11-28T12:08:31.411874+0000","last_fullsized":"2023-11-28T12:08:31.411874+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_clean_scrub_stamp":"2023-11-28T12:08:29.858720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:48:57.457613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":34,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.404036+0000","last_change":"2023-11-28T12:06:23.961595+0000","last_active":"2023-11-28T12:08:31.404036+0000","last_peered":"2023-11-28T12:08:31.404036+0000","last_clean":"2023-11-28T12:08:31.404036+0000","last_became_active":"2023-11-28T12:06:23.961257+0000","last_became_peered":"2023-11-28T12:06:23.961257+0000","last_unstale":"2023-11-28T12:08:31.404036+0000","last_undegraded":"2023-11-28T12:08:31.404036+0000","last_fullsized":"2023-11-28T12:08:31.404036+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:30:40.200095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.418836+0000","last_change":"2023-11-28T12:08:31.413817+0000","last_active":"2023-11-28T12:08:31.418836+0000","last_peered":"2023-11-28T12:08:31.418836+0000","last_clean":"2023-11-28T12:08:31.418836+0000","last_became_active":"2023-11-28T12:08:31.413533+0000","last_became_peered":"2023-11-28T12:08:31.413533+0000","last_unstale":"2023-11-28T12:08:31.418836+0000","last_undegraded":"2023-11-28T12:08:31.418836+0000","last_fullsized":"2023-11-28T12:08:31.418836+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:48:58.460869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.409534+0000","last_change":"2023-11-28T12:08:30.899021+0000","last_active":"2023-11-28T12:08:31.409534+0000","last_peered":"2023-11-28T12:08:31.409534+0000","last_clean":"2023-11-28T12:08:31.409534+0000","last_became_active":"2023-11-28T12:08:30.897228+0000","last_became_peered":"2023-11-28T12:08:30.897228+0000","last_unstale":"2023-11-28T12:08:31.409534+0000","last_undegraded":"2023-11-28T12:08:31.409534+0000","last_fullsized":"2023-11-28T12:08:31.409534+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_clean_scrub_stamp":"2023-11-28T12:08:29.858720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:07:35.201596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":38,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.407756+0000","last_change":"2023-11-28T12:06:23.517505+0000","last_active":"2023-11-28T12:08:31.407756+0000","last_peered":"2023-11-28T12:08:31.407756+0000","last_clean":"2023-11-28T12:08:31.407756+0000","last_became_active":"2023-11-28T12:06:23.517151+0000","last_became_peered":"2023-11-28T12:06:23.517151+0000","last_unstale":"2023-11-28T12:08:31.407756+0000","last_undegraded":"2023-11-28T12:08:31.407756+0000","last_fullsized":"2023-11-28T12:08:31.407756+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:30:40.200095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.427114+0000","last_change":"2023-11-28T12:08:31.424105+0000","last_active":"2023-11-28T12:08:31.427114+0000","last_peered":"2023-11-28T12:08:31.427114+0000","last_clean":"2023-11-28T12:08:31.427114+0000","last_became_active":"2023-11-28T12:08:31.422969+0000","last_became_peered":"2023-11-28T12:08:31.422969+0000","last_unstale":"2023-11-28T12:08:31.427114+0000","last_undegraded":"2023-11-28T12:08:31.427114+0000","last_fullsized":"2023-11-28T12:08:31.427114+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:07:36.204852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.400496+0000","last_change":"2023-11-28T12:08:30.884021+0000","last_active":"2023-11-28T12:08:31.400496+0000","last_peered":"2023-11-28T12:08:31.400496+0000","last_clean":"2023-11-28T12:08:31.400496+0000","last_became_active":"2023-11-28T12:08:30.883688+0000","last_became_peered":"2023-11-28T12:08:30.883688+0000","last_unstale":"2023-11-28T12:08:31.400496+0000","last_undegraded":"2023-11-28T12:08:31.400496+0000","last_fullsized":"2023-11-28T12:08:31.400496+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_clean_scrub_stamp":"2023-11-28T12:08:29.858720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:42:07.560098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":37,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.406192+0000","last_change":"2023-11-28T12:06:23.517967+0000","last_active":"2023-11-28T12:08:31.406192+0000","last_peered":"2023-11-28T12:08:31.406192+0000","last_clean":"2023-11-28T12:08:31.406192+0000","last_became_active":"2023-11-28T12:06:23.517495+0000","last_became_peered":"2023-11-28T12:06:23.517495+0000","last_unstale":"2023-11-28T12:08:31.406192+0000","last_undegraded":"2023-11-28T12:08:31.406192+0000","last_fullsized":"2023-11-28T12:08:31.406192+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:51:06.844441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":185,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-28T12:08:30.875789+0000","last_change":"2023-11-28T12:06:23.513472+0000","last_active":"2023-11-28T12:08:30.875789+0000","last_peered":"2023-11-28T12:08:30.875789+0000","last_clean":"2023-11-28T12:08:30.875789+0000","last_became_active":"2023-11-28T12:06:23.513150+0000","last_became_peered":"2023-11-28T12:06:23.513150+0000","last_unstale":"2023-11-28T12:08:30.875789+0000","last_undegraded":"2023-11-28T12:08:30.875789+0000","last_fullsized":"2023-11-28T12:08:30.875789+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:34:18.653049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.428691+0000","last_change":"2023-11-28T12:08:31.423626+0000","last_active":"2023-11-28T12:08:31.428691+0000","last_peered":"2023-11-28T12:08:31.428691+0000","last_clean":"2023-11-28T12:08:31.428691+0000","last_became_active":"2023-11-28T12:08:31.423345+0000","last_became_peered":"2023-11-28T12:08:31.423345+0000","last_unstale":"2023-11-28T12:08:31.428691+0000","last_undegraded":"2023-11-28T12:08:31.428691+0000","last_fullsized":"2023-11-28T12:08:31.428691+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:27:20.964521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.403493+0000","last_change":"2023-11-28T12:08:30.887320+0000","last_active":"2023-11-28T12:08:31.403493+0000","last_peered":"2023-11-28T12:08:31.403493+0000","last_clean":"2023-11-28T12:08:31.403493+0000","last_became_active":"2023-11-28T12:08:30.886970+0000","last_became_peered":"2023-11-28T12:08:30.886970+0000","last_unstale":"2023-11-28T12:08:31.403493+0000","last_undegraded":"2023-11-28T12:08:31.403493+0000","last_fullsized":"2023-11-28T12:08:31.403493+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_clean_scrub_stamp":"2023-11-28T12:08:29.858720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:48:57.457613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":35,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.398920+0000","last_change":"2023-11-28T12:06:23.903708+0000","last_active":"2023-11-28T12:08:31.398920+0000","last_peered":"2023-11-28T12:08:31.398920+0000","last_clean":"2023-11-28T12:08:31.398920+0000","last_became_active":"2023-11-28T12:06:23.903399+0000","last_became_peered":"2023-11-28T12:06:23.903399+0000","last_unstale":"2023-11-28T12:08:31.398920+0000","last_undegraded":"2023-11-28T12:08:31.398920+0000","last_fullsized":"2023-11-28T12:08:31.398920+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:31:13.187145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.420184+0000","last_change":"2023-11-28T12:08:31.411681+0000","last_active":"2023-11-28T12:08:31.420184+0000","last_peered":"2023-11-28T12:08:31.420184+0000","last_clean":"2023-11-28T12:08:31.420184+0000","last_became_active":"2023-11-28T12:08:31.411334+0000","last_became_peered":"2023-11-28T12:08:31.411334+0000","last_unstale":"2023-11-28T12:08:31.420184+0000","last_undegraded":"2023-11-28T12:08:31.420184+0000","last_fullsized":"2023-11-28T12:08:31.420184+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:22:14.973672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.408976+0000","last_change":"2023-11-28T12:08:30.896758+0000","last_active":"2023-11-28T12:08:31.408976+0000","last_peered":"2023-11-28T12:08:31.408976+0000","last_clean":"2023-11-28T12:08:31.408976+0000","last_became_active":"2023-11-28T12:08:30.896453+0000","last_became_peered":"2023-11-28T12:08:30.896453+0000","last_unstale":"2023-11-28T12:08:31.408976+0000","last_undegraded":"2023-11-28T12:08:31.408976+0000","last_fullsized":"2023-11-28T12:08:31.408976+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_clean_scrub_stamp":"2023-11-28T12:08:29.858720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:13:34.399511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":35,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-28T12:08:30.875692+0000","last_change":"2023-11-28T12:06:23.903662+0000","last_active":"2023-11-28T12:08:30.875692+0000","last_peered":"2023-11-28T12:08:30.875692+0000","last_clean":"2023-11-28T12:08:30.875692+0000","last_became_active":"2023-11-28T12:06:23.903354+0000","last_became_peered":"2023-11-28T12:06:23.903354+0000","last_unstale":"2023-11-28T12:08:30.875692+0000","last_undegraded":"2023-11-28T12:08:30.875692+0000","last_fullsized":"2023-11-28T12:08:30.875692+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:02:07.694087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.430176+0000","last_change":"2023-11-28T12:08:31.427556+0000","last_active":"2023-11-28T12:08:31.430176+0000","last_peered":"2023-11-28T12:08:31.430176+0000","last_clean":"2023-11-28T12:08:31.430176+0000","last_became_active":"2023-11-28T12:08:31.427158+0000","last_became_peered":"2023-11-28T12:08:31.427158+0000","last_unstale":"2023-11-28T12:08:31.430176+0000","last_undegraded":"2023-11-28T12:08:31.430176+0000","last_fullsized":"2023-11-28T12:08:31.430176+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:19:37.193084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"46'2","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.429131+0000","last_change":"2023-11-28T12:08:30.891685+0000","last_active":"2023-11-28T12:08:31.429131+0000","last_peered":"2023-11-28T12:08:31.429131+0000","last_clean":"2023-11-28T12:08:31.429131+0000","last_became_active":"2023-11-28T12:08:30.891339+0000","last_became_peered":"2023-11-28T12:08:30.891339+0000","last_unstale":"2023-11-28T12:08:31.429131+0000","last_undegraded":"2023-11-28T12:08:31.429131+0000","last_fullsized":"2023-11-28T12:08:31.429131+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_clean_scrub_stamp":"2023-11-28T12:08:29.858720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:39:06.338738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":36,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.402795+0000","last_change":"2023-11-28T12:06:23.903797+0000","last_active":"2023-11-28T12:08:31.402795+0000","last_peered":"2023-11-28T12:08:31.402795+0000","last_clean":"2023-11-28T12:08:31.402795+0000","last_became_active":"2023-11-28T12:06:23.903475+0000","last_became_peered":"2023-11-28T12:06:23.903475+0000","last_unstale":"2023-11-28T12:08:31.402795+0000","last_undegraded":"2023-11-28T12:08:31.402795+0000","last_fullsized":"2023-11-28T12:08:31.402795+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:51:06.844441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.431331+0000","last_change":"2023-11-28T12:08:31.428030+0000","last_active":"2023-11-28T12:08:31.431331+0000","last_peered":"2023-11-28T12:08:31.431331+0000","last_clean":"2023-11-28T12:08:31.431331+0000","last_became_active":"2023-11-28T12:08:31.424371+0000","last_became_peered":"2023-11-28T12:08:31.424371+0000","last_unstale":"2023-11-28T12:08:31.431331+0000","last_undegraded":"2023-11-28T12:08:31.431331+0000","last_fullsized":"2023-11-28T12:08:31.431331+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:15:00.988809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.401449+0000","last_change":"2023-11-28T12:08:30.887499+0000","last_active":"2023-11-28T12:08:31.401449+0000","last_peered":"2023-11-28T12:08:31.401449+0000","last_clean":"2023-11-28T12:08:31.401449+0000","last_became_active":"2023-11-28T12:08:30.887191+0000","last_became_peered":"2023-11-28T12:08:30.887191+0000","last_unstale":"2023-11-28T12:08:31.401449+0000","last_undegraded":"2023-11-28T12:08:31.401449+0000","last_fullsized":"2023-11-28T12:08:31.401449+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_clean_scrub_stamp":"2023-11-28T12:08:29.858720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:22:13.970417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":40,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-28T12:08:30.873463+0000","last_change":"2023-11-28T12:06:23.903983+0000","last_active":"2023-11-28T12:08:30.873463+0000","last_peered":"2023-11-28T12:08:30.873463+0000","last_clean":"2023-11-28T12:08:30.873463+0000","last_became_active":"2023-11-28T12:06:23.903511+0000","last_became_peered":"2023-11-28T12:06:23.903511+0000","last_unstale":"2023-11-28T12:08:30.873463+0000","last_undegraded":"2023-11-28T12:08:30.873463+0000","last_fullsized":"2023-11-28T12:08:30.873463+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:31:13.187145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.436026+0000","last_change":"2023-11-28T12:08:31.431230+0000","last_active":"2023-11-28T12:08:31.436026+0000","last_peered":"2023-11-28T12:08:31.436026+0000","last_clean":"2023-11-28T12:08:31.436026+0000","last_became_active":"2023-11-28T12:08:31.429657+0000","last_became_peered":"2023-11-28T12:08:31.429657+0000","last_unstale":"2023-11-28T12:08:31.436026+0000","last_undegraded":"2023-11-28T12:08:31.436026+0000","last_fullsized":"2023-11-28T12:08:31.436026+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:52:27.427485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.403958+0000","last_change":"2023-11-28T12:08:30.887392+0000","last_active":"2023-11-28T12:08:31.403958+0000","last_peered":"2023-11-28T12:08:31.403958+0000","last_clean":"2023-11-28T12:08:31.403958+0000","last_became_active":"2023-11-28T12:08:30.887096+0000","last_became_peered":"2023-11-28T12:08:30.887096+0000","last_unstale":"2023-11-28T12:08:31.403958+0000","last_undegraded":"2023-11-28T12:08:31.403958+0000","last_fullsized":"2023-11-28T12:08:31.403958+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_clean_scrub_stamp":"2023-11-28T12:08:29.858720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:13:34.399511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":40,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-28T12:08:30.878752+0000","last_change":"2023-11-28T12:06:23.517246+0000","last_active":"2023-11-28T12:08:30.878752+0000","last_peered":"2023-11-28T12:08:30.878752+0000","last_clean":"2023-11-28T12:08:30.878752+0000","last_became_active":"2023-11-28T12:06:23.516854+0000","last_became_peered":"2023-11-28T12:06:23.516854+0000","last_unstale":"2023-11-28T12:08:30.878752+0000","last_undegraded":"2023-11-28T12:08:30.878752+0000","last_fullsized":"2023-11-28T12:08:30.878752+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:51:06.844441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574878,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10000,"kb_used_data":1096,"kb_used_omap":0,"kb_used_meta":8896,"kb_avail":94361840,"statfs":{"total":96636764160,"available":96626524160,"internally_reserved":0,"allocated":1122304,"data_stored":816016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9109504},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:08:23 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.63600000000000001,"15min":0.625},"min":{"1min":0.46000000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.0409999999999999,"5min":1.141,"15min":1.141},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.70399999999999996,"15min":0.70799999999999996},"min":{"1min":0.46700000000000003,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.95099999999999996,"5min":2.7469999999999999,"15min":2.7469999999999999},"last":0.754}]},{"osd":1,"last update":"Tue Nov 28 12:08:23 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.627,"15min":0.61399999999999999},"min":{"1min":0.42199999999999999,"5min":0.374,"15min":0.374},"max":{"1min":1,"5min":1,"15min":1},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.60699999999999998,"15min":0.59899999999999998},"min":{"1min":0.45700000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.90300000000000002,"5min":1.171,"15min":1.171},"last":0.60799999999999998}]},{"osd":2,"last update":"Tue Nov 28 12:08:23 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.70399999999999996,"15min":0.70199999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.98899999999999999,"5min":1.819,"15min":1.819},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.754,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.54200000000000004,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.0680000000000001,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":0.67100000000000004}]},{"osd":3,"last update":"Tue Nov 28 12:08:23 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.68300000000000005,"15min":0.68000000000000005},"min":{"1min":0.441,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.88900000000000001,"5min":0.999,"15min":0.999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.73199999999999998,"15min":0.72399999999999998},"min":{"1min":0.54100000000000004,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.97399999999999998,"5min":1.103,"15min":1.103},"last":0.78300000000000003}]},{"osd":4,"last update":"Tue Nov 28 12:08:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.61499999999999999,"15min":0.61699999999999999},"min":{"1min":0.376,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.77400000000000002,"5min":0.878,"15min":0.878},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.72499999999999998,"15min":0.72399999999999998},"min":{"1min":0.48199999999999998,"5min":0.442,"15min":0.442},"max":{"1min":0.96099999999999997,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.72699999999999998}]},{"osd":5,"last update":"Tue Nov 28 12:08:23 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.48999999999999999,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.94299999999999995,"5min":1.044,"15min":1.044},"last":0.623},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.72599999999999998,"15min":0.72999999999999998},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.92800000000000005,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.79700000000000004}]},{"osd":6,"last update":"Tue Nov 28 12:08:23 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.66600000000000004,"15min":0.67200000000000004},"min":{"1min":0.48899999999999999,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.745,"5min":1.012,"15min":1.012},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.76700000000000002,"15min":0.77200000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.92400000000000004,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.76400000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574876,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8780,"kb_used_data":516,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363060,"statfs":{"total":96636764160,"available":96627773440,"internally_reserved":0,"allocated":528384,"data_stored":225648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:08:25 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.58099999999999996,"15min":0.57899999999999996},"min":{"1min":0.41499999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.81599999999999995,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.59799999999999998,"15min":0.59599999999999997},"min":{"1min":0.41199999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.625}]},{"osd":1,"last update":"Tue Nov 28 12:08:25 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.63100000000000001,"15min":0.629},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.69599999999999995,"15min":0.70299999999999996},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.88400000000000001,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.64800000000000002}]},{"osd":2,"last update":"Tue Nov 28 12:08:25 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.52400000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.625,"5min":0.63500000000000001,"15min":0.63700000000000001},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.73799999999999999}]},{"osd":3,"last update":"Tue Nov 28 12:08:25 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.71199999999999997,"15min":0.71999999999999997},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.82999999999999996,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.71299999999999997,"15min":0.71499999999999997},"min":{"1min":0.58299999999999996,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.79100000000000004}]},{"osd":4,"last update":"Tue Nov 28 12:08:25 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.66700000000000004,"15min":0.67300000000000004},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.49299999999999999,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.75900000000000001}]},{"osd":5,"last update":"Tue Nov 28 12:08:25 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.68899999999999995,"15min":0.69699999999999995},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.747,"5min":0.76800000000000002,"15min":0.77200000000000002},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.70599999999999996}]},{"osd":7,"last update":"Tue Nov 28 12:08:25 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.752,"15min":0.75600000000000001},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":0.91100000000000003,"5min":1.008,"15min":1.008},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.72299999999999998,"15min":0.72899999999999998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.60199999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13968,"kb_used_data":1096,"kb_used_omap":0,"kb_used_meta":12864,"kb_avail":94357872,"statfs":{"total":96636764160,"available":96622460928,"internally_reserved":0,"allocated":1122304,"data_stored":816016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13172736},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:08:24 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.433,"15min":0.438},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.318},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.49399999999999999,"15min":0.5},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.68999999999999995,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.42299999999999999}]},{"osd":2,"last update":"Tue Nov 28 12:08:24 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.46899999999999997,"15min":0.47299999999999998},"min":{"1min":0.34300000000000003,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.58799999999999997,"5min":1.111,"15min":1.111},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.441,"5min":0.48699999999999999,"15min":0.495},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.59999999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.48899999999999999}]},{"osd":3,"last update":"Tue Nov 28 12:08:24 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.57399999999999995,"15min":0.57499999999999996},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.78400000000000003,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.55700000000000005,"15min":0.55500000000000005},"min":{"1min":0.41699999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.81699999999999995,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.68700000000000006}]},{"osd":4,"last update":"Tue Nov 28 12:08:24 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.70199999999999996,"15min":0.70299999999999996},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.97399999999999998,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.754},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.748,"15min":0.752},"min":{"1min":0.55000000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.05,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.84899999999999998}]},{"osd":5,"last update":"Tue Nov 28 12:08:24 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.749,"15min":0.753},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.95799999999999996,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.75700000000000001,"15min":0.76000000000000001},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.22,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.79400000000000004}]},{"osd":6,"last update":"Tue Nov 28 12:08:24 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.76800000000000002,"15min":0.77600000000000002},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.98999999999999999,"5min":1.21,"15min":1.21},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.80000000000000004,"15min":0.80600000000000005},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.0289999999999999,"5min":1.502,"15min":1.502},"last":0.83999999999999997}]},{"osd":7,"last update":"Tue Nov 28 12:08:24 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.80100000000000005,"15min":0.80600000000000005},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.0109999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.77600000000000002,"15min":0.77800000000000002},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.044,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.81399999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12796,"kb_used_data":500,"kb_used_omap":0,"kb_used_meta":12288,"kb_avail":94359044,"statfs":{"total":96636764160,"available":96623661056,"internally_reserved":0,"allocated":512000,"data_stored":217659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12582912},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 12:08:24 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.39000000000000001,"15min":0.38400000000000001},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.498,"15min":0.502},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.70399999999999996,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.45000000000000001}]},{"osd":2,"last update":"Tue Nov 28 12:08:24 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.66700000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.499,"5min":0.54100000000000004,"15min":0.54800000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.69399999999999995,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.499}]},{"osd":3,"last update":"Tue Nov 28 12:08:24 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.52400000000000002,"15min":0.52600000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.73599999999999999,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.60499999999999998,"15min":0.60999999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.81899999999999995,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.54600000000000004}]},{"osd":4,"last update":"Tue Nov 28 12:08:24 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.79400000000000004,"15min":0.79800000000000004},"min":{"1min":0.53400000000000003,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.1859999999999999,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.57999999999999996,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.173,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.70099999999999996}]},{"osd":5,"last update":"Tue Nov 28 12:08:24 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.82399999999999995,"15min":0.83399999999999996},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.1539999999999999,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.80700000000000005,"15min":0.81200000000000006},"min":{"1min":0.59299999999999997,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.2370000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.77800000000000002}]},{"osd":6,"last update":"Tue Nov 28 12:08:24 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.80700000000000005,"15min":0.81000000000000005},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.1319999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.84099999999999997,"15min":0.85199999999999998},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.028,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.92000000000000004}]},{"osd":7,"last update":"Tue Nov 28 12:08:24 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.85599999999999998,"15min":0.86299999999999999},"min":{"1min":0.60199999999999998,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.073,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.876},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.80800000000000005,"15min":0.81200000000000006},"min":{"1min":0.58099999999999996,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.85999999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12812,"kb_used_data":516,"kb_used_omap":0,"kb_used_meta":12288,"kb_avail":94359028,"statfs":{"total":96636764160,"available":96623644672,"internally_reserved":0,"allocated":528384,"data_stored":225648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12582912},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:08:24 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.437,"15min":0.437},"min":{"1min":0.309,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.59899999999999998,"5min":0.745,"15min":0.745},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.45800000000000002,"15min":0.45500000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.32200000000000001}]},{"osd":1,"last update":"Tue Nov 28 12:08:24 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.48899999999999999,"15min":0.48699999999999999},"min":{"1min":0.39100000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.70199999999999996,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.439},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.504,"15min":0.50800000000000001},"min":{"1min":0.34300000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.59999999999999998,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.40699999999999997}]},{"osd":3,"last update":"Tue Nov 28 12:08:24 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.47299999999999998,"15min":0.47799999999999998},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.60299999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.56200000000000006,"15min":0.56799999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.65100000000000002,"5min":0.876,"15min":0.876},"last":0.59899999999999998}]},{"osd":4,"last update":"Tue Nov 28 12:08:24 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.82599999999999996,"15min":0.82899999999999996},"min":{"1min":0.61799999999999999,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.0109999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.81399999999999995,"15min":0.82099999999999995},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.95899999999999996,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.92500000000000004}]},{"osd":5,"last update":"Tue Nov 28 12:08:24 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.73999999999999999,"15min":0.74199999999999999},"min":{"1min":0.53300000000000003,"5min":0.497,"15min":0.497},"max":{"1min":0.97999999999999998,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.78600000000000003,"15min":0.78800000000000003},"min":{"1min":0.59099999999999997,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.93999999999999995,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.81100000000000005}]},{"osd":6,"last update":"Tue Nov 28 12:08:24 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.78200000000000003,"15min":0.78600000000000003},"min":{"1min":0.53800000000000003,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0229999999999999,"5min":1.077,"15min":1.077},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.79200000000000004,"15min":0.78800000000000003},"min":{"1min":0.61399999999999999,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.97599999999999998,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.83499999999999996}]},{"osd":7,"last update":"Tue Nov 28 12:08:24 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.80400000000000005,"15min":0.80700000000000005},"min":{"1min":0.54700000000000004,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.996,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.87},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.82299999999999995,"15min":0.82599999999999996},"min":{"1min":0.63,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.95199999999999996,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.74399999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574876,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12988,"kb_used_data":500,"kb_used_omap":0,"kb_used_meta":12480,"kb_avail":94358852,"statfs":{"total":96636764160,"available":96623464448,"internally_reserved":0,"allocated":512000,"data_stored":217659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12779520},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:08:25 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.436,"15min":0.44},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.433,"5min":0.44500000000000001,"15min":0.44700000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.42599999999999999}]},{"osd":1,"last update":"Tue Nov 28 12:08:25 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.443},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.52700000000000002,"15min":0.53300000000000003},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.75700000000000001,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.47299999999999998}]},{"osd":2,"last update":"Tue Nov 28 12:08:25 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.51800000000000002,"15min":0.52000000000000002},"min":{"1min":0.377,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.64900000000000002,"5min":1.022,"15min":1.022},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.56599999999999995,"15min":0.56999999999999995},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.45300000000000001}]},{"osd":4,"last update":"Tue Nov 28 12:08:25 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.70399999999999996,"15min":0.70199999999999996},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.94299999999999995,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.70599999999999996,"15min":0.70899999999999996},"min":{"1min":0.55100000000000005,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.92600000000000005,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.79100000000000004}]},{"osd":5,"last update":"Tue Nov 28 12:08:25 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.746,"15min":0.75},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.94099999999999995,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.77000000000000002,"15min":0.77800000000000002},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.91300000000000003,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.876}]},{"osd":6,"last update":"Tue Nov 28 12:08:25 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.76400000000000001,"15min":0.76600000000000001},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.98099999999999998,"5min":1.026,"15min":1.026},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.77500000000000002,"15min":0.78100000000000003},"min":{"1min":0.57199999999999995,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.93700000000000006,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.98699999999999999}]},{"osd":7,"last update":"Tue Nov 28 12:08:25 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.78600000000000003,"15min":0.79000000000000004},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.79400000000000004,"15min":0.79600000000000004},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.85599999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8908,"kb_used_data":516,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362932,"statfs":{"total":96636764160,"available":96627642368,"internally_reserved":0,"allocated":528384,"data_stored":225648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:08:25 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.64400000000000002,"15min":0.64700000000000002},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.89100000000000001,"5min":1.044,"15min":1.044},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.64400000000000002,"15min":0.65100000000000002},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.84199999999999997,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.73499999999999999}]},{"osd":1,"last update":"Tue Nov 28 12:08:25 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.65600000000000003,"15min":0.66200000000000003},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.85699999999999998,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.626,"5min":0.67500000000000004,"15min":0.68300000000000005},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.81899999999999995,"5min":1.097,"15min":1.097},"last":0.751}]},{"osd":2,"last update":"Tue Nov 28 12:08:25 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.70899999999999996,"15min":0.71599999999999997},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.84099999999999997,"5min":1.125,"15min":1.125},"last":0.745},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.72999999999999998,"15min":0.73999999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.89800000000000002,"5min":1.143,"15min":1.143},"last":0.78800000000000003}]},{"osd":3,"last update":"Tue Nov 28 12:08:25 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.66900000000000004,"15min":0.67700000000000005},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.83499999999999996,"5min":1.093,"15min":1.093},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.76900000000000002,"15min":0.77900000000000003},"min":{"1min":0.52600000000000002,"5min":0.5,"15min":0.5},"max":{"1min":0.879,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.71499999999999997}]},{"osd":5,"last update":"Tue Nov 28 12:08:25 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.71899999999999997,"15min":0.72899999999999998},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.86599999999999999,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.70699999999999996,"15min":0.71399999999999997},"min":{"1min":0.48499999999999999,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.88400000000000001,"5min":1.296,"15min":1.296},"last":0.46200000000000002}]},{"osd":6,"last update":"Tue Nov 28 12:08:25 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.753,"15min":0.75700000000000001},"min":{"1min":0.54600000000000004,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.95599999999999996,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.80500000000000005,"15min":0.81899999999999995},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.98299999999999998,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.59099999999999997}]},{"osd":7,"last update":"Tue Nov 28 12:08:25 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.78400000000000003,"15min":0.79800000000000004},"min":{"1min":0.54500000000000004,"5min":0.499,"15min":0.499},"max":{"1min":0.83299999999999996,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.84499999999999997,"15min":0.85699999999999998},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":0.92900000000000005,"5min":1.28,"15min":1.28},"last":0.56999999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8844,"kb_used_data":516,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94362996,"statfs":{"total":96636764160,"available":96627707904,"internally_reserved":0,"allocated":528384,"data_stored":225648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.64900000000000002,"15min":0.64600000000000002},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.95599999999999996,"5min":1.204,"15min":1.204},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.69899999999999995,"15min":0.69299999999999995},"min":{"1min":0.50600000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":1.026}]},{"osd":1,"last update":"Tue Nov 28 12:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.60599999999999998,"15min":0.58899999999999997},"min":{"1min":0.46700000000000003,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":1.1279999999999999},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.60899999999999999,"15min":0.60199999999999998},"min":{"1min":0.42999999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":1.0449999999999999}]},{"osd":2,"last update":"Tue Nov 28 12:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.67600000000000005,"15min":0.68100000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.145,"5min":1.173,"15min":1.173},"last":0.97599999999999998},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.68500000000000005,"15min":0.68999999999999995},"min":{"1min":0.46000000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.0129999999999999,"5min":1.298,"15min":1.298},"last":1.0129999999999999}]},{"osd":3,"last update":"Tue Nov 28 12:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.69499999999999995,"15min":0.69099999999999995},"min":{"1min":0.44700000000000001,"5min":0.438,"15min":0.438},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.74399999999999999,"15min":0.747},"min":{"1min":0.57599999999999996,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.94599999999999995,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.94599999999999995}]},{"osd":4,"last update":"Tue Nov 28 12:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.70499999999999996,"15min":0.70899999999999996},"min":{"1min":0.47099999999999997,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.92000000000000004,"5min":1.141,"15min":1.141},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.77800000000000002,"15min":0.77200000000000002},"min":{"1min":0.621,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":1.2270000000000001}]},{"osd":6,"last update":"Tue Nov 28 12:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.76000000000000001,"15min":0.76300000000000001},"min":{"1min":0.52500000000000002,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":1.264},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.997}]},{"osd":7,"last update":"Tue Nov 28 12:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.75700000000000001,"15min":0.76100000000000001},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.78100000000000003,"15min":0.78900000000000003},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.96199999999999997,"5min":1.008,"15min":1.008},"last":0.71799999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T12:08:36.304 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T12:08:36.429 INFO:tasks.ceph.mds.c.smithi045.stderr:2023-11-28T12:08:36.429+0000 7f9ea4ff1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-28T12:08:36.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.542+0000 7f137ffff700 1 Processor -- start 2023-11-28T12:08:36.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.542+0000 7f137ffff700 1 -- start start 2023-11-28T12:08:36.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.543+0000 7f137ffff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f1378159860 0x7f13780c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:36.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.543+0000 7f137ffff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13780ccc00 con 0x7f1378159490 2023-11-28T12:08:36.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.543+0000 7f137ffff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13780ccec0 con 0x7f13780b0d80 2023-11-28T12:08:36.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.543+0000 7f137ffff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13780cd1a0 con 0x7f1378159860 2023-11-28T12:08:36.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.544+0000 7f137dd9b700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f1378159490 0x7f13780b0670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:42916/0 (socket says 172.21.15.45:42916) 2023-11-28T12:08:36.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.544+0000 7f137dd9b700 1 -- 172.21.15.45:0/3519154943 learned_addr learned my addr 172.21.15.45:0/3519154943 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:08:36.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.544+0000 7f137d59a700 1 --2- 172.21.15.45:0/3519154943 >> v2:172.21.15.152:3300/0 conn(0x7f1378159860 0x7f13780c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:36.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.544+0000 7f137cd99700 1 -- 172.21.15.45:0/3519154943 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2833820049 0 0) 0x7f13780ccc00 con 0x7f1378159490 2023-11-28T12:08:36.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.544+0000 7f137cd99700 1 -- 172.21.15.45:0/3519154943 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13640035b0 con 0x7f1378159490 2023-11-28T12:08:36.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.544+0000 7f137cd99700 1 -- 172.21.15.45:0/3519154943 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4153324220 0 0) 0x7f13780ccec0 con 0x7f13780b0d80 2023-11-28T12:08:36.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.544+0000 7f137cd99700 1 -- 172.21.15.45:0/3519154943 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13780ccc00 con 0x7f13780b0d80 2023-11-28T12:08:36.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.544+0000 7f137d59a700 1 -- 172.21.15.45:0/3519154943 >> v1:172.21.15.152:6789/0 conn(0x7f13780b0d80 legacy=0x7f13780c9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:36.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.544+0000 7f137d59a700 1 -- 172.21.15.45:0/3519154943 >> v1:172.21.15.45:6789/0 conn(0x7f1378159490 legacy=0x7f13780b0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:36.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.544+0000 7f137d59a700 1 -- 172.21.15.45:0/3519154943 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13780cd480 con 0x7f1378159860 2023-11-28T12:08:36.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.545+0000 7f137d59a700 1 --2- 172.21.15.45:0/3519154943 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1378159860 0x7f13780c94c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1368009840 tx=0x7f1368009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c458a5e81ea2288 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:36.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.545+0000 7f137cd99700 1 -- 172.21.15.45:0/3519154943 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1368011830 con 0x7f1378159860 2023-11-28T12:08:36.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.545+0000 7f137cd99700 1 -- 172.21.15.45:0/3519154943 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1368011990 con 0x7f1378159860 2023-11-28T12:08:36.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.545+0000 7f137cd99700 1 -- 172.21.15.45:0/3519154943 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1368011d20 con 0x7f1378159860 2023-11-28T12:08:36.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.546+0000 7f137ffff700 1 -- 172.21.15.45:0/3519154943 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1378159860 msgr2=0x7f13780c94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:36.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.546+0000 7f137ffff700 1 --2- 172.21.15.45:0/3519154943 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1378159860 0x7f13780c94c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1368009840 tx=0x7f1368009b50 comp rx=0 tx=0).stop 2023-11-28T12:08:36.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.546+0000 7f137ffff700 1 -- 172.21.15.45:0/3519154943 shutdown_connections 2023-11-28T12:08:36.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.546+0000 7f137ffff700 1 --2- 172.21.15.45:0/3519154943 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1378159860 0x7f13780c94c0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:36.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.546+0000 7f137ffff700 1 -- 172.21.15.45:0/3519154943 >> 172.21.15.45:0/3519154943 conn(0x7f13780cb670 msgr2=0x7f13780cba70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:36.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.546+0000 7f137ffff700 1 -- 172.21.15.45:0/3519154943 shutdown_connections 2023-11-28T12:08:36.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.546+0000 7f137ffff700 1 -- 172.21.15.45:0/3519154943 wait complete. 2023-11-28T12:08:36.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.548+0000 7f137ffff700 1 Processor -- start 2023-11-28T12:08:36.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.548+0000 7f137ffff700 1 -- start start 2023-11-28T12:08:36.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.549+0000 7f137ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13780b0d80 0x7f13780c74b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:36.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.549+0000 7f137ffff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1378159490 0x7f1378153540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:36.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.549+0000 7f137ffff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f13781e3fd0 0x7f137806b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:36.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.549+0000 7f137ffff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13780c8780 con 0x7f13780b0d80 2023-11-28T12:08:36.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.549+0000 7f137ffff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13780c7b00 con 0x7f1378159490 2023-11-28T12:08:36.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.549+0000 7f137ffff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13780c7de0 con 0x7f13781e3fd0 2023-11-28T12:08:36.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.549+0000 7f137dd9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13780b0d80 0x7f13780c74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:36.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.549+0000 7f137dd9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13780b0d80 0x7f13780c74b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59728/0 (socket says 172.21.15.45:59728) 2023-11-28T12:08:36.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.549+0000 7f137dd9b700 1 -- 172.21.15.45:0/2251740001 learned_addr learned my addr 172.21.15.45:0/2251740001 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:36.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.549+0000 7f137dd9b700 1 -- 172.21.15.45:0/2251740001 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f13781e3fd0 msgr2=0x7f137806b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:36.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.549+0000 7f137d59a700 1 --2- 172.21.15.45:0/2251740001 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1378159490 0x7f1378153540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:36.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.549+0000 7f137e59c700 1 --2- 172.21.15.45:0/2251740001 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f13781e3fd0 0x7f137806b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:36.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.549+0000 7f137dd9b700 1 --2- 172.21.15.45:0/2251740001 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f13781e3fd0 0x7f137806b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:36.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.549+0000 7f137dd9b700 1 -- 172.21.15.45:0/2251740001 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1378159490 msgr2=0x7f1378153540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:36.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.549+0000 7f137dd9b700 1 --2- 172.21.15.45:0/2251740001 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1378159490 0x7f1378153540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:36.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.549+0000 7f137dd9b700 1 -- 172.21.15.45:0/2251740001 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13680094a0 con 0x7f13780b0d80 2023-11-28T12:08:36.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.549+0000 7f137d59a700 1 --2- 172.21.15.45:0/2251740001 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1378159490 0x7f1378153540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:08:36.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.549+0000 7f137e59c700 1 --2- 172.21.15.45:0/2251740001 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f13781e3fd0 0x7f137806b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:08:36.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.550+0000 7f137dd9b700 1 --2- 172.21.15.45:0/2251740001 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13780b0d80 0x7f13780c74b0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f137400c700 tx=0x7f137400cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:36.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.550+0000 7f136e7fc700 1 -- 172.21.15.45:0/2251740001 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1374005d70 con 0x7f13780b0d80 2023-11-28T12:08:36.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.550+0000 7f136e7fc700 1 -- 172.21.15.45:0/2251740001 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13740070d0 con 0x7f13780b0d80 2023-11-28T12:08:36.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.550+0000 7f137ffff700 1 -- 172.21.15.45:0/2251740001 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13780cdc80 con 0x7f13780b0d80 2023-11-28T12:08:36.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.550+0000 7f136e7fc700 1 -- 172.21.15.45:0/2251740001 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1374007480 con 0x7f13780b0d80 2023-11-28T12:08:36.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.550+0000 7f137ffff700 1 -- 172.21.15.45:0/2251740001 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13780cd760 con 0x7f13780b0d80 2023-11-28T12:08:36.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.551+0000 7f137ffff700 1 -- 172.21.15.45:0/2251740001 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13780cde10 con 0x7f13780b0d80 2023-11-28T12:08:36.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.552+0000 7f136e7fc700 1 -- 172.21.15.45:0/2251740001 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f1374019030 con 0x7f13780b0d80 2023-11-28T12:08:36.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.553+0000 7f136e7fc700 1 --2- 172.21.15.45:0/2251740001 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f135c0682f0 0x7f135c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:36.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.553+0000 7f136e7fc700 1 -- 172.21.15.45:0/2251740001 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1374085240 con 0x7f13780b0d80 2023-11-28T12:08:36.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.553+0000 7f137d59a700 1 --2- 172.21.15.45:0/2251740001 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f135c0682f0 0x7f135c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:36.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.554+0000 7f137d59a700 1 --2- 172.21.15.45:0/2251740001 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f135c0682f0 0x7f135c06a7a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f137815c1a0 tx=0x7f136801c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:36.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.557+0000 7f136e7fc700 1 -- 172.21.15.45:0/2251740001 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f1374051a20 con 0x7f13780b0d80 2023-11-28T12:08:36.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.758+0000 7f137ffff700 1 -- 172.21.15.45:0/2251740001 --> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f13780c88c0 con 0x7f135c0682f0 2023-11-28T12:08:36.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.768+0000 7f136e7fc700 1 -- 172.21.15.45:0/2251740001 <== mgr.4100 v2:172.21.15.152:6832/115389 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311074 (secure 0 0 0) 0x7f13780c88c0 con 0x7f135c0682f0 2023-11-28T12:08:36.773 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:08:36.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.772+0000 7f137ffff700 1 -- 172.21.15.45:0/2251740001 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f135c0682f0 msgr2=0x7f135c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:36.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.772+0000 7f137ffff700 1 --2- 172.21.15.45:0/2251740001 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f135c0682f0 0x7f135c06a7a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f137815c1a0 tx=0x7f136801c040 comp rx=0 tx=0).stop 2023-11-28T12:08:36.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.772+0000 7f137ffff700 1 -- 172.21.15.45:0/2251740001 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13780b0d80 msgr2=0x7f13780c74b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:36.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.772+0000 7f137ffff700 1 --2- 172.21.15.45:0/2251740001 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13780b0d80 0x7f13780c74b0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f137400c700 tx=0x7f137400cac0 comp rx=0 tx=0).stop 2023-11-28T12:08:36.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.772+0000 7f137ffff700 1 -- 172.21.15.45:0/2251740001 shutdown_connections 2023-11-28T12:08:36.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.772+0000 7f137ffff700 1 --2- 172.21.15.45:0/2251740001 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f135c0682f0 0x7f135c06a7a0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:36.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.772+0000 7f137ffff700 1 --2- 172.21.15.45:0/2251740001 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f13781e3fd0 0x7f137806b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:36.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.772+0000 7f137ffff700 1 --2- 172.21.15.45:0/2251740001 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13780b0d80 0x7f13780c74b0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:36.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.772+0000 7f137ffff700 1 --2- 172.21.15.45:0/2251740001 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1378159490 0x7f1378153540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:36.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.772+0000 7f137ffff700 1 -- 172.21.15.45:0/2251740001 >> 172.21.15.45:0/2251740001 conn(0x7f13780cb670 msgr2=0x7f13780cba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:36.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.772+0000 7f137ffff700 1 -- 172.21.15.45:0/2251740001 shutdown_connections 2023-11-28T12:08:36.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:36.772+0000 7f137ffff700 1 -- 172.21.15.45:0/2251740001 wait complete. 2023-11-28T12:08:36.777 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-11-28T12:08:36.791 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":108,"stamp":"2023-11-28T12:08:36.456588+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":30,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":89096,"kb_used_data":5256,"kb_used_omap":0,"kb_used_meta":83776,"kb_avail":754885624,"statfs":{"total":773094113280,"available":773002878976,"internally_reserved":0,"allocated":5382144,"data_stored":2969942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":85786624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001436"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.416963+0000","last_change":"2023-11-28T12:08:31.411889+0000","last_active":"2023-11-28T12:08:31.416963+0000","last_peered":"2023-11-28T12:08:31.416963+0000","last_clean":"2023-11-28T12:08:31.416963+0000","last_became_active":"2023-11-28T12:08:31.411637+0000","last_became_peered":"2023-11-28T12:08:31.411637+0000","last_unstale":"2023-11-28T12:08:31.416963+0000","last_undegraded":"2023-11-28T12:08:31.416963+0000","last_fullsized":"2023-11-28T12:08:31.416963+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:40:54.842854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.419854+0000","last_change":"2023-11-28T12:08:31.415154+0000","last_active":"2023-11-28T12:08:31.419854+0000","last_peered":"2023-11-28T12:08:31.419854+0000","last_clean":"2023-11-28T12:08:31.419854+0000","last_became_active":"2023-11-28T12:08:31.414223+0000","last_became_peered":"2023-11-28T12:08:31.414223+0000","last_unstale":"2023-11-28T12:08:31.419854+0000","last_undegraded":"2023-11-28T12:08:31.419854+0000","last_fullsized":"2023-11-28T12:08:31.419854+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:52:43.776270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.436209+0000","last_change":"2023-11-28T12:08:31.426400+0000","last_active":"2023-11-28T12:08:31.436209+0000","last_peered":"2023-11-28T12:08:31.436209+0000","last_clean":"2023-11-28T12:08:31.436209+0000","last_became_active":"2023-11-28T12:08:31.425927+0000","last_became_peered":"2023-11-28T12:08:31.425927+0000","last_unstale":"2023-11-28T12:08:31.436209+0000","last_undegraded":"2023-11-28T12:08:31.436209+0000","last_fullsized":"2023-11-28T12:08:31.436209+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:41:50.583641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.432526+0000","last_change":"2023-11-28T12:08:31.427419+0000","last_active":"2023-11-28T12:08:31.432526+0000","last_peered":"2023-11-28T12:08:31.432526+0000","last_clean":"2023-11-28T12:08:31.432526+0000","last_became_active":"2023-11-28T12:08:31.427030+0000","last_became_peered":"2023-11-28T12:08:31.427030+0000","last_unstale":"2023-11-28T12:08:31.432526+0000","last_undegraded":"2023-11-28T12:08:31.432526+0000","last_fullsized":"2023-11-28T12:08:31.432526+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:48:30.989278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.422560+0000","last_change":"2023-11-28T12:08:31.414532+0000","last_active":"2023-11-28T12:08:31.422560+0000","last_peered":"2023-11-28T12:08:31.422560+0000","last_clean":"2023-11-28T12:08:31.422560+0000","last_became_active":"2023-11-28T12:08:31.414241+0000","last_became_peered":"2023-11-28T12:08:31.414241+0000","last_unstale":"2023-11-28T12:08:31.422560+0000","last_undegraded":"2023-11-28T12:08:31.422560+0000","last_fullsized":"2023-11-28T12:08:31.422560+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:25:20.920288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.418958+0000","last_change":"2023-11-28T12:08:31.416815+0000","last_active":"2023-11-28T12:08:31.418958+0000","last_peered":"2023-11-28T12:08:31.418958+0000","last_clean":"2023-11-28T12:08:31.418958+0000","last_became_active":"2023-11-28T12:08:31.415898+0000","last_became_peered":"2023-11-28T12:08:31.415898+0000","last_unstale":"2023-11-28T12:08:31.418958+0000","last_undegraded":"2023-11-28T12:08:31.418958+0000","last_fullsized":"2023-11-28T12:08:31.418958+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:53:19.332201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.435649+0000","last_change":"2023-11-28T12:08:31.422584+0000","last_active":"2023-11-28T12:08:31.435649+0000","last_peered":"2023-11-28T12:08:31.435649+0000","last_clean":"2023-11-28T12:08:31.435649+0000","last_became_active":"2023-11-28T12:08:31.422330+0000","last_became_peered":"2023-11-28T12:08:31.422330+0000","last_unstale":"2023-11-28T12:08:31.435649+0000","last_undegraded":"2023-11-28T12:08:31.435649+0000","last_fullsized":"2023-11-28T12:08:31.435649+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:15:00.988809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.426129+0000","last_change":"2023-11-28T12:08:31.418496+0000","last_active":"2023-11-28T12:08:31.426129+0000","last_peered":"2023-11-28T12:08:31.426129+0000","last_clean":"2023-11-28T12:08:31.426129+0000","last_became_active":"2023-11-28T12:08:31.418174+0000","last_became_peered":"2023-11-28T12:08:31.418174+0000","last_unstale":"2023-11-28T12:08:31.426129+0000","last_undegraded":"2023-11-28T12:08:31.426129+0000","last_fullsized":"2023-11-28T12:08:31.426129+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:36:46.042850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.432231+0000","last_change":"2023-11-28T12:08:31.428730+0000","last_active":"2023-11-28T12:08:31.432231+0000","last_peered":"2023-11-28T12:08:31.432231+0000","last_clean":"2023-11-28T12:08:31.432231+0000","last_became_active":"2023-11-28T12:08:31.428461+0000","last_became_peered":"2023-11-28T12:08:31.428461+0000","last_unstale":"2023-11-28T12:08:31.432231+0000","last_undegraded":"2023-11-28T12:08:31.432231+0000","last_fullsized":"2023-11-28T12:08:31.432231+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:46:20.961979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.423205+0000","last_change":"2023-11-28T12:08:31.421320+0000","last_active":"2023-11-28T12:08:31.423205+0000","last_peered":"2023-11-28T12:08:31.423205+0000","last_clean":"2023-11-28T12:08:31.423205+0000","last_became_active":"2023-11-28T12:08:31.421064+0000","last_became_peered":"2023-11-28T12:08:31.421064+0000","last_unstale":"2023-11-28T12:08:31.423205+0000","last_undegraded":"2023-11-28T12:08:31.423205+0000","last_fullsized":"2023-11-28T12:08:31.423205+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:26:21.456316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.422469+0000","last_change":"2023-11-28T12:08:31.420016+0000","last_active":"2023-11-28T12:08:31.422469+0000","last_peered":"2023-11-28T12:08:31.422469+0000","last_clean":"2023-11-28T12:08:31.422469+0000","last_became_active":"2023-11-28T12:08:31.419491+0000","last_became_peered":"2023-11-28T12:08:31.419491+0000","last_unstale":"2023-11-28T12:08:31.422469+0000","last_undegraded":"2023-11-28T12:08:31.422469+0000","last_fullsized":"2023-11-28T12:08:31.422469+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:38:24.187496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.431303+0000","last_change":"2023-11-28T12:08:31.428012+0000","last_active":"2023-11-28T12:08:31.431303+0000","last_peered":"2023-11-28T12:08:31.431303+0000","last_clean":"2023-11-28T12:08:31.431303+0000","last_became_active":"2023-11-28T12:08:31.424940+0000","last_became_peered":"2023-11-28T12:08:31.424940+0000","last_unstale":"2023-11-28T12:08:31.431303+0000","last_undegraded":"2023-11-28T12:08:31.431303+0000","last_fullsized":"2023-11-28T12:08:31.431303+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:47:24.478600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.427510+0000","last_change":"2023-11-28T12:08:31.424025+0000","last_active":"2023-11-28T12:08:31.427510+0000","last_peered":"2023-11-28T12:08:31.427510+0000","last_clean":"2023-11-28T12:08:31.427510+0000","last_became_active":"2023-11-28T12:08:31.423749+0000","last_became_peered":"2023-11-28T12:08:31.423749+0000","last_unstale":"2023-11-28T12:08:31.427510+0000","last_undegraded":"2023-11-28T12:08:31.427510+0000","last_fullsized":"2023-11-28T12:08:31.427510+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:35:36.691841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.428241+0000","last_change":"2023-11-28T12:08:31.417955+0000","last_active":"2023-11-28T12:08:31.428241+0000","last_peered":"2023-11-28T12:08:31.428241+0000","last_clean":"2023-11-28T12:08:31.428241+0000","last_became_active":"2023-11-28T12:08:31.417577+0000","last_became_peered":"2023-11-28T12:08:31.417577+0000","last_unstale":"2023-11-28T12:08:31.428241+0000","last_undegraded":"2023-11-28T12:08:31.428241+0000","last_fullsized":"2023-11-28T12:08:31.428241+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:45:26.304856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.412479+0000","last_change":"2023-11-28T12:08:31.407807+0000","last_active":"2023-11-28T12:08:31.412479+0000","last_peered":"2023-11-28T12:08:31.412479+0000","last_clean":"2023-11-28T12:08:31.412479+0000","last_became_active":"2023-11-28T12:08:31.406313+0000","last_became_peered":"2023-11-28T12:08:31.406313+0000","last_unstale":"2023-11-28T12:08:31.412479+0000","last_undegraded":"2023-11-28T12:08:31.412479+0000","last_fullsized":"2023-11-28T12:08:31.412479+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:49:15.864164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.419820+0000","last_change":"2023-11-28T12:08:31.419119+0000","last_active":"2023-11-28T12:08:31.419820+0000","last_peered":"2023-11-28T12:08:31.419820+0000","last_clean":"2023-11-28T12:08:31.419820+0000","last_became_active":"2023-11-28T12:08:31.418680+0000","last_became_peered":"2023-11-28T12:08:31.418680+0000","last_unstale":"2023-11-28T12:08:31.419820+0000","last_undegraded":"2023-11-28T12:08:31.419820+0000","last_fullsized":"2023-11-28T12:08:31.419820+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:36:07.372204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.435591+0000","last_change":"2023-11-28T12:08:31.422062+0000","last_active":"2023-11-28T12:08:31.435591+0000","last_peered":"2023-11-28T12:08:31.435591+0000","last_clean":"2023-11-28T12:08:31.435591+0000","last_became_active":"2023-11-28T12:08:31.421620+0000","last_became_peered":"2023-11-28T12:08:31.421620+0000","last_unstale":"2023-11-28T12:08:31.435591+0000","last_undegraded":"2023-11-28T12:08:31.435591+0000","last_fullsized":"2023-11-28T12:08:31.435591+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:51:41.950131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.419874+0000","last_change":"2023-11-28T12:08:31.415406+0000","last_active":"2023-11-28T12:08:31.419874+0000","last_peered":"2023-11-28T12:08:31.419874+0000","last_clean":"2023-11-28T12:08:31.419874+0000","last_became_active":"2023-11-28T12:08:31.414772+0000","last_became_peered":"2023-11-28T12:08:31.414772+0000","last_unstale":"2023-11-28T12:08:31.419874+0000","last_undegraded":"2023-11-28T12:08:31.419874+0000","last_fullsized":"2023-11-28T12:08:31.419874+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:53:27.068927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.436192+0000","last_change":"2023-11-28T12:08:31.426200+0000","last_active":"2023-11-28T12:08:31.436192+0000","last_peered":"2023-11-28T12:08:31.436192+0000","last_clean":"2023-11-28T12:08:31.436192+0000","last_became_active":"2023-11-28T12:08:31.425600+0000","last_became_peered":"2023-11-28T12:08:31.425600+0000","last_unstale":"2023-11-28T12:08:31.436192+0000","last_undegraded":"2023-11-28T12:08:31.436192+0000","last_fullsized":"2023-11-28T12:08:31.436192+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:47:24.969667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.420281+0000","last_change":"2023-11-28T12:08:31.412577+0000","last_active":"2023-11-28T12:08:31.420281+0000","last_peered":"2023-11-28T12:08:31.420281+0000","last_clean":"2023-11-28T12:08:31.420281+0000","last_became_active":"2023-11-28T12:08:31.412298+0000","last_became_peered":"2023-11-28T12:08:31.412298+0000","last_unstale":"2023-11-28T12:08:31.420281+0000","last_undegraded":"2023-11-28T12:08:31.420281+0000","last_fullsized":"2023-11-28T12:08:31.420281+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:17:04.004236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.419978+0000","last_change":"2023-11-28T12:08:31.409775+0000","last_active":"2023-11-28T12:08:31.419978+0000","last_peered":"2023-11-28T12:08:31.419978+0000","last_clean":"2023-11-28T12:08:31.419978+0000","last_became_active":"2023-11-28T12:08:31.409467+0000","last_became_peered":"2023-11-28T12:08:31.409467+0000","last_unstale":"2023-11-28T12:08:31.419978+0000","last_undegraded":"2023-11-28T12:08:31.419978+0000","last_fullsized":"2023-11-28T12:08:31.419978+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:40:40.363195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.431194+0000","last_change":"2023-11-28T12:08:31.427447+0000","last_active":"2023-11-28T12:08:31.431194+0000","last_peered":"2023-11-28T12:08:31.431194+0000","last_clean":"2023-11-28T12:08:31.431194+0000","last_became_active":"2023-11-28T12:08:31.426911+0000","last_became_peered":"2023-11-28T12:08:31.426911+0000","last_unstale":"2023-11-28T12:08:31.431194+0000","last_undegraded":"2023-11-28T12:08:31.431194+0000","last_fullsized":"2023-11-28T12:08:31.431194+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:51:57.572624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.428376+0000","last_change":"2023-11-28T12:08:31.414257+0000","last_active":"2023-11-28T12:08:31.428376+0000","last_peered":"2023-11-28T12:08:31.428376+0000","last_clean":"2023-11-28T12:08:31.428376+0000","last_became_active":"2023-11-28T12:08:31.413965+0000","last_became_peered":"2023-11-28T12:08:31.413965+0000","last_unstale":"2023-11-28T12:08:31.428376+0000","last_undegraded":"2023-11-28T12:08:31.428376+0000","last_fullsized":"2023-11-28T12:08:31.428376+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:39:07.341993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.427134+0000","last_change":"2023-11-28T12:08:31.419380+0000","last_active":"2023-11-28T12:08:31.427134+0000","last_peered":"2023-11-28T12:08:31.427134+0000","last_clean":"2023-11-28T12:08:31.427134+0000","last_became_active":"2023-11-28T12:08:31.418301+0000","last_became_peered":"2023-11-28T12:08:31.418301+0000","last_unstale":"2023-11-28T12:08:31.427134+0000","last_undegraded":"2023-11-28T12:08:31.427134+0000","last_fullsized":"2023-11-28T12:08:31.427134+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:36:46.042850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.436899+0000","last_change":"2023-11-28T12:08:31.434974+0000","last_active":"2023-11-28T12:08:31.436899+0000","last_peered":"2023-11-28T12:08:31.436899+0000","last_clean":"2023-11-28T12:08:31.436899+0000","last_became_active":"2023-11-28T12:08:31.434757+0000","last_became_peered":"2023-11-28T12:08:31.434757+0000","last_unstale":"2023-11-28T12:08:31.436899+0000","last_undegraded":"2023-11-28T12:08:31.436899+0000","last_fullsized":"2023-11-28T12:08:31.436899+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:33:18.485327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.432329+0000","last_change":"2023-11-28T12:08:31.429685+0000","last_active":"2023-11-28T12:08:31.432329+0000","last_peered":"2023-11-28T12:08:31.432329+0000","last_clean":"2023-11-28T12:08:31.432329+0000","last_became_active":"2023-11-28T12:08:31.429391+0000","last_became_peered":"2023-11-28T12:08:31.429391+0000","last_unstale":"2023-11-28T12:08:31.432329+0000","last_undegraded":"2023-11-28T12:08:31.432329+0000","last_fullsized":"2023-11-28T12:08:31.432329+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:46:19.524019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.434341+0000","last_change":"2023-11-28T12:08:31.432889+0000","last_active":"2023-11-28T12:08:31.434341+0000","last_peered":"2023-11-28T12:08:31.434341+0000","last_clean":"2023-11-28T12:08:31.434341+0000","last_became_active":"2023-11-28T12:08:31.432588+0000","last_became_peered":"2023-11-28T12:08:31.432588+0000","last_unstale":"2023-11-28T12:08:31.434341+0000","last_undegraded":"2023-11-28T12:08:31.434341+0000","last_fullsized":"2023-11-28T12:08:31.434341+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:48:58.460869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.421053+0000","last_change":"2023-11-28T12:08:31.417348+0000","last_active":"2023-11-28T12:08:31.421053+0000","last_peered":"2023-11-28T12:08:31.421053+0000","last_clean":"2023-11-28T12:08:31.421053+0000","last_became_active":"2023-11-28T12:08:31.417043+0000","last_became_peered":"2023-11-28T12:08:31.417043+0000","last_unstale":"2023-11-28T12:08:31.421053+0000","last_undegraded":"2023-11-28T12:08:31.421053+0000","last_fullsized":"2023-11-28T12:08:31.421053+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:38:47.446743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.435520+0000","last_change":"2023-11-28T12:08:31.421323+0000","last_active":"2023-11-28T12:08:31.435520+0000","last_peered":"2023-11-28T12:08:31.435520+0000","last_clean":"2023-11-28T12:08:31.435520+0000","last_became_active":"2023-11-28T12:08:31.421074+0000","last_became_peered":"2023-11-28T12:08:31.421074+0000","last_unstale":"2023-11-28T12:08:31.435520+0000","last_undegraded":"2023-11-28T12:08:31.435520+0000","last_fullsized":"2023-11-28T12:08:31.435520+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:14:30.799554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.416672+0000","last_change":"2023-11-28T12:08:31.411310+0000","last_active":"2023-11-28T12:08:31.416672+0000","last_peered":"2023-11-28T12:08:31.416672+0000","last_clean":"2023-11-28T12:08:31.416672+0000","last_became_active":"2023-11-28T12:08:31.410976+0000","last_became_peered":"2023-11-28T12:08:31.410976+0000","last_unstale":"2023-11-28T12:08:31.416672+0000","last_undegraded":"2023-11-28T12:08:31.416672+0000","last_fullsized":"2023-11-28T12:08:31.416672+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:50:07.890432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.428951+0000","last_change":"2023-11-28T12:08:31.418063+0000","last_active":"2023-11-28T12:08:31.428951+0000","last_peered":"2023-11-28T12:08:31.428951+0000","last_clean":"2023-11-28T12:08:31.428951+0000","last_became_active":"2023-11-28T12:08:31.417788+0000","last_became_peered":"2023-11-28T12:08:31.417788+0000","last_unstale":"2023-11-28T12:08:31.428951+0000","last_undegraded":"2023-11-28T12:08:31.428951+0000","last_fullsized":"2023-11-28T12:08:31.428951+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:46:19.524019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.430196+0000","last_change":"2023-11-28T12:08:31.427702+0000","last_active":"2023-11-28T12:08:31.430196+0000","last_peered":"2023-11-28T12:08:31.430196+0000","last_clean":"2023-11-28T12:08:31.430196+0000","last_became_active":"2023-11-28T12:08:31.427170+0000","last_became_peered":"2023-11-28T12:08:31.427170+0000","last_unstale":"2023-11-28T12:08:31.430196+0000","last_undegraded":"2023-11-28T12:08:31.430196+0000","last_fullsized":"2023-11-28T12:08:31.430196+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:54:44.440250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.419654+0000","last_change":"2023-11-28T12:08:31.414564+0000","last_active":"2023-11-28T12:08:31.419654+0000","last_peered":"2023-11-28T12:08:31.419654+0000","last_clean":"2023-11-28T12:08:31.419654+0000","last_became_active":"2023-11-28T12:08:31.414279+0000","last_became_peered":"2023-11-28T12:08:31.414279+0000","last_unstale":"2023-11-28T12:08:31.419654+0000","last_undegraded":"2023-11-28T12:08:31.419654+0000","last_fullsized":"2023-11-28T12:08:31.419654+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:52:27.427485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"46'4","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.425401+0000","last_change":"2023-11-28T12:08:30.891019+0000","last_active":"2023-11-28T12:08:31.425401+0000","last_peered":"2023-11-28T12:08:31.425401+0000","last_clean":"2023-11-28T12:08:31.425401+0000","last_became_active":"2023-11-28T12:08:30.890448+0000","last_became_peered":"2023-11-28T12:08:30.890448+0000","last_unstale":"2023-11-28T12:08:31.425401+0000","last_undegraded":"2023-11-28T12:08:31.425401+0000","last_fullsized":"2023-11-28T12:08:31.425401+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_clean_scrub_stamp":"2023-11-28T12:08:29.858720+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:38:23.184241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.418778+0000","last_change":"2023-11-28T12:08:31.412654+0000","last_active":"2023-11-28T12:08:31.418778+0000","last_peered":"2023-11-28T12:08:31.418778+0000","last_clean":"2023-11-28T12:08:31.418778+0000","last_became_active":"2023-11-28T12:08:31.412390+0000","last_became_peered":"2023-11-28T12:08:31.412390+0000","last_unstale":"2023-11-28T12:08:31.418778+0000","last_undegraded":"2023-11-28T12:08:31.418778+0000","last_fullsized":"2023-11-28T12:08:31.418778+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:13:35.402766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"46'1","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.427198+0000","last_change":"2023-11-28T12:08:30.897694+0000","last_active":"2023-11-28T12:08:31.427198+0000","last_peered":"2023-11-28T12:08:31.427198+0000","last_clean":"2023-11-28T12:08:31.427198+0000","last_became_active":"2023-11-28T12:08:30.897378+0000","last_became_peered":"2023-11-28T12:08:30.897378+0000","last_unstale":"2023-11-28T12:08:31.427198+0000","last_undegraded":"2023-11-28T12:08:31.427198+0000","last_fullsized":"2023-11-28T12:08:31.427198+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_clean_scrub_stamp":"2023-11-28T12:08:29.858720+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:13:25.938388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.420204+0000","last_change":"2023-11-28T12:08:31.410860+0000","last_active":"2023-11-28T12:08:31.420204+0000","last_peered":"2023-11-28T12:08:31.420204+0000","last_clean":"2023-11-28T12:08:31.420204+0000","last_became_active":"2023-11-28T12:08:31.410585+0000","last_became_peered":"2023-11-28T12:08:31.410585+0000","last_unstale":"2023-11-28T12:08:31.420204+0000","last_undegraded":"2023-11-28T12:08:31.420204+0000","last_fullsized":"2023-11-28T12:08:31.420204+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:19:44.186674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"46'2","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.420014+0000","last_change":"2023-11-28T12:08:30.890294+0000","last_active":"2023-11-28T12:08:31.420014+0000","last_peered":"2023-11-28T12:08:31.420014+0000","last_clean":"2023-11-28T12:08:31.420014+0000","last_became_active":"2023-11-28T12:08:30.889889+0000","last_became_peered":"2023-11-28T12:08:30.889889+0000","last_unstale":"2023-11-28T12:08:31.420014+0000","last_undegraded":"2023-11-28T12:08:31.420014+0000","last_fullsized":"2023-11-28T12:08:31.420014+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_clean_scrub_stamp":"2023-11-28T12:08:29.858720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:49:17.471742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.428668+0000","last_change":"2023-11-28T12:08:31.420634+0000","last_active":"2023-11-28T12:08:31.428668+0000","last_peered":"2023-11-28T12:08:31.428668+0000","last_clean":"2023-11-28T12:08:31.428668+0000","last_became_active":"2023-11-28T12:08:31.420350+0000","last_became_peered":"2023-11-28T12:08:31.420350+0000","last_unstale":"2023-11-28T12:08:31.428668+0000","last_undegraded":"2023-11-28T12:08:31.428668+0000","last_fullsized":"2023-11-28T12:08:31.428668+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:51:41.950131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"46'2","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.431766+0000","last_change":"2023-11-28T12:08:30.900474+0000","last_active":"2023-11-28T12:08:31.431766+0000","last_peered":"2023-11-28T12:08:31.431766+0000","last_clean":"2023-11-28T12:08:31.431766+0000","last_became_active":"2023-11-28T12:08:30.900127+0000","last_became_peered":"2023-11-28T12:08:30.900127+0000","last_unstale":"2023-11-28T12:08:31.431766+0000","last_undegraded":"2023-11-28T12:08:31.431766+0000","last_fullsized":"2023-11-28T12:08:31.431766+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_clean_scrub_stamp":"2023-11-28T12:08:29.858720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:38:46.443488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.427297+0000","last_change":"2023-11-28T12:08:31.424114+0000","last_active":"2023-11-28T12:08:31.427297+0000","last_peered":"2023-11-28T12:08:31.427297+0000","last_clean":"2023-11-28T12:08:31.427297+0000","last_became_active":"2023-11-28T12:08:31.423800+0000","last_became_peered":"2023-11-28T12:08:31.423800+0000","last_unstale":"2023-11-28T12:08:31.427297+0000","last_undegraded":"2023-11-28T12:08:31.427297+0000","last_fullsized":"2023-11-28T12:08:31.427297+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:48:30.989278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"46'1","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.427838+0000","last_change":"2023-11-28T12:08:30.883232+0000","last_active":"2023-11-28T12:08:31.427838+0000","last_peered":"2023-11-28T12:08:31.427838+0000","last_clean":"2023-11-28T12:08:31.427838+0000","last_became_active":"2023-11-28T12:08:30.882905+0000","last_became_peered":"2023-11-28T12:08:30.882905+0000","last_unstale":"2023-11-28T12:08:31.427838+0000","last_undegraded":"2023-11-28T12:08:31.427838+0000","last_fullsized":"2023-11-28T12:08:31.427838+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_clean_scrub_stamp":"2023-11-28T12:08:29.858720+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:35:35.688586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.413894+0000","last_change":"2023-11-28T12:08:31.408899+0000","last_active":"2023-11-28T12:08:31.413894+0000","last_peered":"2023-11-28T12:08:31.413894+0000","last_clean":"2023-11-28T12:08:31.413894+0000","last_became_active":"2023-11-28T12:08:31.408610+0000","last_became_peered":"2023-11-28T12:08:31.408610+0000","last_unstale":"2023-11-28T12:08:31.413894+0000","last_undegraded":"2023-11-28T12:08:31.413894+0000","last_fullsized":"2023-11-28T12:08:31.413894+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:30:18.131628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"46'1","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.424856+0000","last_change":"2023-11-28T12:08:30.889019+0000","last_active":"2023-11-28T12:08:31.424856+0000","last_peered":"2023-11-28T12:08:31.424856+0000","last_clean":"2023-11-28T12:08:31.424856+0000","last_became_active":"2023-11-28T12:08:30.888790+0000","last_became_peered":"2023-11-28T12:08:30.888790+0000","last_unstale":"2023-11-28T12:08:31.424856+0000","last_undegraded":"2023-11-28T12:08:31.424856+0000","last_fullsized":"2023-11-28T12:08:31.424856+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_clean_scrub_stamp":"2023-11-28T12:08:29.858720+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:40:53.839598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.432346+0000","last_change":"2023-11-28T12:08:31.429325+0000","last_active":"2023-11-28T12:08:31.432346+0000","last_peered":"2023-11-28T12:08:31.432346+0000","last_clean":"2023-11-28T12:08:31.432346+0000","last_became_active":"2023-11-28T12:08:31.429064+0000","last_became_peered":"2023-11-28T12:08:31.429064+0000","last_unstale":"2023-11-28T12:08:31.432346+0000","last_undegraded":"2023-11-28T12:08:31.432346+0000","last_fullsized":"2023-11-28T12:08:31.432346+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:54:52.666260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.400203+0000","last_change":"2023-11-28T12:08:30.890799+0000","last_active":"2023-11-28T12:08:31.400203+0000","last_peered":"2023-11-28T12:08:31.400203+0000","last_clean":"2023-11-28T12:08:31.400203+0000","last_became_active":"2023-11-28T12:08:30.890480+0000","last_became_peered":"2023-11-28T12:08:30.890480+0000","last_unstale":"2023-11-28T12:08:31.400203+0000","last_undegraded":"2023-11-28T12:08:31.400203+0000","last_fullsized":"2023-11-28T12:08:31.400203+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_clean_scrub_stamp":"2023-11-28T12:08:29.858720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:14:15.838121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.426630+0000","last_change":"2023-11-28T12:08:31.423374+0000","last_active":"2023-11-28T12:08:31.426630+0000","last_peered":"2023-11-28T12:08:31.426630+0000","last_clean":"2023-11-28T12:08:31.426630+0000","last_became_active":"2023-11-28T12:08:31.423029+0000","last_became_peered":"2023-11-28T12:08:31.423029+0000","last_unstale":"2023-11-28T12:08:31.426630+0000","last_undegraded":"2023-11-28T12:08:31.426630+0000","last_fullsized":"2023-11-28T12:08:31.426630+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:35:06.199339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.403054+0000","last_change":"2023-11-28T12:08:30.889152+0000","last_active":"2023-11-28T12:08:31.403054+0000","last_peered":"2023-11-28T12:08:31.403054+0000","last_clean":"2023-11-28T12:08:31.403054+0000","last_became_active":"2023-11-28T12:08:30.888908+0000","last_became_peered":"2023-11-28T12:08:30.888908+0000","last_unstale":"2023-11-28T12:08:31.403054+0000","last_undegraded":"2023-11-28T12:08:31.403054+0000","last_fullsized":"2023-11-28T12:08:31.403054+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_clean_scrub_stamp":"2023-11-28T12:08:29.858720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:36:06.368948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.432857+0000","last_change":"2023-11-28T12:08:31.428509+0000","last_active":"2023-11-28T12:08:31.432857+0000","last_peered":"2023-11-28T12:08:31.432857+0000","last_clean":"2023-11-28T12:08:31.432857+0000","last_became_active":"2023-11-28T12:08:31.428291+0000","last_became_peered":"2023-11-28T12:08:31.428291+0000","last_unstale":"2023-11-28T12:08:31.432857+0000","last_undegraded":"2023-11-28T12:08:31.432857+0000","last_fullsized":"2023-11-28T12:08:31.432857+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:50:07.890432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.400902+0000","last_change":"2023-11-28T12:08:30.887549+0000","last_active":"2023-11-28T12:08:31.400902+0000","last_peered":"2023-11-28T12:08:31.400902+0000","last_clean":"2023-11-28T12:08:31.400902+0000","last_became_active":"2023-11-28T12:08:30.887247+0000","last_became_peered":"2023-11-28T12:08:30.887247+0000","last_unstale":"2023-11-28T12:08:31.400902+0000","last_undegraded":"2023-11-28T12:08:31.400902+0000","last_fullsized":"2023-11-28T12:08:31.400902+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_clean_scrub_stamp":"2023-11-28T12:08:29.858720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:40:53.839598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.424448+0000","last_change":"2023-11-28T12:08:31.420891+0000","last_active":"2023-11-28T12:08:31.424448+0000","last_peered":"2023-11-28T12:08:31.424448+0000","last_clean":"2023-11-28T12:08:31.424448+0000","last_became_active":"2023-11-28T12:08:31.420545+0000","last_became_peered":"2023-11-28T12:08:31.420545+0000","last_unstale":"2023-11-28T12:08:31.424448+0000","last_undegraded":"2023-11-28T12:08:31.424448+0000","last_fullsized":"2023-11-28T12:08:31.424448+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:35:36.691841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.404194+0000","last_change":"2023-11-28T12:08:30.885319+0000","last_active":"2023-11-28T12:08:31.404194+0000","last_peered":"2023-11-28T12:08:31.404194+0000","last_clean":"2023-11-28T12:08:31.404194+0000","last_became_active":"2023-11-28T12:08:30.884801+0000","last_became_peered":"2023-11-28T12:08:30.884801+0000","last_unstale":"2023-11-28T12:08:31.404194+0000","last_undegraded":"2023-11-28T12:08:31.404194+0000","last_fullsized":"2023-11-28T12:08:31.404194+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_clean_scrub_stamp":"2023-11-28T12:08:29.858720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:07:35.201596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.428221+0000","last_change":"2023-11-28T12:08:31.416594+0000","last_active":"2023-11-28T12:08:31.428221+0000","last_peered":"2023-11-28T12:08:31.428221+0000","last_clean":"2023-11-28T12:08:31.428221+0000","last_became_active":"2023-11-28T12:08:31.416302+0000","last_became_peered":"2023-11-28T12:08:31.416302+0000","last_unstale":"2023-11-28T12:08:31.428221+0000","last_undegraded":"2023-11-28T12:08:31.428221+0000","last_fullsized":"2023-11-28T12:08:31.428221+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:46:20.961979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"46'3","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.419754+0000","last_change":"2023-11-28T12:08:30.886671+0000","last_active":"2023-11-28T12:08:31.419754+0000","last_peered":"2023-11-28T12:08:31.419754+0000","last_clean":"2023-11-28T12:08:31.419754+0000","last_became_active":"2023-11-28T12:08:30.886248+0000","last_became_peered":"2023-11-28T12:08:30.886248+0000","last_unstale":"2023-11-28T12:08:31.419754+0000","last_undegraded":"2023-11-28T12:08:31.419754+0000","last_fullsized":"2023-11-28T12:08:31.419754+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_clean_scrub_stamp":"2023-11-28T12:08:29.858720+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:36:06.368948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.425163+0000","last_change":"2023-11-28T12:08:31.420536+0000","last_active":"2023-11-28T12:08:31.425163+0000","last_peered":"2023-11-28T12:08:31.425163+0000","last_clean":"2023-11-28T12:08:31.425163+0000","last_became_active":"2023-11-28T12:08:31.420184+0000","last_became_peered":"2023-11-28T12:08:31.420184+0000","last_unstale":"2023-11-28T12:08:31.425163+0000","last_undegraded":"2023-11-28T12:08:31.425163+0000","last_fullsized":"2023-11-28T12:08:31.425163+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:49:30.518586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"46'6","reported_seq":16,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.435419+0000","last_change":"2023-11-28T12:08:30.897850+0000","last_active":"2023-11-28T12:08:31.435419+0000","last_peered":"2023-11-28T12:08:31.435419+0000","last_clean":"2023-11-28T12:08:31.435419+0000","last_became_active":"2023-11-28T12:08:30.895990+0000","last_became_peered":"2023-11-28T12:08:30.895990+0000","last_unstale":"2023-11-28T12:08:31.435419+0000","last_undegraded":"2023-11-28T12:08:31.435419+0000","last_fullsized":"2023-11-28T12:08:31.435419+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_clean_scrub_stamp":"2023-11-28T12:08:29.858720+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:19:36.189829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.420663+0000","last_change":"2023-11-28T12:08:31.412494+0000","last_active":"2023-11-28T12:08:31.420663+0000","last_peered":"2023-11-28T12:08:31.420663+0000","last_clean":"2023-11-28T12:08:31.420663+0000","last_became_active":"2023-11-28T12:08:31.412213+0000","last_became_peered":"2023-11-28T12:08:31.412213+0000","last_unstale":"2023-11-28T12:08:31.420663+0000","last_undegraded":"2023-11-28T12:08:31.420663+0000","last_fullsized":"2023-11-28T12:08:31.420663+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:56:23.042466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"46'2","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.425952+0000","last_change":"2023-11-28T12:08:30.898610+0000","last_active":"2023-11-28T12:08:31.425952+0000","last_peered":"2023-11-28T12:08:31.425952+0000","last_clean":"2023-11-28T12:08:31.425952+0000","last_became_active":"2023-11-28T12:08:30.896112+0000","last_became_peered":"2023-11-28T12:08:30.896112+0000","last_unstale":"2023-11-28T12:08:31.425952+0000","last_undegraded":"2023-11-28T12:08:31.425952+0000","last_fullsized":"2023-11-28T12:08:31.425952+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_clean_scrub_stamp":"2023-11-28T12:08:29.858720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:40:53.839598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.434093+0000","last_change":"2023-11-28T12:08:31.420815+0000","last_active":"2023-11-28T12:08:31.434093+0000","last_peered":"2023-11-28T12:08:31.434093+0000","last_clean":"2023-11-28T12:08:31.434093+0000","last_became_active":"2023-11-28T12:08:31.420584+0000","last_became_peered":"2023-11-28T12:08:31.420584+0000","last_unstale":"2023-11-28T12:08:31.434093+0000","last_undegraded":"2023-11-28T12:08:31.434093+0000","last_fullsized":"2023-11-28T12:08:31.434093+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:22:18.182535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.400415+0000","last_change":"2023-11-28T12:08:30.888041+0000","last_active":"2023-11-28T12:08:31.400415+0000","last_peered":"2023-11-28T12:08:31.400415+0000","last_clean":"2023-11-28T12:08:31.400415+0000","last_became_active":"2023-11-28T12:08:30.886410+0000","last_became_peered":"2023-11-28T12:08:30.886410+0000","last_unstale":"2023-11-28T12:08:31.400415+0000","last_undegraded":"2023-11-28T12:08:31.400415+0000","last_fullsized":"2023-11-28T12:08:31.400415+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_clean_scrub_stamp":"2023-11-28T12:08:29.858720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:36:36.670276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.432309+0000","last_change":"2023-11-28T12:08:31.427069+0000","last_active":"2023-11-28T12:08:31.432309+0000","last_peered":"2023-11-28T12:08:31.432309+0000","last_clean":"2023-11-28T12:08:31.432309+0000","last_became_active":"2023-11-28T12:08:31.426836+0000","last_became_peered":"2023-11-28T12:08:31.426836+0000","last_unstale":"2023-11-28T12:08:31.432309+0000","last_undegraded":"2023-11-28T12:08:31.432309+0000","last_fullsized":"2023-11-28T12:08:31.432309+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:35:06.199339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.398049+0000","last_change":"2023-11-28T12:08:30.888321+0000","last_active":"2023-11-28T12:08:31.398049+0000","last_peered":"2023-11-28T12:08:31.398049+0000","last_clean":"2023-11-28T12:08:31.398049+0000","last_became_active":"2023-11-28T12:08:30.888002+0000","last_became_peered":"2023-11-28T12:08:30.888002+0000","last_unstale":"2023-11-28T12:08:31.398049+0000","last_undegraded":"2023-11-28T12:08:31.398049+0000","last_fullsized":"2023-11-28T12:08:31.398049+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_clean_scrub_stamp":"2023-11-28T12:08:29.858720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:53:18.328945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.435611+0000","last_change":"2023-11-28T12:08:31.422264+0000","last_active":"2023-11-28T12:08:31.435611+0000","last_peered":"2023-11-28T12:08:31.435611+0000","last_clean":"2023-11-28T12:08:31.435611+0000","last_became_active":"2023-11-28T12:08:31.421991+0000","last_became_peered":"2023-11-28T12:08:31.421991+0000","last_unstale":"2023-11-28T12:08:31.435611+0000","last_undegraded":"2023-11-28T12:08:31.435611+0000","last_fullsized":"2023-11-28T12:08:31.435611+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:21:25.365383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"46'8","reported_seq":18,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.427018+0000","last_change":"2023-11-28T12:08:30.897784+0000","last_active":"2023-11-28T12:08:31.427018+0000","last_peered":"2023-11-28T12:08:31.427018+0000","last_clean":"2023-11-28T12:08:31.427018+0000","last_became_active":"2023-11-28T12:08:30.897431+0000","last_became_peered":"2023-11-28T12:08:30.897431+0000","last_unstale":"2023-11-28T12:08:31.427018+0000","last_undegraded":"2023-11-28T12:08:31.427018+0000","last_fullsized":"2023-11-28T12:08:31.427018+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_clean_scrub_stamp":"2023-11-28T12:08:29.858720+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:56:22.039211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.430987+0000","last_change":"2023-11-28T12:08:31.426350+0000","last_active":"2023-11-28T12:08:31.430987+0000","last_peered":"2023-11-28T12:08:31.430987+0000","last_clean":"2023-11-28T12:08:31.430987+0000","last_became_active":"2023-11-28T12:08:31.426011+0000","last_became_peered":"2023-11-28T12:08:31.426011+0000","last_unstale":"2023-11-28T12:08:31.430987+0000","last_undegraded":"2023-11-28T12:08:31.430987+0000","last_fullsized":"2023-11-28T12:08:31.430987+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:12:43.260621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"46'1","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.434531+0000","last_change":"2023-11-28T12:08:30.902749+0000","last_active":"2023-11-28T12:08:31.434531+0000","last_peered":"2023-11-28T12:08:31.434531+0000","last_clean":"2023-11-28T12:08:31.434531+0000","last_became_active":"2023-11-28T12:08:30.902412+0000","last_became_peered":"2023-11-28T12:08:30.902412+0000","last_unstale":"2023-11-28T12:08:31.434531+0000","last_undegraded":"2023-11-28T12:08:31.434531+0000","last_fullsized":"2023-11-28T12:08:31.434531+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_clean_scrub_stamp":"2023-11-28T12:08:29.858720+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:56:22.039211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.434367+0000","last_change":"2023-11-28T12:08:31.432744+0000","last_active":"2023-11-28T12:08:31.434367+0000","last_peered":"2023-11-28T12:08:31.434367+0000","last_clean":"2023-11-28T12:08:31.434367+0000","last_became_active":"2023-11-28T12:08:31.432508+0000","last_became_peered":"2023-11-28T12:08:31.432508+0000","last_unstale":"2023-11-28T12:08:31.434367+0000","last_undegraded":"2023-11-28T12:08:31.434367+0000","last_fullsized":"2023-11-28T12:08:31.434367+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:13:35.402766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"46'2","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.428271+0000","last_change":"2023-11-28T12:08:30.892945+0000","last_active":"2023-11-28T12:08:31.428271+0000","last_peered":"2023-11-28T12:08:31.428271+0000","last_clean":"2023-11-28T12:08:31.428271+0000","last_became_active":"2023-11-28T12:08:30.890649+0000","last_became_peered":"2023-11-28T12:08:30.890649+0000","last_unstale":"2023-11-28T12:08:31.428271+0000","last_undegraded":"2023-11-28T12:08:31.428271+0000","last_fullsized":"2023-11-28T12:08:31.428271+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_clean_scrub_stamp":"2023-11-28T12:08:29.858720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:57:16.696314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.427310+0000","last_change":"2023-11-28T12:08:31.424129+0000","last_active":"2023-11-28T12:08:31.427310+0000","last_peered":"2023-11-28T12:08:31.427310+0000","last_clean":"2023-11-28T12:08:31.427310+0000","last_became_active":"2023-11-28T12:08:31.423803+0000","last_became_peered":"2023-11-28T12:08:31.423803+0000","last_unstale":"2023-11-28T12:08:31.427310+0000","last_undegraded":"2023-11-28T12:08:31.427310+0000","last_fullsized":"2023-11-28T12:08:31.427310+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:30:18.131628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"46'1","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.425871+0000","last_change":"2023-11-28T12:08:30.887553+0000","last_active":"2023-11-28T12:08:31.425871+0000","last_peered":"2023-11-28T12:08:31.425871+0000","last_clean":"2023-11-28T12:08:31.425871+0000","last_became_active":"2023-11-28T12:08:30.887202+0000","last_became_peered":"2023-11-28T12:08:30.887202+0000","last_unstale":"2023-11-28T12:08:31.425871+0000","last_undegraded":"2023-11-28T12:08:31.425871+0000","last_fullsized":"2023-11-28T12:08:31.425871+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_clean_scrub_stamp":"2023-11-28T12:08:29.858720+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:32:30.993995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.418162+0000","last_change":"2023-11-28T12:08:31.415000+0000","last_active":"2023-11-28T12:08:31.418162+0000","last_peered":"2023-11-28T12:08:31.418162+0000","last_clean":"2023-11-28T12:08:31.418162+0000","last_became_active":"2023-11-28T12:08:31.414684+0000","last_became_peered":"2023-11-28T12:08:31.414684+0000","last_unstale":"2023-11-28T12:08:31.418162+0000","last_undegraded":"2023-11-28T12:08:31.418162+0000","last_fullsized":"2023-11-28T12:08:31.418162+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:42:08.563353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.401199+0000","last_change":"2023-11-28T12:08:30.900439+0000","last_active":"2023-11-28T12:08:31.401199+0000","last_peered":"2023-11-28T12:08:31.401199+0000","last_clean":"2023-11-28T12:08:31.401199+0000","last_became_active":"2023-11-28T12:08:30.900113+0000","last_became_peered":"2023-11-28T12:08:30.900113+0000","last_unstale":"2023-11-28T12:08:31.401199+0000","last_undegraded":"2023-11-28T12:08:31.401199+0000","last_fullsized":"2023-11-28T12:08:31.401199+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_clean_scrub_stamp":"2023-11-28T12:08:29.858720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:49:17.471742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.424472+0000","last_change":"2023-11-28T12:08:31.420556+0000","last_active":"2023-11-28T12:08:31.424472+0000","last_peered":"2023-11-28T12:08:31.424472+0000","last_clean":"2023-11-28T12:08:31.424472+0000","last_became_active":"2023-11-28T12:08:31.417300+0000","last_became_peered":"2023-11-28T12:08:31.417300+0000","last_unstale":"2023-11-28T12:08:31.424472+0000","last_undegraded":"2023-11-28T12:08:31.424472+0000","last_fullsized":"2023-11-28T12:08:31.424472+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:07:36.204852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"46'2","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.413786+0000","last_change":"2023-11-28T12:08:30.887383+0000","last_active":"2023-11-28T12:08:31.413786+0000","last_peered":"2023-11-28T12:08:31.413786+0000","last_clean":"2023-11-28T12:08:31.413786+0000","last_became_active":"2023-11-28T12:08:30.887080+0000","last_became_peered":"2023-11-28T12:08:30.887080+0000","last_unstale":"2023-11-28T12:08:31.413786+0000","last_undegraded":"2023-11-28T12:08:31.413786+0000","last_fullsized":"2023-11-28T12:08:31.413786+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_clean_scrub_stamp":"2023-11-28T12:08:29.858720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:33:16.828884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.420239+0000","last_change":"2023-11-28T12:08:31.412097+0000","last_active":"2023-11-28T12:08:31.420239+0000","last_peered":"2023-11-28T12:08:31.420239+0000","last_clean":"2023-11-28T12:08:31.420239+0000","last_became_active":"2023-11-28T12:08:31.411793+0000","last_became_peered":"2023-11-28T12:08:31.411793+0000","last_unstale":"2023-11-28T12:08:31.420239+0000","last_undegraded":"2023-11-28T12:08:31.420239+0000","last_fullsized":"2023-11-28T12:08:31.420239+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:28:34.376054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.409434+0000","last_change":"2023-11-28T12:08:30.890005+0000","last_active":"2023-11-28T12:08:31.409434+0000","last_peered":"2023-11-28T12:08:31.409434+0000","last_clean":"2023-11-28T12:08:31.409434+0000","last_became_active":"2023-11-28T12:08:30.889409+0000","last_became_peered":"2023-11-28T12:08:30.889409+0000","last_unstale":"2023-11-28T12:08:31.409434+0000","last_undegraded":"2023-11-28T12:08:31.409434+0000","last_fullsized":"2023-11-28T12:08:31.409434+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_clean_scrub_stamp":"2023-11-28T12:08:29.858720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:35:35.688586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.426686+0000","last_change":"2023-11-28T12:08:31.416598+0000","last_active":"2023-11-28T12:08:31.426686+0000","last_peered":"2023-11-28T12:08:31.426686+0000","last_clean":"2023-11-28T12:08:31.426686+0000","last_became_active":"2023-11-28T12:08:31.416247+0000","last_became_peered":"2023-11-28T12:08:31.416247+0000","last_unstale":"2023-11-28T12:08:31.426686+0000","last_undegraded":"2023-11-28T12:08:31.426686+0000","last_fullsized":"2023-11-28T12:08:31.426686+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:53:27.068927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.403032+0000","last_change":"2023-11-28T12:08:30.883964+0000","last_active":"2023-11-28T12:08:31.403032+0000","last_peered":"2023-11-28T12:08:31.403032+0000","last_clean":"2023-11-28T12:08:31.403032+0000","last_became_active":"2023-11-28T12:08:30.883438+0000","last_became_peered":"2023-11-28T12:08:30.883438+0000","last_unstale":"2023-11-28T12:08:31.403032+0000","last_undegraded":"2023-11-28T12:08:31.403032+0000","last_fullsized":"2023-11-28T12:08:31.403032+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_clean_scrub_stamp":"2023-11-28T12:08:29.858720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:07:35.201596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.431160+0000","last_change":"2023-11-28T12:08:31.429492+0000","last_active":"2023-11-28T12:08:31.431160+0000","last_peered":"2023-11-28T12:08:31.431160+0000","last_clean":"2023-11-28T12:08:31.431160+0000","last_became_active":"2023-11-28T12:08:31.429162+0000","last_became_peered":"2023-11-28T12:08:31.429162+0000","last_unstale":"2023-11-28T12:08:31.431160+0000","last_undegraded":"2023-11-28T12:08:31.431160+0000","last_fullsized":"2023-11-28T12:08:31.431160+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:08:46.484468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.399769+0000","last_change":"2023-11-28T12:08:30.883689+0000","last_active":"2023-11-28T12:08:31.399769+0000","last_peered":"2023-11-28T12:08:31.399769+0000","last_clean":"2023-11-28T12:08:31.399769+0000","last_became_active":"2023-11-28T12:08:30.882857+0000","last_became_peered":"2023-11-28T12:08:30.882857+0000","last_unstale":"2023-11-28T12:08:31.399769+0000","last_undegraded":"2023-11-28T12:08:31.399769+0000","last_fullsized":"2023-11-28T12:08:31.399769+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_clean_scrub_stamp":"2023-11-28T12:08:29.858720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:43:52.916822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.436746+0000","last_change":"2023-11-28T12:08:31.435018+0000","last_active":"2023-11-28T12:08:31.436746+0000","last_peered":"2023-11-28T12:08:31.436746+0000","last_clean":"2023-11-28T12:08:31.436746+0000","last_became_active":"2023-11-28T12:08:31.434752+0000","last_became_peered":"2023-11-28T12:08:31.434752+0000","last_unstale":"2023-11-28T12:08:31.436746+0000","last_undegraded":"2023-11-28T12:08:31.436746+0000","last_fullsized":"2023-11-28T12:08:31.436746+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:25:37.130663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.411874+0000","last_change":"2023-11-28T12:08:30.898570+0000","last_active":"2023-11-28T12:08:31.411874+0000","last_peered":"2023-11-28T12:08:31.411874+0000","last_clean":"2023-11-28T12:08:31.411874+0000","last_became_active":"2023-11-28T12:08:30.898301+0000","last_became_peered":"2023-11-28T12:08:30.898301+0000","last_unstale":"2023-11-28T12:08:31.411874+0000","last_undegraded":"2023-11-28T12:08:31.411874+0000","last_fullsized":"2023-11-28T12:08:31.411874+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_clean_scrub_stamp":"2023-11-28T12:08:29.858720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:48:57.457613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":34,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.404036+0000","last_change":"2023-11-28T12:06:23.961595+0000","last_active":"2023-11-28T12:08:31.404036+0000","last_peered":"2023-11-28T12:08:31.404036+0000","last_clean":"2023-11-28T12:08:31.404036+0000","last_became_active":"2023-11-28T12:06:23.961257+0000","last_became_peered":"2023-11-28T12:06:23.961257+0000","last_unstale":"2023-11-28T12:08:31.404036+0000","last_undegraded":"2023-11-28T12:08:31.404036+0000","last_fullsized":"2023-11-28T12:08:31.404036+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:30:40.200095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.418836+0000","last_change":"2023-11-28T12:08:31.413817+0000","last_active":"2023-11-28T12:08:31.418836+0000","last_peered":"2023-11-28T12:08:31.418836+0000","last_clean":"2023-11-28T12:08:31.418836+0000","last_became_active":"2023-11-28T12:08:31.413533+0000","last_became_peered":"2023-11-28T12:08:31.413533+0000","last_unstale":"2023-11-28T12:08:31.418836+0000","last_undegraded":"2023-11-28T12:08:31.418836+0000","last_fullsized":"2023-11-28T12:08:31.418836+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:48:58.460869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.409534+0000","last_change":"2023-11-28T12:08:30.899021+0000","last_active":"2023-11-28T12:08:31.409534+0000","last_peered":"2023-11-28T12:08:31.409534+0000","last_clean":"2023-11-28T12:08:31.409534+0000","last_became_active":"2023-11-28T12:08:30.897228+0000","last_became_peered":"2023-11-28T12:08:30.897228+0000","last_unstale":"2023-11-28T12:08:31.409534+0000","last_undegraded":"2023-11-28T12:08:31.409534+0000","last_fullsized":"2023-11-28T12:08:31.409534+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_clean_scrub_stamp":"2023-11-28T12:08:29.858720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:07:35.201596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":38,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.407756+0000","last_change":"2023-11-28T12:06:23.517505+0000","last_active":"2023-11-28T12:08:31.407756+0000","last_peered":"2023-11-28T12:08:31.407756+0000","last_clean":"2023-11-28T12:08:31.407756+0000","last_became_active":"2023-11-28T12:06:23.517151+0000","last_became_peered":"2023-11-28T12:06:23.517151+0000","last_unstale":"2023-11-28T12:08:31.407756+0000","last_undegraded":"2023-11-28T12:08:31.407756+0000","last_fullsized":"2023-11-28T12:08:31.407756+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:30:40.200095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.427114+0000","last_change":"2023-11-28T12:08:31.424105+0000","last_active":"2023-11-28T12:08:31.427114+0000","last_peered":"2023-11-28T12:08:31.427114+0000","last_clean":"2023-11-28T12:08:31.427114+0000","last_became_active":"2023-11-28T12:08:31.422969+0000","last_became_peered":"2023-11-28T12:08:31.422969+0000","last_unstale":"2023-11-28T12:08:31.427114+0000","last_undegraded":"2023-11-28T12:08:31.427114+0000","last_fullsized":"2023-11-28T12:08:31.427114+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:07:36.204852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.400496+0000","last_change":"2023-11-28T12:08:30.884021+0000","last_active":"2023-11-28T12:08:31.400496+0000","last_peered":"2023-11-28T12:08:31.400496+0000","last_clean":"2023-11-28T12:08:31.400496+0000","last_became_active":"2023-11-28T12:08:30.883688+0000","last_became_peered":"2023-11-28T12:08:30.883688+0000","last_unstale":"2023-11-28T12:08:31.400496+0000","last_undegraded":"2023-11-28T12:08:31.400496+0000","last_fullsized":"2023-11-28T12:08:31.400496+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_clean_scrub_stamp":"2023-11-28T12:08:29.858720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:42:07.560098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":37,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.406192+0000","last_change":"2023-11-28T12:06:23.517967+0000","last_active":"2023-11-28T12:08:31.406192+0000","last_peered":"2023-11-28T12:08:31.406192+0000","last_clean":"2023-11-28T12:08:31.406192+0000","last_became_active":"2023-11-28T12:06:23.517495+0000","last_became_peered":"2023-11-28T12:06:23.517495+0000","last_unstale":"2023-11-28T12:08:31.406192+0000","last_undegraded":"2023-11-28T12:08:31.406192+0000","last_fullsized":"2023-11-28T12:08:31.406192+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:51:06.844441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":185,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-28T12:08:30.875789+0000","last_change":"2023-11-28T12:06:23.513472+0000","last_active":"2023-11-28T12:08:30.875789+0000","last_peered":"2023-11-28T12:08:30.875789+0000","last_clean":"2023-11-28T12:08:30.875789+0000","last_became_active":"2023-11-28T12:06:23.513150+0000","last_became_peered":"2023-11-28T12:06:23.513150+0000","last_unstale":"2023-11-28T12:08:30.875789+0000","last_undegraded":"2023-11-28T12:08:30.875789+0000","last_fullsized":"2023-11-28T12:08:30.875789+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:34:18.653049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.428691+0000","last_change":"2023-11-28T12:08:31.423626+0000","last_active":"2023-11-28T12:08:31.428691+0000","last_peered":"2023-11-28T12:08:31.428691+0000","last_clean":"2023-11-28T12:08:31.428691+0000","last_became_active":"2023-11-28T12:08:31.423345+0000","last_became_peered":"2023-11-28T12:08:31.423345+0000","last_unstale":"2023-11-28T12:08:31.428691+0000","last_undegraded":"2023-11-28T12:08:31.428691+0000","last_fullsized":"2023-11-28T12:08:31.428691+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:27:20.964521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.403493+0000","last_change":"2023-11-28T12:08:30.887320+0000","last_active":"2023-11-28T12:08:31.403493+0000","last_peered":"2023-11-28T12:08:31.403493+0000","last_clean":"2023-11-28T12:08:31.403493+0000","last_became_active":"2023-11-28T12:08:30.886970+0000","last_became_peered":"2023-11-28T12:08:30.886970+0000","last_unstale":"2023-11-28T12:08:31.403493+0000","last_undegraded":"2023-11-28T12:08:31.403493+0000","last_fullsized":"2023-11-28T12:08:31.403493+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_clean_scrub_stamp":"2023-11-28T12:08:29.858720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:48:57.457613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":35,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.398920+0000","last_change":"2023-11-28T12:06:23.903708+0000","last_active":"2023-11-28T12:08:31.398920+0000","last_peered":"2023-11-28T12:08:31.398920+0000","last_clean":"2023-11-28T12:08:31.398920+0000","last_became_active":"2023-11-28T12:06:23.903399+0000","last_became_peered":"2023-11-28T12:06:23.903399+0000","last_unstale":"2023-11-28T12:08:31.398920+0000","last_undegraded":"2023-11-28T12:08:31.398920+0000","last_fullsized":"2023-11-28T12:08:31.398920+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:31:13.187145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.420184+0000","last_change":"2023-11-28T12:08:31.411681+0000","last_active":"2023-11-28T12:08:31.420184+0000","last_peered":"2023-11-28T12:08:31.420184+0000","last_clean":"2023-11-28T12:08:31.420184+0000","last_became_active":"2023-11-28T12:08:31.411334+0000","last_became_peered":"2023-11-28T12:08:31.411334+0000","last_unstale":"2023-11-28T12:08:31.420184+0000","last_undegraded":"2023-11-28T12:08:31.420184+0000","last_fullsized":"2023-11-28T12:08:31.420184+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:22:14.973672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.408976+0000","last_change":"2023-11-28T12:08:30.896758+0000","last_active":"2023-11-28T12:08:31.408976+0000","last_peered":"2023-11-28T12:08:31.408976+0000","last_clean":"2023-11-28T12:08:31.408976+0000","last_became_active":"2023-11-28T12:08:30.896453+0000","last_became_peered":"2023-11-28T12:08:30.896453+0000","last_unstale":"2023-11-28T12:08:31.408976+0000","last_undegraded":"2023-11-28T12:08:31.408976+0000","last_fullsized":"2023-11-28T12:08:31.408976+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_clean_scrub_stamp":"2023-11-28T12:08:29.858720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:13:34.399511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":35,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-28T12:08:30.875692+0000","last_change":"2023-11-28T12:06:23.903662+0000","last_active":"2023-11-28T12:08:30.875692+0000","last_peered":"2023-11-28T12:08:30.875692+0000","last_clean":"2023-11-28T12:08:30.875692+0000","last_became_active":"2023-11-28T12:06:23.903354+0000","last_became_peered":"2023-11-28T12:06:23.903354+0000","last_unstale":"2023-11-28T12:08:30.875692+0000","last_undegraded":"2023-11-28T12:08:30.875692+0000","last_fullsized":"2023-11-28T12:08:30.875692+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:02:07.694087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.430176+0000","last_change":"2023-11-28T12:08:31.427556+0000","last_active":"2023-11-28T12:08:31.430176+0000","last_peered":"2023-11-28T12:08:31.430176+0000","last_clean":"2023-11-28T12:08:31.430176+0000","last_became_active":"2023-11-28T12:08:31.427158+0000","last_became_peered":"2023-11-28T12:08:31.427158+0000","last_unstale":"2023-11-28T12:08:31.430176+0000","last_undegraded":"2023-11-28T12:08:31.430176+0000","last_fullsized":"2023-11-28T12:08:31.430176+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:19:37.193084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"46'2","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.429131+0000","last_change":"2023-11-28T12:08:30.891685+0000","last_active":"2023-11-28T12:08:31.429131+0000","last_peered":"2023-11-28T12:08:31.429131+0000","last_clean":"2023-11-28T12:08:31.429131+0000","last_became_active":"2023-11-28T12:08:30.891339+0000","last_became_peered":"2023-11-28T12:08:30.891339+0000","last_unstale":"2023-11-28T12:08:31.429131+0000","last_undegraded":"2023-11-28T12:08:31.429131+0000","last_fullsized":"2023-11-28T12:08:31.429131+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_clean_scrub_stamp":"2023-11-28T12:08:29.858720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:39:06.338738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":36,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.402795+0000","last_change":"2023-11-28T12:06:23.903797+0000","last_active":"2023-11-28T12:08:31.402795+0000","last_peered":"2023-11-28T12:08:31.402795+0000","last_clean":"2023-11-28T12:08:31.402795+0000","last_became_active":"2023-11-28T12:06:23.903475+0000","last_became_peered":"2023-11-28T12:06:23.903475+0000","last_unstale":"2023-11-28T12:08:31.402795+0000","last_undegraded":"2023-11-28T12:08:31.402795+0000","last_fullsized":"2023-11-28T12:08:31.402795+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:51:06.844441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.431331+0000","last_change":"2023-11-28T12:08:31.428030+0000","last_active":"2023-11-28T12:08:31.431331+0000","last_peered":"2023-11-28T12:08:31.431331+0000","last_clean":"2023-11-28T12:08:31.431331+0000","last_became_active":"2023-11-28T12:08:31.424371+0000","last_became_peered":"2023-11-28T12:08:31.424371+0000","last_unstale":"2023-11-28T12:08:31.431331+0000","last_undegraded":"2023-11-28T12:08:31.431331+0000","last_fullsized":"2023-11-28T12:08:31.431331+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:15:00.988809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.401449+0000","last_change":"2023-11-28T12:08:30.887499+0000","last_active":"2023-11-28T12:08:31.401449+0000","last_peered":"2023-11-28T12:08:31.401449+0000","last_clean":"2023-11-28T12:08:31.401449+0000","last_became_active":"2023-11-28T12:08:30.887191+0000","last_became_peered":"2023-11-28T12:08:30.887191+0000","last_unstale":"2023-11-28T12:08:31.401449+0000","last_undegraded":"2023-11-28T12:08:31.401449+0000","last_fullsized":"2023-11-28T12:08:31.401449+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_clean_scrub_stamp":"2023-11-28T12:08:29.858720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:22:13.970417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":40,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-28T12:08:30.873463+0000","last_change":"2023-11-28T12:06:23.903983+0000","last_active":"2023-11-28T12:08:30.873463+0000","last_peered":"2023-11-28T12:08:30.873463+0000","last_clean":"2023-11-28T12:08:30.873463+0000","last_became_active":"2023-11-28T12:06:23.903511+0000","last_became_peered":"2023-11-28T12:06:23.903511+0000","last_unstale":"2023-11-28T12:08:30.873463+0000","last_undegraded":"2023-11-28T12:08:30.873463+0000","last_fullsized":"2023-11-28T12:08:30.873463+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:31:13.187145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.436026+0000","last_change":"2023-11-28T12:08:31.431230+0000","last_active":"2023-11-28T12:08:31.436026+0000","last_peered":"2023-11-28T12:08:31.436026+0000","last_clean":"2023-11-28T12:08:31.436026+0000","last_became_active":"2023-11-28T12:08:31.429657+0000","last_became_peered":"2023-11-28T12:08:31.429657+0000","last_unstale":"2023-11-28T12:08:31.436026+0000","last_undegraded":"2023-11-28T12:08:31.436026+0000","last_fullsized":"2023-11-28T12:08:31.436026+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:30.861975+0000","last_clean_scrub_stamp":"2023-11-28T12:08:30.861975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:52:27.427485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-28T12:08:31.403958+0000","last_change":"2023-11-28T12:08:30.887392+0000","last_active":"2023-11-28T12:08:31.403958+0000","last_peered":"2023-11-28T12:08:31.403958+0000","last_clean":"2023-11-28T12:08:31.403958+0000","last_became_active":"2023-11-28T12:08:30.887096+0000","last_became_peered":"2023-11-28T12:08:30.887096+0000","last_unstale":"2023-11-28T12:08:31.403958+0000","last_undegraded":"2023-11-28T12:08:31.403958+0000","last_fullsized":"2023-11-28T12:08:31.403958+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:08:29.858720+0000","last_clean_scrub_stamp":"2023-11-28T12:08:29.858720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:13:34.399511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":40,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-28T12:08:30.878752+0000","last_change":"2023-11-28T12:06:23.517246+0000","last_active":"2023-11-28T12:08:30.878752+0000","last_peered":"2023-11-28T12:08:30.878752+0000","last_clean":"2023-11-28T12:08:30.878752+0000","last_became_active":"2023-11-28T12:06:23.516854+0000","last_became_peered":"2023-11-28T12:06:23.516854+0000","last_unstale":"2023-11-28T12:08:30.878752+0000","last_undegraded":"2023-11-28T12:08:30.878752+0000","last_fullsized":"2023-11-28T12:08:30.878752+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:51:06.844441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574878,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10000,"kb_used_data":1096,"kb_used_omap":0,"kb_used_meta":8896,"kb_avail":94361840,"statfs":{"total":96636764160,"available":96626524160,"internally_reserved":0,"allocated":1122304,"data_stored":816016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9109504},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:08:23 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.63600000000000001,"15min":0.625},"min":{"1min":0.46000000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.0409999999999999,"5min":1.141,"15min":1.141},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.70399999999999996,"15min":0.70799999999999996},"min":{"1min":0.46700000000000003,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.95099999999999996,"5min":2.7469999999999999,"15min":2.7469999999999999},"last":0.754}]},{"osd":1,"last update":"Tue Nov 28 12:08:23 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.627,"15min":0.61399999999999999},"min":{"1min":0.42199999999999999,"5min":0.374,"15min":0.374},"max":{"1min":1,"5min":1,"15min":1},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.60699999999999998,"15min":0.59899999999999998},"min":{"1min":0.45700000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.90300000000000002,"5min":1.171,"15min":1.171},"last":0.60799999999999998}]},{"osd":2,"last update":"Tue Nov 28 12:08:23 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.70399999999999996,"15min":0.70199999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.98899999999999999,"5min":1.819,"15min":1.819},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.754,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.54200000000000004,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.0680000000000001,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":0.67100000000000004}]},{"osd":3,"last update":"Tue Nov 28 12:08:23 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.68300000000000005,"15min":0.68000000000000005},"min":{"1min":0.441,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.88900000000000001,"5min":0.999,"15min":0.999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.73199999999999998,"15min":0.72399999999999998},"min":{"1min":0.54100000000000004,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.97399999999999998,"5min":1.103,"15min":1.103},"last":0.78300000000000003}]},{"osd":4,"last update":"Tue Nov 28 12:08:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.61499999999999999,"15min":0.61699999999999999},"min":{"1min":0.376,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.77400000000000002,"5min":0.878,"15min":0.878},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.72499999999999998,"15min":0.72399999999999998},"min":{"1min":0.48199999999999998,"5min":0.442,"15min":0.442},"max":{"1min":0.96099999999999997,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.72699999999999998}]},{"osd":5,"last update":"Tue Nov 28 12:08:23 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.48999999999999999,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.94299999999999995,"5min":1.044,"15min":1.044},"last":0.623},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.72599999999999998,"15min":0.72999999999999998},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.92800000000000005,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.79700000000000004}]},{"osd":6,"last update":"Tue Nov 28 12:08:23 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.66600000000000004,"15min":0.67200000000000004},"min":{"1min":0.48899999999999999,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.745,"5min":1.012,"15min":1.012},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.76700000000000002,"15min":0.77200000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.92400000000000004,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.76400000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574876,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8780,"kb_used_data":516,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363060,"statfs":{"total":96636764160,"available":96627773440,"internally_reserved":0,"allocated":528384,"data_stored":225648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:08:25 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.58099999999999996,"15min":0.57899999999999996},"min":{"1min":0.41499999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.81599999999999995,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.59799999999999998,"15min":0.59599999999999997},"min":{"1min":0.41199999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.625}]},{"osd":1,"last update":"Tue Nov 28 12:08:25 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.63100000000000001,"15min":0.629},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.69599999999999995,"15min":0.70299999999999996},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.88400000000000001,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.64800000000000002}]},{"osd":2,"last update":"Tue Nov 28 12:08:25 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.52400000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.625,"5min":0.63500000000000001,"15min":0.63700000000000001},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.73799999999999999}]},{"osd":3,"last update":"Tue Nov 28 12:08:25 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.71199999999999997,"15min":0.71999999999999997},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.82999999999999996,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.71299999999999997,"15min":0.71499999999999997},"min":{"1min":0.58299999999999996,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.79100000000000004}]},{"osd":4,"last update":"Tue Nov 28 12:08:25 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.66700000000000004,"15min":0.67300000000000004},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.49299999999999999,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.75900000000000001}]},{"osd":5,"last update":"Tue Nov 28 12:08:25 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.68899999999999995,"15min":0.69699999999999995},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.747,"5min":0.76800000000000002,"15min":0.77200000000000002},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.70599999999999996}]},{"osd":7,"last update":"Tue Nov 28 12:08:25 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.752,"15min":0.75600000000000001},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":0.91100000000000003,"5min":1.008,"15min":1.008},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.72299999999999998,"15min":0.72899999999999998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.60199999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13968,"kb_used_data":1096,"kb_used_omap":0,"kb_used_meta":12864,"kb_avail":94357872,"statfs":{"total":96636764160,"available":96622460928,"internally_reserved":0,"allocated":1122304,"data_stored":816016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13172736},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:08:24 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.433,"15min":0.438},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.318},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.49399999999999999,"15min":0.5},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.68999999999999995,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.42299999999999999}]},{"osd":2,"last update":"Tue Nov 28 12:08:24 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.46899999999999997,"15min":0.47299999999999998},"min":{"1min":0.34300000000000003,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.58799999999999997,"5min":1.111,"15min":1.111},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.441,"5min":0.48699999999999999,"15min":0.495},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.59999999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.48899999999999999}]},{"osd":3,"last update":"Tue Nov 28 12:08:24 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.57399999999999995,"15min":0.57499999999999996},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.78400000000000003,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.55700000000000005,"15min":0.55500000000000005},"min":{"1min":0.41699999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.81699999999999995,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.68700000000000006}]},{"osd":4,"last update":"Tue Nov 28 12:08:24 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.70199999999999996,"15min":0.70299999999999996},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.97399999999999998,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.754},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.748,"15min":0.752},"min":{"1min":0.55000000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.05,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.84899999999999998}]},{"osd":5,"last update":"Tue Nov 28 12:08:24 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.749,"15min":0.753},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.95799999999999996,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.75700000000000001,"15min":0.76000000000000001},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.22,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.79400000000000004}]},{"osd":6,"last update":"Tue Nov 28 12:08:24 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.76800000000000002,"15min":0.77600000000000002},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.98999999999999999,"5min":1.21,"15min":1.21},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.80000000000000004,"15min":0.80600000000000005},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.0289999999999999,"5min":1.502,"15min":1.502},"last":0.83999999999999997}]},{"osd":7,"last update":"Tue Nov 28 12:08:24 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.80100000000000005,"15min":0.80600000000000005},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.0109999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.77600000000000002,"15min":0.77800000000000002},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.044,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.81399999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12796,"kb_used_data":500,"kb_used_omap":0,"kb_used_meta":12288,"kb_avail":94359044,"statfs":{"total":96636764160,"available":96623661056,"internally_reserved":0,"allocated":512000,"data_stored":217659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12582912},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 12:08:24 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.39000000000000001,"15min":0.38400000000000001},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.498,"15min":0.502},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.70399999999999996,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.45000000000000001}]},{"osd":2,"last update":"Tue Nov 28 12:08:24 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.66700000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.499,"5min":0.54100000000000004,"15min":0.54800000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.69399999999999995,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.499}]},{"osd":3,"last update":"Tue Nov 28 12:08:24 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.52400000000000002,"15min":0.52600000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.73599999999999999,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.60499999999999998,"15min":0.60999999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.81899999999999995,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.54600000000000004}]},{"osd":4,"last update":"Tue Nov 28 12:08:24 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.79400000000000004,"15min":0.79800000000000004},"min":{"1min":0.53400000000000003,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.1859999999999999,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.57999999999999996,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.173,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.70099999999999996}]},{"osd":5,"last update":"Tue Nov 28 12:08:24 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.82399999999999995,"15min":0.83399999999999996},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.1539999999999999,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.80700000000000005,"15min":0.81200000000000006},"min":{"1min":0.59299999999999997,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.2370000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.77800000000000002}]},{"osd":6,"last update":"Tue Nov 28 12:08:24 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.80700000000000005,"15min":0.81000000000000005},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.1319999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.84099999999999997,"15min":0.85199999999999998},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.028,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.92000000000000004}]},{"osd":7,"last update":"Tue Nov 28 12:08:24 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.85599999999999998,"15min":0.86299999999999999},"min":{"1min":0.60199999999999998,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.073,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.876},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.80800000000000005,"15min":0.81200000000000006},"min":{"1min":0.58099999999999996,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.85999999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12812,"kb_used_data":516,"kb_used_omap":0,"kb_used_meta":12288,"kb_avail":94359028,"statfs":{"total":96636764160,"available":96623644672,"internally_reserved":0,"allocated":528384,"data_stored":225648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12582912},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:08:24 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.437,"15min":0.437},"min":{"1min":0.309,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.59899999999999998,"5min":0.745,"15min":0.745},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.45800000000000002,"15min":0.45500000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.32200000000000001}]},{"osd":1,"last update":"Tue Nov 28 12:08:24 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.48899999999999999,"15min":0.48699999999999999},"min":{"1min":0.39100000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.70199999999999996,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.439},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.504,"15min":0.50800000000000001},"min":{"1min":0.34300000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.59999999999999998,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.40699999999999997}]},{"osd":3,"last update":"Tue Nov 28 12:08:24 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.47299999999999998,"15min":0.47799999999999998},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.60299999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.56200000000000006,"15min":0.56799999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.65100000000000002,"5min":0.876,"15min":0.876},"last":0.59899999999999998}]},{"osd":4,"last update":"Tue Nov 28 12:08:24 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.82599999999999996,"15min":0.82899999999999996},"min":{"1min":0.61799999999999999,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.0109999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.81399999999999995,"15min":0.82099999999999995},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.95899999999999996,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.92500000000000004}]},{"osd":5,"last update":"Tue Nov 28 12:08:24 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.73999999999999999,"15min":0.74199999999999999},"min":{"1min":0.53300000000000003,"5min":0.497,"15min":0.497},"max":{"1min":0.97999999999999998,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.78600000000000003,"15min":0.78800000000000003},"min":{"1min":0.59099999999999997,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.93999999999999995,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.81100000000000005}]},{"osd":6,"last update":"Tue Nov 28 12:08:24 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.78200000000000003,"15min":0.78600000000000003},"min":{"1min":0.53800000000000003,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0229999999999999,"5min":1.077,"15min":1.077},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.79200000000000004,"15min":0.78800000000000003},"min":{"1min":0.61399999999999999,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.97599999999999998,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.83499999999999996}]},{"osd":7,"last update":"Tue Nov 28 12:08:24 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.80400000000000005,"15min":0.80700000000000005},"min":{"1min":0.54700000000000004,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.996,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.87},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.82299999999999995,"15min":0.82599999999999996},"min":{"1min":0.63,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.95199999999999996,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.74399999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574876,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12988,"kb_used_data":500,"kb_used_omap":0,"kb_used_meta":12480,"kb_avail":94358852,"statfs":{"total":96636764160,"available":96623464448,"internally_reserved":0,"allocated":512000,"data_stored":217659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12779520},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:08:25 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.436,"15min":0.44},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.433,"5min":0.44500000000000001,"15min":0.44700000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.42599999999999999}]},{"osd":1,"last update":"Tue Nov 28 12:08:25 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.443},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.52700000000000002,"15min":0.53300000000000003},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.75700000000000001,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.47299999999999998}]},{"osd":2,"last update":"Tue Nov 28 12:08:25 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.51800000000000002,"15min":0.52000000000000002},"min":{"1min":0.377,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.64900000000000002,"5min":1.022,"15min":1.022},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.56599999999999995,"15min":0.56999999999999995},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.45300000000000001}]},{"osd":4,"last update":"Tue Nov 28 12:08:25 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.70399999999999996,"15min":0.70199999999999996},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.94299999999999995,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.70599999999999996,"15min":0.70899999999999996},"min":{"1min":0.55100000000000005,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.92600000000000005,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.79100000000000004}]},{"osd":5,"last update":"Tue Nov 28 12:08:25 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.746,"15min":0.75},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.94099999999999995,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.77000000000000002,"15min":0.77800000000000002},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.91300000000000003,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.876}]},{"osd":6,"last update":"Tue Nov 28 12:08:25 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.76400000000000001,"15min":0.76600000000000001},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.98099999999999998,"5min":1.026,"15min":1.026},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.77500000000000002,"15min":0.78100000000000003},"min":{"1min":0.57199999999999995,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.93700000000000006,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.98699999999999999}]},{"osd":7,"last update":"Tue Nov 28 12:08:25 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.78600000000000003,"15min":0.79000000000000004},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.79400000000000004,"15min":0.79600000000000004},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.85599999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8908,"kb_used_data":516,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362932,"statfs":{"total":96636764160,"available":96627642368,"internally_reserved":0,"allocated":528384,"data_stored":225648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:08:25 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.64400000000000002,"15min":0.64700000000000002},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.89100000000000001,"5min":1.044,"15min":1.044},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.64400000000000002,"15min":0.65100000000000002},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.84199999999999997,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.73499999999999999}]},{"osd":1,"last update":"Tue Nov 28 12:08:25 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.65600000000000003,"15min":0.66200000000000003},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.85699999999999998,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.626,"5min":0.67500000000000004,"15min":0.68300000000000005},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.81899999999999995,"5min":1.097,"15min":1.097},"last":0.751}]},{"osd":2,"last update":"Tue Nov 28 12:08:25 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.70899999999999996,"15min":0.71599999999999997},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.84099999999999997,"5min":1.125,"15min":1.125},"last":0.745},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.72999999999999998,"15min":0.73999999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.89800000000000002,"5min":1.143,"15min":1.143},"last":0.78800000000000003}]},{"osd":3,"last update":"Tue Nov 28 12:08:25 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.66900000000000004,"15min":0.67700000000000005},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.83499999999999996,"5min":1.093,"15min":1.093},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.76900000000000002,"15min":0.77900000000000003},"min":{"1min":0.52600000000000002,"5min":0.5,"15min":0.5},"max":{"1min":0.879,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.71499999999999997}]},{"osd":5,"last update":"Tue Nov 28 12:08:25 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.71899999999999997,"15min":0.72899999999999998},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.86599999999999999,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.70699999999999996,"15min":0.71399999999999997},"min":{"1min":0.48499999999999999,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.88400000000000001,"5min":1.296,"15min":1.296},"last":0.46200000000000002}]},{"osd":6,"last update":"Tue Nov 28 12:08:25 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.753,"15min":0.75700000000000001},"min":{"1min":0.54600000000000004,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.95599999999999996,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.80500000000000005,"15min":0.81899999999999995},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.98299999999999998,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.59099999999999997}]},{"osd":7,"last update":"Tue Nov 28 12:08:25 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.78400000000000003,"15min":0.79800000000000004},"min":{"1min":0.54500000000000004,"5min":0.499,"15min":0.499},"max":{"1min":0.83299999999999996,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.84499999999999997,"15min":0.85699999999999998},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":0.92900000000000005,"5min":1.28,"15min":1.28},"last":0.56999999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8844,"kb_used_data":516,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94362996,"statfs":{"total":96636764160,"available":96627707904,"internally_reserved":0,"allocated":528384,"data_stored":225648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.64900000000000002,"15min":0.64600000000000002},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.95599999999999996,"5min":1.204,"15min":1.204},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.69899999999999995,"15min":0.69299999999999995},"min":{"1min":0.50600000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":1.026}]},{"osd":1,"last update":"Tue Nov 28 12:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.60599999999999998,"15min":0.58899999999999997},"min":{"1min":0.46700000000000003,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":1.1279999999999999},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.60899999999999999,"15min":0.60199999999999998},"min":{"1min":0.42999999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":1.0449999999999999}]},{"osd":2,"last update":"Tue Nov 28 12:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.67600000000000005,"15min":0.68100000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.145,"5min":1.173,"15min":1.173},"last":0.97599999999999998},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.68500000000000005,"15min":0.68999999999999995},"min":{"1min":0.46000000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.0129999999999999,"5min":1.298,"15min":1.298},"last":1.0129999999999999}]},{"osd":3,"last update":"Tue Nov 28 12:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.69499999999999995,"15min":0.69099999999999995},"min":{"1min":0.44700000000000001,"5min":0.438,"15min":0.438},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.74399999999999999,"15min":0.747},"min":{"1min":0.57599999999999996,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.94599999999999995,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.94599999999999995}]},{"osd":4,"last update":"Tue Nov 28 12:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.70499999999999996,"15min":0.70899999999999996},"min":{"1min":0.47099999999999997,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.92000000000000004,"5min":1.141,"15min":1.141},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.77800000000000002,"15min":0.77200000000000002},"min":{"1min":0.621,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":1.2270000000000001}]},{"osd":6,"last update":"Tue Nov 28 12:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.76000000000000001,"15min":0.76300000000000001},"min":{"1min":0.52500000000000002,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":1.264},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.997}]},{"osd":7,"last update":"Tue Nov 28 12:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.75700000000000001,"15min":0.76100000000000001},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.78100000000000003,"15min":0.78900000000000003},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.96199999999999997,"5min":1.008,"15min":1.008},"last":0.71799999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T12:08:36.797 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-28T12:08:36.797 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw pool=cephfs_data' mds allow 2023-11-28T12:08:37.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.043+0000 7ff0e4dff700 1 Processor -- start 2023-11-28T12:08:37.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.043+0000 7ff0e4dff700 1 -- start start 2023-11-28T12:08:37.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.044+0000 7ff0e4dff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ff0e015c9b0 0x7ff0e00b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:37.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.044+0000 7ff0e4dff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff0e0161340 0x7ff0e00d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:37.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.044+0000 7ff0e4dff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0e00d1950 con 0x7ff0e00d2320 2023-11-28T12:08:37.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.044+0000 7ff0e4dff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0e00b5800 con 0x7ff0e015c9b0 2023-11-28T12:08:37.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.044+0000 7ff0e4dff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e00b5520 con 0x7ff0e0161340 2023-11-28T12:08:37.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.044+0000 7ff0ded9d700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ff0e00d2320 0x7ff0e00cd7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:42922/0 (socket says 172.21.15.45:42922) 2023-11-28T12:08:37.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.044+0000 7ff0ded9d700 1 -- 172.21.15.45:0/1404970583 learned_addr learned my addr 172.21.15.45:0/1404970583 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:08:37.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.044+0000 7ff0d7fff700 1 --2- 172.21.15.45:0/1404970583 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff0e0161340 0x7ff0e00d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:37.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.045+0000 7ff0de59c700 1 --2- 172.21.15.45:0/1404970583 >> v2:172.21.15.152:3300/0 conn(0x7ff0e015c9b0 0x7ff0e00b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:37.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.045+0000 7ff0ddd9b700 1 -- 172.21.15.45:0/1404970583 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3618045904 0 0) 0x7ff0e00d1950 con 0x7ff0e00d2320 2023-11-28T12:08:37.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.045+0000 7ff0ddd9b700 1 -- 172.21.15.45:0/1404970583 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0cc0035b0 con 0x7ff0e00d2320 2023-11-28T12:08:37.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.045+0000 7ff0ddd9b700 1 -- 172.21.15.45:0/1404970583 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2059191916 0 0) 0x7ff0cc0035b0 con 0x7ff0e00d2320 2023-11-28T12:08:37.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.045+0000 7ff0ddd9b700 1 -- 172.21.15.45:0/1404970583 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff0e0161340 msgr2=0x7ff0e00d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:37.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.045+0000 7ff0ddd9b700 1 --2- 172.21.15.45:0/1404970583 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff0e0161340 0x7ff0e00d1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:37.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.045+0000 7ff0ddd9b700 1 -- 172.21.15.45:0/1404970583 >> v2:172.21.15.152:3300/0 conn(0x7ff0e015c9b0 msgr2=0x7ff0e00b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:37.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.045+0000 7ff0ddd9b700 1 --2- 172.21.15.45:0/1404970583 >> v2:172.21.15.152:3300/0 conn(0x7ff0e015c9b0 0x7ff0e00b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:37.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.045+0000 7ff0ddd9b700 1 -- 172.21.15.45:0/1404970583 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0e00d1300 con 0x7ff0e00d2320 2023-11-28T12:08:37.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.045+0000 7ff0ddd9b700 1 -- 172.21.15.45:0/1404970583 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3460218165 0 0) 0x7ff0d80019f0 con 0x7ff0e00d2320 2023-11-28T12:08:37.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.045+0000 7ff0de59c700 1 --2- 172.21.15.45:0/1404970583 >> v2:172.21.15.152:3300/0 conn(0x7ff0e015c9b0 0x7ff0e00b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:08:37.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.045+0000 7ff0ddd9b700 1 -- 172.21.15.45:0/1404970583 >> v1:172.21.15.45:6789/0 conn(0x7ff0e00d2320 legacy=0x7ff0e00cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:37.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.045+0000 7ff0ddd9b700 1 --2- 172.21.15.45:0/1404970583 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0cc003a00 0x7ff0cc003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:37.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.045+0000 7ff0ddd9b700 1 --2- 172.21.15.45:0/1404970583 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff0e0161340 0x7ff0cc004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:37.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.045+0000 7ff0ddd9b700 1 --2- 172.21.15.45:0/1404970583 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0cc004d90 0x7ff0cc005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:37.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.045+0000 7ff0ddd9b700 1 -- 172.21.15.45:0/1404970583 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e00b5800 con 0x7ff0cc004d90 2023-11-28T12:08:37.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.045+0000 7ff0ddd9b700 1 -- 172.21.15.45:0/1404970583 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e00b5520 con 0x7ff0cc003a00 2023-11-28T12:08:37.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.045+0000 7ff0ddd9b700 1 -- 172.21.15.45:0/1404970583 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0cc00ba10 con 0x7ff0e0161340 2023-11-28T12:08:37.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.045+0000 7ff0de59c700 1 --2- 172.21.15.45:0/1404970583 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0cc003a00 0x7ff0cc003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:37.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.046+0000 7ff0ded9d700 1 --2- 172.21.15.45:0/1404970583 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0cc004d90 0x7ff0cc005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:37.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.046+0000 7ff0d7fff700 1 --2- 172.21.15.45:0/1404970583 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff0e0161340 0x7ff0cc004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:37.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.046+0000 7ff0de59c700 1 -- 172.21.15.45:0/1404970583 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff0e0161340 msgr2=0x7ff0cc004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:37.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.046+0000 7ff0de59c700 1 --2- 172.21.15.45:0/1404970583 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff0e0161340 0x7ff0cc004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:37.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.046+0000 7ff0de59c700 1 -- 172.21.15.45:0/1404970583 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0cc004d90 msgr2=0x7ff0cc005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:37.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.046+0000 7ff0de59c700 1 --2- 172.21.15.45:0/1404970583 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0cc004d90 0x7ff0cc005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:37.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.046+0000 7ff0de59c700 1 -- 172.21.15.45:0/1404970583 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0cc0035b0 con 0x7ff0cc003a00 2023-11-28T12:08:37.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.046+0000 7ff0ded9d700 1 --2- 172.21.15.45:0/1404970583 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0cc004d90 0x7ff0cc005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:08:37.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.046+0000 7ff0de59c700 1 --2- 172.21.15.45:0/1404970583 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0cc003a00 0x7ff0cc003e10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff0d0009d30 tx=0x7ff0cc005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9f751225004e76b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:37.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.047+0000 7ff0ddd9b700 1 -- 172.21.15.45:0/1404970583 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d0009e80 con 0x7ff0cc003a00 2023-11-28T12:08:37.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.047+0000 7ff0ddd9b700 1 -- 172.21.15.45:0/1404970583 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0d000e9a0 con 0x7ff0cc003a00 2023-11-28T12:08:37.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.047+0000 7ff0ddd9b700 1 -- 172.21.15.45:0/1404970583 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d000ed30 con 0x7ff0cc003a00 2023-11-28T12:08:37.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.047+0000 7ff0e4dff700 1 -- 172.21.15.45:0/1404970583 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0cc003a00 msgr2=0x7ff0cc003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:37.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.047+0000 7ff0e4dff700 1 --2- 172.21.15.45:0/1404970583 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0cc003a00 0x7ff0cc003e10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff0d0009d30 tx=0x7ff0cc005880 comp rx=0 tx=0).stop 2023-11-28T12:08:37.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.047+0000 7ff0ded9d700 1 -- 172.21.15.45:0/1404970583 reap_dead start 2023-11-28T12:08:37.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.047+0000 7ff0e4dff700 1 -- 172.21.15.45:0/1404970583 shutdown_connections 2023-11-28T12:08:37.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.047+0000 7ff0e4dff700 1 -- 172.21.15.45:0/1404970583 >> 172.21.15.45:0/1404970583 conn(0x7ff0e0072600 msgr2=0x7ff0e00cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:37.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.047+0000 7ff0e4dff700 1 -- 172.21.15.45:0/1404970583 shutdown_connections 2023-11-28T12:08:37.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.047+0000 7ff0e4dff700 1 -- 172.21.15.45:0/1404970583 wait complete. 2023-11-28T12:08:37.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.049+0000 7ff0e4dff700 1 Processor -- start 2023-11-28T12:08:37.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.049+0000 7ff0e4dff700 1 -- start start 2023-11-28T12:08:37.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.050+0000 7ff0e4dff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff0cc003a00 0x7ff0e01f6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:37.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.050+0000 7ff0e4dff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0e00c8b50 0x7ff0e00c5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:37.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.050+0000 7ff0e4dff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0e015f210 0x7ff0e015f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:37.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.050+0000 7ff0e4dff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e00c9eb0 con 0x7ff0e015f210 2023-11-28T12:08:37.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.050+0000 7ff0e4dff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e015fbd0 con 0x7ff0e00c8b50 2023-11-28T12:08:37.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.050+0000 7ff0e4dff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e00c9330 con 0x7ff0cc003a00 2023-11-28T12:08:37.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.051+0000 7ff0ded9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0e015f210 0x7ff0e015f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:37.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.051+0000 7ff0ded9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0e015f210 0x7ff0e015f690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59748/0 (socket says 172.21.15.45:59748) 2023-11-28T12:08:37.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.051+0000 7ff0ded9d700 1 -- 172.21.15.45:0/995968913 learned_addr learned my addr 172.21.15.45:0/995968913 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:37.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.051+0000 7ff0de59c700 1 --2- 172.21.15.45:0/995968913 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff0cc003a00 0x7ff0e01f6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:37.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.051+0000 7ff0d7fff700 1 --2- 172.21.15.45:0/995968913 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0e00c8b50 0x7ff0e00c5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:37.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.051+0000 7ff0ded9d700 1 -- 172.21.15.45:0/995968913 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff0cc003a00 msgr2=0x7ff0e01f6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:37.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.051+0000 7ff0ded9d700 1 --2- 172.21.15.45:0/995968913 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff0cc003a00 0x7ff0e01f6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:37.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.051+0000 7ff0ded9d700 1 -- 172.21.15.45:0/995968913 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0e00c8b50 msgr2=0x7ff0e00c5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:37.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.051+0000 7ff0ded9d700 1 --2- 172.21.15.45:0/995968913 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0e00c8b50 0x7ff0e00c5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:37.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.051+0000 7ff0ded9d700 1 -- 172.21.15.45:0/995968913 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0e00b5130 con 0x7ff0e015f210 2023-11-28T12:08:37.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.051+0000 7ff0ded9d700 1 --2- 172.21.15.45:0/995968913 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0e015f210 0x7ff0e015f690 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7ff0e008bfd0 tx=0x7ff0d8007570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:37.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.051+0000 7ff0d6ffd700 1 -- 172.21.15.45:0/995968913 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d8001ef0 con 0x7ff0e015f210 2023-11-28T12:08:37.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.051+0000 7ff0d6ffd700 1 -- 172.21.15.45:0/995968913 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0d80133f0 con 0x7ff0e015f210 2023-11-28T12:08:37.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.052+0000 7ff0e4dff700 1 -- 172.21.15.45:0/995968913 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0e00d15e0 con 0x7ff0e015f210 2023-11-28T12:08:37.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.052+0000 7ff0d6ffd700 1 -- 172.21.15.45:0/995968913 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d80137a0 con 0x7ff0e015f210 2023-11-28T12:08:37.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.052+0000 7ff0e4dff700 1 -- 172.21.15.45:0/995968913 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0e00b52c0 con 0x7ff0e015f210 2023-11-28T12:08:37.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.053+0000 7ff0e4dff700 1 -- 172.21.15.45:0/995968913 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0e00745c0 con 0x7ff0e015f210 2023-11-28T12:08:37.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.054+0000 7ff0d6ffd700 1 -- 172.21.15.45:0/995968913 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7ff0d8023070 con 0x7ff0e015f210 2023-11-28T12:08:37.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.055+0000 7ff0d6ffd700 1 --2- 172.21.15.45:0/995968913 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7ff0c00682f0 0x7ff0c006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:37.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.055+0000 7ff0d6ffd700 1 -- 172.21.15.45:0/995968913 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff0d8086630 con 0x7ff0e015f210 2023-11-28T12:08:37.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.055+0000 7ff0de59c700 1 --2- 172.21.15.45:0/995968913 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7ff0c00682f0 0x7ff0c006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:37.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.056+0000 7ff0de59c700 1 --2- 172.21.15.45:0/995968913 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7ff0c00682f0 0x7ff0c006a7a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff0d00090b0 tx=0x7ff0d0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:37.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.058+0000 7ff0d6ffd700 1 -- 172.21.15.45:0/995968913 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7ff0d8052d40 con 0x7ff0e015f210 2023-11-28T12:08:37.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.342+0000 7ff0e4dff700 1 -- 172.21.15.45:0/995968913 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs_data", "mds", "allow"]} v 0) v1 -- 0x7ff0e00b4e00 con 0x7ff0e015f210 2023-11-28T12:08:37.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.346+0000 7ff0d6ffd700 1 -- 172.21.15.45:0/995968913 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs_data", "mds", "allow"]}]=0 updated caps for client.0 v12) v1 ==== 184+0+0 (secure 0 0 0) 0x7ff0d800a480 con 0x7ff0e015f210 2023-11-28T12:08:37.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.348+0000 7ff0e4dff700 1 -- 172.21.15.45:0/995968913 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7ff0c00682f0 msgr2=0x7ff0c006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:37.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.348+0000 7ff0e4dff700 1 --2- 172.21.15.45:0/995968913 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7ff0c00682f0 0x7ff0c006a7a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff0d00090b0 tx=0x7ff0d0008030 comp rx=0 tx=0).stop 2023-11-28T12:08:37.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.348+0000 7ff0e4dff700 1 -- 172.21.15.45:0/995968913 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0e015f210 msgr2=0x7ff0e015f690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:37.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.348+0000 7ff0e4dff700 1 --2- 172.21.15.45:0/995968913 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0e015f210 0x7ff0e015f690 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7ff0e008bfd0 tx=0x7ff0d8007570 comp rx=0 tx=0).stop 2023-11-28T12:08:37.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.348+0000 7ff0e4dff700 1 -- 172.21.15.45:0/995968913 shutdown_connections 2023-11-28T12:08:37.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.348+0000 7ff0e4dff700 1 --2- 172.21.15.45:0/995968913 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7ff0c00682f0 0x7ff0c006a7a0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:37.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.348+0000 7ff0e4dff700 1 --2- 172.21.15.45:0/995968913 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0e015f210 0x7ff0e015f690 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:37.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.348+0000 7ff0e4dff700 1 --2- 172.21.15.45:0/995968913 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff0cc003a00 0x7ff0e01f6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:37.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.348+0000 7ff0e4dff700 1 --2- 172.21.15.45:0/995968913 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff0e00c8b50 0x7ff0e00c5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:37.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.348+0000 7ff0e4dff700 1 -- 172.21.15.45:0/995968913 >> 172.21.15.45:0/995968913 conn(0x7ff0e0072600 msgr2=0x7ff0e006a900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:37.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.348+0000 7ff0e4dff700 1 -- 172.21.15.45:0/995968913 shutdown_connections 2023-11-28T12:08:37.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.348+0000 7ff0e4dff700 1 -- 172.21.15.45:0/995968913 wait complete. 2023-11-28T12:08:37.350 INFO:teuthology.orchestra.run.smithi045.stderr:updated caps for client.0 2023-11-28T12:08:37.367 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T12:08:37.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.570+0000 7fcf8d3ff700 1 Processor -- start 2023-11-28T12:08:37.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.570+0000 7fcf8d3ff700 1 -- start start 2023-11-28T12:08:37.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.571+0000 7fcf8d3ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fcf8815c9b0 0x7fcf880b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:37.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.571+0000 7fcf8d3ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fcf880cd7c0 0x7fcf880cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:37.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.571+0000 7fcf8d3ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf880d1950 con 0x7fcf88161340 2023-11-28T12:08:37.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.571+0000 7fcf8d3ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf880b5800 con 0x7fcf8815c9b0 2023-11-28T12:08:37.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.571+0000 7fcf8d3ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf880ce140 con 0x7fcf880cd7c0 2023-11-28T12:08:37.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.572+0000 7fcf877fe700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fcf880cd7c0 0x7fcf880cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:37.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.572+0000 7fcf867fc700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fcf88161340 0x7fcf880d1de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.45:51710/0 (socket says 172.21.15.45:51710) 2023-11-28T12:08:37.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.572+0000 7fcf867fc700 1 -- 172.21.15.45:0/3178450784 learned_addr learned my addr 172.21.15.45:0/3178450784 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:08:37.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.572+0000 7fcf86ffd700 1 --2- 172.21.15.45:0/3178450784 >> v2:172.21.15.152:3300/0 conn(0x7fcf8815c9b0 0x7fcf880b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:37.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.572+0000 7fcf85ffb700 1 -- 172.21.15.45:0/3178450784 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2503619243 0 0) 0x7fcf880d1950 con 0x7fcf88161340 2023-11-28T12:08:37.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.572+0000 7fcf85ffb700 1 -- 172.21.15.45:0/3178450784 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf700035b0 con 0x7fcf88161340 2023-11-28T12:08:37.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.572+0000 7fcf86ffd700 1 -- 172.21.15.45:0/3178450784 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fcf880cd7c0 msgr2=0x7fcf880cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:37.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.572+0000 7fcf86ffd700 1 --2- 172.21.15.45:0/3178450784 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fcf880cd7c0 0x7fcf880cdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:37.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.572+0000 7fcf86ffd700 1 -- 172.21.15.45:0/3178450784 >> v1:172.21.15.152:6789/0 conn(0x7fcf88161340 legacy=0x7fcf880d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:37.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.572+0000 7fcf86ffd700 1 -- 172.21.15.45:0/3178450784 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf880d24f0 con 0x7fcf8815c9b0 2023-11-28T12:08:37.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.572+0000 7fcf877fe700 1 --2- 172.21.15.45:0/3178450784 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fcf880cd7c0 0x7fcf880cdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:08:37.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.573+0000 7fcf86ffd700 1 --2- 172.21.15.45:0/3178450784 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcf8815c9b0 0x7fcf880b4bf0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fcf78009840 tx=0x7fcf78009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=afacbba6abf73304 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:37.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.573+0000 7fcf85ffb700 1 -- 172.21.15.45:0/3178450784 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf78011830 con 0x7fcf8815c9b0 2023-11-28T12:08:37.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.573+0000 7fcf85ffb700 1 -- 172.21.15.45:0/3178450784 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf78011990 con 0x7fcf8815c9b0 2023-11-28T12:08:37.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.573+0000 7fcf85ffb700 1 -- 172.21.15.45:0/3178450784 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf78011d00 con 0x7fcf8815c9b0 2023-11-28T12:08:37.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.573+0000 7fcf8d3ff700 1 -- 172.21.15.45:0/3178450784 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcf8815c9b0 msgr2=0x7fcf880b4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:37.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.573+0000 7fcf8d3ff700 1 --2- 172.21.15.45:0/3178450784 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcf8815c9b0 0x7fcf880b4bf0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fcf78009840 tx=0x7fcf78009b50 comp rx=0 tx=0).stop 2023-11-28T12:08:37.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.574+0000 7fcf8d3ff700 1 -- 172.21.15.45:0/3178450784 shutdown_connections 2023-11-28T12:08:37.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.574+0000 7fcf8d3ff700 1 --2- 172.21.15.45:0/3178450784 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fcf880cd7c0 0x7fcf880cdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:37.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.574+0000 7fcf8d3ff700 1 --2- 172.21.15.45:0/3178450784 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcf8815c9b0 0x7fcf880b4bf0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:37.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.574+0000 7fcf8d3ff700 1 -- 172.21.15.45:0/3178450784 >> 172.21.15.45:0/3178450784 conn(0x7fcf88072600 msgr2=0x7fcf880cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:37.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.574+0000 7fcf8d3ff700 1 -- 172.21.15.45:0/3178450784 shutdown_connections 2023-11-28T12:08:37.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.574+0000 7fcf8d3ff700 1 -- 172.21.15.45:0/3178450784 wait complete. 2023-11-28T12:08:37.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.575+0000 7fcf8d3ff700 1 Processor -- start 2023-11-28T12:08:37.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.576+0000 7fcf8d3ff700 1 -- start start 2023-11-28T12:08:37.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.576+0000 7fcf8d3ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf880cd7c0 0x7fcf88154a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:37.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.577+0000 7fcf8d3ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fcf8815c9b0 0x7fcf880cbc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:37.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.577+0000 7fcf8d3ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcf88161340 0x7fcf880cc180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:37.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.577+0000 7fcf8d3ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf881e70c0 con 0x7fcf880cd7c0 2023-11-28T12:08:37.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.577+0000 7fcf8d3ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf881e73a0 con 0x7fcf88161340 2023-11-28T12:08:37.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.577+0000 7fcf8d3ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf881e7680 con 0x7fcf8815c9b0 2023-11-28T12:08:37.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.577+0000 7fcf86ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf880cd7c0 0x7fcf88154a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:37.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.577+0000 7fcf86ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf880cd7c0 0x7fcf88154a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59764/0 (socket says 172.21.15.45:59764) 2023-11-28T12:08:37.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.577+0000 7fcf86ffd700 1 -- 172.21.15.45:0/888451396 learned_addr learned my addr 172.21.15.45:0/888451396 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:37.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.577+0000 7fcf867fc700 1 --2- 172.21.15.45:0/888451396 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fcf8815c9b0 0x7fcf880cbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:37.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.577+0000 7fcf877fe700 1 --2- 172.21.15.45:0/888451396 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcf88161340 0x7fcf880cc180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:37.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.577+0000 7fcf86ffd700 1 -- 172.21.15.45:0/888451396 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fcf8815c9b0 msgr2=0x7fcf880cbc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:37.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.577+0000 7fcf86ffd700 1 --2- 172.21.15.45:0/888451396 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fcf8815c9b0 0x7fcf880cbc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:37.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.577+0000 7fcf86ffd700 1 -- 172.21.15.45:0/888451396 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcf88161340 msgr2=0x7fcf880cc180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:37.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.577+0000 7fcf86ffd700 1 --2- 172.21.15.45:0/888451396 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcf88161340 0x7fcf880cc180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:37.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.577+0000 7fcf86ffd700 1 -- 172.21.15.45:0/888451396 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf80009a70 con 0x7fcf880cd7c0 2023-11-28T12:08:37.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.578+0000 7fcf86ffd700 1 --2- 172.21.15.45:0/888451396 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf880cd7c0 0x7fcf88154a40 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fcf78009fd0 tx=0x7fcf78004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:37.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.578+0000 7fcf6f7fe700 1 -- 172.21.15.45:0/888451396 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf78004550 con 0x7fcf880cd7c0 2023-11-28T12:08:37.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.578+0000 7fcf6f7fe700 1 -- 172.21.15.45:0/888451396 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf7801e070 con 0x7fcf880cd7c0 2023-11-28T12:08:37.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.578+0000 7fcf6f7fe700 1 -- 172.21.15.45:0/888451396 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf780038c0 con 0x7fcf880cd7c0 2023-11-28T12:08:37.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.578+0000 7fcf8d3ff700 1 -- 172.21.15.45:0/888451396 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf780094a0 con 0x7fcf880cd7c0 2023-11-28T12:08:37.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.578+0000 7fcf8d3ff700 1 -- 172.21.15.45:0/888451396 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf880d1300 con 0x7fcf880cd7c0 2023-11-28T12:08:37.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.579+0000 7fcf8d3ff700 1 -- 172.21.15.45:0/888451396 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf880b5520 con 0x7fcf880cd7c0 2023-11-28T12:08:37.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.580+0000 7fcf6f7fe700 1 -- 172.21.15.45:0/888451396 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fcf7800f050 con 0x7fcf880cd7c0 2023-11-28T12:08:37.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.581+0000 7fcf6f7fe700 1 --2- 172.21.15.45:0/888451396 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fcf740682f0 0x7fcf7406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:37.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.581+0000 7fcf6f7fe700 1 -- 172.21.15.45:0/888451396 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcf78086c80 con 0x7fcf880cd7c0 2023-11-28T12:08:37.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.581+0000 7fcf867fc700 1 --2- 172.21.15.45:0/888451396 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fcf740682f0 0x7fcf7406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:37.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.582+0000 7fcf867fc700 1 --2- 172.21.15.45:0/888451396 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fcf740682f0 0x7fcf7406a7a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fcf8815f670 tx=0x7fcf7c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:37.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.585+0000 7fcf6f7fe700 1 -- 172.21.15.45:0/888451396 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fcf780533f0 con 0x7fcf880cd7c0 2023-11-28T12:08:37.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.830+0000 7fcf8d3ff700 1 -- 172.21.15.45:0/888451396 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcf880d15e0 con 0x7fcf880cd7c0 2023-11-28T12:08:37.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.831+0000 7fcf6f7fe700 1 -- 172.21.15.45:0/888451396 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4651 (secure 0 0 0) 0x7fcf78015090 con 0x7fcf880cd7c0 2023-11-28T12:08:37.831 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:08:37.831 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5398,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6836/2532875180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":2532875180},{"type":"v1","addr":"172.21.15.152:6836","nonce":2532875180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5404,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/930111917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6835","nonce":930111917},{"type":"v1","addr":"172.21.15.152:6837","nonce":930111917}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5547,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/1974473454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1974473454},{"type":"v1","addr":"172.21.15.45:6834","nonce":1974473454}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T12:08:31.391914+0000","modified":"2023-11-28T12:08:34.873102+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5550},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5550":{"gid":5550,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/1281816633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":1281816633},{"type":"v1","addr":"172.21.15.45:6835","nonce":1281816633}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-28T12:08:37.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.833+0000 7fcf8d3ff700 1 -- 172.21.15.45:0/888451396 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fcf740682f0 msgr2=0x7fcf7406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:37.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.833+0000 7fcf8d3ff700 1 --2- 172.21.15.45:0/888451396 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fcf740682f0 0x7fcf7406a7a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fcf8815f670 tx=0x7fcf7c009040 comp rx=0 tx=0).stop 2023-11-28T12:08:37.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.833+0000 7fcf8d3ff700 1 -- 172.21.15.45:0/888451396 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf880cd7c0 msgr2=0x7fcf88154a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:37.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.833+0000 7fcf8d3ff700 1 --2- 172.21.15.45:0/888451396 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf880cd7c0 0x7fcf88154a40 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fcf78009fd0 tx=0x7fcf78004750 comp rx=0 tx=0).stop 2023-11-28T12:08:37.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.833+0000 7fcf8d3ff700 1 -- 172.21.15.45:0/888451396 shutdown_connections 2023-11-28T12:08:37.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.833+0000 7fcf8d3ff700 1 --2- 172.21.15.45:0/888451396 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fcf740682f0 0x7fcf7406a7a0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:37.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.833+0000 7fcf8d3ff700 1 --2- 172.21.15.45:0/888451396 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcf88161340 0x7fcf880cc180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:37.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.833+0000 7fcf8d3ff700 1 --2- 172.21.15.45:0/888451396 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf880cd7c0 0x7fcf88154a40 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:37.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.833+0000 7fcf8d3ff700 1 --2- 172.21.15.45:0/888451396 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fcf8815c9b0 0x7fcf880cbc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:37.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.833+0000 7fcf8d3ff700 1 -- 172.21.15.45:0/888451396 >> 172.21.15.45:0/888451396 conn(0x7fcf88072600 msgr2=0x7fcf8815a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:37.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.833+0000 7fcf8d3ff700 1 -- 172.21.15.45:0/888451396 shutdown_connections 2023-11-28T12:08:37.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:37.833+0000 7fcf8d3ff700 1 -- 172.21.15.45:0/888451396 wait complete. 2023-11-28T12:08:37.835 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 24 2023-11-28T12:08:38.254 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-28T12:08:31.391914+0000', 'modified': '2023-11-28T12:08:34.873102+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5550}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5550': {'gid': 5550, 'name': 'c', 'rank': 0, 'incarnation': 20, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.45:6835/1281816633', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.45:6833', 'nonce': 1281816633}, {'type': 'v1', 'addr': '172.21.15.45:6835', 'nonce': 1281816633}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-28T12:08:38.255 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-28T12:08:38.255 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-28T12:08:38.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.461+0000 7f6a015ff700 1 Processor -- start 2023-11-28T12:08:38.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.462+0000 7f6a015ff700 1 -- start start 2023-11-28T12:08:38.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.463+0000 7f6a015ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f69fc15c9b0 0x7f69fc0b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:38.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.463+0000 7f6a015ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f69fc0cd7c0 0x7f69fc0cdc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:38.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.463+0000 7f6a015ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69fc0ce160 con 0x7f69fc161340 2023-11-28T12:08:38.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.463+0000 7f6a015ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69fc0b5800 con 0x7f69fc0cd7c0 2023-11-28T12:08:38.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.463+0000 7f6a015ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69fc0d1950 con 0x7f69fc15c9b0 2023-11-28T12:08:38.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.463+0000 7f69fb7fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f69fc0cd7c0 0x7f69fc0cdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:38.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.463+0000 7f69f3fff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f69fc161340 0x7f69fc0d1de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:42936/0 (socket says 172.21.15.45:42936) 2023-11-28T12:08:38.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.463+0000 7f69f3fff700 1 -- 172.21.15.45:0/2738311426 learned_addr learned my addr 172.21.15.45:0/2738311426 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:08:38.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.463+0000 7f69faffd700 1 --2- 172.21.15.45:0/2738311426 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f69fc15c9b0 0x7f69fc0b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:38.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.463+0000 7f69fb7fe700 1 -- 172.21.15.45:0/2738311426 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f69fc15c9b0 msgr2=0x7f69fc0b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:38.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.463+0000 7f69fb7fe700 1 --2- 172.21.15.45:0/2738311426 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f69fc15c9b0 0x7f69fc0b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:38.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.463+0000 7f69fb7fe700 1 -- 172.21.15.45:0/2738311426 >> v1:172.21.15.45:6789/0 conn(0x7f69fc161340 legacy=0x7f69fc0d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:38.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.463+0000 7f69fb7fe700 1 -- 172.21.15.45:0/2738311426 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69fc0d24f0 con 0x7f69fc0cd7c0 2023-11-28T12:08:38.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.463+0000 7f69fa7fc700 1 -- 172.21.15.45:0/2738311426 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1059349796 0 0) 0x7f69fc0ce160 con 0x7f69fc161340 2023-11-28T12:08:38.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.464+0000 7f69fb7fe700 1 --2- 172.21.15.45:0/2738311426 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f69fc0cd7c0 0x7f69fc0cdc20 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f69f4009d90 tx=0x7f69f400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35f904d48774dd96 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:38.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.464+0000 7f69fa7fc700 1 -- 172.21.15.45:0/2738311426 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f400e070 con 0x7f69fc0cd7c0 2023-11-28T12:08:38.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.464+0000 7f69fa7fc700 1 -- 172.21.15.45:0/2738311426 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69f400bbd0 con 0x7f69fc0cd7c0 2023-11-28T12:08:38.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.464+0000 7f69fa7fc700 1 -- 172.21.15.45:0/2738311426 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f4012430 con 0x7f69fc0cd7c0 2023-11-28T12:08:38.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.464+0000 7f6a015ff700 1 -- 172.21.15.45:0/2738311426 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f69fc0cd7c0 msgr2=0x7f69fc0cdc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:38.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.464+0000 7f6a015ff700 1 --2- 172.21.15.45:0/2738311426 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f69fc0cd7c0 0x7f69fc0cdc20 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f69f4009d90 tx=0x7f69f400b330 comp rx=0 tx=0).stop 2023-11-28T12:08:38.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.465+0000 7f6a015ff700 1 -- 172.21.15.45:0/2738311426 shutdown_connections 2023-11-28T12:08:38.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.465+0000 7f6a015ff700 1 --2- 172.21.15.45:0/2738311426 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f69fc0cd7c0 0x7f69fc0cdc20 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:38.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.465+0000 7f6a015ff700 1 --2- 172.21.15.45:0/2738311426 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f69fc15c9b0 0x7f69fc0b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:38.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.465+0000 7f6a015ff700 1 -- 172.21.15.45:0/2738311426 >> 172.21.15.45:0/2738311426 conn(0x7f69fc072600 msgr2=0x7f69fc0cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:38.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.465+0000 7f6a015ff700 1 -- 172.21.15.45:0/2738311426 shutdown_connections 2023-11-28T12:08:38.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.465+0000 7f6a015ff700 1 -- 172.21.15.45:0/2738311426 wait complete. 2023-11-28T12:08:38.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.466+0000 7f6a015ff700 1 Processor -- start 2023-11-28T12:08:38.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.466+0000 7f6a015ff700 1 -- start start 2023-11-28T12:08:38.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.467+0000 7f6a015ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f69fc0cd7c0 0x7f69fc1e6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:38.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.467+0000 7f6a015ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f69fc15c9b0 0x7f69fc15e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:38.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.467+0000 7f6a015ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f69fc161340 0x7f69fc1f5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:38.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.467+0000 7f6a015ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69fc1e6db0 con 0x7f69fc161340 2023-11-28T12:08:38.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.467+0000 7f6a015ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69fc1e7090 con 0x7f69fc15c9b0 2023-11-28T12:08:38.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.467+0000 7f6a015ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69fc1e7370 con 0x7f69fc0cd7c0 2023-11-28T12:08:38.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.468+0000 7f69fb7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f69fc161340 0x7f69fc1f5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:38.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.468+0000 7f69fb7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f69fc161340 0x7f69fc1f5a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59794/0 (socket says 172.21.15.45:59794) 2023-11-28T12:08:38.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.468+0000 7f69fb7fe700 1 -- 172.21.15.45:0/1878676657 learned_addr learned my addr 172.21.15.45:0/1878676657 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:38.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.468+0000 7f69faffd700 1 --2- 172.21.15.45:0/1878676657 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f69fc0cd7c0 0x7f69fc1e6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:38.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.468+0000 7f69f3fff700 1 --2- 172.21.15.45:0/1878676657 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f69fc15c9b0 0x7f69fc15e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:38.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.468+0000 7f69fb7fe700 1 -- 172.21.15.45:0/1878676657 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f69fc0cd7c0 msgr2=0x7f69fc1e6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:38.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.468+0000 7f69fb7fe700 1 --2- 172.21.15.45:0/1878676657 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f69fc0cd7c0 0x7f69fc1e6480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:38.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.468+0000 7f69fb7fe700 1 -- 172.21.15.45:0/1878676657 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f69fc15c9b0 msgr2=0x7f69fc15e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:38.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.468+0000 7f69fb7fe700 1 --2- 172.21.15.45:0/1878676657 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f69fc15c9b0 0x7f69fc15e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:38.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.468+0000 7f69fb7fe700 1 -- 172.21.15.45:0/1878676657 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69f4009a70 con 0x7f69fc161340 2023-11-28T12:08:38.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.468+0000 7f69f3fff700 1 --2- 172.21.15.45:0/1878676657 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f69fc15c9b0 0x7f69fc15e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:08:38.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.468+0000 7f69fb7fe700 1 --2- 172.21.15.45:0/1878676657 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f69fc161340 0x7f69fc1f5a60 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f69fc067550 tx=0x7f69f4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:38.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.469+0000 7f69f37fe700 1 -- 172.21.15.45:0/1878676657 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f4012430 con 0x7f69fc161340 2023-11-28T12:08:38.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.469+0000 7f69f37fe700 1 -- 172.21.15.45:0/1878676657 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69f4020070 con 0x7f69fc161340 2023-11-28T12:08:38.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.469+0000 7f6a015ff700 1 -- 172.21.15.45:0/1878676657 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69fc0d1300 con 0x7f69fc161340 2023-11-28T12:08:38.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.469+0000 7f69f37fe700 1 -- 172.21.15.45:0/1878676657 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f4004280 con 0x7f69fc161340 2023-11-28T12:08:38.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.469+0000 7f6a015ff700 1 -- 172.21.15.45:0/1878676657 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69fc0b5520 con 0x7f69fc161340 2023-11-28T12:08:38.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.471+0000 7f69f37fe700 1 -- 172.21.15.45:0/1878676657 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f69f40043e0 con 0x7f69fc161340 2023-11-28T12:08:38.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.472+0000 7f69f37fe700 1 --2- 172.21.15.45:0/1878676657 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f69dc0682f0 0x7f69dc06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:38.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.472+0000 7f69f37fe700 1 -- 172.21.15.45:0/1878676657 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f69f4022070 con 0x7f69fc161340 2023-11-28T12:08:38.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.472+0000 7f69faffd700 1 --2- 172.21.15.45:0/1878676657 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f69dc0682f0 0x7f69dc06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:38.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.473+0000 7f69faffd700 1 --2- 172.21.15.45:0/1878676657 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f69dc0682f0 0x7f69dc06a7a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f69ec006b20 tx=0x7f69ec008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:38.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.474+0000 7f6a14e5eb80 1 Processor -- start 2023-11-28T12:08:38.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.474+0000 7f6a14e5eb80 1 -- start start 2023-11-28T12:08:38.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.475+0000 7f6a14e5eb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b437bd3f50 0x55b437b8d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:38.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.475+0000 7f6a14e5eb80 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55b437bcaac0 0x55b437bd4320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:38.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.475+0000 7f6a14e5eb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b437bb6660 0x55b437b8eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:38.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.475+0000 7f6a14e5eb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b437b0bde0 con 0x55b437bb6660 2023-11-28T12:08:38.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.475+0000 7f6a14e5eb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b437a78140 con 0x55b437bd3f50 2023-11-28T12:08:38.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.475+0000 7f6a14e5eb80 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b437ae6db0 con 0x55b437bcaac0 2023-11-28T12:08:38.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.476+0000 7f69fb7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b437bb6660 0x55b437b8eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:38.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.476+0000 7f69faffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b437bd3f50 0x55b437b8d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:38.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.476+0000 7f69f3fff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55b437bcaac0 0x55b437bd4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:38.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.476+0000 7f69fb7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b437bb6660 0x55b437b8eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59804/0 (socket says 172.21.15.45:59804) 2023-11-28T12:08:38.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.476+0000 7f69fb7fe700 1 -- 172.21.15.45:0/3243432901 learned_addr learned my addr 172.21.15.45:0/3243432901 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:38.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.476+0000 7f69fb7fe700 1 -- 172.21.15.45:0/3243432901 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55b437bcaac0 msgr2=0x55b437bd4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:38.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.476+0000 7f69fb7fe700 1 --2- 172.21.15.45:0/3243432901 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55b437bcaac0 0x55b437bd4320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:38.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.476+0000 7f69fb7fe700 1 -- 172.21.15.45:0/3243432901 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b437bd3f50 msgr2=0x55b437b8d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:38.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.476+0000 7f69fb7fe700 1 --2- 172.21.15.45:0/3243432901 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b437bd3f50 0x55b437b8d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:38.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.476+0000 7f69fb7fe700 1 -- 172.21.15.45:0/3243432901 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b4378d4790 con 0x55b437bb6660 2023-11-28T12:08:38.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.476+0000 7f69fb7fe700 1 --2- 172.21.15.45:0/3243432901 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b437bb6660 0x55b437b8eb60 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f69f4058540 tx=0x7f69f4058570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3457dbc0170e522 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:38.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.476+0000 7f69f0ff9700 1 -- 172.21.15.45:0/3243432901 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f4025380 con 0x55b437bb6660 2023-11-28T12:08:38.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.476+0000 7f69f0ff9700 1 -- 172.21.15.45:0/3243432901 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69f40609c0 con 0x55b437bb6660 2023-11-28T12:08:38.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.476+0000 7f69f0ff9700 1 -- 172.21.15.45:0/3243432901 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f40882f0 con 0x55b437bb6660 2023-11-28T12:08:38.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.477+0000 7f6a14e5eb80 1 -- 172.21.15.45:0/3243432901 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b437bb6660 msgr2=0x55b437b8eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:38.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.477+0000 7f6a14e5eb80 1 --2- 172.21.15.45:0/3243432901 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b437bb6660 0x55b437b8eb60 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f69f4058540 tx=0x7f69f4058570 comp rx=0 tx=0).stop 2023-11-28T12:08:38.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.477+0000 7f6a14e5eb80 1 -- 172.21.15.45:0/3243432901 shutdown_connections 2023-11-28T12:08:38.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.477+0000 7f6a14e5eb80 1 --2- 172.21.15.45:0/3243432901 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b437bd3f50 0x55b437b8d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:38.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.477+0000 7f6a14e5eb80 1 --2- 172.21.15.45:0/3243432901 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b437bb6660 0x55b437b8eb60 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:38.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.477+0000 7f6a14e5eb80 1 --2- 172.21.15.45:0/3243432901 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55b437bcaac0 0x55b437bd4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:38.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.477+0000 7f6a14e5eb80 1 -- 172.21.15.45:0/3243432901 >> 172.21.15.45:0/3243432901 conn(0x55b437b83d20 msgr2=0x55b437b8cf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:38.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.477+0000 7f6a14e5eb80 1 -- 172.21.15.45:0/3243432901 shutdown_connections 2023-11-28T12:08:38.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.477+0000 7f6a14e5eb80 1 -- 172.21.15.45:0/3243432901 wait complete. 2023-11-28T12:08:38.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.478+0000 7f6a14e5eb80 1 -- start start 2023-11-28T12:08:38.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.478+0000 7f6a14e5eb80 1 Processor -- start 2023-11-28T12:08:38.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.480+0000 7f6a14e5eb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b437bb6660 0x55b437bd2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:38.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.480+0000 7f6a14e5eb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b437bcaac0 0x55b437bd33e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:38.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.480+0000 7f6a14e5eb80 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55b437bd3f50 0x55b437bcaef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:38.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.480+0000 7f6a14e5eb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b437ae0120 con 0x55b437bb6660 2023-11-28T12:08:38.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.480+0000 7f6a14e5eb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4378d5390 con 0x55b437bcaac0 2023-11-28T12:08:38.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.480+0000 7f6a14e5eb80 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b437a78340 con 0x55b437bd3f50 2023-11-28T12:08:38.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.480+0000 7f6a14e5eb80 10 client.0 _ll_register_callbacks cb 0x55b437a7e400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T12:08:38.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.480+0000 7f69faffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b437bb6660 0x55b437bd2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:38.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.480+0000 7f69faffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b437bb6660 0x55b437bd2ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59820/0 (socket says 172.21.15.45:59820) 2023-11-28T12:08:38.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.480+0000 7f69faffd700 1 -- 172.21.15.45:0/3959952290 learned_addr learned my addr 172.21.15.45:0/3959952290 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:38.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.481+0000 7f69fb7fe700 1 --2- 172.21.15.45:0/3959952290 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55b437bd3f50 0x55b437bcaef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:38.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.481+0000 7f69f3fff700 1 --2- 172.21.15.45:0/3959952290 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b437bcaac0 0x55b437bd33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:38.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.481+0000 7f69faffd700 1 -- 172.21.15.45:0/3959952290 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55b437bd3f50 msgr2=0x55b437bcaef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:38.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.481+0000 7f69faffd700 1 --2- 172.21.15.45:0/3959952290 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55b437bd3f50 0x55b437bcaef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:38.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.481+0000 7f69faffd700 1 -- 172.21.15.45:0/3959952290 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b437bcaac0 msgr2=0x55b437bd33e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:38.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.481+0000 7f69faffd700 1 --2- 172.21.15.45:0/3959952290 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b437bcaac0 0x55b437bd33e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:38.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.481+0000 7f69faffd700 1 -- 172.21.15.45:0/3959952290 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69fc0b5520 con 0x55b437bb6660 2023-11-28T12:08:38.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.481+0000 7f69faffd700 1 --2- 172.21.15.45:0/3959952290 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b437bb6660 0x55b437bd2ea0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f69ec016760 tx=0x7f69ec004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7960746171714d6e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:38.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.481+0000 7f69d9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-11-28T12:08:38.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.481+0000 7f69d9ffb700 1 -- 172.21.15.45:0/3959952290 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69ec014640 con 0x55b437bb6660 2023-11-28T12:08:38.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.481+0000 7f69d9ffb700 1 -- 172.21.15.45:0/3959952290 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(47..47 src has 1..47) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f69ec0147a0 con 0x55b437bb6660 2023-11-28T12:08:38.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.481+0000 7f6a14e5eb80 1 -- 172.21.15.45:0/3959952290 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b437ae4030 con 0x55b437bb6660 2023-11-28T12:08:38.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.482+0000 7f69d9ffb700 1 -- 172.21.15.45:0/3959952290 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f69ec014960 con 0x55b437bb6660 2023-11-28T12:08:38.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.482+0000 7f6a14e5eb80 10 client.5685 fetch_fsmap learned FSMap version 24 2023-11-28T12:08:38.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.482+0000 7f6a14e5eb80 1 -- 172.21.15.45:0/3959952290 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x55b4379c10a0 con 0x55b437bb6660 2023-11-28T12:08:38.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.482+0000 7f69d9ffb700 1 -- 172.21.15.45:0/3959952290 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b437ae4030 con 0x55b437bb6660 2023-11-28T12:08:38.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.482+0000 7f69d9ffb700 1 -- 172.21.15.45:0/3959952290 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 24) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f69ec014ac0 con 0x55b437bb6660 2023-11-28T12:08:38.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.482+0000 7f6a14e5eb80 10 client.5685 fetch_fsmap finished waiting for FSMap version 24 2023-11-28T12:08:38.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.482+0000 7f6a14e5eb80 10 client.5685 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-28T12:08:38.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.482+0000 7f6a14e5eb80 20 client.5685 populate_metadata read hostname 'smithi045' 2023-11-28T12:08:38.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.482+0000 7f6a14e5eb80 1 --2- 172.21.15.45:0/3959952290 >> [v2:172.21.15.45:6833/1281816633,v1:172.21.15.45:6835/1281816633] conn(0x55b437bcb920 0x55b437be67d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:38.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.482+0000 7f6a14e5eb80 4 client.5685 mds_command: new command op to 5550 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-28T12:08:38.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.482+0000 7f6a14e5eb80 1 -- 172.21.15.45:0/3959952290 --> [v2:172.21.15.45:6833/1281816633,v1:172.21.15.45:6835/1281816633] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b43792fef0 con 0x55b437bcb920 2023-11-28T12:08:38.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.482+0000 7f69f3fff700 1 --2- 172.21.15.45:0/3959952290 >> [v2:172.21.15.45:6833/1281816633,v1:172.21.15.45:6835/1281816633] conn(0x55b437bcb920 0x55b437be67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:38.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.483+0000 7f69f3fff700 1 --2- 172.21.15.45:0/3959952290 >> [v2:172.21.15.45:6833/1281816633,v1:172.21.15.45:6835/1281816633] conn(0x55b437bcb920 0x55b437be67d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f0e680ba96846ea6 server_cookie=d4d6b3b6e40a02b5 in_seq=0 out_seq=0 2023-11-28T12:08:38.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.483+0000 7f69d9ffb700 10 client.5685 ms_handle_connect on v2:172.21.15.45:6833/1281816633 2023-11-28T12:08:38.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.484+0000 7f69d9ffb700 1 -- 172.21.15.45:0/3959952290 <== mds.0 v2:172.21.15.45:6833/1281816633 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x55b43792fef0 con 0x55b437bcb920 2023-11-28T12:08:38.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.484+0000 7f69d9ffb700 10 client.5685 handle_command_reply: tid=0 2023-11-28T12:08:38.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.484+0000 7f6a14e5eb80 1 client.5685 shutdown 2023-11-28T12:08:38.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.484+0000 7f6a14e5eb80 1 -- 172.21.15.45:0/3959952290 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b437bb6660 msgr2=0x55b437bd2ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:38.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.484+0000 7f6a14e5eb80 1 --2- 172.21.15.45:0/3959952290 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b437bb6660 0x55b437bd2ea0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f69ec016760 tx=0x7f69ec004750 comp rx=0 tx=0).stop 2023-11-28T12:08:38.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.484+0000 7f6a14e5eb80 1 -- 172.21.15.45:0/3959952290 shutdown_connections 2023-11-28T12:08:38.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.484+0000 7f6a14e5eb80 1 --2- 172.21.15.45:0/3959952290 >> [v2:172.21.15.45:6833/1281816633,v1:172.21.15.45:6835/1281816633] conn(0x55b437bcb920 0x55b437be67d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:38.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.484+0000 7f6a14e5eb80 1 --2- 172.21.15.45:0/3959952290 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55b437bd3f50 0x55b437bcaef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:38.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.484+0000 7f6a14e5eb80 1 --2- 172.21.15.45:0/3959952290 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b437bb6660 0x55b437bd2ea0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:38.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.484+0000 7f6a14e5eb80 1 --2- 172.21.15.45:0/3959952290 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b437bcaac0 0x55b437bd33e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:38.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.484+0000 7f69d9ffb700 0 client.5685 ms_handle_reset on v2:172.21.15.45:6833/1281816633 2023-11-28T12:08:38.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.484+0000 7f6a14e5eb80 1 -- 172.21.15.45:0/3959952290 >> 172.21.15.45:0/3959952290 conn(0x55b437b83d20 msgr2=0x55b437b8cf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:38.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.484+0000 7f6a14e5eb80 1 -- 172.21.15.45:0/3959952290 shutdown_connections 2023-11-28T12:08:38.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.484+0000 7f6a14e5eb80 1 -- 172.21.15.45:0/3959952290 wait complete. 2023-11-28T12:08:38.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.484+0000 7f6a14e5eb80 20 client.5685 trim_cache size 0 max 16384 2023-11-28T12:08:38.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.502+0000 7f6a14e5eb80 1 Processor -- start 2023-11-28T12:08:38.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.502+0000 7f6a14e5eb80 1 -- start start 2023-11-28T12:08:38.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.503+0000 7f6a14e5eb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b437bb6660 0x55b437bb6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:38.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.503+0000 7f6a14e5eb80 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55b437bcaac0 0x55b437bb72f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:38.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.503+0000 7f6a14e5eb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b437bd3f50 0x55b437bb9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:38.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.503+0000 7f6a14e5eb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b437bcbcf0 con 0x55b437bd3f50 2023-11-28T12:08:38.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.503+0000 7f6a14e5eb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b437b89370 con 0x55b437bb6660 2023-11-28T12:08:38.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.503+0000 7f6a14e5eb80 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b437b83ac0 con 0x55b437bcaac0 2023-11-28T12:08:38.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.503+0000 7f69fb7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b437bd3f50 0x55b437bb9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:38.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.503+0000 7f69fb7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b437bd3f50 0x55b437bb9040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59824/0 (socket says 172.21.15.45:59824) 2023-11-28T12:08:38.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.504+0000 7f69fb7fe700 1 -- 172.21.15.45:0/2158341804 learned_addr learned my addr 172.21.15.45:0/2158341804 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:38.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.504+0000 7f69fb7fe700 1 -- 172.21.15.45:0/2158341804 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55b437bcaac0 msgr2=0x55b437bb72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:38.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.504+0000 7f69fb7fe700 1 --2- 172.21.15.45:0/2158341804 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55b437bcaac0 0x55b437bb72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:38.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.504+0000 7f69fb7fe700 1 -- 172.21.15.45:0/2158341804 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b437bb6660 msgr2=0x55b437bb6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:38.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.504+0000 7f69fb7fe700 1 --2- 172.21.15.45:0/2158341804 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b437bb6660 0x55b437bb6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:38.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.504+0000 7f69fb7fe700 1 -- 172.21.15.45:0/2158341804 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b437aa72e0 con 0x55b437bd3f50 2023-11-28T12:08:38.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.504+0000 7f69fb7fe700 1 --2- 172.21.15.45:0/2158341804 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b437bd3f50 0x55b437bb9040 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f69f4056c80 tx=0x7f69f4087000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74a8414c520ec585 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:38.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.504+0000 7f69f17fa700 1 -- 172.21.15.45:0/2158341804 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f4085040 con 0x55b437bd3f50 2023-11-28T12:08:38.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.504+0000 7f69f17fa700 1 -- 172.21.15.45:0/2158341804 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69f4058470 con 0x55b437bd3f50 2023-11-28T12:08:38.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.504+0000 7f69f17fa700 1 -- 172.21.15.45:0/2158341804 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f4088310 con 0x55b437bd3f50 2023-11-28T12:08:38.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.505+0000 7f6a14e5eb80 1 -- 172.21.15.45:0/2158341804 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b437bd3f50 msgr2=0x55b437bb9040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:38.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.505+0000 7f6a14e5eb80 1 --2- 172.21.15.45:0/2158341804 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b437bd3f50 0x55b437bb9040 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f69f4056c80 tx=0x7f69f4087000 comp rx=0 tx=0).stop 2023-11-28T12:08:38.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.505+0000 7f6a14e5eb80 1 -- 172.21.15.45:0/2158341804 shutdown_connections 2023-11-28T12:08:38.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.505+0000 7f6a14e5eb80 1 --2- 172.21.15.45:0/2158341804 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b437bb6660 0x55b437bb6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:38.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.505+0000 7f6a14e5eb80 1 --2- 172.21.15.45:0/2158341804 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b437bd3f50 0x55b437bb9040 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:38.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.505+0000 7f6a14e5eb80 1 --2- 172.21.15.45:0/2158341804 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55b437bcaac0 0x55b437bb72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:38.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.505+0000 7f6a14e5eb80 1 -- 172.21.15.45:0/2158341804 >> 172.21.15.45:0/2158341804 conn(0x55b437b83d20 msgr2=0x55b437bcc250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:38.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.505+0000 7f6a14e5eb80 1 -- 172.21.15.45:0/2158341804 shutdown_connections 2023-11-28T12:08:38.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.505+0000 7f6a14e5eb80 1 -- 172.21.15.45:0/2158341804 wait complete. 2023-11-28T12:08:38.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.506+0000 7f6a14e5eb80 1 -- start start 2023-11-28T12:08:38.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.506+0000 7f6a14e5eb80 1 Processor -- start 2023-11-28T12:08:38.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.507+0000 7f6a14e5eb80 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55b437bb6660 0x55b437c33900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:38.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.507+0000 7f6a14e5eb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b437bcaac0 0x55b437be48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:38.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.507+0000 7f6a14e5eb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b437bd3f50 0x55b437c3a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:38.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.507+0000 7f6a14e5eb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b437c3a7b0 con 0x55b437bd3f50 2023-11-28T12:08:38.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.507+0000 7f6a14e5eb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b437bb4d00 con 0x55b437bcaac0 2023-11-28T12:08:38.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.507+0000 7f6a14e5eb80 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b437be4ec0 con 0x55b437bb6660 2023-11-28T12:08:38.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.507+0000 7f6a14e5eb80 10 client.0 _ll_register_callbacks cb 0x55b437a7e400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T12:08:38.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.507+0000 7f69fb7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b437bd3f50 0x55b437c3a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:38.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.507+0000 7f69fb7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b437bd3f50 0x55b437c3a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59836/0 (socket says 172.21.15.45:59836) 2023-11-28T12:08:38.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.507+0000 7f69fb7fe700 1 -- 172.21.15.45:0/1518740403 learned_addr learned my addr 172.21.15.45:0/1518740403 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:38.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.507+0000 7f69faffd700 1 --2- 172.21.15.45:0/1518740403 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55b437bb6660 0x55b437c33900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:38.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.508+0000 7f69f3fff700 1 --2- 172.21.15.45:0/1518740403 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b437bcaac0 0x55b437be48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:38.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.508+0000 7f69fb7fe700 1 -- 172.21.15.45:0/1518740403 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55b437bb6660 msgr2=0x55b437c33900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:38.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.508+0000 7f69fb7fe700 1 --2- 172.21.15.45:0/1518740403 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55b437bb6660 0x55b437c33900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:38.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.508+0000 7f69fb7fe700 1 -- 172.21.15.45:0/1518740403 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b437bcaac0 msgr2=0x55b437be48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:38.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.508+0000 7f69fb7fe700 1 --2- 172.21.15.45:0/1518740403 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b437bcaac0 0x55b437be48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:38.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.508+0000 7f69fb7fe700 1 -- 172.21.15.45:0/1518740403 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b4378d4790 con 0x55b437bd3f50 2023-11-28T12:08:38.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.508+0000 7f69f3fff700 1 --2- 172.21.15.45:0/1518740403 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b437bcaac0 0x55b437be48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:08:38.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.508+0000 7f69fb7fe700 1 --2- 172.21.15.45:0/1518740403 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b437bd3f50 0x55b437c3a270 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f69f4009a40 tx=0x7f69f4009560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee195d5c4e1f189b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:38.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.508+0000 7f69d9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-11-28T12:08:38.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.508+0000 7f69d9ffb700 1 -- 172.21.15.45:0/1518740403 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f4085040 con 0x55b437bd3f50 2023-11-28T12:08:38.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.508+0000 7f69d9ffb700 1 -- 172.21.15.45:0/1518740403 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(47..47 src has 1..47) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f69f406fe40 con 0x55b437bd3f50 2023-11-28T12:08:38.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.508+0000 7f6a14e5eb80 1 -- 172.21.15.45:0/1518740403 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b437b90080 con 0x55b437bd3f50 2023-11-28T12:08:38.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.508+0000 7f69d9ffb700 1 -- 172.21.15.45:0/1518740403 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f69f4004670 con 0x55b437bd3f50 2023-11-28T12:08:38.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.508+0000 7f6a14e5eb80 10 client.5691 fetch_fsmap learned FSMap version 24 2023-11-28T12:08:38.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.508+0000 7f6a14e5eb80 1 -- 172.21.15.45:0/1518740403 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x55b4379351d0 con 0x55b437bd3f50 2023-11-28T12:08:38.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.509+0000 7f69d9ffb700 1 -- 172.21.15.45:0/1518740403 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b437b90080 con 0x55b437bd3f50 2023-11-28T12:08:38.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.509+0000 7f69d9ffb700 1 -- 172.21.15.45:0/1518740403 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 24) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f69f40047d0 con 0x55b437bd3f50 2023-11-28T12:08:38.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.509+0000 7f6a14e5eb80 10 client.5691 fetch_fsmap finished waiting for FSMap version 24 2023-11-28T12:08:38.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.509+0000 7f6a14e5eb80 10 client.5691 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-28T12:08:38.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.509+0000 7f6a14e5eb80 20 client.5691 populate_metadata read hostname 'smithi045' 2023-11-28T12:08:38.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.509+0000 7f6a14e5eb80 1 --2- 172.21.15.45:0/1518740403 >> [v2:172.21.15.45:6833/1281816633,v1:172.21.15.45:6835/1281816633] conn(0x55b437bb73d0 0x55b437bb40a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:38.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.509+0000 7f6a14e5eb80 4 client.5691 mds_command: new command op to 5550 tid=0[{"prefix": "status"}] 2023-11-28T12:08:38.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.509+0000 7f6a14e5eb80 1 -- 172.21.15.45:0/1518740403 --> [v2:172.21.15.45:6833/1281816633,v1:172.21.15.45:6835/1281816633] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f69f40609c0 con 0x55b437bb73d0 2023-11-28T12:08:38.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.509+0000 7f69faffd700 1 --2- 172.21.15.45:0/1518740403 >> [v2:172.21.15.45:6833/1281816633,v1:172.21.15.45:6835/1281816633] conn(0x55b437bb73d0 0x55b437bb40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:38.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.509+0000 7f69faffd700 1 --2- 172.21.15.45:0/1518740403 >> [v2:172.21.15.45:6833/1281816633,v1:172.21.15.45:6835/1281816633] conn(0x55b437bb73d0 0x55b437bb40a0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=adfcf9883ed378f8 server_cookie=86f71b83f684d624 in_seq=0 out_seq=0 2023-11-28T12:08:38.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.509+0000 7f69d9ffb700 10 client.5691 ms_handle_connect on v2:172.21.15.45:6833/1281816633 2023-11-28T12:08:38.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.510+0000 7f69d9ffb700 1 -- 172.21.15.45:0/1518740403 <== mds.0 v2:172.21.15.45:6833/1281816633 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x7f69f40609c0 con 0x55b437bb73d0 2023-11-28T12:08:38.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.510+0000 7f69d9ffb700 10 client.5691 handle_command_reply: tid=0 2023-11-28T12:08:38.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.510+0000 7f6a14e5eb80 1 client.5691 shutdown 2023-11-28T12:08:38.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.510+0000 7f6a14e5eb80 1 -- 172.21.15.45:0/1518740403 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b437bd3f50 msgr2=0x55b437c3a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:38.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.510+0000 7f6a14e5eb80 1 --2- 172.21.15.45:0/1518740403 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b437bd3f50 0x55b437c3a270 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f69f4009a40 tx=0x7f69f4009560 comp rx=0 tx=0).stop 2023-11-28T12:08:38.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.510+0000 7f6a14e5eb80 1 -- 172.21.15.45:0/1518740403 shutdown_connections 2023-11-28T12:08:38.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.510+0000 7f6a14e5eb80 1 --2- 172.21.15.45:0/1518740403 >> [v2:172.21.15.45:6833/1281816633,v1:172.21.15.45:6835/1281816633] conn(0x55b437bb73d0 0x55b437bb40a0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:38.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.510+0000 7f6a14e5eb80 1 --2- 172.21.15.45:0/1518740403 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b437bd3f50 0x55b437c3a270 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:38.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.510+0000 7f69d9ffb700 0 client.5691 ms_handle_reset on v2:172.21.15.45:6833/1281816633 2023-11-28T12:08:38.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.510+0000 7f6a14e5eb80 1 --2- 172.21.15.45:0/1518740403 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55b437bb6660 0x55b437c33900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:38.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.510+0000 7f6a14e5eb80 1 --2- 172.21.15.45:0/1518740403 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55b437bcaac0 0x55b437be48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:38.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.510+0000 7f6a14e5eb80 1 -- 172.21.15.45:0/1518740403 >> 172.21.15.45:0/1518740403 conn(0x55b437b83d20 msgr2=0x55b437bcd570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:38.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.510+0000 7f6a14e5eb80 1 -- 172.21.15.45:0/1518740403 shutdown_connections 2023-11-28T12:08:38.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.510+0000 7f6a14e5eb80 1 -- 172.21.15.45:0/1518740403 wait complete. 2023-11-28T12:08:38.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.510+0000 7f6a14e5eb80 20 client.5691 trim_cache size 0 max 16384 2023-11-28T12:08:38.516 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-11-28T12:08:38.516 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_fsid": "bd7c37f1-f7c6-4778-b845-52cf2aa6e366", 2023-11-28T12:08:38.517 INFO:teuthology.orchestra.run.smithi045.stdout: "whoami": 0, 2023-11-28T12:08:38.517 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 5550, 2023-11-28T12:08:38.517 INFO:teuthology.orchestra.run.smithi045.stdout: "want_state": "up:active", 2023-11-28T12:08:38.517 INFO:teuthology.orchestra.run.smithi045.stdout: "state": "up:active", 2023-11-28T12:08:38.517 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs", 2023-11-28T12:08:38.518 INFO:teuthology.orchestra.run.smithi045.stdout: "rank_uptime": 7.1160580040000001, 2023-11-28T12:08:38.518 INFO:teuthology.orchestra.run.smithi045.stdout: "mdsmap_epoch": 24, 2023-11-28T12:08:38.518 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch": 47, 2023-11-28T12:08:38.518 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch_barrier": 47, 2023-11-28T12:08:38.519 INFO:teuthology.orchestra.run.smithi045.stdout: "uptime": 12.978308194 2023-11-28T12:08:38.522 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-11-28T12:08:38.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.511+0000 7f6a015ff700 1 -- 172.21.15.45:0/1878676657 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f69dc0682f0 msgr2=0x7f69dc06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:38.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.511+0000 7f6a015ff700 1 --2- 172.21.15.45:0/1878676657 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f69dc0682f0 0x7f69dc06a7a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f69ec006b20 tx=0x7f69ec008040 comp rx=0 tx=0).stop 2023-11-28T12:08:38.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.511+0000 7f6a015ff700 1 -- 172.21.15.45:0/1878676657 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f69fc161340 msgr2=0x7f69fc1f5a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:38.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.511+0000 7f6a015ff700 1 --2- 172.21.15.45:0/1878676657 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f69fc161340 0x7f69fc1f5a60 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f69fc067550 tx=0x7f69f4004ad0 comp rx=0 tx=0).stop 2023-11-28T12:08:38.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.511+0000 7f6a015ff700 1 -- 172.21.15.45:0/1878676657 shutdown_connections 2023-11-28T12:08:38.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.511+0000 7f6a015ff700 1 --2- 172.21.15.45:0/1878676657 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f69dc0682f0 0x7f69dc06a7a0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:38.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.511+0000 7f6a015ff700 1 --2- 172.21.15.45:0/1878676657 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f69fc161340 0x7f69fc1f5a60 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:38.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.511+0000 7f6a015ff700 1 --2- 172.21.15.45:0/1878676657 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f69fc0cd7c0 0x7f69fc1e6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:38.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.511+0000 7f6a015ff700 1 --2- 172.21.15.45:0/1878676657 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f69fc15c9b0 0x7f69fc15e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:38.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.511+0000 7f6a015ff700 1 -- 172.21.15.45:0/1878676657 >> 172.21.15.45:0/1878676657 conn(0x7f69fc072600 msgr2=0x7f69fc160610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:38.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.511+0000 7f6a015ff700 1 -- 172.21.15.45:0/1878676657 shutdown_connections 2023-11-28T12:08:38.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.511+0000 7f6a015ff700 1 -- 172.21.15.45:0/1878676657 wait complete. 2023-11-28T12:08:38.529 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T12:08:38.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.732+0000 7f79ed3ff700 1 Processor -- start 2023-11-28T12:08:38.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.732+0000 7f79ed3ff700 1 -- start start 2023-11-28T12:08:38.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.733+0000 7f79ed3ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f79e8161340 0x7f79e80d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:38.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.733+0000 7f79ed3ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79e80d1950 con 0x7f79e80d2320 2023-11-28T12:08:38.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.733+0000 7f79ed3ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79e80b5520 con 0x7f79e815c9b0 2023-11-28T12:08:38.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.733+0000 7f79ed3ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79e80b5800 con 0x7f79e8161340 2023-11-28T12:08:38.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.734+0000 7f79e77fe700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f79e80d2320 0x7f79e80cd7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:42950/0 (socket says 172.21.15.45:42950) 2023-11-28T12:08:38.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.734+0000 7f79e77fe700 1 -- 172.21.15.45:0/1733576982 learned_addr learned my addr 172.21.15.45:0/1733576982 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:08:38.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.734+0000 7f79e67fc700 1 --2- 172.21.15.45:0/1733576982 >> v2:172.21.15.152:3300/0 conn(0x7f79e8161340 0x7f79e80d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:38.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.734+0000 7f79e5ffb700 1 -- 172.21.15.45:0/1733576982 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4241165245 0 0) 0x7f79e80d1950 con 0x7f79e80d2320 2023-11-28T12:08:38.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.734+0000 7f79e5ffb700 1 -- 172.21.15.45:0/1733576982 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79d00035b0 con 0x7f79e80d2320 2023-11-28T12:08:38.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.734+0000 7f79e5ffb700 1 -- 172.21.15.45:0/1733576982 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1236490654 0 0) 0x7f79e80b5520 con 0x7f79e815c9b0 2023-11-28T12:08:38.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.734+0000 7f79e5ffb700 1 -- 172.21.15.45:0/1733576982 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79e80d1950 con 0x7f79e815c9b0 2023-11-28T12:08:38.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.734+0000 7f79e5ffb700 1 -- 172.21.15.45:0/1733576982 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 312921799 0 0) 0x7f79d00035b0 con 0x7f79e80d2320 2023-11-28T12:08:38.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.734+0000 7f79e67fc700 1 -- 172.21.15.45:0/1733576982 >> v1:172.21.15.152:6789/0 conn(0x7f79e815c9b0 legacy=0x7f79e80b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:38.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.735+0000 7f79e67fc700 1 -- 172.21.15.45:0/1733576982 >> v1:172.21.15.45:6789/0 conn(0x7f79e80d2320 legacy=0x7f79e80cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:38.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.735+0000 7f79e67fc700 1 -- 172.21.15.45:0/1733576982 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e80d1300 con 0x7f79e8161340 2023-11-28T12:08:38.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.735+0000 7f79e67fc700 1 --2- 172.21.15.45:0/1733576982 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79e8161340 0x7f79e80d1de0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f79dc0097c0 tx=0x7f79dc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c14c0037c420c70 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:38.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.735+0000 7f79e5ffb700 1 -- 172.21.15.45:0/1733576982 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e00019f0 con 0x7f79e8161340 2023-11-28T12:08:38.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.735+0000 7f79e5ffb700 1 -- 172.21.15.45:0/1733576982 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79dc004030 con 0x7f79e8161340 2023-11-28T12:08:38.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.735+0000 7f79e5ffb700 1 -- 172.21.15.45:0/1733576982 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d80015f0 con 0x7f79e8161340 2023-11-28T12:08:38.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.736+0000 7f79ed3ff700 1 -- 172.21.15.45:0/1733576982 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79e8161340 msgr2=0x7f79e80d1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:38.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.736+0000 7f79ed3ff700 1 --2- 172.21.15.45:0/1733576982 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79e8161340 0x7f79e80d1de0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f79dc0097c0 tx=0x7f79dc009b50 comp rx=0 tx=0).stop 2023-11-28T12:08:38.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.736+0000 7f79ed3ff700 1 -- 172.21.15.45:0/1733576982 shutdown_connections 2023-11-28T12:08:38.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.736+0000 7f79ed3ff700 1 --2- 172.21.15.45:0/1733576982 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79e8161340 0x7f79e80d1de0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:38.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.736+0000 7f79ed3ff700 1 -- 172.21.15.45:0/1733576982 >> 172.21.15.45:0/1733576982 conn(0x7f79e8072600 msgr2=0x7f79e80cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:38.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.736+0000 7f79ed3ff700 1 -- 172.21.15.45:0/1733576982 shutdown_connections 2023-11-28T12:08:38.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.736+0000 7f79ed3ff700 1 -- 172.21.15.45:0/1733576982 wait complete. 2023-11-28T12:08:38.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.737+0000 7f79ed3ff700 1 Processor -- start 2023-11-28T12:08:38.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.738+0000 7f79ed3ff700 1 -- start start 2023-11-28T12:08:38.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.738+0000 7f79ed3ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79e80d2320 0x7f79e8159ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:38.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.739+0000 7f79ed3ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79e815c9b0 0x7f79e806ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:38.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.739+0000 7f79ed3ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f79e8161340 0x7f79e80c7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:38.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.739+0000 7f79ed3ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e8158c00 con 0x7f79e815c9b0 2023-11-28T12:08:38.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.739+0000 7f79ed3ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e8158ee0 con 0x7f79e80d2320 2023-11-28T12:08:38.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.739+0000 7f79ed3ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79e81591c0 con 0x7f79e8161340 2023-11-28T12:08:38.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.739+0000 7f79e67fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79e815c9b0 0x7f79e806ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:38.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.739+0000 7f79e67fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79e815c9b0 0x7f79e806ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59852/0 (socket says 172.21.15.45:59852) 2023-11-28T12:08:38.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.739+0000 7f79e67fc700 1 -- 172.21.15.45:0/1026390016 learned_addr learned my addr 172.21.15.45:0/1026390016 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:38.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.739+0000 7f79e67fc700 1 -- 172.21.15.45:0/1026390016 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f79e8161340 msgr2=0x7f79e80c7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:38.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.739+0000 7f79e67fc700 1 --2- 172.21.15.45:0/1026390016 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f79e8161340 0x7f79e80c7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:38.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.739+0000 7f79e67fc700 1 -- 172.21.15.45:0/1026390016 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79e80d2320 msgr2=0x7f79e8159ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:38.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.739+0000 7f79e6ffd700 1 --2- 172.21.15.45:0/1026390016 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79e80d2320 0x7f79e8159ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:38.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.739+0000 7f79e67fc700 1 --2- 172.21.15.45:0/1026390016 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79e80d2320 0x7f79e8159ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:38.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.739+0000 7f79e67fc700 1 -- 172.21.15.45:0/1026390016 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79dc0094a0 con 0x7f79e815c9b0 2023-11-28T12:08:38.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.739+0000 7f79e6ffd700 1 --2- 172.21.15.45:0/1026390016 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79e80d2320 0x7f79e8159ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:08:38.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.740+0000 7f79e67fc700 1 --2- 172.21.15.45:0/1026390016 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79e815c9b0 0x7f79e806ab70 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f79dc000c00 tx=0x7f79dc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:38.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.740+0000 7f79cf7fe700 1 -- 172.21.15.45:0/1026390016 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79dc010590 con 0x7f79e815c9b0 2023-11-28T12:08:38.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.740+0000 7f79cf7fe700 1 -- 172.21.15.45:0/1026390016 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79dc010710 con 0x7f79e815c9b0 2023-11-28T12:08:38.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.740+0000 7f79cf7fe700 1 -- 172.21.15.45:0/1026390016 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79dc010ac0 con 0x7f79e815c9b0 2023-11-28T12:08:38.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.740+0000 7f79ed3ff700 1 -- 172.21.15.45:0/1026390016 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79e815cd80 con 0x7f79e815c9b0 2023-11-28T12:08:38.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.740+0000 7f79ed3ff700 1 -- 172.21.15.45:0/1026390016 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79e80d15e0 con 0x7f79e815c9b0 2023-11-28T12:08:38.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.741+0000 7f79ed3ff700 1 -- 172.21.15.45:0/1026390016 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79e815cf10 con 0x7f79e815c9b0 2023-11-28T12:08:38.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.742+0000 7f79cf7fe700 1 -- 172.21.15.45:0/1026390016 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f79dc00f050 con 0x7f79e815c9b0 2023-11-28T12:08:38.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.743+0000 7f79cf7fe700 1 --2- 172.21.15.45:0/1026390016 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f79d40682f0 0x7f79d406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:38.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.743+0000 7f79cf7fe700 1 -- 172.21.15.45:0/1026390016 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f79dc087400 con 0x7f79e815c9b0 2023-11-28T12:08:38.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.743+0000 7f79e6ffd700 1 --2- 172.21.15.45:0/1026390016 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f79d40682f0 0x7f79d406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:38.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.744+0000 7f79e6ffd700 1 --2- 172.21.15.45:0/1026390016 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f79d40682f0 0x7f79d406a7a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f79d8007a20 tx=0x7f79d8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:38.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.747+0000 7f79cf7fe700 1 -- 172.21.15.45:0/1026390016 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f79dc053b70 con 0x7f79e815c9b0 2023-11-28T12:08:38.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.998+0000 7f79ed3ff700 1 -- 172.21.15.45:0/1026390016 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f79e80745c0 con 0x7f79e815c9b0 2023-11-28T12:08:38.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:38.999+0000 7f79cf7fe700 1 -- 172.21.15.45:0/1026390016 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v24) v1 ==== 53+0+73 (secure 0 0 0) 0x7f79dc020060 con 0x7f79e815c9b0 2023-11-28T12:08:38.999 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-28T12:08:39.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:39.001+0000 7f79ed3ff700 1 -- 172.21.15.45:0/1026390016 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f79d40682f0 msgr2=0x7f79d406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:39.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:39.001+0000 7f79ed3ff700 1 --2- 172.21.15.45:0/1026390016 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f79d40682f0 0x7f79d406a7a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f79d8007a20 tx=0x7f79d8009040 comp rx=0 tx=0).stop 2023-11-28T12:08:39.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:39.001+0000 7f79ed3ff700 1 -- 172.21.15.45:0/1026390016 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79e815c9b0 msgr2=0x7f79e806ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:39.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:39.001+0000 7f79ed3ff700 1 --2- 172.21.15.45:0/1026390016 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79e815c9b0 0x7f79e806ab70 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f79dc000c00 tx=0x7f79dc004750 comp rx=0 tx=0).stop 2023-11-28T12:08:39.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:39.001+0000 7f79ed3ff700 1 -- 172.21.15.45:0/1026390016 shutdown_connections 2023-11-28T12:08:39.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:39.001+0000 7f79ed3ff700 1 --2- 172.21.15.45:0/1026390016 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f79d40682f0 0x7f79d406a7a0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:39.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:39.001+0000 7f79ed3ff700 1 --2- 172.21.15.45:0/1026390016 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79e80d2320 0x7f79e8159ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:39.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:39.001+0000 7f79ed3ff700 1 --2- 172.21.15.45:0/1026390016 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f79e8161340 0x7f79e80c7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:39.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:39.001+0000 7f79ed3ff700 1 --2- 172.21.15.45:0/1026390016 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79e815c9b0 0x7f79e806ab70 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:39.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:39.001+0000 7f79ed3ff700 1 -- 172.21.15.45:0/1026390016 >> 172.21.15.45:0/1026390016 conn(0x7f79e8072600 msgr2=0x7f79e80b5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:39.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:39.001+0000 7f79ed3ff700 1 -- 172.21.15.45:0/1026390016 shutdown_connections 2023-11-28T12:08:39.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:39.001+0000 7f79ed3ff700 1 -- 172.21.15.45:0/1026390016 wait complete. 2023-11-28T12:08:39.020 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-28T12:08:39.020 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T12:08:39.020 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi045.front.sepia.ceph.com 2023-11-28T12:08:39.020 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-28T12:08:39.020 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-28T12:08:39.020 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-28T12:08:39.020 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-28T12:08:39.021 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T12:08:39.021 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T12:08:39.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:08:39.021 DEBUG:teuthology.orchestra.run.smithi045:> ip addr 2023-11-28T12:08:39.070 INFO:teuthology.orchestra.run.smithi045.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T12:08:39.070 INFO:teuthology.orchestra.run.smithi045.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T12:08:39.070 INFO:teuthology.orchestra.run.smithi045.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T12:08:39.070 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T12:08:39.070 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 ::1/128 scope host 2023-11-28T12:08:39.071 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T12:08:39.071 INFO:teuthology.orchestra.run.smithi045.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-28T12:08:39.071 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a6 brd ff:ff:ff:ff:ff:ff 2023-11-28T12:08:39.071 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f0 2023-11-28T12:08:39.071 INFO:teuthology.orchestra.run.smithi045.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-28T12:08:39.071 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a7 brd ff:ff:ff:ff:ff:ff 2023-11-28T12:08:39.072 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f1 2023-11-28T12:08:39.072 INFO:teuthology.orchestra.run.smithi045.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T12:08:39.072 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:be brd ff:ff:ff:ff:ff:ff 2023-11-28T12:08:39.072 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f0 2023-11-28T12:08:39.073 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.21.15.45/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-11-28T12:08:39.073 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft 41870sec preferred_lft 41870sec 2023-11-28T12:08:39.073 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::ec4:7aff:febd:12be/64 scope link 2023-11-28T12:08:39.073 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T12:08:39.074 INFO:teuthology.orchestra.run.smithi045.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-28T12:08:39.074 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:bf brd ff:ff:ff:ff:ff:ff 2023-11-28T12:08:39.074 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f1 2023-11-28T12:08:39.074 INFO:teuthology.orchestra.run.smithi045.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T12:08:39.075 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 22:47:66:33:f5:4d brd ff:ff:ff:ff:ff:ff 2023-11-28T12:08:39.075 INFO:teuthology.orchestra.run.smithi045.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-28T12:08:39.075 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T12:08:39.075 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::c479:bdff:fe23:e158/64 scope link 2023-11-28T12:08:39.076 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T12:08:39.076 INFO:teuthology.orchestra.run.smithi045.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T12:08:39.076 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 62:87:bf:4a:62:2a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T12:08:39.076 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::6087:bfff:fe4a:622a/64 scope link 2023-11-28T12:08:39.076 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T12:08:39.076 INFO:teuthology.orchestra.run.smithi045.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T12:08:39.077 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 22:47:66:33:f5:4d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T12:08:39.077 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::2047:66ff:fe33:f54d/64 scope link 2023-11-28T12:08:39.077 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T12:08:39.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:08:39.078 DEBUG:teuthology.orchestra.run.smithi045:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T12:08:39.146 INFO:teuthology.orchestra.run.smithi045.stdout:1 2023-11-28T12:08:39.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:08:39.150 DEBUG:teuthology.orchestra.run.smithi045:> route 2023-11-28T12:08:39.199 INFO:teuthology.orchestra.run.smithi045.stdout:Kernel IP routing table 2023-11-28T12:08:39.199 INFO:teuthology.orchestra.run.smithi045.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T12:08:39.200 INFO:teuthology.orchestra.run.smithi045.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-11-28T12:08:39.200 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-11-28T12:08:39.200 INFO:teuthology.orchestra.run.smithi045.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T12:08:39.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:08:39.200 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-11-28T12:08:39.200 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-11-28T12:08:39.200 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-28T12:08:39.201 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-28T12:08:39.201 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-28T12:08:39.201 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-11-28T12:08:39.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:08:39.374 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2023-11-28T12:08:39.422 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-28T12:08:39.422 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-28T12:08:39.423 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T12:08:39.423 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:08:39.423 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set brx.0 up 2023-11-28T12:08:39.496 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T12:08:39.496 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-28T12:08:39.545 INFO:teuthology.orchestra.run.smithi045.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-28T12:08:39.546 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T12:08:39.546 DEBUG:teuthology.orchestra.run.smithi045:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-28T12:08:39.591 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-28T12:08:39.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:08:39.592 DEBUG:teuthology.orchestra.run.smithi045:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-28T12:08:39.739 INFO:teuthology.orchestra.run.smithi045.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-28T12:08:39.740 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-28T12:08:39.740 INFO:teuthology.orchestra.run.smithi045.stdout:invalid new device string format 2023-11-28T12:08:39.756 INFO:teuthology.orchestra.run.smithi045.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-28T12:08:39.756 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-28T12:08:39.756 INFO:teuthology.orchestra.run.smithi045.stdout:invalid new device string format 2023-11-28T12:08:39.756 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: resolved to: "172.21.15.45:3300,172.21.15.152:3300,172.21.15.152:3301" 2023-11-28T12:08:39.756 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-28T12:08:39.777 INFO:teuthology.orchestra.run.smithi045.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-28T12:08:39.777 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-28T12:08:39.777 INFO:teuthology.orchestra.run.smithi045.stdout:invalid new device string format 2023-11-28T12:08:39.777 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: resolved to: "172.21.15.45:3300,172.21.15.152:3300,172.21.15.152:3301" 2023-11-28T12:08:39.777 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-28T12:08:39.778 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: resolved to: "172.21.15.45:6789,172.21.15.152:6789,172.21.15.152:6790" 2023-11-28T12:08:39.778 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.45:6789,172.21.15.152:6789,172.21.15.152:6790:/ 2023-11-28T12:08:39.778 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=bd7c37f1-f7c6-4778-b845-52cf2aa6e366" will pass to kernel 2023-11-28T12:08:39.782 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-28T12:08:39.782 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:08:39.782 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-28T12:08:39.853 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:08:39.853 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-28T12:08:39.957 INFO:teuthology.orchestra.run.smithi045.stdout:client5700 2023-11-28T12:08:39.958 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T12:08:39.958 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T12:08:40.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:08:40.005 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parent_a) 2023-11-28T12:08:40.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:08:40.097 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch parent_a/alpha) 2023-11-28T12:08:40.146 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits daemon-helper kill python3 -c ' 2023-11-28T12:08:40.146 DEBUG:teuthology.orchestra.run.smithi045:> import os 2023-11-28T12:08:40.146 DEBUG:teuthology.orchestra.run.smithi045:> import stat 2023-11-28T12:08:40.146 DEBUG:teuthology.orchestra.run.smithi045:> 2023-11-28T12:08:40.147 DEBUG:teuthology.orchestra.run.smithi045:> print(os.stat("/home/ubuntu/cephtest/mnt.0/parent_a/alpha").st_ino) 2023-11-28T12:08:40.147 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-11-28T12:08:40.264 INFO:teuthology.orchestra.run.smithi045.stdout:1099511627777 2023-11-28T12:08:40.447 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T12:08:40.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:40.692+0000 7f697adff700 1 Processor -- start 2023-11-28T12:08:40.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:40.693+0000 7f697adff700 1 -- start start 2023-11-28T12:08:40.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:40.694+0000 7f697adff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f69740cd7c0 0x7f69740cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:40.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:40.694+0000 7f697adff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69740d1950 con 0x7f6974161340 2023-11-28T12:08:40.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:40.694+0000 7f697adff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69740ce140 con 0x7f697415c9b0 2023-11-28T12:08:40.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:40.694+0000 7f697adff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69740b5800 con 0x7f69740cd7c0 2023-11-28T12:08:40.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:40.694+0000 7f6973fff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f6974161340 0x7f69740d1de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:42954/0 (socket says 172.21.15.45:42954) 2023-11-28T12:08:40.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:40.694+0000 7f6973fff700 1 -- 172.21.15.45:0/989734405 learned_addr learned my addr 172.21.15.45:0/989734405 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:08:40.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:40.695+0000 7f697939c700 1 --2- 172.21.15.45:0/989734405 >> v2:172.21.15.152:3300/0 conn(0x7f69740cd7c0 0x7f69740cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:40.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:40.695+0000 7f69737fe700 1 -- 172.21.15.45:0/989734405 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2775526129 0 0) 0x7f69740d1950 con 0x7f6974161340 2023-11-28T12:08:40.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:40.695+0000 7f69737fe700 1 -- 172.21.15.45:0/989734405 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69640035b0 con 0x7f6974161340 2023-11-28T12:08:40.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:40.695+0000 7f69737fe700 1 -- 172.21.15.45:0/989734405 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3890936378 0 0) 0x7f69740ce140 con 0x7f697415c9b0 2023-11-28T12:08:40.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:40.695+0000 7f69737fe700 1 -- 172.21.15.45:0/989734405 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69740d1950 con 0x7f697415c9b0 2023-11-28T12:08:40.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:40.695+0000 7f69737fe700 1 -- 172.21.15.45:0/989734405 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 97220654 0 0) 0x7f69640035b0 con 0x7f6974161340 2023-11-28T12:08:40.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:40.695+0000 7f69737fe700 1 -- 172.21.15.45:0/989734405 >> v2:172.21.15.152:3300/0 conn(0x7f69740cd7c0 msgr2=0x7f69740cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:40.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:40.695+0000 7f69737fe700 1 --2- 172.21.15.45:0/989734405 >> v2:172.21.15.152:3300/0 conn(0x7f69740cd7c0 0x7f69740cdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:40.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:40.695+0000 7f69737fe700 1 -- 172.21.15.45:0/989734405 >> v1:172.21.15.152:6789/0 conn(0x7f697415c9b0 legacy=0x7f69740b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:40.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:40.695+0000 7f69737fe700 1 -- 172.21.15.45:0/989734405 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69740d24f0 con 0x7f6974161340 2023-11-28T12:08:40.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:40.695+0000 7f69737fe700 1 -- 172.21.15.45:0/989734405 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3460218165 0 0) 0x7f69600015f0 con 0x7f6974161340 2023-11-28T12:08:40.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:40.695+0000 7f69737fe700 1 -- 172.21.15.45:0/989734405 >> v1:172.21.15.45:6789/0 conn(0x7f6974161340 legacy=0x7f69740d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:40.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:40.695+0000 7f69737fe700 1 --2- 172.21.15.45:0/989734405 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6964003be0 0x7f6964003fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:40.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:40.695+0000 7f69737fe700 1 --2- 172.21.15.45:0/989734405 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6964004850 0x7f6964004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:40.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:40.695+0000 7f69737fe700 1 --2- 172.21.15.45:0/989734405 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6964005250 0x7f696400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:40.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:40.695+0000 7f69737fe700 1 -- 172.21.15.45:0/989734405 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69740b5800 con 0x7f6964005250 2023-11-28T12:08:40.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:40.695+0000 7f69737fe700 1 -- 172.21.15.45:0/989734405 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f696400c160 con 0x7f6964004850 2023-11-28T12:08:40.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:40.695+0000 7f69737fe700 1 -- 172.21.15.45:0/989734405 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f696400c320 con 0x7f6964003be0 2023-11-28T12:08:40.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:40.696+0000 7f697939c700 1 --2- 172.21.15.45:0/989734405 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6964005250 0x7f696400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:40.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:40.696+0000 7f6973fff700 1 --2- 172.21.15.45:0/989734405 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6964004850 0x7f6964004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:40.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:40.696+0000 7f6978b9b700 1 --2- 172.21.15.45:0/989734405 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6964003be0 0x7f6964003fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:40.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:40.696+0000 7f697939c700 1 -- 172.21.15.45:0/989734405 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6964003be0 msgr2=0x7f6964003fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:40.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:40.696+0000 7f697939c700 1 --2- 172.21.15.45:0/989734405 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6964003be0 0x7f6964003fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:40.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:40.696+0000 7f697939c700 1 -- 172.21.15.45:0/989734405 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6964004850 msgr2=0x7f6964004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:40.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:40.696+0000 7f697939c700 1 --2- 172.21.15.45:0/989734405 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6964004850 0x7f6964004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:40.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:40.696+0000 7f697939c700 1 -- 172.21.15.45:0/989734405 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69640035b0 con 0x7f6964005250 2023-11-28T12:08:40.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:40.696+0000 7f697939c700 1 -- 172.21.15.45:0/989734405 reap_dead start 2023-11-28T12:08:40.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:40.696+0000 7f697939c700 1 --2- 172.21.15.45:0/989734405 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6964005250 0x7f696400ba10 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f696c009f90 tx=0x7f6964005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c09daeb25e12f95 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:40.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:40.696+0000 7f69737fe700 1 -- 172.21.15.45:0/989734405 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696c003a20 con 0x7f6964005250 2023-11-28T12:08:40.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:40.696+0000 7f69737fe700 1 -- 172.21.15.45:0/989734405 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f696c00f040 con 0x7f6964005250 2023-11-28T12:08:40.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:40.696+0000 7f69737fe700 1 -- 172.21.15.45:0/989734405 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696c003dc0 con 0x7f6964005250 2023-11-28T12:08:40.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:40.697+0000 7f697adff700 1 -- 172.21.15.45:0/989734405 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6964005250 msgr2=0x7f696400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:40.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:40.697+0000 7f697adff700 1 --2- 172.21.15.45:0/989734405 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6964005250 0x7f696400ba10 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f696c009f90 tx=0x7f6964005880 comp rx=0 tx=0).stop 2023-11-28T12:08:40.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:40.697+0000 7f697adff700 1 -- 172.21.15.45:0/989734405 shutdown_connections 2023-11-28T12:08:40.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:40.697+0000 7f697adff700 1 --2- 172.21.15.45:0/989734405 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6964005250 0x7f696400ba10 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:40.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:40.697+0000 7f697adff700 1 -- 172.21.15.45:0/989734405 >> 172.21.15.45:0/989734405 conn(0x7f6974072600 msgr2=0x7f69740cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:40.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:40.697+0000 7f697adff700 1 -- 172.21.15.45:0/989734405 shutdown_connections 2023-11-28T12:08:40.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:40.697+0000 7f697adff700 1 -- 172.21.15.45:0/989734405 wait complete. 2023-11-28T12:08:40.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:40.699+0000 7f697adff700 1 Processor -- start 2023-11-28T12:08:40.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:40.699+0000 7f697adff700 1 -- start start 2023-11-28T12:08:40.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:40.700+0000 7f697adff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6964005250 0x7f69740ca240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:40.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:40.700+0000 7f697adff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f69740c9a50 0x7f697414d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:40.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:40.700+0000 7f697adff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f697415e3c0 0x7f697415e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:40.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:40.700+0000 7f697adff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f697415eda0 con 0x7f697415e3c0 2023-11-28T12:08:40.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:40.700+0000 7f697adff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69740ca820 con 0x7f6964005250 2023-11-28T12:08:40.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:40.700+0000 7f697adff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69740cab00 con 0x7f69740c9a50 2023-11-28T12:08:40.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:40.700+0000 7f697939c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f697415e3c0 0x7f697415e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:40.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:40.700+0000 7f697939c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f697415e3c0 0x7f697415e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59872/0 (socket says 172.21.15.45:59872) 2023-11-28T12:08:40.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:40.700+0000 7f697939c700 1 -- 172.21.15.45:0/3560726680 learned_addr learned my addr 172.21.15.45:0/3560726680 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:40.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:40.700+0000 7f6973fff700 1 --2- 172.21.15.45:0/3560726680 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f69740c9a50 0x7f697414d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:40.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:40.700+0000 7f6978b9b700 1 --2- 172.21.15.45:0/3560726680 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6964005250 0x7f69740ca240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:40.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:40.701+0000 7f697939c700 1 -- 172.21.15.45:0/3560726680 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f69740c9a50 msgr2=0x7f697414d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:40.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:40.701+0000 7f697939c700 1 --2- 172.21.15.45:0/3560726680 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f69740c9a50 0x7f697414d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:40.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:40.701+0000 7f697939c700 1 -- 172.21.15.45:0/3560726680 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6964005250 msgr2=0x7f69740ca240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:40.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:40.701+0000 7f697939c700 1 --2- 172.21.15.45:0/3560726680 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6964005250 0x7f69740ca240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:40.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:40.701+0000 7f697939c700 1 -- 172.21.15.45:0/3560726680 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69740d1300 con 0x7f697415e3c0 2023-11-28T12:08:40.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:40.701+0000 7f697939c700 1 --2- 172.21.15.45:0/3560726680 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f697415e3c0 0x7f697415e860 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f69740d05d0 tx=0x7f696c004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:40.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:40.701+0000 7f69717fa700 1 -- 172.21.15.45:0/3560726680 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696c003e90 con 0x7f697415e3c0 2023-11-28T12:08:40.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:40.701+0000 7f69717fa700 1 -- 172.21.15.45:0/3560726680 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f696c004230 con 0x7f697415e3c0 2023-11-28T12:08:40.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:40.701+0000 7f697adff700 1 -- 172.21.15.45:0/3560726680 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69740b5520 con 0x7f697415e3c0 2023-11-28T12:08:40.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:40.701+0000 7f69717fa700 1 -- 172.21.15.45:0/3560726680 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696c0045c0 con 0x7f697415e3c0 2023-11-28T12:08:40.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:40.701+0000 7f697adff700 1 -- 172.21.15.45:0/3560726680 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69740d15e0 con 0x7f697415e3c0 2023-11-28T12:08:40.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:40.702+0000 7f697adff700 1 -- 172.21.15.45:0/3560726680 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69740745c0 con 0x7f697415e3c0 2023-11-28T12:08:40.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:40.703+0000 7f69717fa700 1 -- 172.21.15.45:0/3560726680 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f696c004720 con 0x7f697415e3c0 2023-11-28T12:08:40.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:40.705+0000 7f69717fa700 1 --2- 172.21.15.45:0/3560726680 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f69580682f0 0x7f695806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:40.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:40.705+0000 7f69717fa700 1 -- 172.21.15.45:0/3560726680 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f696c087080 con 0x7f697415e3c0 2023-11-28T12:08:40.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:40.705+0000 7f6978b9b700 1 --2- 172.21.15.45:0/3560726680 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f69580682f0 0x7f695806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:40.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:40.706+0000 7f6978b9b700 1 --2- 172.21.15.45:0/3560726680 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f69580682f0 0x7f695806a7a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f6968007fd0 tx=0x7f6968009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:40.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:40.709+0000 7f69717fa700 1 -- 172.21.15.45:0/3560726680 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f696c0537f0 con 0x7f697415e3c0 2023-11-28T12:08:40.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:40.958+0000 7f697adff700 1 -- 172.21.15.45:0/3560726680 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f69740d08a0 con 0x7f697415e3c0 2023-11-28T12:08:40.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:40.958+0000 7f69717fa700 1 -- 172.21.15.45:0/3560726680 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4651 (secure 0 0 0) 0x7f696c018090 con 0x7f697415e3c0 2023-11-28T12:08:40.959 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:08:40.959 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5398,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6836/2532875180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":2532875180},{"type":"v1","addr":"172.21.15.152:6836","nonce":2532875180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5404,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/930111917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6835","nonce":930111917},{"type":"v1","addr":"172.21.15.152:6837","nonce":930111917}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5547,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/1974473454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1974473454},{"type":"v1","addr":"172.21.15.45:6834","nonce":1974473454}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T12:08:31.391914+0000","modified":"2023-11-28T12:08:34.873102+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5550},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5550":{"gid":5550,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/1281816633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":1281816633},{"type":"v1","addr":"172.21.15.45:6835","nonce":1281816633}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-28T12:08:40.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:40.961+0000 7f697adff700 1 -- 172.21.15.45:0/3560726680 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f69580682f0 msgr2=0x7f695806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:40.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:40.961+0000 7f697adff700 1 --2- 172.21.15.45:0/3560726680 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f69580682f0 0x7f695806a7a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f6968007fd0 tx=0x7f6968009040 comp rx=0 tx=0).stop 2023-11-28T12:08:40.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:40.961+0000 7f697adff700 1 -- 172.21.15.45:0/3560726680 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f697415e3c0 msgr2=0x7f697415e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:40.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:40.961+0000 7f697adff700 1 --2- 172.21.15.45:0/3560726680 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f697415e3c0 0x7f697415e860 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f69740d05d0 tx=0x7f696c004b40 comp rx=0 tx=0).stop 2023-11-28T12:08:40.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:40.961+0000 7f697adff700 1 -- 172.21.15.45:0/3560726680 shutdown_connections 2023-11-28T12:08:40.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:40.961+0000 7f697adff700 1 --2- 172.21.15.45:0/3560726680 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f69580682f0 0x7f695806a7a0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:40.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:40.961+0000 7f697adff700 1 --2- 172.21.15.45:0/3560726680 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6964005250 0x7f69740ca240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:40.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:40.961+0000 7f697adff700 1 --2- 172.21.15.45:0/3560726680 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f697415e3c0 0x7f697415e860 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:40.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:40.961+0000 7f697adff700 1 --2- 172.21.15.45:0/3560726680 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f69740c9a50 0x7f697414d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:40.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:40.961+0000 7f697adff700 1 -- 172.21.15.45:0/3560726680 >> 172.21.15.45:0/3560726680 conn(0x7f6974072600 msgr2=0x7f69740d1dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:40.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:40.961+0000 7f697adff700 1 -- 172.21.15.45:0/3560726680 shutdown_connections 2023-11-28T12:08:40.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:40.961+0000 7f697adff700 1 -- 172.21.15.45:0/3560726680 wait complete. 2023-11-28T12:08:40.963 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 24 2023-11-28T12:08:40.980 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2023-11-28T12:08:41.212 INFO:teuthology.orchestra.run.smithi045.stdout:{"message":"","return_code":0} 2023-11-28T12:08:41.213 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2023-11-28T12:08:41.213 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2023-11-28T12:08:41.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.302+0000 7f2e79a4c0c0 1 Processor -- start 2023-11-28T12:08:41.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.302+0000 7f2e79a4c0c0 1 -- start start 2023-11-28T12:08:41.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.303+0000 7f2e79a4c0c0 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x557f1d858510 0x557f1d89ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:41.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.303+0000 7f2e79a4c0c0 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557f1d8595b0 0x557f1d85a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:41.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.303+0000 7f2e79a4c0c0 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557f1d89ec00 0x557f1d8a0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:41.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.303+0000 7f2e79a4c0c0 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f1d793fe0 con 0x557f1d89ec00 2023-11-28T12:08:41.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.303+0000 7f2e79a4c0c0 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f1d8851e0 con 0x557f1d8595b0 2023-11-28T12:08:41.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.303+0000 7f2e79a4c0c0 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x557f1d921c90 con 0x557f1d858510 2023-11-28T12:08:41.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.303+0000 7f2e6b99c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557f1d89ec00 0x557f1d8a0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:41.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.303+0000 7f2e6b99c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557f1d89ec00 0x557f1d8a0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59884/0 (socket says 172.21.15.45:59884) 2023-11-28T12:08:41.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.303+0000 7f2e6b99c700 1 -- 172.21.15.45:0/2330706275 learned_addr learned my addr 172.21.15.45:0/2330706275 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:41.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.303+0000 7f2e6a99a700 1 --2- 172.21.15.45:0/2330706275 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557f1d8595b0 0x557f1d85a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:41.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.303+0000 7f2e6b19b700 1 --2- 172.21.15.45:0/2330706275 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x557f1d858510 0x557f1d89ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:41.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.303+0000 7f2e6b99c700 1 -- 172.21.15.45:0/2330706275 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x557f1d858510 msgr2=0x557f1d89ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:41.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.303+0000 7f2e6b99c700 1 --2- 172.21.15.45:0/2330706275 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x557f1d858510 0x557f1d89ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:41.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.303+0000 7f2e6b99c700 1 -- 172.21.15.45:0/2330706275 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557f1d8595b0 msgr2=0x557f1d85a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:41.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.303+0000 7f2e6b99c700 1 --2- 172.21.15.45:0/2330706275 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557f1d8595b0 0x557f1d85a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:41.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.303+0000 7f2e6b99c700 1 -- 172.21.15.45:0/2330706275 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e5c005d20 con 0x557f1d89ec00 2023-11-28T12:08:41.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.303+0000 7f2e6b19b700 1 --2- 172.21.15.45:0/2330706275 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x557f1d858510 0x557f1d89ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:08:41.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.303+0000 7f2e6b99c700 1 --2- 172.21.15.45:0/2330706275 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557f1d89ec00 0x557f1d8a0ff0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f2e64006ea0 tx=0x7f2e64001890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=306e60477b2d2025 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:41.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.304+0000 7f2e69998700 1 -- 172.21.15.45:0/2330706275 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e64006310 con 0x557f1d89ec00 2023-11-28T12:08:41.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.304+0000 7f2e69998700 1 -- 172.21.15.45:0/2330706275 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e64004520 con 0x557f1d89ec00 2023-11-28T12:08:41.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.304+0000 7f2e69998700 1 -- 172.21.15.45:0/2330706275 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e640048d0 con 0x557f1d89ec00 2023-11-28T12:08:41.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.304+0000 7f2e79a4c0c0 1 -- 172.21.15.45:0/2330706275 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557f1d89ec00 msgr2=0x557f1d8a0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:41.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.304+0000 7f2e79a4c0c0 1 --2- 172.21.15.45:0/2330706275 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557f1d89ec00 0x557f1d8a0ff0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f2e64006ea0 tx=0x7f2e64001890 comp rx=0 tx=0).stop 2023-11-28T12:08:41.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.304+0000 7f2e79a4c0c0 1 -- 172.21.15.45:0/2330706275 shutdown_connections 2023-11-28T12:08:41.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.304+0000 7f2e79a4c0c0 1 --2- 172.21.15.45:0/2330706275 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557f1d89ec00 0x557f1d8a0ff0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:41.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.304+0000 7f2e79a4c0c0 1 --2- 172.21.15.45:0/2330706275 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x557f1d858510 0x557f1d89ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:41.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.304+0000 7f2e79a4c0c0 1 --2- 172.21.15.45:0/2330706275 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557f1d8595b0 0x557f1d85a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:41.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.304+0000 7f2e79a4c0c0 1 -- 172.21.15.45:0/2330706275 >> 172.21.15.45:0/2330706275 conn(0x557f1d8a5890 msgr2=0x557f1d89f080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:41.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.304+0000 7f2e79a4c0c0 1 -- 172.21.15.45:0/2330706275 shutdown_connections 2023-11-28T12:08:41.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.304+0000 7f2e79a4c0c0 1 -- 172.21.15.45:0/2330706275 wait complete. 2023-11-28T12:08:41.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.305+0000 7f2e79a4c0c0 1 Processor -- start 2023-11-28T12:08:41.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.305+0000 7f2e79a4c0c0 1 -- start start 2023-11-28T12:08:41.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.306+0000 7f2e79a4c0c0 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557f1d858510 0x557f1d88b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:41.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.306+0000 7f2e79a4c0c0 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557f1d8595b0 0x557f1d91fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:41.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.306+0000 7f2e79a4c0c0 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x557f1d89ec00 0x557f1d888880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:41.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.306+0000 7f2e79a4c0c0 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f1d889e50 con 0x557f1d858510 2023-11-28T12:08:41.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.306+0000 7f2e79a4c0c0 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f1d88ba00 con 0x557f1d8595b0 2023-11-28T12:08:41.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.306+0000 7f2e79a4c0c0 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x557f1d88a760 con 0x557f1d89ec00 2023-11-28T12:08:41.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.306+0000 7f2e6b19b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557f1d858510 0x557f1d88b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:41.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.306+0000 7f2e6b19b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557f1d858510 0x557f1d88b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59900/0 (socket says 172.21.15.45:59900) 2023-11-28T12:08:41.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.306+0000 7f2e6b19b700 1 -- 172.21.15.45:0/1184771407 learned_addr learned my addr 172.21.15.45:0/1184771407 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:41.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.306+0000 7f2e6a99a700 1 --2- 172.21.15.45:0/1184771407 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557f1d8595b0 0x557f1d91fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:41.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.307+0000 7f2e6b99c700 1 --2- 172.21.15.45:0/1184771407 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x557f1d89ec00 0x557f1d888880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:41.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.307+0000 7f2e6b19b700 1 -- 172.21.15.45:0/1184771407 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x557f1d89ec00 msgr2=0x557f1d888880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:41.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.307+0000 7f2e6b19b700 1 --2- 172.21.15.45:0/1184771407 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x557f1d89ec00 0x557f1d888880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:41.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.307+0000 7f2e6b19b700 1 -- 172.21.15.45:0/1184771407 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557f1d8595b0 msgr2=0x557f1d91fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:41.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.307+0000 7f2e6b19b700 1 --2- 172.21.15.45:0/1184771407 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557f1d8595b0 0x557f1d91fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:41.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.307+0000 7f2e6b19b700 1 -- 172.21.15.45:0/1184771407 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e54001e10 con 0x557f1d858510 2023-11-28T12:08:41.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.307+0000 7f2e6b19b700 1 --2- 172.21.15.45:0/1184771407 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557f1d858510 0x557f1d88b4c0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c015040 tx=0x7f2e5c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:41.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.307+0000 7f2e68996700 1 -- 172.21.15.45:0/1184771407 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e5c008a10 con 0x557f1d858510 2023-11-28T12:08:41.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.307+0000 7f2e68996700 1 -- 172.21.15.45:0/1184771407 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e5c008b70 con 0x557f1d858510 2023-11-28T12:08:41.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.307+0000 7f2e79a4c0c0 1 -- 172.21.15.45:0/1184771407 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557f1d7ac120 con 0x557f1d858510 2023-11-28T12:08:41.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.307+0000 7f2e68996700 1 -- 172.21.15.45:0/1184771407 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e5c012410 con 0x557f1d858510 2023-11-28T12:08:41.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.308+0000 7f2e79a4c0c0 1 -- 172.21.15.45:0/1184771407 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557f1d79f830 con 0x557f1d858510 2023-11-28T12:08:41.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.310+0000 7f2e68996700 1 -- 172.21.15.45:0/1184771407 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f2e5c02c070 con 0x557f1d858510 2023-11-28T12:08:41.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.310+0000 7f2e68996700 1 --2- 172.21.15.45:0/1184771407 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f2e58066c10 0x7f2e580690c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:41.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.311+0000 7f2e68996700 1 -- 172.21.15.45:0/1184771407 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2e5c085b40 con 0x557f1d858510 2023-11-28T12:08:41.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.311+0000 7f2e6a99a700 1 --2- 172.21.15.45:0/1184771407 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f2e58066c10 0x7f2e580690c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:41.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.311+0000 7f2e79a4c0c0 1 --2- 172.21.15.45:0/1184771407 >> [v2:172.21.15.45:6800/115842,v1:172.21.15.45:6801/115842] conn(0x557f1d8a0380 0x557f1d9bcbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:41.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.311+0000 7f2e79a4c0c0 1 -- 172.21.15.45:0/1184771407 --> [v2:172.21.15.45:6800/115842,v1:172.21.15.45:6801/115842] -- osd_op(unknown.0.0:1 8.7 8:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47) v8 -- 0x557f1d9bd100 con 0x557f1d8a0380 2023-11-28T12:08:41.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.311+0000 7f2e6b99c700 1 --2- 172.21.15.45:0/1184771407 >> [v2:172.21.15.45:6800/115842,v1:172.21.15.45:6801/115842] conn(0x557f1d8a0380 0x557f1d9bcbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:41.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.312+0000 7f2e6a99a700 1 --2- 172.21.15.45:0/1184771407 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f2e58066c10 0x7f2e580690c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x557f1d85acd0 tx=0x7f2e6000c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:41.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.312+0000 7f2e6b99c700 1 --2- 172.21.15.45:0/1184771407 >> [v2:172.21.15.45:6800/115842,v1:172.21.15.45:6801/115842] conn(0x557f1d8a0380 0x557f1d9bcbc0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:41.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.312+0000 7f2e6b99c700 1 -- 172.21.15.45:0/1184771407 <== osd.1 v2:172.21.15.45:6800/115842 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (95) out=95b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+95 (crc 0 0 0) 0x7f2e640063d0 con 0x557f1d8a0380 2023-11-28T12:08:41.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.312+0000 7f2e79a4c0c0 1 -- 172.21.15.45:0/1184771407 >> [v2:172.21.15.45:6800/115842,v1:172.21.15.45:6801/115842] conn(0x557f1d8a0380 msgr2=0x557f1d9bcbc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:41.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.312+0000 7f2e79a4c0c0 1 --2- 172.21.15.45:0/1184771407 >> [v2:172.21.15.45:6800/115842,v1:172.21.15.45:6801/115842] conn(0x557f1d8a0380 0x557f1d9bcbc0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:41.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.312+0000 7f2e79a4c0c0 1 -- 172.21.15.45:0/1184771407 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f2e58066c10 msgr2=0x7f2e580690c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:41.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.312+0000 7f2e79a4c0c0 1 --2- 172.21.15.45:0/1184771407 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f2e58066c10 0x7f2e580690c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x557f1d85acd0 tx=0x7f2e6000c040 comp rx=0 tx=0).stop 2023-11-28T12:08:41.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.312+0000 7f2e79a4c0c0 1 -- 172.21.15.45:0/1184771407 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557f1d858510 msgr2=0x557f1d88b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:41.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.312+0000 7f2e79a4c0c0 1 --2- 172.21.15.45:0/1184771407 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557f1d858510 0x557f1d88b4c0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c015040 tx=0x7f2e5c002fb0 comp rx=0 tx=0).stop 2023-11-28T12:08:41.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.312+0000 7f2e6b99c700 1 -- 172.21.15.45:0/1184771407 reap_dead start 2023-11-28T12:08:41.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.312+0000 7f2e79a4c0c0 1 -- 172.21.15.45:0/1184771407 shutdown_connections 2023-11-28T12:08:41.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.312+0000 7f2e79a4c0c0 1 -- 172.21.15.45:0/1184771407 >> 172.21.15.45:0/1184771407 conn(0x557f1d8a5890 msgr2=0x557f1d921e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:41.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.312+0000 7f2e79a4c0c0 1 -- 172.21.15.45:0/1184771407 shutdown_connections 2023-11-28T12:08:41.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.312+0000 7f2e79a4c0c0 1 -- 172.21.15.45:0/1184771407 wait complete. 2023-11-28T12:08:41.317 INFO:teuthology.orchestra.run.smithi045.stdout:Yalphaparent_a 2023-11-28T12:08:41.317 DEBUG:teuthology.orchestra.run.smithi045:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2023-11-28T12:08:41.496 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-11-28T12:08:41.496 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511627777, 2023-11-28T12:08:41.496 INFO:teuthology.orchestra.run.smithi045.stdout: "ancestors": [ 2023-11-28T12:08:41.497 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T12:08:41.497 INFO:teuthology.orchestra.run.smithi045.stdout: "dirino": 1099511627776, 2023-11-28T12:08:41.497 INFO:teuthology.orchestra.run.smithi045.stdout: "dname": "alpha", 2023-11-28T12:08:41.497 INFO:teuthology.orchestra.run.smithi045.stdout: "version": 2 2023-11-28T12:08:41.497 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T12:08:41.497 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T12:08:41.497 INFO:teuthology.orchestra.run.smithi045.stdout: "dirino": 1, 2023-11-28T12:08:41.497 INFO:teuthology.orchestra.run.smithi045.stdout: "dname": "parent_a", 2023-11-28T12:08:41.497 INFO:teuthology.orchestra.run.smithi045.stdout: "version": 4 2023-11-28T12:08:41.497 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T12:08:41.497 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-11-28T12:08:41.497 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 8, 2023-11-28T12:08:41.498 INFO:teuthology.orchestra.run.smithi045.stdout: "old_pools": [] 2023-11-28T12:08:41.498 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-11-28T12:08:41.498 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:08:41.501 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data setxattr 10000000001.00000000 parent 'oh i'"'"'m sorry did i overwrite your xattr?' 2023-11-28T12:08:41.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.590+0000 7fb2e44d90c0 1 Processor -- start 2023-11-28T12:08:41.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.591+0000 7fb2e44d90c0 1 -- start start 2023-11-28T12:08:41.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.591+0000 7fb2e44d90c0 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559c146ad310 0x559c146adcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:41.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.591+0000 7fb2e44d90c0 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559c146ad6e0 0x559c1461f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:41.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.591+0000 7fb2e44d90c0 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x559c146b15d0 0x559c146a83f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:41.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.591+0000 7fb2e44d90c0 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c1450ffe0 con 0x559c146ad310 2023-11-28T12:08:41.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.591+0000 7fb2e44d90c0 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c1461c7b0 con 0x559c146ad6e0 2023-11-28T12:08:41.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.591+0000 7fb2e44d90c0 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x559c14620ec0 con 0x559c146b15d0 2023-11-28T12:08:41.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.592+0000 7fb2d5b9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559c146ad310 0x559c146adcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:41.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.592+0000 7fb2d5b9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559c146ad310 0x559c146adcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59922/0 (socket says 172.21.15.45:59922) 2023-11-28T12:08:41.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.592+0000 7fb2d5b9b700 1 -- 172.21.15.45:0/2165185959 learned_addr learned my addr 172.21.15.45:0/2165185959 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:41.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.592+0000 7fb2d539a700 1 --2- 172.21.15.45:0/2165185959 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559c146ad6e0 0x559c1461f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:41.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.592+0000 7fb2d639c700 1 --2- 172.21.15.45:0/2165185959 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x559c146b15d0 0x559c146a83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:41.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.592+0000 7fb2d5b9b700 1 -- 172.21.15.45:0/2165185959 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x559c146b15d0 msgr2=0x559c146a83f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:41.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.592+0000 7fb2d5b9b700 1 --2- 172.21.15.45:0/2165185959 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x559c146b15d0 0x559c146a83f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:41.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.592+0000 7fb2d5b9b700 1 -- 172.21.15.45:0/2165185959 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559c146ad6e0 msgr2=0x559c1461f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:41.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.592+0000 7fb2d5b9b700 1 --2- 172.21.15.45:0/2165185959 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559c146ad6e0 0x559c1461f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:41.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.592+0000 7fb2d5b9b700 1 -- 172.21.15.45:0/2165185959 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2cc005de0 con 0x559c146ad310 2023-11-28T12:08:41.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.592+0000 7fb2d5b9b700 1 --2- 172.21.15.45:0/2165185959 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559c146ad310 0x559c146adcb0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fb2c80098b0 tx=0x7fb2c8005a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c10a6f3e23fdf71 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:41.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.593+0000 7fb2c7fff700 1 -- 172.21.15.45:0/2165185959 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c800f040 con 0x559c146ad310 2023-11-28T12:08:41.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.593+0000 7fb2c7fff700 1 -- 172.21.15.45:0/2165185959 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2c8008a30 con 0x559c146ad310 2023-11-28T12:08:41.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.593+0000 7fb2c7fff700 1 -- 172.21.15.45:0/2165185959 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c8008de0 con 0x559c146ad310 2023-11-28T12:08:41.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.593+0000 7fb2e44d90c0 1 -- 172.21.15.45:0/2165185959 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559c146ad310 msgr2=0x559c146adcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:41.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.593+0000 7fb2e44d90c0 1 --2- 172.21.15.45:0/2165185959 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559c146ad310 0x559c146adcb0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fb2c80098b0 tx=0x7fb2c8005a00 comp rx=0 tx=0).stop 2023-11-28T12:08:41.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.593+0000 7fb2e44d90c0 1 -- 172.21.15.45:0/2165185959 shutdown_connections 2023-11-28T12:08:41.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.593+0000 7fb2e44d90c0 1 --2- 172.21.15.45:0/2165185959 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x559c146b15d0 0x559c146a83f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:41.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.593+0000 7fb2e44d90c0 1 --2- 172.21.15.45:0/2165185959 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559c146ad310 0x559c146adcb0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:41.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.593+0000 7fb2e44d90c0 1 --2- 172.21.15.45:0/2165185959 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559c146ad6e0 0x559c1461f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:41.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.593+0000 7fb2e44d90c0 1 -- 172.21.15.45:0/2165185959 >> 172.21.15.45:0/2165185959 conn(0x559c14604190 msgr2=0x559c1461ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:41.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.593+0000 7fb2e44d90c0 1 -- 172.21.15.45:0/2165185959 shutdown_connections 2023-11-28T12:08:41.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.593+0000 7fb2e44d90c0 1 -- 172.21.15.45:0/2165185959 wait complete. 2023-11-28T12:08:41.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.594+0000 7fb2e44d90c0 1 Processor -- start 2023-11-28T12:08:41.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.595+0000 7fb2e44d90c0 1 -- start start 2023-11-28T12:08:41.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.596+0000 7fb2e44d90c0 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x559c146ad310 0x559c146a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:41.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.596+0000 7fb2e44d90c0 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559c146ad6e0 0x559c14615480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:41.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.596+0000 7fb2e44d90c0 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559c146b15d0 0x559c146159c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:41.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.596+0000 7fb2e44d90c0 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c146a6b40 con 0x559c146ad6e0 2023-11-28T12:08:41.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.596+0000 7fb2e44d90c0 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c14617470 con 0x559c146b15d0 2023-11-28T12:08:41.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.596+0000 7fb2e44d90c0 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x559c146a6d90 con 0x559c146ad310 2023-11-28T12:08:41.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.596+0000 7fb2d539a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559c146ad6e0 0x559c14615480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:41.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.596+0000 7fb2d5b9b700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x559c146ad310 0x559c146a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:41.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.596+0000 7fb2d539a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559c146ad6e0 0x559c14615480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59934/0 (socket says 172.21.15.45:59934) 2023-11-28T12:08:41.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.596+0000 7fb2d539a700 1 -- 172.21.15.45:0/1350176808 learned_addr learned my addr 172.21.15.45:0/1350176808 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:41.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.596+0000 7fb2d639c700 1 --2- 172.21.15.45:0/1350176808 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559c146b15d0 0x559c146159c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:41.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.597+0000 7fb2d539a700 1 -- 172.21.15.45:0/1350176808 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x559c146ad310 msgr2=0x559c146a6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:41.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.597+0000 7fb2d539a700 1 --2- 172.21.15.45:0/1350176808 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x559c146ad310 0x559c146a6210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:41.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.597+0000 7fb2d539a700 1 -- 172.21.15.45:0/1350176808 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559c146b15d0 msgr2=0x559c146159c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:41.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.597+0000 7fb2d539a700 1 --2- 172.21.15.45:0/1350176808 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559c146b15d0 0x559c146159c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:41.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.597+0000 7fb2d539a700 1 -- 172.21.15.45:0/1350176808 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2c8009510 con 0x559c146ad6e0 2023-11-28T12:08:41.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.597+0000 7fb2d539a700 1 --2- 172.21.15.45:0/1350176808 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559c146ad6e0 0x559c14615480 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc015040 tx=0x7fb2cc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:41.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.597+0000 7fb2c6ffd700 1 -- 172.21.15.45:0/1350176808 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2cc008690 con 0x559c146ad6e0 2023-11-28T12:08:41.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.597+0000 7fb2c6ffd700 1 -- 172.21.15.45:0/1350176808 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2cc012860 con 0x559c146ad6e0 2023-11-28T12:08:41.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.597+0000 7fb2e44d90c0 1 -- 172.21.15.45:0/1350176808 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559c14528120 con 0x559c146ad6e0 2023-11-28T12:08:41.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.597+0000 7fb2c6ffd700 1 -- 172.21.15.45:0/1350176808 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2cc012c10 con 0x559c146ad6e0 2023-11-28T12:08:41.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.597+0000 7fb2e44d90c0 1 -- 172.21.15.45:0/1350176808 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559c1451b830 con 0x559c146ad6e0 2023-11-28T12:08:41.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.599+0000 7fb2c6ffd700 1 -- 172.21.15.45:0/1350176808 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fb2cc012d70 con 0x559c146ad6e0 2023-11-28T12:08:41.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.600+0000 7fb2c6ffd700 1 --2- 172.21.15.45:0/1350176808 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb2b8066c10 0x7fb2b80690c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:41.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.600+0000 7fb2c6ffd700 1 -- 172.21.15.45:0/1350176808 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb2cc086730 con 0x559c146ad6e0 2023-11-28T12:08:41.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.600+0000 7fb2e44d90c0 1 --2- 172.21.15.45:0/1350176808 >> [v2:172.21.15.45:6800/115842,v1:172.21.15.45:6801/115842] conn(0x559c146a6750 0x559c14750a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:41.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.600+0000 7fb2e44d90c0 1 -- 172.21.15.45:0/1350176808 --> [v2:172.21.15.45:6800/115842,v1:172.21.15.45:6801/115842] -- osd_op(unknown.0.0:1 8.7 8:e2e07930:::10000000001.00000000:head [setxattr parent (40) in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47) v8 -- 0x559c146a7070 con 0x559c146a6750 2023-11-28T12:08:41.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.601+0000 7fb2d5b9b700 1 --2- 172.21.15.45:0/1350176808 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb2b8066c10 0x7fb2b80690c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:41.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.601+0000 7fb2d639c700 1 --2- 172.21.15.45:0/1350176808 >> [v2:172.21.15.45:6800/115842,v1:172.21.15.45:6801/115842] conn(0x559c146a6750 0x559c14750a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:41.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.601+0000 7fb2d639c700 1 --2- 172.21.15.45:0/1350176808 >> [v2:172.21.15.45:6800/115842,v1:172.21.15.45:6801/115842] conn(0x559c146a6750 0x559c14750a20 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:41.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.601+0000 7fb2d5b9b700 1 --2- 172.21.15.45:0/1350176808 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb2b8066c10 0x7fb2b80690c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb2c8015040 tx=0x7fb2c801f040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:41.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.603+0000 7fb2d639c700 1 -- 172.21.15.45:0/1350176808 <== osd.1 v2:172.21.15.45:6800/115842 1 ==== osd_op_reply(1 10000000001.00000000 [setxattr (40)] v47'2 uv2 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fb2d0010550 con 0x559c146a6750 2023-11-28T12:08:41.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.603+0000 7fb2e44d90c0 1 -- 172.21.15.45:0/1350176808 >> [v2:172.21.15.45:6800/115842,v1:172.21.15.45:6801/115842] conn(0x559c146a6750 msgr2=0x559c14750a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:41.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.603+0000 7fb2e44d90c0 1 --2- 172.21.15.45:0/1350176808 >> [v2:172.21.15.45:6800/115842,v1:172.21.15.45:6801/115842] conn(0x559c146a6750 0x559c14750a20 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:41.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.603+0000 7fb2e44d90c0 1 -- 172.21.15.45:0/1350176808 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb2b8066c10 msgr2=0x7fb2b80690c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:41.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.603+0000 7fb2e44d90c0 1 --2- 172.21.15.45:0/1350176808 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb2b8066c10 0x7fb2b80690c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb2c8015040 tx=0x7fb2c801f040 comp rx=0 tx=0).stop 2023-11-28T12:08:41.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.603+0000 7fb2e44d90c0 1 -- 172.21.15.45:0/1350176808 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559c146ad6e0 msgr2=0x559c14615480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:41.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.603+0000 7fb2e44d90c0 1 --2- 172.21.15.45:0/1350176808 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559c146ad6e0 0x559c14615480 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc015040 tx=0x7fb2cc002fb0 comp rx=0 tx=0).stop 2023-11-28T12:08:41.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.603+0000 7fb2d639c700 1 -- 172.21.15.45:0/1350176808 reap_dead start 2023-11-28T12:08:41.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.603+0000 7fb2e44d90c0 1 -- 172.21.15.45:0/1350176808 shutdown_connections 2023-11-28T12:08:41.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.603+0000 7fb2e44d90c0 1 -- 172.21.15.45:0/1350176808 >> 172.21.15.45:0/1350176808 conn(0x559c14604190 msgr2=0x559c1461ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:41.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.603+0000 7fb2e44d90c0 1 -- 172.21.15.45:0/1350176808 shutdown_connections 2023-11-28T12:08:41.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.603+0000 7fb2e44d90c0 1 -- 172.21.15.45:0/1350176808 wait complete. 2023-11-28T12:08:41.607 DEBUG:teuthology.orchestra.run.smithi045:> sudo daemon-helper kill ceph --cluster ceph -w 2023-11-28T12:08:41.612 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start / repair,recursive 2023-11-28T12:08:41.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.824+0000 7f188bbff700 1 Processor -- start 2023-11-28T12:08:41.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.824+0000 7f188bbff700 1 -- start start 2023-11-28T12:08:41.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.826+0000 7f188bbff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f188415a760 0x7f1884161200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:41.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.826+0000 7f188bbff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f188415e0a0 con 0x7f18840cded0 2023-11-28T12:08:41.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.826+0000 7f188bbff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1884160d70 con 0x7f188415dc30 2023-11-28T12:08:41.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.826+0000 7f188bbff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f188415ab30 con 0x7f188415a760 2023-11-28T12:08:41.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.826+0000 7f188999b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f188415a760 0x7f1884161200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:41.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.826+0000 7f188a19c700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f18840cded0 0x7f18840d0d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:42970/0 (socket says 172.21.15.45:42970) 2023-11-28T12:08:41.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.826+0000 7f188a19c700 1 -- 172.21.15.45:0/2492559485 learned_addr learned my addr 172.21.15.45:0/2492559485 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:08:41.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.827+0000 7f188999b700 1 -- 172.21.15.45:0/2492559485 >> v1:172.21.15.152:6789/0 conn(0x7f188415dc30 legacy=0x7f18840cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:41.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.827+0000 7f188999b700 1 -- 172.21.15.45:0/2492559485 >> v1:172.21.15.45:6789/0 conn(0x7f18840cded0 legacy=0x7f18840d0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:41.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.827+0000 7f188999b700 1 -- 172.21.15.45:0/2492559485 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18840b5390 con 0x7f188415a760 2023-11-28T12:08:41.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.827+0000 7f1888999700 1 -- 172.21.15.45:0/2492559485 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 853678677 0 0) 0x7f188415e0a0 con 0x7f18840cded0 2023-11-28T12:08:41.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.827+0000 7f188999b700 1 --2- 172.21.15.45:0/2492559485 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f188415a760 0x7f1884161200 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f1880009840 tx=0x7f1880009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=326ecd3c470e0005 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:41.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.827+0000 7f1888999700 1 -- 172.21.15.45:0/2492559485 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1880011830 con 0x7f188415a760 2023-11-28T12:08:41.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.827+0000 7f1888999700 1 -- 172.21.15.45:0/2492559485 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1880011990 con 0x7f188415a760 2023-11-28T12:08:41.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.827+0000 7f1888999700 1 -- 172.21.15.45:0/2492559485 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1880011d20 con 0x7f188415a760 2023-11-28T12:08:41.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.828+0000 7f188bbff700 1 -- 172.21.15.45:0/2492559485 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f188415a760 msgr2=0x7f1884161200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:41.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.828+0000 7f188bbff700 1 --2- 172.21.15.45:0/2492559485 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f188415a760 0x7f1884161200 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f1880009840 tx=0x7f1880009b50 comp rx=0 tx=0).stop 2023-11-28T12:08:41.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.828+0000 7f188bbff700 1 -- 172.21.15.45:0/2492559485 shutdown_connections 2023-11-28T12:08:41.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.828+0000 7f188bbff700 1 --2- 172.21.15.45:0/2492559485 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f188415a760 0x7f1884161200 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:41.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.828+0000 7f188bbff700 1 -- 172.21.15.45:0/2492559485 >> 172.21.15.45:0/2492559485 conn(0x7f1884072620 msgr2=0x7f18840cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:41.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.828+0000 7f188bbff700 1 -- 172.21.15.45:0/2492559485 shutdown_connections 2023-11-28T12:08:41.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.828+0000 7f188bbff700 1 -- 172.21.15.45:0/2492559485 wait complete. 2023-11-28T12:08:41.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.830+0000 7f188bbff700 1 Processor -- start 2023-11-28T12:08:41.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.830+0000 7f188bbff700 1 -- start start 2023-11-28T12:08:41.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.831+0000 7f188bbff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f18840cded0 0x7f18840b8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:41.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.831+0000 7f188bbff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f188415a760 0x7f18840c84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:41.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.831+0000 7f188bbff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f188415dc30 0x7f188414c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:41.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.831+0000 7f188bbff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18841f3b90 con 0x7f188415dc30 2023-11-28T12:08:41.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.831+0000 7f188bbff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18841f2f10 con 0x7f188415a760 2023-11-28T12:08:41.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.831+0000 7f188bbff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18841f31f0 con 0x7f18840cded0 2023-11-28T12:08:41.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.831+0000 7f188a19c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f188415dc30 0x7f188414c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:41.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.831+0000 7f188a19c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f188415dc30 0x7f188414c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59944/0 (socket says 172.21.15.45:59944) 2023-11-28T12:08:41.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.831+0000 7f188a19c700 1 -- 172.21.15.45:0/2571950697 learned_addr learned my addr 172.21.15.45:0/2571950697 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:41.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.831+0000 7f188999b700 1 --2- 172.21.15.45:0/2571950697 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f18840cded0 0x7f18840b8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:41.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.831+0000 7f188919a700 1 --2- 172.21.15.45:0/2571950697 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f188415a760 0x7f18840c84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:41.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.832+0000 7f188a19c700 1 -- 172.21.15.45:0/2571950697 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f18840cded0 msgr2=0x7f18840b8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:41.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.832+0000 7f188a19c700 1 --2- 172.21.15.45:0/2571950697 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f18840cded0 0x7f18840b8cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:41.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.832+0000 7f188a19c700 1 -- 172.21.15.45:0/2571950697 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f188415a760 msgr2=0x7f18840c84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:41.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.832+0000 7f188a19c700 1 --2- 172.21.15.45:0/2571950697 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f188415a760 0x7f18840c84e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:41.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.832+0000 7f188a19c700 1 -- 172.21.15.45:0/2571950697 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18800094a0 con 0x7f188415dc30 2023-11-28T12:08:41.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.832+0000 7f188a19c700 1 --2- 172.21.15.45:0/2571950697 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f188415dc30 0x7f188414c000 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f187c00cbe0 tx=0x7f187c00cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:41.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.832+0000 7f187a7fc700 1 -- 172.21.15.45:0/2571950697 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f187c00ab50 con 0x7f188415dc30 2023-11-28T12:08:41.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.832+0000 7f187a7fc700 1 -- 172.21.15.45:0/2571950697 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f187c00acd0 con 0x7f188415dc30 2023-11-28T12:08:41.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.832+0000 7f188bbff700 1 -- 172.21.15.45:0/2571950697 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1884160720 con 0x7f188415dc30 2023-11-28T12:08:41.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.832+0000 7f187a7fc700 1 -- 172.21.15.45:0/2571950697 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f187c007310 con 0x7f188415dc30 2023-11-28T12:08:41.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.833+0000 7f188bbff700 1 -- 172.21.15.45:0/2571950697 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18840b5670 con 0x7f188415dc30 2023-11-28T12:08:41.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.835+0000 7f187a7fc700 1 -- 172.21.15.45:0/2571950697 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f187c010070 con 0x7f188415dc30 2023-11-28T12:08:41.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.836+0000 7f187a7fc700 1 --2- 172.21.15.45:0/2571950697 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f18680682f0 0x7f186806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:41.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.836+0000 7f187a7fc700 1 -- 172.21.15.45:0/2571950697 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f187c085680 con 0x7f188415dc30 2023-11-28T12:08:41.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.837+0000 7f188999b700 1 --2- 172.21.15.45:0/2571950697 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f18680682f0 0x7f186806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:41.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.838+0000 7f188999b700 1 --2- 172.21.15.45:0/2571950697 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f18680682f0 0x7f186806a7a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f18800090b0 tx=0x7f188001c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:41.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.838+0000 7f189f618b80 1 Processor -- start 2023-11-28T12:08:41.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.839+0000 7f189f618b80 1 -- start start 2023-11-28T12:08:41.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.839+0000 7f189f618b80 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x563e614a3020 0x563e6145cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:41.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.839+0000 7f189f618b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563e61499b90 0x563e614a33f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:41.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.839+0000 7f189f618b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563e61485730 0x563e6145dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:41.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.839+0000 7f189f618b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e613daeb0 con 0x563e61485730 2023-11-28T12:08:41.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.839+0000 7f189f618b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e61347210 con 0x563e61499b90 2023-11-28T12:08:41.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.839+0000 7f189f618b80 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x563e613b5e80 con 0x563e614a3020 2023-11-28T12:08:41.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.840+0000 7f188a19c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563e61485730 0x563e6145dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:41.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.840+0000 7f188999b700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x563e614a3020 0x563e6145cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:41.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.840+0000 7f188a19c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563e61485730 0x563e6145dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59960/0 (socket says 172.21.15.45:59960) 2023-11-28T12:08:41.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.840+0000 7f188a19c700 1 -- 172.21.15.45:0/3893451251 learned_addr learned my addr 172.21.15.45:0/3893451251 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:41.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.840+0000 7f188919a700 1 --2- 172.21.15.45:0/3893451251 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563e61499b90 0x563e614a33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:41.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.840+0000 7f188a19c700 1 -- 172.21.15.45:0/3893451251 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x563e614a3020 msgr2=0x563e6145cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:41.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.840+0000 7f188a19c700 1 --2- 172.21.15.45:0/3893451251 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x563e614a3020 0x563e6145cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:41.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.840+0000 7f188a19c700 1 -- 172.21.15.45:0/3893451251 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563e61499b90 msgr2=0x563e614a33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:41.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.840+0000 7f188a19c700 1 --2- 172.21.15.45:0/3893451251 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563e61499b90 0x563e614a33f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:41.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.840+0000 7f188a19c700 1 -- 172.21.15.45:0/3893451251 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563e611a3860 con 0x563e61485730 2023-11-28T12:08:41.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.841+0000 7f188a19c700 1 --2- 172.21.15.45:0/3893451251 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563e61485730 0x563e6145dc30 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f187c00aef0 tx=0x7f187c00af20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2690ffa258ba75af server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:41.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.841+0000 7f18677fe700 1 -- 172.21.15.45:0/3893451251 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f187c05d6b0 con 0x563e61485730 2023-11-28T12:08:41.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.841+0000 7f18677fe700 1 -- 172.21.15.45:0/3893451251 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f187c05d810 con 0x563e61485730 2023-11-28T12:08:41.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.841+0000 7f18677fe700 1 -- 172.21.15.45:0/3893451251 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f187c05d980 con 0x563e61485730 2023-11-28T12:08:41.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.841+0000 7f189f618b80 1 -- 172.21.15.45:0/3893451251 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563e61485730 msgr2=0x563e6145dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:41.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.841+0000 7f189f618b80 1 --2- 172.21.15.45:0/3893451251 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563e61485730 0x563e6145dc30 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f187c00aef0 tx=0x7f187c00af20 comp rx=0 tx=0).stop 2023-11-28T12:08:41.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.842+0000 7f189f618b80 1 -- 172.21.15.45:0/3893451251 shutdown_connections 2023-11-28T12:08:41.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.842+0000 7f189f618b80 1 --2- 172.21.15.45:0/3893451251 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563e61485730 0x563e6145dc30 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:41.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.842+0000 7f189f618b80 1 --2- 172.21.15.45:0/3893451251 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x563e614a3020 0x563e6145cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:41.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.842+0000 7f189f618b80 1 --2- 172.21.15.45:0/3893451251 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563e61499b90 0x563e614a33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:41.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.842+0000 7f189f618b80 1 -- 172.21.15.45:0/3893451251 >> 172.21.15.45:0/3893451251 conn(0x563e61452df0 msgr2=0x563e6145bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:41.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.842+0000 7f189f618b80 1 -- 172.21.15.45:0/3893451251 shutdown_connections 2023-11-28T12:08:41.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.842+0000 7f189f618b80 1 -- 172.21.15.45:0/3893451251 wait complete. 2023-11-28T12:08:41.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.843+0000 7f189f618b80 1 -- start start 2023-11-28T12:08:41.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.843+0000 7f189f618b80 1 Processor -- start 2023-11-28T12:08:41.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.845+0000 7f189f618b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563e61485730 0x563e614a6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:41.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.845+0000 7f189f618b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563e61499b90 0x563e6145d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:41.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.845+0000 7f189f618b80 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x563e614a3020 0x563e6145daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:41.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.845+0000 7f189f618b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e613af1f0 con 0x563e61485730 2023-11-28T12:08:41.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.845+0000 7f189f618b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e611a4460 con 0x563e61499b90 2023-11-28T12:08:41.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.845+0000 7f189f618b80 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x563e61347410 con 0x563e614a3020 2023-11-28T12:08:41.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.845+0000 7f189f618b80 10 client.0 _ll_register_callbacks cb 0x563e6134d4d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T12:08:41.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.845+0000 7f188999b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563e61485730 0x563e614a6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:41.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.845+0000 7f188999b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563e61485730 0x563e614a6bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59968/0 (socket says 172.21.15.45:59968) 2023-11-28T12:08:41.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.845+0000 7f188999b700 1 -- 172.21.15.45:0/4001095557 learned_addr learned my addr 172.21.15.45:0/4001095557 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:41.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.845+0000 7f188919a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563e61499b90 0x563e6145d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:41.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.845+0000 7f188a19c700 1 --2- 172.21.15.45:0/4001095557 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x563e614a3020 0x563e6145daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:41.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.846+0000 7f188919a700 1 -- 172.21.15.45:0/4001095557 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x563e614a3020 msgr2=0x563e6145daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:41.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.846+0000 7f188919a700 1 --2- 172.21.15.45:0/4001095557 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x563e614a3020 0x563e6145daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:41.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.846+0000 7f188919a700 1 -- 172.21.15.45:0/4001095557 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563e61485730 msgr2=0x563e614a6bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:41.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.846+0000 7f188919a700 1 --2- 172.21.15.45:0/4001095557 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563e61485730 0x563e614a6bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:41.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.846+0000 7f188919a700 1 -- 172.21.15.45:0/4001095557 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18840b5670 con 0x563e61499b90 2023-11-28T12:08:41.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.846+0000 7f188999b700 1 --2- 172.21.15.45:0/4001095557 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563e61485730 0x563e614a6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:08:41.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.846+0000 7f188919a700 1 --2- 172.21.15.45:0/4001095557 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563e61499b90 0x563e6145d5b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f18840b2b60 tx=0x7f1874011530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=630d2a355e69002a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:41.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.846+0000 7f1864ff9700 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2023-11-28T12:08:41.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.846+0000 7f1864ff9700 1 -- 172.21.15.45:0/4001095557 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f187401a070 con 0x563e61499b90 2023-11-28T12:08:41.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.846+0000 7f1864ff9700 1 -- 172.21.15.45:0/4001095557 <== mon.1 v2:172.21.15.152:3300/0 2 ==== osd_map(47..47 src has 1..47) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1874005320 con 0x563e61499b90 2023-11-28T12:08:41.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.846+0000 7f189f618b80 1 -- 172.21.15.45:0/4001095557 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563e613b3100 con 0x563e61499b90 2023-11-28T12:08:41.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.847+0000 7f1864ff9700 1 -- 172.21.15.45:0/4001095557 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f18740054e0 con 0x563e61499b90 2023-11-28T12:08:41.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.847+0000 7f189f618b80 10 client.5563 fetch_fsmap learned FSMap version 24 2023-11-28T12:08:41.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.847+0000 7f189f618b80 1 -- 172.21.15.45:0/4001095557 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x563e61290170 con 0x563e61499b90 2023-11-28T12:08:41.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.847+0000 7f1864ff9700 1 -- 172.21.15.45:0/4001095557 <== mon.1 v2:172.21.15.152:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1874024020 con 0x563e61499b90 2023-11-28T12:08:41.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.847+0000 7f1864ff9700 1 -- 172.21.15.45:0/4001095557 <== mon.1 v2:172.21.15.152:3300/0 5 ==== fsmap(e 24) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f187401d020 con 0x563e61499b90 2023-11-28T12:08:41.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.847+0000 7f189f618b80 10 client.5563 fetch_fsmap finished waiting for FSMap version 24 2023-11-28T12:08:41.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.847+0000 7f189f618b80 10 client.5563 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-11-28T12:08:41.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.847+0000 7f189f618b80 20 client.5563 populate_metadata read hostname 'smithi045' 2023-11-28T12:08:41.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.847+0000 7f189f618b80 1 --2- 172.21.15.45:0/4001095557 >> [v2:172.21.15.45:6833/1281816633,v1:172.21.15.45:6835/1281816633] conn(0x563e61482fc0 0x563e6149a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:41.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.847+0000 7f189f618b80 4 client.5563 mds_command: new command op to 5550 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-28T12:08:41.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.847+0000 7f189f618b80 1 -- 172.21.15.45:0/4001095557 --> [v2:172.21.15.45:6833/1281816633,v1:172.21.15.45:6835/1281816633] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563e611fefc0 con 0x563e61482fc0 2023-11-28T12:08:41.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.848+0000 7f188999b700 1 --2- 172.21.15.45:0/4001095557 >> [v2:172.21.15.45:6833/1281816633,v1:172.21.15.45:6835/1281816633] conn(0x563e61482fc0 0x563e6149a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:41.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.848+0000 7f188999b700 1 --2- 172.21.15.45:0/4001095557 >> [v2:172.21.15.45:6833/1281816633,v1:172.21.15.45:6835/1281816633] conn(0x563e61482fc0 0x563e6149a4b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d152751bb3db9c8 server_cookie=17ecf3ddab49725e in_seq=0 out_seq=0 2023-11-28T12:08:41.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.848+0000 7f1864ff9700 10 client.5563 ms_handle_connect on v2:172.21.15.45:6833/1281816633 2023-11-28T12:08:41.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.849+0000 7f1864ff9700 1 -- 172.21.15.45:0/4001095557 <== mds.0 v2:172.21.15.45:6833/1281816633 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x563e611fefc0 con 0x563e61482fc0 2023-11-28T12:08:41.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.849+0000 7f1864ff9700 10 client.5563 handle_command_reply: tid=0 2023-11-28T12:08:41.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.849+0000 7f189f618b80 1 client.5563 shutdown 2023-11-28T12:08:41.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.849+0000 7f189f618b80 1 -- 172.21.15.45:0/4001095557 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563e61499b90 msgr2=0x563e6145d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:41.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.849+0000 7f189f618b80 1 --2- 172.21.15.45:0/4001095557 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563e61499b90 0x563e6145d5b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f18840b2b60 tx=0x7f1874011530 comp rx=0 tx=0).stop 2023-11-28T12:08:41.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.849+0000 7f189f618b80 1 -- 172.21.15.45:0/4001095557 shutdown_connections 2023-11-28T12:08:41.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.849+0000 7f189f618b80 1 --2- 172.21.15.45:0/4001095557 >> [v2:172.21.15.45:6833/1281816633,v1:172.21.15.45:6835/1281816633] conn(0x563e61482fc0 0x563e6149a4b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:41.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.849+0000 7f189f618b80 1 --2- 172.21.15.45:0/4001095557 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x563e614a3020 0x563e6145daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:41.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.849+0000 7f189f618b80 1 --2- 172.21.15.45:0/4001095557 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563e61485730 0x563e614a6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:41.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.849+0000 7f1864ff9700 0 client.5563 ms_handle_reset on v2:172.21.15.45:6833/1281816633 2023-11-28T12:08:41.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.849+0000 7f189f618b80 1 --2- 172.21.15.45:0/4001095557 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563e61499b90 0x563e6145d5b0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:41.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.849+0000 7f189f618b80 1 -- 172.21.15.45:0/4001095557 >> 172.21.15.45:0/4001095557 conn(0x563e61452df0 msgr2=0x563e61484d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:41.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.849+0000 7f189f618b80 1 -- 172.21.15.45:0/4001095557 shutdown_connections 2023-11-28T12:08:41.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.850+0000 7f189f618b80 1 -- 172.21.15.45:0/4001095557 wait complete. 2023-11-28T12:08:41.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.850+0000 7f189f618b80 20 client.5563 trim_cache size 0 max 16384 2023-11-28T12:08:41.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.855+0000 7f5f601ff700 1 Processor -- start 2023-11-28T12:08:41.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.855+0000 7f5f601ff700 1 -- start start 2023-11-28T12:08:41.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.856+0000 7f5f601ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f5f5815cc80 0x7f5f5815d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:41.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.856+0000 7f5f601ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5f580d0bb0 0x7f5f580d1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:41.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.856+0000 7f5f601ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f580d1550 con 0x7f5f580b6840 2023-11-28T12:08:41.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.856+0000 7f5f601ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f580b4610 con 0x7f5f580d0bb0 2023-11-28T12:08:41.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.856+0000 7f5f601ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f580b79c0 con 0x7f5f5815cc80 2023-11-28T12:08:41.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.856+0000 7f5f5e79c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5f580d0bb0 0x7f5f580d1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:41.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.856+0000 7f5f5e79c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5f580d0bb0 0x7f5f580d1010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59978/0 (socket says 172.21.15.45:59978) 2023-11-28T12:08:41.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.856+0000 7f5f5e79c700 1 -- 172.21.15.45:0/251734211 learned_addr learned my addr 172.21.15.45:0/251734211 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:41.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.857+0000 7f5f5df9b700 1 --2- 172.21.15.45:0/251734211 >> v2:172.21.15.152:3300/0 conn(0x7f5f5815cc80 0x7f5f5815d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:41.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.857+0000 7f5f5e79c700 1 -- 172.21.15.45:0/251734211 >> v2:172.21.15.152:3300/0 conn(0x7f5f5815cc80 msgr2=0x7f5f5815d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:41.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.857+0000 7f5f5e79c700 1 --2- 172.21.15.45:0/251734211 >> v2:172.21.15.152:3300/0 conn(0x7f5f5815cc80 0x7f5f5815d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:41.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.857+0000 7f5f5e79c700 1 -- 172.21.15.45:0/251734211 >> v1:172.21.15.152:6789/0 conn(0x7f5f580b6840 legacy=0x7f5f580b3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:41.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.857+0000 7f5f5e79c700 1 -- 172.21.15.45:0/251734211 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f580b6db0 con 0x7f5f580d0bb0 2023-11-28T12:08:41.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.857+0000 7f5f5e79c700 1 --2- 172.21.15.45:0/251734211 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f580d0bb0 0x7f5f580d1010 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f5f5808b0f0 tx=0x7f5f5000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a31563891639b6a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:41.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.857+0000 7f5f5cf99700 1 -- 172.21.15.45:0/251734211 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5000e070 con 0x7f5f580d0bb0 2023-11-28T12:08:41.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.857+0000 7f5f5cf99700 1 -- 172.21.15.45:0/251734211 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f50003a20 con 0x7f5f580d0bb0 2023-11-28T12:08:41.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.857+0000 7f5f5cf99700 1 -- 172.21.15.45:0/251734211 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f50003dd0 con 0x7f5f580d0bb0 2023-11-28T12:08:41.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.858+0000 7f5f601ff700 1 -- 172.21.15.45:0/251734211 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f580d0bb0 msgr2=0x7f5f580d1010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:41.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.858+0000 7f5f601ff700 1 --2- 172.21.15.45:0/251734211 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f580d0bb0 0x7f5f580d1010 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f5f5808b0f0 tx=0x7f5f5000b330 comp rx=0 tx=0).stop 2023-11-28T12:08:41.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.858+0000 7f5f601ff700 1 -- 172.21.15.45:0/251734211 shutdown_connections 2023-11-28T12:08:41.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.858+0000 7f5f601ff700 1 --2- 172.21.15.45:0/251734211 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f580d0bb0 0x7f5f580d1010 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:41.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.858+0000 7f5f601ff700 1 --2- 172.21.15.45:0/251734211 >> v2:172.21.15.152:3300/0 conn(0x7f5f5815cc80 0x7f5f5815d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:41.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.858+0000 7f5f601ff700 1 -- 172.21.15.45:0/251734211 >> 172.21.15.45:0/251734211 conn(0x7f5f5809c360 msgr2=0x7f5f580d2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:41.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.858+0000 7f5f601ff700 1 -- 172.21.15.45:0/251734211 shutdown_connections 2023-11-28T12:08:41.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.858+0000 7f5f601ff700 1 -- 172.21.15.45:0/251734211 wait complete. 2023-11-28T12:08:41.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.860+0000 7f5f601ff700 1 Processor -- start 2023-11-28T12:08:41.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.860+0000 7f5f601ff700 1 -- start start 2023-11-28T12:08:41.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.861+0000 7f5f601ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5f580b6840 0x7f5f581588a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:41.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.861+0000 7f5f601ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f580d0bb0 0x7f5f580b80c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:41.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.861+0000 7f5f601ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5f5815cc80 0x7f5f5815b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:41.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.861+0000 7f5f601ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f5815a640 con 0x7f5f580d0bb0 2023-11-28T12:08:41.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.861+0000 7f5f601ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f5815a920 con 0x7f5f580b6840 2023-11-28T12:08:41.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.861+0000 7f5f601ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f5815ac00 con 0x7f5f5815cc80 2023-11-28T12:08:41.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.861+0000 7f5f5d79a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f580d0bb0 0x7f5f580b80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:41.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.862+0000 7f5f5d79a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f580d0bb0 0x7f5f580b80c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59992/0 (socket says 172.21.15.45:59992) 2023-11-28T12:08:41.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.862+0000 7f5f5df9b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5f580b6840 0x7f5f581588a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:41.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.862+0000 7f5f5d79a700 1 -- 172.21.15.45:0/2359991840 learned_addr learned my addr 172.21.15.45:0/2359991840 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:41.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.862+0000 7f5f5e79c700 1 --2- 172.21.15.45:0/2359991840 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5f5815cc80 0x7f5f5815b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:41.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.862+0000 7f5f5d79a700 1 -- 172.21.15.45:0/2359991840 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5f5815cc80 msgr2=0x7f5f5815b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:41.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.862+0000 7f5f5d79a700 1 --2- 172.21.15.45:0/2359991840 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5f5815cc80 0x7f5f5815b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:41.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.862+0000 7f5f5d79a700 1 -- 172.21.15.45:0/2359991840 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5f580b6840 msgr2=0x7f5f581588a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:41.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.862+0000 7f5f5d79a700 1 --2- 172.21.15.45:0/2359991840 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5f580b6840 0x7f5f581588a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:41.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.862+0000 7f5f5d79a700 1 -- 172.21.15.45:0/2359991840 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f50009b30 con 0x7f5f580d0bb0 2023-11-28T12:08:41.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.862+0000 7f5f5d79a700 1 --2- 172.21.15.45:0/2359991840 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f580d0bb0 0x7f5f580b80c0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f5f4800b4a0 tx=0x7f5f4800b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:41.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.863+0000 7f5f4e7fc700 1 -- 172.21.15.45:0/2359991840 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f48011830 con 0x7f5f580d0bb0 2023-11-28T12:08:41.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.863+0000 7f5f4e7fc700 1 -- 172.21.15.45:0/2359991840 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f48011990 con 0x7f5f580d0bb0 2023-11-28T12:08:41.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.863+0000 7f5f4e7fc700 1 -- 172.21.15.45:0/2359991840 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f48011d40 con 0x7f5f580d0bb0 2023-11-28T12:08:41.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.863+0000 7f5f601ff700 1 -- 172.21.15.45:0/2359991840 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f580b7370 con 0x7f5f580d0bb0 2023-11-28T12:08:41.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.863+0000 7f5f601ff700 1 -- 172.21.15.45:0/2359991840 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f580b7090 con 0x7f5f580d0bb0 2023-11-28T12:08:41.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.863+0000 7f5f601ff700 1 -- 172.21.15.45:0/2359991840 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f5f580b7650 con 0x7f5f580d0bb0 2023-11-28T12:08:41.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.865+0000 7f5f4e7fc700 1 -- 172.21.15.45:0/2359991840 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f5f4800f050 con 0x7f5f580d0bb0 2023-11-28T12:08:41.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.866+0000 7f5f4e7fc700 1 --2- 172.21.15.45:0/2359991840 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5f3c068340 0x7f5f3c06a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:41.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.866+0000 7f5f4e7fc700 1 -- 172.21.15.45:0/2359991840 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5f48085cb0 con 0x7f5f580d0bb0 2023-11-28T12:08:41.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.866+0000 7f5f4e7fc700 1 -- 172.21.15.45:0/2359991840 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+502 (secure 0 0 0) 0x7f5f480862b0 con 0x7f5f580d0bb0 2023-11-28T12:08:41.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.866+0000 7f5f5df9b700 1 --2- 172.21.15.45:0/2359991840 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5f3c068340 0x7f5f3c06a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:41.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.866+0000 7f5f601ff700 1 -- 172.21.15.45:0/2359991840 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({log-info=0+}) v3 -- 0x7f5f580678e0 con 0x7f5f580d0bb0 2023-11-28T12:08:41.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.867+0000 7f5f5df9b700 1 --2- 172.21.15.45:0/2359991840 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5f3c068340 0x7f5f3c06a7f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5f580c96f0 tx=0x7f5f54008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:41.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.869+0000 7f189f618b80 1 Processor -- start 2023-11-28T12:08:41.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.869+0000 7f189f618b80 1 -- start start 2023-11-28T12:08:41.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.870+0000 7f189f618b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563e61485730 0x563e614a4e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:41.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.870+0000 7f189f618b80 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x563e61499b90 0x563e6145d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:41.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.870+0000 7f189f618b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563e614a3020 0x563e6149a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:41.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.870+0000 7f189f618b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e614a1240 con 0x563e614a3020 2023-11-28T12:08:41.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.870+0000 7f189f618b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e6149b680 con 0x563e61485730 2023-11-28T12:08:41.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.870+0000 7f189f618b80 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x563e6149bc10 con 0x563e61499b90 2023-11-28T12:08:41.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.870+0000 7f188a19c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563e614a3020 0x563e6149a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:41.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.870+0000 7f188a19c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563e614a3020 0x563e6149a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60002/0 (socket says 172.21.15.45:60002) 2023-11-28T12:08:41.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.870+0000 7f188a19c700 1 -- 172.21.15.45:0/2711963793 learned_addr learned my addr 172.21.15.45:0/2711963793 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:41.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.870+0000 7f188999b700 1 --2- 172.21.15.45:0/2711963793 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563e61485730 0x563e614a4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:41.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.870+0000 7f188919a700 1 --2- 172.21.15.45:0/2711963793 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x563e61499b90 0x563e6145d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:41.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.870+0000 7f188a19c700 1 -- 172.21.15.45:0/2711963793 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x563e61499b90 msgr2=0x563e6145d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:41.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.870+0000 7f188a19c700 1 --2- 172.21.15.45:0/2711963793 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x563e61499b90 0x563e6145d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:41.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.870+0000 7f188a19c700 1 -- 172.21.15.45:0/2711963793 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563e61485730 msgr2=0x563e614a4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:41.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.870+0000 7f188a19c700 1 --2- 172.21.15.45:0/2711963793 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563e61485730 0x563e614a4e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:41.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.870+0000 7f188a19c700 1 -- 172.21.15.45:0/2711963793 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563e613763b0 con 0x563e614a3020 2023-11-28T12:08:41.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.870+0000 7f188999b700 1 --2- 172.21.15.45:0/2711963793 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563e61485730 0x563e614a4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:08:41.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.870+0000 7f188919a700 1 --2- 172.21.15.45:0/2711963793 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x563e61499b90 0x563e6145d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:08:41.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.871+0000 7f188a19c700 1 --2- 172.21.15.45:0/2711963793 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563e614a3020 0x563e6149a6a0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f187c055990 tx=0x7f187c05b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bacd85e7aaf139de server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:41.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.871+0000 7f1867fff700 1 -- 172.21.15.45:0/2711963793 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f187c05d980 con 0x563e614a3020 2023-11-28T12:08:41.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.871+0000 7f1867fff700 1 -- 172.21.15.45:0/2711963793 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f187c083b50 con 0x563e614a3020 2023-11-28T12:08:41.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.871+0000 7f1867fff700 1 -- 172.21.15.45:0/2711963793 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f187c05d6b0 con 0x563e614a3020 2023-11-28T12:08:41.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.872+0000 7f189f618b80 1 -- 172.21.15.45:0/2711963793 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563e614a3020 msgr2=0x563e6149a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:41.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.872+0000 7f189f618b80 1 --2- 172.21.15.45:0/2711963793 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563e614a3020 0x563e6149a6a0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f187c055990 tx=0x7f187c05b000 comp rx=0 tx=0).stop 2023-11-28T12:08:41.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.872+0000 7f189f618b80 1 -- 172.21.15.45:0/2711963793 shutdown_connections 2023-11-28T12:08:41.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.872+0000 7f189f618b80 1 --2- 172.21.15.45:0/2711963793 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563e61485730 0x563e614a4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:41.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.872+0000 7f189f618b80 1 --2- 172.21.15.45:0/2711963793 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563e614a3020 0x563e6149a6a0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:41.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.872+0000 7f189f618b80 1 --2- 172.21.15.45:0/2711963793 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x563e61499b90 0x563e6145d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:41.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.872+0000 7f189f618b80 1 -- 172.21.15.45:0/2711963793 >> 172.21.15.45:0/2711963793 conn(0x563e61452df0 msgr2=0x563e6149c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:41.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.872+0000 7f189f618b80 1 -- 172.21.15.45:0/2711963793 shutdown_connections 2023-11-28T12:08:41.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.872+0000 7f189f618b80 1 -- 172.21.15.45:0/2711963793 wait complete. 2023-11-28T12:08:41.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.872+0000 7f189f618b80 1 -- start start 2023-11-28T12:08:41.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.873+0000 7f189f618b80 1 Processor -- start 2023-11-28T12:08:41.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.874+0000 7f189f618b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563e61485730 0x563e6145d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:41.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.874+0000 7f189f618b80 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x563e61499b90 0x563e6145da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:41.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.874+0000 7f189f618b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563e614a3020 0x563e614a1df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:41.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.874+0000 7f189f618b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e614ffb60 con 0x563e61485730 2023-11-28T12:08:41.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.874+0000 7f189f618b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e614beb50 con 0x563e614a3020 2023-11-28T12:08:41.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.874+0000 7f189f618b80 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x563e614beda0 con 0x563e61499b90 2023-11-28T12:08:41.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.874+0000 7f189f618b80 10 client.0 _ll_register_callbacks cb 0x563e6134d4d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T12:08:41.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.874+0000 7f188999b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563e61485730 0x563e6145d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:41.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.874+0000 7f188999b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563e61485730 0x563e6145d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60004/0 (socket says 172.21.15.45:60004) 2023-11-28T12:08:41.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.874+0000 7f188999b700 1 -- 172.21.15.45:0/2222594425 learned_addr learned my addr 172.21.15.45:0/2222594425 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:41.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.874+0000 7f188a19c700 1 --2- 172.21.15.45:0/2222594425 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563e614a3020 0x563e614a1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:41.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.874+0000 7f188919a700 1 --2- 172.21.15.45:0/2222594425 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x563e61499b90 0x563e6145da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:41.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.874+0000 7f188999b700 1 -- 172.21.15.45:0/2222594425 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x563e61499b90 msgr2=0x563e6145da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:41.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.874+0000 7f188999b700 1 --2- 172.21.15.45:0/2222594425 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x563e61499b90 0x563e6145da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:41.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.874+0000 7f188999b700 1 -- 172.21.15.45:0/2222594425 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563e614a3020 msgr2=0x563e614a1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:41.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.874+0000 7f188999b700 1 --2- 172.21.15.45:0/2222594425 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563e614a3020 0x563e614a1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:41.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.874+0000 7f188999b700 1 -- 172.21.15.45:0/2222594425 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563e611a3860 con 0x563e61485730 2023-11-28T12:08:41.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.875+0000 7f188999b700 1 --2- 172.21.15.45:0/2222594425 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563e61485730 0x563e6145d4f0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f1880009840 tx=0x7f18800047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec5dde4a5be625a0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:41.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.875+0000 7f1864ff9700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-11-28T12:08:41.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.875+0000 7f1864ff9700 1 -- 172.21.15.45:0/2222594425 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1880037070 con 0x563e61485730 2023-11-28T12:08:41.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.875+0000 7f1864ff9700 1 -- 172.21.15.45:0/2222594425 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(47..47 src has 1..47) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f188001f040 con 0x563e61485730 2023-11-28T12:08:41.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.875+0000 7f189f618b80 1 -- 172.21.15.45:0/2222594425 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f187c05d810 con 0x563e61485730 2023-11-28T12:08:41.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.875+0000 7f1864ff9700 1 -- 172.21.15.45:0/2222594425 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1880038460 con 0x563e61485730 2023-11-28T12:08:41.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.875+0000 7f189f618b80 10 client.5754 fetch_fsmap learned FSMap version 24 2023-11-28T12:08:41.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.875+0000 7f189f618b80 1 -- 172.21.15.45:0/2222594425 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x563e612042a0 con 0x563e61485730 2023-11-28T12:08:41.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.875+0000 7f1864ff9700 1 -- 172.21.15.45:0/2222594425 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f187c05d810 con 0x563e61485730 2023-11-28T12:08:41.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.875+0000 7f1864ff9700 1 -- 172.21.15.45:0/2222594425 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 24) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f1880025ad0 con 0x563e61485730 2023-11-28T12:08:41.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.875+0000 7f189f618b80 10 client.5754 fetch_fsmap finished waiting for FSMap version 24 2023-11-28T12:08:41.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.875+0000 7f189f618b80 10 client.5754 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-11-28T12:08:41.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.875+0000 7f189f618b80 20 client.5754 populate_metadata read hostname 'smithi045' 2023-11-28T12:08:41.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.875+0000 7f189f618b80 1 --2- 172.21.15.45:0/2222594425 >> [v2:172.21.15.45:6833/1281816633,v1:172.21.15.45:6835/1281816633] conn(0x563e61482200 0x563e614a2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:41.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.875+0000 7f189f618b80 4 client.5754 mds_command: new command op to 5550 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}] 2023-11-28T12:08:41.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.875+0000 7f189f618b80 1 -- 172.21.15.45:0/2222594425 --> [v2:172.21.15.45:6833/1281816633,v1:172.21.15.45:6835/1281816633] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}) v1 -- 0x563e61234110 con 0x563e61482200 2023-11-28T12:08:41.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.876+0000 7f188919a700 1 --2- 172.21.15.45:0/2222594425 >> [v2:172.21.15.45:6833/1281816633,v1:172.21.15.45:6835/1281816633] conn(0x563e61482200 0x563e614a2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:41.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.876+0000 7f188919a700 1 --2- 172.21.15.45:0/2222594425 >> [v2:172.21.15.45:6833/1281816633,v1:172.21.15.45:6835/1281816633] conn(0x563e61482200 0x563e614a2330 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=170a95491373db63 server_cookie=dcfd9106a285f432 in_seq=0 out_seq=0 2023-11-28T12:08:41.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.876+0000 7f1864ff9700 10 client.5754 ms_handle_connect on v2:172.21.15.45:6833/1281816633 2023-11-28T12:08:41.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.877+0000 7f1864ff9700 1 -- 172.21.15.45:0/2222594425 <== mds.0 v2:172.21.15.45:6833/1281816633 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x563e61234110 con 0x563e61482200 2023-11-28T12:08:41.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.877+0000 7f1864ff9700 10 client.5754 handle_command_reply: tid=0 2023-11-28T12:08:41.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.877+0000 7f189f618b80 1 client.5754 shutdown 2023-11-28T12:08:41.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.877+0000 7f189f618b80 1 -- 172.21.15.45:0/2222594425 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563e61485730 msgr2=0x563e6145d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:41.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.877+0000 7f189f618b80 1 --2- 172.21.15.45:0/2222594425 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563e61485730 0x563e6145d4f0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f1880009840 tx=0x7f18800047c0 comp rx=0 tx=0).stop 2023-11-28T12:08:41.882 INFO:tasks.ceph.mds.c.smithi045.stderr:2023-11-28T12:08:41.877+0000 7f9ea17ea700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /parent_a/alpha auth v2 ap=1 DIRTYPARENT s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={5700=0-4194304@1} caps={5700=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=5700 | request=0 caps=1 dirtyparent=1 dirty=0 authpin=1 scrubqueue=0 0x562c90ba6100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(8)0x10000000001:[<0x10000000000/alpha v2>,<0x1/parent_a v4>]//[]","error_str":"failed to decode on-disk backtrace (40 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-11-28T12:08:41.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.877+0000 7f189f618b80 1 -- 172.21.15.45:0/2222594425 shutdown_connections 2023-11-28T12:08:41.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.877+0000 7f189f618b80 1 --2- 172.21.15.45:0/2222594425 >> [v2:172.21.15.45:6833/1281816633,v1:172.21.15.45:6835/1281816633] conn(0x563e61482200 0x563e614a2330 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:41.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.877+0000 7f189f618b80 1 --2- 172.21.15.45:0/2222594425 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563e614a3020 0x563e614a1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:41.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.877+0000 7f189f618b80 1 --2- 172.21.15.45:0/2222594425 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563e61485730 0x563e6145d4f0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:41.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.877+0000 7f189f618b80 1 --2- 172.21.15.45:0/2222594425 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x563e61499b90 0x563e6145da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:41.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.877+0000 7f1864ff9700 0 client.5754 ms_handle_reset on v2:172.21.15.45:6833/1281816633 2023-11-28T12:08:41.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.877+0000 7f189f618b80 1 -- 172.21.15.45:0/2222594425 >> 172.21.15.45:0/2222594425 conn(0x563e61452df0 msgr2=0x563e614b1900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:41.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.878+0000 7f189f618b80 1 -- 172.21.15.45:0/2222594425 shutdown_connections 2023-11-28T12:08:41.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.878+0000 7f189f618b80 1 -- 172.21.15.45:0/2222594425 wait complete. 2023-11-28T12:08:41.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.878+0000 7f189f618b80 20 client.5754 trim_cache size 0 max 16384 2023-11-28T12:08:41.884 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-11-28T12:08:41.884 INFO:teuthology.orchestra.run.smithi045.stdout: "return_code": 0, 2023-11-28T12:08:41.885 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_tag": "8d0213ad-2a13-4bbc-b5b6-bc51a9fe7fcc", 2023-11-28T12:08:41.885 INFO:teuthology.orchestra.run.smithi045.stdout: "mode": "asynchronous" 2023-11-28T12:08:41.885 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-11-28T12:08:41.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.879+0000 7f188bbff700 1 -- 172.21.15.45:0/2571950697 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f18680682f0 msgr2=0x7f186806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:41.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.879+0000 7f188bbff700 1 --2- 172.21.15.45:0/2571950697 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f18680682f0 0x7f186806a7a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f18800090b0 tx=0x7f188001c040 comp rx=0 tx=0).stop 2023-11-28T12:08:41.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.879+0000 7f188bbff700 1 -- 172.21.15.45:0/2571950697 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f188415dc30 msgr2=0x7f188414c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:41.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.879+0000 7f188bbff700 1 --2- 172.21.15.45:0/2571950697 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f188415dc30 0x7f188414c000 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f187c00cbe0 tx=0x7f187c00cef0 comp rx=0 tx=0).stop 2023-11-28T12:08:41.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.879+0000 7f188bbff700 1 -- 172.21.15.45:0/2571950697 shutdown_connections 2023-11-28T12:08:41.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.879+0000 7f188bbff700 1 --2- 172.21.15.45:0/2571950697 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f18680682f0 0x7f186806a7a0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:41.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.879+0000 7f188bbff700 1 --2- 172.21.15.45:0/2571950697 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f188415dc30 0x7f188414c000 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:41.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.879+0000 7f188bbff700 1 --2- 172.21.15.45:0/2571950697 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f18840cded0 0x7f18840b8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:41.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.879+0000 7f188bbff700 1 --2- 172.21.15.45:0/2571950697 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f188415a760 0x7f18840c84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:41.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.879+0000 7f188bbff700 1 -- 172.21.15.45:0/2571950697 >> 172.21.15.45:0/2571950697 conn(0x7f1884072620 msgr2=0x7f188415e5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:41.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.879+0000 7f188bbff700 1 -- 172.21.15.45:0/2571950697 shutdown_connections 2023-11-28T12:08:41.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:41.879+0000 7f188bbff700 1 -- 172.21.15.45:0/2571950697 wait complete. 2023-11-28T12:08:41.898 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub status 2023-11-28T12:08:42.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.103+0000 7f9969dff700 1 Processor -- start 2023-11-28T12:08:42.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.104+0000 7f9969dff700 1 -- start start 2023-11-28T12:08:42.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.105+0000 7f9969dff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f9964161340 0x7f99640d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:42.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.105+0000 7f9969dff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99640d1950 con 0x7f99640d2320 2023-11-28T12:08:42.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.105+0000 7f9969dff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99640b5520 con 0x7f996415c9b0 2023-11-28T12:08:42.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.105+0000 7f9969dff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99640b5800 con 0x7f9964161340 2023-11-28T12:08:42.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.105+0000 7f9963fff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f99640d2320 0x7f99640cd7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:38796/0 (socket says 172.21.15.45:38796) 2023-11-28T12:08:42.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.105+0000 7f9963fff700 1 -- 172.21.15.45:0/2326748344 learned_addr learned my addr 172.21.15.45:0/2326748344 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:08:42.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.105+0000 7f995bfff700 1 --2- 172.21.15.45:0/2326748344 >> v2:172.21.15.152:3300/0 conn(0x7f9964161340 0x7f99640d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:42.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.106+0000 7f9962ffd700 1 -- 172.21.15.45:0/2326748344 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2032809399 0 0) 0x7f99640d1950 con 0x7f99640d2320 2023-11-28T12:08:42.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.106+0000 7f9962ffd700 1 -- 172.21.15.45:0/2326748344 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99500035b0 con 0x7f99640d2320 2023-11-28T12:08:42.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.106+0000 7f995bfff700 1 -- 172.21.15.45:0/2326748344 >> v1:172.21.15.152:6789/0 conn(0x7f996415c9b0 legacy=0x7f99640b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:42.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.106+0000 7f995bfff700 1 -- 172.21.15.45:0/2326748344 >> v1:172.21.15.45:6789/0 conn(0x7f99640d2320 legacy=0x7f99640cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:42.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.106+0000 7f995bfff700 1 -- 172.21.15.45:0/2326748344 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99640d1300 con 0x7f9964161340 2023-11-28T12:08:42.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.106+0000 7f995bfff700 1 --2- 172.21.15.45:0/2326748344 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9964161340 0x7f99640d1de0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f994c009840 tx=0x7f994c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c1a47b6224b22772 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:42.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.106+0000 7f9962ffd700 1 -- 172.21.15.45:0/2326748344 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f994c011830 con 0x7f9964161340 2023-11-28T12:08:42.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.106+0000 7f9962ffd700 1 -- 172.21.15.45:0/2326748344 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f994c011990 con 0x7f9964161340 2023-11-28T12:08:42.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.106+0000 7f9962ffd700 1 -- 172.21.15.45:0/2326748344 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f994c011d20 con 0x7f9964161340 2023-11-28T12:08:42.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.107+0000 7f9969dff700 1 -- 172.21.15.45:0/2326748344 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9964161340 msgr2=0x7f99640d1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:42.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.107+0000 7f9969dff700 1 --2- 172.21.15.45:0/2326748344 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9964161340 0x7f99640d1de0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f994c009840 tx=0x7f994c009b50 comp rx=0 tx=0).stop 2023-11-28T12:08:42.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.107+0000 7f9969dff700 1 -- 172.21.15.45:0/2326748344 shutdown_connections 2023-11-28T12:08:42.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.107+0000 7f9969dff700 1 --2- 172.21.15.45:0/2326748344 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9964161340 0x7f99640d1de0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:42.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.107+0000 7f9969dff700 1 -- 172.21.15.45:0/2326748344 >> 172.21.15.45:0/2326748344 conn(0x7f9964072600 msgr2=0x7f99640cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:42.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.107+0000 7f9969dff700 1 -- 172.21.15.45:0/2326748344 shutdown_connections 2023-11-28T12:08:42.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.107+0000 7f9969dff700 1 -- 172.21.15.45:0/2326748344 wait complete. 2023-11-28T12:08:42.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.109+0000 7f9969dff700 1 Processor -- start 2023-11-28T12:08:42.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.110+0000 7f9969dff700 1 -- start start 2023-11-28T12:08:42.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.111+0000 7f9969dff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f99640d2320 0x7f99640cdb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:42.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.111+0000 7f9969dff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f996415c9b0 0x7f99640b7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:42.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.111+0000 7f9969dff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9964161340 0x7f99640b7f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:42.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.111+0000 7f9969dff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99640c9620 con 0x7f996415c9b0 2023-11-28T12:08:42.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.111+0000 7f9969dff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99640ce0a0 con 0x7f99640d2320 2023-11-28T12:08:42.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.111+0000 7f9969dff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f996414de60 con 0x7f9964161340 2023-11-28T12:08:42.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.111+0000 7f995bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f996415c9b0 0x7f99640b7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:42.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.111+0000 7f995bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f996415c9b0 0x7f99640b7a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52014/0 (socket says 172.21.15.45:52014) 2023-11-28T12:08:42.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.111+0000 7f995bfff700 1 -- 172.21.15.45:0/1864153340 learned_addr learned my addr 172.21.15.45:0/1864153340 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:42.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.112+0000 7f99637fe700 1 --2- 172.21.15.45:0/1864153340 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f99640d2320 0x7f99640cdb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:42.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.112+0000 7f9963fff700 1 --2- 172.21.15.45:0/1864153340 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9964161340 0x7f99640b7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:42.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.112+0000 7f995bfff700 1 -- 172.21.15.45:0/1864153340 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9964161340 msgr2=0x7f99640b7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:42.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.112+0000 7f995bfff700 1 --2- 172.21.15.45:0/1864153340 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9964161340 0x7f99640b7f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:42.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.112+0000 7f995bfff700 1 -- 172.21.15.45:0/1864153340 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f99640d2320 msgr2=0x7f99640cdb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:42.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.112+0000 7f995bfff700 1 --2- 172.21.15.45:0/1864153340 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f99640d2320 0x7f99640cdb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:42.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.112+0000 7f995bfff700 1 -- 172.21.15.45:0/1864153340 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f994c0094a0 con 0x7f996415c9b0 2023-11-28T12:08:42.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.112+0000 7f9963fff700 1 --2- 172.21.15.45:0/1864153340 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9964161340 0x7f99640b7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:08:42.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.112+0000 7f995bfff700 1 --2- 172.21.15.45:0/1864153340 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f996415c9b0 0x7f99640b7a10 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f994c009b90 tx=0x7f994c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:42.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.112+0000 7f9960ff9700 1 -- 172.21.15.45:0/1864153340 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f994c0038a0 con 0x7f996415c9b0 2023-11-28T12:08:42.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.112+0000 7f9960ff9700 1 -- 172.21.15.45:0/1864153340 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f994c01e070 con 0x7f996415c9b0 2023-11-28T12:08:42.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.112+0000 7f9960ff9700 1 -- 172.21.15.45:0/1864153340 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f994c003c40 con 0x7f996415c9b0 2023-11-28T12:08:42.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.112+0000 7f9969dff700 1 -- 172.21.15.45:0/1864153340 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f996415cd80 con 0x7f996415c9b0 2023-11-28T12:08:42.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.112+0000 7f9969dff700 1 -- 172.21.15.45:0/1864153340 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99640d15e0 con 0x7f996415c9b0 2023-11-28T12:08:42.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.114+0000 7f9960ff9700 1 -- 172.21.15.45:0/1864153340 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f994c00f050 con 0x7f996415c9b0 2023-11-28T12:08:42.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.115+0000 7f9960ff9700 1 --2- 172.21.15.45:0/1864153340 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f99440682f0 0x7f994406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:42.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.115+0000 7f9960ff9700 1 -- 172.21.15.45:0/1864153340 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f994c086d50 con 0x7f996415c9b0 2023-11-28T12:08:42.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.116+0000 7f99637fe700 1 --2- 172.21.15.45:0/1864153340 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f99440682f0 0x7f994406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:42.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.117+0000 7f99637fe700 1 --2- 172.21.15.45:0/1864153340 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f99440682f0 0x7f994406a7a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9954000f60 tx=0x7f9954009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:42.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.117+0000 7f997d6ddb80 1 Processor -- start 2023-11-28T12:08:42.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.118+0000 7f997d6ddb80 1 -- start start 2023-11-28T12:08:42.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.119+0000 7f997d6ddb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5626768adfa0 0x562676867a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:42.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.119+0000 7f997d6ddb80 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x5626768a4b10 0x5626768ae370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:42.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.119+0000 7f997d6ddb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5626768906b0 0x562676868bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:42.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.119+0000 7f997d6ddb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626767e5e30 con 0x5626768adfa0 2023-11-28T12:08:42.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.119+0000 7f997d6ddb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x562676752190 con 0x5626768906b0 2023-11-28T12:08:42.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.119+0000 7f997d6ddb80 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x5626767c0e00 con 0x5626768a4b10 2023-11-28T12:08:42.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.119+0000 7f99637fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5626768adfa0 0x562676867a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:42.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.119+0000 7f99637fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5626768adfa0 0x562676867a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52028/0 (socket says 172.21.15.45:52028) 2023-11-28T12:08:42.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.119+0000 7f99637fe700 1 -- 172.21.15.45:0/1807437707 learned_addr learned my addr 172.21.15.45:0/1807437707 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:42.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.119+0000 7f995bfff700 1 --2- 172.21.15.45:0/1807437707 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x5626768a4b10 0x5626768ae370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:42.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.119+0000 7f9963fff700 1 --2- 172.21.15.45:0/1807437707 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5626768906b0 0x562676868bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:42.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.119+0000 7f99637fe700 1 -- 172.21.15.45:0/1807437707 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x5626768a4b10 msgr2=0x5626768ae370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:42.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.119+0000 7f99637fe700 1 --2- 172.21.15.45:0/1807437707 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x5626768a4b10 0x5626768ae370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:42.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.120+0000 7f99637fe700 1 -- 172.21.15.45:0/1807437707 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5626768906b0 msgr2=0x562676868bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:42.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.120+0000 7f99637fe700 1 --2- 172.21.15.45:0/1807437707 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5626768906b0 0x562676868bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:42.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.120+0000 7f99637fe700 1 -- 172.21.15.45:0/1807437707 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5626765ae7e0 con 0x5626768adfa0 2023-11-28T12:08:42.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.120+0000 7f9963fff700 1 --2- 172.21.15.45:0/1807437707 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5626768906b0 0x562676868bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:08:42.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.120+0000 7f99637fe700 1 --2- 172.21.15.45:0/1807437707 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5626768adfa0 0x562676867a40 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f9954005390 tx=0x7f9954011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a776337d6486d3be server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:42.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.120+0000 7f99597fa700 1 -- 172.21.15.45:0/1807437707 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99540050d0 con 0x5626768adfa0 2023-11-28T12:08:42.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.120+0000 7f99597fa700 1 -- 172.21.15.45:0/1807437707 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9954003dd0 con 0x5626768adfa0 2023-11-28T12:08:42.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.120+0000 7f99597fa700 1 -- 172.21.15.45:0/1807437707 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9954021670 con 0x5626768adfa0 2023-11-28T12:08:42.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.121+0000 7f997d6ddb80 1 -- 172.21.15.45:0/1807437707 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5626768adfa0 msgr2=0x562676867a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:42.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.121+0000 7f997d6ddb80 1 --2- 172.21.15.45:0/1807437707 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5626768adfa0 0x562676867a40 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f9954005390 tx=0x7f9954011000 comp rx=0 tx=0).stop 2023-11-28T12:08:42.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.121+0000 7f997d6ddb80 1 -- 172.21.15.45:0/1807437707 shutdown_connections 2023-11-28T12:08:42.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.121+0000 7f997d6ddb80 1 --2- 172.21.15.45:0/1807437707 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5626768906b0 0x562676868bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:42.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.121+0000 7f997d6ddb80 1 --2- 172.21.15.45:0/1807437707 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5626768adfa0 0x562676867a40 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:42.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.121+0000 7f997d6ddb80 1 --2- 172.21.15.45:0/1807437707 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x5626768a4b10 0x5626768ae370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:42.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.121+0000 7f997d6ddb80 1 -- 172.21.15.45:0/1807437707 >> 172.21.15.45:0/1807437707 conn(0x56267685dd70 msgr2=0x562676866f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:42.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.121+0000 7f997d6ddb80 1 -- 172.21.15.45:0/1807437707 shutdown_connections 2023-11-28T12:08:42.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.121+0000 7f997d6ddb80 1 -- 172.21.15.45:0/1807437707 wait complete. 2023-11-28T12:08:42.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.122+0000 7f997d6ddb80 1 -- start start 2023-11-28T12:08:42.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.122+0000 7f997d6ddb80 1 Processor -- start 2023-11-28T12:08:42.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.123+0000 7f997d6ddb80 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x5626768906b0 0x56267688cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:42.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.123+0000 7f997d6ddb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5626768a4b10 0x5626768c14a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:42.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.123+0000 7f997d6ddb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5626768adfa0 0x5626768ac310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:42.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.123+0000 7f997d6ddb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626767ba170 con 0x5626768adfa0 2023-11-28T12:08:42.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.123+0000 7f997d6ddb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626765af3e0 con 0x5626768a4b10 2023-11-28T12:08:42.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.123+0000 7f997d6ddb80 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x562676752390 con 0x5626768906b0 2023-11-28T12:08:42.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.123+0000 7f997d6ddb80 10 client.0 _ll_register_callbacks cb 0x562676758450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T12:08:42.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.123+0000 7f9963fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5626768adfa0 0x5626768ac310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:42.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.123+0000 7f9963fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5626768adfa0 0x5626768ac310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52044/0 (socket says 172.21.15.45:52044) 2023-11-28T12:08:42.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.123+0000 7f9963fff700 1 -- 172.21.15.45:0/883807926 learned_addr learned my addr 172.21.15.45:0/883807926 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:42.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.123+0000 7f99637fe700 1 --2- 172.21.15.45:0/883807926 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x5626768906b0 0x56267688cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:42.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.123+0000 7f995bfff700 1 --2- 172.21.15.45:0/883807926 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5626768a4b10 0x5626768c14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:42.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.124+0000 7f9963fff700 1 -- 172.21.15.45:0/883807926 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x5626768906b0 msgr2=0x56267688cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:42.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.124+0000 7f9963fff700 1 --2- 172.21.15.45:0/883807926 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x5626768906b0 0x56267688cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:42.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.124+0000 7f9963fff700 1 -- 172.21.15.45:0/883807926 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5626768a4b10 msgr2=0x5626768c14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:42.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.124+0000 7f9963fff700 1 --2- 172.21.15.45:0/883807926 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5626768a4b10 0x5626768c14a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:42.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.124+0000 7f9963fff700 1 -- 172.21.15.45:0/883807926 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f995400f040 con 0x5626768adfa0 2023-11-28T12:08:42.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.124+0000 7f9963fff700 1 --2- 172.21.15.45:0/883807926 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5626768adfa0 0x5626768ac310 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f995c00e810 tx=0x7f995c00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8a57b048dcfc1d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:42.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.124+0000 7f99427fc700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-11-28T12:08:42.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.124+0000 7f99427fc700 1 -- 172.21.15.45:0/883807926 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f995c0127f0 con 0x5626768adfa0 2023-11-28T12:08:42.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.124+0000 7f99427fc700 1 -- 172.21.15.45:0/883807926 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(47..47 src has 1..47) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f995c012950 con 0x5626768adfa0 2023-11-28T12:08:42.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.124+0000 7f997d6ddb80 1 -- 172.21.15.45:0/883807926 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5626767be080 con 0x5626768adfa0 2023-11-28T12:08:42.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.124+0000 7f99427fc700 1 -- 172.21.15.45:0/883807926 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f995c001be0 con 0x5626768adfa0 2023-11-28T12:08:42.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.124+0000 7f997d6ddb80 10 client.5766 fetch_fsmap learned FSMap version 24 2023-11-28T12:08:42.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.124+0000 7f997d6ddb80 1 -- 172.21.15.45:0/883807926 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x56267669b0f0 con 0x5626768adfa0 2023-11-28T12:08:42.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.125+0000 7f99427fc700 1 -- 172.21.15.45:0/883807926 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5626767be080 con 0x5626768adfa0 2023-11-28T12:08:42.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.125+0000 7f99427fc700 1 -- 172.21.15.45:0/883807926 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 24) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f995c012b10 con 0x5626768adfa0 2023-11-28T12:08:42.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.125+0000 7f997d6ddb80 10 client.5766 fetch_fsmap finished waiting for FSMap version 24 2023-11-28T12:08:42.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.125+0000 7f997d6ddb80 10 client.5766 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-11-28T12:08:42.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.125+0000 7f997d6ddb80 20 client.5766 populate_metadata read hostname 'smithi045' 2023-11-28T12:08:42.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.125+0000 7f997d6ddb80 1 --2- 172.21.15.45:0/883807926 >> [v2:172.21.15.45:6833/1281816633,v1:172.21.15.45:6835/1281816633] conn(0x5626768a5b00 0x5626768a5f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:42.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.125+0000 7f997d6ddb80 4 client.5766 mds_command: new command op to 5550 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-28T12:08:42.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.125+0000 7f997d6ddb80 1 -- 172.21.15.45:0/883807926 --> [v2:172.21.15.45:6833/1281816633,v1:172.21.15.45:6835/1281816633] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562676609f40 con 0x5626768a5b00 2023-11-28T12:08:42.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.125+0000 7f99637fe700 1 --2- 172.21.15.45:0/883807926 >> [v2:172.21.15.45:6833/1281816633,v1:172.21.15.45:6835/1281816633] conn(0x5626768a5b00 0x5626768a5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:42.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.126+0000 7f99427fc700 10 client.5766 ms_handle_connect on v2:172.21.15.45:6833/1281816633 2023-11-28T12:08:42.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.126+0000 7f99637fe700 1 --2- 172.21.15.45:0/883807926 >> [v2:172.21.15.45:6833/1281816633,v1:172.21.15.45:6835/1281816633] conn(0x5626768a5b00 0x5626768a5f00 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bfe857305dc9d78f server_cookie=86f34ce282ae76f1 in_seq=0 out_seq=0 2023-11-28T12:08:42.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.126+0000 7f99427fc700 1 -- 172.21.15.45:0/883807926 <== mds.0 v2:172.21.15.45:6833/1281816633 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x562676609f40 con 0x5626768a5b00 2023-11-28T12:08:42.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.126+0000 7f99427fc700 10 client.5766 handle_command_reply: tid=0 2023-11-28T12:08:42.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.126+0000 7f997d6ddb80 1 client.5766 shutdown 2023-11-28T12:08:42.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.127+0000 7f997d6ddb80 1 -- 172.21.15.45:0/883807926 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5626768adfa0 msgr2=0x5626768ac310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:42.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.127+0000 7f997d6ddb80 1 --2- 172.21.15.45:0/883807926 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5626768adfa0 0x5626768ac310 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f995c00e810 tx=0x7f995c00eb20 comp rx=0 tx=0).stop 2023-11-28T12:08:42.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.127+0000 7f997d6ddb80 1 -- 172.21.15.45:0/883807926 shutdown_connections 2023-11-28T12:08:42.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.127+0000 7f997d6ddb80 1 --2- 172.21.15.45:0/883807926 >> [v2:172.21.15.45:6833/1281816633,v1:172.21.15.45:6835/1281816633] conn(0x5626768a5b00 0x5626768a5f00 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:42.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.127+0000 7f997d6ddb80 1 --2- 172.21.15.45:0/883807926 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5626768adfa0 0x5626768ac310 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:42.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.127+0000 7f997d6ddb80 1 --2- 172.21.15.45:0/883807926 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x5626768906b0 0x56267688cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:42.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.127+0000 7f99427fc700 0 client.5766 ms_handle_reset on v2:172.21.15.45:6833/1281816633 2023-11-28T12:08:42.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.127+0000 7f997d6ddb80 1 --2- 172.21.15.45:0/883807926 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5626768a4b10 0x5626768c14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:42.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.127+0000 7f997d6ddb80 1 -- 172.21.15.45:0/883807926 >> 172.21.15.45:0/883807926 conn(0x56267685dd70 msgr2=0x562676862f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:42.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.127+0000 7f997d6ddb80 1 -- 172.21.15.45:0/883807926 shutdown_connections 2023-11-28T12:08:42.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.127+0000 7f997d6ddb80 1 -- 172.21.15.45:0/883807926 wait complete. 2023-11-28T12:08:42.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.127+0000 7f997d6ddb80 20 client.5766 trim_cache size 0 max 16384 2023-11-28T12:08:42.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.144+0000 7f997d6ddb80 1 Processor -- start 2023-11-28T12:08:42.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.144+0000 7f997d6ddb80 1 -- start start 2023-11-28T12:08:42.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.145+0000 7f997d6ddb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5626768906b0 0x562676864660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:42.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.146+0000 7f997d6ddb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5626768a4b10 0x5626768aad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:42.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.146+0000 7f997d6ddb80 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x5626768adfa0 0x5626768a5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:42.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.146+0000 7f997d6ddb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626768c1010 con 0x5626768a4b10 2023-11-28T12:08:42.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.146+0000 7f997d6ddb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x562676863150 con 0x5626768906b0 2023-11-28T12:08:42.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.146+0000 7f997d6ddb80 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x562676863560 con 0x5626768adfa0 2023-11-28T12:08:42.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.146+0000 7f995bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5626768a4b10 0x5626768aad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:42.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.146+0000 7f995bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5626768a4b10 0x5626768aad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52046/0 (socket says 172.21.15.45:52046) 2023-11-28T12:08:42.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.146+0000 7f995bfff700 1 -- 172.21.15.45:0/750919747 learned_addr learned my addr 172.21.15.45:0/750919747 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:42.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.146+0000 7f99637fe700 1 --2- 172.21.15.45:0/750919747 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5626768906b0 0x562676864660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:42.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.146+0000 7f9963fff700 1 --2- 172.21.15.45:0/750919747 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x5626768adfa0 0x5626768a5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:42.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.146+0000 7f995bfff700 1 -- 172.21.15.45:0/750919747 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x5626768adfa0 msgr2=0x5626768a5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:42.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.146+0000 7f995bfff700 1 --2- 172.21.15.45:0/750919747 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x5626768adfa0 0x5626768a5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:42.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.146+0000 7f995bfff700 1 -- 172.21.15.45:0/750919747 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5626768906b0 msgr2=0x562676864660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:42.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.146+0000 7f995bfff700 1 --2- 172.21.15.45:0/750919747 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5626768906b0 0x562676864660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:42.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.146+0000 7f995bfff700 1 -- 172.21.15.45:0/750919747 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562676781330 con 0x5626768a4b10 2023-11-28T12:08:42.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.146+0000 7f995bfff700 1 --2- 172.21.15.45:0/750919747 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5626768a4b10 0x5626768aad40 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f994c000c00 tx=0x7f994c056cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5aebe133fc6e18e4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:42.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.147+0000 7f9959ffb700 1 -- 172.21.15.45:0/750919747 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f994c055520 con 0x5626768a4b10 2023-11-28T12:08:42.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.147+0000 7f9959ffb700 1 -- 172.21.15.45:0/750919747 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f994c06e070 con 0x5626768a4b10 2023-11-28T12:08:42.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.147+0000 7f9959ffb700 1 -- 172.21.15.45:0/750919747 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f994c056890 con 0x5626768a4b10 2023-11-28T12:08:42.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.147+0000 7f997d6ddb80 1 -- 172.21.15.45:0/750919747 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5626768a4b10 msgr2=0x5626768aad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:42.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.147+0000 7f997d6ddb80 1 --2- 172.21.15.45:0/750919747 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5626768a4b10 0x5626768aad40 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f994c000c00 tx=0x7f994c056cc0 comp rx=0 tx=0).stop 2023-11-28T12:08:42.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.147+0000 7f997d6ddb80 1 -- 172.21.15.45:0/750919747 shutdown_connections 2023-11-28T12:08:42.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.147+0000 7f997d6ddb80 1 --2- 172.21.15.45:0/750919747 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5626768906b0 0x562676864660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:42.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.147+0000 7f997d6ddb80 1 --2- 172.21.15.45:0/750919747 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x5626768adfa0 0x5626768a5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:42.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.147+0000 7f997d6ddb80 1 --2- 172.21.15.45:0/750919747 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5626768a4b10 0x5626768aad40 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:42.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.147+0000 7f997d6ddb80 1 -- 172.21.15.45:0/750919747 >> 172.21.15.45:0/750919747 conn(0x56267685dd70 msgr2=0x56267688f520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:42.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.147+0000 7f997d6ddb80 1 -- 172.21.15.45:0/750919747 shutdown_connections 2023-11-28T12:08:42.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.147+0000 7f997d6ddb80 1 -- 172.21.15.45:0/750919747 wait complete. 2023-11-28T12:08:42.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.148+0000 7f997d6ddb80 1 -- start start 2023-11-28T12:08:42.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.148+0000 7f997d6ddb80 1 Processor -- start 2023-11-28T12:08:42.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.149+0000 7f997d6ddb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5626768906b0 0x56267690cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:42.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.149+0000 7f997d6ddb80 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x5626768a4b10 0x56267688c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:42.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.149+0000 7f997d6ddb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5626768adfa0 0x56267688cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:42.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.149+0000 7f997d6ddb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x56267690d510 con 0x5626768adfa0 2023-11-28T12:08:42.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.149+0000 7f997d6ddb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626768c76f0 con 0x5626768906b0 2023-11-28T12:08:42.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.149+0000 7f997d6ddb80 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x5626768aae70 con 0x5626768a4b10 2023-11-28T12:08:42.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.149+0000 7f997d6ddb80 10 client.0 _ll_register_callbacks cb 0x562676758450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T12:08:42.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.149+0000 7f9963fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5626768adfa0 0x56267688cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:42.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.149+0000 7f9963fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5626768adfa0 0x56267688cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52050/0 (socket says 172.21.15.45:52050) 2023-11-28T12:08:42.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.149+0000 7f9963fff700 1 -- 172.21.15.45:0/2282537379 learned_addr learned my addr 172.21.15.45:0/2282537379 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:08:42.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.149+0000 7f995bfff700 1 --2- 172.21.15.45:0/2282537379 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x5626768a4b10 0x56267688c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:42.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.150+0000 7f99637fe700 1 --2- 172.21.15.45:0/2282537379 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5626768906b0 0x56267690cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:42.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.150+0000 7f9963fff700 1 -- 172.21.15.45:0/2282537379 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x5626768a4b10 msgr2=0x56267688c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:42.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.150+0000 7f9963fff700 1 --2- 172.21.15.45:0/2282537379 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x5626768a4b10 0x56267688c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:42.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.150+0000 7f9963fff700 1 -- 172.21.15.45:0/2282537379 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5626768906b0 msgr2=0x56267690cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:08:42.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.150+0000 7f9963fff700 1 --2- 172.21.15.45:0/2282537379 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5626768906b0 0x56267690cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:42.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.150+0000 7f9963fff700 1 -- 172.21.15.45:0/2282537379 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99640d15e0 con 0x5626768adfa0 2023-11-28T12:08:42.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.150+0000 7f9963fff700 1 --2- 172.21.15.45:0/2282537379 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5626768adfa0 0x56267688cef0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x5626768abd00 tx=0x7f995c0014d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a04e547debe35666 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:08:42.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.150+0000 7f99427fc700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-11-28T12:08:42.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.150+0000 7f99427fc700 1 -- 172.21.15.45:0/2282537379 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f995c0019f0 con 0x5626768adfa0 2023-11-28T12:08:42.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.150+0000 7f99427fc700 1 -- 172.21.15.45:0/2282537379 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(47..47 src has 1..47) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f995c013520 con 0x5626768adfa0 2023-11-28T12:08:42.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.150+0000 7f997d6ddb80 1 -- 172.21.15.45:0/2282537379 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56267686a0d0 con 0x5626768adfa0 2023-11-28T12:08:42.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.151+0000 7f99427fc700 1 -- 172.21.15.45:0/2282537379 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f995c001be0 con 0x5626768adfa0 2023-11-28T12:08:42.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.151+0000 7f997d6ddb80 10 client.5772 fetch_fsmap learned FSMap version 24 2023-11-28T12:08:42.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.151+0000 7f997d6ddb80 1 -- 172.21.15.45:0/2282537379 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x56267660f220 con 0x5626768adfa0 2023-11-28T12:08:42.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.151+0000 7f99427fc700 1 -- 172.21.15.45:0/2282537379 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56267686a0d0 con 0x5626768adfa0 2023-11-28T12:08:42.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.151+0000 7f99427fc700 1 -- 172.21.15.45:0/2282537379 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 24) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f995c013930 con 0x5626768adfa0 2023-11-28T12:08:42.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.151+0000 7f997d6ddb80 10 client.5772 fetch_fsmap finished waiting for FSMap version 24 2023-11-28T12:08:42.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.151+0000 7f997d6ddb80 10 client.5772 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-11-28T12:08:42.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.151+0000 7f997d6ddb80 20 client.5772 populate_metadata read hostname 'smithi045' 2023-11-28T12:08:42.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.151+0000 7f997d6ddb80 1 --2- 172.21.15.45:0/2282537379 >> [v2:172.21.15.45:6833/1281816633,v1:172.21.15.45:6835/1281816633] conn(0x5626768bebb0 0x5626768a3890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:08:42.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.151+0000 7f997d6ddb80 4 client.5772 mds_command: new command op to 5550 tid=0[{"prefix": "scrub status"}] 2023-11-28T12:08:42.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.151+0000 7f997d6ddb80 1 -- 172.21.15.45:0/2282537379 --> [v2:172.21.15.45:6833/1281816633,v1:172.21.15.45:6835/1281816633] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x7f9954003dd0 con 0x5626768bebb0 2023-11-28T12:08:42.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.151+0000 7f99637fe700 1 --2- 172.21.15.45:0/2282537379 >> [v2:172.21.15.45:6833/1281816633,v1:172.21.15.45:6835/1281816633] conn(0x5626768bebb0 0x5626768a3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:08:42.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.152+0000 7f99637fe700 1 --2- 172.21.15.45:0/2282537379 >> [v2:172.21.15.45:6833/1281816633,v1:172.21.15.45:6835/1281816633] conn(0x5626768bebb0 0x5626768a3890 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b06effb9cd11949 server_cookie=ba48d6b11eedb015 in_seq=0 out_seq=0 2023-11-28T12:08:42.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.152+0000 7f99427fc700 10 client.5772 ms_handle_connect on v2:172.21.15.45:6833/1281816633 2023-11-28T12:08:42.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.152+0000 7f99427fc700 1 -- 172.21.15.45:0/2282537379 <== mds.0 v2:172.21.15.45:6833/1281816633 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+260 (crc 0 0 0) 0x7f9954003dd0 con 0x5626768bebb0 2023-11-28T12:08:42.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.152+0000 7f99427fc700 10 client.5772 handle_command_reply: tid=0 2023-11-28T12:08:42.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.152+0000 7f997d6ddb80 1 client.5772 shutdown 2023-11-28T12:08:42.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.152+0000 7f997d6ddb80 1 -- 172.21.15.45:0/2282537379 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5626768adfa0 msgr2=0x56267688cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:42.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.152+0000 7f997d6ddb80 1 --2- 172.21.15.45:0/2282537379 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5626768adfa0 0x56267688cef0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x5626768abd00 tx=0x7f995c0014d0 comp rx=0 tx=0).stop 2023-11-28T12:08:42.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.152+0000 7f997d6ddb80 1 -- 172.21.15.45:0/2282537379 shutdown_connections 2023-11-28T12:08:42.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.152+0000 7f997d6ddb80 1 --2- 172.21.15.45:0/2282537379 >> [v2:172.21.15.45:6833/1281816633,v1:172.21.15.45:6835/1281816633] conn(0x5626768bebb0 0x5626768a3890 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:42.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.152+0000 7f997d6ddb80 1 --2- 172.21.15.45:0/2282537379 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x5626768906b0 0x56267690cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:42.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.152+0000 7f997d6ddb80 1 --2- 172.21.15.45:0/2282537379 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5626768adfa0 0x56267688cef0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:42.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.152+0000 7f997d6ddb80 1 --2- 172.21.15.45:0/2282537379 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x5626768a4b10 0x56267688c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:42.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.152+0000 7f997d6ddb80 1 -- 172.21.15.45:0/2282537379 >> 172.21.15.45:0/2282537379 conn(0x56267685dd70 msgr2=0x5626768abd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:42.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.152+0000 7f99427fc700 0 client.5772 ms_handle_reset on v2:172.21.15.45:6833/1281816633 2023-11-28T12:08:42.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.153+0000 7f997d6ddb80 1 -- 172.21.15.45:0/2282537379 shutdown_connections 2023-11-28T12:08:42.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.153+0000 7f997d6ddb80 1 -- 172.21.15.45:0/2282537379 wait complete. 2023-11-28T12:08:42.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.153+0000 7f997d6ddb80 20 client.5772 trim_cache size 0 max 16384 2023-11-28T12:08:42.165 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-11-28T12:08:42.166 INFO:teuthology.orchestra.run.smithi045.stdout: "status": "IDLE (waiting for more scrubs)", 2023-11-28T12:08:42.166 INFO:teuthology.orchestra.run.smithi045.stdout: "scrubs": { 2023-11-28T12:08:42.166 INFO:teuthology.orchestra.run.smithi045.stdout: "8d0213ad-2a13-4bbc-b5b6-bc51a9fe7fcc": { 2023-11-28T12:08:42.166 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/", 2023-11-28T12:08:42.166 INFO:teuthology.orchestra.run.smithi045.stdout: "tag": "8d0213ad-2a13-4bbc-b5b6-bc51a9fe7fcc", 2023-11-28T12:08:42.166 INFO:teuthology.orchestra.run.smithi045.stdout: "options": "recursive,repair" 2023-11-28T12:08:42.166 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T12:08:42.166 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T12:08:42.166 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-11-28T12:08:42.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.153+0000 7f9969dff700 1 -- 172.21.15.45:0/1864153340 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f99440682f0 msgr2=0x7f994406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:42.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.153+0000 7f9969dff700 1 --2- 172.21.15.45:0/1864153340 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f99440682f0 0x7f994406a7a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9954000f60 tx=0x7f9954009040 comp rx=0 tx=0).stop 2023-11-28T12:08:42.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.153+0000 7f9969dff700 1 -- 172.21.15.45:0/1864153340 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f996415c9b0 msgr2=0x7f99640b7a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:08:42.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.153+0000 7f9969dff700 1 --2- 172.21.15.45:0/1864153340 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f996415c9b0 0x7f99640b7a10 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f994c009b90 tx=0x7f994c004750 comp rx=0 tx=0).stop 2023-11-28T12:08:42.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.153+0000 7f9969dff700 1 -- 172.21.15.45:0/1864153340 shutdown_connections 2023-11-28T12:08:42.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.153+0000 7f9969dff700 1 --2- 172.21.15.45:0/1864153340 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f99440682f0 0x7f994406a7a0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:42.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.153+0000 7f9969dff700 1 --2- 172.21.15.45:0/1864153340 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f99640d2320 0x7f99640cdb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:42.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.153+0000 7f9969dff700 1 --2- 172.21.15.45:0/1864153340 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9964161340 0x7f99640b7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:42.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.153+0000 7f9969dff700 1 --2- 172.21.15.45:0/1864153340 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f996415c9b0 0x7f99640b7a10 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:08:42.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.153+0000 7f9969dff700 1 -- 172.21.15.45:0/1864153340 >> 172.21.15.45:0/1864153340 conn(0x7f9964072600 msgr2=0x7f996415a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:08:42.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.153+0000 7f9969dff700 1 -- 172.21.15.45:0/1864153340 shutdown_connections 2023-11-28T12:08:42.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.153+0000 7f9969dff700 1 -- 172.21.15.45:0/1864153340 wait complete. 2023-11-28T12:08:42.171 INFO:tasks.cephfs.filesystem:scrub status for tag:8d0213ad-2a13-4bbc-b5b6-bc51a9fe7fcc - {'path': '/', 'tag': '8d0213ad-2a13-4bbc-b5b6-bc51a9fe7fcc', 'options': 'recursive,repair'} 2023-11-28T12:08:42.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:42.898+0000 7f5f4e7fc700 1 -- 172.21.15.45:0/2359991840 <== mon.0 v2:172.21.15.45:3300/0 7 ==== log(6 entries from seq 1 at 2023-11-28T12:08:41.877417+0000) v1 ==== 1078+0+0 (secure 0 0 0) 0x7f5f48086290 con 0x7f5f580d0bb0 2023-11-28T12:08:42.900 INFO:teuthology.orchestra.run.smithi045.stdout: cluster: 2023-11-28T12:08:42.900 INFO:teuthology.orchestra.run.smithi045.stdout: id: bd7c37f1-f7c6-4778-b845-52cf2aa6e366 2023-11-28T12:08:42.900 INFO:teuthology.orchestra.run.smithi045.stdout: health: HEALTH_OK 2023-11-28T12:08:42.900 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:08:42.900 INFO:teuthology.orchestra.run.smithi045.stdout: services: 2023-11-28T12:08:42.900 INFO:teuthology.orchestra.run.smithi045.stdout: mon: 3 daemons, quorum a,b,c (age 2m) 2023-11-28T12:08:42.900 INFO:teuthology.orchestra.run.smithi045.stdout: mgr: x(active, since 2m), standbys: y 2023-11-28T12:08:42.900 INFO:teuthology.orchestra.run.smithi045.stdout: mds: 1/1 daemons up, 3 standby 2023-11-28T12:08:42.900 INFO:teuthology.orchestra.run.smithi045.stdout: osd: 8 osds: 8 up (since 2m), 8 in (since 2m) 2023-11-28T12:08:42.901 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:08:42.901 INFO:teuthology.orchestra.run.smithi045.stdout: data: 2023-11-28T12:08:42.901 INFO:teuthology.orchestra.run.smithi045.stdout: volumes: 1/1 healthy 2023-11-28T12:08:42.901 INFO:teuthology.orchestra.run.smithi045.stdout: pools: 4 pools, 105 pgs 2023-11-28T12:08:42.901 INFO:teuthology.orchestra.run.smithi045.stdout: objects: 24 objects, 579 KiB 2023-11-28T12:08:42.901 INFO:teuthology.orchestra.run.smithi045.stdout: usage: 88 MiB used, 720 GiB / 720 GiB avail 2023-11-28T12:08:42.901 INFO:teuthology.orchestra.run.smithi045.stdout: pgs: 105 active+clean 2023-11-28T12:08:42.901 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:08:42.901 INFO:teuthology.orchestra.run.smithi045.stdout: io: 2023-11-28T12:08:42.901 INFO:teuthology.orchestra.run.smithi045.stdout: client: 1.5 KiB/s wr, 0 op/s rd, 4 op/s wr 2023-11-28T12:08:42.901 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:08:42.902 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:08:42.902 INFO:teuthology.orchestra.run.smithi045.stdout:2023-11-28T12:08:41.877417+0000 mds.c [INF] scrub queued for path: / 2023-11-28T12:08:42.902 INFO:teuthology.orchestra.run.smithi045.stdout:2023-11-28T12:08:41.877421+0000 mds.c [INF] scrub summary: idle+waiting paths [/] 2023-11-28T12:08:42.902 INFO:teuthology.orchestra.run.smithi045.stdout:2023-11-28T12:08:41.877425+0000 mds.c [INF] scrub summary: active paths [/] 2023-11-28T12:08:42.902 INFO:teuthology.orchestra.run.smithi045.stdout:2023-11-28T12:08:41.878377+0000 mds.c [WRN] bad backtrace on inode 0x10000000001(/parent_a/alpha), rewriting it 2023-11-28T12:08:42.902 INFO:teuthology.orchestra.run.smithi045.stdout:2023-11-28T12:08:41.878390+0000 mds.c [INF] Scrub repaired inode 0x10000000001 (/parent_a/alpha) 2023-11-28T12:08:42.902 INFO:teuthology.orchestra.run.smithi045.stdout:2023-11-28T12:08:41.879145+0000 mds.c [INF] scrub summary: idle+waiting paths [/] 2023-11-28T12:08:46.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:08:46.908+0000 7f5f4e7fc700 1 -- 172.21.15.45:0/2359991840 <== mon.0 v2:172.21.15.45:3300/0 8 ==== log(1 entries from seq 7 at 2023-11-28T12:08:45.536244+0000) v1 ==== 189+0+0 (secure 0 0 0) 0x7f5f4805e1f0 con 0x7f5f580d0bb0 2023-11-28T12:08:46.909 INFO:teuthology.orchestra.run.smithi045.stdout:2023-11-28T12:08:45.536244+0000 mds.c [INF] scrub summary: idle 2023-11-28T12:09:00.363 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T12:09:00.369 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T12:09:12.172 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub status 2023-11-28T12:09:12.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.388+0000 7f27577ff700 1 Processor -- start 2023-11-28T12:09:12.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.388+0000 7f27577ff700 1 -- start start 2023-11-28T12:09:12.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.389+0000 7f27577ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f275015c9b0 0x7f27500b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:12.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.389+0000 7f27577ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2750161340 0x7f27500d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:12.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.389+0000 7f27577ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27500d1950 con 0x7f27500d2320 2023-11-28T12:09:12.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.389+0000 7f27577ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27500b5800 con 0x7f275015c9b0 2023-11-28T12:09:12.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.389+0000 7f27577ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27500b5520 con 0x7f2750161340 2023-11-28T12:09:12.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.390+0000 7f2754d9a700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2750161340 0x7f27500d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:12.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.390+0000 7f2755d9c700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f27500d2320 0x7f27500cd7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.45:41722/0 (socket says 172.21.15.45:41722) 2023-11-28T12:09:12.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.390+0000 7f2755d9c700 1 -- 172.21.15.45:0/79575270 learned_addr learned my addr 172.21.15.45:0/79575270 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:09:12.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.390+0000 7f275559b700 1 --2- 172.21.15.45:0/79575270 >> v2:172.21.15.152:3300/0 conn(0x7f275015c9b0 0x7f27500b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:12.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.390+0000 7f2747fff700 1 -- 172.21.15.45:0/79575270 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 366819191 0 0) 0x7f27500d1950 con 0x7f27500d2320 2023-11-28T12:09:12.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.390+0000 7f2747fff700 1 -- 172.21.15.45:0/79575270 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f273c0035b0 con 0x7f27500d2320 2023-11-28T12:09:12.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.390+0000 7f2754d9a700 1 -- 172.21.15.45:0/79575270 >> v2:172.21.15.152:3300/0 conn(0x7f275015c9b0 msgr2=0x7f27500b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:12.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.390+0000 7f2754d9a700 1 --2- 172.21.15.45:0/79575270 >> v2:172.21.15.152:3300/0 conn(0x7f275015c9b0 0x7f27500b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:12.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.390+0000 7f2754d9a700 1 -- 172.21.15.45:0/79575270 >> v1:172.21.15.152:6789/0 conn(0x7f27500d2320 legacy=0x7f27500cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:12.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.390+0000 7f2754d9a700 1 -- 172.21.15.45:0/79575270 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27500d1300 con 0x7f2750161340 2023-11-28T12:09:12.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.390+0000 7f275559b700 1 --2- 172.21.15.45:0/79575270 >> v2:172.21.15.152:3300/0 conn(0x7f275015c9b0 0x7f27500b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:09:12.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.390+0000 7f2754d9a700 1 --2- 172.21.15.45:0/79575270 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2750161340 0x7f27500d1de0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2740009840 tx=0x7f2740009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a1393dc2e548a0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:12.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.391+0000 7f2747fff700 1 -- 172.21.15.45:0/79575270 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2740011830 con 0x7f2750161340 2023-11-28T12:09:12.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.391+0000 7f2747fff700 1 -- 172.21.15.45:0/79575270 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2740011990 con 0x7f2750161340 2023-11-28T12:09:12.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.391+0000 7f2747fff700 1 -- 172.21.15.45:0/79575270 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2740011d20 con 0x7f2750161340 2023-11-28T12:09:12.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.391+0000 7f27577ff700 1 -- 172.21.15.45:0/79575270 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2750161340 msgr2=0x7f27500d1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:12.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.391+0000 7f27577ff700 1 --2- 172.21.15.45:0/79575270 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2750161340 0x7f27500d1de0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2740009840 tx=0x7f2740009b50 comp rx=0 tx=0).stop 2023-11-28T12:09:12.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.391+0000 7f27577ff700 1 -- 172.21.15.45:0/79575270 shutdown_connections 2023-11-28T12:09:12.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.391+0000 7f27577ff700 1 --2- 172.21.15.45:0/79575270 >> v2:172.21.15.152:3300/0 conn(0x7f275015c9b0 0x7f27500b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:12.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.391+0000 7f27577ff700 1 --2- 172.21.15.45:0/79575270 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2750161340 0x7f27500d1de0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:12.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.391+0000 7f27577ff700 1 -- 172.21.15.45:0/79575270 >> 172.21.15.45:0/79575270 conn(0x7f2750072600 msgr2=0x7f27500cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:12.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.391+0000 7f27577ff700 1 -- 172.21.15.45:0/79575270 shutdown_connections 2023-11-28T12:09:12.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.392+0000 7f27577ff700 1 -- 172.21.15.45:0/79575270 wait complete. 2023-11-28T12:09:12.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.393+0000 7f27577ff700 1 Processor -- start 2023-11-28T12:09:12.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.393+0000 7f27577ff700 1 -- start start 2023-11-28T12:09:12.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.394+0000 7f27577ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f27500d2320 0x7f275014de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:12.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.394+0000 7f27577ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f275015c9b0 0x7f275015d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:12.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.394+0000 7f27577ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2750161340 0x7f275014d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:12.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.394+0000 7f27577ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f275015e210 con 0x7f2750161340 2023-11-28T12:09:12.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.394+0000 7f27577ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f275015e4f0 con 0x7f275015c9b0 2023-11-28T12:09:12.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.394+0000 7f27577ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f275015e7d0 con 0x7f27500d2320 2023-11-28T12:09:12.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.395+0000 7f275559b700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f27500d2320 0x7f275014de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:12.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.395+0000 7f2755d9c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2750161340 0x7f275014d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:12.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.395+0000 7f275559b700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f27500d2320 0x7f275014de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.45:46898/0 (socket says 172.21.15.45:46898) 2023-11-28T12:09:12.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.395+0000 7f275559b700 1 -- 172.21.15.45:0/558970239 learned_addr learned my addr 172.21.15.45:0/558970239 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:09:12.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.395+0000 7f2754d9a700 1 --2- 172.21.15.45:0/558970239 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f275015c9b0 0x7f275015d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:12.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.395+0000 7f2755d9c700 1 -- 172.21.15.45:0/558970239 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f27500d2320 msgr2=0x7f275014de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:12.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.395+0000 7f2755d9c700 1 --2- 172.21.15.45:0/558970239 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f27500d2320 0x7f275014de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:12.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.395+0000 7f2755d9c700 1 -- 172.21.15.45:0/558970239 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f275015c9b0 msgr2=0x7f275015d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:12.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.395+0000 7f2755d9c700 1 --2- 172.21.15.45:0/558970239 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f275015c9b0 0x7f275015d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:12.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.395+0000 7f2755d9c700 1 -- 172.21.15.45:0/558970239 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f274c0094a0 con 0x7f2750161340 2023-11-28T12:09:12.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.395+0000 7f275559b700 1 --2- 172.21.15.45:0/558970239 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f27500d2320 0x7f275014de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:09:12.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.395+0000 7f2755d9c700 1 --2- 172.21.15.45:0/558970239 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2750161340 0x7f275014d6b0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f274800caa0 tx=0x7f274800cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:12.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.396+0000 7f2745ffb700 1 -- 172.21.15.45:0/558970239 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f274800a9e0 con 0x7f2750161340 2023-11-28T12:09:12.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.396+0000 7f2745ffb700 1 -- 172.21.15.45:0/558970239 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f274800ab40 con 0x7f2750161340 2023-11-28T12:09:12.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.396+0000 7f27577ff700 1 -- 172.21.15.45:0/558970239 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27400094a0 con 0x7f2750161340 2023-11-28T12:09:12.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.396+0000 7f2745ffb700 1 -- 172.21.15.45:0/558970239 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2748012400 con 0x7f2750161340 2023-11-28T12:09:12.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.396+0000 7f27577ff700 1 -- 172.21.15.45:0/558970239 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27500b5130 con 0x7f2750161340 2023-11-28T12:09:12.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.398+0000 7f2745ffb700 1 -- 172.21.15.45:0/558970239 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f2748019030 con 0x7f2750161340 2023-11-28T12:09:12.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.399+0000 7f2745ffb700 1 --2- 172.21.15.45:0/558970239 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f27340682f0 0x7f273406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:12.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.399+0000 7f2745ffb700 1 -- 172.21.15.45:0/558970239 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2748085640 con 0x7f2750161340 2023-11-28T12:09:12.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.399+0000 7f275559b700 1 --2- 172.21.15.45:0/558970239 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f27340682f0 0x7f273406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:12.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.400+0000 7f275559b700 1 --2- 172.21.15.45:0/558970239 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f27340682f0 0x7f273406a7a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f27500ce3a0 tx=0x7f274c009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:12.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.401+0000 7f276b046b80 1 Processor -- start 2023-11-28T12:09:12.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.401+0000 7f276b046b80 1 -- start start 2023-11-28T12:09:12.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.402+0000 7f276b046b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d603393fa0 0x55d60334da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:12.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.402+0000 7f276b046b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d60338ab10 0x55d603394370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:12.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.402+0000 7f276b046b80 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55d6033766b0 0x55d60334ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:12.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.402+0000 7f276b046b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6032cbe30 con 0x55d60338ab10 2023-11-28T12:09:12.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.402+0000 7f276b046b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d603238190 con 0x55d603393fa0 2023-11-28T12:09:12.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.402+0000 7f276b046b80 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d6032a6e00 con 0x55d6033766b0 2023-11-28T12:09:12.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.402+0000 7f2754d9a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d60338ab10 0x55d603394370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:12.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.402+0000 7f2754d9a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d60338ab10 0x55d603394370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40270/0 (socket says 172.21.15.45:40270) 2023-11-28T12:09:12.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.402+0000 7f2754d9a700 1 -- 172.21.15.45:0/4051608603 learned_addr learned my addr 172.21.15.45:0/4051608603 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:09:12.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.402+0000 7f275559b700 1 --2- 172.21.15.45:0/4051608603 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d603393fa0 0x55d60334da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:12.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.402+0000 7f2755d9c700 1 --2- 172.21.15.45:0/4051608603 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55d6033766b0 0x55d60334ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:12.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.402+0000 7f2754d9a700 1 -- 172.21.15.45:0/4051608603 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55d6033766b0 msgr2=0x55d60334ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:12.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.402+0000 7f2754d9a700 1 --2- 172.21.15.45:0/4051608603 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55d6033766b0 0x55d60334ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:12.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.402+0000 7f2754d9a700 1 -- 172.21.15.45:0/4051608603 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d603393fa0 msgr2=0x55d60334da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:12.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.402+0000 7f2754d9a700 1 --2- 172.21.15.45:0/4051608603 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d603393fa0 0x55d60334da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:12.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.402+0000 7f2754d9a700 1 -- 172.21.15.45:0/4051608603 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d6030947e0 con 0x55d60338ab10 2023-11-28T12:09:12.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.402+0000 7f275559b700 1 --2- 172.21.15.45:0/4051608603 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d603393fa0 0x55d60334da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:09:12.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.402+0000 7f2755d9c700 1 --2- 172.21.15.45:0/4051608603 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55d6033766b0 0x55d60334ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:09:12.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.403+0000 7f2754d9a700 1 --2- 172.21.15.45:0/4051608603 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d60338ab10 0x55d603394370 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f27500b5660 tx=0x7f2740010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1585c30daba2a35 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:12.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.403+0000 7f273affd700 1 -- 172.21.15.45:0/4051608603 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2740020070 con 0x55d60338ab10 2023-11-28T12:09:12.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.403+0000 7f273affd700 1 -- 172.21.15.45:0/4051608603 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2740011730 con 0x55d60338ab10 2023-11-28T12:09:12.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.403+0000 7f273affd700 1 -- 172.21.15.45:0/4051608603 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2740011d20 con 0x55d60338ab10 2023-11-28T12:09:12.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.403+0000 7f276b046b80 1 -- 172.21.15.45:0/4051608603 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d60338ab10 msgr2=0x55d603394370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:12.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.403+0000 7f276b046b80 1 --2- 172.21.15.45:0/4051608603 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d60338ab10 0x55d603394370 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f27500b5660 tx=0x7f2740010000 comp rx=0 tx=0).stop 2023-11-28T12:09:12.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.404+0000 7f276b046b80 1 -- 172.21.15.45:0/4051608603 shutdown_connections 2023-11-28T12:09:12.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.404+0000 7f276b046b80 1 --2- 172.21.15.45:0/4051608603 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d603393fa0 0x55d60334da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:12.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.404+0000 7f276b046b80 1 --2- 172.21.15.45:0/4051608603 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55d6033766b0 0x55d60334ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:12.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.404+0000 7f276b046b80 1 --2- 172.21.15.45:0/4051608603 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d60338ab10 0x55d603394370 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:12.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.404+0000 7f276b046b80 1 -- 172.21.15.45:0/4051608603 >> 172.21.15.45:0/4051608603 conn(0x55d603343d70 msgr2=0x55d60334cf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:12.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.404+0000 7f276b046b80 1 -- 172.21.15.45:0/4051608603 shutdown_connections 2023-11-28T12:09:12.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.404+0000 7f276b046b80 1 -- 172.21.15.45:0/4051608603 wait complete. 2023-11-28T12:09:12.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.404+0000 7f276b046b80 1 -- start start 2023-11-28T12:09:12.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.405+0000 7f276b046b80 1 Processor -- start 2023-11-28T12:09:12.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.406+0000 7f276b046b80 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55d6033766b0 0x55d603371970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:12.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.406+0000 7f276b046b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d60338ab10 0x55d6033a6680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:12.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.406+0000 7f276b046b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d603393fa0 0x55d6033a6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:12.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.406+0000 7f276b046b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6032a0170 con 0x55d603393fa0 2023-11-28T12:09:12.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.406+0000 7f276b046b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6030953e0 con 0x55d60338ab10 2023-11-28T12:09:12.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.406+0000 7f276b046b80 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d603238390 con 0x55d6033766b0 2023-11-28T12:09:12.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.406+0000 7f276b046b80 10 client.0 _ll_register_callbacks cb 0x55d60323e450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T12:09:12.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.406+0000 7f2755d9c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d603393fa0 0x55d6033a6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:12.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.406+0000 7f2755d9c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d603393fa0 0x55d6033a6bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40274/0 (socket says 172.21.15.45:40274) 2023-11-28T12:09:12.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.406+0000 7f2755d9c700 1 -- 172.21.15.45:0/3315507822 learned_addr learned my addr 172.21.15.45:0/3315507822 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:09:12.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.406+0000 7f275559b700 1 --2- 172.21.15.45:0/3315507822 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55d6033766b0 0x55d603371970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:12.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.406+0000 7f2755d9c700 1 -- 172.21.15.45:0/3315507822 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55d6033766b0 msgr2=0x55d603371970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:12.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.406+0000 7f2755d9c700 1 --2- 172.21.15.45:0/3315507822 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55d6033766b0 0x55d603371970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:12.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.406+0000 7f2755d9c700 1 -- 172.21.15.45:0/3315507822 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d60338ab10 msgr2=0x55d6033a6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:12.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.406+0000 7f2754d9a700 1 --2- 172.21.15.45:0/3315507822 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d60338ab10 0x55d6033a6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:12.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.406+0000 7f2755d9c700 1 --2- 172.21.15.45:0/3315507822 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d60338ab10 0x55d6033a6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:12.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.406+0000 7f2755d9c700 1 -- 172.21.15.45:0/3315507822 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27500d1300 con 0x55d603393fa0 2023-11-28T12:09:12.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.406+0000 7f2754d9a700 1 --2- 172.21.15.45:0/3315507822 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d60338ab10 0x55d6033a6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:09:12.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.407+0000 7f2755d9c700 1 --2- 172.21.15.45:0/3315507822 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d603393fa0 0x55d6033a6bc0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f2748083c10 tx=0x7f27480552f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec57f8a1d5ac8965 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:12.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.407+0000 7f272ffff700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-11-28T12:09:12.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.407+0000 7f272ffff700 1 -- 172.21.15.45:0/3315507822 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2748054a80 con 0x55d603393fa0 2023-11-28T12:09:12.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.407+0000 7f272ffff700 1 -- 172.21.15.45:0/3315507822 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(47..47 src has 1..47) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2748054be0 con 0x55d603393fa0 2023-11-28T12:09:12.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.407+0000 7f276b046b80 1 -- 172.21.15.45:0/3315507822 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d6032a4080 con 0x55d603393fa0 2023-11-28T12:09:12.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.407+0000 7f272ffff700 1 -- 172.21.15.45:0/3315507822 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2748054da0 con 0x55d603393fa0 2023-11-28T12:09:12.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.407+0000 7f276b046b80 10 client.5781 fetch_fsmap learned FSMap version 24 2023-11-28T12:09:12.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.407+0000 7f276b046b80 1 -- 172.21.15.45:0/3315507822 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x55d6031810f0 con 0x55d603393fa0 2023-11-28T12:09:12.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.407+0000 7f272ffff700 1 -- 172.21.15.45:0/3315507822 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2748061080 con 0x55d603393fa0 2023-11-28T12:09:12.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.407+0000 7f272ffff700 1 -- 172.21.15.45:0/3315507822 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 24) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f2748085070 con 0x55d603393fa0 2023-11-28T12:09:12.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.407+0000 7f276b046b80 10 client.5781 fetch_fsmap finished waiting for FSMap version 24 2023-11-28T12:09:12.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.407+0000 7f276b046b80 10 client.5781 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-11-28T12:09:12.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.407+0000 7f276b046b80 20 client.5781 populate_metadata read hostname 'smithi045' 2023-11-28T12:09:12.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.407+0000 7f276b046b80 1 --2- 172.21.15.45:0/3315507822 >> [v2:172.21.15.45:6833/1281816633,v1:172.21.15.45:6835/1281816633] conn(0x55d603370a80 0x55d60336fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:12.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.407+0000 7f276b046b80 4 client.5781 mds_command: new command op to 5550 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-28T12:09:12.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.407+0000 7f276b046b80 1 -- 172.21.15.45:0/3315507822 --> [v2:172.21.15.45:6833/1281816633,v1:172.21.15.45:6835/1281816633] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d6030eff40 con 0x55d603370a80 2023-11-28T12:09:12.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.408+0000 7f275559b700 1 --2- 172.21.15.45:0/3315507822 >> [v2:172.21.15.45:6833/1281816633,v1:172.21.15.45:6835/1281816633] conn(0x55d603370a80 0x55d60336fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:12.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.408+0000 7f275559b700 1 --2- 172.21.15.45:0/3315507822 >> [v2:172.21.15.45:6833/1281816633,v1:172.21.15.45:6835/1281816633] conn(0x55d603370a80 0x55d60336fee0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12554832f0994c33 server_cookie=30806292378de940 in_seq=0 out_seq=0 2023-11-28T12:09:12.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.408+0000 7f272ffff700 10 client.5781 ms_handle_connect on v2:172.21.15.45:6833/1281816633 2023-11-28T12:09:12.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.409+0000 7f272ffff700 1 -- 172.21.15.45:0/3315507822 <== mds.0 v2:172.21.15.45:6833/1281816633 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x55d6030eff40 con 0x55d603370a80 2023-11-28T12:09:12.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.409+0000 7f272ffff700 10 client.5781 handle_command_reply: tid=0 2023-11-28T12:09:12.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.409+0000 7f276b046b80 1 client.5781 shutdown 2023-11-28T12:09:12.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.409+0000 7f276b046b80 1 -- 172.21.15.45:0/3315507822 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d603393fa0 msgr2=0x55d6033a6bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:12.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.409+0000 7f276b046b80 1 --2- 172.21.15.45:0/3315507822 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d603393fa0 0x55d6033a6bc0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f2748083c10 tx=0x7f27480552f0 comp rx=0 tx=0).stop 2023-11-28T12:09:12.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.409+0000 7f276b046b80 1 -- 172.21.15.45:0/3315507822 shutdown_connections 2023-11-28T12:09:12.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.409+0000 7f276b046b80 1 --2- 172.21.15.45:0/3315507822 >> [v2:172.21.15.45:6833/1281816633,v1:172.21.15.45:6835/1281816633] conn(0x55d603370a80 0x55d60336fee0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:12.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.409+0000 7f276b046b80 1 --2- 172.21.15.45:0/3315507822 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d603393fa0 0x55d6033a6bc0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:12.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.409+0000 7f276b046b80 1 --2- 172.21.15.45:0/3315507822 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55d6033766b0 0x55d603371970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:12.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.409+0000 7f272ffff700 0 client.5781 ms_handle_reset on v2:172.21.15.45:6833/1281816633 2023-11-28T12:09:12.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.409+0000 7f276b046b80 1 --2- 172.21.15.45:0/3315507822 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d60338ab10 0x55d6033a6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:12.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.409+0000 7f276b046b80 1 -- 172.21.15.45:0/3315507822 >> 172.21.15.45:0/3315507822 conn(0x55d603343d70 msgr2=0x55d603375d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:12.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.409+0000 7f276b046b80 1 -- 172.21.15.45:0/3315507822 shutdown_connections 2023-11-28T12:09:12.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.409+0000 7f276b046b80 1 -- 172.21.15.45:0/3315507822 wait complete. 2023-11-28T12:09:12.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.410+0000 7f276b046b80 20 client.5781 trim_cache size 0 max 16384 2023-11-28T12:09:12.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.427+0000 7f276b046b80 1 Processor -- start 2023-11-28T12:09:12.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.427+0000 7f276b046b80 1 -- start start 2023-11-28T12:09:12.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.428+0000 7f276b046b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d6033766b0 0x55d603392cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:12.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.428+0000 7f276b046b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d60338ab10 0x55d603393210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:12.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.428+0000 7f276b046b80 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55d603393fa0 0x55d60334c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:12.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.428+0000 7f276b046b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d603379fd0 con 0x55d6033766b0 2023-11-28T12:09:12.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.428+0000 7f276b046b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d603349d50 con 0x55d60338ab10 2023-11-28T12:09:12.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.428+0000 7f276b046b80 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d6033b68f0 con 0x55d603393fa0 2023-11-28T12:09:12.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.428+0000 7f275559b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d6033766b0 0x55d603392cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:12.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.428+0000 7f275559b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d6033766b0 0x55d603392cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40290/0 (socket says 172.21.15.45:40290) 2023-11-28T12:09:12.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.428+0000 7f275559b700 1 -- 172.21.15.45:0/3754624001 learned_addr learned my addr 172.21.15.45:0/3754624001 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:09:12.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.428+0000 7f275559b700 1 -- 172.21.15.45:0/3754624001 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55d603393fa0 msgr2=0x55d60334c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:12.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.428+0000 7f275559b700 1 --2- 172.21.15.45:0/3754624001 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55d603393fa0 0x55d60334c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:12.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.428+0000 7f275559b700 1 -- 172.21.15.45:0/3754624001 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d60338ab10 msgr2=0x55d603393210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:12.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.428+0000 7f275559b700 1 --2- 172.21.15.45:0/3754624001 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d60338ab10 0x55d603393210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:12.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.428+0000 7f275559b700 1 -- 172.21.15.45:0/3754624001 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d603267330 con 0x55d6033766b0 2023-11-28T12:09:12.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.428+0000 7f275559b700 1 --2- 172.21.15.45:0/3754624001 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d6033766b0 0x55d603392cd0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f274c011c50 tx=0x7f274c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4954e65a246bf5d5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:12.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.429+0000 7f273b7fe700 1 -- 172.21.15.45:0/3754624001 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f274c01c040 con 0x55d6033766b0 2023-11-28T12:09:12.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.429+0000 7f273b7fe700 1 -- 172.21.15.45:0/3754624001 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f274c011ec0 con 0x55d6033766b0 2023-11-28T12:09:12.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.429+0000 7f273b7fe700 1 -- 172.21.15.45:0/3754624001 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f274c02a3e0 con 0x55d6033766b0 2023-11-28T12:09:12.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.429+0000 7f276b046b80 1 -- 172.21.15.45:0/3754624001 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d6033766b0 msgr2=0x55d603392cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:12.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.429+0000 7f276b046b80 1 --2- 172.21.15.45:0/3754624001 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d6033766b0 0x55d603392cd0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f274c011c50 tx=0x7f274c018000 comp rx=0 tx=0).stop 2023-11-28T12:09:12.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.429+0000 7f276b046b80 1 -- 172.21.15.45:0/3754624001 shutdown_connections 2023-11-28T12:09:12.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.429+0000 7f276b046b80 1 --2- 172.21.15.45:0/3754624001 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55d603393fa0 0x55d60334c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:12.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.429+0000 7f276b046b80 1 --2- 172.21.15.45:0/3754624001 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d6033766b0 0x55d603392cd0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:12.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.429+0000 7f276b046b80 1 --2- 172.21.15.45:0/3754624001 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d60338ab10 0x55d603393210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:12.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.429+0000 7f276b046b80 1 -- 172.21.15.45:0/3754624001 >> 172.21.15.45:0/3754624001 conn(0x55d603343d70 msgr2=0x55d60334a840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:12.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.429+0000 7f276b046b80 1 -- 172.21.15.45:0/3754624001 shutdown_connections 2023-11-28T12:09:12.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.429+0000 7f276b046b80 1 -- 172.21.15.45:0/3754624001 wait complete. 2023-11-28T12:09:12.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.430+0000 7f276b046b80 1 -- start start 2023-11-28T12:09:12.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.430+0000 7f276b046b80 1 Processor -- start 2023-11-28T12:09:12.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.431+0000 7f276b046b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d6033766b0 0x55d603390210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:12.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.431+0000 7f276b046b80 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55d60338ab10 0x55d60338a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:12.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.431+0000 7f276b046b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d603393fa0 0x55d60336ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:12.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.431+0000 7f276b046b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d60338fdf0 con 0x55d603393fa0 2023-11-28T12:09:12.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.431+0000 7f276b046b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d60336d9b0 con 0x55d6033766b0 2023-11-28T12:09:12.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.431+0000 7f276b046b80 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d60336f770 con 0x55d60338ab10 2023-11-28T12:09:12.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.431+0000 7f276b046b80 10 client.0 _ll_register_callbacks cb 0x55d60323e450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T12:09:12.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.432+0000 7f2755d9c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d603393fa0 0x55d60336ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:12.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.432+0000 7f2755d9c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d603393fa0 0x55d60336ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40302/0 (socket says 172.21.15.45:40302) 2023-11-28T12:09:12.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.432+0000 7f2755d9c700 1 -- 172.21.15.45:0/1471351038 learned_addr learned my addr 172.21.15.45:0/1471351038 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:09:12.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.432+0000 7f275559b700 1 --2- 172.21.15.45:0/1471351038 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d6033766b0 0x55d603390210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:12.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.432+0000 7f2754d9a700 1 --2- 172.21.15.45:0/1471351038 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55d60338ab10 0x55d60338a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:12.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.432+0000 7f2755d9c700 1 -- 172.21.15.45:0/1471351038 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55d60338ab10 msgr2=0x55d60338a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:12.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.432+0000 7f2755d9c700 1 --2- 172.21.15.45:0/1471351038 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55d60338ab10 0x55d60338a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:12.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.432+0000 7f2755d9c700 1 -- 172.21.15.45:0/1471351038 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d6033766b0 msgr2=0x55d603390210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:12.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.432+0000 7f2755d9c700 1 --2- 172.21.15.45:0/1471351038 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d6033766b0 0x55d603390210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:12.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.432+0000 7f2755d9c700 1 -- 172.21.15.45:0/1471351038 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f274c0042c0 con 0x55d603393fa0 2023-11-28T12:09:12.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.432+0000 7f2755d9c700 1 --2- 172.21.15.45:0/1471351038 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d603393fa0 0x55d60336ce10 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f2748053e70 tx=0x7f27480014d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a4e1c97b33678fc server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:12.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.432+0000 7f272ffff700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-11-28T12:09:12.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.432+0000 7f272ffff700 1 -- 172.21.15.45:0/1471351038 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2748001ac0 con 0x55d603393fa0 2023-11-28T12:09:12.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.432+0000 7f272ffff700 1 -- 172.21.15.45:0/1471351038 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(47..47 src has 1..47) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2748054a80 con 0x55d603393fa0 2023-11-28T12:09:12.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.432+0000 7f276b046b80 1 -- 172.21.15.45:0/1471351038 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d603125090 con 0x55d603393fa0 2023-11-28T12:09:12.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.433+0000 7f272ffff700 1 -- 172.21.15.45:0/1471351038 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2748085280 con 0x55d603393fa0 2023-11-28T12:09:12.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.433+0000 7f276b046b80 10 client.5787 fetch_fsmap learned FSMap version 24 2023-11-28T12:09:12.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.433+0000 7f276b046b80 1 -- 172.21.15.45:0/1471351038 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x55d6030f5220 con 0x55d603393fa0 2023-11-28T12:09:12.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.433+0000 7f272ffff700 1 -- 172.21.15.45:0/1471351038 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d603125090 con 0x55d603393fa0 2023-11-28T12:09:12.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.433+0000 7f272ffff700 1 -- 172.21.15.45:0/1471351038 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 24) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f2748067070 con 0x55d603393fa0 2023-11-28T12:09:12.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.433+0000 7f276b046b80 10 client.5787 fetch_fsmap finished waiting for FSMap version 24 2023-11-28T12:09:12.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.433+0000 7f276b046b80 10 client.5787 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-11-28T12:09:12.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.433+0000 7f276b046b80 20 client.5787 populate_metadata read hostname 'smithi045' 2023-11-28T12:09:12.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.433+0000 7f276b046b80 1 --2- 172.21.15.45:0/1471351038 >> [v2:172.21.15.45:6833/1281816633,v1:172.21.15.45:6835/1281816633] conn(0x55d6033ea320 0x55d6033ad160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:12.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.433+0000 7f276b046b80 4 client.5787 mds_command: new command op to 5550 tid=0[{"prefix": "scrub status"}] 2023-11-28T12:09:12.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.433+0000 7f276b046b80 1 -- 172.21.15.45:0/1471351038 --> [v2:172.21.15.45:6833/1281816633,v1:172.21.15.45:6835/1281816633] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55d6031e2410 con 0x55d6033ea320 2023-11-28T12:09:12.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.433+0000 7f275559b700 1 --2- 172.21.15.45:0/1471351038 >> [v2:172.21.15.45:6833/1281816633,v1:172.21.15.45:6835/1281816633] conn(0x55d6033ea320 0x55d6033ad160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:12.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.434+0000 7f272ffff700 10 client.5787 ms_handle_connect on v2:172.21.15.45:6833/1281816633 2023-11-28T12:09:12.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.434+0000 7f275559b700 1 --2- 172.21.15.45:0/1471351038 >> [v2:172.21.15.45:6833/1281816633,v1:172.21.15.45:6835/1281816633] conn(0x55d6033ea320 0x55d6033ad160 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9cb4cf91527de0d8 server_cookie=9ac935903494d796 in_seq=0 out_seq=0 2023-11-28T12:09:12.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.434+0000 7f272ffff700 1 -- 172.21.15.45:0/1471351038 <== mds.0 v2:172.21.15.45:6833/1281816633 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55d6031e2410 con 0x55d6033ea320 2023-11-28T12:09:12.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.434+0000 7f272ffff700 10 client.5787 handle_command_reply: tid=0 2023-11-28T12:09:12.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.434+0000 7f276b046b80 1 client.5787 shutdown 2023-11-28T12:09:12.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.434+0000 7f276b046b80 1 -- 172.21.15.45:0/1471351038 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d603393fa0 msgr2=0x55d60336ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:12.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.434+0000 7f276b046b80 1 --2- 172.21.15.45:0/1471351038 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d603393fa0 0x55d60336ce10 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f2748053e70 tx=0x7f27480014d0 comp rx=0 tx=0).stop 2023-11-28T12:09:12.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.434+0000 7f276b046b80 1 -- 172.21.15.45:0/1471351038 shutdown_connections 2023-11-28T12:09:12.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.434+0000 7f276b046b80 1 --2- 172.21.15.45:0/1471351038 >> [v2:172.21.15.45:6833/1281816633,v1:172.21.15.45:6835/1281816633] conn(0x55d6033ea320 0x55d6033ad160 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:12.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.434+0000 7f276b046b80 1 --2- 172.21.15.45:0/1471351038 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55d6033766b0 0x55d603390210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:12.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.434+0000 7f276b046b80 1 --2- 172.21.15.45:0/1471351038 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d603393fa0 0x55d60336ce10 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:12.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.434+0000 7f276b046b80 1 --2- 172.21.15.45:0/1471351038 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55d60338ab10 0x55d60338a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:12.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.434+0000 7f272ffff700 0 client.5787 ms_handle_reset on v2:172.21.15.45:6833/1281816633 2023-11-28T12:09:12.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.434+0000 7f276b046b80 1 -- 172.21.15.45:0/1471351038 >> 172.21.15.45:0/1471351038 conn(0x55d603343d70 msgr2=0x55d603392c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:12.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.434+0000 7f276b046b80 1 -- 172.21.15.45:0/1471351038 shutdown_connections 2023-11-28T12:09:12.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.434+0000 7f276b046b80 1 -- 172.21.15.45:0/1471351038 wait complete. 2023-11-28T12:09:12.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.435+0000 7f276b046b80 20 client.5787 trim_cache size 0 max 16384 2023-11-28T12:09:12.441 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-11-28T12:09:12.441 INFO:teuthology.orchestra.run.smithi045.stdout: "status": "no active scrubs running", 2023-11-28T12:09:12.441 INFO:teuthology.orchestra.run.smithi045.stdout: "scrubs": {} 2023-11-28T12:09:12.441 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-11-28T12:09:12.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.435+0000 7f27577ff700 1 -- 172.21.15.45:0/558970239 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f27340682f0 msgr2=0x7f273406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:12.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.435+0000 7f27577ff700 1 --2- 172.21.15.45:0/558970239 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f27340682f0 0x7f273406a7a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f27500ce3a0 tx=0x7f274c009210 comp rx=0 tx=0).stop 2023-11-28T12:09:12.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.435+0000 7f27577ff700 1 -- 172.21.15.45:0/558970239 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2750161340 msgr2=0x7f275014d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:12.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.435+0000 7f27577ff700 1 --2- 172.21.15.45:0/558970239 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2750161340 0x7f275014d6b0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f274800caa0 tx=0x7f274800cdb0 comp rx=0 tx=0).stop 2023-11-28T12:09:12.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.435+0000 7f27577ff700 1 -- 172.21.15.45:0/558970239 shutdown_connections 2023-11-28T12:09:12.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.435+0000 7f27577ff700 1 --2- 172.21.15.45:0/558970239 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f27340682f0 0x7f273406a7a0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:12.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.435+0000 7f27577ff700 1 --2- 172.21.15.45:0/558970239 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2750161340 0x7f275014d6b0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:12.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.435+0000 7f27577ff700 1 --2- 172.21.15.45:0/558970239 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f27500d2320 0x7f275014de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:12.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.435+0000 7f27577ff700 1 --2- 172.21.15.45:0/558970239 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f275015c9b0 0x7f275015d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:12.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.435+0000 7f27577ff700 1 -- 172.21.15.45:0/558970239 >> 172.21.15.45:0/558970239 conn(0x7f2750072600 msgr2=0x7f275015cd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:12.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.435+0000 7f27577ff700 1 -- 172.21.15.45:0/558970239 shutdown_connections 2023-11-28T12:09:12.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.435+0000 7f27577ff700 1 -- 172.21.15.45:0/558970239 wait complete. 2023-11-28T12:09:12.455 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-11-28T12:09:12.556 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T12:09:12.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.758+0000 7fd2f2fff700 1 Processor -- start 2023-11-28T12:09:12.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.759+0000 7fd2f2fff700 1 -- start start 2023-11-28T12:09:12.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.760+0000 7fd2f2fff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fd2ec15c9b0 0x7fd2ec0b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:12.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.760+0000 7fd2f2fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd2ec0cd7c0 0x7fd2ec0cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:12.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.760+0000 7fd2f2fff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2ec0d1950 con 0x7fd2ec161340 2023-11-28T12:09:12.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.760+0000 7fd2f2fff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2ec0b5800 con 0x7fd2ec0cd7c0 2023-11-28T12:09:12.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.760+0000 7fd2f2fff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2ec0ce140 con 0x7fd2ec15c9b0 2023-11-28T12:09:12.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.760+0000 7fd2f159c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd2ec0cd7c0 0x7fd2ec0cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:12.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.760+0000 7fd2ebfff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fd2ec161340 0x7fd2ec0d1de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:53546/0 (socket says 172.21.15.45:53546) 2023-11-28T12:09:12.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.760+0000 7fd2ebfff700 1 -- 172.21.15.45:0/2599417704 learned_addr learned my addr 172.21.15.45:0/2599417704 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:09:12.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.760+0000 7fd2f0d9b700 1 --2- 172.21.15.45:0/2599417704 >> v2:172.21.15.152:3300/0 conn(0x7fd2ec15c9b0 0x7fd2ec0b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:12.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.760+0000 7fd2f159c700 1 -- 172.21.15.45:0/2599417704 >> v2:172.21.15.152:3300/0 conn(0x7fd2ec15c9b0 msgr2=0x7fd2ec0b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:12.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.760+0000 7fd2f159c700 1 --2- 172.21.15.45:0/2599417704 >> v2:172.21.15.152:3300/0 conn(0x7fd2ec15c9b0 0x7fd2ec0b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:12.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.761+0000 7fd2f159c700 1 -- 172.21.15.45:0/2599417704 >> v1:172.21.15.45:6789/0 conn(0x7fd2ec161340 legacy=0x7fd2ec0d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:12.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.761+0000 7fd2f159c700 1 -- 172.21.15.45:0/2599417704 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2ec0d24f0 con 0x7fd2ec0cd7c0 2023-11-28T12:09:12.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.761+0000 7fd2eb7fe700 1 -- 172.21.15.45:0/2599417704 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3265285040 0 0) 0x7fd2ec0d1950 con 0x7fd2ec161340 2023-11-28T12:09:12.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.761+0000 7fd2f0d9b700 1 --2- 172.21.15.45:0/2599417704 >> v2:172.21.15.152:3300/0 conn(0x7fd2ec15c9b0 0x7fd2ec0b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:09:12.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.761+0000 7fd2f159c700 1 --2- 172.21.15.45:0/2599417704 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2ec0cd7c0 0x7fd2ec0cdc00 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec067460 tx=0x7fd2e400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2675f19af8bad28e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:12.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.761+0000 7fd2eb7fe700 1 -- 172.21.15.45:0/2599417704 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e400e070 con 0x7fd2ec0cd7c0 2023-11-28T12:09:12.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.761+0000 7fd2eb7fe700 1 -- 172.21.15.45:0/2599417704 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2e400bbd0 con 0x7fd2ec0cd7c0 2023-11-28T12:09:12.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.761+0000 7fd2eb7fe700 1 -- 172.21.15.45:0/2599417704 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e4012430 con 0x7fd2ec0cd7c0 2023-11-28T12:09:12.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.762+0000 7fd2f2fff700 1 -- 172.21.15.45:0/2599417704 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2ec0cd7c0 msgr2=0x7fd2ec0cdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:12.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.762+0000 7fd2f2fff700 1 --2- 172.21.15.45:0/2599417704 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2ec0cd7c0 0x7fd2ec0cdc00 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec067460 tx=0x7fd2e400b330 comp rx=0 tx=0).stop 2023-11-28T12:09:12.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.762+0000 7fd2f2fff700 1 -- 172.21.15.45:0/2599417704 shutdown_connections 2023-11-28T12:09:12.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.762+0000 7fd2f2fff700 1 --2- 172.21.15.45:0/2599417704 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2ec0cd7c0 0x7fd2ec0cdc00 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:12.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.762+0000 7fd2f2fff700 1 --2- 172.21.15.45:0/2599417704 >> v2:172.21.15.152:3300/0 conn(0x7fd2ec15c9b0 0x7fd2ec0b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:12.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.762+0000 7fd2f2fff700 1 -- 172.21.15.45:0/2599417704 >> 172.21.15.45:0/2599417704 conn(0x7fd2ec072600 msgr2=0x7fd2ec0cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:12.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.762+0000 7fd2f2fff700 1 -- 172.21.15.45:0/2599417704 shutdown_connections 2023-11-28T12:09:12.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.762+0000 7fd2f2fff700 1 -- 172.21.15.45:0/2599417704 wait complete. 2023-11-28T12:09:12.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.763+0000 7fd2f2fff700 1 Processor -- start 2023-11-28T12:09:12.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.764+0000 7fd2f2fff700 1 -- start start 2023-11-28T12:09:12.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.765+0000 7fd2f2fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd2ec0cd7c0 0x7fd2ec157850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:12.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.765+0000 7fd2f2fff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd2ec15c9b0 0x7fd2ec15e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:12.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.765+0000 7fd2f2fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2ec161340 0x7fd2ec15e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:12.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.765+0000 7fd2f2fff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2ec0cb410 con 0x7fd2ec161340 2023-11-28T12:09:12.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.765+0000 7fd2f2fff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2ec0ca800 con 0x7fd2ec0cd7c0 2023-11-28T12:09:12.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.765+0000 7fd2f2fff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2ec0caae0 con 0x7fd2ec15c9b0 2023-11-28T12:09:12.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.765+0000 7fd2f159c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2ec161340 0x7fd2ec15e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:12.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.765+0000 7fd2f159c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2ec161340 0x7fd2ec15e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40316/0 (socket says 172.21.15.45:40316) 2023-11-28T12:09:12.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.765+0000 7fd2f159c700 1 -- 172.21.15.45:0/417342600 learned_addr learned my addr 172.21.15.45:0/417342600 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:09:12.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.765+0000 7fd2f159c700 1 -- 172.21.15.45:0/417342600 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd2ec15c9b0 msgr2=0x7fd2ec15e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:12.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.765+0000 7fd2ebfff700 1 --2- 172.21.15.45:0/417342600 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd2ec15c9b0 0x7fd2ec15e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:12.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.765+0000 7fd2f0d9b700 1 --2- 172.21.15.45:0/417342600 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd2ec0cd7c0 0x7fd2ec157850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:12.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.765+0000 7fd2f159c700 1 --2- 172.21.15.45:0/417342600 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd2ec15c9b0 0x7fd2ec15e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:12.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.765+0000 7fd2f159c700 1 -- 172.21.15.45:0/417342600 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd2ec0cd7c0 msgr2=0x7fd2ec157850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:12.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.765+0000 7fd2f159c700 1 --2- 172.21.15.45:0/417342600 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd2ec0cd7c0 0x7fd2ec157850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:12.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.765+0000 7fd2f159c700 1 -- 172.21.15.45:0/417342600 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2e4009a70 con 0x7fd2ec161340 2023-11-28T12:09:12.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.765+0000 7fd2ebfff700 1 --2- 172.21.15.45:0/417342600 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd2ec15c9b0 0x7fd2ec15e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:09:12.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.765+0000 7fd2f0d9b700 1 --2- 172.21.15.45:0/417342600 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd2ec0cd7c0 0x7fd2ec157850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:09:12.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.766+0000 7fd2f159c700 1 --2- 172.21.15.45:0/417342600 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2ec161340 0x7fd2ec15e760 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec0675d0 tx=0x7fd2e4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:12.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.766+0000 7fd2e97fa700 1 -- 172.21.15.45:0/417342600 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e4012430 con 0x7fd2ec161340 2023-11-28T12:09:12.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.766+0000 7fd2e97fa700 1 -- 172.21.15.45:0/417342600 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2e4020070 con 0x7fd2ec161340 2023-11-28T12:09:12.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.766+0000 7fd2f2fff700 1 -- 172.21.15.45:0/417342600 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2ec0d1300 con 0x7fd2ec161340 2023-11-28T12:09:12.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.766+0000 7fd2e97fa700 1 -- 172.21.15.45:0/417342600 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e4004280 con 0x7fd2ec161340 2023-11-28T12:09:12.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.766+0000 7fd2f2fff700 1 -- 172.21.15.45:0/417342600 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2ec0b5520 con 0x7fd2ec161340 2023-11-28T12:09:12.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.767+0000 7fd2f2fff700 1 -- 172.21.15.45:0/417342600 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2ec0d15e0 con 0x7fd2ec161340 2023-11-28T12:09:12.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.768+0000 7fd2e97fa700 1 -- 172.21.15.45:0/417342600 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fd2e40043e0 con 0x7fd2ec161340 2023-11-28T12:09:12.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.769+0000 7fd2e97fa700 1 --2- 172.21.15.45:0/417342600 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fd2d00682f0 0x7fd2d006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:12.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.769+0000 7fd2e97fa700 1 -- 172.21.15.45:0/417342600 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd2e4022070 con 0x7fd2ec161340 2023-11-28T12:09:12.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.770+0000 7fd2f0d9b700 1 --2- 172.21.15.45:0/417342600 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fd2d00682f0 0x7fd2d006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:12.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.770+0000 7fd2f0d9b700 1 --2- 172.21.15.45:0/417342600 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fd2d00682f0 0x7fd2d006a7a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fd2e0008910 tx=0x7fd2e0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:12.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:12.773+0000 7fd2e97fa700 1 -- 172.21.15.45:0/417342600 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fd2e40b95e0 con 0x7fd2ec161340 2023-11-28T12:09:13.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:13.019+0000 7fd2f2fff700 1 -- 172.21.15.45:0/417342600 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd2ec0ceb10 con 0x7fd2ec161340 2023-11-28T12:09:13.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:13.019+0000 7fd2e97fa700 1 -- 172.21.15.45:0/417342600 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4651 (secure 0 0 0) 0x7fd2e4054990 con 0x7fd2ec161340 2023-11-28T12:09:13.021 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:09:13.021 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5398,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6836/2532875180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":2532875180},{"type":"v1","addr":"172.21.15.152:6836","nonce":2532875180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5404,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/930111917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6835","nonce":930111917},{"type":"v1","addr":"172.21.15.152:6837","nonce":930111917}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5547,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/1974473454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1974473454},{"type":"v1","addr":"172.21.15.45:6834","nonce":1974473454}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T12:08:31.391914+0000","modified":"2023-11-28T12:08:34.873102+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5550},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5550":{"gid":5550,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/1281816633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":1281816633},{"type":"v1","addr":"172.21.15.45:6835","nonce":1281816633}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-28T12:09:13.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:13.022+0000 7fd2f2fff700 1 -- 172.21.15.45:0/417342600 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fd2d00682f0 msgr2=0x7fd2d006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:13.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:13.022+0000 7fd2f2fff700 1 --2- 172.21.15.45:0/417342600 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fd2d00682f0 0x7fd2d006a7a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fd2e0008910 tx=0x7fd2e0008040 comp rx=0 tx=0).stop 2023-11-28T12:09:13.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:13.022+0000 7fd2f2fff700 1 -- 172.21.15.45:0/417342600 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2ec161340 msgr2=0x7fd2ec15e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:13.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:13.022+0000 7fd2f2fff700 1 --2- 172.21.15.45:0/417342600 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2ec161340 0x7fd2ec15e760 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec0675d0 tx=0x7fd2e4004ad0 comp rx=0 tx=0).stop 2023-11-28T12:09:13.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:13.022+0000 7fd2f2fff700 1 -- 172.21.15.45:0/417342600 shutdown_connections 2023-11-28T12:09:13.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:13.022+0000 7fd2f2fff700 1 --2- 172.21.15.45:0/417342600 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fd2d00682f0 0x7fd2d006a7a0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:13.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:13.022+0000 7fd2f2fff700 1 --2- 172.21.15.45:0/417342600 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd2ec0cd7c0 0x7fd2ec157850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:13.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:13.022+0000 7fd2f2fff700 1 --2- 172.21.15.45:0/417342600 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2ec161340 0x7fd2ec15e760 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:13.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:13.022+0000 7fd2f2fff700 1 --2- 172.21.15.45:0/417342600 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd2ec15c9b0 0x7fd2ec15e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:13.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:13.022+0000 7fd2f2fff700 1 -- 172.21.15.45:0/417342600 >> 172.21.15.45:0/417342600 conn(0x7fd2ec072600 msgr2=0x7fd2ec15bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:13.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:13.022+0000 7fd2f2fff700 1 -- 172.21.15.45:0/417342600 shutdown_connections 2023-11-28T12:09:13.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:13.022+0000 7fd2f2fff700 1 -- 172.21.15.45:0/417342600 wait complete. 2023-11-28T12:09:13.025 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 24 2023-11-28T12:09:13.042 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2023-11-28T12:09:13.274 INFO:teuthology.orchestra.run.smithi045.stdout:{"message":"","return_code":0} 2023-11-28T12:09:13.274 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2023-11-28T12:09:13.274 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2023-11-28T12:09:13.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:13.361+0000 7fee262620c0 1 Processor -- start 2023-11-28T12:09:13.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:13.362+0000 7fee262620c0 1 -- start start 2023-11-28T12:09:13.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:13.362+0000 7fee262620c0 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55706a363510 0x55706a43d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:13.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:13.362+0000 7fee262620c0 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55706a3645b0 0x55706a3aaf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:13.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:13.362+0000 7fee262620c0 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55706a3a9c00 0x55706a3af100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:13.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:13.362+0000 7fee262620c0 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55706a29efe0 con 0x55706a3a9c00 2023-11-28T12:09:13.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:13.362+0000 7fee262620c0 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55706a3905c0 con 0x55706a3645b0 2023-11-28T12:09:13.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:13.362+0000 7fee262620c0 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x55706a42cb00 con 0x55706a363510 2023-11-28T12:09:13.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:13.363+0000 7fee1839c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55706a3a9c00 0x55706a3af100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:13.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:13.363+0000 7fee1839c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55706a3a9c00 0x55706a3af100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40326/0 (socket says 172.21.15.45:40326) 2023-11-28T12:09:13.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:13.363+0000 7fee1839c700 1 -- 172.21.15.45:0/965720084 learned_addr learned my addr 172.21.15.45:0/965720084 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:09:13.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:13.363+0000 7fee17b9b700 1 --2- 172.21.15.45:0/965720084 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55706a363510 0x55706a43d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:13.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:13.363+0000 7fee1739a700 1 --2- 172.21.15.45:0/965720084 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55706a3645b0 0x55706a3aaf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:13.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:13.363+0000 7fee1839c700 1 -- 172.21.15.45:0/965720084 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55706a363510 msgr2=0x55706a43d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:13.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:13.363+0000 7fee1839c700 1 --2- 172.21.15.45:0/965720084 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55706a363510 0x55706a43d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:13.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:13.363+0000 7fee1839c700 1 -- 172.21.15.45:0/965720084 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55706a3645b0 msgr2=0x55706a3aaf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:13.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:13.363+0000 7fee1839c700 1 --2- 172.21.15.45:0/965720084 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55706a3645b0 0x55706a3aaf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:13.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:13.363+0000 7fee1839c700 1 -- 172.21.15.45:0/965720084 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee08005d20 con 0x55706a3a9c00 2023-11-28T12:09:13.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:13.363+0000 7fee1839c700 1 --2- 172.21.15.45:0/965720084 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55706a3a9c00 0x55706a3af100 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fee100015c0 tx=0x7fee100018d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18fcb8618b678bf7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:13.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:13.364+0000 7fee16398700 1 -- 172.21.15.45:0/965720084 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee100062f0 con 0x55706a3a9c00 2023-11-28T12:09:13.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:13.364+0000 7fee16398700 1 -- 172.21.15.45:0/965720084 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee10003450 con 0x55706a3a9c00 2023-11-28T12:09:13.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:13.364+0000 7fee16398700 1 -- 172.21.15.45:0/965720084 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee10003800 con 0x55706a3a9c00 2023-11-28T12:09:13.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:13.364+0000 7fee262620c0 1 -- 172.21.15.45:0/965720084 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55706a3a9c00 msgr2=0x55706a3af100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:13.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:13.364+0000 7fee262620c0 1 --2- 172.21.15.45:0/965720084 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55706a3a9c00 0x55706a3af100 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fee100015c0 tx=0x7fee100018d0 comp rx=0 tx=0).stop 2023-11-28T12:09:13.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:13.364+0000 7fee262620c0 1 -- 172.21.15.45:0/965720084 shutdown_connections 2023-11-28T12:09:13.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:13.364+0000 7fee262620c0 1 --2- 172.21.15.45:0/965720084 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55706a3a9c00 0x55706a3af100 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:13.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:13.364+0000 7fee262620c0 1 --2- 172.21.15.45:0/965720084 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55706a363510 0x55706a43d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:13.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:13.364+0000 7fee262620c0 1 --2- 172.21.15.45:0/965720084 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55706a3645b0 0x55706a3aaf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:13.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:13.364+0000 7fee262620c0 1 -- 172.21.15.45:0/965720084 >> 172.21.15.45:0/965720084 conn(0x55706a3b0890 msgr2=0x55706a3aa080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:13.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:13.364+0000 7fee262620c0 1 -- 172.21.15.45:0/965720084 shutdown_connections 2023-11-28T12:09:13.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:13.364+0000 7fee262620c0 1 -- 172.21.15.45:0/965720084 wait complete. 2023-11-28T12:09:13.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:13.365+0000 7fee262620c0 1 Processor -- start 2023-11-28T12:09:13.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:13.365+0000 7fee262620c0 1 -- start start 2023-11-28T12:09:13.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:13.366+0000 7fee262620c0 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55706a363510 0x55706a4d2330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:13.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:13.366+0000 7fee262620c0 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55706a3645b0 0x55706a42b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:13.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:13.366+0000 7fee262620c0 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55706a3a9c00 0x55706a3abd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:13.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:13.366+0000 7fee262620c0 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55706a3ab6a0 con 0x55706a3645b0 2023-11-28T12:09:13.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:13.366+0000 7fee262620c0 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55706a3aae90 con 0x55706a363510 2023-11-28T12:09:13.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:13.366+0000 7fee262620c0 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x55706a4d2870 con 0x55706a3a9c00 2023-11-28T12:09:13.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:13.367+0000 7fee1739a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55706a3645b0 0x55706a42b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:13.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:13.367+0000 7fee17b9b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55706a363510 0x55706a4d2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:13.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:13.367+0000 7fee1739a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55706a3645b0 0x55706a42b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40342/0 (socket says 172.21.15.45:40342) 2023-11-28T12:09:13.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:13.367+0000 7fee1739a700 1 -- 172.21.15.45:0/1476185898 learned_addr learned my addr 172.21.15.45:0/1476185898 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:09:13.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:13.367+0000 7fee1839c700 1 --2- 172.21.15.45:0/1476185898 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55706a3a9c00 0x55706a3abd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:13.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:13.367+0000 7fee1739a700 1 -- 172.21.15.45:0/1476185898 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55706a3a9c00 msgr2=0x55706a3abd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:13.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:13.367+0000 7fee1739a700 1 --2- 172.21.15.45:0/1476185898 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55706a3a9c00 0x55706a3abd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:13.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:13.367+0000 7fee1739a700 1 -- 172.21.15.45:0/1476185898 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55706a363510 msgr2=0x55706a4d2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:13.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:13.367+0000 7fee1739a700 1 --2- 172.21.15.45:0/1476185898 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55706a363510 0x55706a4d2330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:13.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:13.367+0000 7fee1739a700 1 -- 172.21.15.45:0/1476185898 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee10006d90 con 0x55706a3645b0 2023-11-28T12:09:13.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:13.367+0000 7fee1739a700 1 --2- 172.21.15.45:0/1476185898 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55706a3645b0 0x55706a42b3f0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fee0c007e50 tx=0x7fee0c006660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:13.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:13.367+0000 7fee15396700 1 -- 172.21.15.45:0/1476185898 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee0c0133f0 con 0x55706a3645b0 2023-11-28T12:09:13.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:13.367+0000 7fee15396700 1 -- 172.21.15.45:0/1476185898 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee0c00f040 con 0x55706a3645b0 2023-11-28T12:09:13.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:13.367+0000 7fee262620c0 1 -- 172.21.15.45:0/1476185898 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55706a2b7120 con 0x55706a3645b0 2023-11-28T12:09:13.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:13.368+0000 7fee15396700 1 -- 172.21.15.45:0/1476185898 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee0c013770 con 0x55706a3645b0 2023-11-28T12:09:13.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:13.368+0000 7fee262620c0 1 -- 172.21.15.45:0/1476185898 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55706a2aa830 con 0x55706a3645b0 2023-11-28T12:09:13.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:13.369+0000 7fee15396700 1 -- 172.21.15.45:0/1476185898 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fee0c01a030 con 0x55706a3645b0 2023-11-28T12:09:13.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:13.370+0000 7fee15396700 1 --2- 172.21.15.45:0/1476185898 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fee04066c10 0x7fee040690c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:13.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:13.370+0000 7fee15396700 1 -- 172.21.15.45:0/1476185898 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fee0c0839a0 con 0x55706a3645b0 2023-11-28T12:09:13.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:13.371+0000 7fee262620c0 1 --2- 172.21.15.45:0/1476185898 >> [v2:172.21.15.45:6800/115842,v1:172.21.15.45:6801/115842] conn(0x55706a42bba0 0x55706a4c82e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:13.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:13.371+0000 7fee262620c0 1 -- 172.21.15.45:0/1476185898 --> [v2:172.21.15.45:6800/115842,v1:172.21.15.45:6801/115842] -- osd_op(unknown.0.0:1 8.7 8:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47) v8 -- 0x55706a42c490 con 0x55706a42bba0 2023-11-28T12:09:13.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:13.371+0000 7fee17b9b700 1 --2- 172.21.15.45:0/1476185898 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fee04066c10 0x7fee040690c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:13.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:13.371+0000 7fee1839c700 1 --2- 172.21.15.45:0/1476185898 >> [v2:172.21.15.45:6800/115842,v1:172.21.15.45:6801/115842] conn(0x55706a42bba0 0x55706a4c82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:13.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:13.371+0000 7fee1839c700 1 --2- 172.21.15.45:0/1476185898 >> [v2:172.21.15.45:6800/115842,v1:172.21.15.45:6801/115842] conn(0x55706a42bba0 0x55706a4c82e0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:13.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:13.371+0000 7fee17b9b700 1 --2- 172.21.15.45:0/1476185898 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fee04066c10 0x7fee040690c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fee0800c010 tx=0x7fee0800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:13.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:13.372+0000 7fee1839c700 1 -- 172.21.15.45:0/1476185898 <== osd.1 v2:172.21.15.45:6800/115842 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (95) out=95b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+95 (crc 0 0 0) 0x7fee100035c0 con 0x55706a42bba0 2023-11-28T12:09:13.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:13.372+0000 7fee262620c0 1 -- 172.21.15.45:0/1476185898 >> [v2:172.21.15.45:6800/115842,v1:172.21.15.45:6801/115842] conn(0x55706a42bba0 msgr2=0x55706a4c82e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:13.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:13.372+0000 7fee262620c0 1 --2- 172.21.15.45:0/1476185898 >> [v2:172.21.15.45:6800/115842,v1:172.21.15.45:6801/115842] conn(0x55706a42bba0 0x55706a4c82e0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:13.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:13.372+0000 7fee262620c0 1 -- 172.21.15.45:0/1476185898 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fee04066c10 msgr2=0x7fee040690c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:13.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:13.372+0000 7fee262620c0 1 --2- 172.21.15.45:0/1476185898 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fee04066c10 0x7fee040690c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fee0800c010 tx=0x7fee0800f000 comp rx=0 tx=0).stop 2023-11-28T12:09:13.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:13.372+0000 7fee262620c0 1 -- 172.21.15.45:0/1476185898 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55706a3645b0 msgr2=0x55706a42b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:13.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:13.372+0000 7fee262620c0 1 --2- 172.21.15.45:0/1476185898 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55706a3645b0 0x55706a42b3f0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fee0c007e50 tx=0x7fee0c006660 comp rx=0 tx=0).stop 2023-11-28T12:09:13.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:13.372+0000 7fee1839c700 1 -- 172.21.15.45:0/1476185898 reap_dead start 2023-11-28T12:09:13.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:13.372+0000 7fee262620c0 1 -- 172.21.15.45:0/1476185898 shutdown_connections 2023-11-28T12:09:13.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:13.372+0000 7fee262620c0 1 -- 172.21.15.45:0/1476185898 >> 172.21.15.45:0/1476185898 conn(0x55706a3b0890 msgr2=0x55706a3aa080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:13.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:13.372+0000 7fee262620c0 1 -- 172.21.15.45:0/1476185898 shutdown_connections 2023-11-28T12:09:13.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:13.372+0000 7fee262620c0 1 -- 172.21.15.45:0/1476185898 wait complete. 2023-11-28T12:09:13.377 INFO:teuthology.orchestra.run.smithi045.stdout:Yalphaparent_a 2023-11-28T12:09:13.377 DEBUG:teuthology.orchestra.run.smithi045:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2023-11-28T12:09:13.488 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-11-28T12:09:13.489 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511627777, 2023-11-28T12:09:13.489 INFO:teuthology.orchestra.run.smithi045.stdout: "ancestors": [ 2023-11-28T12:09:13.489 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T12:09:13.489 INFO:teuthology.orchestra.run.smithi045.stdout: "dirino": 1099511627776, 2023-11-28T12:09:13.489 INFO:teuthology.orchestra.run.smithi045.stdout: "dname": "alpha", 2023-11-28T12:09:13.489 INFO:teuthology.orchestra.run.smithi045.stdout: "version": 4 2023-11-28T12:09:13.489 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T12:09:13.489 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T12:09:13.489 INFO:teuthology.orchestra.run.smithi045.stdout: "dirino": 1, 2023-11-28T12:09:13.489 INFO:teuthology.orchestra.run.smithi045.stdout: "dname": "parent_a", 2023-11-28T12:09:13.489 INFO:teuthology.orchestra.run.smithi045.stdout: "version": 7 2023-11-28T12:09:13.489 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T12:09:13.490 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-11-28T12:09:13.490 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 8, 2023-11-28T12:09:13.490 INFO:teuthology.orchestra.run.smithi045.stdout: "old_pools": [] 2023-11-28T12:09:13.490 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-11-28T12:09:13.490 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:09:13.495 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-28T12:09:13.495 DEBUG:teuthology.orchestra.run.smithi045:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T12:09:13.583 DEBUG:teuthology.orchestra.run.smithi152:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T12:09:13.687 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-28T12:09:13.687 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T12:09:13.687 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T12:09:13.734 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T12:09:13.735 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T12:09:13.822 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T12:09:14.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.064+0000 7fc7e45ff700 1 Processor -- start 2023-11-28T12:09:14.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.065+0000 7fc7e45ff700 1 -- start start 2023-11-28T12:09:14.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.066+0000 7fc7e45ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fc7dc161340 0x7fc7dc0d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:14.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.066+0000 7fc7e45ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc7dc0d2320 0x7fc7dc0cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:14.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.066+0000 7fc7e45ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7dc0d1950 con 0x7fc7dc15c9b0 2023-11-28T12:09:14.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.066+0000 7fc7e45ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7dc0b5800 con 0x7fc7dc161340 2023-11-28T12:09:14.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.066+0000 7fc7e45ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7dc0b5300 con 0x7fc7dc0d2320 2023-11-28T12:09:14.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.066+0000 7fc7e239b700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fc7dc15c9b0 0x7fc7dc0b4bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:53554/0 (socket says 172.21.15.45:53554) 2023-11-28T12:09:14.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.066+0000 7fc7e239b700 1 -- 172.21.15.45:0/1580388495 learned_addr learned my addr 172.21.15.45:0/1580388495 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:09:14.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.066+0000 7fc7e1b9a700 1 --2- 172.21.15.45:0/1580388495 >> v2:172.21.15.152:3300/0 conn(0x7fc7dc161340 0x7fc7dc0d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:14.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.066+0000 7fc7e2b9c700 1 --2- 172.21.15.45:0/1580388495 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc7dc0d2320 0x7fc7dc0cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:14.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.066+0000 7fc7e1399700 1 -- 172.21.15.45:0/1580388495 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1170563522 0 0) 0x7fc7dc0d1950 con 0x7fc7dc15c9b0 2023-11-28T12:09:14.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.066+0000 7fc7e1399700 1 -- 172.21.15.45:0/1580388495 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7c80035b0 con 0x7fc7dc15c9b0 2023-11-28T12:09:14.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.067+0000 7fc7e1399700 1 -- 172.21.15.45:0/1580388495 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 408449463 0 0) 0x7fc7c80035b0 con 0x7fc7dc15c9b0 2023-11-28T12:09:14.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.067+0000 7fc7e1399700 1 -- 172.21.15.45:0/1580388495 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc7dc0d2320 msgr2=0x7fc7dc0cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:14.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.067+0000 7fc7e1399700 1 --2- 172.21.15.45:0/1580388495 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc7dc0d2320 0x7fc7dc0cd7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:14.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.067+0000 7fc7e1399700 1 -- 172.21.15.45:0/1580388495 >> v2:172.21.15.152:3300/0 conn(0x7fc7dc161340 msgr2=0x7fc7dc0d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:14.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.067+0000 7fc7e1399700 1 --2- 172.21.15.45:0/1580388495 >> v2:172.21.15.152:3300/0 conn(0x7fc7dc161340 0x7fc7dc0d1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:14.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.067+0000 7fc7e1399700 1 -- 172.21.15.45:0/1580388495 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7dc0b5520 con 0x7fc7dc15c9b0 2023-11-28T12:09:14.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.067+0000 7fc7e1399700 1 -- 172.21.15.45:0/1580388495 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3460218165 0 0) 0x7fc7d8001670 con 0x7fc7dc15c9b0 2023-11-28T12:09:14.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.067+0000 7fc7e1399700 1 -- 172.21.15.45:0/1580388495 >> v1:172.21.15.45:6789/0 conn(0x7fc7dc15c9b0 legacy=0x7fc7dc0b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:14.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.067+0000 7fc7e1399700 1 --2- 172.21.15.45:0/1580388495 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7c8003a00 0x7fc7c8003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:14.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.067+0000 7fc7e1399700 1 --2- 172.21.15.45:0/1580388495 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc7c8004850 0x7fc7c8004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:14.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.067+0000 7fc7e1399700 1 --2- 172.21.15.45:0/1580388495 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc7dc0d2320 0x7fc7c8005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:14.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.067+0000 7fc7e1399700 1 -- 172.21.15.45:0/1580388495 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7dc0b5800 con 0x7fc7c8004850 2023-11-28T12:09:14.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.067+0000 7fc7e1399700 1 -- 172.21.15.45:0/1580388495 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7dc0b5300 con 0x7fc7c8003a00 2023-11-28T12:09:14.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.067+0000 7fc7e1399700 1 -- 172.21.15.45:0/1580388495 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c800ba60 con 0x7fc7dc0d2320 2023-11-28T12:09:14.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.067+0000 7fc7e1b9a700 1 --2- 172.21.15.45:0/1580388495 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc7c8004850 0x7fc7c8004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:14.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.067+0000 7fc7e239b700 1 --2- 172.21.15.45:0/1580388495 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7c8003a00 0x7fc7c8003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:14.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.067+0000 7fc7e2b9c700 1 --2- 172.21.15.45:0/1580388495 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc7dc0d2320 0x7fc7c8005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:14.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.068+0000 7fc7e1b9a700 1 -- 172.21.15.45:0/1580388495 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc7dc0d2320 msgr2=0x7fc7c8005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:14.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.068+0000 7fc7e1b9a700 1 --2- 172.21.15.45:0/1580388495 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc7dc0d2320 0x7fc7c8005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:14.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.068+0000 7fc7e1b9a700 1 -- 172.21.15.45:0/1580388495 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7c8003a00 msgr2=0x7fc7c8003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:14.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.068+0000 7fc7e1b9a700 1 --2- 172.21.15.45:0/1580388495 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7c8003a00 0x7fc7c8003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:14.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.068+0000 7fc7e1b9a700 1 -- 172.21.15.45:0/1580388495 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7c80035b0 con 0x7fc7c8004850 2023-11-28T12:09:14.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.068+0000 7fc7e2b9c700 1 --2- 172.21.15.45:0/1580388495 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc7dc0d2320 0x7fc7c8005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:09:14.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.068+0000 7fc7e1b9a700 1 --2- 172.21.15.45:0/1580388495 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc7c8004850 0x7fc7c8004cc0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc009b90 tx=0x7fc7c8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f73639f8355bc1b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:14.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.068+0000 7fc7e1399700 1 -- 172.21.15.45:0/1580388495 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7cc00e6c0 con 0x7fc7c8004850 2023-11-28T12:09:14.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.068+0000 7fc7e1399700 1 -- 172.21.15.45:0/1580388495 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7cc00e820 con 0x7fc7c8004850 2023-11-28T12:09:14.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.068+0000 7fc7e1399700 1 -- 172.21.15.45:0/1580388495 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7cc00eb90 con 0x7fc7c8004850 2023-11-28T12:09:14.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.069+0000 7fc7e45ff700 1 -- 172.21.15.45:0/1580388495 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc7c8004850 msgr2=0x7fc7c8004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:14.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.069+0000 7fc7e45ff700 1 --2- 172.21.15.45:0/1580388495 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc7c8004850 0x7fc7c8004cc0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc009b90 tx=0x7fc7c8005880 comp rx=0 tx=0).stop 2023-11-28T12:09:14.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.069+0000 7fc7e2b9c700 1 -- 172.21.15.45:0/1580388495 reap_dead start 2023-11-28T12:09:14.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.069+0000 7fc7e45ff700 1 -- 172.21.15.45:0/1580388495 shutdown_connections 2023-11-28T12:09:14.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.069+0000 7fc7e45ff700 1 -- 172.21.15.45:0/1580388495 >> 172.21.15.45:0/1580388495 conn(0x7fc7dc072600 msgr2=0x7fc7dc0cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:14.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.069+0000 7fc7e45ff700 1 -- 172.21.15.45:0/1580388495 shutdown_connections 2023-11-28T12:09:14.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.069+0000 7fc7e45ff700 1 -- 172.21.15.45:0/1580388495 wait complete. 2023-11-28T12:09:14.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.071+0000 7fc7e45ff700 1 Processor -- start 2023-11-28T12:09:14.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.071+0000 7fc7e45ff700 1 -- start start 2023-11-28T12:09:14.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.072+0000 7fc7e45ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc7c8004850 0x7fc7dc1574b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:14.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.072+0000 7fc7e45ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7dc0c8970 0x7fc7dc0c8de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:14.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.072+0000 7fc7e45ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc7dc0cb250 0x7fc7dc0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:14.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.072+0000 7fc7e45ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7dc0c9320 con 0x7fc7dc0cb250 2023-11-28T12:09:14.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.072+0000 7fc7e45ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7dc157e40 con 0x7fc7dc0c8970 2023-11-28T12:09:14.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.072+0000 7fc7e45ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7dc1e6e30 con 0x7fc7c8004850 2023-11-28T12:09:14.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.072+0000 7fc7e2b9c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc7dc0cb250 0x7fc7dc0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:14.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.072+0000 7fc7e2b9c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc7dc0cb250 0x7fc7dc0cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40364/0 (socket says 172.21.15.45:40364) 2023-11-28T12:09:14.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.072+0000 7fc7e2b9c700 1 -- 172.21.15.45:0/3562001489 learned_addr learned my addr 172.21.15.45:0/3562001489 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:09:14.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.072+0000 7fc7e1b9a700 1 --2- 172.21.15.45:0/3562001489 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7dc0c8970 0x7fc7dc0c8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:14.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.072+0000 7fc7e239b700 1 --2- 172.21.15.45:0/3562001489 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc7c8004850 0x7fc7dc1574b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:14.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.072+0000 7fc7e2b9c700 1 -- 172.21.15.45:0/3562001489 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc7c8004850 msgr2=0x7fc7dc1574b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:14.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.072+0000 7fc7e2b9c700 1 --2- 172.21.15.45:0/3562001489 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc7c8004850 0x7fc7dc1574b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:14.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.072+0000 7fc7e2b9c700 1 -- 172.21.15.45:0/3562001489 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7dc0c8970 msgr2=0x7fc7dc0c8de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:14.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.072+0000 7fc7e2b9c700 1 --2- 172.21.15.45:0/3562001489 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7dc0c8970 0x7fc7dc0c8de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:14.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.072+0000 7fc7e2b9c700 1 -- 172.21.15.45:0/3562001489 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7dc0d15e0 con 0x7fc7dc0cb250 2023-11-28T12:09:14.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.072+0000 7fc7e239b700 1 --2- 172.21.15.45:0/3562001489 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc7c8004850 0x7fc7dc1574b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:09:14.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.073+0000 7fc7e2b9c700 1 --2- 172.21.15.45:0/3562001489 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc7dc0cb250 0x7fc7dc0cb6f0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc08bfd0 tx=0x7fc7d40104a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:14.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.073+0000 7fc7d2ffd700 1 -- 172.21.15.45:0/3562001489 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d401b070 con 0x7fc7dc0cb250 2023-11-28T12:09:14.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.073+0000 7fc7d2ffd700 1 -- 172.21.15.45:0/3562001489 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7d400f040 con 0x7fc7dc0cb250 2023-11-28T12:09:14.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.073+0000 7fc7e45ff700 1 -- 172.21.15.45:0/3562001489 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7dc0d1300 con 0x7fc7dc0cb250 2023-11-28T12:09:14.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.073+0000 7fc7d2ffd700 1 -- 172.21.15.45:0/3562001489 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d400e050 con 0x7fc7dc0cb250 2023-11-28T12:09:14.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.073+0000 7fc7e45ff700 1 -- 172.21.15.45:0/3562001489 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7dc15cd80 con 0x7fc7dc0cb250 2023-11-28T12:09:14.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.074+0000 7fc7e45ff700 1 -- 172.21.15.45:0/3562001489 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7dc0745c0 con 0x7fc7dc0cb250 2023-11-28T12:09:14.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.075+0000 7fc7d2ffd700 1 -- 172.21.15.45:0/3562001489 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fc7d4003a20 con 0x7fc7dc0cb250 2023-11-28T12:09:14.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.076+0000 7fc7d2ffd700 1 --2- 172.21.15.45:0/3562001489 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fc7c00682f0 0x7fc7c006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:14.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.076+0000 7fc7d2ffd700 1 -- 172.21.15.45:0/3562001489 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc7d4086090 con 0x7fc7dc0cb250 2023-11-28T12:09:14.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.076+0000 7fc7e239b700 1 --2- 172.21.15.45:0/3562001489 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fc7c00682f0 0x7fc7c006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:14.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.077+0000 7fc7e239b700 1 --2- 172.21.15.45:0/3562001489 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fc7c00682f0 0x7fc7c006a7a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc7d8000fb0 tx=0x7fc7d8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:14.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.080+0000 7fc7d2ffd700 1 -- 172.21.15.45:0/3562001489 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fc7d40528f0 con 0x7fc7dc0cb250 2023-11-28T12:09:14.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.280+0000 7fc7e45ff700 1 -- 172.21.15.45:0/3562001489 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc7dc0ce230 con 0x7fc7dc0cb250 2023-11-28T12:09:14.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.281+0000 7fc7d2ffd700 1 -- 172.21.15.45:0/3562001489 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+17921 (secure 0 0 0) 0x7fc7d4003cb0 con 0x7fc7dc0cb250 2023-11-28T12:09:14.283 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:09:14.283 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":47,"fsid":"bd7c37f1-f7c6-4778-b845-52cf2aa6e366","created":"2023-11-28T12:06:09.045075+0000","modified":"2023-11-28T12:08:32.394210+0000","last_up_change":"2023-11-28T12:06:21.282227+0000","last_in_change":"2023-11-28T12:06:12.560924+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T12:06:21.807108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T12:06:22.491009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-11-28T12:08:29.364957+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-11-28T12:08:30.374968+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d0cdd8a-87fd-4f2c-91bd-47bdfa661905","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":115843},{"type":"v1","addr":"172.21.15.45:6808","nonce":115843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":115843},{"type":"v1","addr":"172.21.15.45:6811","nonce":115843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":115843},{"type":"v1","addr":"172.21.15.45:6815","nonce":115843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":115843},{"type":"v1","addr":"172.21.15.45:6813","nonce":115843}]},"public_addr":"172.21.15.45:6808/115843","cluster_addr":"172.21.15.45:6811/115843","heartbeat_back_addr":"172.21.15.45:6815/115843","heartbeat_front_addr":"172.21.15.45:6813/115843","state":["exists","up"]},{"osd":1,"uuid":"c5de4ebd-9ec5-40b3-9caa-9b706fab4c76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":115842},{"type":"v1","addr":"172.21.15.45:6801","nonce":115842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":115842},{"type":"v1","addr":"172.21.15.45:6803","nonce":115842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6807","nonce":115842},{"type":"v1","addr":"172.21.15.45:6809","nonce":115842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":115842},{"type":"v1","addr":"172.21.15.45:6805","nonce":115842}]},"public_addr":"172.21.15.45:6801/115842","cluster_addr":"172.21.15.45:6803/115842","heartbeat_back_addr":"172.21.15.45:6809/115842","heartbeat_front_addr":"172.21.15.45:6805/115842","state":["exists","up"]},{"osd":2,"uuid":"9f4b36b2-65d2-40e7-9fe6-a2991afa71c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":115850},{"type":"v1","addr":"172.21.15.45:6819","nonce":115850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":115850},{"type":"v1","addr":"172.21.15.45:6823","nonce":115850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":115850},{"type":"v1","addr":"172.21.15.45:6831","nonce":115850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":115850},{"type":"v1","addr":"172.21.15.45:6828","nonce":115850}]},"public_addr":"172.21.15.45:6819/115850","cluster_addr":"172.21.15.45:6823/115850","heartbeat_back_addr":"172.21.15.45:6831/115850","heartbeat_front_addr":"172.21.15.45:6828/115850","state":["exists","up"]},{"osd":3,"uuid":"6fe7ef05-4e0d-426c-bf94-44b51d4d550b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":115848},{"type":"v1","addr":"172.21.15.45:6818","nonce":115848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":115848},{"type":"v1","addr":"172.21.15.45:6822","nonce":115848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6827","nonce":115848},{"type":"v1","addr":"172.21.15.45:6829","nonce":115848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":115848},{"type":"v1","addr":"172.21.15.45:6825","nonce":115848}]},"public_addr":"172.21.15.45:6818/115848","cluster_addr":"172.21.15.45:6822/115848","heartbeat_back_addr":"172.21.15.45:6829/115848","heartbeat_front_addr":"172.21.15.45:6825/115848","state":["exists","up"]},{"osd":4,"uuid":"fa403c08-d8a1-4a3a-8384-cb465c1a654c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":116092},{"type":"v1","addr":"172.21.15.152:6801","nonce":116092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":116092},{"type":"v1","addr":"172.21.15.152:6803","nonce":116092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":116092},{"type":"v1","addr":"172.21.15.152:6807","nonce":116092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":116092},{"type":"v1","addr":"172.21.15.152:6805","nonce":116092}]},"public_addr":"172.21.15.152:6801/116092","cluster_addr":"172.21.15.152:6803/116092","heartbeat_back_addr":"172.21.15.152:6807/116092","heartbeat_front_addr":"172.21.15.152:6805/116092","state":["exists","up"]},{"osd":5,"uuid":"399fc450-39fa-43a6-bf80-0b8bcb41bd95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6815","nonce":116093},{"type":"v1","addr":"172.21.15.152:6817","nonce":116093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":116093},{"type":"v1","addr":"172.21.15.152:6819","nonce":116093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":116093},{"type":"v1","addr":"172.21.15.152:6823","nonce":116093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":116093},{"type":"v1","addr":"172.21.15.152:6821","nonce":116093}]},"public_addr":"172.21.15.152:6817/116093","cluster_addr":"172.21.15.152:6819/116093","heartbeat_back_addr":"172.21.15.152:6823/116093","heartbeat_front_addr":"172.21.15.152:6821/116093","state":["exists","up"]},{"osd":6,"uuid":"e59a4017-2d23-4627-836b-e25b2d3ddaaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":116094},{"type":"v1","addr":"172.21.15.152:6809","nonce":116094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":116094},{"type":"v1","addr":"172.21.15.152:6811","nonce":116094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":116094},{"type":"v1","addr":"172.21.15.152:6816","nonce":116094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":116094},{"type":"v1","addr":"172.21.15.152:6813","nonce":116094}]},"public_addr":"172.21.15.152:6809/116094","cluster_addr":"172.21.15.152:6811/116094","heartbeat_back_addr":"172.21.15.152:6816/116094","heartbeat_front_addr":"172.21.15.152:6813/116094","state":["exists","up"]},{"osd":7,"uuid":"8d7f9d4b-bf08-4670-8591-388c0f012a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":116097},{"type":"v1","addr":"172.21.15.152:6825","nonce":116097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":116097},{"type":"v1","addr":"172.21.15.152:6827","nonce":116097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":116097},{"type":"v1","addr":"172.21.15.152:6831","nonce":116097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":116097},{"type":"v1","addr":"172.21.15.152:6829","nonce":116097}]},"public_addr":"172.21.15.152:6825/116097","cluster_addr":"172.21.15.152:6827/116097","heartbeat_back_addr":"172.21.15.152:6831/116097","heartbeat_front_addr":"172.21.15.152:6829/116097","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.937710+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.865423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.159434+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.913090+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.131647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.966255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.972583+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.177209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T12:09:14.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.284+0000 7fc7e45ff700 1 -- 172.21.15.45:0/3562001489 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fc7c00682f0 msgr2=0x7fc7c006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:14.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.284+0000 7fc7e45ff700 1 --2- 172.21.15.45:0/3562001489 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fc7c00682f0 0x7fc7c006a7a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc7d8000fb0 tx=0x7fc7d8009040 comp rx=0 tx=0).stop 2023-11-28T12:09:14.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.284+0000 7fc7e45ff700 1 -- 172.21.15.45:0/3562001489 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc7dc0cb250 msgr2=0x7fc7dc0cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:14.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.284+0000 7fc7e45ff700 1 --2- 172.21.15.45:0/3562001489 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc7dc0cb250 0x7fc7dc0cb6f0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc08bfd0 tx=0x7fc7d40104a0 comp rx=0 tx=0).stop 2023-11-28T12:09:14.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.284+0000 7fc7e45ff700 1 -- 172.21.15.45:0/3562001489 shutdown_connections 2023-11-28T12:09:14.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.284+0000 7fc7e45ff700 1 --2- 172.21.15.45:0/3562001489 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fc7c00682f0 0x7fc7c006a7a0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:14.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.284+0000 7fc7e45ff700 1 --2- 172.21.15.45:0/3562001489 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc7dc0cb250 0x7fc7dc0cb6f0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:14.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.284+0000 7fc7e45ff700 1 --2- 172.21.15.45:0/3562001489 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc7c8004850 0x7fc7dc1574b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:14.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.284+0000 7fc7e45ff700 1 --2- 172.21.15.45:0/3562001489 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc7dc0c8970 0x7fc7dc0c8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:14.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.284+0000 7fc7e45ff700 1 -- 172.21.15.45:0/3562001489 >> 172.21.15.45:0/3562001489 conn(0x7fc7dc072600 msgr2=0x7fc7dc15af20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:14.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.284+0000 7fc7e45ff700 1 -- 172.21.15.45:0/3562001489 shutdown_connections 2023-11-28T12:09:14.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.284+0000 7fc7e45ff700 1 -- 172.21.15.45:0/3562001489 wait complete. 2023-11-28T12:09:14.303 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-28T12:06:21.807108+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-28T12:06:22.491009+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T12:08:29.364957+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T12:08:30.374968+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '47', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T12:09:14.304 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T12:09:14.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.509+0000 7f412e3ff700 1 Processor -- start 2023-11-28T12:09:14.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.509+0000 7f412e3ff700 1 -- start start 2023-11-28T12:09:14.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.510+0000 7f412e3ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f412815c9b0 0x7f41280b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:14.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.510+0000 7f412e3ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4128161340 0x7f41280d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:14.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.510+0000 7f412e3ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41280d1950 con 0x7f41280d2320 2023-11-28T12:09:14.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.510+0000 7f412e3ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41280b5800 con 0x7f4128161340 2023-11-28T12:09:14.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.510+0000 7f412e3ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41280b5520 con 0x7f412815c9b0 2023-11-28T12:09:14.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.510+0000 7f41277fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4128161340 0x7f41280d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:14.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.511+0000 7f41277fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4128161340 0x7f41280d1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40372/0 (socket says 172.21.15.45:40372) 2023-11-28T12:09:14.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.511+0000 7f41277fe700 1 -- 172.21.15.45:0/3503276391 learned_addr learned my addr 172.21.15.45:0/3503276391 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:09:14.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.511+0000 7f4127fff700 1 --2- 172.21.15.45:0/3503276391 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f412815c9b0 0x7f41280b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:14.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.511+0000 7f41277fe700 1 -- 172.21.15.45:0/3503276391 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f412815c9b0 msgr2=0x7f41280b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:14.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.511+0000 7f41277fe700 1 --2- 172.21.15.45:0/3503276391 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f412815c9b0 0x7f41280b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:14.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.511+0000 7f41277fe700 1 -- 172.21.15.45:0/3503276391 >> v1:172.21.15.152:6789/0 conn(0x7f41280d2320 legacy=0x7f41280cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:14.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.511+0000 7f41277fe700 1 -- 172.21.15.45:0/3503276391 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41280d1300 con 0x7f4128161340 2023-11-28T12:09:14.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.511+0000 7f41277fe700 1 --2- 172.21.15.45:0/3503276391 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4128161340 0x7f41280d1de0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f411c0098f0 tx=0x7f411c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22ad9529d982015d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:14.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.511+0000 7f4126ffd700 1 -- 172.21.15.45:0/3503276391 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f411c011830 con 0x7f4128161340 2023-11-28T12:09:14.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.512+0000 7f4126ffd700 1 -- 172.21.15.45:0/3503276391 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f411c011990 con 0x7f4128161340 2023-11-28T12:09:14.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.512+0000 7f4126ffd700 1 -- 172.21.15.45:0/3503276391 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f411c011d20 con 0x7f4128161340 2023-11-28T12:09:14.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.512+0000 7f412e3ff700 1 -- 172.21.15.45:0/3503276391 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4128161340 msgr2=0x7f41280d1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:14.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.512+0000 7f412e3ff700 1 --2- 172.21.15.45:0/3503276391 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4128161340 0x7f41280d1de0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f411c0098f0 tx=0x7f411c009c00 comp rx=0 tx=0).stop 2023-11-28T12:09:14.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.512+0000 7f412e3ff700 1 -- 172.21.15.45:0/3503276391 shutdown_connections 2023-11-28T12:09:14.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.512+0000 7f412e3ff700 1 --2- 172.21.15.45:0/3503276391 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f412815c9b0 0x7f41280b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:14.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.512+0000 7f412e3ff700 1 --2- 172.21.15.45:0/3503276391 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4128161340 0x7f41280d1de0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:14.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.512+0000 7f412e3ff700 1 -- 172.21.15.45:0/3503276391 >> 172.21.15.45:0/3503276391 conn(0x7f4128072600 msgr2=0x7f41280cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:14.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.512+0000 7f412e3ff700 1 -- 172.21.15.45:0/3503276391 shutdown_connections 2023-11-28T12:09:14.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.512+0000 7f412e3ff700 1 -- 172.21.15.45:0/3503276391 wait complete. 2023-11-28T12:09:14.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.515+0000 7f412e3ff700 1 Processor -- start 2023-11-28T12:09:14.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.515+0000 7f412e3ff700 1 -- start start 2023-11-28T12:09:14.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.516+0000 7f412e3ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41280d2320 0x7f41280c94f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:14.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.516+0000 7f412e3ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f412815c9b0 0x7f41280c6f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:14.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.516+0000 7f412e3ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4128161340 0x7f4128150f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:14.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.516+0000 7f412e3ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41281584b0 con 0x7f41280d2320 2023-11-28T12:09:14.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.516+0000 7f412e3ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41280c9ad0 con 0x7f412815c9b0 2023-11-28T12:09:14.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.516+0000 7f412e3ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41280c8bc0 con 0x7f4128161340 2023-11-28T12:09:14.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.516+0000 7f4127fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41280d2320 0x7f41280c94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:14.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.516+0000 7f4127fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41280d2320 0x7f41280c94f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40388/0 (socket says 172.21.15.45:40388) 2023-11-28T12:09:14.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.516+0000 7f4127fff700 1 -- 172.21.15.45:0/295036152 learned_addr learned my addr 172.21.15.45:0/295036152 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:09:14.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.517+0000 7f41277fe700 1 --2- 172.21.15.45:0/295036152 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f412815c9b0 0x7f41280c6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:14.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.517+0000 7f412c99c700 1 --2- 172.21.15.45:0/295036152 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4128161340 0x7f4128150f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:14.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.517+0000 7f4127fff700 1 -- 172.21.15.45:0/295036152 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4128161340 msgr2=0x7f4128150f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:14.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.517+0000 7f4127fff700 1 --2- 172.21.15.45:0/295036152 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4128161340 0x7f4128150f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:14.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.517+0000 7f4127fff700 1 -- 172.21.15.45:0/295036152 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f412815c9b0 msgr2=0x7f41280c6f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:14.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.517+0000 7f4127fff700 1 --2- 172.21.15.45:0/295036152 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f412815c9b0 0x7f41280c6f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:14.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.517+0000 7f4127fff700 1 -- 172.21.15.45:0/295036152 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f411c009550 con 0x7f41280d2320 2023-11-28T12:09:14.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.517+0000 7f41277fe700 1 --2- 172.21.15.45:0/295036152 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f412815c9b0 0x7f41280c6f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:09:14.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.517+0000 7f4127fff700 1 --2- 172.21.15.45:0/295036152 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41280d2320 0x7f41280c94f0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f411800e9b0 tx=0x7f411800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:14.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.517+0000 7f4124ff9700 1 -- 172.21.15.45:0/295036152 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4118009710 con 0x7f41280d2320 2023-11-28T12:09:14.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.517+0000 7f4124ff9700 1 -- 172.21.15.45:0/295036152 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f411800c850 con 0x7f41280d2320 2023-11-28T12:09:14.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.517+0000 7f4124ff9700 1 -- 172.21.15.45:0/295036152 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f411800cbc0 con 0x7f41280d2320 2023-11-28T12:09:14.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.517+0000 7f412e3ff700 1 -- 172.21.15.45:0/295036152 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41280b5130 con 0x7f41280d2320 2023-11-28T12:09:14.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.518+0000 7f412e3ff700 1 -- 172.21.15.45:0/295036152 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41280d15e0 con 0x7f41280d2320 2023-11-28T12:09:14.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.519+0000 7f412e3ff700 1 -- 172.21.15.45:0/295036152 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41280b52c0 con 0x7f41280d2320 2023-11-28T12:09:14.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.519+0000 7f4124ff9700 1 -- 172.21.15.45:0/295036152 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f4118019030 con 0x7f41280d2320 2023-11-28T12:09:14.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.520+0000 7f4124ff9700 1 --2- 172.21.15.45:0/295036152 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f41140682f0 0x7f411406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:14.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.520+0000 7f4124ff9700 1 -- 172.21.15.45:0/295036152 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4118085d90 con 0x7f41280d2320 2023-11-28T12:09:14.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.521+0000 7f41277fe700 1 --2- 172.21.15.45:0/295036152 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f41140682f0 0x7f411406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:14.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.521+0000 7f41277fe700 1 --2- 172.21.15.45:0/295036152 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f41140682f0 0x7f411406a7a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f411c009c40 tx=0x7f411c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:14.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.524+0000 7f4124ff9700 1 -- 172.21.15.45:0/295036152 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f4118052500 con 0x7f41280d2320 2023-11-28T12:09:14.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.725+0000 7f412e3ff700 1 -- 172.21.15.45:0/295036152 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4128158720 con 0x7f41280d2320 2023-11-28T12:09:14.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.725+0000 7f4124ff9700 1 -- 172.21.15.45:0/295036152 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v47) v1 ==== 92+0+10 (secure 0 0 0) 0x7f41180210a0 con 0x7f41280d2320 2023-11-28T12:09:14.727 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-11-28T12:09:14.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.728+0000 7f412e3ff700 1 -- 172.21.15.45:0/295036152 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f41140682f0 msgr2=0x7f411406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:14.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.728+0000 7f412e3ff700 1 --2- 172.21.15.45:0/295036152 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f41140682f0 0x7f411406a7a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f411c009c40 tx=0x7f411c008030 comp rx=0 tx=0).stop 2023-11-28T12:09:14.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.728+0000 7f412e3ff700 1 -- 172.21.15.45:0/295036152 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41280d2320 msgr2=0x7f41280c94f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:14.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.728+0000 7f412e3ff700 1 --2- 172.21.15.45:0/295036152 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41280d2320 0x7f41280c94f0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f411800e9b0 tx=0x7f411800ed70 comp rx=0 tx=0).stop 2023-11-28T12:09:14.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.728+0000 7f412e3ff700 1 -- 172.21.15.45:0/295036152 shutdown_connections 2023-11-28T12:09:14.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.728+0000 7f412e3ff700 1 --2- 172.21.15.45:0/295036152 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f41140682f0 0x7f411406a7a0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:14.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.728+0000 7f412e3ff700 1 --2- 172.21.15.45:0/295036152 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4128161340 0x7f4128150f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:14.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.728+0000 7f412e3ff700 1 --2- 172.21.15.45:0/295036152 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41280d2320 0x7f41280c94f0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:14.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.728+0000 7f412e3ff700 1 --2- 172.21.15.45:0/295036152 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f412815c9b0 0x7f41280c6f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:14.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.728+0000 7f412e3ff700 1 -- 172.21.15.45:0/295036152 >> 172.21.15.45:0/295036152 conn(0x7f4128072600 msgr2=0x7f412815cf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:14.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.728+0000 7f412e3ff700 1 -- 172.21.15.45:0/295036152 shutdown_connections 2023-11-28T12:09:14.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.728+0000 7f412e3ff700 1 -- 172.21.15.45:0/295036152 wait complete. 2023-11-28T12:09:14.747 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T12:09:14.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.952+0000 7f97167ff700 1 Processor -- start 2023-11-28T12:09:14.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.952+0000 7f97167ff700 1 -- start start 2023-11-28T12:09:14.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.953+0000 7f97167ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9710161340 0x7f97100d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:14.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.953+0000 7f97167ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f97100d2320 0x7f97100cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:14.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.953+0000 7f97167ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97100d1950 con 0x7f971015c9b0 2023-11-28T12:09:14.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.953+0000 7f97167ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97100b5800 con 0x7f97100d2320 2023-11-28T12:09:14.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.953+0000 7f97167ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97100b5300 con 0x7f9710161340 2023-11-28T12:09:14.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.954+0000 7f9714d9c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f97100d2320 0x7f97100cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:14.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.954+0000 7f970ffff700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f971015c9b0 0x7f97100b4bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.45:41738/0 (socket says 172.21.15.45:41738) 2023-11-28T12:09:14.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.954+0000 7f970f7fe700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9710161340 0x7f97100d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:14.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.954+0000 7f970ffff700 1 -- 172.21.15.45:0/1923990895 learned_addr learned my addr 172.21.15.45:0/1923990895 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:09:14.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.954+0000 7f9714d9c700 1 -- 172.21.15.45:0/1923990895 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9710161340 msgr2=0x7f97100d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:14.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.954+0000 7f9714d9c700 1 --2- 172.21.15.45:0/1923990895 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9710161340 0x7f97100d1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:14.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.954+0000 7f9714d9c700 1 -- 172.21.15.45:0/1923990895 >> v1:172.21.15.152:6789/0 conn(0x7f971015c9b0 legacy=0x7f97100b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:14.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.954+0000 7f9714d9c700 1 -- 172.21.15.45:0/1923990895 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97100b5520 con 0x7f97100d2320 2023-11-28T12:09:14.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.955+0000 7f9714d9c700 1 --2- 172.21.15.45:0/1923990895 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97100d2320 0x7f97100cd7c0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f9708009dc0 tx=0x7f970800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccdc9338971bda75 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:14.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.955+0000 7f970effd700 1 -- 172.21.15.45:0/1923990895 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f970800e070 con 0x7f97100d2320 2023-11-28T12:09:14.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.955+0000 7f970effd700 1 -- 172.21.15.45:0/1923990895 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f970800bae0 con 0x7f97100d2320 2023-11-28T12:09:14.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.955+0000 7f970effd700 1 -- 172.21.15.45:0/1923990895 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f970800be90 con 0x7f97100d2320 2023-11-28T12:09:14.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.955+0000 7f97167ff700 1 -- 172.21.15.45:0/1923990895 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97100d2320 msgr2=0x7f97100cd7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:14.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.955+0000 7f97167ff700 1 --2- 172.21.15.45:0/1923990895 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97100d2320 0x7f97100cd7c0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f9708009dc0 tx=0x7f970800b330 comp rx=0 tx=0).stop 2023-11-28T12:09:14.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.956+0000 7f97167ff700 1 -- 172.21.15.45:0/1923990895 shutdown_connections 2023-11-28T12:09:14.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.956+0000 7f97167ff700 1 --2- 172.21.15.45:0/1923990895 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97100d2320 0x7f97100cd7c0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:14.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.956+0000 7f97167ff700 1 --2- 172.21.15.45:0/1923990895 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9710161340 0x7f97100d1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:14.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.956+0000 7f97167ff700 1 -- 172.21.15.45:0/1923990895 >> 172.21.15.45:0/1923990895 conn(0x7f9710072600 msgr2=0x7f97100cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:14.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.956+0000 7f97167ff700 1 -- 172.21.15.45:0/1923990895 shutdown_connections 2023-11-28T12:09:14.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.956+0000 7f97167ff700 1 -- 172.21.15.45:0/1923990895 wait complete. 2023-11-28T12:09:14.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.958+0000 7f97167ff700 1 Processor -- start 2023-11-28T12:09:14.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.958+0000 7f97167ff700 1 -- start start 2023-11-28T12:09:14.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.959+0000 7f97167ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f97100d2320 0x7f97101f2a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:14.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.959+0000 7f97167ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f971015c9b0 0x7f9710157620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:14.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.959+0000 7f97167ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9710161340 0x7f9710160610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:14.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.959+0000 7f97167ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9710152880 con 0x7f971015c9b0 2023-11-28T12:09:14.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.959+0000 7f97167ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9710152b60 con 0x7f97100d2320 2023-11-28T12:09:14.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.959+0000 7f97167ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9710152e40 con 0x7f9710161340 2023-11-28T12:09:14.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.960+0000 7f970f7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f971015c9b0 0x7f9710157620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:14.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.960+0000 7f970ffff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f97100d2320 0x7f97101f2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:14.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.960+0000 7f970f7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f971015c9b0 0x7f9710157620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40404/0 (socket says 172.21.15.45:40404) 2023-11-28T12:09:14.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.960+0000 7f970f7fe700 1 -- 172.21.15.45:0/3303497372 learned_addr learned my addr 172.21.15.45:0/3303497372 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:09:14.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.960+0000 7f9714d9c700 1 --2- 172.21.15.45:0/3303497372 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9710161340 0x7f9710160610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:14.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.960+0000 7f970f7fe700 1 -- 172.21.15.45:0/3303497372 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9710161340 msgr2=0x7f9710160610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:14.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.960+0000 7f970f7fe700 1 --2- 172.21.15.45:0/3303497372 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9710161340 0x7f9710160610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:14.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.960+0000 7f970f7fe700 1 -- 172.21.15.45:0/3303497372 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f97100d2320 msgr2=0x7f97101f2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:14.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.960+0000 7f970f7fe700 1 --2- 172.21.15.45:0/3303497372 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f97100d2320 0x7f97101f2a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:14.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.960+0000 7f970f7fe700 1 -- 172.21.15.45:0/3303497372 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9708009a70 con 0x7f971015c9b0 2023-11-28T12:09:14.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.961+0000 7f970f7fe700 1 --2- 172.21.15.45:0/3303497372 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f971015c9b0 0x7f9710157620 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f970400e9b0 tx=0x7f970400ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:14.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.961+0000 7f970cff9700 1 -- 172.21.15.45:0/3303497372 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9704009710 con 0x7f971015c9b0 2023-11-28T12:09:14.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.961+0000 7f970cff9700 1 -- 172.21.15.45:0/3303497372 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f970400ee50 con 0x7f971015c9b0 2023-11-28T12:09:14.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.961+0000 7f97167ff700 1 -- 172.21.15.45:0/3303497372 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97100d15e0 con 0x7f971015c9b0 2023-11-28T12:09:14.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.961+0000 7f970cff9700 1 -- 172.21.15.45:0/3303497372 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f970400ca50 con 0x7f971015c9b0 2023-11-28T12:09:14.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.961+0000 7f97167ff700 1 -- 172.21.15.45:0/3303497372 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97100d1300 con 0x7f971015c9b0 2023-11-28T12:09:14.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.962+0000 7f97167ff700 1 -- 172.21.15.45:0/3303497372 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f971015cd80 con 0x7f971015c9b0 2023-11-28T12:09:14.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.964+0000 7f970cff9700 1 -- 172.21.15.45:0/3303497372 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f9704019030 con 0x7f971015c9b0 2023-11-28T12:09:14.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.965+0000 7f970cff9700 1 --2- 172.21.15.45:0/3303497372 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f96fc0682f0 0x7f96fc06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:14.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.965+0000 7f970cff9700 1 -- 172.21.15.45:0/3303497372 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9704085c00 con 0x7f971015c9b0 2023-11-28T12:09:14.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.965+0000 7f970ffff700 1 --2- 172.21.15.45:0/3303497372 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f96fc0682f0 0x7f96fc06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:14.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.966+0000 7f970ffff700 1 --2- 172.21.15.45:0/3303497372 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f96fc0682f0 0x7f96fc06a7a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f9700005910 tx=0x7f9700009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:14.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:14.969+0000 7f970cff9700 1 -- 172.21.15.45:0/3303497372 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f9704052380 con 0x7f971015c9b0 2023-11-28T12:09:15.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.169+0000 7f97167ff700 1 -- 172.21.15.45:0/3303497372 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9710153770 con 0x7f971015c9b0 2023-11-28T12:09:15.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.169+0000 7f970cff9700 1 -- 172.21.15.45:0/3303497372 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v47) v1 ==== 93+0+10 (secure 0 0 0) 0x7f97040559a0 con 0x7f971015c9b0 2023-11-28T12:09:15.171 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-11-28T12:09:15.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.171+0000 7f97167ff700 1 -- 172.21.15.45:0/3303497372 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f96fc0682f0 msgr2=0x7f96fc06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:15.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.171+0000 7f97167ff700 1 --2- 172.21.15.45:0/3303497372 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f96fc0682f0 0x7f96fc06a7a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f9700005910 tx=0x7f9700009040 comp rx=0 tx=0).stop 2023-11-28T12:09:15.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.171+0000 7f97167ff700 1 -- 172.21.15.45:0/3303497372 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f971015c9b0 msgr2=0x7f9710157620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:15.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.171+0000 7f97167ff700 1 --2- 172.21.15.45:0/3303497372 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f971015c9b0 0x7f9710157620 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f970400e9b0 tx=0x7f970400ecc0 comp rx=0 tx=0).stop 2023-11-28T12:09:15.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.171+0000 7f97167ff700 1 -- 172.21.15.45:0/3303497372 shutdown_connections 2023-11-28T12:09:15.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.171+0000 7f97167ff700 1 --2- 172.21.15.45:0/3303497372 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f96fc0682f0 0x7f96fc06a7a0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:15.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.171+0000 7f97167ff700 1 --2- 172.21.15.45:0/3303497372 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f97100d2320 0x7f97101f2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:15.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.171+0000 7f97167ff700 1 --2- 172.21.15.45:0/3303497372 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9710161340 0x7f9710160610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:15.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.171+0000 7f97167ff700 1 --2- 172.21.15.45:0/3303497372 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f971015c9b0 0x7f9710157620 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:15.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.171+0000 7f97167ff700 1 -- 172.21.15.45:0/3303497372 >> 172.21.15.45:0/3303497372 conn(0x7f9710072600 msgr2=0x7f971015a430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:15.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.171+0000 7f97167ff700 1 -- 172.21.15.45:0/3303497372 shutdown_connections 2023-11-28T12:09:15.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.171+0000 7f97167ff700 1 -- 172.21.15.45:0/3303497372 wait complete. 2023-11-28T12:09:15.191 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T12:09:15.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.396+0000 7fd8c2dff700 1 Processor -- start 2023-11-28T12:09:15.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.396+0000 7fd8c2dff700 1 -- start start 2023-11-28T12:09:15.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.397+0000 7fd8c2dff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fd8bc158ce0 0x7fd8bc15d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:15.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.397+0000 7fd8c2dff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd8bc0ce4b0 0x7fd8bc06c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:15.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.397+0000 7fd8c2dff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8bc06bf10 con 0x7fd8bc06fb30 2023-11-28T12:09:15.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.397+0000 7fd8c2dff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8bc15d730 con 0x7fd8bc158ce0 2023-11-28T12:09:15.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.397+0000 7fd8c2dff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8bc1590b0 con 0x7fd8bc0ce4b0 2023-11-28T12:09:15.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.397+0000 7fd8c139c700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd8bc0ce4b0 0x7fd8bc06c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:15.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.397+0000 7fd8bbfff700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fd8bc06fb30 0x7fd8bc0cdda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.45:41752/0 (socket says 172.21.15.45:41752) 2023-11-28T12:09:15.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.397+0000 7fd8bbfff700 1 -- 172.21.15.45:0/1500634229 learned_addr learned my addr 172.21.15.45:0/1500634229 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:09:15.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.397+0000 7fd8c0b9b700 1 --2- 172.21.15.45:0/1500634229 >> v2:172.21.15.152:3300/0 conn(0x7fd8bc158ce0 0x7fd8bc15d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:15.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.398+0000 7fd8bb7fe700 1 -- 172.21.15.45:0/1500634229 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 37870035 0 0) 0x7fd8bc06bf10 con 0x7fd8bc06fb30 2023-11-28T12:09:15.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.398+0000 7fd8bb7fe700 1 -- 172.21.15.45:0/1500634229 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8ac0035b0 con 0x7fd8bc06fb30 2023-11-28T12:09:15.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.398+0000 7fd8c139c700 1 -- 172.21.15.45:0/1500634229 >> v2:172.21.15.152:3300/0 conn(0x7fd8bc158ce0 msgr2=0x7fd8bc15d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:15.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.398+0000 7fd8c139c700 1 --2- 172.21.15.45:0/1500634229 >> v2:172.21.15.152:3300/0 conn(0x7fd8bc158ce0 0x7fd8bc15d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:15.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.398+0000 7fd8c139c700 1 -- 172.21.15.45:0/1500634229 >> v1:172.21.15.152:6789/0 conn(0x7fd8bc06fb30 legacy=0x7fd8bc0cdda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:15.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.398+0000 7fd8c139c700 1 -- 172.21.15.45:0/1500634229 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8bc0cb0d0 con 0x7fd8bc0ce4b0 2023-11-28T12:09:15.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.398+0000 7fd8c139c700 1 --2- 172.21.15.45:0/1500634229 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd8bc0ce4b0 0x7fd8bc06c3a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd8b400aea0 tx=0x7fd8b400c330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2c8dbe2b6982152 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:15.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.399+0000 7fd8bb7fe700 1 -- 172.21.15.45:0/1500634229 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b400f070 con 0x7fd8bc0ce4b0 2023-11-28T12:09:15.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.399+0000 7fd8bb7fe700 1 -- 172.21.15.45:0/1500634229 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8b400a2e0 con 0x7fd8bc0ce4b0 2023-11-28T12:09:15.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.399+0000 7fd8bb7fe700 1 -- 172.21.15.45:0/1500634229 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b400cb50 con 0x7fd8bc0ce4b0 2023-11-28T12:09:15.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.399+0000 7fd8c2dff700 1 -- 172.21.15.45:0/1500634229 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd8bc0ce4b0 msgr2=0x7fd8bc06c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:15.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.399+0000 7fd8c2dff700 1 --2- 172.21.15.45:0/1500634229 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd8bc0ce4b0 0x7fd8bc06c3a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd8b400aea0 tx=0x7fd8b400c330 comp rx=0 tx=0).stop 2023-11-28T12:09:15.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.399+0000 7fd8c2dff700 1 -- 172.21.15.45:0/1500634229 shutdown_connections 2023-11-28T12:09:15.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.399+0000 7fd8c2dff700 1 --2- 172.21.15.45:0/1500634229 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd8bc0ce4b0 0x7fd8bc06c3a0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:15.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.399+0000 7fd8c2dff700 1 --2- 172.21.15.45:0/1500634229 >> v2:172.21.15.152:3300/0 conn(0x7fd8bc158ce0 0x7fd8bc15d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:15.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.399+0000 7fd8c2dff700 1 -- 172.21.15.45:0/1500634229 >> 172.21.15.45:0/1500634229 conn(0x7fd8bc0cb670 msgr2=0x7fd8bc0cba70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:15.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.399+0000 7fd8c2dff700 1 -- 172.21.15.45:0/1500634229 shutdown_connections 2023-11-28T12:09:15.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.399+0000 7fd8c2dff700 1 -- 172.21.15.45:0/1500634229 wait complete. 2023-11-28T12:09:15.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.401+0000 7fd8c2dff700 1 Processor -- start 2023-11-28T12:09:15.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.401+0000 7fd8c2dff700 1 -- start start 2023-11-28T12:09:15.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.402+0000 7fd8c2dff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd8bc06fb30 0x7fd8bc0c2650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:15.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.402+0000 7fd8c2dff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd8bc0ce4b0 0x7fd8bc0c3d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:15.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.402+0000 7fd8c2dff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd8bc158ce0 0x7fd8bc157480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:15.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.402+0000 7fd8c2dff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8bc0c2ca0 con 0x7fd8bc158ce0 2023-11-28T12:09:15.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.402+0000 7fd8c2dff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8bc0c2f80 con 0x7fd8bc0ce4b0 2023-11-28T12:09:15.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.402+0000 7fd8c2dff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8bc0c3260 con 0x7fd8bc06fb30 2023-11-28T12:09:15.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.402+0000 7fd8c139c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd8bc158ce0 0x7fd8bc157480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:15.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.402+0000 7fd8c0b9b700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd8bc06fb30 0x7fd8bc0c2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:15.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.403+0000 7fd8c0b9b700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd8bc06fb30 0x7fd8bc0c2650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.45:47030/0 (socket says 172.21.15.45:47030) 2023-11-28T12:09:15.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.403+0000 7fd8c0b9b700 1 -- 172.21.15.45:0/3841379529 learned_addr learned my addr 172.21.15.45:0/3841379529 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:09:15.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.403+0000 7fd8bbfff700 1 --2- 172.21.15.45:0/3841379529 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd8bc0ce4b0 0x7fd8bc0c3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:15.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.403+0000 7fd8c139c700 1 -- 172.21.15.45:0/3841379529 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd8bc06fb30 msgr2=0x7fd8bc0c2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:15.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.403+0000 7fd8c139c700 1 --2- 172.21.15.45:0/3841379529 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd8bc06fb30 0x7fd8bc0c2650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:15.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.403+0000 7fd8c139c700 1 -- 172.21.15.45:0/3841379529 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd8bc0ce4b0 msgr2=0x7fd8bc0c3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:15.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.403+0000 7fd8c139c700 1 --2- 172.21.15.45:0/3841379529 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd8bc0ce4b0 0x7fd8bc0c3d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:15.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.403+0000 7fd8c139c700 1 -- 172.21.15.45:0/3841379529 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b400ab80 con 0x7fd8bc158ce0 2023-11-28T12:09:15.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.403+0000 7fd8c139c700 1 --2- 172.21.15.45:0/3841379529 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd8bc158ce0 0x7fd8bc157480 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fd8b4016000 tx=0x7fd8b4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:15.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.404+0000 7fd8b97fa700 1 -- 172.21.15.45:0/3841379529 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b401d8c0 con 0x7fd8bc158ce0 2023-11-28T12:09:15.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.404+0000 7fd8b97fa700 1 -- 172.21.15.45:0/3841379529 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8b401da20 con 0x7fd8bc158ce0 2023-11-28T12:09:15.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.404+0000 7fd8b97fa700 1 -- 172.21.15.45:0/3841379529 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b401ddb0 con 0x7fd8bc158ce0 2023-11-28T12:09:15.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.404+0000 7fd8c2dff700 1 -- 172.21.15.45:0/3841379529 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8bc06b8c0 con 0x7fd8bc158ce0 2023-11-28T12:09:15.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.404+0000 7fd8c2dff700 1 -- 172.21.15.45:0/3841379529 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8bc0cb3b0 con 0x7fd8bc158ce0 2023-11-28T12:09:15.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.405+0000 7fd8c2dff700 1 -- 172.21.15.45:0/3841379529 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8bc06bba0 con 0x7fd8bc158ce0 2023-11-28T12:09:15.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.406+0000 7fd8b97fa700 1 -- 172.21.15.45:0/3841379529 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fd8b402d060 con 0x7fd8bc158ce0 2023-11-28T12:09:15.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.407+0000 7fd8b97fa700 1 --2- 172.21.15.45:0/3841379529 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fd8a00682f0 0x7fd8a006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:15.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.407+0000 7fd8b97fa700 1 -- 172.21.15.45:0/3841379529 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd8b408abf0 con 0x7fd8bc158ce0 2023-11-28T12:09:15.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.407+0000 7fd8c0b9b700 1 --2- 172.21.15.45:0/3841379529 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fd8a00682f0 0x7fd8a006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:15.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.408+0000 7fd8c0b9b700 1 --2- 172.21.15.45:0/3841379529 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fd8a00682f0 0x7fd8a006a7a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc0b0b50 tx=0x7fd8b0009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:15.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.411+0000 7fd8b97fa700 1 -- 172.21.15.45:0/3841379529 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fd8b4057360 con 0x7fd8bc158ce0 2023-11-28T12:09:15.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.611+0000 7fd8c2dff700 1 -- 172.21.15.45:0/3841379529 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd8bc0745c0 con 0x7fd8bc158ce0 2023-11-28T12:09:15.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.611+0000 7fd8b97fa700 1 -- 172.21.15.45:0/3841379529 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v47) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd8b405a980 con 0x7fd8bc158ce0 2023-11-28T12:09:15.613 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-11-28T12:09:15.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.614+0000 7fd8c2dff700 1 -- 172.21.15.45:0/3841379529 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fd8a00682f0 msgr2=0x7fd8a006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:15.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.614+0000 7fd8c2dff700 1 --2- 172.21.15.45:0/3841379529 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fd8a00682f0 0x7fd8a006a7a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc0b0b50 tx=0x7fd8b0009210 comp rx=0 tx=0).stop 2023-11-28T12:09:15.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.614+0000 7fd8c2dff700 1 -- 172.21.15.45:0/3841379529 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd8bc158ce0 msgr2=0x7fd8bc157480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:15.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.614+0000 7fd8c2dff700 1 --2- 172.21.15.45:0/3841379529 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd8bc158ce0 0x7fd8bc157480 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fd8b4016000 tx=0x7fd8b4004ad0 comp rx=0 tx=0).stop 2023-11-28T12:09:15.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.614+0000 7fd8c2dff700 1 -- 172.21.15.45:0/3841379529 shutdown_connections 2023-11-28T12:09:15.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.614+0000 7fd8c2dff700 1 --2- 172.21.15.45:0/3841379529 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fd8a00682f0 0x7fd8a006a7a0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:15.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.614+0000 7fd8c2dff700 1 --2- 172.21.15.45:0/3841379529 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd8bc158ce0 0x7fd8bc157480 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:15.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.614+0000 7fd8c2dff700 1 --2- 172.21.15.45:0/3841379529 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd8bc06fb30 0x7fd8bc0c2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:15.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.614+0000 7fd8c2dff700 1 --2- 172.21.15.45:0/3841379529 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd8bc0ce4b0 0x7fd8bc0c3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:15.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.614+0000 7fd8c2dff700 1 -- 172.21.15.45:0/3841379529 >> 172.21.15.45:0/3841379529 conn(0x7fd8bc0cb670 msgr2=0x7fd8bc06c780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:15.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.614+0000 7fd8c2dff700 1 -- 172.21.15.45:0/3841379529 shutdown_connections 2023-11-28T12:09:15.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.614+0000 7fd8c2dff700 1 -- 172.21.15.45:0/3841379529 wait complete. 2023-11-28T12:09:15.633 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T12:09:15.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.838+0000 7f2a151ff700 1 Processor -- start 2023-11-28T12:09:15.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.838+0000 7f2a151ff700 1 -- start start 2023-11-28T12:09:15.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.839+0000 7f2a151ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2a10158200 0x7f2a10070c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:15.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.839+0000 7f2a151ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a1015e1a0 con 0x7f2a100b0d80 2023-11-28T12:09:15.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.839+0000 7f2a151ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a101585d0 con 0x7f2a100caa70 2023-11-28T12:09:15.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.839+0000 7f2a151ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a1015f070 con 0x7f2a10158200 2023-11-28T12:09:15.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.839+0000 7f2a0f59e700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f2a100b0d80 0x7f2a1015add0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:53556/0 (socket says 172.21.15.45:53556) 2023-11-28T12:09:15.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.839+0000 7f2a0f59e700 1 -- 172.21.15.45:0/3527559005 learned_addr learned my addr 172.21.15.45:0/3527559005 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:09:15.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.839+0000 7f2a0ed9d700 1 --2- 172.21.15.45:0/3527559005 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2a10158200 0x7f2a10070c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:15.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.840+0000 7f2a0dd9b700 1 -- 172.21.15.45:0/3527559005 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1386455537 0 0) 0x7f2a1015e1a0 con 0x7f2a100b0d80 2023-11-28T12:09:15.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.840+0000 7f2a0dd9b700 1 -- 172.21.15.45:0/3527559005 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29f80035b0 con 0x7f2a100b0d80 2023-11-28T12:09:15.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.840+0000 7f2a0dd9b700 1 -- 172.21.15.45:0/3527559005 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1782234804 0 0) 0x7f2a101585d0 con 0x7f2a100caa70 2023-11-28T12:09:15.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.840+0000 7f2a0dd9b700 1 -- 172.21.15.45:0/3527559005 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a1015e1a0 con 0x7f2a100caa70 2023-11-28T12:09:15.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.840+0000 7f2a0dd9b700 1 -- 172.21.15.45:0/3527559005 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2126843422 0 0) 0x7f29f80035b0 con 0x7f2a100b0d80 2023-11-28T12:09:15.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.840+0000 7f2a0ed9d700 1 -- 172.21.15.45:0/3527559005 >> v1:172.21.15.152:6789/0 conn(0x7f2a100caa70 legacy=0x7f2a100b0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:15.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.840+0000 7f2a0ed9d700 1 -- 172.21.15.45:0/3527559005 >> v1:172.21.15.45:6789/0 conn(0x7f2a100b0d80 legacy=0x7f2a1015add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:15.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.840+0000 7f2a0ed9d700 1 -- 172.21.15.45:0/3527559005 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a1015e3f0 con 0x7f2a10158200 2023-11-28T12:09:15.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.840+0000 7f2a0ed9d700 1 --2- 172.21.15.45:0/3527559005 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2a10158200 0x7f2a10070c50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2a00009870 tx=0x7f2a00009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1fbc78569e0ff21 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:15.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.841+0000 7f2a0dd9b700 1 -- 172.21.15.45:0/3527559005 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a080019f0 con 0x7f2a10158200 2023-11-28T12:09:15.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.841+0000 7f2a0dd9b700 1 -- 172.21.15.45:0/3527559005 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a00004030 con 0x7f2a10158200 2023-11-28T12:09:15.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.841+0000 7f2a0dd9b700 1 -- 172.21.15.45:0/3527559005 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a000043c0 con 0x7f2a10158200 2023-11-28T12:09:15.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.841+0000 7f2a151ff700 1 -- 172.21.15.45:0/3527559005 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2a10158200 msgr2=0x7f2a10070c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:15.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.841+0000 7f2a151ff700 1 --2- 172.21.15.45:0/3527559005 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2a10158200 0x7f2a10070c50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2a00009870 tx=0x7f2a00009b80 comp rx=0 tx=0).stop 2023-11-28T12:09:15.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.841+0000 7f2a151ff700 1 -- 172.21.15.45:0/3527559005 shutdown_connections 2023-11-28T12:09:15.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.841+0000 7f2a151ff700 1 --2- 172.21.15.45:0/3527559005 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2a10158200 0x7f2a10070c50 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:15.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.841+0000 7f2a151ff700 1 -- 172.21.15.45:0/3527559005 >> 172.21.15.45:0/3527559005 conn(0x7f2a100cb670 msgr2=0x7f2a100cba70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:15.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.842+0000 7f2a151ff700 1 -- 172.21.15.45:0/3527559005 shutdown_connections 2023-11-28T12:09:15.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.842+0000 7f2a151ff700 1 -- 172.21.15.45:0/3527559005 wait complete. 2023-11-28T12:09:15.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.843+0000 7f2a151ff700 1 Processor -- start 2023-11-28T12:09:15.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.843+0000 7f2a151ff700 1 -- start start 2023-11-28T12:09:15.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.844+0000 7f2a151ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a100b0d80 0x7f2a100c89d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:15.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.844+0000 7f2a151ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2a100caa70 0x7f2a100c5c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:15.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.844+0000 7f2a151ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2a10158200 0x7f2a1015add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:15.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.844+0000 7f2a151ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a10071190 con 0x7f2a10158200 2023-11-28T12:09:15.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.844+0000 7f2a151ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a100c7930 con 0x7f2a100b0d80 2023-11-28T12:09:15.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.844+0000 7f2a151ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a100c7c10 con 0x7f2a100caa70 2023-11-28T12:09:15.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.845+0000 7f2a0f59e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2a10158200 0x7f2a1015add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:15.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.845+0000 7f2a0f59e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2a10158200 0x7f2a1015add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40418/0 (socket says 172.21.15.45:40418) 2023-11-28T12:09:15.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.845+0000 7f2a0f59e700 1 -- 172.21.15.45:0/2971903 learned_addr learned my addr 172.21.15.45:0/2971903 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:09:15.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.845+0000 7f2a0ed9d700 1 --2- 172.21.15.45:0/2971903 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a100b0d80 0x7f2a100c89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:15.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.845+0000 7f2a0e59c700 1 --2- 172.21.15.45:0/2971903 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2a100caa70 0x7f2a100c5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:15.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.845+0000 7f2a0f59e700 1 -- 172.21.15.45:0/2971903 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2a100caa70 msgr2=0x7f2a100c5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:15.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.845+0000 7f2a0f59e700 1 --2- 172.21.15.45:0/2971903 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2a100caa70 0x7f2a100c5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:15.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.845+0000 7f2a0f59e700 1 -- 172.21.15.45:0/2971903 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a100b0d80 msgr2=0x7f2a100c89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:15.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.845+0000 7f2a0f59e700 1 --2- 172.21.15.45:0/2971903 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a100b0d80 0x7f2a100c89d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:15.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.845+0000 7f2a0f59e700 1 -- 172.21.15.45:0/2971903 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a000094a0 con 0x7f2a10158200 2023-11-28T12:09:15.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.845+0000 7f2a0f59e700 1 --2- 172.21.15.45:0/2971903 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2a10158200 0x7f2a1015add0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f2a08001700 tx=0x7f2a0800cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:15.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.846+0000 7f29f77fe700 1 -- 172.21.15.45:0/2971903 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a0800aaa0 con 0x7f2a10158200 2023-11-28T12:09:15.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.846+0000 7f29f77fe700 1 -- 172.21.15.45:0/2971903 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a0800ac00 con 0x7f2a10158200 2023-11-28T12:09:15.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.846+0000 7f2a151ff700 1 -- 172.21.15.45:0/2971903 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a1015e9b0 con 0x7f2a10158200 2023-11-28T12:09:15.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.846+0000 7f29f77fe700 1 -- 172.21.15.45:0/2971903 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a080070d0 con 0x7f2a10158200 2023-11-28T12:09:15.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.846+0000 7f2a151ff700 1 -- 172.21.15.45:0/2971903 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a1015e6d0 con 0x7f2a10158200 2023-11-28T12:09:15.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.847+0000 7f2a151ff700 1 -- 172.21.15.45:0/2971903 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a1015ec90 con 0x7f2a10158200 2023-11-28T12:09:15.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.848+0000 7f29f77fe700 1 -- 172.21.15.45:0/2971903 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f2a0801a030 con 0x7f2a10158200 2023-11-28T12:09:15.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.849+0000 7f29f77fe700 1 --2- 172.21.15.45:0/2971903 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f29fc0682f0 0x7f29fc06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:15.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.849+0000 7f29f77fe700 1 -- 172.21.15.45:0/2971903 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2a080859f0 con 0x7f2a10158200 2023-11-28T12:09:15.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.849+0000 7f2a0ed9d700 1 --2- 172.21.15.45:0/2971903 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f29fc0682f0 0x7f29fc06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:15.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.850+0000 7f2a0ed9d700 1 --2- 172.21.15.45:0/2971903 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f29fc0682f0 0x7f29fc06a7a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f2a000097c0 tx=0x7f2a00008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:15.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:15.853+0000 7f29f77fe700 1 -- 172.21.15.45:0/2971903 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f2a08052160 con 0x7f2a10158200 2023-11-28T12:09:16.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:16.056+0000 7f2a151ff700 1 -- 172.21.15.45:0/2971903 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2a1006fd60 con 0x7f2a10158200 2023-11-28T12:09:16.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:16.057+0000 7f29f77fe700 1 -- 172.21.15.45:0/2971903 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v47) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2a080180a0 con 0x7f2a10158200 2023-11-28T12:09:16.058 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-11-28T12:09:16.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:16.059+0000 7f2a151ff700 1 -- 172.21.15.45:0/2971903 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f29fc0682f0 msgr2=0x7f29fc06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:16.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:16.059+0000 7f2a151ff700 1 --2- 172.21.15.45:0/2971903 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f29fc0682f0 0x7f29fc06a7a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f2a000097c0 tx=0x7f2a00008030 comp rx=0 tx=0).stop 2023-11-28T12:09:16.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:16.059+0000 7f2a151ff700 1 -- 172.21.15.45:0/2971903 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2a10158200 msgr2=0x7f2a1015add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:16.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:16.059+0000 7f2a151ff700 1 --2- 172.21.15.45:0/2971903 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2a10158200 0x7f2a1015add0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f2a08001700 tx=0x7f2a0800cf30 comp rx=0 tx=0).stop 2023-11-28T12:09:16.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:16.059+0000 7f2a151ff700 1 -- 172.21.15.45:0/2971903 shutdown_connections 2023-11-28T12:09:16.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:16.059+0000 7f2a151ff700 1 --2- 172.21.15.45:0/2971903 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f29fc0682f0 0x7f29fc06a7a0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:16.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:16.059+0000 7f2a151ff700 1 --2- 172.21.15.45:0/2971903 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a100b0d80 0x7f2a100c89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:16.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:16.059+0000 7f2a151ff700 1 --2- 172.21.15.45:0/2971903 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2a10158200 0x7f2a1015add0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:16.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:16.059+0000 7f2a151ff700 1 --2- 172.21.15.45:0/2971903 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2a100caa70 0x7f2a100c5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:16.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:16.059+0000 7f2a151ff700 1 -- 172.21.15.45:0/2971903 >> 172.21.15.45:0/2971903 conn(0x7f2a100cb670 msgr2=0x7f2a1006b820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:16.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:16.059+0000 7f2a151ff700 1 -- 172.21.15.45:0/2971903 shutdown_connections 2023-11-28T12:09:16.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:16.059+0000 7f2a151ff700 1 -- 172.21.15.45:0/2971903 wait complete. 2023-11-28T12:09:16.080 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T12:09:16.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:16.282+0000 7f92505ff700 1 Processor -- start 2023-11-28T12:09:16.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:16.282+0000 7f92505ff700 1 -- start start 2023-11-28T12:09:16.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:16.283+0000 7f92505ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f9248161340 0x7f92480d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:16.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:16.283+0000 7f92505ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f92480d2320 0x7f92480cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:16.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:16.283+0000 7f92505ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92480d1950 con 0x7f924815c9b0 2023-11-28T12:09:16.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:16.283+0000 7f92505ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92480b5800 con 0x7f9248161340 2023-11-28T12:09:16.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:16.283+0000 7f92505ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92480b5300 con 0x7f92480d2320 2023-11-28T12:09:16.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:16.284+0000 7f924eb9c700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f92480d2320 0x7f92480cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:16.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:16.284+0000 7f924eb9c700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f92480d2320 0x7f92480cd7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.45:47062/0 (socket says 172.21.15.45:47062) 2023-11-28T12:09:16.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:16.284+0000 7f924eb9c700 1 -- 172.21.15.45:0/807094553 learned_addr learned my addr 172.21.15.45:0/807094553 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:09:16.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:16.284+0000 7f924db9a700 1 --2- 172.21.15.45:0/807094553 >> v2:172.21.15.152:3300/0 conn(0x7f9248161340 0x7f92480d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:16.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:16.284+0000 7f924eb9c700 1 -- 172.21.15.45:0/807094553 >> v2:172.21.15.152:3300/0 conn(0x7f9248161340 msgr2=0x7f92480d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:16.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:16.284+0000 7f924eb9c700 1 --2- 172.21.15.45:0/807094553 >> v2:172.21.15.152:3300/0 conn(0x7f9248161340 0x7f92480d1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:16.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:16.284+0000 7f924d399700 1 -- 172.21.15.45:0/807094553 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1273735553 0 0) 0x7f92480d1950 con 0x7f924815c9b0 2023-11-28T12:09:16.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:16.284+0000 7f924eb9c700 1 -- 172.21.15.45:0/807094553 >> v1:172.21.15.152:6789/0 conn(0x7f924815c9b0 legacy=0x7f92480b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:16.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:16.284+0000 7f924eb9c700 1 -- 172.21.15.45:0/807094553 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92480b5520 con 0x7f92480d2320 2023-11-28T12:09:16.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:16.285+0000 7f924eb9c700 1 --2- 172.21.15.45:0/807094553 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f92480d2320 0x7f92480cd7c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9240009e50 tx=0x7f924000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15e706550d05abb0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:16.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:16.285+0000 7f924d399700 1 -- 172.21.15.45:0/807094553 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f924000e070 con 0x7f92480d2320 2023-11-28T12:09:16.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:16.285+0000 7f924d399700 1 -- 172.21.15.45:0/807094553 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f924000b910 con 0x7f92480d2320 2023-11-28T12:09:16.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:16.285+0000 7f924d399700 1 -- 172.21.15.45:0/807094553 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f924000bcc0 con 0x7f92480d2320 2023-11-28T12:09:16.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:16.285+0000 7f92505ff700 1 -- 172.21.15.45:0/807094553 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f92480d2320 msgr2=0x7f92480cd7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:16.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:16.285+0000 7f92505ff700 1 --2- 172.21.15.45:0/807094553 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f92480d2320 0x7f92480cd7c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9240009e50 tx=0x7f924000b330 comp rx=0 tx=0).stop 2023-11-28T12:09:16.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:16.285+0000 7f92505ff700 1 -- 172.21.15.45:0/807094553 shutdown_connections 2023-11-28T12:09:16.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:16.285+0000 7f92505ff700 1 --2- 172.21.15.45:0/807094553 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f92480d2320 0x7f92480cd7c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:16.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:16.285+0000 7f92505ff700 1 --2- 172.21.15.45:0/807094553 >> v2:172.21.15.152:3300/0 conn(0x7f9248161340 0x7f92480d1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:16.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:16.286+0000 7f92505ff700 1 -- 172.21.15.45:0/807094553 >> 172.21.15.45:0/807094553 conn(0x7f9248072600 msgr2=0x7f92480cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:16.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:16.286+0000 7f92505ff700 1 -- 172.21.15.45:0/807094553 shutdown_connections 2023-11-28T12:09:16.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:16.286+0000 7f92505ff700 1 -- 172.21.15.45:0/807094553 wait complete. 2023-11-28T12:09:16.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:16.287+0000 7f92505ff700 1 Processor -- start 2023-11-28T12:09:16.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:16.287+0000 7f92505ff700 1 -- start start 2023-11-28T12:09:16.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:16.288+0000 7f92505ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f92480d2320 0x7f924814d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:16.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:16.288+0000 7f92505ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f924815c9b0 0x7f924815e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:16.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:16.288+0000 7f92505ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9248161340 0x7f924815ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:16.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:16.288+0000 7f92505ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92480c7b00 con 0x7f9248161340 2023-11-28T12:09:16.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:16.288+0000 7f92505ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92480c6ca0 con 0x7f92480d2320 2023-11-28T12:09:16.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:16.288+0000 7f92505ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92480c6ef0 con 0x7f924815c9b0 2023-11-28T12:09:16.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:16.289+0000 7f924eb9c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9248161340 0x7f924815ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:16.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:16.289+0000 7f924e39b700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f92480d2320 0x7f924814d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:16.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:16.289+0000 7f924eb9c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9248161340 0x7f924815ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40430/0 (socket says 172.21.15.45:40430) 2023-11-28T12:09:16.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:16.289+0000 7f924eb9c700 1 -- 172.21.15.45:0/4259307722 learned_addr learned my addr 172.21.15.45:0/4259307722 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:09:16.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:16.289+0000 7f924db9a700 1 --2- 172.21.15.45:0/4259307722 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f924815c9b0 0x7f924815e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:16.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:16.289+0000 7f924eb9c700 1 -- 172.21.15.45:0/4259307722 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f924815c9b0 msgr2=0x7f924815e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:16.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:16.289+0000 7f924eb9c700 1 --2- 172.21.15.45:0/4259307722 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f924815c9b0 0x7f924815e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:16.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:16.289+0000 7f924eb9c700 1 -- 172.21.15.45:0/4259307722 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f92480d2320 msgr2=0x7f924814d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:16.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:16.289+0000 7f924eb9c700 1 --2- 172.21.15.45:0/4259307722 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f92480d2320 0x7f924814d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:16.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:16.289+0000 7f924eb9c700 1 -- 172.21.15.45:0/4259307722 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9240009b30 con 0x7f9248161340 2023-11-28T12:09:16.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:16.290+0000 7f924eb9c700 1 --2- 172.21.15.45:0/4259307722 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9248161340 0x7f924815ea80 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f9240012000 tx=0x7f9240004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:16.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:16.290+0000 7f923effd700 1 -- 172.21.15.45:0/4259307722 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9240003ea0 con 0x7f9248161340 2023-11-28T12:09:16.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:16.290+0000 7f923effd700 1 -- 172.21.15.45:0/4259307722 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92400048e0 con 0x7f9248161340 2023-11-28T12:09:16.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:16.290+0000 7f923effd700 1 -- 172.21.15.45:0/4259307722 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f924001b670 con 0x7f9248161340 2023-11-28T12:09:16.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:16.290+0000 7f92505ff700 1 -- 172.21.15.45:0/4259307722 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92480d15e0 con 0x7f9248161340 2023-11-28T12:09:16.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:16.290+0000 7f92505ff700 1 -- 172.21.15.45:0/4259307722 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92480d1300 con 0x7f9248161340 2023-11-28T12:09:16.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:16.291+0000 7f92505ff700 1 -- 172.21.15.45:0/4259307722 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f924815cd80 con 0x7f9248161340 2023-11-28T12:09:16.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:16.292+0000 7f923effd700 1 -- 172.21.15.45:0/4259307722 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f924002b070 con 0x7f9248161340 2023-11-28T12:09:16.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:16.293+0000 7f923effd700 1 --2- 172.21.15.45:0/4259307722 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f922c0682f0 0x7f922c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:16.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:16.293+0000 7f923effd700 1 -- 172.21.15.45:0/4259307722 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9240087440 con 0x7f9248161340 2023-11-28T12:09:16.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:16.293+0000 7f924e39b700 1 --2- 172.21.15.45:0/4259307722 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f922c0682f0 0x7f922c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:16.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:16.294+0000 7f924e39b700 1 --2- 172.21.15.45:0/4259307722 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f922c0682f0 0x7f922c06a7a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f9244007fd0 tx=0x7f9244009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:16.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:16.297+0000 7f923effd700 1 -- 172.21.15.45:0/4259307722 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f9240053bb0 con 0x7f9248161340 2023-11-28T12:09:16.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:16.518+0000 7f92505ff700 1 -- 172.21.15.45:0/4259307722 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f92480745c0 con 0x7f9248161340 2023-11-28T12:09:16.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:16.519+0000 7f923effd700 1 -- 172.21.15.45:0/4259307722 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v47) v1 ==== 80+0+0 (secure 0 0 0) 0x7f92400571d0 con 0x7f9248161340 2023-11-28T12:09:16.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:16.521+0000 7f92505ff700 1 -- 172.21.15.45:0/4259307722 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f922c0682f0 msgr2=0x7f922c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:16.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:16.521+0000 7f92505ff700 1 --2- 172.21.15.45:0/4259307722 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f922c0682f0 0x7f922c06a7a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f9244007fd0 tx=0x7f9244009040 comp rx=0 tx=0).stop 2023-11-28T12:09:16.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:16.521+0000 7f92505ff700 1 -- 172.21.15.45:0/4259307722 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9248161340 msgr2=0x7f924815ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:16.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:16.521+0000 7f92505ff700 1 --2- 172.21.15.45:0/4259307722 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9248161340 0x7f924815ea80 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f9240012000 tx=0x7f9240004ad0 comp rx=0 tx=0).stop 2023-11-28T12:09:16.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:16.521+0000 7f92505ff700 1 -- 172.21.15.45:0/4259307722 shutdown_connections 2023-11-28T12:09:16.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:16.521+0000 7f92505ff700 1 --2- 172.21.15.45:0/4259307722 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f922c0682f0 0x7f922c06a7a0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:16.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:16.521+0000 7f92505ff700 1 --2- 172.21.15.45:0/4259307722 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f92480d2320 0x7f924814d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:16.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:16.521+0000 7f92505ff700 1 --2- 172.21.15.45:0/4259307722 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9248161340 0x7f924815ea80 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:16.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:16.521+0000 7f92505ff700 1 --2- 172.21.15.45:0/4259307722 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f924815c9b0 0x7f924815e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:16.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:16.521+0000 7f92505ff700 1 -- 172.21.15.45:0/4259307722 >> 172.21.15.45:0/4259307722 conn(0x7f9248072600 msgr2=0x7f92480b5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:16.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:16.521+0000 7f92505ff700 1 -- 172.21.15.45:0/4259307722 shutdown_connections 2023-11-28T12:09:16.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:16.521+0000 7f92505ff700 1 -- 172.21.15.45:0/4259307722 wait complete. 2023-11-28T12:09:16.524 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-11-28T12:09:16.540 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-28T12:09:16.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:09:16.541 DEBUG:teuthology.orchestra.run.smithi045:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-11-28T12:09:16.634 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi045.front.sepia.ceph.com 2023-11-28T12:09:16.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:09:16.635 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-28T12:09:16.706 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-11-28T12:09:16.706 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T12:09:16.756 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16348296k,nr_inodes=4087074,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=41,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275620k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-11-28T12:09:16.756 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T12:09:16.756 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T12:09:16.803 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16351388k,nr_inodes=4087847,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=41,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3276240k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-11-28T12:09:16.803 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-11-28T12:09:16.803 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T12:09:16.851 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16348296k,nr_inodes=4087074,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=41,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275620k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-11-28T12:09:16.852 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T12:09:17.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.054+0000 7fd7327ff700 1 Processor -- start 2023-11-28T12:09:17.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.055+0000 7fd7327ff700 1 -- start start 2023-11-28T12:09:17.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.056+0000 7fd7327ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fd72c15c9b0 0x7fd72c0b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:17.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.056+0000 7fd7327ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd72c0cd7c0 0x7fd72c0cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:17.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.056+0000 7fd7327ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd72c0d1950 con 0x7fd72c161340 2023-11-28T12:09:17.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.056+0000 7fd7327ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd72c0b5800 con 0x7fd72c15c9b0 2023-11-28T12:09:17.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.056+0000 7fd7327ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd72c0ce140 con 0x7fd72c0cd7c0 2023-11-28T12:09:17.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.056+0000 7fd72b7fe700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fd72c161340 0x7fd72c0d1de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:53564/0 (socket says 172.21.15.45:53564) 2023-11-28T12:09:17.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.056+0000 7fd72b7fe700 1 -- 172.21.15.45:0/620579044 learned_addr learned my addr 172.21.15.45:0/620579044 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:09:17.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.056+0000 7fd72bfff700 1 --2- 172.21.15.45:0/620579044 >> v2:172.21.15.152:3300/0 conn(0x7fd72c15c9b0 0x7fd72c0b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:17.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.056+0000 7fd730d9c700 1 --2- 172.21.15.45:0/620579044 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd72c0cd7c0 0x7fd72c0cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:17.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.057+0000 7fd72affd700 1 -- 172.21.15.45:0/620579044 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3135306082 0 0) 0x7fd72c0d1950 con 0x7fd72c161340 2023-11-28T12:09:17.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.057+0000 7fd72affd700 1 -- 172.21.15.45:0/620579044 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7140035b0 con 0x7fd72c161340 2023-11-28T12:09:17.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.057+0000 7fd730d9c700 1 -- 172.21.15.45:0/620579044 >> v2:172.21.15.152:3300/0 conn(0x7fd72c15c9b0 msgr2=0x7fd72c0b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:17.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.057+0000 7fd730d9c700 1 --2- 172.21.15.45:0/620579044 >> v2:172.21.15.152:3300/0 conn(0x7fd72c15c9b0 0x7fd72c0b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:17.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.057+0000 7fd730d9c700 1 -- 172.21.15.45:0/620579044 >> v1:172.21.15.45:6789/0 conn(0x7fd72c161340 legacy=0x7fd72c0d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:17.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.057+0000 7fd730d9c700 1 -- 172.21.15.45:0/620579044 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd72c0d24f0 con 0x7fd72c0cd7c0 2023-11-28T12:09:17.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.057+0000 7fd730d9c700 1 --2- 172.21.15.45:0/620579044 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd72c0cd7c0 0x7fd72c0cdc00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd724009d90 tx=0x7fd72400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc7a45742ce5d1c3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:17.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.057+0000 7fd72affd700 1 -- 172.21.15.45:0/620579044 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd72400e070 con 0x7fd72c0cd7c0 2023-11-28T12:09:17.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.057+0000 7fd72affd700 1 -- 172.21.15.45:0/620579044 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd72400bb20 con 0x7fd72c0cd7c0 2023-11-28T12:09:17.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.057+0000 7fd72affd700 1 -- 172.21.15.45:0/620579044 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd724012430 con 0x7fd72c0cd7c0 2023-11-28T12:09:17.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.058+0000 7fd7327ff700 1 -- 172.21.15.45:0/620579044 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd72c0cd7c0 msgr2=0x7fd72c0cdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:17.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.058+0000 7fd7327ff700 1 --2- 172.21.15.45:0/620579044 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd72c0cd7c0 0x7fd72c0cdc00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd724009d90 tx=0x7fd72400b330 comp rx=0 tx=0).stop 2023-11-28T12:09:17.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.058+0000 7fd7327ff700 1 -- 172.21.15.45:0/620579044 shutdown_connections 2023-11-28T12:09:17.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.058+0000 7fd7327ff700 1 --2- 172.21.15.45:0/620579044 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd72c0cd7c0 0x7fd72c0cdc00 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:17.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.058+0000 7fd7327ff700 1 --2- 172.21.15.45:0/620579044 >> v2:172.21.15.152:3300/0 conn(0x7fd72c15c9b0 0x7fd72c0b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:17.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.058+0000 7fd7327ff700 1 -- 172.21.15.45:0/620579044 >> 172.21.15.45:0/620579044 conn(0x7fd72c072600 msgr2=0x7fd72c0cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:17.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.058+0000 7fd7327ff700 1 -- 172.21.15.45:0/620579044 shutdown_connections 2023-11-28T12:09:17.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.058+0000 7fd7327ff700 1 -- 172.21.15.45:0/620579044 wait complete. 2023-11-28T12:09:17.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.060+0000 7fd7327ff700 1 Processor -- start 2023-11-28T12:09:17.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.061+0000 7fd7327ff700 1 -- start start 2023-11-28T12:09:17.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.062+0000 7fd7327ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd72c0cd7c0 0x7fd72c15e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:17.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.062+0000 7fd7327ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd72c15c9b0 0x7fd72c1e76f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:17.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.062+0000 7fd7327ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd72c161340 0x7fd72c157220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:17.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.062+0000 7fd7327ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd72c1e8ce0 con 0x7fd72c15c9b0 2023-11-28T12:09:17.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.062+0000 7fd7327ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd72c1e9100 con 0x7fd72c0cd7c0 2023-11-28T12:09:17.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.062+0000 7fd7327ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd72c1e8060 con 0x7fd72c161340 2023-11-28T12:09:17.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.062+0000 7fd72b7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd72c15c9b0 0x7fd72c1e76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:17.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.062+0000 7fd72b7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd72c15c9b0 0x7fd72c1e76f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40442/0 (socket says 172.21.15.45:40442) 2023-11-28T12:09:17.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.062+0000 7fd72b7fe700 1 -- 172.21.15.45:0/1478881383 learned_addr learned my addr 172.21.15.45:0/1478881383 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:09:17.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.062+0000 7fd72bfff700 1 --2- 172.21.15.45:0/1478881383 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd72c0cd7c0 0x7fd72c15e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:17.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.062+0000 7fd730d9c700 1 --2- 172.21.15.45:0/1478881383 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd72c161340 0x7fd72c157220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:17.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.063+0000 7fd72b7fe700 1 -- 172.21.15.45:0/1478881383 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd72c161340 msgr2=0x7fd72c157220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:17.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.063+0000 7fd72b7fe700 1 --2- 172.21.15.45:0/1478881383 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd72c161340 0x7fd72c157220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:17.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.063+0000 7fd72b7fe700 1 -- 172.21.15.45:0/1478881383 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd72c0cd7c0 msgr2=0x7fd72c15e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:17.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.063+0000 7fd72b7fe700 1 --2- 172.21.15.45:0/1478881383 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd72c0cd7c0 0x7fd72c15e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:17.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.063+0000 7fd72b7fe700 1 -- 172.21.15.45:0/1478881383 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd724009a70 con 0x7fd72c15c9b0 2023-11-28T12:09:17.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.063+0000 7fd72b7fe700 1 --2- 172.21.15.45:0/1478881383 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd72c15c9b0 0x7fd72c1e76f0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fd72000c700 tx=0x7fd72000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:17.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.063+0000 7fd728ff9700 1 -- 172.21.15.45:0/1478881383 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd720005d70 con 0x7fd72c15c9b0 2023-11-28T12:09:17.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.063+0000 7fd728ff9700 1 -- 172.21.15.45:0/1478881383 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7200070d0 con 0x7fd72c15c9b0 2023-11-28T12:09:17.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.063+0000 7fd7327ff700 1 -- 172.21.15.45:0/1478881383 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd72c0d1300 con 0x7fd72c15c9b0 2023-11-28T12:09:17.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.063+0000 7fd728ff9700 1 -- 172.21.15.45:0/1478881383 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd720007460 con 0x7fd72c15c9b0 2023-11-28T12:09:17.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.063+0000 7fd7327ff700 1 -- 172.21.15.45:0/1478881383 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd72c0b5520 con 0x7fd72c15c9b0 2023-11-28T12:09:17.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.065+0000 7fd7327ff700 1 -- 172.21.15.45:0/1478881383 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd72c0d15e0 con 0x7fd72c15c9b0 2023-11-28T12:09:17.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.066+0000 7fd728ff9700 1 -- 172.21.15.45:0/1478881383 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fd720019030 con 0x7fd72c15c9b0 2023-11-28T12:09:17.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.066+0000 7fd728ff9700 1 --2- 172.21.15.45:0/1478881383 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fd7180682f0 0x7fd71806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:17.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.066+0000 7fd728ff9700 1 -- 172.21.15.45:0/1478881383 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd720084fa0 con 0x7fd72c15c9b0 2023-11-28T12:09:17.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.067+0000 7fd72bfff700 1 --2- 172.21.15.45:0/1478881383 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fd7180682f0 0x7fd71806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:17.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.068+0000 7fd72bfff700 1 --2- 172.21.15.45:0/1478881383 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fd7180682f0 0x7fd71806a7a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fd71c009b40 tx=0x7fd71c009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:17.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.070+0000 7fd728ff9700 1 -- 172.21.15.45:0/1478881383 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fd720051800 con 0x7fd72c15c9b0 2023-11-28T12:09:17.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.318+0000 7fd7327ff700 1 -- 172.21.15.45:0/1478881383 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd72c1e8e20 con 0x7fd72c15c9b0 2023-11-28T12:09:17.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.319+0000 7fd728ff9700 1 -- 172.21.15.45:0/1478881383 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4651 (secure 0 0 0) 0x7fd72c1e8e20 con 0x7fd72c15c9b0 2023-11-28T12:09:17.320 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:09:17.321 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5398,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6836/2532875180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":2532875180},{"type":"v1","addr":"172.21.15.152:6836","nonce":2532875180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5404,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/930111917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6835","nonce":930111917},{"type":"v1","addr":"172.21.15.152:6837","nonce":930111917}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5547,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/1974473454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1974473454},{"type":"v1","addr":"172.21.15.45:6834","nonce":1974473454}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T12:08:31.391914+0000","modified":"2023-11-28T12:08:34.873102+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5550},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5550":{"gid":5550,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/1281816633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":1281816633},{"type":"v1","addr":"172.21.15.45:6835","nonce":1281816633}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-28T12:09:17.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.321+0000 7fd7327ff700 1 -- 172.21.15.45:0/1478881383 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fd7180682f0 msgr2=0x7fd71806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:17.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.321+0000 7fd7327ff700 1 --2- 172.21.15.45:0/1478881383 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fd7180682f0 0x7fd71806a7a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fd71c009b40 tx=0x7fd71c009210 comp rx=0 tx=0).stop 2023-11-28T12:09:17.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.321+0000 7fd7327ff700 1 -- 172.21.15.45:0/1478881383 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd72c15c9b0 msgr2=0x7fd72c1e76f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:17.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.321+0000 7fd7327ff700 1 --2- 172.21.15.45:0/1478881383 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd72c15c9b0 0x7fd72c1e76f0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fd72000c700 tx=0x7fd72000ca10 comp rx=0 tx=0).stop 2023-11-28T12:09:17.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.321+0000 7fd7327ff700 1 -- 172.21.15.45:0/1478881383 shutdown_connections 2023-11-28T12:09:17.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.321+0000 7fd7327ff700 1 --2- 172.21.15.45:0/1478881383 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fd7180682f0 0x7fd71806a7a0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:17.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.321+0000 7fd7327ff700 1 --2- 172.21.15.45:0/1478881383 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd72c0cd7c0 0x7fd72c15e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:17.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.321+0000 7fd7327ff700 1 --2- 172.21.15.45:0/1478881383 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fd72c161340 0x7fd72c157220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:17.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.321+0000 7fd7327ff700 1 --2- 172.21.15.45:0/1478881383 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd72c15c9b0 0x7fd72c1e76f0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:17.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.321+0000 7fd7327ff700 1 -- 172.21.15.45:0/1478881383 >> 172.21.15.45:0/1478881383 conn(0x7fd72c072600 msgr2=0x7fd72c15a250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:17.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.321+0000 7fd7327ff700 1 -- 172.21.15.45:0/1478881383 shutdown_connections 2023-11-28T12:09:17.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.321+0000 7fd7327ff700 1 -- 172.21.15.45:0/1478881383 wait complete. 2023-11-28T12:09:17.325 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 24 2023-11-28T12:09:17.341 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T12:09:17.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.543+0000 7f898d7ff700 1 Processor -- start 2023-11-28T12:09:17.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.543+0000 7f898d7ff700 1 -- start start 2023-11-28T12:09:17.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.544+0000 7f898d7ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8988159490 0x7f89880b0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:17.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.544+0000 7f898d7ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f8988159860 0x7f89880b0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:17.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.544+0000 7f898d7ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89880ccc00 con 0x7f89880cdc80 2023-11-28T12:09:17.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.544+0000 7f898d7ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89880ccec0 con 0x7f8988159490 2023-11-28T12:09:17.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.544+0000 7f898d7ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89880cd1a0 con 0x7f8988159860 2023-11-28T12:09:17.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.544+0000 7f8986ffd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8988159490 0x7f89880b0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:17.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.544+0000 7f89877fe700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f89880cdc80 0x7f89880c94c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:53572/0 (socket says 172.21.15.45:53572) 2023-11-28T12:09:17.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.544+0000 7f89877fe700 1 -- 172.21.15.45:0/293306391 learned_addr learned my addr 172.21.15.45:0/293306391 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:09:17.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.545+0000 7f89867fc700 1 --2- 172.21.15.45:0/293306391 >> v2:172.21.15.152:3300/0 conn(0x7f8988159860 0x7f89880b0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:17.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.545+0000 7f8986ffd700 1 -- 172.21.15.45:0/293306391 >> v2:172.21.15.152:3300/0 conn(0x7f8988159860 msgr2=0x7f89880b0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:17.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.545+0000 7f8986ffd700 1 --2- 172.21.15.45:0/293306391 >> v2:172.21.15.152:3300/0 conn(0x7f8988159860 0x7f89880b0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:17.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.545+0000 7f8986ffd700 1 -- 172.21.15.45:0/293306391 >> v1:172.21.15.45:6789/0 conn(0x7f89880cdc80 legacy=0x7f89880c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:17.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.545+0000 7f8986ffd700 1 -- 172.21.15.45:0/293306391 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89880cd480 con 0x7f8988159490 2023-11-28T12:09:17.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.545+0000 7f8986ffd700 1 --2- 172.21.15.45:0/293306391 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8988159490 0x7f89880b0670 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f89880cb5d0 tx=0x7f8978009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88203267d31e702 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:17.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.545+0000 7f8985ffb700 1 -- 172.21.15.45:0/293306391 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8978011830 con 0x7f8988159490 2023-11-28T12:09:17.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.545+0000 7f8985ffb700 1 -- 172.21.15.45:0/293306391 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8978011990 con 0x7f8988159490 2023-11-28T12:09:17.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.545+0000 7f8985ffb700 1 -- 172.21.15.45:0/293306391 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8978011d20 con 0x7f8988159490 2023-11-28T12:09:17.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.546+0000 7f898d7ff700 1 -- 172.21.15.45:0/293306391 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8988159490 msgr2=0x7f89880b0670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:17.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.546+0000 7f898d7ff700 1 --2- 172.21.15.45:0/293306391 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8988159490 0x7f89880b0670 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f89880cb5d0 tx=0x7f8978009b20 comp rx=0 tx=0).stop 2023-11-28T12:09:17.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.546+0000 7f898d7ff700 1 -- 172.21.15.45:0/293306391 shutdown_connections 2023-11-28T12:09:17.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.546+0000 7f898d7ff700 1 --2- 172.21.15.45:0/293306391 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8988159490 0x7f89880b0670 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:17.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.546+0000 7f898d7ff700 1 --2- 172.21.15.45:0/293306391 >> v2:172.21.15.152:3300/0 conn(0x7f8988159860 0x7f89880b0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:17.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.546+0000 7f898d7ff700 1 -- 172.21.15.45:0/293306391 >> 172.21.15.45:0/293306391 conn(0x7f89880cb670 msgr2=0x7f89880cba70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:17.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.546+0000 7f898d7ff700 1 -- 172.21.15.45:0/293306391 shutdown_connections 2023-11-28T12:09:17.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.546+0000 7f898d7ff700 1 -- 172.21.15.45:0/293306391 wait complete. 2023-11-28T12:09:17.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.548+0000 7f898d7ff700 1 Processor -- start 2023-11-28T12:09:17.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.548+0000 7f898d7ff700 1 -- start start 2023-11-28T12:09:17.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.549+0000 7f898d7ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f89880cdc80 0x7f89880c4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:17.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.549+0000 7f898d7ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8988159490 0x7f8988166fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:17.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.549+0000 7f898d7ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8988165480 0x7f8988165920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:17.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.549+0000 7f898d7ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8988166b50 con 0x7f8988165480 2023-11-28T12:09:17.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.549+0000 7f898d7ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8988165f40 con 0x7f8988159490 2023-11-28T12:09:17.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.549+0000 7f898d7ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8988166220 con 0x7f89880cdc80 2023-11-28T12:09:17.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.549+0000 7f89877fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8988165480 0x7f8988165920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:17.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.549+0000 7f89877fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8988165480 0x7f8988165920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40470/0 (socket says 172.21.15.45:40470) 2023-11-28T12:09:17.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.549+0000 7f89877fe700 1 -- 172.21.15.45:0/1159180456 learned_addr learned my addr 172.21.15.45:0/1159180456 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:09:17.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.549+0000 7f8986ffd700 1 --2- 172.21.15.45:0/1159180456 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f89880cdc80 0x7f89880c4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:17.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.549+0000 7f89867fc700 1 --2- 172.21.15.45:0/1159180456 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8988159490 0x7f8988166fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:17.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.549+0000 7f89877fe700 1 -- 172.21.15.45:0/1159180456 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f89880cdc80 msgr2=0x7f89880c4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:17.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.549+0000 7f89877fe700 1 --2- 172.21.15.45:0/1159180456 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f89880cdc80 0x7f89880c4c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:17.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.549+0000 7f89877fe700 1 -- 172.21.15.45:0/1159180456 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8988159490 msgr2=0x7f8988166fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:17.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.549+0000 7f89877fe700 1 --2- 172.21.15.45:0/1159180456 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8988159490 0x7f8988166fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:17.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.549+0000 7f89877fe700 1 -- 172.21.15.45:0/1159180456 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89780094a0 con 0x7f8988165480 2023-11-28T12:09:17.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.549+0000 7f8986ffd700 1 --2- 172.21.15.45:0/1159180456 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f89880cdc80 0x7f89880c4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:09:17.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.549+0000 7f89867fc700 1 --2- 172.21.15.45:0/1159180456 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8988159490 0x7f8988166fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:09:17.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.550+0000 7f89877fe700 1 --2- 172.21.15.45:0/1159180456 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8988165480 0x7f8988165920 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f898000cbc0 tx=0x7f898000cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:17.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.550+0000 7f896f7fe700 1 -- 172.21.15.45:0/1159180456 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f898000ab50 con 0x7f8988165480 2023-11-28T12:09:17.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.550+0000 7f896f7fe700 1 -- 172.21.15.45:0/1159180456 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f898000acb0 con 0x7f8988165480 2023-11-28T12:09:17.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.550+0000 7f896f7fe700 1 -- 172.21.15.45:0/1159180456 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8980012600 con 0x7f8988165480 2023-11-28T12:09:17.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.550+0000 7f898d7ff700 1 -- 172.21.15.45:0/1159180456 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89880c9bd0 con 0x7f8988165480 2023-11-28T12:09:17.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.550+0000 7f898d7ff700 1 -- 172.21.15.45:0/1159180456 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89880cd760 con 0x7f8988165480 2023-11-28T12:09:17.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.551+0000 7f898d7ff700 1 -- 172.21.15.45:0/1159180456 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89880c9d60 con 0x7f8988165480 2023-11-28T12:09:17.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.552+0000 7f896f7fe700 1 -- 172.21.15.45:0/1159180456 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f8980019030 con 0x7f8988165480 2023-11-28T12:09:17.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.553+0000 7f896f7fe700 1 --2- 172.21.15.45:0/1159180456 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f89740682f0 0x7f897406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:17.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.553+0000 7f896f7fe700 1 -- 172.21.15.45:0/1159180456 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8980085850 con 0x7f8988165480 2023-11-28T12:09:17.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.553+0000 7f8986ffd700 1 --2- 172.21.15.45:0/1159180456 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f89740682f0 0x7f897406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:17.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.554+0000 7f8986ffd700 1 --2- 172.21.15.45:0/1159180456 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f89740682f0 0x7f897406a7a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f89780090b0 tx=0x7f8978008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:17.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.557+0000 7f896f7fe700 1 -- 172.21.15.45:0/1159180456 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f898004b5e0 con 0x7f8988165480 2023-11-28T12:09:17.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.760+0000 7f898d7ff700 1 -- 172.21.15.45:0/1159180456 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f89880745c0 con 0x7f8988165480 2023-11-28T12:09:17.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.762+0000 7f896f7fe700 1 -- 172.21.15.45:0/1159180456 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+17921 (secure 0 0 0) 0x7f8980052070 con 0x7f8988165480 2023-11-28T12:09:17.764 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:09:17.764 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":47,"fsid":"bd7c37f1-f7c6-4778-b845-52cf2aa6e366","created":"2023-11-28T12:06:09.045075+0000","modified":"2023-11-28T12:08:32.394210+0000","last_up_change":"2023-11-28T12:06:21.282227+0000","last_in_change":"2023-11-28T12:06:12.560924+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T12:06:21.807108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T12:06:22.491009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-11-28T12:08:29.364957+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-11-28T12:08:30.374968+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d0cdd8a-87fd-4f2c-91bd-47bdfa661905","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":115843},{"type":"v1","addr":"172.21.15.45:6808","nonce":115843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":115843},{"type":"v1","addr":"172.21.15.45:6811","nonce":115843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":115843},{"type":"v1","addr":"172.21.15.45:6815","nonce":115843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":115843},{"type":"v1","addr":"172.21.15.45:6813","nonce":115843}]},"public_addr":"172.21.15.45:6808/115843","cluster_addr":"172.21.15.45:6811/115843","heartbeat_back_addr":"172.21.15.45:6815/115843","heartbeat_front_addr":"172.21.15.45:6813/115843","state":["exists","up"]},{"osd":1,"uuid":"c5de4ebd-9ec5-40b3-9caa-9b706fab4c76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":115842},{"type":"v1","addr":"172.21.15.45:6801","nonce":115842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":115842},{"type":"v1","addr":"172.21.15.45:6803","nonce":115842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6807","nonce":115842},{"type":"v1","addr":"172.21.15.45:6809","nonce":115842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":115842},{"type":"v1","addr":"172.21.15.45:6805","nonce":115842}]},"public_addr":"172.21.15.45:6801/115842","cluster_addr":"172.21.15.45:6803/115842","heartbeat_back_addr":"172.21.15.45:6809/115842","heartbeat_front_addr":"172.21.15.45:6805/115842","state":["exists","up"]},{"osd":2,"uuid":"9f4b36b2-65d2-40e7-9fe6-a2991afa71c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":115850},{"type":"v1","addr":"172.21.15.45:6819","nonce":115850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":115850},{"type":"v1","addr":"172.21.15.45:6823","nonce":115850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":115850},{"type":"v1","addr":"172.21.15.45:6831","nonce":115850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":115850},{"type":"v1","addr":"172.21.15.45:6828","nonce":115850}]},"public_addr":"172.21.15.45:6819/115850","cluster_addr":"172.21.15.45:6823/115850","heartbeat_back_addr":"172.21.15.45:6831/115850","heartbeat_front_addr":"172.21.15.45:6828/115850","state":["exists","up"]},{"osd":3,"uuid":"6fe7ef05-4e0d-426c-bf94-44b51d4d550b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":115848},{"type":"v1","addr":"172.21.15.45:6818","nonce":115848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":115848},{"type":"v1","addr":"172.21.15.45:6822","nonce":115848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6827","nonce":115848},{"type":"v1","addr":"172.21.15.45:6829","nonce":115848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":115848},{"type":"v1","addr":"172.21.15.45:6825","nonce":115848}]},"public_addr":"172.21.15.45:6818/115848","cluster_addr":"172.21.15.45:6822/115848","heartbeat_back_addr":"172.21.15.45:6829/115848","heartbeat_front_addr":"172.21.15.45:6825/115848","state":["exists","up"]},{"osd":4,"uuid":"fa403c08-d8a1-4a3a-8384-cb465c1a654c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":116092},{"type":"v1","addr":"172.21.15.152:6801","nonce":116092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":116092},{"type":"v1","addr":"172.21.15.152:6803","nonce":116092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":116092},{"type":"v1","addr":"172.21.15.152:6807","nonce":116092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":116092},{"type":"v1","addr":"172.21.15.152:6805","nonce":116092}]},"public_addr":"172.21.15.152:6801/116092","cluster_addr":"172.21.15.152:6803/116092","heartbeat_back_addr":"172.21.15.152:6807/116092","heartbeat_front_addr":"172.21.15.152:6805/116092","state":["exists","up"]},{"osd":5,"uuid":"399fc450-39fa-43a6-bf80-0b8bcb41bd95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6815","nonce":116093},{"type":"v1","addr":"172.21.15.152:6817","nonce":116093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":116093},{"type":"v1","addr":"172.21.15.152:6819","nonce":116093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":116093},{"type":"v1","addr":"172.21.15.152:6823","nonce":116093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":116093},{"type":"v1","addr":"172.21.15.152:6821","nonce":116093}]},"public_addr":"172.21.15.152:6817/116093","cluster_addr":"172.21.15.152:6819/116093","heartbeat_back_addr":"172.21.15.152:6823/116093","heartbeat_front_addr":"172.21.15.152:6821/116093","state":["exists","up"]},{"osd":6,"uuid":"e59a4017-2d23-4627-836b-e25b2d3ddaaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":116094},{"type":"v1","addr":"172.21.15.152:6809","nonce":116094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":116094},{"type":"v1","addr":"172.21.15.152:6811","nonce":116094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":116094},{"type":"v1","addr":"172.21.15.152:6816","nonce":116094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":116094},{"type":"v1","addr":"172.21.15.152:6813","nonce":116094}]},"public_addr":"172.21.15.152:6809/116094","cluster_addr":"172.21.15.152:6811/116094","heartbeat_back_addr":"172.21.15.152:6816/116094","heartbeat_front_addr":"172.21.15.152:6813/116094","state":["exists","up"]},{"osd":7,"uuid":"8d7f9d4b-bf08-4670-8591-388c0f012a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":116097},{"type":"v1","addr":"172.21.15.152:6825","nonce":116097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":116097},{"type":"v1","addr":"172.21.15.152:6827","nonce":116097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":116097},{"type":"v1","addr":"172.21.15.152:6831","nonce":116097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":116097},{"type":"v1","addr":"172.21.15.152:6829","nonce":116097}]},"public_addr":"172.21.15.152:6825/116097","cluster_addr":"172.21.15.152:6827/116097","heartbeat_back_addr":"172.21.15.152:6831/116097","heartbeat_front_addr":"172.21.15.152:6829/116097","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.937710+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.865423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.159434+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.913090+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.131647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.966255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.972583+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.177209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T12:09:17.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.764+0000 7f898d7ff700 1 -- 172.21.15.45:0/1159180456 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f89740682f0 msgr2=0x7f897406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:17.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.764+0000 7f898d7ff700 1 --2- 172.21.15.45:0/1159180456 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f89740682f0 0x7f897406a7a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f89780090b0 tx=0x7f8978008030 comp rx=0 tx=0).stop 2023-11-28T12:09:17.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.764+0000 7f898d7ff700 1 -- 172.21.15.45:0/1159180456 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8988165480 msgr2=0x7f8988165920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:17.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.764+0000 7f898d7ff700 1 --2- 172.21.15.45:0/1159180456 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8988165480 0x7f8988165920 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f898000cbc0 tx=0x7f898000cf80 comp rx=0 tx=0).stop 2023-11-28T12:09:17.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.764+0000 7f898d7ff700 1 -- 172.21.15.45:0/1159180456 shutdown_connections 2023-11-28T12:09:17.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.764+0000 7f898d7ff700 1 --2- 172.21.15.45:0/1159180456 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f89740682f0 0x7f897406a7a0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:17.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.764+0000 7f898d7ff700 1 --2- 172.21.15.45:0/1159180456 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8988165480 0x7f8988165920 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:17.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.764+0000 7f898d7ff700 1 --2- 172.21.15.45:0/1159180456 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f89880cdc80 0x7f89880c4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:17.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.764+0000 7f898d7ff700 1 --2- 172.21.15.45:0/1159180456 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8988159490 0x7f8988166fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:17.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.764+0000 7f898d7ff700 1 -- 172.21.15.45:0/1159180456 >> 172.21.15.45:0/1159180456 conn(0x7f89880cb670 msgr2=0x7f898806fb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:17.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.764+0000 7f898d7ff700 1 -- 172.21.15.45:0/1159180456 shutdown_connections 2023-11-28T12:09:17.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.764+0000 7f898d7ff700 1 -- 172.21.15.45:0/1159180456 wait complete. 2023-11-28T12:09:17.784 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-28T12:06:21.807108+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-28T12:06:22.491009+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T12:08:29.364957+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T12:08:30.374968+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '47', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T12:09:17.784 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T12:09:17.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.992+0000 7f502ddff700 1 Processor -- start 2023-11-28T12:09:17.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.993+0000 7f502ddff700 1 -- start start 2023-11-28T12:09:17.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.994+0000 7f502ddff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f502815c9b0 0x7f50280b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:17.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.994+0000 7f502ddff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f50280cd7c0 0x7f50280cdc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:17.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.994+0000 7f502ddff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50280ce160 con 0x7f5028161340 2023-11-28T12:09:17.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.994+0000 7f502ddff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50280b5800 con 0x7f50280cd7c0 2023-11-28T12:09:17.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.994+0000 7f502ddff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50280d1950 con 0x7f502815c9b0 2023-11-28T12:09:18.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.994+0000 7f5027fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f50280cd7c0 0x7f50280cdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:18.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.994+0000 7f5026ffd700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f5028161340 0x7f50280d1de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:53586/0 (socket says 172.21.15.45:53586) 2023-11-28T12:09:18.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.994+0000 7f5026ffd700 1 -- 172.21.15.45:0/2161859039 learned_addr learned my addr 172.21.15.45:0/2161859039 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:09:18.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.994+0000 7f50277fe700 1 --2- 172.21.15.45:0/2161859039 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f502815c9b0 0x7f50280b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:18.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.995+0000 7f5027fff700 1 -- 172.21.15.45:0/2161859039 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f502815c9b0 msgr2=0x7f50280b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:18.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.995+0000 7f5027fff700 1 --2- 172.21.15.45:0/2161859039 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f502815c9b0 0x7f50280b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:18.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.995+0000 7f5027fff700 1 -- 172.21.15.45:0/2161859039 >> v1:172.21.15.45:6789/0 conn(0x7f5028161340 legacy=0x7f50280d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:18.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.995+0000 7f5027fff700 1 -- 172.21.15.45:0/2161859039 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50280d24f0 con 0x7f50280cd7c0 2023-11-28T12:09:18.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.995+0000 7f50267fc700 1 -- 172.21.15.45:0/2161859039 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3512239964 0 0) 0x7f50280ce160 con 0x7f5028161340 2023-11-28T12:09:18.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.995+0000 7f5027fff700 1 --2- 172.21.15.45:0/2161859039 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50280cd7c0 0x7f50280cdc20 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f5020009d90 tx=0x7f502000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2575e2c9272112d3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:18.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.995+0000 7f50267fc700 1 -- 172.21.15.45:0/2161859039 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f502000e070 con 0x7f50280cd7c0 2023-11-28T12:09:18.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.995+0000 7f50267fc700 1 -- 172.21.15.45:0/2161859039 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f502000bbd0 con 0x7f50280cd7c0 2023-11-28T12:09:18.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.995+0000 7f50267fc700 1 -- 172.21.15.45:0/2161859039 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5020012430 con 0x7f50280cd7c0 2023-11-28T12:09:18.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.996+0000 7f502ddff700 1 -- 172.21.15.45:0/2161859039 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50280cd7c0 msgr2=0x7f50280cdc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:18.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.996+0000 7f502ddff700 1 --2- 172.21.15.45:0/2161859039 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50280cd7c0 0x7f50280cdc20 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f5020009d90 tx=0x7f502000b330 comp rx=0 tx=0).stop 2023-11-28T12:09:18.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.996+0000 7f502ddff700 1 -- 172.21.15.45:0/2161859039 shutdown_connections 2023-11-28T12:09:18.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.996+0000 7f502ddff700 1 --2- 172.21.15.45:0/2161859039 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50280cd7c0 0x7f50280cdc20 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:18.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.996+0000 7f502ddff700 1 --2- 172.21.15.45:0/2161859039 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f502815c9b0 0x7f50280b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:18.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.996+0000 7f502ddff700 1 -- 172.21.15.45:0/2161859039 >> 172.21.15.45:0/2161859039 conn(0x7f5028072600 msgr2=0x7f50280cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:18.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.996+0000 7f502ddff700 1 -- 172.21.15.45:0/2161859039 shutdown_connections 2023-11-28T12:09:18.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.996+0000 7f502ddff700 1 -- 172.21.15.45:0/2161859039 wait complete. 2023-11-28T12:09:18.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.998+0000 7f502ddff700 1 Processor -- start 2023-11-28T12:09:18.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.998+0000 7f502ddff700 1 -- start start 2023-11-28T12:09:18.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.999+0000 7f502ddff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50280cd7c0 0x7f50281ef7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:18.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.999+0000 7f502ddff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f502815c9b0 0x7f502815e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:18.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.999+0000 7f502ddff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5028161340 0x7f502815e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:18.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.999+0000 7f502ddff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50281f68a0 con 0x7f50280cd7c0 2023-11-28T12:09:18.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.999+0000 7f502ddff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50281e6bf0 con 0x7f502815c9b0 2023-11-28T12:09:18.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.999+0000 7f502ddff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50281e6ed0 con 0x7f5028161340 2023-11-28T12:09:18.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.999+0000 7f50277fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50280cd7c0 0x7f50281ef7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:18.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.999+0000 7f50277fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50280cd7c0 0x7f50281ef7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40494/0 (socket says 172.21.15.45:40494) 2023-11-28T12:09:18.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.999+0000 7f50277fe700 1 -- 172.21.15.45:0/2561151840 learned_addr learned my addr 172.21.15.45:0/2561151840 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:09:18.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.999+0000 7f5027fff700 1 --2- 172.21.15.45:0/2561151840 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5028161340 0x7f502815e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:18.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.999+0000 7f5026ffd700 1 --2- 172.21.15.45:0/2561151840 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f502815c9b0 0x7f502815e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:18.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.999+0000 7f50277fe700 1 -- 172.21.15.45:0/2561151840 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5028161340 msgr2=0x7f502815e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:18.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.999+0000 7f50277fe700 1 --2- 172.21.15.45:0/2561151840 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5028161340 0x7f502815e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:18.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.999+0000 7f50277fe700 1 -- 172.21.15.45:0/2561151840 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f502815c9b0 msgr2=0x7f502815e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:18.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.999+0000 7f50277fe700 1 --2- 172.21.15.45:0/2561151840 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f502815c9b0 0x7f502815e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:18.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.999+0000 7f50277fe700 1 -- 172.21.15.45:0/2561151840 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5020009a70 con 0x7f50280cd7c0 2023-11-28T12:09:18.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:17.999+0000 7f5026ffd700 1 --2- 172.21.15.45:0/2561151840 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f502815c9b0 0x7f502815e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:09:18.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.000+0000 7f50277fe700 1 --2- 172.21.15.45:0/2561151840 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50280cd7c0 0x7f50281ef7b0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f501800d800 tx=0x7f501800db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:18.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.000+0000 7f500ffff700 1 -- 172.21.15.45:0/2561151840 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50180125f0 con 0x7f50280cd7c0 2023-11-28T12:09:18.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.000+0000 7f500ffff700 1 -- 172.21.15.45:0/2561151840 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5018012750 con 0x7f50280cd7c0 2023-11-28T12:09:18.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.000+0000 7f500ffff700 1 -- 172.21.15.45:0/2561151840 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5018012b00 con 0x7f50280cd7c0 2023-11-28T12:09:18.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.000+0000 7f502ddff700 1 -- 172.21.15.45:0/2561151840 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50280d1300 con 0x7f50280cd7c0 2023-11-28T12:09:18.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.000+0000 7f502ddff700 1 -- 172.21.15.45:0/2561151840 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50280b5520 con 0x7f50280cd7c0 2023-11-28T12:09:18.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.001+0000 7f502ddff700 1 -- 172.21.15.45:0/2561151840 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50280d15e0 con 0x7f50280cd7c0 2023-11-28T12:09:18.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.002+0000 7f500ffff700 1 -- 172.21.15.45:0/2561151840 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f5018012c60 con 0x7f50280cd7c0 2023-11-28T12:09:18.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.003+0000 7f500ffff700 1 --2- 172.21.15.45:0/2561151840 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f50140682f0 0x7f501406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:18.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.003+0000 7f500ffff700 1 -- 172.21.15.45:0/2561151840 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f5018086230 con 0x7f50280cd7c0 2023-11-28T12:09:18.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.003+0000 7f5026ffd700 1 --2- 172.21.15.45:0/2561151840 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f50140682f0 0x7f501406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:18.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.004+0000 7f5026ffd700 1 --2- 172.21.15.45:0/2561151840 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f50140682f0 0x7f501406a7a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f50281e68a0 tx=0x7f501c007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:18.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.007+0000 7f500ffff700 1 -- 172.21.15.45:0/2561151840 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f5018052960 con 0x7f50280cd7c0 2023-11-28T12:09:18.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.208+0000 7f502ddff700 1 -- 172.21.15.45:0/2561151840 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f50281e7520 con 0x7f50280cd7c0 2023-11-28T12:09:18.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.208+0000 7f500ffff700 1 -- 172.21.15.45:0/2561151840 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v48) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5018055f80 con 0x7f50280cd7c0 2023-11-28T12:09:18.210 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-11-28T12:09:18.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.211+0000 7f502ddff700 1 -- 172.21.15.45:0/2561151840 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f50140682f0 msgr2=0x7f501406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:18.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.211+0000 7f502ddff700 1 --2- 172.21.15.45:0/2561151840 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f50140682f0 0x7f501406a7a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f50281e68a0 tx=0x7f501c007d30 comp rx=0 tx=0).stop 2023-11-28T12:09:18.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.211+0000 7f502ddff700 1 -- 172.21.15.45:0/2561151840 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50280cd7c0 msgr2=0x7f50281ef7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:18.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.211+0000 7f502ddff700 1 --2- 172.21.15.45:0/2561151840 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50280cd7c0 0x7f50281ef7b0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f501800d800 tx=0x7f501800db10 comp rx=0 tx=0).stop 2023-11-28T12:09:18.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.211+0000 7f502ddff700 1 -- 172.21.15.45:0/2561151840 shutdown_connections 2023-11-28T12:09:18.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.211+0000 7f502ddff700 1 --2- 172.21.15.45:0/2561151840 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f50140682f0 0x7f501406a7a0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:18.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.211+0000 7f502ddff700 1 --2- 172.21.15.45:0/2561151840 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5028161340 0x7f502815e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:18.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.211+0000 7f502ddff700 1 --2- 172.21.15.45:0/2561151840 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50280cd7c0 0x7f50281ef7b0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:18.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.211+0000 7f502ddff700 1 --2- 172.21.15.45:0/2561151840 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f502815c9b0 0x7f502815e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:18.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.211+0000 7f502ddff700 1 -- 172.21.15.45:0/2561151840 >> 172.21.15.45:0/2561151840 conn(0x7f5028072600 msgr2=0x7f50280b8940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:18.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.211+0000 7f502ddff700 1 -- 172.21.15.45:0/2561151840 shutdown_connections 2023-11-28T12:09:18.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.211+0000 7f502ddff700 1 -- 172.21.15.45:0/2561151840 wait complete. 2023-11-28T12:09:18.230 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T12:09:18.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.438+0000 7f291e5ff700 1 Processor -- start 2023-11-28T12:09:18.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.438+0000 7f291e5ff700 1 -- start start 2023-11-28T12:09:18.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.438+0000 7f291e5ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f29180cd7c0 0x7f29180cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:18.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.438+0000 7f291e5ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29180d1950 con 0x7f2918161340 2023-11-28T12:09:18.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.438+0000 7f291e5ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29180ce140 con 0x7f291815c9b0 2023-11-28T12:09:18.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.438+0000 7f291e5ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29180b5800 con 0x7f29180cd7c0 2023-11-28T12:09:18.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.439+0000 7f29177fe700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f2918161340 0x7f29180d1de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:53588/0 (socket says 172.21.15.45:53588) 2023-11-28T12:09:18.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.439+0000 7f29177fe700 1 -- 172.21.15.45:0/2830688011 learned_addr learned my addr 172.21.15.45:0/2830688011 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:09:18.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.439+0000 7f291cb9c700 1 --2- 172.21.15.45:0/2830688011 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f29180cd7c0 0x7f29180cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:18.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.439+0000 7f2916ffd700 1 -- 172.21.15.45:0/2830688011 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3704164806 0 0) 0x7f29180d1950 con 0x7f2918161340 2023-11-28T12:09:18.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.439+0000 7f2916ffd700 1 -- 172.21.15.45:0/2830688011 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29000035b0 con 0x7f2918161340 2023-11-28T12:09:18.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.440+0000 7f2916ffd700 1 -- 172.21.15.45:0/2830688011 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 92402562 0 0) 0x7f29180ce140 con 0x7f291815c9b0 2023-11-28T12:09:18.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.440+0000 7f2916ffd700 1 -- 172.21.15.45:0/2830688011 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29180d1950 con 0x7f291815c9b0 2023-11-28T12:09:18.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.440+0000 7f291cb9c700 1 -- 172.21.15.45:0/2830688011 >> v1:172.21.15.152:6789/0 conn(0x7f291815c9b0 legacy=0x7f29180b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:18.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.440+0000 7f291cb9c700 1 -- 172.21.15.45:0/2830688011 >> v1:172.21.15.45:6789/0 conn(0x7f2918161340 legacy=0x7f29180d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:18.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.440+0000 7f2916ffd700 1 -- 172.21.15.45:0/2830688011 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2778886594 0 0) 0x7f29000035b0 con 0x7f2918161340 2023-11-28T12:09:18.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.440+0000 7f291cb9c700 1 -- 172.21.15.45:0/2830688011 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29180d24f0 con 0x7f29180cd7c0 2023-11-28T12:09:18.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.440+0000 7f291cb9c700 1 --2- 172.21.15.45:0/2830688011 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f29180cd7c0 0x7f29180cdc00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2910009dc0 tx=0x7f291000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=611b8753a836847d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:18.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.440+0000 7f2916ffd700 1 -- 172.21.15.45:0/2830688011 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f291000e070 con 0x7f29180cd7c0 2023-11-28T12:09:18.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.441+0000 7f2916ffd700 1 -- 172.21.15.45:0/2830688011 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2910003a20 con 0x7f29180cd7c0 2023-11-28T12:09:18.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.441+0000 7f2916ffd700 1 -- 172.21.15.45:0/2830688011 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f290c001670 con 0x7f29180cd7c0 2023-11-28T12:09:18.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.441+0000 7f291e5ff700 1 -- 172.21.15.45:0/2830688011 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f29180cd7c0 msgr2=0x7f29180cdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:18.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.441+0000 7f291e5ff700 1 --2- 172.21.15.45:0/2830688011 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f29180cd7c0 0x7f29180cdc00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2910009dc0 tx=0x7f291000b330 comp rx=0 tx=0).stop 2023-11-28T12:09:18.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.441+0000 7f291e5ff700 1 -- 172.21.15.45:0/2830688011 shutdown_connections 2023-11-28T12:09:18.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.441+0000 7f291e5ff700 1 --2- 172.21.15.45:0/2830688011 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f29180cd7c0 0x7f29180cdc00 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:18.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.441+0000 7f291e5ff700 1 -- 172.21.15.45:0/2830688011 >> 172.21.15.45:0/2830688011 conn(0x7f2918072600 msgr2=0x7f29180cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:18.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.441+0000 7f291e5ff700 1 -- 172.21.15.45:0/2830688011 shutdown_connections 2023-11-28T12:09:18.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.441+0000 7f291e5ff700 1 -- 172.21.15.45:0/2830688011 wait complete. 2023-11-28T12:09:18.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.443+0000 7f291e5ff700 1 Processor -- start 2023-11-28T12:09:18.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.443+0000 7f291e5ff700 1 -- start start 2023-11-28T12:09:18.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.444+0000 7f291e5ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f29180cd7c0 0x7f29180ca240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:18.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.444+0000 7f291e5ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f291815c9b0 0x7f2918159970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:18.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.444+0000 7f291e5ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2918161340 0x7f29180cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:18.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.444+0000 7f291e5ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29181e81f0 con 0x7f2918161340 2023-11-28T12:09:18.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.444+0000 7f291e5ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29181e7c30 con 0x7f29180cd7c0 2023-11-28T12:09:18.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.444+0000 7f291e5ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29181e7f10 con 0x7f291815c9b0 2023-11-28T12:09:18.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.444+0000 7f291cb9c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2918161340 0x7f29180cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:18.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.444+0000 7f291cb9c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2918161340 0x7f29180cbd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40504/0 (socket says 172.21.15.45:40504) 2023-11-28T12:09:18.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.444+0000 7f291cb9c700 1 -- 172.21.15.45:0/2686916352 learned_addr learned my addr 172.21.15.45:0/2686916352 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:09:18.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.444+0000 7f2917fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f29180cd7c0 0x7f29180ca240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:18.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.444+0000 7f29177fe700 1 --2- 172.21.15.45:0/2686916352 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f291815c9b0 0x7f2918159970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:18.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.445+0000 7f291cb9c700 1 -- 172.21.15.45:0/2686916352 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f291815c9b0 msgr2=0x7f2918159970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:18.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.445+0000 7f291cb9c700 1 --2- 172.21.15.45:0/2686916352 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f291815c9b0 0x7f2918159970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:18.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.445+0000 7f291cb9c700 1 -- 172.21.15.45:0/2686916352 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f29180cd7c0 msgr2=0x7f29180ca240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:18.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.445+0000 7f291cb9c700 1 --2- 172.21.15.45:0/2686916352 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f29180cd7c0 0x7f29180ca240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:18.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.445+0000 7f291cb9c700 1 -- 172.21.15.45:0/2686916352 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2910009a70 con 0x7f2918161340 2023-11-28T12:09:18.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.445+0000 7f291cb9c700 1 --2- 172.21.15.45:0/2686916352 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2918161340 0x7f29180cbd30 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f2910009d90 tx=0x7f2910004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:18.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.445+0000 7f2914ff9700 1 -- 172.21.15.45:0/2686916352 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29100042c0 con 0x7f2918161340 2023-11-28T12:09:18.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.445+0000 7f2914ff9700 1 -- 172.21.15.45:0/2686916352 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2910004440 con 0x7f2918161340 2023-11-28T12:09:18.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.445+0000 7f2914ff9700 1 -- 172.21.15.45:0/2686916352 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29100047f0 con 0x7f2918161340 2023-11-28T12:09:18.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.445+0000 7f291e5ff700 1 -- 172.21.15.45:0/2686916352 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29180d1300 con 0x7f2918161340 2023-11-28T12:09:18.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.446+0000 7f291e5ff700 1 -- 172.21.15.45:0/2686916352 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29180b5520 con 0x7f2918161340 2023-11-28T12:09:18.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.447+0000 7f291e5ff700 1 -- 172.21.15.45:0/2686916352 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29180d15e0 con 0x7f2918161340 2023-11-28T12:09:18.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.447+0000 7f2914ff9700 1 -- 172.21.15.45:0/2686916352 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f2910018040 con 0x7f2918161340 2023-11-28T12:09:18.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.448+0000 7f2914ff9700 1 --2- 172.21.15.45:0/2686916352 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f29040682f0 0x7f290406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:18.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.448+0000 7f2914ff9700 1 -- 172.21.15.45:0/2686916352 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f2910087240 con 0x7f2918161340 2023-11-28T12:09:18.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.449+0000 7f2917fff700 1 --2- 172.21.15.45:0/2686916352 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f29040682f0 0x7f290406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:18.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.449+0000 7f2917fff700 1 --2- 172.21.15.45:0/2686916352 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f29040682f0 0x7f290406a7a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f29080011e0 tx=0x7f2908009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:18.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.452+0000 7f2914ff9700 1 -- 172.21.15.45:0/2686916352 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f2910053910 con 0x7f2918161340 2023-11-28T12:09:18.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.656+0000 7f291e5ff700 1 -- 172.21.15.45:0/2686916352 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f29180745c0 con 0x7f2918161340 2023-11-28T12:09:18.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.657+0000 7f2914ff9700 1 -- 172.21.15.45:0/2686916352 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v48) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2910056f30 con 0x7f2918161340 2023-11-28T12:09:18.658 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-11-28T12:09:18.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.659+0000 7f291e5ff700 1 -- 172.21.15.45:0/2686916352 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f29040682f0 msgr2=0x7f290406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:18.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.659+0000 7f291e5ff700 1 --2- 172.21.15.45:0/2686916352 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f29040682f0 0x7f290406a7a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f29080011e0 tx=0x7f2908009040 comp rx=0 tx=0).stop 2023-11-28T12:09:18.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.659+0000 7f291e5ff700 1 -- 172.21.15.45:0/2686916352 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2918161340 msgr2=0x7f29180cbd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:18.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.659+0000 7f291e5ff700 1 --2- 172.21.15.45:0/2686916352 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2918161340 0x7f29180cbd30 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f2910009d90 tx=0x7f2910004ad0 comp rx=0 tx=0).stop 2023-11-28T12:09:18.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.659+0000 7f291e5ff700 1 -- 172.21.15.45:0/2686916352 shutdown_connections 2023-11-28T12:09:18.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.659+0000 7f291e5ff700 1 --2- 172.21.15.45:0/2686916352 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f29040682f0 0x7f290406a7a0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:18.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.659+0000 7f291e5ff700 1 --2- 172.21.15.45:0/2686916352 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f29180cd7c0 0x7f29180ca240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:18.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.659+0000 7f291e5ff700 1 --2- 172.21.15.45:0/2686916352 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2918161340 0x7f29180cbd30 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:18.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.659+0000 7f291e5ff700 1 --2- 172.21.15.45:0/2686916352 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f291815c9b0 0x7f2918159970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:18.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.659+0000 7f291e5ff700 1 -- 172.21.15.45:0/2686916352 >> 172.21.15.45:0/2686916352 conn(0x7f2918072600 msgr2=0x7f291815f380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:18.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.659+0000 7f291e5ff700 1 -- 172.21.15.45:0/2686916352 shutdown_connections 2023-11-28T12:09:18.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.659+0000 7f291e5ff700 1 -- 172.21.15.45:0/2686916352 wait complete. 2023-11-28T12:09:18.679 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T12:09:18.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.883+0000 7f57b81ff700 1 Processor -- start 2023-11-28T12:09:18.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.883+0000 7f57b81ff700 1 -- start start 2023-11-28T12:09:18.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.885+0000 7f57b81ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f57b015c9b0 0x7f57b00b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:18.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.885+0000 7f57b81ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f57b0161340 0x7f57b00d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:18.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.885+0000 7f57b81ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f57b00d2320 0x7f57b00cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:18.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.885+0000 7f57b81ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57b00b5800 con 0x7f57b015c9b0 2023-11-28T12:09:18.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.885+0000 7f57b81ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57b00d1950 con 0x7f57b0161340 2023-11-28T12:09:18.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.885+0000 7f57b81ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57b00b5520 con 0x7f57b00d2320 2023-11-28T12:09:18.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.885+0000 7f57b5f9b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f57b015c9b0 0x7f57b00b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:18.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.885+0000 7f57b5f9b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f57b015c9b0 0x7f57b00b4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40506/0 (socket says 172.21.15.45:40506) 2023-11-28T12:09:18.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.885+0000 7f57b5f9b700 1 -- 172.21.15.45:0/382153718 learned_addr learned my addr 172.21.15.45:0/382153718 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:09:18.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.885+0000 7f57b679c700 1 --2- 172.21.15.45:0/382153718 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f57b00d2320 0x7f57b00cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:18.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.885+0000 7f57b579a700 1 --2- 172.21.15.45:0/382153718 >> v2:172.21.15.152:3300/0 conn(0x7f57b0161340 0x7f57b00d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:18.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.885+0000 7f57b5f9b700 1 -- 172.21.15.45:0/382153718 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f57b00d2320 msgr2=0x7f57b00cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:18.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.885+0000 7f57b5f9b700 1 --2- 172.21.15.45:0/382153718 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f57b00d2320 0x7f57b00cd7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:18.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.885+0000 7f57b5f9b700 1 -- 172.21.15.45:0/382153718 >> v2:172.21.15.152:3300/0 conn(0x7f57b0161340 msgr2=0x7f57b00d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:18.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.885+0000 7f57b5f9b700 1 --2- 172.21.15.45:0/382153718 >> v2:172.21.15.152:3300/0 conn(0x7f57b0161340 0x7f57b00d1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:18.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.885+0000 7f57b5f9b700 1 -- 172.21.15.45:0/382153718 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57b00d1300 con 0x7f57b015c9b0 2023-11-28T12:09:18.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.886+0000 7f57b5f9b700 1 --2- 172.21.15.45:0/382153718 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57b015c9b0 0x7f57b00b4bf0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f57b00685c0 tx=0x7f57ac009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1852c5f1e338688e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:18.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.886+0000 7f57b4f99700 1 -- 172.21.15.45:0/382153718 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57ac00b870 con 0x7f57b015c9b0 2023-11-28T12:09:18.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.886+0000 7f57b4f99700 1 -- 172.21.15.45:0/382153718 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57ac00b9d0 con 0x7f57b015c9b0 2023-11-28T12:09:18.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.886+0000 7f57b4f99700 1 -- 172.21.15.45:0/382153718 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57ac00bd60 con 0x7f57b015c9b0 2023-11-28T12:09:18.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.887+0000 7f57b81ff700 1 -- 172.21.15.45:0/382153718 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57b015c9b0 msgr2=0x7f57b00b4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:18.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.887+0000 7f57b81ff700 1 --2- 172.21.15.45:0/382153718 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57b015c9b0 0x7f57b00b4bf0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f57b00685c0 tx=0x7f57ac009bd0 comp rx=0 tx=0).stop 2023-11-28T12:09:18.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.887+0000 7f57b81ff700 1 -- 172.21.15.45:0/382153718 shutdown_connections 2023-11-28T12:09:18.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.887+0000 7f57b81ff700 1 --2- 172.21.15.45:0/382153718 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f57b00d2320 0x7f57b00cd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:18.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.887+0000 7f57b81ff700 1 --2- 172.21.15.45:0/382153718 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57b015c9b0 0x7f57b00b4bf0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:18.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.887+0000 7f57b81ff700 1 --2- 172.21.15.45:0/382153718 >> v2:172.21.15.152:3300/0 conn(0x7f57b0161340 0x7f57b00d1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:18.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.887+0000 7f57b81ff700 1 -- 172.21.15.45:0/382153718 >> 172.21.15.45:0/382153718 conn(0x7f57b0072600 msgr2=0x7f57b00cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:18.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.887+0000 7f57b81ff700 1 -- 172.21.15.45:0/382153718 shutdown_connections 2023-11-28T12:09:18.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.887+0000 7f57b81ff700 1 -- 172.21.15.45:0/382153718 wait complete. 2023-11-28T12:09:18.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.889+0000 7f57b81ff700 1 Processor -- start 2023-11-28T12:09:18.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.889+0000 7f57b81ff700 1 -- start start 2023-11-28T12:09:18.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.890+0000 7f57b81ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57b00d2320 0x7f57b00c5da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:18.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.890+0000 7f57b81ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f57b015c9b0 0x7f57b0154b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:18.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.890+0000 7f57b81ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57b0161340 0x7f57b01f2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:18.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.890+0000 7f57b81ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57b0153ba0 con 0x7f57b0161340 2023-11-28T12:09:18.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.890+0000 7f57b81ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57b0152fd0 con 0x7f57b00d2320 2023-11-28T12:09:18.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.890+0000 7f57b81ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57b0153270 con 0x7f57b015c9b0 2023-11-28T12:09:18.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.890+0000 7f57b679c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57b0161340 0x7f57b01f2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:18.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.890+0000 7f57b679c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57b0161340 0x7f57b01f2ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40516/0 (socket says 172.21.15.45:40516) 2023-11-28T12:09:18.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.890+0000 7f57b679c700 1 -- 172.21.15.45:0/3139222840 learned_addr learned my addr 172.21.15.45:0/3139222840 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:09:18.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.891+0000 7f57b5f9b700 1 --2- 172.21.15.45:0/3139222840 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57b00d2320 0x7f57b00c5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:18.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.891+0000 7f57b579a700 1 --2- 172.21.15.45:0/3139222840 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f57b015c9b0 0x7f57b0154b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:18.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.891+0000 7f57b679c700 1 -- 172.21.15.45:0/3139222840 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f57b015c9b0 msgr2=0x7f57b0154b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:18.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.891+0000 7f57b679c700 1 --2- 172.21.15.45:0/3139222840 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f57b015c9b0 0x7f57b0154b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:18.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.891+0000 7f57b679c700 1 -- 172.21.15.45:0/3139222840 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57b00d2320 msgr2=0x7f57b00c5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:18.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.891+0000 7f57b679c700 1 --2- 172.21.15.45:0/3139222840 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57b00d2320 0x7f57b00c5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:18.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.891+0000 7f57b679c700 1 -- 172.21.15.45:0/3139222840 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57ac009550 con 0x7f57b0161340 2023-11-28T12:09:18.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.891+0000 7f57b5f9b700 1 --2- 172.21.15.45:0/3139222840 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57b00d2320 0x7f57b00c5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:09:18.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.891+0000 7f57b679c700 1 --2- 172.21.15.45:0/3139222840 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57b0161340 0x7f57b01f2ac0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f57a8009fd0 tx=0x7f57a800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:18.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.891+0000 7f57a67fc700 1 -- 172.21.15.45:0/3139222840 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a8007ea0 con 0x7f57b0161340 2023-11-28T12:09:18.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.891+0000 7f57a67fc700 1 -- 172.21.15.45:0/3139222840 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57a800ede0 con 0x7f57b0161340 2023-11-28T12:09:18.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.891+0000 7f57b81ff700 1 -- 172.21.15.45:0/3139222840 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57b00b5130 con 0x7f57b0161340 2023-11-28T12:09:18.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.891+0000 7f57a67fc700 1 -- 172.21.15.45:0/3139222840 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a8014660 con 0x7f57b0161340 2023-11-28T12:09:18.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.892+0000 7f57b81ff700 1 -- 172.21.15.45:0/3139222840 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57b00d15e0 con 0x7f57b0161340 2023-11-28T12:09:18.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.893+0000 7f57b81ff700 1 -- 172.21.15.45:0/3139222840 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57b00b52c0 con 0x7f57b0161340 2023-11-28T12:09:18.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.895+0000 7f57a67fc700 1 -- 172.21.15.45:0/3139222840 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f57a8012050 con 0x7f57b0161340 2023-11-28T12:09:18.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.895+0000 7f57a67fc700 1 --2- 172.21.15.45:0/3139222840 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5794068320 0x7f579406a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:18.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.895+0000 7f57a67fc700 1 -- 172.21.15.45:0/3139222840 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f57a8086310 con 0x7f57b0161340 2023-11-28T12:09:18.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.895+0000 7f57b5f9b700 1 --2- 172.21.15.45:0/3139222840 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5794068320 0x7f579406a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:18.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.896+0000 7f57b5f9b700 1 --2- 172.21.15.45:0/3139222840 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5794068320 0x7f579406a7d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f57ac000c00 tx=0x7f57ac008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:18.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:18.899+0000 7f57a67fc700 1 -- 172.21.15.45:0/3139222840 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f57a8052a40 con 0x7f57b0161340 2023-11-28T12:09:19.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.104+0000 7f57b81ff700 1 -- 172.21.15.45:0/3139222840 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f57b00745c0 con 0x7f57b0161340 2023-11-28T12:09:19.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.105+0000 7f57a67fc700 1 -- 172.21.15.45:0/3139222840 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v49) v1 ==== 104+0+11 (secure 0 0 0) 0x7f57a8056060 con 0x7f57b0161340 2023-11-28T12:09:19.106 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-11-28T12:09:19.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.108+0000 7f57b81ff700 1 -- 172.21.15.45:0/3139222840 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5794068320 msgr2=0x7f579406a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:19.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.108+0000 7f57b81ff700 1 --2- 172.21.15.45:0/3139222840 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5794068320 0x7f579406a7d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f57ac000c00 tx=0x7f57ac008030 comp rx=0 tx=0).stop 2023-11-28T12:09:19.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.108+0000 7f57b81ff700 1 -- 172.21.15.45:0/3139222840 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57b0161340 msgr2=0x7f57b01f2ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:19.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.108+0000 7f57b81ff700 1 --2- 172.21.15.45:0/3139222840 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57b0161340 0x7f57b01f2ac0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f57a8009fd0 tx=0x7f57a800e3c0 comp rx=0 tx=0).stop 2023-11-28T12:09:19.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.108+0000 7f57b81ff700 1 -- 172.21.15.45:0/3139222840 shutdown_connections 2023-11-28T12:09:19.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.108+0000 7f57b81ff700 1 --2- 172.21.15.45:0/3139222840 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5794068320 0x7f579406a7d0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:19.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.108+0000 7f57b81ff700 1 --2- 172.21.15.45:0/3139222840 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57b00d2320 0x7f57b00c5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:19.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.108+0000 7f57b81ff700 1 --2- 172.21.15.45:0/3139222840 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57b0161340 0x7f57b01f2ac0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:19.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.108+0000 7f57b81ff700 1 --2- 172.21.15.45:0/3139222840 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f57b015c9b0 0x7f57b0154b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:19.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.108+0000 7f57b81ff700 1 -- 172.21.15.45:0/3139222840 >> 172.21.15.45:0/3139222840 conn(0x7f57b0072600 msgr2=0x7f57b00b8a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:19.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.108+0000 7f57b81ff700 1 -- 172.21.15.45:0/3139222840 shutdown_connections 2023-11-28T12:09:19.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.108+0000 7f57b81ff700 1 -- 172.21.15.45:0/3139222840 wait complete. 2023-11-28T12:09:19.127 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T12:09:19.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.334+0000 7fbfbffff700 1 Processor -- start 2023-11-28T12:09:19.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.334+0000 7fbfbffff700 1 -- start start 2023-11-28T12:09:19.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.335+0000 7fbfbffff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbfb8161340 0x7fbfb80d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:19.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.335+0000 7fbfbffff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfb80d1950 con 0x7fbfb80d2320 2023-11-28T12:09:19.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.335+0000 7fbfbffff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfb80b5520 con 0x7fbfb815c9b0 2023-11-28T12:09:19.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.335+0000 7fbfbffff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb80b5800 con 0x7fbfb8161340 2023-11-28T12:09:19.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.335+0000 7fbfbe59c700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fbfb80d2320 0x7fbfb80cd7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:53590/0 (socket says 172.21.15.45:53590) 2023-11-28T12:09:19.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.335+0000 7fbfbe59c700 1 -- 172.21.15.45:0/2585019189 learned_addr learned my addr 172.21.15.45:0/2585019189 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:09:19.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.335+0000 7fbfbd59a700 1 --2- 172.21.15.45:0/2585019189 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbfb8161340 0x7fbfb80d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:19.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.335+0000 7fbfbcd99700 1 -- 172.21.15.45:0/2585019189 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2790320854 0 0) 0x7fbfb80d1950 con 0x7fbfb80d2320 2023-11-28T12:09:19.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.335+0000 7fbfbcd99700 1 -- 172.21.15.45:0/2585019189 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbfa40035b0 con 0x7fbfb80d2320 2023-11-28T12:09:19.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.336+0000 7fbfbcd99700 1 -- 172.21.15.45:0/2585019189 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 585408980 0 0) 0x7fbfb80b5520 con 0x7fbfb815c9b0 2023-11-28T12:09:19.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.336+0000 7fbfbcd99700 1 -- 172.21.15.45:0/2585019189 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbfb80d1950 con 0x7fbfb815c9b0 2023-11-28T12:09:19.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.336+0000 7fbfbcd99700 1 -- 172.21.15.45:0/2585019189 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4025253859 0 0) 0x7fbfa40035b0 con 0x7fbfb80d2320 2023-11-28T12:09:19.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.336+0000 7fbfbcd99700 1 -- 172.21.15.45:0/2585019189 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbfb8161340 msgr2=0x7fbfb80d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:19.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.336+0000 7fbfbcd99700 1 --2- 172.21.15.45:0/2585019189 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbfb8161340 0x7fbfb80d1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:19.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.336+0000 7fbfbcd99700 1 -- 172.21.15.45:0/2585019189 >> v1:172.21.15.152:6789/0 conn(0x7fbfb815c9b0 legacy=0x7fbfb80b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:19.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.336+0000 7fbfbcd99700 1 -- 172.21.15.45:0/2585019189 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfb80d1300 con 0x7fbfb80d2320 2023-11-28T12:09:19.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.336+0000 7fbfbcd99700 1 -- 172.21.15.45:0/2585019189 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3460218165 0 0) 0x7fbfb00019f0 con 0x7fbfb80d2320 2023-11-28T12:09:19.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.336+0000 7fbfbd59a700 1 --2- 172.21.15.45:0/2585019189 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbfb8161340 0x7fbfb80d1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:09:19.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.336+0000 7fbfbcd99700 1 -- 172.21.15.45:0/2585019189 >> v1:172.21.15.45:6789/0 conn(0x7fbfb80d2320 legacy=0x7fbfb80cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:19.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.336+0000 7fbfbcd99700 1 --2- 172.21.15.45:0/2585019189 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfa4003bc0 0x7fbfa4003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:19.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.336+0000 7fbfbcd99700 1 --2- 172.21.15.45:0/2585019189 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbfa4004850 0x7fbfa4004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:19.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.336+0000 7fbfbcd99700 1 --2- 172.21.15.45:0/2585019189 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbfb8161340 0x7fbfa4005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:19.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.336+0000 7fbfbcd99700 1 -- 172.21.15.45:0/2585019189 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb80b5800 con 0x7fbfa4003bc0 2023-11-28T12:09:19.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.336+0000 7fbfbcd99700 1 -- 172.21.15.45:0/2585019189 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa400bb60 con 0x7fbfa4004850 2023-11-28T12:09:19.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.336+0000 7fbfbcd99700 1 -- 172.21.15.45:0/2585019189 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa400bd20 con 0x7fbfb8161340 2023-11-28T12:09:19.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.336+0000 7fbfbdd9b700 1 --2- 172.21.15.45:0/2585019189 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfa4003bc0 0x7fbfa4003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:19.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.336+0000 7fbfbe59c700 1 --2- 172.21.15.45:0/2585019189 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbfb8161340 0x7fbfa4005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:19.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.336+0000 7fbfbd59a700 1 --2- 172.21.15.45:0/2585019189 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbfa4004850 0x7fbfa4004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:19.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.337+0000 7fbfbdd9b700 1 -- 172.21.15.45:0/2585019189 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbfb8161340 msgr2=0x7fbfa4005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:19.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.337+0000 7fbfbdd9b700 1 --2- 172.21.15.45:0/2585019189 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbfb8161340 0x7fbfa4005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:19.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.337+0000 7fbfbdd9b700 1 -- 172.21.15.45:0/2585019189 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbfa4004850 msgr2=0x7fbfa4004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:19.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.337+0000 7fbfbdd9b700 1 --2- 172.21.15.45:0/2585019189 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbfa4004850 0x7fbfa4004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:19.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.337+0000 7fbfbdd9b700 1 -- 172.21.15.45:0/2585019189 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfa80094a0 con 0x7fbfa4003bc0 2023-11-28T12:09:19.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.337+0000 7fbfbdd9b700 1 --2- 172.21.15.45:0/2585019189 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfa4003bc0 0x7fbfa4003fb0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fbfb4001940 tx=0x7fbfa4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d48ecfce85aa9e2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:19.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.337+0000 7fbfbcd99700 1 -- 172.21.15.45:0/2585019189 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb4001430 con 0x7fbfa4003bc0 2023-11-28T12:09:19.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.337+0000 7fbfbcd99700 1 -- 172.21.15.45:0/2585019189 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfb4001d70 con 0x7fbfa4003bc0 2023-11-28T12:09:19.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.337+0000 7fbfbcd99700 1 -- 172.21.15.45:0/2585019189 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb4005510 con 0x7fbfa4003bc0 2023-11-28T12:09:19.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.338+0000 7fbfbffff700 1 -- 172.21.15.45:0/2585019189 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfa4003bc0 msgr2=0x7fbfa4003fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:19.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.338+0000 7fbfbffff700 1 --2- 172.21.15.45:0/2585019189 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfa4003bc0 0x7fbfa4003fb0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fbfb4001940 tx=0x7fbfa4005880 comp rx=0 tx=0).stop 2023-11-28T12:09:19.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.338+0000 7fbfbe59c700 1 -- 172.21.15.45:0/2585019189 reap_dead start 2023-11-28T12:09:19.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.338+0000 7fbfbffff700 1 -- 172.21.15.45:0/2585019189 shutdown_connections 2023-11-28T12:09:19.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.338+0000 7fbfbffff700 1 -- 172.21.15.45:0/2585019189 >> 172.21.15.45:0/2585019189 conn(0x7fbfb8072600 msgr2=0x7fbfb80cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:19.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.338+0000 7fbfbffff700 1 -- 172.21.15.45:0/2585019189 shutdown_connections 2023-11-28T12:09:19.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.338+0000 7fbfbffff700 1 -- 172.21.15.45:0/2585019189 wait complete. 2023-11-28T12:09:19.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.340+0000 7fbfbffff700 1 Processor -- start 2023-11-28T12:09:19.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.340+0000 7fbfbffff700 1 -- start start 2023-11-28T12:09:19.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.341+0000 7fbfbffff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbfa4003bc0 0x7fbfb80cde60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:19.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.341+0000 7fbfbffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfb814d6b0 0x7fbfb80cac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:19.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.341+0000 7fbfbffff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbfb81f2ab0 0x7fbfb80cbad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:19.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.341+0000 7fbfbffff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb80cb3c0 con 0x7fbfb814d6b0 2023-11-28T12:09:19.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.341+0000 7fbfbffff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb80cb140 con 0x7fbfa4003bc0 2023-11-28T12:09:19.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.341+0000 7fbfbffff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb814db20 con 0x7fbfb81f2ab0 2023-11-28T12:09:19.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.341+0000 7fbfbd59a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfb814d6b0 0x7fbfb80cac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:19.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.341+0000 7fbfbd59a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfb814d6b0 0x7fbfb80cac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40538/0 (socket says 172.21.15.45:40538) 2023-11-28T12:09:19.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.341+0000 7fbfbd59a700 1 -- 172.21.15.45:0/1971116242 learned_addr learned my addr 172.21.15.45:0/1971116242 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:09:19.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.341+0000 7fbfbdd9b700 1 --2- 172.21.15.45:0/1971116242 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbfa4003bc0 0x7fbfb80cde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:19.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.341+0000 7fbfbe59c700 1 --2- 172.21.15.45:0/1971116242 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbfb81f2ab0 0x7fbfb80cbad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:19.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.341+0000 7fbfbd59a700 1 -- 172.21.15.45:0/1971116242 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbfb81f2ab0 msgr2=0x7fbfb80cbad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:19.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.341+0000 7fbfbd59a700 1 --2- 172.21.15.45:0/1971116242 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbfb81f2ab0 0x7fbfb80cbad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:19.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.341+0000 7fbfbd59a700 1 -- 172.21.15.45:0/1971116242 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbfa4003bc0 msgr2=0x7fbfb80cde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:19.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.341+0000 7fbfbd59a700 1 --2- 172.21.15.45:0/1971116242 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbfa4003bc0 0x7fbfb80cde60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:19.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.341+0000 7fbfbd59a700 1 -- 172.21.15.45:0/1971116242 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfb815cd80 con 0x7fbfb814d6b0 2023-11-28T12:09:19.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.342+0000 7fbfbd59a700 1 --2- 172.21.15.45:0/1971116242 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfb814d6b0 0x7fbfb80cac00 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fbfa8011ca0 tx=0x7fbfa8009e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:19.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.342+0000 7fbfae7fc700 1 -- 172.21.15.45:0/1971116242 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa800fa00 con 0x7fbfb814d6b0 2023-11-28T12:09:19.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.342+0000 7fbfae7fc700 1 -- 172.21.15.45:0/1971116242 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfa800fb60 con 0x7fbfb814d6b0 2023-11-28T12:09:19.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.342+0000 7fbfae7fc700 1 -- 172.21.15.45:0/1971116242 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa8004020 con 0x7fbfb814d6b0 2023-11-28T12:09:19.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.342+0000 7fbfbffff700 1 -- 172.21.15.45:0/1971116242 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfb80d15e0 con 0x7fbfb814d6b0 2023-11-28T12:09:19.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.342+0000 7fbfbffff700 1 -- 172.21.15.45:0/1971116242 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfb815cf10 con 0x7fbfb814d6b0 2023-11-28T12:09:19.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.343+0000 7fbfbffff700 1 -- 172.21.15.45:0/1971116242 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfb80745c0 con 0x7fbfb814d6b0 2023-11-28T12:09:19.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.345+0000 7fbfae7fc700 1 -- 172.21.15.45:0/1971116242 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fbfa8024070 con 0x7fbfb814d6b0 2023-11-28T12:09:19.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.345+0000 7fbfae7fc700 1 --2- 172.21.15.45:0/1971116242 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fbf9c0682f0 0x7fbf9c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:19.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.345+0000 7fbfae7fc700 1 -- 172.21.15.45:0/1971116242 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fbfa80860f0 con 0x7fbfb814d6b0 2023-11-28T12:09:19.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.345+0000 7fbfbdd9b700 1 --2- 172.21.15.45:0/1971116242 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fbf9c0682f0 0x7fbf9c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:19.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.346+0000 7fbfbdd9b700 1 --2- 172.21.15.45:0/1971116242 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fbf9c0682f0 0x7fbf9c06a7a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fbfb4015040 tx=0x7fbfb400a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:19.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.349+0000 7fbfae7fc700 1 -- 172.21.15.45:0/1971116242 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fbfa8052820 con 0x7fbfb814d6b0 2023-11-28T12:09:19.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.554+0000 7fbfbffff700 1 -- 172.21.15.45:0/1971116242 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbfb80c6a20 con 0x7fbfb814d6b0 2023-11-28T12:09:19.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.555+0000 7fbfae7fc700 1 -- 172.21.15.45:0/1971116242 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v49) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbfa8055e40 con 0x7fbfb814d6b0 2023-11-28T12:09:19.555 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-11-28T12:09:19.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.557+0000 7fbfbffff700 1 -- 172.21.15.45:0/1971116242 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fbf9c0682f0 msgr2=0x7fbf9c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:19.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.557+0000 7fbfbffff700 1 --2- 172.21.15.45:0/1971116242 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fbf9c0682f0 0x7fbf9c06a7a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fbfb4015040 tx=0x7fbfb400a000 comp rx=0 tx=0).stop 2023-11-28T12:09:19.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.557+0000 7fbfbffff700 1 -- 172.21.15.45:0/1971116242 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfb814d6b0 msgr2=0x7fbfb80cac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:19.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.557+0000 7fbfbffff700 1 --2- 172.21.15.45:0/1971116242 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfb814d6b0 0x7fbfb80cac00 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fbfa8011ca0 tx=0x7fbfa8009e80 comp rx=0 tx=0).stop 2023-11-28T12:09:19.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.557+0000 7fbfbffff700 1 -- 172.21.15.45:0/1971116242 shutdown_connections 2023-11-28T12:09:19.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.557+0000 7fbfbffff700 1 --2- 172.21.15.45:0/1971116242 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fbf9c0682f0 0x7fbf9c06a7a0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:19.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.557+0000 7fbfbffff700 1 --2- 172.21.15.45:0/1971116242 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbfa4003bc0 0x7fbfb80cde60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:19.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.557+0000 7fbfbffff700 1 --2- 172.21.15.45:0/1971116242 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbfb81f2ab0 0x7fbfb80cbad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:19.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.557+0000 7fbfbffff700 1 --2- 172.21.15.45:0/1971116242 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfb814d6b0 0x7fbfb80cac00 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:19.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.557+0000 7fbfbffff700 1 -- 172.21.15.45:0/1971116242 >> 172.21.15.45:0/1971116242 conn(0x7fbfb8072600 msgr2=0x7fbfb80b61f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:19.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.557+0000 7fbfbffff700 1 -- 172.21.15.45:0/1971116242 shutdown_connections 2023-11-28T12:09:19.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.557+0000 7fbfbffff700 1 -- 172.21.15.45:0/1971116242 wait complete. 2023-11-28T12:09:19.576 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T12:09:19.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.777+0000 7fa8083ff700 1 Processor -- start 2023-11-28T12:09:19.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.778+0000 7fa8083ff700 1 -- start start 2023-11-28T12:09:19.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.779+0000 7fa8083ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fa80015c9b0 0x7fa8000b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:19.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.779+0000 7fa8083ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa800161340 0x7fa8000d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:19.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.779+0000 7fa8083ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8000d1950 con 0x7fa8000d2320 2023-11-28T12:09:19.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.779+0000 7fa8083ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8000b5800 con 0x7fa800161340 2023-11-28T12:09:19.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.779+0000 7fa8083ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8000b5520 con 0x7fa80015c9b0 2023-11-28T12:09:19.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.779+0000 7fa80599a700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa800161340 0x7fa8000d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:19.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.779+0000 7fa80599a700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa800161340 0x7fa8000d1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40548/0 (socket says 172.21.15.45:40548) 2023-11-28T12:09:19.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.779+0000 7fa80599a700 1 -- 172.21.15.45:0/2812750657 learned_addr learned my addr 172.21.15.45:0/2812750657 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:09:19.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.779+0000 7fa80619b700 1 --2- 172.21.15.45:0/2812750657 >> v2:172.21.15.152:3300/0 conn(0x7fa80015c9b0 0x7fa8000b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:19.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.779+0000 7fa80599a700 1 -- 172.21.15.45:0/2812750657 >> v2:172.21.15.152:3300/0 conn(0x7fa80015c9b0 msgr2=0x7fa8000b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:19.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.779+0000 7fa80599a700 1 --2- 172.21.15.45:0/2812750657 >> v2:172.21.15.152:3300/0 conn(0x7fa80015c9b0 0x7fa8000b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:19.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.779+0000 7fa80599a700 1 -- 172.21.15.45:0/2812750657 >> v1:172.21.15.45:6789/0 conn(0x7fa8000d2320 legacy=0x7fa8000cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:19.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.780+0000 7fa80599a700 1 -- 172.21.15.45:0/2812750657 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8000d1300 con 0x7fa800161340 2023-11-28T12:09:19.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.780+0000 7fa805199700 1 -- 172.21.15.45:0/2812750657 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 368722563 0 0) 0x7fa8000d1950 con 0x7fa8000d2320 2023-11-28T12:09:19.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.780+0000 7fa80599a700 1 --2- 172.21.15.45:0/2812750657 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa800161340 0x7fa8000d1de0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fa800067460 tx=0x7fa7f0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22a0e586d7f6d332 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:19.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.780+0000 7fa805199700 1 -- 172.21.15.45:0/2812750657 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f000b870 con 0x7fa800161340 2023-11-28T12:09:19.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.780+0000 7fa805199700 1 -- 172.21.15.45:0/2812750657 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7f000b9d0 con 0x7fa800161340 2023-11-28T12:09:19.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.780+0000 7fa805199700 1 -- 172.21.15.45:0/2812750657 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f000bd60 con 0x7fa800161340 2023-11-28T12:09:19.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.781+0000 7fa8083ff700 1 -- 172.21.15.45:0/2812750657 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa800161340 msgr2=0x7fa8000d1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:19.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.781+0000 7fa8083ff700 1 --2- 172.21.15.45:0/2812750657 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa800161340 0x7fa8000d1de0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fa800067460 tx=0x7fa7f0009bd0 comp rx=0 tx=0).stop 2023-11-28T12:09:19.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.781+0000 7fa8083ff700 1 -- 172.21.15.45:0/2812750657 shutdown_connections 2023-11-28T12:09:19.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.781+0000 7fa8083ff700 1 --2- 172.21.15.45:0/2812750657 >> v2:172.21.15.152:3300/0 conn(0x7fa80015c9b0 0x7fa8000b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:19.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.781+0000 7fa8083ff700 1 --2- 172.21.15.45:0/2812750657 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa800161340 0x7fa8000d1de0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:19.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.781+0000 7fa8083ff700 1 -- 172.21.15.45:0/2812750657 >> 172.21.15.45:0/2812750657 conn(0x7fa800072600 msgr2=0x7fa8000cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:19.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.781+0000 7fa8083ff700 1 -- 172.21.15.45:0/2812750657 shutdown_connections 2023-11-28T12:09:19.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.781+0000 7fa8083ff700 1 -- 172.21.15.45:0/2812750657 wait complete. 2023-11-28T12:09:19.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.783+0000 7fa8083ff700 1 Processor -- start 2023-11-28T12:09:19.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.783+0000 7fa8083ff700 1 -- start start 2023-11-28T12:09:19.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.784+0000 7fa8083ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8000d2320 0x7fa80014c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:19.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.784+0000 7fa8083ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa80015c9b0 0x7fa8000ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:19.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.784+0000 7fa8083ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa800161340 0x7fa8000cafb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:19.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.784+0000 7fa8083ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa80014cae0 con 0x7fa8000d2320 2023-11-28T12:09:19.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.784+0000 7fa8083ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8000cba50 con 0x7fa80015c9b0 2023-11-28T12:09:19.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.784+0000 7fa8083ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8000cbd30 con 0x7fa800161340 2023-11-28T12:09:19.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.784+0000 7fa80619b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8000d2320 0x7fa80014c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:19.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.784+0000 7fa80619b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8000d2320 0x7fa80014c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40560/0 (socket says 172.21.15.45:40560) 2023-11-28T12:09:19.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.784+0000 7fa80619b700 1 -- 172.21.15.45:0/220539191 learned_addr learned my addr 172.21.15.45:0/220539191 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:09:19.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.784+0000 7fa80599a700 1 --2- 172.21.15.45:0/220539191 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa80015c9b0 0x7fa8000ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:19.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.784+0000 7fa80699c700 1 --2- 172.21.15.45:0/220539191 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa800161340 0x7fa8000cafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:19.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.784+0000 7fa80619b700 1 -- 172.21.15.45:0/220539191 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa800161340 msgr2=0x7fa8000cafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:19.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.784+0000 7fa80619b700 1 --2- 172.21.15.45:0/220539191 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa800161340 0x7fa8000cafb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:19.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.785+0000 7fa80619b700 1 -- 172.21.15.45:0/220539191 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa80015c9b0 msgr2=0x7fa8000ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:19.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.785+0000 7fa80619b700 1 --2- 172.21.15.45:0/220539191 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa80015c9b0 0x7fa8000ccaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:19.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.785+0000 7fa80619b700 1 -- 172.21.15.45:0/220539191 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7f0009550 con 0x7fa8000d2320 2023-11-28T12:09:19.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.785+0000 7fa80599a700 1 --2- 172.21.15.45:0/220539191 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa80015c9b0 0x7fa8000ccaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:09:19.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.785+0000 7fa80619b700 1 --2- 172.21.15.45:0/220539191 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8000d2320 0x7fa80014c5a0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc00e810 tx=0x7fa7fc00ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:19.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.785+0000 7fa7f6ffd700 1 -- 172.21.15.45:0/220539191 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7fc013610 con 0x7fa8000d2320 2023-11-28T12:09:19.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.785+0000 7fa7f6ffd700 1 -- 172.21.15.45:0/220539191 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7fc013770 con 0x7fa8000d2320 2023-11-28T12:09:19.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.785+0000 7fa8083ff700 1 -- 172.21.15.45:0/220539191 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8000b5130 con 0x7fa8000d2320 2023-11-28T12:09:19.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.785+0000 7fa7f6ffd700 1 -- 172.21.15.45:0/220539191 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7fc013b20 con 0x7fa8000d2320 2023-11-28T12:09:19.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.785+0000 7fa8083ff700 1 -- 172.21.15.45:0/220539191 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8000d15e0 con 0x7fa8000d2320 2023-11-28T12:09:19.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.786+0000 7fa8083ff700 1 -- 172.21.15.45:0/220539191 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8000b52c0 con 0x7fa8000d2320 2023-11-28T12:09:19.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.787+0000 7fa7f6ffd700 1 -- 172.21.15.45:0/220539191 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fa7fc023070 con 0x7fa8000d2320 2023-11-28T12:09:19.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.788+0000 7fa7f6ffd700 1 --2- 172.21.15.45:0/220539191 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fa7e40682f0 0x7fa7e406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:19.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.788+0000 7fa7f6ffd700 1 -- 172.21.15.45:0/220539191 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fa7fc085a40 con 0x7fa8000d2320 2023-11-28T12:09:19.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.789+0000 7fa80599a700 1 --2- 172.21.15.45:0/220539191 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fa7e40682f0 0x7fa7e406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:19.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.789+0000 7fa80599a700 1 --2- 172.21.15.45:0/220539191 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fa7e40682f0 0x7fa7e406a7a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa8000aadf0 tx=0x7fa7f0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:19.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:19.792+0000 7fa7f6ffd700 1 -- 172.21.15.45:0/220539191 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fa7fc052180 con 0x7fa8000d2320 2023-11-28T12:09:20.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.040+0000 7fa8083ff700 1 -- 172.21.15.45:0/220539191 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa8000cc940 con 0x7fa8000d2320 2023-11-28T12:09:20.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.040+0000 7fa7f6ffd700 1 -- 172.21.15.45:0/220539191 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4651 (secure 0 0 0) 0x7fa7fc0557a0 con 0x7fa8000d2320 2023-11-28T12:09:20.041 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:09:20.041 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5398,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6836/2532875180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":2532875180},{"type":"v1","addr":"172.21.15.152:6836","nonce":2532875180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5404,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/930111917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6835","nonce":930111917},{"type":"v1","addr":"172.21.15.152:6837","nonce":930111917}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5547,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/1974473454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1974473454},{"type":"v1","addr":"172.21.15.45:6834","nonce":1974473454}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T12:08:31.391914+0000","modified":"2023-11-28T12:08:34.873102+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5550},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5550":{"gid":5550,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/1281816633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":1281816633},{"type":"v1","addr":"172.21.15.45:6835","nonce":1281816633}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-28T12:09:20.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.043+0000 7fa8083ff700 1 -- 172.21.15.45:0/220539191 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fa7e40682f0 msgr2=0x7fa7e406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:20.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.043+0000 7fa8083ff700 1 --2- 172.21.15.45:0/220539191 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fa7e40682f0 0x7fa7e406a7a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa8000aadf0 tx=0x7fa7f0008030 comp rx=0 tx=0).stop 2023-11-28T12:09:20.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.043+0000 7fa8083ff700 1 -- 172.21.15.45:0/220539191 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8000d2320 msgr2=0x7fa80014c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:20.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.043+0000 7fa8083ff700 1 --2- 172.21.15.45:0/220539191 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8000d2320 0x7fa80014c5a0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc00e810 tx=0x7fa7fc00ebd0 comp rx=0 tx=0).stop 2023-11-28T12:09:20.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.043+0000 7fa8083ff700 1 -- 172.21.15.45:0/220539191 shutdown_connections 2023-11-28T12:09:20.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.043+0000 7fa8083ff700 1 --2- 172.21.15.45:0/220539191 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fa7e40682f0 0x7fa7e406a7a0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:20.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.043+0000 7fa8083ff700 1 --2- 172.21.15.45:0/220539191 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa800161340 0x7fa8000cafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:20.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.043+0000 7fa8083ff700 1 --2- 172.21.15.45:0/220539191 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8000d2320 0x7fa80014c5a0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:20.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.043+0000 7fa8083ff700 1 --2- 172.21.15.45:0/220539191 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa80015c9b0 0x7fa8000ccaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:20.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.043+0000 7fa8083ff700 1 -- 172.21.15.45:0/220539191 >> 172.21.15.45:0/220539191 conn(0x7fa800072600 msgr2=0x7fa80015a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:20.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.043+0000 7fa8083ff700 1 -- 172.21.15.45:0/220539191 shutdown_connections 2023-11-28T12:09:20.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.043+0000 7fa8083ff700 1 -- 172.21.15.45:0/220539191 wait complete. 2023-11-28T12:09:20.045 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 24 2023-11-28T12:09:20.061 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T12:09:20.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.266+0000 7f49337ff700 1 Processor -- start 2023-11-28T12:09:20.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.266+0000 7f49337ff700 1 -- start start 2023-11-28T12:09:20.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.267+0000 7f49337ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f492c0cd7c0 0x7f492c0cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:20.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.267+0000 7f49337ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f492c0d1950 con 0x7f492c161340 2023-11-28T12:09:20.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.267+0000 7f49337ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f492c0ce140 con 0x7f492c15c9b0 2023-11-28T12:09:20.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.267+0000 7f49337ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f492c0b5800 con 0x7f492c0cd7c0 2023-11-28T12:09:20.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.267+0000 7f4930d9a700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f492c161340 0x7f492c0d1de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:53596/0 (socket says 172.21.15.45:53596) 2023-11-28T12:09:20.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.267+0000 7f4930d9a700 1 -- 172.21.15.45:0/1553608669 learned_addr learned my addr 172.21.15.45:0/1553608669 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:09:20.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.267+0000 7f4931d9c700 1 --2- 172.21.15.45:0/1553608669 >> v2:172.21.15.152:3300/0 conn(0x7f492c0cd7c0 0x7f492c0cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:20.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.268+0000 7f4923fff700 1 -- 172.21.15.45:0/1553608669 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2561886909 0 0) 0x7f492c0d1950 con 0x7f492c161340 2023-11-28T12:09:20.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.268+0000 7f4923fff700 1 -- 172.21.15.45:0/1553608669 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49180035b0 con 0x7f492c161340 2023-11-28T12:09:20.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.268+0000 7f4923fff700 1 -- 172.21.15.45:0/1553608669 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 225067325 0 0) 0x7f492c0ce140 con 0x7f492c15c9b0 2023-11-28T12:09:20.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.268+0000 7f4923fff700 1 -- 172.21.15.45:0/1553608669 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f492c0d1950 con 0x7f492c15c9b0 2023-11-28T12:09:20.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.268+0000 7f4931d9c700 1 -- 172.21.15.45:0/1553608669 >> v1:172.21.15.152:6789/0 conn(0x7f492c15c9b0 legacy=0x7f492c0b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:20.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.268+0000 7f4923fff700 1 -- 172.21.15.45:0/1553608669 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2272893395 0 0) 0x7f49180035b0 con 0x7f492c161340 2023-11-28T12:09:20.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.268+0000 7f4931d9c700 1 -- 172.21.15.45:0/1553608669 >> v1:172.21.15.45:6789/0 conn(0x7f492c161340 legacy=0x7f492c0d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:20.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.268+0000 7f4931d9c700 1 -- 172.21.15.45:0/1553608669 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f492c0d24f0 con 0x7f492c0cd7c0 2023-11-28T12:09:20.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.268+0000 7f4931d9c700 1 --2- 172.21.15.45:0/1553608669 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f492c0cd7c0 0x7f492c0cdc00 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4924009d90 tx=0x7f492400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3f5e9073b56a665 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:20.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.269+0000 7f4923fff700 1 -- 172.21.15.45:0/1553608669 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f492400e070 con 0x7f492c0cd7c0 2023-11-28T12:09:20.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.269+0000 7f4923fff700 1 -- 172.21.15.45:0/1553608669 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4924003a20 con 0x7f492c0cd7c0 2023-11-28T12:09:20.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.269+0000 7f4923fff700 1 -- 172.21.15.45:0/1553608669 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491c001670 con 0x7f492c0cd7c0 2023-11-28T12:09:20.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.269+0000 7f49337ff700 1 -- 172.21.15.45:0/1553608669 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f492c0cd7c0 msgr2=0x7f492c0cdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:20.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.269+0000 7f49337ff700 1 --2- 172.21.15.45:0/1553608669 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f492c0cd7c0 0x7f492c0cdc00 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4924009d90 tx=0x7f492400b330 comp rx=0 tx=0).stop 2023-11-28T12:09:20.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.269+0000 7f49337ff700 1 -- 172.21.15.45:0/1553608669 shutdown_connections 2023-11-28T12:09:20.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.269+0000 7f49337ff700 1 --2- 172.21.15.45:0/1553608669 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f492c0cd7c0 0x7f492c0cdc00 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:20.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.269+0000 7f49337ff700 1 -- 172.21.15.45:0/1553608669 >> 172.21.15.45:0/1553608669 conn(0x7f492c072600 msgr2=0x7f492c0cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:20.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.269+0000 7f49337ff700 1 -- 172.21.15.45:0/1553608669 shutdown_connections 2023-11-28T12:09:20.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.269+0000 7f49337ff700 1 -- 172.21.15.45:0/1553608669 wait complete. 2023-11-28T12:09:20.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.271+0000 7f49337ff700 1 Processor -- start 2023-11-28T12:09:20.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.271+0000 7f49337ff700 1 -- start start 2023-11-28T12:09:20.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.272+0000 7f49337ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f492c0cd7c0 0x7f492c148650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:20.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.272+0000 7f49337ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f492c15c9b0 0x7f492c1e8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:20.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.272+0000 7f49337ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f492c161340 0x7f492c1e81d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:20.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.272+0000 7f49337ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f492c1466b0 con 0x7f492c161340 2023-11-28T12:09:20.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.272+0000 7f49337ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f492c1599f0 con 0x7f492c15c9b0 2023-11-28T12:09:20.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.272+0000 7f49337ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f492c148c60 con 0x7f492c0cd7c0 2023-11-28T12:09:20.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.273+0000 7f4931d9c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f492c161340 0x7f492c1e81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:20.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.273+0000 7f493159b700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f492c0cd7c0 0x7f492c148650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:20.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.273+0000 7f4931d9c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f492c161340 0x7f492c1e81d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40566/0 (socket says 172.21.15.45:40566) 2023-11-28T12:09:20.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.273+0000 7f4931d9c700 1 -- 172.21.15.45:0/796952227 learned_addr learned my addr 172.21.15.45:0/796952227 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:09:20.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.273+0000 7f4930d9a700 1 --2- 172.21.15.45:0/796952227 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f492c15c9b0 0x7f492c1e8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:20.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.273+0000 7f4931d9c700 1 -- 172.21.15.45:0/796952227 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f492c0cd7c0 msgr2=0x7f492c148650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:20.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.273+0000 7f4931d9c700 1 --2- 172.21.15.45:0/796952227 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f492c0cd7c0 0x7f492c148650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:20.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.273+0000 7f4931d9c700 1 -- 172.21.15.45:0/796952227 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f492c15c9b0 msgr2=0x7f492c1e8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:20.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.273+0000 7f4931d9c700 1 --2- 172.21.15.45:0/796952227 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f492c15c9b0 0x7f492c1e8bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:20.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.273+0000 7f4931d9c700 1 -- 172.21.15.45:0/796952227 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4924009a70 con 0x7f492c161340 2023-11-28T12:09:20.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.273+0000 7f4931d9c700 1 --2- 172.21.15.45:0/796952227 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f492c161340 0x7f492c1e81d0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f4924015040 tx=0x7f4924004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:20.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.274+0000 7f4921ffb700 1 -- 172.21.15.45:0/796952227 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49240044c0 con 0x7f492c161340 2023-11-28T12:09:20.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.274+0000 7f4921ffb700 1 -- 172.21.15.45:0/796952227 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4924004620 con 0x7f492c161340 2023-11-28T12:09:20.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.274+0000 7f49337ff700 1 -- 172.21.15.45:0/796952227 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f492c0d1300 con 0x7f492c161340 2023-11-28T12:09:20.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.274+0000 7f4921ffb700 1 -- 172.21.15.45:0/796952227 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4924012430 con 0x7f492c161340 2023-11-28T12:09:20.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.274+0000 7f49337ff700 1 -- 172.21.15.45:0/796952227 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f492c0b5520 con 0x7f492c161340 2023-11-28T12:09:20.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.275+0000 7f49337ff700 1 -- 172.21.15.45:0/796952227 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f492c0d15e0 con 0x7f492c161340 2023-11-28T12:09:20.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.276+0000 7f4921ffb700 1 -- 172.21.15.45:0/796952227 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f4924023030 con 0x7f492c161340 2023-11-28T12:09:20.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.276+0000 7f4921ffb700 1 --2- 172.21.15.45:0/796952227 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f49100682f0 0x7f491006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:20.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.277+0000 7f4921ffb700 1 -- 172.21.15.45:0/796952227 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f4924087100 con 0x7f492c161340 2023-11-28T12:09:20.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.277+0000 7f493159b700 1 --2- 172.21.15.45:0/796952227 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f49100682f0 0x7f491006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:20.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.278+0000 7f493159b700 1 --2- 172.21.15.45:0/796952227 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f49100682f0 0x7f491006a7a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f49280011e0 tx=0x7f4928009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:20.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.281+0000 7f4921ffb700 1 -- 172.21.15.45:0/796952227 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f4924053830 con 0x7f492c161340 2023-11-28T12:09:20.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.482+0000 7f49337ff700 1 -- 172.21.15.45:0/796952227 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f492c0d0600 con 0x7f492c161340 2023-11-28T12:09:20.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.483+0000 7f4921ffb700 1 -- 172.21.15.45:0/796952227 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+17961 (secure 0 0 0) 0x7f4924056e50 con 0x7f492c161340 2023-11-28T12:09:20.484 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:09:20.484 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":49,"fsid":"bd7c37f1-f7c6-4778-b845-52cf2aa6e366","created":"2023-11-28T12:06:09.045075+0000","modified":"2023-11-28T12:09:18.977178+0000","last_up_change":"2023-11-28T12:06:21.282227+0000","last_in_change":"2023-11-28T12:06:12.560924+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T12:06:21.807108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T12:06:22.491009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-11-28T12:08:29.364957+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-11-28T12:08:30.374968+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d0cdd8a-87fd-4f2c-91bd-47bdfa661905","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":115843},{"type":"v1","addr":"172.21.15.45:6808","nonce":115843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":115843},{"type":"v1","addr":"172.21.15.45:6811","nonce":115843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":115843},{"type":"v1","addr":"172.21.15.45:6815","nonce":115843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":115843},{"type":"v1","addr":"172.21.15.45:6813","nonce":115843}]},"public_addr":"172.21.15.45:6808/115843","cluster_addr":"172.21.15.45:6811/115843","heartbeat_back_addr":"172.21.15.45:6815/115843","heartbeat_front_addr":"172.21.15.45:6813/115843","state":["exists","up"]},{"osd":1,"uuid":"c5de4ebd-9ec5-40b3-9caa-9b706fab4c76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":115842},{"type":"v1","addr":"172.21.15.45:6801","nonce":115842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":115842},{"type":"v1","addr":"172.21.15.45:6803","nonce":115842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6807","nonce":115842},{"type":"v1","addr":"172.21.15.45:6809","nonce":115842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":115842},{"type":"v1","addr":"172.21.15.45:6805","nonce":115842}]},"public_addr":"172.21.15.45:6801/115842","cluster_addr":"172.21.15.45:6803/115842","heartbeat_back_addr":"172.21.15.45:6809/115842","heartbeat_front_addr":"172.21.15.45:6805/115842","state":["exists","up"]},{"osd":2,"uuid":"9f4b36b2-65d2-40e7-9fe6-a2991afa71c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":115850},{"type":"v1","addr":"172.21.15.45:6819","nonce":115850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":115850},{"type":"v1","addr":"172.21.15.45:6823","nonce":115850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":115850},{"type":"v1","addr":"172.21.15.45:6831","nonce":115850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":115850},{"type":"v1","addr":"172.21.15.45:6828","nonce":115850}]},"public_addr":"172.21.15.45:6819/115850","cluster_addr":"172.21.15.45:6823/115850","heartbeat_back_addr":"172.21.15.45:6831/115850","heartbeat_front_addr":"172.21.15.45:6828/115850","state":["exists","up"]},{"osd":3,"uuid":"6fe7ef05-4e0d-426c-bf94-44b51d4d550b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":115848},{"type":"v1","addr":"172.21.15.45:6818","nonce":115848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":115848},{"type":"v1","addr":"172.21.15.45:6822","nonce":115848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6827","nonce":115848},{"type":"v1","addr":"172.21.15.45:6829","nonce":115848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":115848},{"type":"v1","addr":"172.21.15.45:6825","nonce":115848}]},"public_addr":"172.21.15.45:6818/115848","cluster_addr":"172.21.15.45:6822/115848","heartbeat_back_addr":"172.21.15.45:6829/115848","heartbeat_front_addr":"172.21.15.45:6825/115848","state":["exists","up"]},{"osd":4,"uuid":"fa403c08-d8a1-4a3a-8384-cb465c1a654c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":116092},{"type":"v1","addr":"172.21.15.152:6801","nonce":116092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":116092},{"type":"v1","addr":"172.21.15.152:6803","nonce":116092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":116092},{"type":"v1","addr":"172.21.15.152:6807","nonce":116092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":116092},{"type":"v1","addr":"172.21.15.152:6805","nonce":116092}]},"public_addr":"172.21.15.152:6801/116092","cluster_addr":"172.21.15.152:6803/116092","heartbeat_back_addr":"172.21.15.152:6807/116092","heartbeat_front_addr":"172.21.15.152:6805/116092","state":["exists","up"]},{"osd":5,"uuid":"399fc450-39fa-43a6-bf80-0b8bcb41bd95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6815","nonce":116093},{"type":"v1","addr":"172.21.15.152:6817","nonce":116093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":116093},{"type":"v1","addr":"172.21.15.152:6819","nonce":116093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":116093},{"type":"v1","addr":"172.21.15.152:6823","nonce":116093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":116093},{"type":"v1","addr":"172.21.15.152:6821","nonce":116093}]},"public_addr":"172.21.15.152:6817/116093","cluster_addr":"172.21.15.152:6819/116093","heartbeat_back_addr":"172.21.15.152:6823/116093","heartbeat_front_addr":"172.21.15.152:6821/116093","state":["exists","up"]},{"osd":6,"uuid":"e59a4017-2d23-4627-836b-e25b2d3ddaaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":116094},{"type":"v1","addr":"172.21.15.152:6809","nonce":116094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":116094},{"type":"v1","addr":"172.21.15.152:6811","nonce":116094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":116094},{"type":"v1","addr":"172.21.15.152:6816","nonce":116094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":116094},{"type":"v1","addr":"172.21.15.152:6813","nonce":116094}]},"public_addr":"172.21.15.152:6809/116094","cluster_addr":"172.21.15.152:6811/116094","heartbeat_back_addr":"172.21.15.152:6816/116094","heartbeat_front_addr":"172.21.15.152:6813/116094","state":["exists","up"]},{"osd":7,"uuid":"8d7f9d4b-bf08-4670-8591-388c0f012a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":116097},{"type":"v1","addr":"172.21.15.152:6825","nonce":116097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":116097},{"type":"v1","addr":"172.21.15.152:6827","nonce":116097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":116097},{"type":"v1","addr":"172.21.15.152:6831","nonce":116097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":116097},{"type":"v1","addr":"172.21.15.152:6829","nonce":116097}]},"public_addr":"172.21.15.152:6825/116097","cluster_addr":"172.21.15.152:6827/116097","heartbeat_back_addr":"172.21.15.152:6831/116097","heartbeat_front_addr":"172.21.15.152:6829/116097","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.937710+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.865423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.159434+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.913090+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.131647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.966255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.972583+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.177209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.14","mappings":[{"from":0,"to":6}]},{"pgid":"8.27","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T12:09:20.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.485+0000 7f49337ff700 1 -- 172.21.15.45:0/796952227 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f49100682f0 msgr2=0x7f491006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:20.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.485+0000 7f49337ff700 1 --2- 172.21.15.45:0/796952227 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f49100682f0 0x7f491006a7a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f49280011e0 tx=0x7f4928009040 comp rx=0 tx=0).stop 2023-11-28T12:09:20.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.485+0000 7f49337ff700 1 -- 172.21.15.45:0/796952227 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f492c161340 msgr2=0x7f492c1e81d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:20.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.485+0000 7f49337ff700 1 --2- 172.21.15.45:0/796952227 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f492c161340 0x7f492c1e81d0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f4924015040 tx=0x7f4924004ad0 comp rx=0 tx=0).stop 2023-11-28T12:09:20.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.485+0000 7f49337ff700 1 -- 172.21.15.45:0/796952227 shutdown_connections 2023-11-28T12:09:20.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.485+0000 7f49337ff700 1 --2- 172.21.15.45:0/796952227 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f49100682f0 0x7f491006a7a0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:20.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.485+0000 7f49337ff700 1 --2- 172.21.15.45:0/796952227 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f492c161340 0x7f492c1e81d0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:20.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.485+0000 7f49337ff700 1 --2- 172.21.15.45:0/796952227 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f492c0cd7c0 0x7f492c148650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:20.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.485+0000 7f49337ff700 1 --2- 172.21.15.45:0/796952227 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f492c15c9b0 0x7f492c1e8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:20.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.485+0000 7f49337ff700 1 -- 172.21.15.45:0/796952227 >> 172.21.15.45:0/796952227 conn(0x7f492c072600 msgr2=0x7f492c0b8090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:20.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.485+0000 7f49337ff700 1 -- 172.21.15.45:0/796952227 shutdown_connections 2023-11-28T12:09:20.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.486+0000 7f49337ff700 1 -- 172.21.15.45:0/796952227 wait complete. 2023-11-28T12:09:20.504 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-28T12:09:20.504 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T12:09:20.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.707+0000 7f3c079ff700 1 Processor -- start 2023-11-28T12:09:20.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.707+0000 7f3c079ff700 1 -- start start 2023-11-28T12:09:20.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.708+0000 7f3c079ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3c0015c9b0 0x7f3c000b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:20.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.708+0000 7f3c079ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3c00161340 0x7f3c000d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:20.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.708+0000 7f3c079ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f3c000d2320 0x7f3c000cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:20.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.708+0000 7f3c079ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c000b5800 con 0x7f3c0015c9b0 2023-11-28T12:09:20.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.708+0000 7f3c079ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c000d1950 con 0x7f3c000d2320 2023-11-28T12:09:20.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.708+0000 7f3c079ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c000b5520 con 0x7f3c00161340 2023-11-28T12:09:20.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.709+0000 7f3c0579b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3c0015c9b0 0x7f3c000b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:20.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.709+0000 7f3c0579b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3c0015c9b0 0x7f3c000b4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40576/0 (socket says 172.21.15.45:40576) 2023-11-28T12:09:20.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.709+0000 7f3c0579b700 1 -- 172.21.15.45:0/3538364569 learned_addr learned my addr 172.21.15.45:0/3538364569 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:09:20.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.709+0000 7f3c05f9c700 1 --2- 172.21.15.45:0/3538364569 >> v2:172.21.15.152:3300/0 conn(0x7f3c000d2320 0x7f3c000cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:20.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.709+0000 7f3c04f9a700 1 --2- 172.21.15.45:0/3538364569 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3c00161340 0x7f3c000d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:20.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.709+0000 7f3c0579b700 1 -- 172.21.15.45:0/3538364569 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3c00161340 msgr2=0x7f3c000d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:20.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.709+0000 7f3c0579b700 1 --2- 172.21.15.45:0/3538364569 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3c00161340 0x7f3c000d1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:20.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.709+0000 7f3c0579b700 1 -- 172.21.15.45:0/3538364569 >> v2:172.21.15.152:3300/0 conn(0x7f3c000d2320 msgr2=0x7f3c000cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:20.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.709+0000 7f3c0579b700 1 --2- 172.21.15.45:0/3538364569 >> v2:172.21.15.152:3300/0 conn(0x7f3c000d2320 0x7f3c000cd7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:20.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.709+0000 7f3c0579b700 1 -- 172.21.15.45:0/3538364569 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c000d1300 con 0x7f3c0015c9b0 2023-11-28T12:09:20.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.709+0000 7f3c05f9c700 1 --2- 172.21.15.45:0/3538364569 >> v2:172.21.15.152:3300/0 conn(0x7f3c000d2320 0x7f3c000cd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:09:20.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.709+0000 7f3c0579b700 1 --2- 172.21.15.45:0/3538364569 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c0015c9b0 0x7f3c000b4bf0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f3c0008c4d0 tx=0x7f3bfc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8b36c669458835d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:20.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.710+0000 7f3bf7fff700 1 -- 172.21.15.45:0/3538364569 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bfc00b870 con 0x7f3c0015c9b0 2023-11-28T12:09:20.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.710+0000 7f3bf7fff700 1 -- 172.21.15.45:0/3538364569 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bfc00b9d0 con 0x7f3c0015c9b0 2023-11-28T12:09:20.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.710+0000 7f3bf7fff700 1 -- 172.21.15.45:0/3538364569 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bfc00bd60 con 0x7f3c0015c9b0 2023-11-28T12:09:20.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.710+0000 7f3c079ff700 1 -- 172.21.15.45:0/3538364569 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c0015c9b0 msgr2=0x7f3c000b4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:20.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.710+0000 7f3c079ff700 1 --2- 172.21.15.45:0/3538364569 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c0015c9b0 0x7f3c000b4bf0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f3c0008c4d0 tx=0x7f3bfc009bd0 comp rx=0 tx=0).stop 2023-11-28T12:09:20.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.710+0000 7f3c079ff700 1 -- 172.21.15.45:0/3538364569 shutdown_connections 2023-11-28T12:09:20.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.710+0000 7f3c079ff700 1 --2- 172.21.15.45:0/3538364569 >> v2:172.21.15.152:3300/0 conn(0x7f3c000d2320 0x7f3c000cd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:20.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.710+0000 7f3c079ff700 1 --2- 172.21.15.45:0/3538364569 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c0015c9b0 0x7f3c000b4bf0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:20.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.710+0000 7f3c079ff700 1 --2- 172.21.15.45:0/3538364569 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3c00161340 0x7f3c000d1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:20.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.710+0000 7f3c079ff700 1 -- 172.21.15.45:0/3538364569 >> 172.21.15.45:0/3538364569 conn(0x7f3c00072600 msgr2=0x7f3c000cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:20.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.710+0000 7f3c079ff700 1 -- 172.21.15.45:0/3538364569 shutdown_connections 2023-11-28T12:09:20.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.710+0000 7f3c079ff700 1 -- 172.21.15.45:0/3538364569 wait complete. 2023-11-28T12:09:20.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.712+0000 7f3c079ff700 1 Processor -- start 2023-11-28T12:09:20.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.712+0000 7f3c079ff700 1 -- start start 2023-11-28T12:09:20.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.713+0000 7f3c079ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3c000d2320 0x7f3c00151230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:20.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.713+0000 7f3c079ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c0015c9b0 0x7f3c001e64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:20.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.713+0000 7f3c079ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c00161340 0x7f3c001e6a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:20.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.713+0000 7f3c079ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c001e9080 con 0x7f3c00161340 2023-11-28T12:09:20.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.713+0000 7f3c079ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c001e7800 con 0x7f3c0015c9b0 2023-11-28T12:09:20.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.713+0000 7f3c079ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c000c9ad0 con 0x7f3c000d2320 2023-11-28T12:09:20.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.714+0000 7f3c05f9c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c00161340 0x7f3c001e6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:20.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.714+0000 7f3c05f9c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c00161340 0x7f3c001e6a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40588/0 (socket says 172.21.15.45:40588) 2023-11-28T12:09:20.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.714+0000 7f3c05f9c700 1 -- 172.21.15.45:0/1865422520 learned_addr learned my addr 172.21.15.45:0/1865422520 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:09:20.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.714+0000 7f3c0579b700 1 --2- 172.21.15.45:0/1865422520 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3c000d2320 0x7f3c00151230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:20.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.714+0000 7f3c04f9a700 1 --2- 172.21.15.45:0/1865422520 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c0015c9b0 0x7f3c001e64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:20.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.714+0000 7f3c05f9c700 1 -- 172.21.15.45:0/1865422520 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3c000d2320 msgr2=0x7f3c00151230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:20.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.714+0000 7f3c05f9c700 1 --2- 172.21.15.45:0/1865422520 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3c000d2320 0x7f3c00151230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:20.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.714+0000 7f3c05f9c700 1 -- 172.21.15.45:0/1865422520 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c0015c9b0 msgr2=0x7f3c001e64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:20.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.714+0000 7f3c05f9c700 1 --2- 172.21.15.45:0/1865422520 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c0015c9b0 0x7f3c001e64c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:20.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.714+0000 7f3c05f9c700 1 -- 172.21.15.45:0/1865422520 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bfc009550 con 0x7f3c00161340 2023-11-28T12:09:20.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.714+0000 7f3c04f9a700 1 --2- 172.21.15.45:0/1865422520 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c0015c9b0 0x7f3c001e64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:09:20.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.714+0000 7f3c05f9c700 1 --2- 172.21.15.45:0/1865422520 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c00161340 0x7f3c001e6a00 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f3bf8007ea0 tx=0x7f3bf800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:20.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.714+0000 7f3bf5ffb700 1 -- 172.21.15.45:0/1865422520 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf800ddd0 con 0x7f3c00161340 2023-11-28T12:09:20.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.715+0000 7f3bf5ffb700 1 -- 172.21.15.45:0/1865422520 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bf800f040 con 0x7f3c00161340 2023-11-28T12:09:20.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.715+0000 7f3c079ff700 1 -- 172.21.15.45:0/1865422520 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c000b5130 con 0x7f3c00161340 2023-11-28T12:09:20.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.715+0000 7f3bf5ffb700 1 -- 172.21.15.45:0/1865422520 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf8003c60 con 0x7f3c00161340 2023-11-28T12:09:20.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.715+0000 7f3c079ff700 1 -- 172.21.15.45:0/1865422520 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c000d15e0 con 0x7f3c00161340 2023-11-28T12:09:20.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.716+0000 7f3c079ff700 1 -- 172.21.15.45:0/1865422520 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c000b52c0 con 0x7f3c00161340 2023-11-28T12:09:20.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.717+0000 7f3bf5ffb700 1 -- 172.21.15.45:0/1865422520 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f3bf801c030 con 0x7f3c00161340 2023-11-28T12:09:20.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.718+0000 7f3bf5ffb700 1 --2- 172.21.15.45:0/1865422520 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f3be40682f0 0x7f3be406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:20.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.718+0000 7f3bf5ffb700 1 -- 172.21.15.45:0/1865422520 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f3bf8085e60 con 0x7f3c00161340 2023-11-28T12:09:20.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.718+0000 7f3c0579b700 1 --2- 172.21.15.45:0/1865422520 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f3be40682f0 0x7f3be406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:20.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.719+0000 7f3c0579b700 1 --2- 172.21.15.45:0/1865422520 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f3be40682f0 0x7f3be406a7a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f3bfc014040 tx=0x7f3bfc008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:20.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.722+0000 7f3bf5ffb700 1 -- 172.21.15.45:0/1865422520 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f3bf8052500 con 0x7f3c00161340 2023-11-28T12:09:20.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.968+0000 7f3c079ff700 1 -- 172.21.15.45:0/1865422520 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3c000745c0 con 0x7f3c00161340 2023-11-28T12:09:20.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.969+0000 7f3bf5ffb700 1 -- 172.21.15.45:0/1865422520 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4651 (secure 0 0 0) 0x7f3bf801a020 con 0x7f3c00161340 2023-11-28T12:09:20.969 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:09:20.970 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5398,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6836/2532875180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":2532875180},{"type":"v1","addr":"172.21.15.152:6836","nonce":2532875180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5404,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/930111917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6835","nonce":930111917},{"type":"v1","addr":"172.21.15.152:6837","nonce":930111917}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5547,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/1974473454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1974473454},{"type":"v1","addr":"172.21.15.45:6834","nonce":1974473454}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T12:08:31.391914+0000","modified":"2023-11-28T12:08:34.873102+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5550},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5550":{"gid":5550,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/1281816633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":1281816633},{"type":"v1","addr":"172.21.15.45:6835","nonce":1281816633}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-28T12:09:20.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.971+0000 7f3c079ff700 1 -- 172.21.15.45:0/1865422520 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f3be40682f0 msgr2=0x7f3be406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:20.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.971+0000 7f3c079ff700 1 --2- 172.21.15.45:0/1865422520 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f3be40682f0 0x7f3be406a7a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f3bfc014040 tx=0x7f3bfc008030 comp rx=0 tx=0).stop 2023-11-28T12:09:20.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.971+0000 7f3c079ff700 1 -- 172.21.15.45:0/1865422520 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c00161340 msgr2=0x7f3c001e6a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:20.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.971+0000 7f3c079ff700 1 --2- 172.21.15.45:0/1865422520 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c00161340 0x7f3c001e6a00 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f3bf8007ea0 tx=0x7f3bf800d3b0 comp rx=0 tx=0).stop 2023-11-28T12:09:20.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.971+0000 7f3c079ff700 1 -- 172.21.15.45:0/1865422520 shutdown_connections 2023-11-28T12:09:20.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.971+0000 7f3c079ff700 1 --2- 172.21.15.45:0/1865422520 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f3be40682f0 0x7f3be406a7a0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:20.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.971+0000 7f3c079ff700 1 --2- 172.21.15.45:0/1865422520 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c00161340 0x7f3c001e6a00 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:20.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.971+0000 7f3c079ff700 1 --2- 172.21.15.45:0/1865422520 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3c000d2320 0x7f3c00151230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:20.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.971+0000 7f3c079ff700 1 --2- 172.21.15.45:0/1865422520 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c0015c9b0 0x7f3c001e64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:20.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.971+0000 7f3c079ff700 1 -- 172.21.15.45:0/1865422520 >> 172.21.15.45:0/1865422520 conn(0x7f3c00072600 msgr2=0x7f3c000b89f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:20.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.971+0000 7f3c079ff700 1 -- 172.21.15.45:0/1865422520 shutdown_connections 2023-11-28T12:09:20.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:20.971+0000 7f3c079ff700 1 -- 172.21.15.45:0/1865422520 wait complete. 2023-11-28T12:09:20.973 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 24 2023-11-28T12:09:20.991 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T12:09:21.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.194+0000 7ff37e7ff700 1 Processor -- start 2023-11-28T12:09:21.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.194+0000 7ff37e7ff700 1 -- start start 2023-11-28T12:09:21.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.195+0000 7ff37e7ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ff378161340 0x7ff3780d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:21.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.195+0000 7ff37e7ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3780d1950 con 0x7ff37815c9b0 2023-11-28T12:09:21.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.195+0000 7ff37e7ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3780b5520 con 0x7ff3780d2320 2023-11-28T12:09:21.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.195+0000 7ff37e7ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3780b5800 con 0x7ff378161340 2023-11-28T12:09:21.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.196+0000 7ff377fff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ff37815c9b0 0x7ff3780b4bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:53598/0 (socket says 172.21.15.45:53598) 2023-11-28T12:09:21.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.196+0000 7ff377fff700 1 -- 172.21.15.45:0/88606977 learned_addr learned my addr 172.21.15.45:0/88606977 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:09:21.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.196+0000 7ff3777fe700 1 --2- 172.21.15.45:0/88606977 >> v2:172.21.15.152:3300/0 conn(0x7ff378161340 0x7ff3780d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:21.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.196+0000 7ff376ffd700 1 -- 172.21.15.45:0/88606977 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1010132815 0 0) 0x7ff3780d1950 con 0x7ff37815c9b0 2023-11-28T12:09:21.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.196+0000 7ff376ffd700 1 -- 172.21.15.45:0/88606977 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3600035b0 con 0x7ff37815c9b0 2023-11-28T12:09:21.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.196+0000 7ff376ffd700 1 -- 172.21.15.45:0/88606977 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 430319134 0 0) 0x7ff3600035b0 con 0x7ff37815c9b0 2023-11-28T12:09:21.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.196+0000 7ff376ffd700 1 -- 172.21.15.45:0/88606977 >> v2:172.21.15.152:3300/0 conn(0x7ff378161340 msgr2=0x7ff3780d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:21.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.196+0000 7ff376ffd700 1 --2- 172.21.15.45:0/88606977 >> v2:172.21.15.152:3300/0 conn(0x7ff378161340 0x7ff3780d1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:21.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.196+0000 7ff376ffd700 1 -- 172.21.15.45:0/88606977 >> v1:172.21.15.152:6789/0 conn(0x7ff3780d2320 legacy=0x7ff3780cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:21.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.196+0000 7ff376ffd700 1 -- 172.21.15.45:0/88606977 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3780d1300 con 0x7ff37815c9b0 2023-11-28T12:09:21.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.196+0000 7ff376ffd700 1 -- 172.21.15.45:0/88606977 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3460218165 0 0) 0x7ff368001670 con 0x7ff37815c9b0 2023-11-28T12:09:21.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.197+0000 7ff376ffd700 1 -- 172.21.15.45:0/88606977 >> v1:172.21.15.45:6789/0 conn(0x7ff37815c9b0 legacy=0x7ff3780b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:21.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.197+0000 7ff376ffd700 1 --2- 172.21.15.45:0/88606977 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff360003a50 0x7ff360003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:21.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.197+0000 7ff376ffd700 1 --2- 172.21.15.45:0/88606977 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff360004850 0x7ff360004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:21.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.197+0000 7ff376ffd700 1 --2- 172.21.15.45:0/88606977 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff360005250 0x7ff36000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:21.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.197+0000 7ff376ffd700 1 -- 172.21.15.45:0/88606977 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3780b5800 con 0x7ff360005250 2023-11-28T12:09:21.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.197+0000 7ff376ffd700 1 -- 172.21.15.45:0/88606977 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff36000c160 con 0x7ff360003a50 2023-11-28T12:09:21.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.197+0000 7ff376ffd700 1 -- 172.21.15.45:0/88606977 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff36000c320 con 0x7ff360004850 2023-11-28T12:09:21.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.197+0000 7ff37cd9c700 1 --2- 172.21.15.45:0/88606977 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff360005250 0x7ff36000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:21.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.197+0000 7ff3777fe700 1 --2- 172.21.15.45:0/88606977 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff360004850 0x7ff360004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:21.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.197+0000 7ff377fff700 1 --2- 172.21.15.45:0/88606977 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff360003a50 0x7ff360003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:21.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.197+0000 7ff37cd9c700 1 -- 172.21.15.45:0/88606977 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff360004850 msgr2=0x7ff360004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:21.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.197+0000 7ff37cd9c700 1 --2- 172.21.15.45:0/88606977 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff360004850 0x7ff360004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:21.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.197+0000 7ff37cd9c700 1 -- 172.21.15.45:0/88606977 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff360003a50 msgr2=0x7ff360003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:21.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.197+0000 7ff37cd9c700 1 --2- 172.21.15.45:0/88606977 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff360003a50 0x7ff360003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:21.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.197+0000 7ff37cd9c700 1 -- 172.21.15.45:0/88606977 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3600035b0 con 0x7ff360005250 2023-11-28T12:09:21.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.197+0000 7ff377fff700 1 --2- 172.21.15.45:0/88606977 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff360003a50 0x7ff360003e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:09:21.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.197+0000 7ff37cd9c700 1 -- 172.21.15.45:0/88606977 reap_dead start 2023-11-28T12:09:21.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.198+0000 7ff37cd9c700 1 --2- 172.21.15.45:0/88606977 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff360005250 0x7ff36000ba10 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7ff37000c160 tx=0x7ff360005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69c8bb36cbd4b601 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:21.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.198+0000 7ff376ffd700 1 -- 172.21.15.45:0/88606977 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff370001db0 con 0x7ff360005250 2023-11-28T12:09:21.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.198+0000 7ff376ffd700 1 -- 172.21.15.45:0/88606977 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff37000ccc0 con 0x7ff360005250 2023-11-28T12:09:21.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.198+0000 7ff376ffd700 1 -- 172.21.15.45:0/88606977 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff370003c40 con 0x7ff360005250 2023-11-28T12:09:21.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.198+0000 7ff37e7ff700 1 -- 172.21.15.45:0/88606977 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff360005250 msgr2=0x7ff36000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:21.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.198+0000 7ff37e7ff700 1 --2- 172.21.15.45:0/88606977 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff360005250 0x7ff36000ba10 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7ff37000c160 tx=0x7ff360005880 comp rx=0 tx=0).stop 2023-11-28T12:09:21.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.198+0000 7ff37e7ff700 1 -- 172.21.15.45:0/88606977 shutdown_connections 2023-11-28T12:09:21.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.198+0000 7ff37e7ff700 1 --2- 172.21.15.45:0/88606977 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff360005250 0x7ff36000ba10 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:21.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.198+0000 7ff37e7ff700 1 -- 172.21.15.45:0/88606977 >> 172.21.15.45:0/88606977 conn(0x7ff378072600 msgr2=0x7ff3780cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:21.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.198+0000 7ff37e7ff700 1 -- 172.21.15.45:0/88606977 shutdown_connections 2023-11-28T12:09:21.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.199+0000 7ff37e7ff700 1 -- 172.21.15.45:0/88606977 wait complete. 2023-11-28T12:09:21.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.201+0000 7ff37e7ff700 1 Processor -- start 2023-11-28T12:09:21.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.201+0000 7ff37e7ff700 1 -- start start 2023-11-28T12:09:21.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.202+0000 7ff37e7ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff360005250 0x7ff37815f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:21.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.202+0000 7ff37e7ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff3781577f0 0x7ff3780c7610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:21.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.202+0000 7ff37e7ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3780c99d0 0x7ff3780c7b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:21.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.202+0000 7ff37e7ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3781e7810 con 0x7ff360005250 2023-11-28T12:09:21.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.202+0000 7ff37e7ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3780ce030 con 0x7ff3780c99d0 2023-11-28T12:09:21.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.202+0000 7ff37e7ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3781e74e0 con 0x7ff3781577f0 2023-11-28T12:09:21.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.203+0000 7ff377fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff360005250 0x7ff37815f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:21.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.203+0000 7ff377fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff360005250 0x7ff37815f070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40606/0 (socket says 172.21.15.45:40606) 2023-11-28T12:09:21.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.203+0000 7ff377fff700 1 -- 172.21.15.45:0/1195780067 learned_addr learned my addr 172.21.15.45:0/1195780067 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:09:21.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.203+0000 7ff377fff700 1 -- 172.21.15.45:0/1195780067 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff3781577f0 msgr2=0x7ff3780c7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:21.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.203+0000 7ff377fff700 1 --2- 172.21.15.45:0/1195780067 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff3781577f0 0x7ff3780c7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:21.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.203+0000 7ff377fff700 1 -- 172.21.15.45:0/1195780067 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3780c99d0 msgr2=0x7ff3780c7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:21.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.203+0000 7ff377fff700 1 --2- 172.21.15.45:0/1195780067 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3780c99d0 0x7ff3780c7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:21.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.203+0000 7ff377fff700 1 -- 172.21.15.45:0/1195780067 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff37815cd80 con 0x7ff360005250 2023-11-28T12:09:21.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.203+0000 7ff377fff700 1 --2- 172.21.15.45:0/1195780067 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff360005250 0x7ff37815f070 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7ff36800e830 tx=0x7ff36800ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:21.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.203+0000 7ff374ff9700 1 -- 172.21.15.45:0/1195780067 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff368012590 con 0x7ff360005250 2023-11-28T12:09:21.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.204+0000 7ff374ff9700 1 -- 172.21.15.45:0/1195780067 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3680126f0 con 0x7ff360005250 2023-11-28T12:09:21.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.204+0000 7ff37e7ff700 1 -- 172.21.15.45:0/1195780067 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3780d15e0 con 0x7ff360005250 2023-11-28T12:09:21.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.204+0000 7ff374ff9700 1 -- 172.21.15.45:0/1195780067 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff368012a60 con 0x7ff360005250 2023-11-28T12:09:21.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.204+0000 7ff37e7ff700 1 -- 172.21.15.45:0/1195780067 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff37815cf10 con 0x7ff360005250 2023-11-28T12:09:21.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.205+0000 7ff37e7ff700 1 -- 172.21.15.45:0/1195780067 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3780ce170 con 0x7ff360005250 2023-11-28T12:09:21.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.206+0000 7ff374ff9700 1 -- 172.21.15.45:0/1195780067 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7ff368012bc0 con 0x7ff360005250 2023-11-28T12:09:21.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.206+0000 7ff374ff9700 1 --2- 172.21.15.45:0/1195780067 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7ff3640682f0 0x7ff36406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:21.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.206+0000 7ff374ff9700 1 -- 172.21.15.45:0/1195780067 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6120+0+0 (secure 0 0 0) 0x7ff368085d40 con 0x7ff360005250 2023-11-28T12:09:21.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.207+0000 7ff3777fe700 1 --2- 172.21.15.45:0/1195780067 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7ff3640682f0 0x7ff36406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:21.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.208+0000 7ff3777fe700 1 --2- 172.21.15.45:0/1195780067 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7ff3640682f0 0x7ff36406a7a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ff3781e95a0 tx=0x7ff36c0093c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:21.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.210+0000 7ff374ff9700 1 -- 172.21.15.45:0/1195780067 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7ff3780ce170 con 0x7ff360005250 2023-11-28T12:09:21.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.459+0000 7ff37e7ff700 1 -- 172.21.15.45:0/1195780067 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff3780ce170 con 0x7ff360005250 2023-11-28T12:09:21.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.459+0000 7ff374ff9700 1 -- 172.21.15.45:0/1195780067 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4651 (secure 0 0 0) 0x7ff3780ce170 con 0x7ff360005250 2023-11-28T12:09:21.460 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:09:21.460 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5398,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6836/2532875180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":2532875180},{"type":"v1","addr":"172.21.15.152:6836","nonce":2532875180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5404,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/930111917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6835","nonce":930111917},{"type":"v1","addr":"172.21.15.152:6837","nonce":930111917}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5547,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/1974473454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1974473454},{"type":"v1","addr":"172.21.15.45:6834","nonce":1974473454}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T12:08:31.391914+0000","modified":"2023-11-28T12:08:34.873102+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5550},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5550":{"gid":5550,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/1281816633","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":1281816633},{"type":"v1","addr":"172.21.15.45:6835","nonce":1281816633}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-28T12:09:21.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.462+0000 7ff37e7ff700 1 -- 172.21.15.45:0/1195780067 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7ff3640682f0 msgr2=0x7ff36406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:21.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.462+0000 7ff37e7ff700 1 --2- 172.21.15.45:0/1195780067 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7ff3640682f0 0x7ff36406a7a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ff3781e95a0 tx=0x7ff36c0093c0 comp rx=0 tx=0).stop 2023-11-28T12:09:21.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.462+0000 7ff37e7ff700 1 -- 172.21.15.45:0/1195780067 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff360005250 msgr2=0x7ff37815f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:21.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.462+0000 7ff37e7ff700 1 --2- 172.21.15.45:0/1195780067 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff360005250 0x7ff37815f070 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7ff36800e830 tx=0x7ff36800ebf0 comp rx=0 tx=0).stop 2023-11-28T12:09:21.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.462+0000 7ff37e7ff700 1 -- 172.21.15.45:0/1195780067 shutdown_connections 2023-11-28T12:09:21.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.462+0000 7ff37e7ff700 1 --2- 172.21.15.45:0/1195780067 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7ff3640682f0 0x7ff36406a7a0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:21.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.462+0000 7ff37e7ff700 1 --2- 172.21.15.45:0/1195780067 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3780c99d0 0x7ff3780c7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:21.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.462+0000 7ff37e7ff700 1 --2- 172.21.15.45:0/1195780067 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff360005250 0x7ff37815f070 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:21.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.462+0000 7ff37e7ff700 1 --2- 172.21.15.45:0/1195780067 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff3781577f0 0x7ff3780c7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:21.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.462+0000 7ff37e7ff700 1 -- 172.21.15.45:0/1195780067 >> 172.21.15.45:0/1195780067 conn(0x7ff378072600 msgr2=0x7ff3780b6030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:21.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.462+0000 7ff37e7ff700 1 -- 172.21.15.45:0/1195780067 shutdown_connections 2023-11-28T12:09:21.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.462+0000 7ff37e7ff700 1 -- 172.21.15.45:0/1195780067 wait complete. 2023-11-28T12:09:21.464 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 24 2023-11-28T12:09:21.480 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T12:09:21.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.684+0000 7fafbd5ff700 1 Processor -- start 2023-11-28T12:09:21.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.684+0000 7fafbd5ff700 1 -- start start 2023-11-28T12:09:21.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.686+0000 7fafbd5ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fafb815c9b0 0x7fafb80b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:21.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.686+0000 7fafbd5ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fafb80cd7c0 0x7fafb80cdc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:21.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.686+0000 7fafbd5ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafb80ce160 con 0x7fafb8161340 2023-11-28T12:09:21.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.686+0000 7fafbd5ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafb80b5800 con 0x7fafb80cd7c0 2023-11-28T12:09:21.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.686+0000 7fafbd5ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafb80d1950 con 0x7fafb815c9b0 2023-11-28T12:09:21.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.686+0000 7fafb77fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fafb80cd7c0 0x7fafb80cdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:21.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.686+0000 7fafaffff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fafb8161340 0x7fafb80d1de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:53608/0 (socket says 172.21.15.45:53608) 2023-11-28T12:09:21.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.686+0000 7fafaffff700 1 -- 172.21.15.45:0/1838289669 learned_addr learned my addr 172.21.15.45:0/1838289669 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:09:21.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.687+0000 7fafb6ffd700 1 --2- 172.21.15.45:0/1838289669 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fafb815c9b0 0x7fafb80b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:21.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.687+0000 7fafb77fe700 1 -- 172.21.15.45:0/1838289669 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fafb815c9b0 msgr2=0x7fafb80b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:21.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.687+0000 7fafb77fe700 1 --2- 172.21.15.45:0/1838289669 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fafb815c9b0 0x7fafb80b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:21.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.687+0000 7fafb77fe700 1 -- 172.21.15.45:0/1838289669 >> v1:172.21.15.45:6789/0 conn(0x7fafb8161340 legacy=0x7fafb80d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:21.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.687+0000 7fafb77fe700 1 -- 172.21.15.45:0/1838289669 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafb80d24f0 con 0x7fafb80cd7c0 2023-11-28T12:09:21.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.687+0000 7fafb67fc700 1 -- 172.21.15.45:0/1838289669 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3452604744 0 0) 0x7fafb80ce160 con 0x7fafb8161340 2023-11-28T12:09:21.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.687+0000 7fafb77fe700 1 --2- 172.21.15.45:0/1838289669 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafb80cd7c0 0x7fafb80cdc20 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fafb0009d90 tx=0x7fafb000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c951e9611c4472a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:21.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.687+0000 7fafb67fc700 1 -- 172.21.15.45:0/1838289669 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb000e070 con 0x7fafb80cd7c0 2023-11-28T12:09:21.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.687+0000 7fafb67fc700 1 -- 172.21.15.45:0/1838289669 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafb000bbd0 con 0x7fafb80cd7c0 2023-11-28T12:09:21.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.687+0000 7fafb67fc700 1 -- 172.21.15.45:0/1838289669 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb0012430 con 0x7fafb80cd7c0 2023-11-28T12:09:21.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.688+0000 7fafbd5ff700 1 -- 172.21.15.45:0/1838289669 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafb80cd7c0 msgr2=0x7fafb80cdc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:21.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.688+0000 7fafbd5ff700 1 --2- 172.21.15.45:0/1838289669 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafb80cd7c0 0x7fafb80cdc20 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fafb0009d90 tx=0x7fafb000b330 comp rx=0 tx=0).stop 2023-11-28T12:09:21.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.688+0000 7fafbd5ff700 1 -- 172.21.15.45:0/1838289669 shutdown_connections 2023-11-28T12:09:21.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.688+0000 7fafbd5ff700 1 --2- 172.21.15.45:0/1838289669 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafb80cd7c0 0x7fafb80cdc20 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:21.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.688+0000 7fafbd5ff700 1 --2- 172.21.15.45:0/1838289669 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fafb815c9b0 0x7fafb80b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:21.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.688+0000 7fafbd5ff700 1 -- 172.21.15.45:0/1838289669 >> 172.21.15.45:0/1838289669 conn(0x7fafb8072600 msgr2=0x7fafb80cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:21.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.688+0000 7fafbd5ff700 1 -- 172.21.15.45:0/1838289669 shutdown_connections 2023-11-28T12:09:21.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.688+0000 7fafbd5ff700 1 -- 172.21.15.45:0/1838289669 wait complete. 2023-11-28T12:09:21.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.690+0000 7fafbd5ff700 1 Processor -- start 2023-11-28T12:09:21.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.690+0000 7fafbd5ff700 1 -- start start 2023-11-28T12:09:21.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.691+0000 7fafbd5ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fafb80cd7c0 0x7fafb814a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:21.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.691+0000 7fafbd5ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fafb815c9b0 0x7fafb80c95c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:21.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.691+0000 7fafbd5ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafb8161340 0x7fafb81f2a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:21.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.691+0000 7fafbd5ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb81e83f0 con 0x7fafb8161340 2023-11-28T12:09:21.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.691+0000 7fafbd5ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb81e77e0 con 0x7fafb80cd7c0 2023-11-28T12:09:21.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.691+0000 7fafbd5ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafb81e7ac0 con 0x7fafb815c9b0 2023-11-28T12:09:21.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.691+0000 7fafb77fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafb8161340 0x7fafb81f2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:21.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.691+0000 7fafb77fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafb8161340 0x7fafb81f2a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40620/0 (socket says 172.21.15.45:40620) 2023-11-28T12:09:21.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.691+0000 7fafb77fe700 1 -- 172.21.15.45:0/2408049308 learned_addr learned my addr 172.21.15.45:0/2408049308 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:09:21.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.691+0000 7fafaffff700 1 --2- 172.21.15.45:0/2408049308 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fafb815c9b0 0x7fafb80c95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:21.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.691+0000 7fafb6ffd700 1 --2- 172.21.15.45:0/2408049308 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fafb80cd7c0 0x7fafb814a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:21.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.692+0000 7fafb77fe700 1 -- 172.21.15.45:0/2408049308 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fafb815c9b0 msgr2=0x7fafb80c95c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:21.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.692+0000 7fafb77fe700 1 --2- 172.21.15.45:0/2408049308 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fafb815c9b0 0x7fafb80c95c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:21.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.692+0000 7fafb77fe700 1 -- 172.21.15.45:0/2408049308 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fafb80cd7c0 msgr2=0x7fafb814a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:21.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.692+0000 7fafb77fe700 1 --2- 172.21.15.45:0/2408049308 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fafb80cd7c0 0x7fafb814a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:21.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.692+0000 7fafb77fe700 1 -- 172.21.15.45:0/2408049308 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafb0009a70 con 0x7fafb8161340 2023-11-28T12:09:21.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.692+0000 7fafb77fe700 1 --2- 172.21.15.45:0/2408049308 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafb8161340 0x7fafb81f2a50 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fafb8067550 tx=0x7fafb0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:21.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.692+0000 7fafaf7fe700 1 -- 172.21.15.45:0/2408049308 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb0012430 con 0x7fafb8161340 2023-11-28T12:09:21.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.692+0000 7fafaf7fe700 1 -- 172.21.15.45:0/2408049308 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafb0020070 con 0x7fafb8161340 2023-11-28T12:09:21.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.692+0000 7fafbd5ff700 1 -- 172.21.15.45:0/2408049308 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafb80d1300 con 0x7fafb8161340 2023-11-28T12:09:21.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.692+0000 7fafaf7fe700 1 -- 172.21.15.45:0/2408049308 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb0004280 con 0x7fafb8161340 2023-11-28T12:09:21.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.692+0000 7fafbd5ff700 1 -- 172.21.15.45:0/2408049308 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafb80b5520 con 0x7fafb8161340 2023-11-28T12:09:21.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.693+0000 7fafbd5ff700 1 -- 172.21.15.45:0/2408049308 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafb80d15e0 con 0x7fafb8161340 2023-11-28T12:09:21.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.694+0000 7fafaf7fe700 1 -- 172.21.15.45:0/2408049308 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fafb00043e0 con 0x7fafb8161340 2023-11-28T12:09:21.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.695+0000 7fafaf7fe700 1 --2- 172.21.15.45:0/2408049308 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7faf980682f0 0x7faf9806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:21.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.695+0000 7fafaf7fe700 1 -- 172.21.15.45:0/2408049308 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fafb0022070 con 0x7fafb8161340 2023-11-28T12:09:21.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.695+0000 7fafb6ffd700 1 --2- 172.21.15.45:0/2408049308 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7faf980682f0 0x7faf9806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:21.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.696+0000 7fafb6ffd700 1 --2- 172.21.15.45:0/2408049308 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7faf980682f0 0x7faf9806a7a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fafa800b9b0 tx=0x7fafa8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:21.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.699+0000 7fafaf7fe700 1 -- 172.21.15.45:0/2408049308 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fafb0054910 con 0x7fafb8161340 2023-11-28T12:09:21.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.901+0000 7fafbd5ff700 1 -- 172.21.15.45:0/2408049308 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fafb80745c0 con 0x7fafb8161340 2023-11-28T12:09:21.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.902+0000 7fafaf7fe700 1 -- 172.21.15.45:0/2408049308 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+17961 (secure 0 0 0) 0x7fafb0057f30 con 0x7fafb8161340 2023-11-28T12:09:21.903 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:09:21.903 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":49,"fsid":"bd7c37f1-f7c6-4778-b845-52cf2aa6e366","created":"2023-11-28T12:06:09.045075+0000","modified":"2023-11-28T12:09:18.977178+0000","last_up_change":"2023-11-28T12:06:21.282227+0000","last_in_change":"2023-11-28T12:06:12.560924+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T12:06:21.807108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T12:06:22.491009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-11-28T12:08:29.364957+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-11-28T12:08:30.374968+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d0cdd8a-87fd-4f2c-91bd-47bdfa661905","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":115843},{"type":"v1","addr":"172.21.15.45:6808","nonce":115843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":115843},{"type":"v1","addr":"172.21.15.45:6811","nonce":115843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":115843},{"type":"v1","addr":"172.21.15.45:6815","nonce":115843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":115843},{"type":"v1","addr":"172.21.15.45:6813","nonce":115843}]},"public_addr":"172.21.15.45:6808/115843","cluster_addr":"172.21.15.45:6811/115843","heartbeat_back_addr":"172.21.15.45:6815/115843","heartbeat_front_addr":"172.21.15.45:6813/115843","state":["exists","up"]},{"osd":1,"uuid":"c5de4ebd-9ec5-40b3-9caa-9b706fab4c76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":115842},{"type":"v1","addr":"172.21.15.45:6801","nonce":115842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":115842},{"type":"v1","addr":"172.21.15.45:6803","nonce":115842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6807","nonce":115842},{"type":"v1","addr":"172.21.15.45:6809","nonce":115842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":115842},{"type":"v1","addr":"172.21.15.45:6805","nonce":115842}]},"public_addr":"172.21.15.45:6801/115842","cluster_addr":"172.21.15.45:6803/115842","heartbeat_back_addr":"172.21.15.45:6809/115842","heartbeat_front_addr":"172.21.15.45:6805/115842","state":["exists","up"]},{"osd":2,"uuid":"9f4b36b2-65d2-40e7-9fe6-a2991afa71c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":115850},{"type":"v1","addr":"172.21.15.45:6819","nonce":115850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":115850},{"type":"v1","addr":"172.21.15.45:6823","nonce":115850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":115850},{"type":"v1","addr":"172.21.15.45:6831","nonce":115850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":115850},{"type":"v1","addr":"172.21.15.45:6828","nonce":115850}]},"public_addr":"172.21.15.45:6819/115850","cluster_addr":"172.21.15.45:6823/115850","heartbeat_back_addr":"172.21.15.45:6831/115850","heartbeat_front_addr":"172.21.15.45:6828/115850","state":["exists","up"]},{"osd":3,"uuid":"6fe7ef05-4e0d-426c-bf94-44b51d4d550b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":115848},{"type":"v1","addr":"172.21.15.45:6818","nonce":115848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":115848},{"type":"v1","addr":"172.21.15.45:6822","nonce":115848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6827","nonce":115848},{"type":"v1","addr":"172.21.15.45:6829","nonce":115848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":115848},{"type":"v1","addr":"172.21.15.45:6825","nonce":115848}]},"public_addr":"172.21.15.45:6818/115848","cluster_addr":"172.21.15.45:6822/115848","heartbeat_back_addr":"172.21.15.45:6829/115848","heartbeat_front_addr":"172.21.15.45:6825/115848","state":["exists","up"]},{"osd":4,"uuid":"fa403c08-d8a1-4a3a-8384-cb465c1a654c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":116092},{"type":"v1","addr":"172.21.15.152:6801","nonce":116092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":116092},{"type":"v1","addr":"172.21.15.152:6803","nonce":116092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":116092},{"type":"v1","addr":"172.21.15.152:6807","nonce":116092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":116092},{"type":"v1","addr":"172.21.15.152:6805","nonce":116092}]},"public_addr":"172.21.15.152:6801/116092","cluster_addr":"172.21.15.152:6803/116092","heartbeat_back_addr":"172.21.15.152:6807/116092","heartbeat_front_addr":"172.21.15.152:6805/116092","state":["exists","up"]},{"osd":5,"uuid":"399fc450-39fa-43a6-bf80-0b8bcb41bd95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6815","nonce":116093},{"type":"v1","addr":"172.21.15.152:6817","nonce":116093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":116093},{"type":"v1","addr":"172.21.15.152:6819","nonce":116093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":116093},{"type":"v1","addr":"172.21.15.152:6823","nonce":116093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":116093},{"type":"v1","addr":"172.21.15.152:6821","nonce":116093}]},"public_addr":"172.21.15.152:6817/116093","cluster_addr":"172.21.15.152:6819/116093","heartbeat_back_addr":"172.21.15.152:6823/116093","heartbeat_front_addr":"172.21.15.152:6821/116093","state":["exists","up"]},{"osd":6,"uuid":"e59a4017-2d23-4627-836b-e25b2d3ddaaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":116094},{"type":"v1","addr":"172.21.15.152:6809","nonce":116094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":116094},{"type":"v1","addr":"172.21.15.152:6811","nonce":116094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":116094},{"type":"v1","addr":"172.21.15.152:6816","nonce":116094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":116094},{"type":"v1","addr":"172.21.15.152:6813","nonce":116094}]},"public_addr":"172.21.15.152:6809/116094","cluster_addr":"172.21.15.152:6811/116094","heartbeat_back_addr":"172.21.15.152:6816/116094","heartbeat_front_addr":"172.21.15.152:6813/116094","state":["exists","up"]},{"osd":7,"uuid":"8d7f9d4b-bf08-4670-8591-388c0f012a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":116097},{"type":"v1","addr":"172.21.15.152:6825","nonce":116097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":116097},{"type":"v1","addr":"172.21.15.152:6827","nonce":116097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":116097},{"type":"v1","addr":"172.21.15.152:6831","nonce":116097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":116097},{"type":"v1","addr":"172.21.15.152:6829","nonce":116097}]},"public_addr":"172.21.15.152:6825/116097","cluster_addr":"172.21.15.152:6827/116097","heartbeat_back_addr":"172.21.15.152:6831/116097","heartbeat_front_addr":"172.21.15.152:6829/116097","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.937710+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.865423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.159434+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.913090+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.131647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.966255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.972583+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.177209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.14","mappings":[{"from":0,"to":6}]},{"pgid":"8.27","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T12:09:21.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.905+0000 7fafbd5ff700 1 -- 172.21.15.45:0/2408049308 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7faf980682f0 msgr2=0x7faf9806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:21.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.905+0000 7fafbd5ff700 1 --2- 172.21.15.45:0/2408049308 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7faf980682f0 0x7faf9806a7a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fafa800b9b0 tx=0x7fafa8008040 comp rx=0 tx=0).stop 2023-11-28T12:09:21.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.905+0000 7fafbd5ff700 1 -- 172.21.15.45:0/2408049308 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafb8161340 msgr2=0x7fafb81f2a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:21.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.905+0000 7fafbd5ff700 1 --2- 172.21.15.45:0/2408049308 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafb8161340 0x7fafb81f2a50 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fafb8067550 tx=0x7fafb0004ad0 comp rx=0 tx=0).stop 2023-11-28T12:09:21.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.905+0000 7fafbd5ff700 1 -- 172.21.15.45:0/2408049308 shutdown_connections 2023-11-28T12:09:21.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.905+0000 7fafbd5ff700 1 --2- 172.21.15.45:0/2408049308 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7faf980682f0 0x7faf9806a7a0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:21.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.905+0000 7fafbd5ff700 1 --2- 172.21.15.45:0/2408049308 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fafb80cd7c0 0x7fafb814a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:21.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.905+0000 7fafbd5ff700 1 --2- 172.21.15.45:0/2408049308 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafb8161340 0x7fafb81f2a50 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:21.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.905+0000 7fafbd5ff700 1 --2- 172.21.15.45:0/2408049308 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fafb815c9b0 0x7fafb80c95c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:21.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.905+0000 7fafbd5ff700 1 -- 172.21.15.45:0/2408049308 >> 172.21.15.45:0/2408049308 conn(0x7fafb8072600 msgr2=0x7fafb80b5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:21.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.905+0000 7fafbd5ff700 1 -- 172.21.15.45:0/2408049308 shutdown_connections 2023-11-28T12:09:21.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:21.905+0000 7fafbd5ff700 1 -- 172.21.15.45:0/2408049308 wait complete. 2023-11-28T12:09:21.924 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-28T12:09:22.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:22.129+0000 7f469d9ff700 1 Processor -- start 2023-11-28T12:09:22.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:22.130+0000 7f469d9ff700 1 -- start start 2023-11-28T12:09:22.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:22.131+0000 7f469d9ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4698161340 0x7f46980d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:22.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:22.131+0000 7f469d9ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f46980d2320 0x7f46980cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:22.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:22.131+0000 7f469d9ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46980d1950 con 0x7f469815c9b0 2023-11-28T12:09:22.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:22.131+0000 7f469d9ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46980b5800 con 0x7f46980d2320 2023-11-28T12:09:22.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:22.131+0000 7f469d9ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46980b5300 con 0x7f4698161340 2023-11-28T12:09:22.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:22.131+0000 7f4696ffd700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f469815c9b0 0x7f46980b4bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:43550/0 (socket says 172.21.15.45:43550) 2023-11-28T12:09:22.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:22.131+0000 7f4696ffd700 1 -- 172.21.15.45:0/1435675002 learned_addr learned my addr 172.21.15.45:0/1435675002 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:09:22.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:22.131+0000 7f468ffff700 1 --2- 172.21.15.45:0/1435675002 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4698161340 0x7f46980d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:22.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:22.131+0000 7f46977fe700 1 --2- 172.21.15.45:0/1435675002 >> v2:172.21.15.152:3300/0 conn(0x7f46980d2320 0x7f46980cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:22.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:22.132+0000 7f46967fc700 1 -- 172.21.15.45:0/1435675002 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3545240369 0 0) 0x7f46980d1950 con 0x7f469815c9b0 2023-11-28T12:09:22.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:22.132+0000 7f46967fc700 1 -- 172.21.15.45:0/1435675002 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46840035b0 con 0x7f469815c9b0 2023-11-28T12:09:22.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:22.132+0000 7f46977fe700 1 -- 172.21.15.45:0/1435675002 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4698161340 msgr2=0x7f46980d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:22.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:22.132+0000 7f46977fe700 1 --2- 172.21.15.45:0/1435675002 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4698161340 0x7f46980d1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:22.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:22.132+0000 7f46977fe700 1 -- 172.21.15.45:0/1435675002 >> v1:172.21.15.45:6789/0 conn(0x7f469815c9b0 legacy=0x7f46980b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:22.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:22.132+0000 7f46977fe700 1 -- 172.21.15.45:0/1435675002 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46980b5520 con 0x7f46980d2320 2023-11-28T12:09:22.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:22.132+0000 7f468ffff700 1 --2- 172.21.15.45:0/1435675002 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4698161340 0x7f46980d1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:09:22.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:22.132+0000 7f46977fe700 1 --2- 172.21.15.45:0/1435675002 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f46980d2320 0x7f46980cd7c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4690009dc0 tx=0x7f469000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f583141b0b46b7a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:22.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:22.133+0000 7f46967fc700 1 -- 172.21.15.45:0/1435675002 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469000e070 con 0x7f46980d2320 2023-11-28T12:09:22.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:22.133+0000 7f46967fc700 1 -- 172.21.15.45:0/1435675002 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f469000bae0 con 0x7f46980d2320 2023-11-28T12:09:22.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:22.133+0000 7f46967fc700 1 -- 172.21.15.45:0/1435675002 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469000be90 con 0x7f46980d2320 2023-11-28T12:09:22.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:22.133+0000 7f469d9ff700 1 -- 172.21.15.45:0/1435675002 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f46980d2320 msgr2=0x7f46980cd7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:22.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:22.133+0000 7f469d9ff700 1 --2- 172.21.15.45:0/1435675002 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f46980d2320 0x7f46980cd7c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4690009dc0 tx=0x7f469000b330 comp rx=0 tx=0).stop 2023-11-28T12:09:22.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:22.133+0000 7f469d9ff700 1 -- 172.21.15.45:0/1435675002 shutdown_connections 2023-11-28T12:09:22.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:22.133+0000 7f469d9ff700 1 --2- 172.21.15.45:0/1435675002 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f46980d2320 0x7f46980cd7c0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:22.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:22.133+0000 7f469d9ff700 1 --2- 172.21.15.45:0/1435675002 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4698161340 0x7f46980d1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:22.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:22.133+0000 7f469d9ff700 1 -- 172.21.15.45:0/1435675002 >> 172.21.15.45:0/1435675002 conn(0x7f4698072600 msgr2=0x7f46980cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:22.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:22.133+0000 7f469d9ff700 1 -- 172.21.15.45:0/1435675002 shutdown_connections 2023-11-28T12:09:22.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:22.133+0000 7f469d9ff700 1 -- 172.21.15.45:0/1435675002 wait complete. 2023-11-28T12:09:22.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:22.135+0000 7f469d9ff700 1 Processor -- start 2023-11-28T12:09:22.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:22.135+0000 7f469d9ff700 1 -- start start 2023-11-28T12:09:22.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:22.136+0000 7f469d9ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46980d2320 0x7f4698152e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:22.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:22.136+0000 7f469d9ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f469815c9b0 0x7f4698143480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:22.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:22.136+0000 7f469d9ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4698161340 0x7f46981514e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:22.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:22.136+0000 7f469d9ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46981439c0 con 0x7f46980d2320 2023-11-28T12:09:22.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:22.136+0000 7f469d9ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46981529d0 con 0x7f469815c9b0 2023-11-28T12:09:22.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:22.136+0000 7f469d9ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4698151dc0 con 0x7f4698161340 2023-11-28T12:09:22.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:22.136+0000 7f4696ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46980d2320 0x7f4698152e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:22.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:22.136+0000 7f4696ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46980d2320 0x7f4698152e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56854/0 (socket says 172.21.15.45:56854) 2023-11-28T12:09:22.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:22.136+0000 7f4696ffd700 1 -- 172.21.15.45:0/1927391819 learned_addr learned my addr 172.21.15.45:0/1927391819 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:09:22.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:22.137+0000 7f468ffff700 1 --2- 172.21.15.45:0/1927391819 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f469815c9b0 0x7f4698143480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:22.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:22.137+0000 7f46977fe700 1 --2- 172.21.15.45:0/1927391819 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4698161340 0x7f46981514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:22.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:22.137+0000 7f4696ffd700 1 -- 172.21.15.45:0/1927391819 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4698161340 msgr2=0x7f46981514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:22.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:22.137+0000 7f4696ffd700 1 --2- 172.21.15.45:0/1927391819 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4698161340 0x7f46981514e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:22.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:22.137+0000 7f4696ffd700 1 -- 172.21.15.45:0/1927391819 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f469815c9b0 msgr2=0x7f4698143480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:22.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:22.137+0000 7f4696ffd700 1 --2- 172.21.15.45:0/1927391819 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f469815c9b0 0x7f4698143480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:22.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:22.137+0000 7f4696ffd700 1 -- 172.21.15.45:0/1927391819 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46800094a0 con 0x7f46980d2320 2023-11-28T12:09:22.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:22.137+0000 7f468ffff700 1 --2- 172.21.15.45:0/1927391819 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f469815c9b0 0x7f4698143480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:09:22.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:22.137+0000 7f4696ffd700 1 --2- 172.21.15.45:0/1927391819 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46980d2320 0x7f4698152e60 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f4688001eb0 tx=0x7f468800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:22.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:22.137+0000 7f4694ff9700 1 -- 172.21.15.45:0/1927391819 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4688005d70 con 0x7f46980d2320 2023-11-28T12:09:22.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:22.137+0000 7f4694ff9700 1 -- 172.21.15.45:0/1927391819 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46880070d0 con 0x7f46980d2320 2023-11-28T12:09:22.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:22.137+0000 7f4694ff9700 1 -- 172.21.15.45:0/1927391819 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4688007460 con 0x7f46980d2320 2023-11-28T12:09:22.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:22.137+0000 7f469d9ff700 1 -- 172.21.15.45:0/1927391819 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4690009a70 con 0x7f46980d2320 2023-11-28T12:09:22.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:22.138+0000 7f469d9ff700 1 -- 172.21.15.45:0/1927391819 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46980d15e0 con 0x7f46980d2320 2023-11-28T12:09:22.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:22.138+0000 7f469d9ff700 1 -- 172.21.15.45:0/1927391819 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46980d1300 con 0x7f46980d2320 2023-11-28T12:09:22.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:22.139+0000 7f4694ff9700 1 -- 172.21.15.45:0/1927391819 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f4688019030 con 0x7f46980d2320 2023-11-28T12:09:22.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:22.140+0000 7f4694ff9700 1 --2- 172.21.15.45:0/1927391819 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f46780682f0 0x7f467806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:22.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:22.140+0000 7f4694ff9700 1 -- 172.21.15.45:0/1927391819 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f4688085100 con 0x7f46980d2320 2023-11-28T12:09:22.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:22.141+0000 7f468ffff700 1 --2- 172.21.15.45:0/1927391819 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f46780682f0 0x7f467806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:22.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:22.141+0000 7f468ffff700 1 --2- 172.21.15.45:0/1927391819 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f46780682f0 0x7f467806a7a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f4698154a10 tx=0x7f4680008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:22.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:22.144+0000 7f4694ff9700 1 -- 172.21.15.45:0/1927391819 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f4688051890 con 0x7f46980d2320 2023-11-28T12:09:22.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:22.392+0000 7f469d9ff700 1 -- 172.21.15.45:0/1927391819 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f469815cd80 con 0x7f46980d2320 2023-11-28T12:09:22.991 INFO:tasks.ceph.mon.a.smithi045.stderr:2023-11-28T12:09:22.991+0000 7fe5533f9700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-28T12:09:22.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:22.999+0000 7f4694ff9700 1 -- 172.21.15.45:0/1927391819 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v25) v1 ==== 161+0+0 (secure 0 0 0) 0x7f4688017090 con 0x7f46980d2320 2023-11-28T12:09:23.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.001+0000 7f469d9ff700 1 -- 172.21.15.45:0/1927391819 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f46780682f0 msgr2=0x7f467806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:23.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.001+0000 7f469d9ff700 1 --2- 172.21.15.45:0/1927391819 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f46780682f0 0x7f467806a7a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f4698154a10 tx=0x7f4680008040 comp rx=0 tx=0).stop 2023-11-28T12:09:23.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.001+0000 7f469d9ff700 1 -- 172.21.15.45:0/1927391819 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46980d2320 msgr2=0x7f4698152e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:23.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.001+0000 7f469d9ff700 1 --2- 172.21.15.45:0/1927391819 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46980d2320 0x7f4698152e60 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f4688001eb0 tx=0x7f468800c860 comp rx=0 tx=0).stop 2023-11-28T12:09:23.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.002+0000 7f469d9ff700 1 -- 172.21.15.45:0/1927391819 shutdown_connections 2023-11-28T12:09:23.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.002+0000 7f469d9ff700 1 --2- 172.21.15.45:0/1927391819 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f46780682f0 0x7f467806a7a0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:23.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.002+0000 7f469d9ff700 1 --2- 172.21.15.45:0/1927391819 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4698161340 0x7f46981514e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:23.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.002+0000 7f469d9ff700 1 --2- 172.21.15.45:0/1927391819 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46980d2320 0x7f4698152e60 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:23.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.002+0000 7f469d9ff700 1 --2- 172.21.15.45:0/1927391819 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f469815c9b0 0x7f4698143480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:23.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.002+0000 7f469d9ff700 1 -- 172.21.15.45:0/1927391819 >> 172.21.15.45:0/1927391819 conn(0x7f4698072600 msgr2=0x7f4698160610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:23.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.002+0000 7f469d9ff700 1 -- 172.21.15.45:0/1927391819 shutdown_connections 2023-11-28T12:09:23.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.002+0000 7f469d9ff700 1 -- 172.21.15.45:0/1927391819 wait complete. 2023-11-28T12:09:23.004 INFO:teuthology.orchestra.run.smithi045.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-28T12:09:23.012 INFO:tasks.ceph.mds.c.smithi045.stderr: -6631> 2023-11-28T12:08:36.429+0000 7f9ea4ff1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-28T12:09:23.018 INFO:tasks.ceph.mds.c.smithi045.stderr: -3103> 2023-11-28T12:08:41.877+0000 7f9ea17ea700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /parent_a/alpha auth v2 ap=1 DIRTYPARENT s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={5700=0-4194304@1} caps={5700=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=5700 | request=0 caps=1 dirtyparent=1 dirty=0 authpin=1 scrubqueue=0 0x562c90ba6100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(8)0x10000000001:[<0x10000000000/alpha v2>,<0x1/parent_a v4>]//[]","error_str":"failed to decode on-disk backtrace (40 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-11-28T12:09:23.025 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-28T12:09:23.068 INFO:tasks.ceph.mds.c.smithi045.stdout:starting mds.c at 2023-11-28T12:09:23.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.238+0000 7f335a5ff700 1 Processor -- start 2023-11-28T12:09:23.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.238+0000 7f335a5ff700 1 -- start start 2023-11-28T12:09:23.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.239+0000 7f335a5ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f335415c9b0 0x7f33540b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:23.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.240+0000 7f335a5ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33540d1950 con 0x7f33540cd7c0 2023-11-28T12:09:23.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.240+0000 7f335a5ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33540d24f0 con 0x7f3354161340 2023-11-28T12:09:23.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.240+0000 7f335a5ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33540b5800 con 0x7f335415c9b0 2023-11-28T12:09:23.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.240+0000 7f3358b9c700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f33540cd7c0 0x7f33540b5fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:43570/0 (socket says 172.21.15.45:43570) 2023-11-28T12:09:23.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.240+0000 7f3358b9c700 1 -- 172.21.15.45:0/3132992116 learned_addr learned my addr 172.21.15.45:0/3132992116 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:09:23.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.240+0000 7f3353fff700 1 --2- 172.21.15.45:0/3132992116 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f335415c9b0 0x7f33540b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:23.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.240+0000 7f3352ffd700 1 -- 172.21.15.45:0/3132992116 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1339310226 0 0) 0x7f33540d1950 con 0x7f33540cd7c0 2023-11-28T12:09:23.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.240+0000 7f3352ffd700 1 -- 172.21.15.45:0/3132992116 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f333c0035b0 con 0x7f33540cd7c0 2023-11-28T12:09:23.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.240+0000 7f3352ffd700 1 -- 172.21.15.45:0/3132992116 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1238466931 0 0) 0x7f33540d24f0 con 0x7f3354161340 2023-11-28T12:09:23.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.241+0000 7f3352ffd700 1 -- 172.21.15.45:0/3132992116 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33540d1950 con 0x7f3354161340 2023-11-28T12:09:23.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.241+0000 7f3352ffd700 1 -- 172.21.15.45:0/3132992116 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 281502286 0 0) 0x7f333c0035b0 con 0x7f33540cd7c0 2023-11-28T12:09:23.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.241+0000 7f3352ffd700 1 -- 172.21.15.45:0/3132992116 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f335415c9b0 msgr2=0x7f33540b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:23.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.241+0000 7f3352ffd700 1 --2- 172.21.15.45:0/3132992116 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f335415c9b0 0x7f33540b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:23.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.241+0000 7f3352ffd700 1 -- 172.21.15.45:0/3132992116 >> v1:172.21.15.152:6789/0 conn(0x7f3354161340 legacy=0x7f33540d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:23.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.241+0000 7f3352ffd700 1 -- 172.21.15.45:0/3132992116 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33540b5520 con 0x7f33540cd7c0 2023-11-28T12:09:23.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.241+0000 7f3352ffd700 1 -- 172.21.15.45:0/3132992116 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3460218165 0 0) 0x7f334c001970 con 0x7f33540cd7c0 2023-11-28T12:09:23.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.241+0000 7f3352ffd700 1 -- 172.21.15.45:0/3132992116 >> v1:172.21.15.45:6789/0 conn(0x7f33540cd7c0 legacy=0x7f33540b5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:23.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.241+0000 7f3352ffd700 1 --2- 172.21.15.45:0/3132992116 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f333c003bc0 0x7f333c003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:23.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.241+0000 7f3352ffd700 1 --2- 172.21.15.45:0/3132992116 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f333c004850 0x7f333c004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:23.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.241+0000 7f3352ffd700 1 --2- 172.21.15.45:0/3132992116 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f333c005200 0x7f333c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:23.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.241+0000 7f3352ffd700 1 -- 172.21.15.45:0/3132992116 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33540b5800 con 0x7f333c003bc0 2023-11-28T12:09:23.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.241+0000 7f3352ffd700 1 -- 172.21.15.45:0/3132992116 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f333c00c100 con 0x7f333c004850 2023-11-28T12:09:23.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.241+0000 7f3352ffd700 1 -- 172.21.15.45:0/3132992116 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f333c00c2c0 con 0x7f333c005200 2023-11-28T12:09:23.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.241+0000 7f3353fff700 1 --2- 172.21.15.45:0/3132992116 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f335415c9b0 0x7f33540b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:09:23.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.241+0000 7f3358b9c700 1 --2- 172.21.15.45:0/3132992116 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f333c005200 0x7f333c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:23.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.241+0000 7f3353fff700 1 --2- 172.21.15.45:0/3132992116 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f333c003bc0 0x7f333c003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:23.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.241+0000 7f33537fe700 1 --2- 172.21.15.45:0/3132992116 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f333c004850 0x7f333c004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:23.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.242+0000 7f3353fff700 1 -- 172.21.15.45:0/3132992116 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f333c005200 msgr2=0x7f333c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:23.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.242+0000 7f3353fff700 1 --2- 172.21.15.45:0/3132992116 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f333c005200 0x7f333c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:23.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.242+0000 7f3353fff700 1 -- 172.21.15.45:0/3132992116 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f333c004850 msgr2=0x7f333c004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:23.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.242+0000 7f3353fff700 1 --2- 172.21.15.45:0/3132992116 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f333c004850 0x7f333c004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:23.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.242+0000 7f3353fff700 1 -- 172.21.15.45:0/3132992116 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f333c0035b0 con 0x7f333c003bc0 2023-11-28T12:09:23.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.242+0000 7f3358b9c700 1 --2- 172.21.15.45:0/3132992116 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f333c005200 0x7f333c00ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:09:23.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.242+0000 7f3353fff700 1 --2- 172.21.15.45:0/3132992116 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f333c003bc0 0x7f333c003fb0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f33540d4270 tx=0x7f333c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c99006f2f739e3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:23.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.242+0000 7f3352ffd700 1 -- 172.21.15.45:0/3132992116 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3344004030 con 0x7f333c003bc0 2023-11-28T12:09:23.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.242+0000 7f3352ffd700 1 -- 172.21.15.45:0/3132992116 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3344004190 con 0x7f333c003bc0 2023-11-28T12:09:23.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.242+0000 7f3352ffd700 1 -- 172.21.15.45:0/3132992116 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3344004540 con 0x7f333c003bc0 2023-11-28T12:09:23.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.243+0000 7f335a5ff700 1 -- 172.21.15.45:0/3132992116 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f333c003bc0 msgr2=0x7f333c003fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:23.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.243+0000 7f335a5ff700 1 --2- 172.21.15.45:0/3132992116 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f333c003bc0 0x7f333c003fb0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f33540d4270 tx=0x7f333c005880 comp rx=0 tx=0).stop 2023-11-28T12:09:23.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.243+0000 7f3358b9c700 1 -- 172.21.15.45:0/3132992116 reap_dead start 2023-11-28T12:09:23.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.243+0000 7f335a5ff700 1 -- 172.21.15.45:0/3132992116 shutdown_connections 2023-11-28T12:09:23.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.243+0000 7f335a5ff700 1 -- 172.21.15.45:0/3132992116 >> 172.21.15.45:0/3132992116 conn(0x7f3354072600 msgr2=0x7f33540cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:23.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.243+0000 7f335a5ff700 1 -- 172.21.15.45:0/3132992116 shutdown_connections 2023-11-28T12:09:23.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.243+0000 7f335a5ff700 1 -- 172.21.15.45:0/3132992116 wait complete. 2023-11-28T12:09:23.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.245+0000 7f335a5ff700 1 Processor -- start 2023-11-28T12:09:23.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.245+0000 7f335a5ff700 1 -- start start 2023-11-28T12:09:23.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.246+0000 7f335a5ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f333c003bc0 0x7f33540b41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:23.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.246+0000 7f335a5ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33541f2ea0 0x7f33540ca240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:23.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.246+0000 7f335a5ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f33541f3310 0x7f33540ca780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:23.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.246+0000 7f335a5ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33540cc3b0 con 0x7f33541f2ea0 2023-11-28T12:09:23.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.246+0000 7f335a5ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33540cc690 con 0x7f33541f3310 2023-11-28T12:09:23.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.246+0000 7f335a5ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33540cc970 con 0x7f333c003bc0 2023-11-28T12:09:23.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.246+0000 7f33537fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33541f2ea0 0x7f33540ca240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:23.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.246+0000 7f33537fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33541f2ea0 0x7f33540ca240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56868/0 (socket says 172.21.15.45:56868) 2023-11-28T12:09:23.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.246+0000 7f33537fe700 1 -- 172.21.15.45:0/380995926 learned_addr learned my addr 172.21.15.45:0/380995926 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:09:23.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.246+0000 7f3353fff700 1 --2- 172.21.15.45:0/380995926 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f333c003bc0 0x7f33540b41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:23.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.246+0000 7f3358b9c700 1 --2- 172.21.15.45:0/380995926 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f33541f3310 0x7f33540ca780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:23.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.246+0000 7f33537fe700 1 -- 172.21.15.45:0/380995926 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f333c003bc0 msgr2=0x7f33540b41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:23.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.246+0000 7f33537fe700 1 --2- 172.21.15.45:0/380995926 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f333c003bc0 0x7f33540b41f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:23.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.246+0000 7f33537fe700 1 -- 172.21.15.45:0/380995926 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f33541f3310 msgr2=0x7f33540ca780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:23.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.246+0000 7f33537fe700 1 --2- 172.21.15.45:0/380995926 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f33541f3310 0x7f33540ca780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:23.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.246+0000 7f33537fe700 1 -- 172.21.15.45:0/380995926 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33540d15e0 con 0x7f33541f2ea0 2023-11-28T12:09:23.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.246+0000 7f3358b9c700 1 --2- 172.21.15.45:0/380995926 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f33541f3310 0x7f33540ca780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:09:23.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.247+0000 7f33537fe700 1 --2- 172.21.15.45:0/380995926 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33541f2ea0 0x7f33540ca240 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f334800f770 tx=0x7f334800fb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:23.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.247+0000 7f3350ff9700 1 -- 172.21.15.45:0/380995926 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3348005320 con 0x7f33541f2ea0 2023-11-28T12:09:23.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.247+0000 7f3350ff9700 1 -- 172.21.15.45:0/380995926 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33480054a0 con 0x7f33541f2ea0 2023-11-28T12:09:23.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.247+0000 7f335a5ff700 1 -- 172.21.15.45:0/380995926 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33540d1300 con 0x7f33541f2ea0 2023-11-28T12:09:23.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.247+0000 7f3350ff9700 1 -- 172.21.15.45:0/380995926 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3348006aa0 con 0x7f33541f2ea0 2023-11-28T12:09:23.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.247+0000 7f335a5ff700 1 -- 172.21.15.45:0/380995926 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f335415cd80 con 0x7f33541f2ea0 2023-11-28T12:09:23.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.248+0000 7f335a5ff700 1 -- 172.21.15.45:0/380995926 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33540745c0 con 0x7f33541f2ea0 2023-11-28T12:09:23.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.249+0000 7f3350ff9700 1 -- 172.21.15.45:0/380995926 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f3348006c00 con 0x7f33541f2ea0 2023-11-28T12:09:23.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.250+0000 7f3350ff9700 1 --2- 172.21.15.45:0/380995926 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f33400682f0 0x7f334006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:23.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.250+0000 7f3350ff9700 1 -- 172.21.15.45:0/380995926 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6206+0+0 (secure 0 0 0) 0x7f33480854d0 con 0x7f33541f2ea0 2023-11-28T12:09:23.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.251+0000 7f3353fff700 1 --2- 172.21.15.45:0/380995926 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f33400682f0 0x7f334006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:23.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.252+0000 7f3353fff700 1 --2- 172.21.15.45:0/380995926 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f33400682f0 0x7f334006a7a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f3344016040 tx=0x7f3344008070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:23.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.254+0000 7f3350ff9700 1 -- 172.21.15.45:0/380995926 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f3348051bb0 con 0x7f33541f2ea0 2023-11-28T12:09:23.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.502+0000 7f335a5ff700 1 -- 172.21.15.45:0/380995926 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f33540d08a0 con 0x7f33541f2ea0 2023-11-28T12:09:24.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:23.999+0000 7f3350ff9700 1 -- 172.21.15.45:0/380995926 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v26) v1 ==== 104+0+0 (secure 0 0 0) 0x7f33480551d0 con 0x7f33541f2ea0 2023-11-28T12:09:24.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:24.002+0000 7f335a5ff700 1 -- 172.21.15.45:0/380995926 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f33400682f0 msgr2=0x7f334006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:24.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:24.002+0000 7f335a5ff700 1 --2- 172.21.15.45:0/380995926 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f33400682f0 0x7f334006a7a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f3344016040 tx=0x7f3344008070 comp rx=0 tx=0).stop 2023-11-28T12:09:24.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:24.002+0000 7f335a5ff700 1 -- 172.21.15.45:0/380995926 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33541f2ea0 msgr2=0x7f33540ca240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:24.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:24.002+0000 7f335a5ff700 1 --2- 172.21.15.45:0/380995926 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33541f2ea0 0x7f33540ca240 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f334800f770 tx=0x7f334800fb30 comp rx=0 tx=0).stop 2023-11-28T12:09:24.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:24.002+0000 7f335a5ff700 1 -- 172.21.15.45:0/380995926 shutdown_connections 2023-11-28T12:09:24.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:24.002+0000 7f335a5ff700 1 --2- 172.21.15.45:0/380995926 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f33400682f0 0x7f334006a7a0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:24.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:24.002+0000 7f335a5ff700 1 --2- 172.21.15.45:0/380995926 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f33541f3310 0x7f33540ca780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:24.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:24.002+0000 7f335a5ff700 1 --2- 172.21.15.45:0/380995926 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f333c003bc0 0x7f33540b41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:24.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:24.002+0000 7f335a5ff700 1 --2- 172.21.15.45:0/380995926 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33541f2ea0 0x7f33540ca240 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:24.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:24.002+0000 7f335a5ff700 1 -- 172.21.15.45:0/380995926 >> 172.21.15.45:0/380995926 conn(0x7f3354072600 msgr2=0x7f33540ce080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:24.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:24.002+0000 7f335a5ff700 1 -- 172.21.15.45:0/380995926 shutdown_connections 2023-11-28T12:09:24.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:24.002+0000 7f335a5ff700 1 -- 172.21.15.45:0/380995926 wait complete. 2023-11-28T12:09:24.023 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-28T12:09:24.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:24.274+0000 7f047a5ff700 1 Processor -- start 2023-11-28T12:09:24.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:24.275+0000 7f047a5ff700 1 -- start start 2023-11-28T12:09:24.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:24.276+0000 7f047a5ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0474161200 0x7f047415dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:24.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:24.276+0000 7f047a5ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0474160d70 con 0x7f04740cded0 2023-11-28T12:09:24.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:24.276+0000 7f047a5ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04740b5390 con 0x7f047415a760 2023-11-28T12:09:24.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:24.276+0000 7f047a5ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f047415ab30 con 0x7f0474161200 2023-11-28T12:09:24.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:24.276+0000 7f04737fe700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f04740cded0 0x7f04740d0d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:43586/0 (socket says 172.21.15.45:43586) 2023-11-28T12:09:24.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:24.276+0000 7f04737fe700 1 -- 172.21.15.45:0/189482462 learned_addr learned my addr 172.21.15.45:0/189482462 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:09:24.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:24.276+0000 7f0478b9c700 1 --2- 172.21.15.45:0/189482462 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0474161200 0x7f047415dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:24.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:24.276+0000 7f0472ffd700 1 -- 172.21.15.45:0/189482462 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1080147231 0 0) 0x7f0474160d70 con 0x7f04740cded0 2023-11-28T12:09:24.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:24.276+0000 7f0472ffd700 1 -- 172.21.15.45:0/189482462 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f045c0035b0 con 0x7f04740cded0 2023-11-28T12:09:24.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:24.277+0000 7f0472ffd700 1 -- 172.21.15.45:0/189482462 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3672094275 0 0) 0x7f04740b5390 con 0x7f047415a760 2023-11-28T12:09:24.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:24.277+0000 7f0472ffd700 1 -- 172.21.15.45:0/189482462 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0474160d70 con 0x7f047415a760 2023-11-28T12:09:24.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:24.277+0000 7f0478b9c700 1 -- 172.21.15.45:0/189482462 >> v1:172.21.15.152:6789/0 conn(0x7f047415a760 legacy=0x7f04740cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:24.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:24.277+0000 7f0478b9c700 1 -- 172.21.15.45:0/189482462 >> v1:172.21.15.45:6789/0 conn(0x7f04740cded0 legacy=0x7f04740d0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:24.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:24.277+0000 7f0478b9c700 1 -- 172.21.15.45:0/189482462 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04740b5670 con 0x7f0474161200 2023-11-28T12:09:24.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:24.277+0000 7f0478b9c700 1 --2- 172.21.15.45:0/189482462 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0474161200 0x7f047415dc30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f046c009dc0 tx=0x7f046c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ebe9cd055582d837 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:24.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:24.277+0000 7f0472ffd700 1 -- 172.21.15.45:0/189482462 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f046c00e070 con 0x7f0474161200 2023-11-28T12:09:24.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:24.277+0000 7f0472ffd700 1 -- 172.21.15.45:0/189482462 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f046c00bb20 con 0x7f0474161200 2023-11-28T12:09:24.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:24.277+0000 7f0472ffd700 1 -- 172.21.15.45:0/189482462 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f046c012430 con 0x7f0474161200 2023-11-28T12:09:24.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:24.278+0000 7f047a5ff700 1 -- 172.21.15.45:0/189482462 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0474161200 msgr2=0x7f047415dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:24.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:24.278+0000 7f047a5ff700 1 --2- 172.21.15.45:0/189482462 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0474161200 0x7f047415dc30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f046c009dc0 tx=0x7f046c00b330 comp rx=0 tx=0).stop 2023-11-28T12:09:24.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:24.278+0000 7f047a5ff700 1 -- 172.21.15.45:0/189482462 shutdown_connections 2023-11-28T12:09:24.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:24.278+0000 7f047a5ff700 1 --2- 172.21.15.45:0/189482462 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0474161200 0x7f047415dc30 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:24.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:24.278+0000 7f047a5ff700 1 -- 172.21.15.45:0/189482462 >> 172.21.15.45:0/189482462 conn(0x7f0474072620 msgr2=0x7f04740cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:24.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:24.278+0000 7f047a5ff700 1 -- 172.21.15.45:0/189482462 shutdown_connections 2023-11-28T12:09:24.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:24.278+0000 7f047a5ff700 1 -- 172.21.15.45:0/189482462 wait complete. 2023-11-28T12:09:24.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:24.280+0000 7f047a5ff700 1 Processor -- start 2023-11-28T12:09:24.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:24.280+0000 7f047a5ff700 1 -- start start 2023-11-28T12:09:24.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:24.281+0000 7f047a5ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04740cded0 0x7f04740c9640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:24.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:24.281+0000 7f047a5ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f047415a760 0x7f0474147fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:24.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:24.281+0000 7f047a5ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0474161200 0x7f047415e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:24.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:24.281+0000 7f047a5ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04741f6ff0 con 0x7f04740cded0 2023-11-28T12:09:24.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:24.281+0000 7f047a5ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04740c9b80 con 0x7f0474161200 2023-11-28T12:09:24.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:24.281+0000 7f047a5ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04740cbbf0 con 0x7f047415a760 2023-11-28T12:09:24.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:24.281+0000 7f0473fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04740cded0 0x7f04740c9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:24.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:24.281+0000 7f0473fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04740cded0 0x7f04740c9640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56878/0 (socket says 172.21.15.45:56878) 2023-11-28T12:09:24.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:24.281+0000 7f0473fff700 1 -- 172.21.15.45:0/4282539422 learned_addr learned my addr 172.21.15.45:0/4282539422 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:09:24.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:24.281+0000 7f04737fe700 1 --2- 172.21.15.45:0/4282539422 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f047415a760 0x7f0474147fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:24.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:24.281+0000 7f0478b9c700 1 --2- 172.21.15.45:0/4282539422 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0474161200 0x7f047415e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:24.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:24.282+0000 7f0473fff700 1 -- 172.21.15.45:0/4282539422 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f047415a760 msgr2=0x7f0474147fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:24.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:24.282+0000 7f0473fff700 1 --2- 172.21.15.45:0/4282539422 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f047415a760 0x7f0474147fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:24.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:24.282+0000 7f0473fff700 1 -- 172.21.15.45:0/4282539422 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0474161200 msgr2=0x7f047415e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:24.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:24.282+0000 7f0473fff700 1 --2- 172.21.15.45:0/4282539422 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0474161200 0x7f047415e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:24.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:24.282+0000 7f0473fff700 1 -- 172.21.15.45:0/4282539422 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f046c009a70 con 0x7f04740cded0 2023-11-28T12:09:24.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:24.282+0000 7f0473fff700 1 --2- 172.21.15.45:0/4282539422 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04740cded0 0x7f04740c9640 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f046400c520 tx=0x7f046400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:24.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:24.282+0000 7f0470ff9700 1 -- 172.21.15.45:0/4282539422 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04640052d0 con 0x7f04740cded0 2023-11-28T12:09:24.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:24.282+0000 7f0470ff9700 1 -- 172.21.15.45:0/4282539422 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0464005430 con 0x7f04740cded0 2023-11-28T12:09:24.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:24.282+0000 7f047a5ff700 1 -- 172.21.15.45:0/4282539422 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0474160a00 con 0x7f04740cded0 2023-11-28T12:09:24.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:24.282+0000 7f0470ff9700 1 -- 172.21.15.45:0/4282539422 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04640038c0 con 0x7f04740cded0 2023-11-28T12:09:24.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:24.283+0000 7f047a5ff700 1 -- 172.21.15.45:0/4282539422 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0474160720 con 0x7f04740cded0 2023-11-28T12:09:24.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:24.284+0000 7f047a5ff700 1 -- 172.21.15.45:0/4282539422 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04740b4bf0 con 0x7f04740cded0 2023-11-28T12:09:24.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:24.285+0000 7f0470ff9700 1 -- 172.21.15.45:0/4282539422 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f0464019030 con 0x7f04740cded0 2023-11-28T12:09:24.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:24.285+0000 7f0470ff9700 1 --2- 172.21.15.45:0/4282539422 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f04600682f0 0x7f046006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:24.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:24.286+0000 7f0470ff9700 1 -- 172.21.15.45:0/4282539422 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6206+0+0 (secure 0 0 0) 0x7f0464084f90 con 0x7f04740cded0 2023-11-28T12:09:24.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:24.286+0000 7f04737fe700 1 --2- 172.21.15.45:0/4282539422 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f04600682f0 0x7f046006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:24.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:24.286+0000 7f04737fe700 1 --2- 172.21.15.45:0/4282539422 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f04600682f0 0x7f046006a7a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f0474157f80 tx=0x7f0468007dc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:24.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:24.290+0000 7f0470ff9700 1 -- 172.21.15.45:0/4282539422 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f0464051760 con 0x7f04740cded0 2023-11-28T12:09:24.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:24.491+0000 7f047a5ff700 1 -- 172.21.15.45:0/4282539422 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f047415dd30 con 0x7f04740cded0 2023-11-28T12:09:25.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:25.008+0000 7f0470ff9700 1 -- 172.21.15.45:0/4282539422 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v51) v1 ==== 181+0+0 (secure 0 0 0) 0x7f04640170d0 con 0x7f04740cded0 2023-11-28T12:09:25.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:25.011+0000 7f047a5ff700 1 -- 172.21.15.45:0/4282539422 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f04600682f0 msgr2=0x7f046006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:25.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:25.011+0000 7f047a5ff700 1 --2- 172.21.15.45:0/4282539422 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f04600682f0 0x7f046006a7a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f0474157f80 tx=0x7f0468007dc0 comp rx=0 tx=0).stop 2023-11-28T12:09:25.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:25.011+0000 7f047a5ff700 1 -- 172.21.15.45:0/4282539422 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04740cded0 msgr2=0x7f04740c9640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:25.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:25.011+0000 7f047a5ff700 1 --2- 172.21.15.45:0/4282539422 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04740cded0 0x7f04740c9640 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f046400c520 tx=0x7f046400c830 comp rx=0 tx=0).stop 2023-11-28T12:09:25.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:25.012+0000 7f047a5ff700 1 -- 172.21.15.45:0/4282539422 shutdown_connections 2023-11-28T12:09:25.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:25.012+0000 7f047a5ff700 1 --2- 172.21.15.45:0/4282539422 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f04600682f0 0x7f046006a7a0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:25.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:25.012+0000 7f047a5ff700 1 --2- 172.21.15.45:0/4282539422 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0474161200 0x7f047415e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:25.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:25.012+0000 7f047a5ff700 1 --2- 172.21.15.45:0/4282539422 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04740cded0 0x7f04740c9640 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:25.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:25.012+0000 7f047a5ff700 1 --2- 172.21.15.45:0/4282539422 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f047415a760 0x7f0474147fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:25.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:25.012+0000 7f047a5ff700 1 -- 172.21.15.45:0/4282539422 >> 172.21.15.45:0/4282539422 conn(0x7f0474072620 msgr2=0x7f0474158a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:25.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:25.012+0000 7f047a5ff700 1 -- 172.21.15.45:0/4282539422 shutdown_connections 2023-11-28T12:09:25.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:25.012+0000 7f047a5ff700 1 -- 172.21.15.45:0/4282539422 wait complete. 2023-11-28T12:09:25.014 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' removed 2023-11-28T12:09:25.034 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-28T12:09:25.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:25.244+0000 7f8f8f9ff700 1 Processor -- start 2023-11-28T12:09:25.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:25.244+0000 7f8f8f9ff700 1 -- start start 2023-11-28T12:09:25.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:25.245+0000 7f8f8f9ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8f8815a760 0x7f8f88161200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:25.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:25.245+0000 7f8f8f9ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8f8815dc30 0x7f8f880b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:25.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:25.245+0000 7f8f8f9ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f8f880cd7c0 0x7f8f880cdc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:25.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:25.245+0000 7f8f8f9ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f8815ab30 con 0x7f8f8815dc30 2023-11-28T12:09:25.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:25.245+0000 7f8f8f9ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f8815e0a0 con 0x7f8f880cd7c0 2023-11-28T12:09:25.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:25.245+0000 7f8f8f9ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f880ce150 con 0x7f8f8815a760 2023-11-28T12:09:25.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:25.245+0000 7f8f8cf9a700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8f8815dc30 0x7f8f880b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:25.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:25.245+0000 7f8f8cf9a700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8f8815dc30 0x7f8f880b4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56888/0 (socket says 172.21.15.45:56888) 2023-11-28T12:09:25.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:25.245+0000 7f8f8cf9a700 1 -- 172.21.15.45:0/2107101587 learned_addr learned my addr 172.21.15.45:0/2107101587 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:09:25.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:25.245+0000 7f8f8d79b700 1 --2- 172.21.15.45:0/2107101587 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8f8815a760 0x7f8f88161200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:25.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:25.245+0000 7f8f8df9c700 1 --2- 172.21.15.45:0/2107101587 >> v2:172.21.15.152:3300/0 conn(0x7f8f880cd7c0 0x7f8f880cdc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:25.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:25.246+0000 7f8f8cf9a700 1 -- 172.21.15.45:0/2107101587 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8f8815a760 msgr2=0x7f8f88161200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:25.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:25.246+0000 7f8f8cf9a700 1 --2- 172.21.15.45:0/2107101587 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8f8815a760 0x7f8f88161200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:25.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:25.246+0000 7f8f8cf9a700 1 -- 172.21.15.45:0/2107101587 >> v2:172.21.15.152:3300/0 conn(0x7f8f880cd7c0 msgr2=0x7f8f880cdc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:25.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:25.246+0000 7f8f8cf9a700 1 --2- 172.21.15.45:0/2107101587 >> v2:172.21.15.152:3300/0 conn(0x7f8f880cd7c0 0x7f8f880cdc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:25.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:25.246+0000 7f8f8cf9a700 1 -- 172.21.15.45:0/2107101587 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f88160d70 con 0x7f8f8815dc30 2023-11-28T12:09:25.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:25.246+0000 7f8f8d79b700 1 --2- 172.21.15.45:0/2107101587 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8f8815a760 0x7f8f88161200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:09:25.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:25.246+0000 7f8f8cf9a700 1 --2- 172.21.15.45:0/2107101587 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f8815dc30 0x7f8f880b4bf0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f8f880b5d60 tx=0x7f8f78009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4e994d992b3be41 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:25.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:25.246+0000 7f8f7ffff700 1 -- 172.21.15.45:0/2107101587 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f7800b860 con 0x7f8f8815dc30 2023-11-28T12:09:25.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:25.246+0000 7f8f7ffff700 1 -- 172.21.15.45:0/2107101587 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f7800b9c0 con 0x7f8f8815dc30 2023-11-28T12:09:25.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:25.246+0000 7f8f7ffff700 1 -- 172.21.15.45:0/2107101587 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f7800bd50 con 0x7f8f8815dc30 2023-11-28T12:09:25.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:25.247+0000 7f8f8f9ff700 1 -- 172.21.15.45:0/2107101587 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f8815dc30 msgr2=0x7f8f880b4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:25.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:25.247+0000 7f8f8f9ff700 1 --2- 172.21.15.45:0/2107101587 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f8815dc30 0x7f8f880b4bf0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f8f880b5d60 tx=0x7f8f78009c00 comp rx=0 tx=0).stop 2023-11-28T12:09:25.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:25.247+0000 7f8f8f9ff700 1 -- 172.21.15.45:0/2107101587 shutdown_connections 2023-11-28T12:09:25.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:25.247+0000 7f8f8f9ff700 1 --2- 172.21.15.45:0/2107101587 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8f8815a760 0x7f8f88161200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:25.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:25.247+0000 7f8f8f9ff700 1 --2- 172.21.15.45:0/2107101587 >> v2:172.21.15.152:3300/0 conn(0x7f8f880cd7c0 0x7f8f880cdc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:25.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:25.247+0000 7f8f8f9ff700 1 --2- 172.21.15.45:0/2107101587 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f8815dc30 0x7f8f880b4bf0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:25.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:25.247+0000 7f8f8f9ff700 1 -- 172.21.15.45:0/2107101587 >> 172.21.15.45:0/2107101587 conn(0x7f8f88072620 msgr2=0x7f8f880cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:25.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:25.247+0000 7f8f8f9ff700 1 -- 172.21.15.45:0/2107101587 shutdown_connections 2023-11-28T12:09:25.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:25.247+0000 7f8f8f9ff700 1 -- 172.21.15.45:0/2107101587 wait complete. 2023-11-28T12:09:25.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:25.249+0000 7f8f8f9ff700 1 Processor -- start 2023-11-28T12:09:25.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:25.249+0000 7f8f8f9ff700 1 -- start start 2023-11-28T12:09:25.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:25.250+0000 7f8f8f9ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8f880cd7c0 0x7f8f881f1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:25.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:25.250+0000 7f8f8f9ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f8815a760 0x7f8f881f1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:25.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:25.250+0000 7f8f8f9ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8f8815dc30 0x7f8f8814a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:25.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:25.250+0000 7f8f8f9ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f88148730 con 0x7f8f8815a760 2023-11-28T12:09:25.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:25.250+0000 7f8f8f9ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f880cd160 con 0x7f8f8815dc30 2023-11-28T12:09:25.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:25.250+0000 7f8f8f9ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f880cd440 con 0x7f8f880cd7c0 2023-11-28T12:09:25.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:25.250+0000 7f8f8cf9a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f8815a760 0x7f8f881f1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:25.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:25.250+0000 7f8f8cf9a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f8815a760 0x7f8f881f1ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56896/0 (socket says 172.21.15.45:56896) 2023-11-28T12:09:25.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:25.250+0000 7f8f8cf9a700 1 -- 172.21.15.45:0/3419385590 learned_addr learned my addr 172.21.15.45:0/3419385590 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:09:25.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:25.250+0000 7f8f8d79b700 1 --2- 172.21.15.45:0/3419385590 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8f880cd7c0 0x7f8f881f1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:25.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:25.250+0000 7f8f8df9c700 1 --2- 172.21.15.45:0/3419385590 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8f8815dc30 0x7f8f8814a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:25.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:25.250+0000 7f8f8cf9a700 1 -- 172.21.15.45:0/3419385590 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8f880cd7c0 msgr2=0x7f8f881f1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:25.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:25.251+0000 7f8f8cf9a700 1 --2- 172.21.15.45:0/3419385590 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8f880cd7c0 0x7f8f881f1590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:25.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:25.251+0000 7f8f8cf9a700 1 -- 172.21.15.45:0/3419385590 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8f8815dc30 msgr2=0x7f8f8814a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:25.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:25.251+0000 7f8f8cf9a700 1 --2- 172.21.15.45:0/3419385590 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8f8815dc30 0x7f8f8814a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:25.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:25.251+0000 7f8f8cf9a700 1 -- 172.21.15.45:0/3419385590 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f78009550 con 0x7f8f8815a760 2023-11-28T12:09:25.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:25.251+0000 7f8f8df9c700 1 --2- 172.21.15.45:0/3419385590 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8f8815dc30 0x7f8f8814a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:09:25.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:25.251+0000 7f8f8cf9a700 1 --2- 172.21.15.45:0/3419385590 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f8815a760 0x7f8f881f1ad0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f8f78009130 tx=0x7f8f78004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:25.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:25.251+0000 7f8f7dffb700 1 -- 172.21.15.45:0/3419385590 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f78004450 con 0x7f8f8815a760 2023-11-28T12:09:25.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:25.251+0000 7f8f7dffb700 1 -- 172.21.15.45:0/3419385590 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f7801e070 con 0x7f8f8815a760 2023-11-28T12:09:25.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:25.251+0000 7f8f8f9ff700 1 -- 172.21.15.45:0/3419385590 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f880b5390 con 0x7f8f8815a760 2023-11-28T12:09:25.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:25.251+0000 7f8f7dffb700 1 -- 172.21.15.45:0/3419385590 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f780038e0 con 0x7f8f8815a760 2023-11-28T12:09:25.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:25.251+0000 7f8f8f9ff700 1 -- 172.21.15.45:0/3419385590 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f880b5130 con 0x7f8f8815a760 2023-11-28T12:09:25.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:25.252+0000 7f8f8f9ff700 1 -- 172.21.15.45:0/3419385590 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f880b5670 con 0x7f8f8815a760 2023-11-28T12:09:25.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:25.253+0000 7f8f7dffb700 1 -- 172.21.15.45:0/3419385590 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f8f7800f050 con 0x7f8f8815a760 2023-11-28T12:09:25.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:25.254+0000 7f8f7dffb700 1 --2- 172.21.15.45:0/3419385590 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f8f6c0682f0 0x7f8f6c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:25.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:25.254+0000 7f8f7dffb700 1 -- 172.21.15.45:0/3419385590 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5768+0+0 (secure 0 0 0) 0x7f8f78020070 con 0x7f8f8815a760 2023-11-28T12:09:25.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:25.254+0000 7f8f8d79b700 1 --2- 172.21.15.45:0/3419385590 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f8f6c0682f0 0x7f8f6c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:25.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:25.255+0000 7f8f8d79b700 1 --2- 172.21.15.45:0/3419385590 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f8f6c0682f0 0x7f8f6c06a7a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f8f84006f10 tx=0x7f8f84008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:25.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:25.258+0000 7f8f7dffb700 1 -- 172.21.15.45:0/3419385590 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f8f78053890 con 0x7f8f8815a760 2023-11-28T12:09:25.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:25.464+0000 7f8f8f9ff700 1 -- 172.21.15.45:0/3419385590 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8f8804e620 con 0x7f8f8815a760 2023-11-28T12:09:26.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.015+0000 7f8f7dffb700 1 -- 172.21.15.45:0/3419385590 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v52) v1 ==== 169+0+0 (secure 0 0 0) 0x7f8f780150d0 con 0x7f8f8815a760 2023-11-28T12:09:26.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.018+0000 7f8f8f9ff700 1 -- 172.21.15.45:0/3419385590 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f8f6c0682f0 msgr2=0x7f8f6c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:26.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.018+0000 7f8f8f9ff700 1 --2- 172.21.15.45:0/3419385590 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f8f6c0682f0 0x7f8f6c06a7a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f8f84006f10 tx=0x7f8f84008040 comp rx=0 tx=0).stop 2023-11-28T12:09:26.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.018+0000 7f8f8f9ff700 1 -- 172.21.15.45:0/3419385590 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f8815a760 msgr2=0x7f8f881f1ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:26.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.018+0000 7f8f8f9ff700 1 --2- 172.21.15.45:0/3419385590 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f8815a760 0x7f8f881f1ad0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f8f78009130 tx=0x7f8f78004750 comp rx=0 tx=0).stop 2023-11-28T12:09:26.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.018+0000 7f8f8f9ff700 1 -- 172.21.15.45:0/3419385590 shutdown_connections 2023-11-28T12:09:26.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.018+0000 7f8f8f9ff700 1 --2- 172.21.15.45:0/3419385590 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f8f6c0682f0 0x7f8f6c06a7a0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:26.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.018+0000 7f8f8f9ff700 1 --2- 172.21.15.45:0/3419385590 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8f8815dc30 0x7f8f8814a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:26.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.018+0000 7f8f8f9ff700 1 --2- 172.21.15.45:0/3419385590 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f8f880cd7c0 0x7f8f881f1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:26.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.018+0000 7f8f8f9ff700 1 --2- 172.21.15.45:0/3419385590 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f8815a760 0x7f8f881f1ad0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:26.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.018+0000 7f8f8f9ff700 1 -- 172.21.15.45:0/3419385590 >> 172.21.15.45:0/3419385590 conn(0x7f8f88072620 msgr2=0x7f8f8815eb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:26.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.018+0000 7f8f8f9ff700 1 -- 172.21.15.45:0/3419385590 shutdown_connections 2023-11-28T12:09:26.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.018+0000 7f8f8f9ff700 1 -- 172.21.15.45:0/3419385590 wait complete. 2023-11-28T12:09:26.020 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' removed 2023-11-28T12:09:26.039 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-28T12:09:26.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.246+0000 7f3192bff700 1 Processor -- start 2023-11-28T12:09:26.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.246+0000 7f3192bff700 1 -- start start 2023-11-28T12:09:26.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.247+0000 7f3192bff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f318c0d01b0 0x7f318c0d0c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:26.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.247+0000 7f3192bff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f318c0b16d0 0x7f318c0d1160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:26.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.247+0000 7f3192bff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f318c0b0230 con 0x7f318c0b20b0 2023-11-28T12:09:26.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.247+0000 7f3192bff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f318c15cec0 con 0x7f318c0d01b0 2023-11-28T12:09:26.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.247+0000 7f3192bff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f318c0b4570 con 0x7f318c0b16d0 2023-11-28T12:09:26.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.248+0000 7f319099b700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f318c0d01b0 0x7f318c0d0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:26.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.248+0000 7f319119c700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f318c0b16d0 0x7f318c0d1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:26.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.248+0000 7f319099b700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f318c0d01b0 0x7f318c0d0c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.45:50724/0 (socket says 172.21.15.45:50724) 2023-11-28T12:09:26.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.248+0000 7f319099b700 1 -- 172.21.15.45:0/2778490051 learned_addr learned my addr 172.21.15.45:0/2778490051 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:09:26.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.248+0000 7f318bfff700 1 --1- 172.21.15.45:0/2778490051 >> v1:172.21.15.152:6789/0 conn(0x7f318c0b20b0 0x7f318c0b29b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.45:60006/0 (socket says 172.21.15.45:60006) 2023-11-28T12:09:26.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.248+0000 7f319099b700 1 -- 172.21.15.45:0/2778490051 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f318c0b16d0 msgr2=0x7f318c0d1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:26.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.248+0000 7f319099b700 1 --2- 172.21.15.45:0/2778490051 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f318c0b16d0 0x7f318c0d1160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:26.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.248+0000 7f319099b700 1 -- 172.21.15.45:0/2778490051 >> v1:172.21.15.152:6789/0 conn(0x7f318c0b20b0 legacy=0x7f318c0b29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:26.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.248+0000 7f319099b700 1 -- 172.21.15.45:0/2778490051 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f318c0b4850 con 0x7f318c0d01b0 2023-11-28T12:09:26.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.248+0000 7f319119c700 1 --2- 172.21.15.45:0/2778490051 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f318c0b16d0 0x7f318c0d1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:09:26.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.249+0000 7f319099b700 1 --2- 172.21.15.45:0/2778490051 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f318c0d01b0 0x7f318c0d0c20 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f31800098f0 tx=0x7f3180009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83cf31c5205e84b1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:26.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.249+0000 7f318b7fe700 1 -- 172.21.15.45:0/2778490051 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3180011830 con 0x7f318c0d01b0 2023-11-28T12:09:26.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.249+0000 7f318b7fe700 1 -- 172.21.15.45:0/2778490051 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3180011990 con 0x7f318c0d01b0 2023-11-28T12:09:26.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.249+0000 7f318b7fe700 1 -- 172.21.15.45:0/2778490051 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3180011d20 con 0x7f318c0d01b0 2023-11-28T12:09:26.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.249+0000 7f3192bff700 1 -- 172.21.15.45:0/2778490051 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f318c0d01b0 msgr2=0x7f318c0d0c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:26.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.249+0000 7f3192bff700 1 --2- 172.21.15.45:0/2778490051 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f318c0d01b0 0x7f318c0d0c20 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f31800098f0 tx=0x7f3180009c00 comp rx=0 tx=0).stop 2023-11-28T12:09:26.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.249+0000 7f3192bff700 1 -- 172.21.15.45:0/2778490051 shutdown_connections 2023-11-28T12:09:26.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.249+0000 7f3192bff700 1 --2- 172.21.15.45:0/2778490051 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f318c0b16d0 0x7f318c0d1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:26.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.249+0000 7f3192bff700 1 --2- 172.21.15.45:0/2778490051 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f318c0d01b0 0x7f318c0d0c20 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:26.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.249+0000 7f3192bff700 1 -- 172.21.15.45:0/2778490051 >> 172.21.15.45:0/2778490051 conn(0x7f318c09c3f0 msgr2=0x7f318c0d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:26.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.250+0000 7f3192bff700 1 -- 172.21.15.45:0/2778490051 shutdown_connections 2023-11-28T12:09:26.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.250+0000 7f3192bff700 1 -- 172.21.15.45:0/2778490051 wait complete. 2023-11-28T12:09:26.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.251+0000 7f3192bff700 1 Processor -- start 2023-11-28T12:09:26.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.251+0000 7f3192bff700 1 -- start start 2023-11-28T12:09:26.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.252+0000 7f3192bff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f318c0b16d0 0x7f318c155580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:26.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.252+0000 7f3192bff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f318c0b20b0 0x7f318c0b6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:26.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.252+0000 7f3192bff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f318c0d01b0 0x7f318c1f30a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:26.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.252+0000 7f3192bff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f318c0ca490 con 0x7f318c0b16d0 2023-11-28T12:09:26.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.252+0000 7f3192bff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f318c155ac0 con 0x7f318c0d01b0 2023-11-28T12:09:26.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.252+0000 7f3192bff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f318c0b7820 con 0x7f318c0b20b0 2023-11-28T12:09:26.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.253+0000 7f319099b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f318c0b16d0 0x7f318c155580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:26.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.253+0000 7f319099b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f318c0b16d0 0x7f318c155580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56898/0 (socket says 172.21.15.45:56898) 2023-11-28T12:09:26.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.253+0000 7f319099b700 1 -- 172.21.15.45:0/4106658855 learned_addr learned my addr 172.21.15.45:0/4106658855 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:09:26.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.253+0000 7f318bfff700 1 --2- 172.21.15.45:0/4106658855 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f318c0b20b0 0x7f318c0b6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:26.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.253+0000 7f319119c700 1 --2- 172.21.15.45:0/4106658855 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f318c0d01b0 0x7f318c1f30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:26.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.253+0000 7f319099b700 1 -- 172.21.15.45:0/4106658855 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f318c0b20b0 msgr2=0x7f318c0b6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:26.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.253+0000 7f319099b700 1 --2- 172.21.15.45:0/4106658855 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f318c0b20b0 0x7f318c0b6ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:26.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.253+0000 7f319099b700 1 -- 172.21.15.45:0/4106658855 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f318c0d01b0 msgr2=0x7f318c1f30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:26.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.253+0000 7f319099b700 1 --2- 172.21.15.45:0/4106658855 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f318c0d01b0 0x7f318c1f30a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:26.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.253+0000 7f319099b700 1 -- 172.21.15.45:0/4106658855 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3184009a70 con 0x7f318c0b16d0 2023-11-28T12:09:26.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.254+0000 7f319099b700 1 --2- 172.21.15.45:0/4106658855 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f318c0b16d0 0x7f318c155580 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f3180009c40 tx=0x7f3180004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:26.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.254+0000 7f31897fa700 1 -- 172.21.15.45:0/4106658855 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31800044d0 con 0x7f318c0b16d0 2023-11-28T12:09:26.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.254+0000 7f31897fa700 1 -- 172.21.15.45:0/4106658855 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f318001e070 con 0x7f318c0b16d0 2023-11-28T12:09:26.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.254+0000 7f3192bff700 1 -- 172.21.15.45:0/4106658855 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3180009550 con 0x7f318c0b16d0 2023-11-28T12:09:26.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.254+0000 7f31897fa700 1 -- 172.21.15.45:0/4106658855 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31800038e0 con 0x7f318c0b16d0 2023-11-28T12:09:26.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.254+0000 7f3192bff700 1 -- 172.21.15.45:0/4106658855 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f318c0afec0 con 0x7f318c0b16d0 2023-11-28T12:09:26.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.255+0000 7f3192bff700 1 -- 172.21.15.45:0/4106658855 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f318c0afbe0 con 0x7f318c0b16d0 2023-11-28T12:09:26.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.256+0000 7f31897fa700 1 -- 172.21.15.45:0/4106658855 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f318000f050 con 0x7f318c0b16d0 2023-11-28T12:09:26.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.257+0000 7f31897fa700 1 --2- 172.21.15.45:0/4106658855 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f31700682f0 0x7f317006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:26.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.257+0000 7f31897fa700 1 -- 172.21.15.45:0/4106658855 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f3180086800 con 0x7f318c0b16d0 2023-11-28T12:09:26.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.258+0000 7f318bfff700 1 --2- 172.21.15.45:0/4106658855 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f31700682f0 0x7f317006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:26.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.258+0000 7f318bfff700 1 --2- 172.21.15.45:0/4106658855 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f31700682f0 0x7f317006a7a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f318c1f6590 tx=0x7f3178007ed0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:26.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.261+0000 7f31897fa700 1 -- 172.21.15.45:0/4106658855 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f3180053290 con 0x7f318c0b16d0 2023-11-28T12:09:26.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.462+0000 7f3192bff700 1 -- 172.21.15.45:0/4106658855 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f318c0b2600 con 0x7f318c0b16d0 2023-11-28T12:09:26.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.466+0000 7f31897fa700 1 -- 172.21.15.45:0/4106658855 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7f31800568b0 con 0x7f318c0b16d0 2023-11-28T12:09:26.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.469+0000 7f3192bff700 1 -- 172.21.15.45:0/4106658855 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f31700682f0 msgr2=0x7f317006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:26.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.469+0000 7f3192bff700 1 --2- 172.21.15.45:0/4106658855 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f31700682f0 0x7f317006a7a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f318c1f6590 tx=0x7f3178007ed0 comp rx=0 tx=0).stop 2023-11-28T12:09:26.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.469+0000 7f3192bff700 1 -- 172.21.15.45:0/4106658855 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f318c0b16d0 msgr2=0x7f318c155580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:26.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.469+0000 7f3192bff700 1 --2- 172.21.15.45:0/4106658855 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f318c0b16d0 0x7f318c155580 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f3180009c40 tx=0x7f3180004750 comp rx=0 tx=0).stop 2023-11-28T12:09:26.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.469+0000 7f3192bff700 1 -- 172.21.15.45:0/4106658855 shutdown_connections 2023-11-28T12:09:26.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.469+0000 7f3192bff700 1 --2- 172.21.15.45:0/4106658855 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f31700682f0 0x7f317006a7a0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:26.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.469+0000 7f3192bff700 1 --2- 172.21.15.45:0/4106658855 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f318c0d01b0 0x7f318c1f30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:26.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.469+0000 7f3192bff700 1 --2- 172.21.15.45:0/4106658855 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f318c0b16d0 0x7f318c155580 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:26.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.469+0000 7f3192bff700 1 --2- 172.21.15.45:0/4106658855 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f318c0b20b0 0x7f318c0b6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:26.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.469+0000 7f3192bff700 1 -- 172.21.15.45:0/4106658855 >> 172.21.15.45:0/4106658855 conn(0x7f318c09c3f0 msgr2=0x7f318c0b0f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:26.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.469+0000 7f3192bff700 1 -- 172.21.15.45:0/4106658855 shutdown_connections 2023-11-28T12:09:26.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.469+0000 7f3192bff700 1 -- 172.21.15.45:0/4106658855 wait complete. 2023-11-28T12:09:26.490 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair' 2023-11-28T12:09:26.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.694+0000 7f6d7adff700 1 Processor -- start 2023-11-28T12:09:26.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.695+0000 7f6d7adff700 1 -- start start 2023-11-28T12:09:26.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.696+0000 7f6d7adff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6d7415c9b0 0x7f6d740b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:26.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.696+0000 7f6d7adff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6d74161340 0x7f6d740d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:26.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.696+0000 7f6d7adff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f6d740d2320 0x7f6d740cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:26.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.696+0000 7f6d7adff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d740b5800 con 0x7f6d74161340 2023-11-28T12:09:26.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.696+0000 7f6d7adff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d740d1950 con 0x7f6d740d2320 2023-11-28T12:09:26.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.696+0000 7f6d7adff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d740b5520 con 0x7f6d7415c9b0 2023-11-28T12:09:26.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.696+0000 7f6d73fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6d74161340 0x7f6d740d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:26.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.696+0000 7f6d73fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6d74161340 0x7f6d740d1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56908/0 (socket says 172.21.15.45:56908) 2023-11-28T12:09:26.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.696+0000 7f6d73fff700 1 -- 172.21.15.45:0/218455617 learned_addr learned my addr 172.21.15.45:0/218455617 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:09:26.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.696+0000 7f6d7939c700 1 --2- 172.21.15.45:0/218455617 >> v2:172.21.15.152:3300/0 conn(0x7f6d740d2320 0x7f6d740cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:26.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.696+0000 7f6d78b9b700 1 --2- 172.21.15.45:0/218455617 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6d7415c9b0 0x7f6d740b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:26.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.697+0000 7f6d73fff700 1 -- 172.21.15.45:0/218455617 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6d7415c9b0 msgr2=0x7f6d740b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:26.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.697+0000 7f6d73fff700 1 --2- 172.21.15.45:0/218455617 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6d7415c9b0 0x7f6d740b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:26.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.697+0000 7f6d73fff700 1 -- 172.21.15.45:0/218455617 >> v2:172.21.15.152:3300/0 conn(0x7f6d740d2320 msgr2=0x7f6d740cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:26.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.697+0000 7f6d73fff700 1 --2- 172.21.15.45:0/218455617 >> v2:172.21.15.152:3300/0 conn(0x7f6d740d2320 0x7f6d740cd7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:26.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.697+0000 7f6d73fff700 1 -- 172.21.15.45:0/218455617 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d740d1300 con 0x7f6d74161340 2023-11-28T12:09:26.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.697+0000 7f6d73fff700 1 --2- 172.21.15.45:0/218455617 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d74161340 0x7f6d740d1de0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f6d7408c4d0 tx=0x7f6d60009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bcbfc9e8b3dd822 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:26.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.697+0000 7f6d737fe700 1 -- 172.21.15.45:0/218455617 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d6000b870 con 0x7f6d74161340 2023-11-28T12:09:26.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.697+0000 7f6d737fe700 1 -- 172.21.15.45:0/218455617 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d6000b9d0 con 0x7f6d74161340 2023-11-28T12:09:26.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.697+0000 7f6d737fe700 1 -- 172.21.15.45:0/218455617 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d6000bd60 con 0x7f6d74161340 2023-11-28T12:09:26.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.698+0000 7f6d7adff700 1 -- 172.21.15.45:0/218455617 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d74161340 msgr2=0x7f6d740d1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:26.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.698+0000 7f6d7adff700 1 --2- 172.21.15.45:0/218455617 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d74161340 0x7f6d740d1de0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f6d7408c4d0 tx=0x7f6d60009bd0 comp rx=0 tx=0).stop 2023-11-28T12:09:26.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.698+0000 7f6d7adff700 1 -- 172.21.15.45:0/218455617 shutdown_connections 2023-11-28T12:09:26.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.698+0000 7f6d7adff700 1 --2- 172.21.15.45:0/218455617 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6d7415c9b0 0x7f6d740b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:26.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.698+0000 7f6d7adff700 1 --2- 172.21.15.45:0/218455617 >> v2:172.21.15.152:3300/0 conn(0x7f6d740d2320 0x7f6d740cd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:26.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.698+0000 7f6d7adff700 1 --2- 172.21.15.45:0/218455617 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d74161340 0x7f6d740d1de0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:26.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.698+0000 7f6d7adff700 1 -- 172.21.15.45:0/218455617 >> 172.21.15.45:0/218455617 conn(0x7f6d74072600 msgr2=0x7f6d740cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:26.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.698+0000 7f6d7adff700 1 -- 172.21.15.45:0/218455617 shutdown_connections 2023-11-28T12:09:26.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.698+0000 7f6d7adff700 1 -- 172.21.15.45:0/218455617 wait complete. 2023-11-28T12:09:26.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.700+0000 7f6d7adff700 1 Processor -- start 2023-11-28T12:09:26.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.700+0000 7f6d7adff700 1 -- start start 2023-11-28T12:09:26.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.702+0000 7f6d7adff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d740d2320 0x7f6d74150580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:26.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.702+0000 7f6d7adff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6d7415c9b0 0x7f6d740c84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:26.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.702+0000 7f6d7adff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6d74161340 0x7f6d741f29b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:26.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.702+0000 7f6d7adff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d740c9240 con 0x7f6d740d2320 2023-11-28T12:09:26.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.702+0000 7f6d7adff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d74154560 con 0x7f6d7415c9b0 2023-11-28T12:09:26.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.702+0000 7f6d7adff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d740c8ed0 con 0x7f6d74161340 2023-11-28T12:09:26.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.702+0000 7f6d78b9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d740d2320 0x7f6d74150580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:26.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.702+0000 7f6d78b9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d740d2320 0x7f6d74150580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56920/0 (socket says 172.21.15.45:56920) 2023-11-28T12:09:26.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.702+0000 7f6d78b9b700 1 -- 172.21.15.45:0/2245689354 learned_addr learned my addr 172.21.15.45:0/2245689354 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:09:26.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.702+0000 7f6d7939c700 1 --2- 172.21.15.45:0/2245689354 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6d74161340 0x7f6d741f29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:26.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.702+0000 7f6d73fff700 1 --2- 172.21.15.45:0/2245689354 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6d7415c9b0 0x7f6d740c84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:26.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.702+0000 7f6d78b9b700 1 -- 172.21.15.45:0/2245689354 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6d74161340 msgr2=0x7f6d741f29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:26.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.702+0000 7f6d78b9b700 1 --2- 172.21.15.45:0/2245689354 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6d74161340 0x7f6d741f29b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:26.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.702+0000 7f6d78b9b700 1 -- 172.21.15.45:0/2245689354 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6d7415c9b0 msgr2=0x7f6d740c84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:26.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.702+0000 7f6d78b9b700 1 --2- 172.21.15.45:0/2245689354 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6d7415c9b0 0x7f6d740c84a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:26.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.702+0000 7f6d78b9b700 1 -- 172.21.15.45:0/2245689354 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d60009550 con 0x7f6d740d2320 2023-11-28T12:09:26.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.703+0000 7f6d78b9b700 1 --2- 172.21.15.45:0/2245689354 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d740d2320 0x7f6d74150580 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f6d6800d800 tx=0x7f6d6800dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:26.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.703+0000 7f6d717fa700 1 -- 172.21.15.45:0/2245689354 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d680125f0 con 0x7f6d740d2320 2023-11-28T12:09:26.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.703+0000 7f6d717fa700 1 -- 172.21.15.45:0/2245689354 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d68012750 con 0x7f6d740d2320 2023-11-28T12:09:26.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.703+0000 7f6d7adff700 1 -- 172.21.15.45:0/2245689354 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d740b5130 con 0x7f6d740d2320 2023-11-28T12:09:26.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.703+0000 7f6d717fa700 1 -- 172.21.15.45:0/2245689354 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d68012b00 con 0x7f6d740d2320 2023-11-28T12:09:26.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.703+0000 7f6d7adff700 1 -- 172.21.15.45:0/2245689354 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d740d15e0 con 0x7f6d740d2320 2023-11-28T12:09:26.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.704+0000 7f6d7adff700 1 -- 172.21.15.45:0/2245689354 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d740b52c0 con 0x7f6d740d2320 2023-11-28T12:09:26.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.705+0000 7f6d717fa700 1 -- 172.21.15.45:0/2245689354 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f6d68012c60 con 0x7f6d740d2320 2023-11-28T12:09:26.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.706+0000 7f6d717fa700 1 --2- 172.21.15.45:0/2245689354 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f6d580682f0 0x7f6d5806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:26.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.706+0000 7f6d717fa700 1 -- 172.21.15.45:0/2245689354 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f6d68085f00 con 0x7f6d740d2320 2023-11-28T12:09:26.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.707+0000 7f6d73fff700 1 --2- 172.21.15.45:0/2245689354 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f6d580682f0 0x7f6d5806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:26.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.707+0000 7f6d73fff700 1 --2- 172.21.15.45:0/2245689354 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f6d580682f0 0x7f6d5806a7a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f6d60000c00 tx=0x7f6d60008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:26.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:26.710+0000 7f6d717fa700 1 -- 172.21.15.45:0/2245689354 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f6d68052990 con 0x7f6d740d2320 2023-11-28T12:09:27.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:27.004+0000 7f6d7adff700 1 -- 172.21.15.45:0/2245689354 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]} v 0) v1 -- 0x7f6d740c9090 con 0x7f6d740d2320 2023-11-28T12:09:27.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:27.018+0000 7f6d717fa700 1 -- 172.21.15.45:0/2245689354 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]}]=0 v161) v1 ==== 149+0+0 (secure 0 0 0) 0x7f6d68055fb0 con 0x7f6d740d2320 2023-11-28T12:09:27.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:27.020+0000 7f6d7adff700 1 -- 172.21.15.45:0/2245689354 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f6d580682f0 msgr2=0x7f6d5806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:27.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:27.020+0000 7f6d7adff700 1 --2- 172.21.15.45:0/2245689354 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f6d580682f0 0x7f6d5806a7a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f6d60000c00 tx=0x7f6d60008030 comp rx=0 tx=0).stop 2023-11-28T12:09:27.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:27.020+0000 7f6d7adff700 1 -- 172.21.15.45:0/2245689354 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d740d2320 msgr2=0x7f6d74150580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:27.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:27.020+0000 7f6d7adff700 1 --2- 172.21.15.45:0/2245689354 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d740d2320 0x7f6d74150580 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f6d6800d800 tx=0x7f6d6800dbc0 comp rx=0 tx=0).stop 2023-11-28T12:09:27.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:27.020+0000 7f6d7adff700 1 -- 172.21.15.45:0/2245689354 shutdown_connections 2023-11-28T12:09:27.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:27.020+0000 7f6d7adff700 1 --2- 172.21.15.45:0/2245689354 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f6d580682f0 0x7f6d5806a7a0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:27.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:27.020+0000 7f6d7adff700 1 --2- 172.21.15.45:0/2245689354 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f6d74161340 0x7f6d741f29b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:27.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:27.020+0000 7f6d7adff700 1 --2- 172.21.15.45:0/2245689354 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d740d2320 0x7f6d74150580 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:27.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:27.020+0000 7f6d7adff700 1 --2- 172.21.15.45:0/2245689354 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6d7415c9b0 0x7f6d740c84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:27.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:27.020+0000 7f6d7adff700 1 -- 172.21.15.45:0/2245689354 >> 172.21.15.45:0/2245689354 conn(0x7f6d74072600 msgr2=0x7f6d7406a900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:27.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:27.020+0000 7f6d7adff700 1 -- 172.21.15.45:0/2245689354 shutdown_connections 2023-11-28T12:09:27.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:27.020+0000 7f6d7adff700 1 -- 172.21.15.45:0/2245689354 wait complete. 2023-11-28T12:09:27.039 INFO:tasks.cephfs_test_runner:That the MDS can repair an inodes backtrace in the data pool ... ok 2023-11-28T12:09:27.039 INFO:tasks.cephfs_test_runner:Starting test: test_health_status_after_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) Test that the damage health status is cleared 2023-11-28T12:09:27.039 INFO:tasks.cephfs_test_runner:test_health_status_after_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2023-11-28T12:09:27.039 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair' 2023-11-28T12:09:27.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:27.244+0000 7f2fcf1ff700 1 Processor -- start 2023-11-28T12:09:27.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:27.245+0000 7f2fcf1ff700 1 -- start start 2023-11-28T12:09:27.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:27.246+0000 7f2fcf1ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2fc8159860 0x7f2fc80c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:27.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:27.246+0000 7f2fcf1ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f2fc80b0d80 0x7f2fc80c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:27.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:27.246+0000 7f2fcf1ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fc80ccc00 con 0x7f2fc8159490 2023-11-28T12:09:27.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:27.246+0000 7f2fcf1ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fc80ccec0 con 0x7f2fc8159860 2023-11-28T12:09:27.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:27.246+0000 7f2fcf1ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fc80cd1a0 con 0x7f2fc80b0d80 2023-11-28T12:09:27.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:27.246+0000 7f2fc7fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2fc8159860 0x7f2fc80c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:27.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:27.246+0000 7f2fc7fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2fc8159860 0x7f2fc80c94c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56922/0 (socket says 172.21.15.45:56922) 2023-11-28T12:09:27.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:27.246+0000 7f2fc7fff700 1 -- 172.21.15.45:0/1851294079 learned_addr learned my addr 172.21.15.45:0/1851294079 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:09:27.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:27.246+0000 7f2fcd79c700 1 --2- 172.21.15.45:0/1851294079 >> v2:172.21.15.152:3300/0 conn(0x7f2fc80b0d80 0x7f2fc80c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:27.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:27.247+0000 7f2fc7fff700 1 -- 172.21.15.45:0/1851294079 >> v2:172.21.15.152:3300/0 conn(0x7f2fc80b0d80 msgr2=0x7f2fc80c9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:27.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:27.247+0000 7f2fc7fff700 1 --2- 172.21.15.45:0/1851294079 >> v2:172.21.15.152:3300/0 conn(0x7f2fc80b0d80 0x7f2fc80c9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:27.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:27.247+0000 7f2fc7fff700 1 -- 172.21.15.45:0/1851294079 >> v1:172.21.15.152:6789/0 conn(0x7f2fc8159490 legacy=0x7f2fc80b0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:27.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:27.247+0000 7f2fc7fff700 1 -- 172.21.15.45:0/1851294079 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fc80cd480 con 0x7f2fc8159860 2023-11-28T12:09:27.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:27.247+0000 7f2fc7fff700 1 --2- 172.21.15.45:0/1851294079 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2fc8159860 0x7f2fc80c94c0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f2fc80c5be0 tx=0x7f2fb4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=456911af546cf761 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:27.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:27.247+0000 7f2fc77fe700 1 -- 172.21.15.45:0/1851294079 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb400b870 con 0x7f2fc8159860 2023-11-28T12:09:27.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:27.247+0000 7f2fc77fe700 1 -- 172.21.15.45:0/1851294079 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fb400b9d0 con 0x7f2fc8159860 2023-11-28T12:09:27.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:27.247+0000 7f2fc77fe700 1 -- 172.21.15.45:0/1851294079 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb400bd60 con 0x7f2fc8159860 2023-11-28T12:09:27.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:27.248+0000 7f2fcf1ff700 1 -- 172.21.15.45:0/1851294079 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2fc8159860 msgr2=0x7f2fc80c94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:27.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:27.248+0000 7f2fcf1ff700 1 --2- 172.21.15.45:0/1851294079 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2fc8159860 0x7f2fc80c94c0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f2fc80c5be0 tx=0x7f2fb4009bd0 comp rx=0 tx=0).stop 2023-11-28T12:09:27.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:27.248+0000 7f2fcf1ff700 1 -- 172.21.15.45:0/1851294079 shutdown_connections 2023-11-28T12:09:27.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:27.248+0000 7f2fcf1ff700 1 --2- 172.21.15.45:0/1851294079 >> v2:172.21.15.152:3300/0 conn(0x7f2fc80b0d80 0x7f2fc80c9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:27.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:27.248+0000 7f2fcf1ff700 1 --2- 172.21.15.45:0/1851294079 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2fc8159860 0x7f2fc80c94c0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:27.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:27.248+0000 7f2fcf1ff700 1 -- 172.21.15.45:0/1851294079 >> 172.21.15.45:0/1851294079 conn(0x7f2fc80cb670 msgr2=0x7f2fc80cba70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:27.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:27.248+0000 7f2fcf1ff700 1 -- 172.21.15.45:0/1851294079 shutdown_connections 2023-11-28T12:09:27.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:27.248+0000 7f2fcf1ff700 1 -- 172.21.15.45:0/1851294079 wait complete. 2023-11-28T12:09:27.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:27.250+0000 7f2fcf1ff700 1 Processor -- start 2023-11-28T12:09:27.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:27.250+0000 7f2fcf1ff700 1 -- start start 2023-11-28T12:09:27.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:27.251+0000 7f2fcf1ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2fc80b0d80 0x7f2fc80c6730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:27.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:27.251+0000 7f2fcf1ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2fc8159490 0x7f2fc80c7db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:27.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:27.251+0000 7f2fcf1ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2fc815bfe0 0x7f2fc80c8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:27.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:27.251+0000 7f2fcf1ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc80c6d10 con 0x7f2fc815bfe0 2023-11-28T12:09:27.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:27.251+0000 7f2fcf1ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc80c6ff0 con 0x7f2fc80b0d80 2023-11-28T12:09:27.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:27.251+0000 7f2fcf1ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc80c72d0 con 0x7f2fc8159490 2023-11-28T12:09:27.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:27.251+0000 7f2fcd79c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2fc815bfe0 0x7f2fc80c8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:27.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:27.251+0000 7f2fcd79c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2fc815bfe0 0x7f2fc80c8b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56928/0 (socket says 172.21.15.45:56928) 2023-11-28T12:09:27.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:27.251+0000 7f2fcd79c700 1 -- 172.21.15.45:0/1088603196 learned_addr learned my addr 172.21.15.45:0/1088603196 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:09:27.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:27.251+0000 7f2fc7fff700 1 --2- 172.21.15.45:0/1088603196 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2fc8159490 0x7f2fc80c7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:27.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:27.251+0000 7f2fccf9b700 1 --2- 172.21.15.45:0/1088603196 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2fc80b0d80 0x7f2fc80c6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:27.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:27.251+0000 7f2fcd79c700 1 -- 172.21.15.45:0/1088603196 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2fc8159490 msgr2=0x7f2fc80c7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:27.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:27.251+0000 7f2fcd79c700 1 --2- 172.21.15.45:0/1088603196 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2fc8159490 0x7f2fc80c7db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:27.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:27.251+0000 7f2fcd79c700 1 -- 172.21.15.45:0/1088603196 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2fc80b0d80 msgr2=0x7f2fc80c6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:27.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:27.251+0000 7f2fcd79c700 1 --2- 172.21.15.45:0/1088603196 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2fc80b0d80 0x7f2fc80c6730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:27.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:27.251+0000 7f2fcd79c700 1 -- 172.21.15.45:0/1088603196 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fb4009550 con 0x7f2fc815bfe0 2023-11-28T12:09:27.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:27.252+0000 7f2fccf9b700 1 --2- 172.21.15.45:0/1088603196 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2fc80b0d80 0x7f2fc80c6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:09:27.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:27.252+0000 7f2fcd79c700 1 --2- 172.21.15.45:0/1088603196 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2fc815bfe0 0x7f2fc80c8b30 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f2fc0007e40 tx=0x7f2fc000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:27.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:27.252+0000 7f2fc57fa700 1 -- 172.21.15.45:0/1088603196 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc000eea0 con 0x7f2fc815bfe0 2023-11-28T12:09:27.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:27.252+0000 7f2fc57fa700 1 -- 172.21.15.45:0/1088603196 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fc0014420 con 0x7f2fc815bfe0 2023-11-28T12:09:27.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:27.252+0000 7f2fcf1ff700 1 -- 172.21.15.45:0/1088603196 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fc80c9f40 con 0x7f2fc815bfe0 2023-11-28T12:09:27.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:27.252+0000 7f2fc57fa700 1 -- 172.21.15.45:0/1088603196 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc00147b0 con 0x7f2fc815bfe0 2023-11-28T12:09:27.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:27.252+0000 7f2fcf1ff700 1 -- 172.21.15.45:0/1088603196 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fc80cd760 con 0x7f2fc815bfe0 2023-11-28T12:09:27.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:27.253+0000 7f2fcf1ff700 1 -- 172.21.15.45:0/1088603196 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fc80cdc80 con 0x7f2fc815bfe0 2023-11-28T12:09:27.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:27.254+0000 7f2fc57fa700 1 -- 172.21.15.45:0/1088603196 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f2fc0012050 con 0x7f2fc815bfe0 2023-11-28T12:09:27.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:27.255+0000 7f2fc57fa700 1 --2- 172.21.15.45:0/1088603196 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f2fac0682f0 0x7f2fac06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:27.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:27.255+0000 7f2fc57fa700 1 -- 172.21.15.45:0/1088603196 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f2fc0086130 con 0x7f2fc815bfe0 2023-11-28T12:09:27.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:27.256+0000 7f2fccf9b700 1 --2- 172.21.15.45:0/1088603196 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f2fac0682f0 0x7f2fac06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:27.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:27.257+0000 7f2fccf9b700 1 --2- 172.21.15.45:0/1088603196 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f2fac0682f0 0x7f2fac06a7a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc000f60 tx=0x7f2fbc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:27.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:27.259+0000 7f2fc57fa700 1 -- 172.21.15.45:0/1088603196 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f2fc0052bc0 con 0x7f2fc815bfe0 2023-11-28T12:09:27.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:27.541+0000 7f2fcf1ff700 1 -- 172.21.15.45:0/1088603196 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair"]} v 0) v1 -- 0x7f2fc81f0bb0 con 0x7f2fc815bfe0 2023-11-28T12:09:28.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:28.020+0000 7f2fc57fa700 1 -- 172.21.15.45:0/1088603196 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair"]}]=0 v162) v1 ==== 172+0+0 (secure 0 0 0) 0x7f2fc00561e0 con 0x7f2fc815bfe0 2023-11-28T12:09:28.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:28.022+0000 7f2fcf1ff700 1 -- 172.21.15.45:0/1088603196 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f2fac0682f0 msgr2=0x7f2fac06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:28.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:28.022+0000 7f2fcf1ff700 1 --2- 172.21.15.45:0/1088603196 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f2fac0682f0 0x7f2fac06a7a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc000f60 tx=0x7f2fbc009040 comp rx=0 tx=0).stop 2023-11-28T12:09:28.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:28.022+0000 7f2fcf1ff700 1 -- 172.21.15.45:0/1088603196 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2fc815bfe0 msgr2=0x7f2fc80c8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:28.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:28.022+0000 7f2fcf1ff700 1 --2- 172.21.15.45:0/1088603196 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2fc815bfe0 0x7f2fc80c8b30 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f2fc0007e40 tx=0x7f2fc000e3c0 comp rx=0 tx=0).stop 2023-11-28T12:09:28.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:28.023+0000 7f2fcf1ff700 1 -- 172.21.15.45:0/1088603196 shutdown_connections 2023-11-28T12:09:28.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:28.023+0000 7f2fcf1ff700 1 --2- 172.21.15.45:0/1088603196 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f2fac0682f0 0x7f2fac06a7a0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:28.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:28.023+0000 7f2fcf1ff700 1 --2- 172.21.15.45:0/1088603196 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2fc80b0d80 0x7f2fc80c6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:28.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:28.023+0000 7f2fcf1ff700 1 --2- 172.21.15.45:0/1088603196 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2fc815bfe0 0x7f2fc80c8b30 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:28.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:28.023+0000 7f2fcf1ff700 1 --2- 172.21.15.45:0/1088603196 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2fc8159490 0x7f2fc80c7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:28.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:28.023+0000 7f2fcf1ff700 1 -- 172.21.15.45:0/1088603196 >> 172.21.15.45:0/1088603196 conn(0x7f2fc80cb670 msgr2=0x7f2fc81552a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:28.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:28.023+0000 7f2fcf1ff700 1 -- 172.21.15.45:0/1088603196 shutdown_connections 2023-11-28T12:09:28.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:28.023+0000 7f2fcf1ff700 1 -- 172.21.15.45:0/1088603196 wait complete. 2023-11-28T12:09:28.044 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-28T12:09:28.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:28.252+0000 7fc2013ff700 1 Processor -- start 2023-11-28T12:09:28.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:28.252+0000 7fc2013ff700 1 -- start start 2023-11-28T12:09:28.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:28.253+0000 7fc2013ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fc1fc15c9b0 0x7fc1fc0b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:28.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:28.253+0000 7fc2013ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc1fc161340 0x7fc1fc0d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:28.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:28.253+0000 7fc2013ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1fc0d1950 con 0x7fc1fc0d2320 2023-11-28T12:09:28.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:28.253+0000 7fc2013ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1fc0b5800 con 0x7fc1fc15c9b0 2023-11-28T12:09:28.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:28.253+0000 7fc2013ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1fc0b5520 con 0x7fc1fc161340 2023-11-28T12:09:28.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:28.254+0000 7fc1fa7fc700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc1fc161340 0x7fc1fc0d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:28.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:28.254+0000 7fc1fb7fe700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fc1fc0d2320 0x7fc1fc0cd7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.45:60014/0 (socket says 172.21.15.45:60014) 2023-11-28T12:09:28.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:28.254+0000 7fc1fb7fe700 1 -- 172.21.15.45:0/3304665661 learned_addr learned my addr 172.21.15.45:0/3304665661 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:09:28.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:28.254+0000 7fc1faffd700 1 --2- 172.21.15.45:0/3304665661 >> v2:172.21.15.152:3300/0 conn(0x7fc1fc15c9b0 0x7fc1fc0b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:28.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:28.254+0000 7fc1f9ffb700 1 -- 172.21.15.45:0/3304665661 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3187409129 0 0) 0x7fc1fc0d1950 con 0x7fc1fc0d2320 2023-11-28T12:09:28.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:28.254+0000 7fc1f9ffb700 1 -- 172.21.15.45:0/3304665661 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1e40035b0 con 0x7fc1fc0d2320 2023-11-28T12:09:28.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:28.254+0000 7fc1fa7fc700 1 -- 172.21.15.45:0/3304665661 >> v2:172.21.15.152:3300/0 conn(0x7fc1fc15c9b0 msgr2=0x7fc1fc0b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:28.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:28.254+0000 7fc1fa7fc700 1 --2- 172.21.15.45:0/3304665661 >> v2:172.21.15.152:3300/0 conn(0x7fc1fc15c9b0 0x7fc1fc0b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:28.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:28.254+0000 7fc1fa7fc700 1 -- 172.21.15.45:0/3304665661 >> v1:172.21.15.152:6789/0 conn(0x7fc1fc0d2320 legacy=0x7fc1fc0cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:28.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:28.254+0000 7fc1fa7fc700 1 -- 172.21.15.45:0/3304665661 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1fc0d1300 con 0x7fc1fc161340 2023-11-28T12:09:28.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:28.255+0000 7fc1fa7fc700 1 --2- 172.21.15.45:0/3304665661 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc1fc161340 0x7fc1fc0d1de0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc1f0009840 tx=0x7fc1f0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cec5359a2f72b119 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:28.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:28.255+0000 7fc1f9ffb700 1 -- 172.21.15.45:0/3304665661 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f0011830 con 0x7fc1fc161340 2023-11-28T12:09:28.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:28.255+0000 7fc1f9ffb700 1 -- 172.21.15.45:0/3304665661 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1f0011990 con 0x7fc1fc161340 2023-11-28T12:09:28.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:28.255+0000 7fc1f9ffb700 1 -- 172.21.15.45:0/3304665661 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f0011d20 con 0x7fc1fc161340 2023-11-28T12:09:28.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:28.255+0000 7fc2013ff700 1 -- 172.21.15.45:0/3304665661 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc1fc161340 msgr2=0x7fc1fc0d1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:28.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:28.255+0000 7fc2013ff700 1 --2- 172.21.15.45:0/3304665661 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc1fc161340 0x7fc1fc0d1de0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc1f0009840 tx=0x7fc1f0009b50 comp rx=0 tx=0).stop 2023-11-28T12:09:28.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:28.256+0000 7fc2013ff700 1 -- 172.21.15.45:0/3304665661 shutdown_connections 2023-11-28T12:09:28.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:28.256+0000 7fc2013ff700 1 --2- 172.21.15.45:0/3304665661 >> v2:172.21.15.152:3300/0 conn(0x7fc1fc15c9b0 0x7fc1fc0b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:28.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:28.256+0000 7fc2013ff700 1 --2- 172.21.15.45:0/3304665661 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc1fc161340 0x7fc1fc0d1de0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:28.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:28.256+0000 7fc2013ff700 1 -- 172.21.15.45:0/3304665661 >> 172.21.15.45:0/3304665661 conn(0x7fc1fc072600 msgr2=0x7fc1fc0cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:28.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:28.256+0000 7fc2013ff700 1 -- 172.21.15.45:0/3304665661 shutdown_connections 2023-11-28T12:09:28.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:28.256+0000 7fc2013ff700 1 -- 172.21.15.45:0/3304665661 wait complete. 2023-11-28T12:09:28.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:28.257+0000 7fc2013ff700 1 Processor -- start 2023-11-28T12:09:28.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:28.258+0000 7fc2013ff700 1 -- start start 2023-11-28T12:09:28.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:28.258+0000 7fc2013ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc1fc0d2320 0x7fc1fc1f29d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:28.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:28.258+0000 7fc2013ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc1fc15c9b0 0x7fc1fc0b61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:28.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:28.259+0000 7fc2013ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc1fc161340 0x7fc1fc0b74c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:28.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:28.259+0000 7fc2013ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1fc0b6700 con 0x7fc1fc15c9b0 2023-11-28T12:09:28.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:28.259+0000 7fc2013ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1fc150f20 con 0x7fc1fc0d2320 2023-11-28T12:09:28.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:28.259+0000 7fc2013ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1fc1f2ff0 con 0x7fc1fc161340 2023-11-28T12:09:28.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:28.259+0000 7fc1fa7fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc1fc15c9b0 0x7fc1fc0b61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:28.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:28.259+0000 7fc1fa7fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc1fc15c9b0 0x7fc1fc0b61c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56942/0 (socket says 172.21.15.45:56942) 2023-11-28T12:09:28.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:28.259+0000 7fc1fa7fc700 1 -- 172.21.15.45:0/693827922 learned_addr learned my addr 172.21.15.45:0/693827922 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:09:28.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:28.259+0000 7fc1faffd700 1 --2- 172.21.15.45:0/693827922 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc1fc0d2320 0x7fc1fc1f29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:28.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:28.259+0000 7fc1fb7fe700 1 --2- 172.21.15.45:0/693827922 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc1fc161340 0x7fc1fc0b74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:28.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:28.259+0000 7fc1fa7fc700 1 -- 172.21.15.45:0/693827922 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc1fc161340 msgr2=0x7fc1fc0b74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:28.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:28.259+0000 7fc1fa7fc700 1 --2- 172.21.15.45:0/693827922 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc1fc161340 0x7fc1fc0b74c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:28.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:28.259+0000 7fc1fa7fc700 1 -- 172.21.15.45:0/693827922 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc1fc0d2320 msgr2=0x7fc1fc1f29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:28.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:28.259+0000 7fc1fa7fc700 1 --2- 172.21.15.45:0/693827922 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc1fc0d2320 0x7fc1fc1f29d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:28.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:28.259+0000 7fc1fa7fc700 1 -- 172.21.15.45:0/693827922 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1f00094a0 con 0x7fc1fc15c9b0 2023-11-28T12:09:28.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:28.259+0000 7fc1fb7fe700 1 --2- 172.21.15.45:0/693827922 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc1fc161340 0x7fc1fc0b74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:09:28.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:28.259+0000 7fc1faffd700 1 --2- 172.21.15.45:0/693827922 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc1fc0d2320 0x7fc1fc1f29d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:09:28.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:28.260+0000 7fc1fa7fc700 1 --2- 172.21.15.45:0/693827922 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc1fc15c9b0 0x7fc1fc0b61c0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fc1f00090b0 tx=0x7fc1f0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:28.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:28.260+0000 7fc1e37fe700 1 -- 172.21.15.45:0/693827922 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f00036a0 con 0x7fc1fc15c9b0 2023-11-28T12:09:28.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:28.260+0000 7fc1e37fe700 1 -- 172.21.15.45:0/693827922 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1f001f070 con 0x7fc1fc15c9b0 2023-11-28T12:09:28.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:28.260+0000 7fc2013ff700 1 -- 172.21.15.45:0/693827922 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1fc0b5130 con 0x7fc1fc15c9b0 2023-11-28T12:09:28.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:28.260+0000 7fc1e37fe700 1 -- 172.21.15.45:0/693827922 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f0003a60 con 0x7fc1fc15c9b0 2023-11-28T12:09:28.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:28.260+0000 7fc2013ff700 1 -- 172.21.15.45:0/693827922 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1fc0d15e0 con 0x7fc1fc15c9b0 2023-11-28T12:09:28.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:28.261+0000 7fc2013ff700 1 -- 172.21.15.45:0/693827922 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1fc0b52c0 con 0x7fc1fc15c9b0 2023-11-28T12:09:28.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:28.262+0000 7fc1e37fe700 1 -- 172.21.15.45:0/693827922 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fc1f000f050 con 0x7fc1fc15c9b0 2023-11-28T12:09:28.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:28.263+0000 7fc1e37fe700 1 --2- 172.21.15.45:0/693827922 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fc1e80682f0 0x7fc1e806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:28.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:28.263+0000 7fc1e37fe700 1 -- 172.21.15.45:0/693827922 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fc1f0021070 con 0x7fc1fc15c9b0 2023-11-28T12:09:28.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:28.263+0000 7fc1faffd700 1 --2- 172.21.15.45:0/693827922 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fc1e80682f0 0x7fc1e806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:28.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:28.264+0000 7fc1faffd700 1 --2- 172.21.15.45:0/693827922 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fc1e80682f0 0x7fc1e806a7a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec009f30 tx=0x7fc1ec009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:28.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:28.267+0000 7fc1e37fe700 1 -- 172.21.15.45:0/693827922 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fc1f0053d40 con 0x7fc1fc15c9b0 2023-11-28T12:09:28.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:28.470+0000 7fc2013ff700 1 -- 172.21.15.45:0/693827922 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fc1fc0b8fd0 con 0x7fc1fc15c9b0 2023-11-28T12:09:28.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:28.474+0000 7fc1e37fe700 1 -- 172.21.15.45:0/693827922 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc1f0057360 con 0x7fc1fc15c9b0 2023-11-28T12:09:28.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:28.476+0000 7fc2013ff700 1 -- 172.21.15.45:0/693827922 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fc1e80682f0 msgr2=0x7fc1e806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:28.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:28.476+0000 7fc2013ff700 1 --2- 172.21.15.45:0/693827922 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fc1e80682f0 0x7fc1e806a7a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec009f30 tx=0x7fc1ec009210 comp rx=0 tx=0).stop 2023-11-28T12:09:28.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:28.476+0000 7fc2013ff700 1 -- 172.21.15.45:0/693827922 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc1fc15c9b0 msgr2=0x7fc1fc0b61c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:28.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:28.476+0000 7fc2013ff700 1 --2- 172.21.15.45:0/693827922 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc1fc15c9b0 0x7fc1fc0b61c0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fc1f00090b0 tx=0x7fc1f0004750 comp rx=0 tx=0).stop 2023-11-28T12:09:28.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:28.476+0000 7fc2013ff700 1 -- 172.21.15.45:0/693827922 shutdown_connections 2023-11-28T12:09:28.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:28.476+0000 7fc2013ff700 1 --2- 172.21.15.45:0/693827922 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fc1e80682f0 0x7fc1e806a7a0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:28.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:28.476+0000 7fc2013ff700 1 --2- 172.21.15.45:0/693827922 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc1fc0d2320 0x7fc1fc1f29d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:28.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:28.476+0000 7fc2013ff700 1 --2- 172.21.15.45:0/693827922 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc1fc161340 0x7fc1fc0b74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:28.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:28.476+0000 7fc2013ff700 1 --2- 172.21.15.45:0/693827922 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc1fc15c9b0 0x7fc1fc0b61c0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:28.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:28.476+0000 7fc2013ff700 1 -- 172.21.15.45:0/693827922 >> 172.21.15.45:0/693827922 conn(0x7fc1fc072600 msgr2=0x7fc1fc160610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:28.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:28.476+0000 7fc2013ff700 1 -- 172.21.15.45:0/693827922 shutdown_connections 2023-11-28T12:09:28.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:28.476+0000 7fc2013ff700 1 -- 172.21.15.45:0/693827922 wait complete. 2023-11-28T12:09:28.495 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-28T12:09:28.496 DEBUG:teuthology.orchestra.run.smithi045:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T12:09:28.595 DEBUG:teuthology.orchestra.run.smithi152:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T12:09:28.698 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-28T12:09:28.699 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T12:09:28.699 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T12:09:28.745 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16351388k,nr_inodes=4087847,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=41,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3276240k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-11-28T12:09:28.746 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-11-28T12:09:28.746 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T12:09:28.794 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16348296k,nr_inodes=4087074,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=41,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275620k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-11-28T12:09:28.794 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T12:09:28.794 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T12:09:28.841 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16351388k,nr_inodes=4087847,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=41,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3276240k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-11-28T12:09:28.841 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-11-28T12:09:28.841 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T12:09:28.889 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16348296k,nr_inodes=4087074,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=41,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275620k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-11-28T12:09:28.889 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-28T12:09:28.889 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T12:09:29.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.095+0000 7f0dee7ff700 1 Processor -- start 2023-11-28T12:09:29.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.095+0000 7f0dee7ff700 1 -- start start 2023-11-28T12:09:29.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.096+0000 7f0dee7ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f0de8161340 0x7f0de80d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:29.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.096+0000 7f0dee7ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0de80d1950 con 0x7f0de80d2320 2023-11-28T12:09:29.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.097+0000 7f0dee7ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0de80b5520 con 0x7f0de815c9b0 2023-11-28T12:09:29.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.097+0000 7f0dee7ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0de80b5800 con 0x7f0de8161340 2023-11-28T12:09:29.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.097+0000 7f0decd9c700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f0de80d2320 0x7f0de80cd7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:43596/0 (socket says 172.21.15.45:43596) 2023-11-28T12:09:29.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.097+0000 7f0decd9c700 1 -- 172.21.15.45:0/2995937086 learned_addr learned my addr 172.21.15.45:0/2995937086 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:09:29.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.097+0000 7f0de77fe700 1 --2- 172.21.15.45:0/2995937086 >> v2:172.21.15.152:3300/0 conn(0x7f0de8161340 0x7f0de80d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:29.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.097+0000 7f0de6ffd700 1 -- 172.21.15.45:0/2995937086 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4078946178 0 0) 0x7f0de80d1950 con 0x7f0de80d2320 2023-11-28T12:09:29.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.097+0000 7f0de6ffd700 1 -- 172.21.15.45:0/2995937086 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0dd00035b0 con 0x7f0de80d2320 2023-11-28T12:09:29.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.097+0000 7f0de6ffd700 1 -- 172.21.15.45:0/2995937086 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3593036527 0 0) 0x7f0de80b5520 con 0x7f0de815c9b0 2023-11-28T12:09:29.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.097+0000 7f0de6ffd700 1 -- 172.21.15.45:0/2995937086 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0de80d1950 con 0x7f0de815c9b0 2023-11-28T12:09:29.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.097+0000 7f0de6ffd700 1 -- 172.21.15.45:0/2995937086 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2362765202 0 0) 0x7f0dd00035b0 con 0x7f0de80d2320 2023-11-28T12:09:29.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.097+0000 7f0de6ffd700 1 -- 172.21.15.45:0/2995937086 >> v2:172.21.15.152:3300/0 conn(0x7f0de8161340 msgr2=0x7f0de80d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:29.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.097+0000 7f0de6ffd700 1 --2- 172.21.15.45:0/2995937086 >> v2:172.21.15.152:3300/0 conn(0x7f0de8161340 0x7f0de80d1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:29.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.098+0000 7f0de6ffd700 1 -- 172.21.15.45:0/2995937086 >> v1:172.21.15.152:6789/0 conn(0x7f0de815c9b0 legacy=0x7f0de80b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:29.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.098+0000 7f0de6ffd700 1 -- 172.21.15.45:0/2995937086 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0de80d1300 con 0x7f0de80d2320 2023-11-28T12:09:29.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.098+0000 7f0de6ffd700 1 -- 172.21.15.45:0/2995937086 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3460218165 0 0) 0x7f0de00019f0 con 0x7f0de80d2320 2023-11-28T12:09:29.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.098+0000 7f0de77fe700 1 --2- 172.21.15.45:0/2995937086 >> v2:172.21.15.152:3300/0 conn(0x7f0de8161340 0x7f0de80d1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:09:29.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.098+0000 7f0de6ffd700 1 -- 172.21.15.45:0/2995937086 >> v1:172.21.15.45:6789/0 conn(0x7f0de80d2320 legacy=0x7f0de80cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:29.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.098+0000 7f0de6ffd700 1 --2- 172.21.15.45:0/2995937086 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0dd0003be0 0x7f0dd0003fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:29.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.098+0000 7f0de6ffd700 1 --2- 172.21.15.45:0/2995937086 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0dd0004850 0x7f0dd0004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:29.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.098+0000 7f0de6ffd700 1 --2- 172.21.15.45:0/2995937086 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0dd0005250 0x7f0dd000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:29.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.098+0000 7f0de6ffd700 1 -- 172.21.15.45:0/2995937086 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0de80b5800 con 0x7f0dd0003be0 2023-11-28T12:09:29.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.098+0000 7f0de6ffd700 1 -- 172.21.15.45:0/2995937086 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd000c160 con 0x7f0dd0005250 2023-11-28T12:09:29.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.098+0000 7f0de6ffd700 1 -- 172.21.15.45:0/2995937086 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd000c320 con 0x7f0dd0004850 2023-11-28T12:09:29.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.098+0000 7f0de7fff700 1 --2- 172.21.15.45:0/2995937086 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0dd0003be0 0x7f0dd0003fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:29.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.098+0000 7f0de77fe700 1 --2- 172.21.15.45:0/2995937086 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0dd0004850 0x7f0dd0004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:29.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.098+0000 7f0decd9c700 1 --2- 172.21.15.45:0/2995937086 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0dd0005250 0x7f0dd000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:29.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.098+0000 7f0de7fff700 1 -- 172.21.15.45:0/2995937086 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0dd0004850 msgr2=0x7f0dd0004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:29.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.098+0000 7f0de7fff700 1 --2- 172.21.15.45:0/2995937086 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0dd0004850 0x7f0dd0004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:29.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.098+0000 7f0de7fff700 1 -- 172.21.15.45:0/2995937086 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0dd0005250 msgr2=0x7f0dd000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:29.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.098+0000 7f0de7fff700 1 --2- 172.21.15.45:0/2995937086 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0dd0005250 0x7f0dd000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:29.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.098+0000 7f0de7fff700 1 -- 172.21.15.45:0/2995937086 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dd00035b0 con 0x7f0dd0003be0 2023-11-28T12:09:29.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.098+0000 7f0decd9c700 1 -- 172.21.15.45:0/2995937086 reap_dead start 2023-11-28T12:09:29.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.099+0000 7f0de7fff700 1 --2- 172.21.15.45:0/2995937086 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0dd0003be0 0x7f0dd0003fd0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f0dd8007fd0 tx=0x7f0dd0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1da5dc6c71bd9ced server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:29.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.099+0000 7f0de6ffd700 1 -- 172.21.15.45:0/2995937086 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd8001430 con 0x7f0dd0003be0 2023-11-28T12:09:29.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.099+0000 7f0de6ffd700 1 -- 172.21.15.45:0/2995937086 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dd80052f0 con 0x7f0dd0003be0 2023-11-28T12:09:29.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.099+0000 7f0de6ffd700 1 -- 172.21.15.45:0/2995937086 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd8001d40 con 0x7f0dd0003be0 2023-11-28T12:09:29.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.099+0000 7f0dee7ff700 1 -- 172.21.15.45:0/2995937086 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0dd0003be0 msgr2=0x7f0dd0003fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:29.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.099+0000 7f0dee7ff700 1 --2- 172.21.15.45:0/2995937086 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0dd0003be0 0x7f0dd0003fd0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f0dd8007fd0 tx=0x7f0dd0005880 comp rx=0 tx=0).stop 2023-11-28T12:09:29.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.100+0000 7f0dee7ff700 1 -- 172.21.15.45:0/2995937086 shutdown_connections 2023-11-28T12:09:29.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.100+0000 7f0dee7ff700 1 --2- 172.21.15.45:0/2995937086 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0dd0003be0 0x7f0dd0003fd0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:29.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.100+0000 7f0dee7ff700 1 -- 172.21.15.45:0/2995937086 >> 172.21.15.45:0/2995937086 conn(0x7f0de8072600 msgr2=0x7f0de80cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:29.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.100+0000 7f0dee7ff700 1 -- 172.21.15.45:0/2995937086 shutdown_connections 2023-11-28T12:09:29.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.100+0000 7f0dee7ff700 1 -- 172.21.15.45:0/2995937086 wait complete. 2023-11-28T12:09:29.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.101+0000 7f0dee7ff700 1 Processor -- start 2023-11-28T12:09:29.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.102+0000 7f0dee7ff700 1 -- start start 2023-11-28T12:09:29.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.102+0000 7f0dee7ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0dd0003be0 0x7f0de8151780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:29.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.102+0000 7f0dee7ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0de80c7820 0x7f0de81f5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:29.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.103+0000 7f0dee7ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0de80c7c90 0x7f0de81f5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:29.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.103+0000 7f0dee7ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0de815eac0 con 0x7f0de80c7820 2023-11-28T12:09:29.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.103+0000 7f0dee7ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0de81f64c0 con 0x7f0de80c7c90 2023-11-28T12:09:29.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.103+0000 7f0dee7ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0de81f67a0 con 0x7f0dd0003be0 2023-11-28T12:09:29.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.103+0000 7f0de77fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0de80c7820 0x7f0de81f5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:29.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.103+0000 7f0de77fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0de80c7820 0x7f0de81f5900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56970/0 (socket says 172.21.15.45:56970) 2023-11-28T12:09:29.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.103+0000 7f0de77fe700 1 -- 172.21.15.45:0/3359962503 learned_addr learned my addr 172.21.15.45:0/3359962503 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:09:29.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.103+0000 7f0de77fe700 1 -- 172.21.15.45:0/3359962503 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0dd0003be0 msgr2=0x7f0de8151780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:29.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.103+0000 7f0de77fe700 1 --2- 172.21.15.45:0/3359962503 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0dd0003be0 0x7f0de8151780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:29.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.103+0000 7f0de77fe700 1 -- 172.21.15.45:0/3359962503 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0de80c7c90 msgr2=0x7f0de81f5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:29.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.103+0000 7f0de77fe700 1 --2- 172.21.15.45:0/3359962503 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0de80c7c90 0x7f0de81f5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:29.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.103+0000 7f0de77fe700 1 -- 172.21.15.45:0/3359962503 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0de815cd80 con 0x7f0de80c7820 2023-11-28T12:09:29.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.103+0000 7f0de77fe700 1 --2- 172.21.15.45:0/3359962503 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0de80c7820 0x7f0de81f5900 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc011c00 tx=0x7f0ddc009eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:29.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.104+0000 7f0de4ff9700 1 -- 172.21.15.45:0/3359962503 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ddc00fa70 con 0x7f0de80c7820 2023-11-28T12:09:29.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.104+0000 7f0de4ff9700 1 -- 172.21.15.45:0/3359962503 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ddc00fbd0 con 0x7f0de80c7820 2023-11-28T12:09:29.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.104+0000 7f0de4ff9700 1 -- 172.21.15.45:0/3359962503 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ddc004030 con 0x7f0de80c7820 2023-11-28T12:09:29.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.104+0000 7f0dee7ff700 1 -- 172.21.15.45:0/3359962503 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0de80d15e0 con 0x7f0de80c7820 2023-11-28T12:09:29.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.104+0000 7f0dee7ff700 1 -- 172.21.15.45:0/3359962503 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0de815cf10 con 0x7f0de80c7820 2023-11-28T12:09:29.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.105+0000 7f0dee7ff700 1 -- 172.21.15.45:0/3359962503 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0de80745c0 con 0x7f0de80c7820 2023-11-28T12:09:29.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.106+0000 7f0de4ff9700 1 -- 172.21.15.45:0/3359962503 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f0ddc024070 con 0x7f0de80c7820 2023-11-28T12:09:29.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.107+0000 7f0de4ff9700 1 --2- 172.21.15.45:0/3359962503 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f0dd40682f0 0x7f0dd406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:29.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.107+0000 7f0de4ff9700 1 -- 172.21.15.45:0/3359962503 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f0ddc085ec0 con 0x7f0de80c7820 2023-11-28T12:09:29.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.107+0000 7f0de7fff700 1 --2- 172.21.15.45:0/3359962503 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f0dd40682f0 0x7f0dd406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:29.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.108+0000 7f0de7fff700 1 --2- 172.21.15.45:0/3359962503 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f0dd40682f0 0x7f0dd406a7a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f0dd8015040 tx=0x7f0dd8009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:29.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.111+0000 7f0de4ff9700 1 -- 172.21.15.45:0/3359962503 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f0ddc052950 con 0x7f0de80c7820 2023-11-28T12:09:29.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.361+0000 7f0dee7ff700 1 -- 172.21.15.45:0/3359962503 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0de80d08a0 con 0x7f0de80c7820 2023-11-28T12:09:29.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.361+0000 7f0de4ff9700 1 -- 172.21.15.45:0/3359962503 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+3532 (secure 0 0 0) 0x7f0ddc022020 con 0x7f0de80c7820 2023-11-28T12:09:29.362 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:09:29.362 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":26,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5398,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6836/2532875180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":2532875180},{"type":"v1","addr":"172.21.15.152:6836","nonce":2532875180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5404,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/930111917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6835","nonce":930111917},{"type":"v1","addr":"172.21.15.152:6837","nonce":930111917}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5547,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/1974473454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1974473454},{"type":"v1","addr":"172.21.15.45:6834","nonce":1974473454}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5928,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/3685433654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":3685433654},{"type":"v1","addr":"172.21.15.45:6835","nonce":3685433654}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[]} 2023-11-28T12:09:29.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.364+0000 7f0dee7ff700 1 -- 172.21.15.45:0/3359962503 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f0dd40682f0 msgr2=0x7f0dd406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:29.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.364+0000 7f0dee7ff700 1 --2- 172.21.15.45:0/3359962503 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f0dd40682f0 0x7f0dd406a7a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f0dd8015040 tx=0x7f0dd8009030 comp rx=0 tx=0).stop 2023-11-28T12:09:29.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.364+0000 7f0dee7ff700 1 -- 172.21.15.45:0/3359962503 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0de80c7820 msgr2=0x7f0de81f5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:29.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.364+0000 7f0dee7ff700 1 --2- 172.21.15.45:0/3359962503 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0de80c7820 0x7f0de81f5900 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc011c00 tx=0x7f0ddc009eb0 comp rx=0 tx=0).stop 2023-11-28T12:09:29.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.364+0000 7f0dee7ff700 1 -- 172.21.15.45:0/3359962503 shutdown_connections 2023-11-28T12:09:29.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.364+0000 7f0dee7ff700 1 --2- 172.21.15.45:0/3359962503 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f0dd40682f0 0x7f0dd406a7a0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:29.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.364+0000 7f0dee7ff700 1 --2- 172.21.15.45:0/3359962503 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0de80c7c90 0x7f0de81f5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:29.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.364+0000 7f0dee7ff700 1 --2- 172.21.15.45:0/3359962503 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0dd0003be0 0x7f0de8151780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:29.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.364+0000 7f0dee7ff700 1 --2- 172.21.15.45:0/3359962503 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0de80c7820 0x7f0de81f5900 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:29.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.364+0000 7f0dee7ff700 1 -- 172.21.15.45:0/3359962503 >> 172.21.15.45:0/3359962503 conn(0x7f0de8072600 msgr2=0x7f0de815fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:29.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.364+0000 7f0dee7ff700 1 -- 172.21.15.45:0/3359962503 shutdown_connections 2023-11-28T12:09:29.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.364+0000 7f0dee7ff700 1 -- 172.21.15.45:0/3359962503 wait complete. 2023-11-28T12:09:29.366 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 26 2023-11-28T12:09:29.383 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-28T12:09:29.383 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-28T12:09:29.384 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-28T12:09:29.384 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T12:09:29.384 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-28T12:09:29.384 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-28T12:09:29.384 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-28T12:09:29.384 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T12:09:29.384 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-28T12:09:29.385 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-28T12:09:29.385 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-28T12:09:29.385 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T12:09:29.385 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-28T12:09:29.385 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-28T12:09:29.385 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-28T12:09:29.385 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T12:09:29.398 INFO:tasks.ceph.mds.c:Stopped 2023-11-28T12:09:29.398 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-28T12:09:29.399 INFO:tasks.ceph.mds.a:Stopped 2023-11-28T12:09:29.399 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-28T12:09:29.403 INFO:tasks.ceph.mds.d:Stopped 2023-11-28T12:09:29.403 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-28T12:09:29.403 INFO:tasks.ceph.mds.b:Stopped 2023-11-28T12:09:29.404 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-28T12:09:29.443 INFO:tasks.ceph.mds.c:Started 2023-11-28T12:09:29.443 DEBUG:teuthology.parallel:result is None 2023-11-28T12:09:29.445 INFO:tasks.ceph.mds.a:Started 2023-11-28T12:09:29.446 DEBUG:teuthology.parallel:result is None 2023-11-28T12:09:29.447 INFO:tasks.ceph.mds.d:Started 2023-11-28T12:09:29.447 DEBUG:teuthology.parallel:result is None 2023-11-28T12:09:29.450 INFO:tasks.ceph.mds.b:Started 2023-11-28T12:09:29.450 DEBUG:teuthology.parallel:result is None 2023-11-28T12:09:29.451 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-28T12:09:29.597 INFO:tasks.ceph.mds.c.smithi045.stdout:starting mds.c at 2023-11-28T12:09:29.599 INFO:tasks.ceph.mds.d.smithi152.stdout:starting mds.d at 2023-11-28T12:09:29.599 INFO:tasks.ceph.mds.b.smithi152.stdout:starting mds.b at 2023-11-28T12:09:29.608 INFO:tasks.ceph.mds.a.smithi045.stdout:starting mds.a at 2023-11-28T12:09:29.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.674+0000 7f885f1ff700 1 Processor -- start 2023-11-28T12:09:29.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.674+0000 7f885f1ff700 1 -- start start 2023-11-28T12:09:29.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.675+0000 7f885f1ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f885815c9b0 0x7f88580b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:29.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.675+0000 7f885f1ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f8858161340 0x7f88580d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:29.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.675+0000 7f885f1ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88580d1950 con 0x7f88580d2320 2023-11-28T12:09:29.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.675+0000 7f885f1ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88580b5800 con 0x7f8858161340 2023-11-28T12:09:29.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.675+0000 7f885f1ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88580b5520 con 0x7f885815c9b0 2023-11-28T12:09:29.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.676+0000 7f885d79c700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f88580d2320 0x7f88580cd7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:43606/0 (socket says 172.21.15.45:43606) 2023-11-28T12:09:29.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.676+0000 7f885d79c700 1 -- 172.21.15.45:0/573130968 learned_addr learned my addr 172.21.15.45:0/573130968 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:09:29.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.676+0000 7f8857fff700 1 --2- 172.21.15.45:0/573130968 >> v2:172.21.15.152:3300/0 conn(0x7f8858161340 0x7f88580d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:29.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.676+0000 7f885cf9b700 1 --2- 172.21.15.45:0/573130968 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f885815c9b0 0x7f88580b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:29.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.676+0000 7f88577fe700 1 -- 172.21.15.45:0/573130968 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3590754731 0 0) 0x7f88580d1950 con 0x7f88580d2320 2023-11-28T12:09:29.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.676+0000 7f88577fe700 1 -- 172.21.15.45:0/573130968 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88480035b0 con 0x7f88580d2320 2023-11-28T12:09:29.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.676+0000 7f885cf9b700 1 -- 172.21.15.45:0/573130968 >> v2:172.21.15.152:3300/0 conn(0x7f8858161340 msgr2=0x7f88580d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:29.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.676+0000 7f88577fe700 1 -- 172.21.15.45:0/573130968 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 186947615 0 0) 0x7f88480035b0 con 0x7f88580d2320 2023-11-28T12:09:29.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.676+0000 7f885cf9b700 1 --2- 172.21.15.45:0/573130968 >> v2:172.21.15.152:3300/0 conn(0x7f8858161340 0x7f88580d1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:29.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.676+0000 7f885cf9b700 1 -- 172.21.15.45:0/573130968 >> v1:172.21.15.45:6789/0 conn(0x7f88580d2320 legacy=0x7f88580cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:29.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.676+0000 7f885cf9b700 1 -- 172.21.15.45:0/573130968 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88580d1300 con 0x7f885815c9b0 2023-11-28T12:09:29.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.677+0000 7f885cf9b700 1 --2- 172.21.15.45:0/573130968 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f885815c9b0 0x7f88580b4bf0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f884c009840 tx=0x7f884c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d909a2042ab491eb server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:29.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.677+0000 7f88577fe700 1 -- 172.21.15.45:0/573130968 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88500019f0 con 0x7f885815c9b0 2023-11-28T12:09:29.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.677+0000 7f88577fe700 1 -- 172.21.15.45:0/573130968 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f884c004030 con 0x7f885815c9b0 2023-11-28T12:09:29.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.677+0000 7f88577fe700 1 -- 172.21.15.45:0/573130968 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884c0043c0 con 0x7f885815c9b0 2023-11-28T12:09:29.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.678+0000 7f885f1ff700 1 -- 172.21.15.45:0/573130968 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f885815c9b0 msgr2=0x7f88580b4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:29.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.678+0000 7f885f1ff700 1 --2- 172.21.15.45:0/573130968 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f885815c9b0 0x7f88580b4bf0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f884c009840 tx=0x7f884c009b50 comp rx=0 tx=0).stop 2023-11-28T12:09:29.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.678+0000 7f885f1ff700 1 -- 172.21.15.45:0/573130968 shutdown_connections 2023-11-28T12:09:29.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.678+0000 7f885f1ff700 1 --2- 172.21.15.45:0/573130968 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f885815c9b0 0x7f88580b4bf0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:29.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.678+0000 7f885f1ff700 1 --2- 172.21.15.45:0/573130968 >> v2:172.21.15.152:3300/0 conn(0x7f8858161340 0x7f88580d1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:29.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.678+0000 7f885f1ff700 1 -- 172.21.15.45:0/573130968 >> 172.21.15.45:0/573130968 conn(0x7f8858072600 msgr2=0x7f88580cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:29.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.678+0000 7f885f1ff700 1 -- 172.21.15.45:0/573130968 shutdown_connections 2023-11-28T12:09:29.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.678+0000 7f885f1ff700 1 -- 172.21.15.45:0/573130968 wait complete. 2023-11-28T12:09:29.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.679+0000 7f885f1ff700 1 Processor -- start 2023-11-28T12:09:29.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.680+0000 7f885f1ff700 1 -- start start 2023-11-28T12:09:29.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.680+0000 7f885f1ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f88580d2320 0x7f88581595c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:29.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.680+0000 7f885f1ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f885815c9b0 0x7f88581e7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:29.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.681+0000 7f885f1ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8858161340 0x7f88581e7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:29.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.681+0000 7f885f1ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88580cdab0 con 0x7f8858161340 2023-11-28T12:09:29.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.681+0000 7f885f1ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f885815a120 con 0x7f885815c9b0 2023-11-28T12:09:29.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.681+0000 7f885f1ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88580cceb0 con 0x7f88580d2320 2023-11-28T12:09:29.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.681+0000 7f885d79c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8858161340 0x7f88581e7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:29.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.681+0000 7f885d79c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8858161340 0x7f88581e7ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57020/0 (socket says 172.21.15.45:57020) 2023-11-28T12:09:29.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.681+0000 7f885d79c700 1 -- 172.21.15.45:0/4076827301 learned_addr learned my addr 172.21.15.45:0/4076827301 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:09:29.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.681+0000 7f8857fff700 1 --2- 172.21.15.45:0/4076827301 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f885815c9b0 0x7f88581e7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:29.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.681+0000 7f885cf9b700 1 --2- 172.21.15.45:0/4076827301 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f88580d2320 0x7f88581595c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:29.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.681+0000 7f885d79c700 1 -- 172.21.15.45:0/4076827301 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f88580d2320 msgr2=0x7f88581595c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:29.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.681+0000 7f885d79c700 1 --2- 172.21.15.45:0/4076827301 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f88580d2320 0x7f88581595c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:29.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.681+0000 7f885d79c700 1 -- 172.21.15.45:0/4076827301 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f885815c9b0 msgr2=0x7f88581e7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:29.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.681+0000 7f885d79c700 1 --2- 172.21.15.45:0/4076827301 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f885815c9b0 0x7f88581e7ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:29.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.681+0000 7f885d79c700 1 -- 172.21.15.45:0/4076827301 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f884c0094a0 con 0x7f8858161340 2023-11-28T12:09:29.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.681+0000 7f885cf9b700 1 --2- 172.21.15.45:0/4076827301 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f88580d2320 0x7f88581595c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:09:29.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.682+0000 7f885d79c700 1 --2- 172.21.15.45:0/4076827301 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8858161340 0x7f88581e7ff0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f885000cc00 tx=0x7f885000cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:29.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.682+0000 7f88557fa700 1 -- 172.21.15.45:0/4076827301 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885000ab30 con 0x7f8858161340 2023-11-28T12:09:29.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.682+0000 7f88557fa700 1 -- 172.21.15.45:0/4076827301 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f885000acb0 con 0x7f8858161340 2023-11-28T12:09:29.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.682+0000 7f88557fa700 1 -- 172.21.15.45:0/4076827301 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8850007310 con 0x7f8858161340 2023-11-28T12:09:29.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.682+0000 7f885f1ff700 1 -- 172.21.15.45:0/4076827301 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88580b5130 con 0x7f8858161340 2023-11-28T12:09:29.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.682+0000 7f885f1ff700 1 -- 172.21.15.45:0/4076827301 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88580d15e0 con 0x7f8858161340 2023-11-28T12:09:29.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.683+0000 7f885f1ff700 1 -- 172.21.15.45:0/4076827301 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88580b52c0 con 0x7f8858161340 2023-11-28T12:09:29.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.684+0000 7f88557fa700 1 -- 172.21.15.45:0/4076827301 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f885001a030 con 0x7f8858161340 2023-11-28T12:09:29.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.685+0000 7f88557fa700 1 --2- 172.21.15.45:0/4076827301 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f883c068340 0x7f883c06a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:29.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.685+0000 7f88557fa700 1 -- 172.21.15.45:0/4076827301 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f8850085880 con 0x7f8858161340 2023-11-28T12:09:29.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.686+0000 7f885cf9b700 1 --2- 172.21.15.45:0/4076827301 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f883c068340 0x7f883c06a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:29.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.686+0000 7f885cf9b700 1 --2- 172.21.15.45:0/4076827301 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f883c068340 0x7f883c06a7f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f884c0090b0 tx=0x7f884c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:29.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.689+0000 7f88557fa700 1 -- 172.21.15.45:0/4076827301 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f8850052390 con 0x7f8858161340 2023-11-28T12:09:29.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:29.907+0000 7f885f1ff700 1 -- 172.21.15.45:0/4076827301 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f88580cdbf0 con 0x7f8858161340 2023-11-28T12:09:30.525 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T12:09:30.530 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T12:09:30.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:30.632+0000 7f88557fa700 1 -- 172.21.15.45:0/4076827301 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v57) v1 ==== 97+0+0 (secure 0 0 0) 0x7f8850018020 con 0x7f8858161340 2023-11-28T12:09:30.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:30.635+0000 7f885f1ff700 1 -- 172.21.15.45:0/4076827301 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f883c068340 msgr2=0x7f883c06a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:30.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:30.635+0000 7f885f1ff700 1 --2- 172.21.15.45:0/4076827301 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f883c068340 0x7f883c06a7f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f884c0090b0 tx=0x7f884c008030 comp rx=0 tx=0).stop 2023-11-28T12:09:30.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:30.635+0000 7f885f1ff700 1 -- 172.21.15.45:0/4076827301 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8858161340 msgr2=0x7f88581e7ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:30.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:30.635+0000 7f885f1ff700 1 --2- 172.21.15.45:0/4076827301 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8858161340 0x7f88581e7ff0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f885000cc00 tx=0x7f885000cf10 comp rx=0 tx=0).stop 2023-11-28T12:09:30.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:30.635+0000 7f885f1ff700 1 -- 172.21.15.45:0/4076827301 shutdown_connections 2023-11-28T12:09:30.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:30.635+0000 7f885f1ff700 1 --2- 172.21.15.45:0/4076827301 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f883c068340 0x7f883c06a7f0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:30.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:30.635+0000 7f885f1ff700 1 --2- 172.21.15.45:0/4076827301 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8858161340 0x7f88581e7ff0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:30.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:30.635+0000 7f885f1ff700 1 --2- 172.21.15.45:0/4076827301 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f88580d2320 0x7f88581595c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:30.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:30.635+0000 7f885f1ff700 1 --2- 172.21.15.45:0/4076827301 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f885815c9b0 0x7f88581e7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:30.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:30.635+0000 7f885f1ff700 1 -- 172.21.15.45:0/4076827301 >> 172.21.15.45:0/4076827301 conn(0x7f8858072600 msgr2=0x7f8858160460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:30.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:30.635+0000 7f885f1ff700 1 -- 172.21.15.45:0/4076827301 shutdown_connections 2023-11-28T12:09:30.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:30.635+0000 7f885f1ff700 1 -- 172.21.15.45:0/4076827301 wait complete. 2023-11-28T12:09:30.637 INFO:teuthology.orchestra.run.smithi045.stderr: removed all blocklist entries 2023-11-28T12:09:30.657 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-28T12:09:30.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:30.904+0000 7f7178dff700 1 Processor -- start 2023-11-28T12:09:30.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:30.904+0000 7f7178dff700 1 -- start start 2023-11-28T12:09:30.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:30.906+0000 7f7178dff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f7174161340 0x7f71740d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:30.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:30.906+0000 7f7178dff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f71740d2320 0x7f71740cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:30.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:30.906+0000 7f7178dff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71740d1950 con 0x7f717415c9b0 2023-11-28T12:09:30.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:30.906+0000 7f7178dff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71740b5800 con 0x7f71740d2320 2023-11-28T12:09:30.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:30.906+0000 7f7178dff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71740b5300 con 0x7f7174161340 2023-11-28T12:09:30.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:30.906+0000 7f7172d9d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f71740d2320 0x7f71740cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:30.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:30.906+0000 7f717259c700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f717415c9b0 0x7f71740b4bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:43608/0 (socket says 172.21.15.45:43608) 2023-11-28T12:09:30.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:30.906+0000 7f717259c700 1 -- 172.21.15.45:0/3420296008 learned_addr learned my addr 172.21.15.45:0/3420296008 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:09:30.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:30.906+0000 7f716bfff700 1 --2- 172.21.15.45:0/3420296008 >> v2:172.21.15.152:3300/0 conn(0x7f7174161340 0x7f71740d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:30.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:30.906+0000 7f7172d9d700 1 -- 172.21.15.45:0/3420296008 >> v2:172.21.15.152:3300/0 conn(0x7f7174161340 msgr2=0x7f71740d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:30.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:30.906+0000 7f7172d9d700 1 --2- 172.21.15.45:0/3420296008 >> v2:172.21.15.152:3300/0 conn(0x7f7174161340 0x7f71740d1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:30.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:30.906+0000 7f7172d9d700 1 -- 172.21.15.45:0/3420296008 >> v1:172.21.15.45:6789/0 conn(0x7f717415c9b0 legacy=0x7f71740b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:30.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:30.906+0000 7f7172d9d700 1 -- 172.21.15.45:0/3420296008 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71740b5520 con 0x7f71740d2320 2023-11-28T12:09:30.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:30.906+0000 7f7171d9b700 1 -- 172.21.15.45:0/3420296008 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3340031657 0 0) 0x7f71740d1950 con 0x7f717415c9b0 2023-11-28T12:09:30.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:30.907+0000 7f7172d9d700 1 --2- 172.21.15.45:0/3420296008 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f71740d2320 0x7f71740cd7c0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f71740685c0 tx=0x7f716c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a41a48cee2e76d0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:30.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:30.907+0000 7f7171d9b700 1 -- 172.21.15.45:0/3420296008 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f716c00e070 con 0x7f71740d2320 2023-11-28T12:09:30.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:30.907+0000 7f7171d9b700 1 -- 172.21.15.45:0/3420296008 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f716c00bb90 con 0x7f71740d2320 2023-11-28T12:09:30.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:30.907+0000 7f7171d9b700 1 -- 172.21.15.45:0/3420296008 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f716c012430 con 0x7f71740d2320 2023-11-28T12:09:30.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:30.907+0000 7f7178dff700 1 -- 172.21.15.45:0/3420296008 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f71740d2320 msgr2=0x7f71740cd7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:30.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:30.907+0000 7f7178dff700 1 --2- 172.21.15.45:0/3420296008 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f71740d2320 0x7f71740cd7c0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f71740685c0 tx=0x7f716c00b330 comp rx=0 tx=0).stop 2023-11-28T12:09:30.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:30.907+0000 7f7178dff700 1 -- 172.21.15.45:0/3420296008 shutdown_connections 2023-11-28T12:09:30.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:30.907+0000 7f7178dff700 1 --2- 172.21.15.45:0/3420296008 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f71740d2320 0x7f71740cd7c0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:30.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:30.907+0000 7f7178dff700 1 --2- 172.21.15.45:0/3420296008 >> v2:172.21.15.152:3300/0 conn(0x7f7174161340 0x7f71740d1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:30.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:30.907+0000 7f7178dff700 1 -- 172.21.15.45:0/3420296008 >> 172.21.15.45:0/3420296008 conn(0x7f7174072600 msgr2=0x7f71740cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:30.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:30.908+0000 7f7178dff700 1 -- 172.21.15.45:0/3420296008 shutdown_connections 2023-11-28T12:09:30.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:30.908+0000 7f7178dff700 1 -- 172.21.15.45:0/3420296008 wait complete. 2023-11-28T12:09:30.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:30.909+0000 7f7178dff700 1 Processor -- start 2023-11-28T12:09:30.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:30.909+0000 7f7178dff700 1 -- start start 2023-11-28T12:09:30.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:30.910+0000 7f7178dff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f71740d2320 0x7f7174146540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:30.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:30.910+0000 7f7178dff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f717415c9b0 0x7f7174151400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:30.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:30.910+0000 7f7178dff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7174161340 0x7f7174157800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:30.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:30.910+0000 7f7178dff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7174157d40 con 0x7f717415c9b0 2023-11-28T12:09:30.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:30.910+0000 7f7178dff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7174156760 con 0x7f71740d2320 2023-11-28T12:09:30.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:30.910+0000 7f7178dff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7174156a40 con 0x7f7174161340 2023-11-28T12:09:30.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:30.911+0000 7f716bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f717415c9b0 0x7f7174151400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:30.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:30.911+0000 7f716bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f717415c9b0 0x7f7174151400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57048/0 (socket says 172.21.15.45:57048) 2023-11-28T12:09:30.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:30.911+0000 7f717259c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f71740d2320 0x7f7174146540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:30.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:30.911+0000 7f716bfff700 1 -- 172.21.15.45:0/3374067736 learned_addr learned my addr 172.21.15.45:0/3374067736 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:09:30.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:30.911+0000 7f7172d9d700 1 --2- 172.21.15.45:0/3374067736 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7174161340 0x7f7174157800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:30.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:30.911+0000 7f716bfff700 1 -- 172.21.15.45:0/3374067736 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7174161340 msgr2=0x7f7174157800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:30.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:30.911+0000 7f716bfff700 1 --2- 172.21.15.45:0/3374067736 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7174161340 0x7f7174157800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:30.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:30.911+0000 7f716bfff700 1 -- 172.21.15.45:0/3374067736 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f71740d2320 msgr2=0x7f7174146540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:30.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:30.911+0000 7f716bfff700 1 --2- 172.21.15.45:0/3374067736 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f71740d2320 0x7f7174146540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:30.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:30.911+0000 7f716bfff700 1 -- 172.21.15.45:0/3374067736 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f716c009a70 con 0x7f717415c9b0 2023-11-28T12:09:30.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:30.911+0000 7f7172d9d700 1 --2- 172.21.15.45:0/3374067736 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7174161340 0x7f7174157800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:09:30.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:30.912+0000 7f716bfff700 1 --2- 172.21.15.45:0/3374067736 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f717415c9b0 0x7f7174151400 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f715c00e810 tx=0x7f715c00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:30.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:30.912+0000 7f716affd700 1 -- 172.21.15.45:0/3374067736 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f715c013610 con 0x7f717415c9b0 2023-11-28T12:09:30.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:30.912+0000 7f716affd700 1 -- 172.21.15.45:0/3374067736 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f715c013770 con 0x7f717415c9b0 2023-11-28T12:09:30.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:30.912+0000 7f716affd700 1 -- 172.21.15.45:0/3374067736 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f715c013b20 con 0x7f717415c9b0 2023-11-28T12:09:30.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:30.912+0000 7f7178dff700 1 -- 172.21.15.45:0/3374067736 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71740d15e0 con 0x7f717415c9b0 2023-11-28T12:09:30.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:30.912+0000 7f7178dff700 1 -- 172.21.15.45:0/3374067736 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71740d1300 con 0x7f717415c9b0 2023-11-28T12:09:30.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:30.913+0000 7f7178dff700 1 -- 172.21.15.45:0/3374067736 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f717415cd80 con 0x7f717415c9b0 2023-11-28T12:09:30.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:30.914+0000 7f716affd700 1 -- 172.21.15.45:0/3374067736 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f715c023070 con 0x7f717415c9b0 2023-11-28T12:09:30.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:30.915+0000 7f716affd700 1 --2- 172.21.15.45:0/3374067736 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f71540682f0 0x7f715406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:30.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:30.915+0000 7f716affd700 1 -- 172.21.15.45:0/3374067736 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f715c085690 con 0x7f717415c9b0 2023-11-28T12:09:30.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:30.915+0000 7f717259c700 1 --2- 172.21.15.45:0/3374067736 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f71540682f0 0x7f715406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:30.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:30.916+0000 7f717259c700 1 --2- 172.21.15.45:0/3374067736 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f71540682f0 0x7f715406a7a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f7164000f60 tx=0x7f7164007e70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:30.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:30.919+0000 7f716affd700 1 -- 172.21.15.45:0/3374067736 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f715c0520d0 con 0x7f717415c9b0 2023-11-28T12:09:31.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.202+0000 7f7178dff700 1 -- 172.21.15.45:0/3374067736 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f7174157650 con 0x7f717415c9b0 2023-11-28T12:09:31.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.203+0000 7f716affd700 1 -- 172.21.15.45:0/3374067736 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v12) v1 ==== 80+0+5298 (secure 0 0 0) 0x7f715c0556f0 con 0x7f717415c9b0 2023-11-28T12:09:31.206 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:09:31.206 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-11-28T12:09:31.207 INFO:teuthology.orchestra.run.smithi045.stdout: "auth_dump": [ 2023-11-28T12:09:31.207 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T12:09:31.207 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.a", 2023-11-28T12:09:31.207 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQCN12VlhJ1iEBAAPwejLipJZQnV/6P7L6lA8g==", 2023-11-28T12:09:31.207 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T12:09:31.207 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-11-28T12:09:31.207 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-11-28T12:09:31.207 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-11-28T12:09:31.207 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-11-28T12:09:31.208 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T12:09:31.208 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T12:09:31.208 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T12:09:31.208 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.b", 2023-11-28T12:09:31.208 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQCN12Vlr6poKRAAtFhus9UGFZrdPX+6WU116A==", 2023-11-28T12:09:31.208 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T12:09:31.208 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-11-28T12:09:31.208 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-11-28T12:09:31.208 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-11-28T12:09:31.208 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-11-28T12:09:31.208 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T12:09:31.208 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T12:09:31.208 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T12:09:31.209 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.c", 2023-11-28T12:09:31.209 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQCN12Vlaxs2HRAA/rYFx19h5UmFvkpiAxDjKg==", 2023-11-28T12:09:31.209 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T12:09:31.209 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-11-28T12:09:31.209 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-11-28T12:09:31.209 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-11-28T12:09:31.209 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-11-28T12:09:31.209 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T12:09:31.209 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T12:09:31.209 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T12:09:31.209 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.d", 2023-11-28T12:09:31.209 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQCN12Vl46tjNRAA367PN+mS4wxerzI5vuXgCA==", 2023-11-28T12:09:31.210 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T12:09:31.210 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-11-28T12:09:31.210 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-11-28T12:09:31.210 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-11-28T12:09:31.210 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-11-28T12:09:31.210 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T12:09:31.210 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T12:09:31.210 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T12:09:31.210 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.0", 2023-11-28T12:09:31.210 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQCQ12Vl8522AhAAJv4sFjazwIQ5obUUGqgJ+g==", 2023-11-28T12:09:31.210 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T12:09:31.210 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-11-28T12:09:31.211 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-11-28T12:09:31.211 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-11-28T12:09:31.211 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T12:09:31.211 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T12:09:31.211 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T12:09:31.211 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.1", 2023-11-28T12:09:31.211 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQCT12VlPhVZCBAAS04ENEYS51RMXl904XaeNQ==", 2023-11-28T12:09:31.211 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T12:09:31.211 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-11-28T12:09:31.211 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-11-28T12:09:31.211 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-11-28T12:09:31.211 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T12:09:31.211 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T12:09:31.212 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T12:09:31.212 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.2", 2023-11-28T12:09:31.212 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQCW12Vl5RaxDBAA3n4GyG47l/H5wINInjSqWQ==", 2023-11-28T12:09:31.212 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T12:09:31.212 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-11-28T12:09:31.212 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-11-28T12:09:31.212 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-11-28T12:09:31.212 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T12:09:31.212 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T12:09:31.212 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T12:09:31.212 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.3", 2023-11-28T12:09:31.212 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQCZ12VloTQ4EBAAU8iRvrISZn7x8FfYJj6vOA==", 2023-11-28T12:09:31.213 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T12:09:31.213 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-11-28T12:09:31.213 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-11-28T12:09:31.213 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-11-28T12:09:31.213 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T12:09:31.213 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T12:09:31.213 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T12:09:31.213 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.4", 2023-11-28T12:09:31.213 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQCf12VlJs4aKxAA75OrLomZU+ZLWe6qj+CoJw==", 2023-11-28T12:09:31.213 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T12:09:31.213 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-11-28T12:09:31.213 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-11-28T12:09:31.213 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-11-28T12:09:31.214 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T12:09:31.214 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T12:09:31.214 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T12:09:31.214 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.5", 2023-11-28T12:09:31.214 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQCi12VlQkuxLxAAlT0F37mAouzhrSRKRD78MQ==", 2023-11-28T12:09:31.214 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T12:09:31.214 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-11-28T12:09:31.214 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-11-28T12:09:31.214 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-11-28T12:09:31.214 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T12:09:31.214 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T12:09:31.215 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T12:09:31.215 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.6", 2023-11-28T12:09:31.215 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQCl12Vl2OfDMxAAV9LEr55YsDldXYXahMy9Rg==", 2023-11-28T12:09:31.215 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T12:09:31.215 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-11-28T12:09:31.215 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-11-28T12:09:31.215 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-11-28T12:09:31.215 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T12:09:31.215 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T12:09:31.215 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T12:09:31.215 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.7", 2023-11-28T12:09:31.215 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQCo12VldQCsNxAALZb33rZWI6sXmHBWJlPX0g==", 2023-11-28T12:09:31.215 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T12:09:31.216 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-11-28T12:09:31.216 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-11-28T12:09:31.216 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-11-28T12:09:31.216 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T12:09:31.216 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T12:09:31.216 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T12:09:31.216 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.0", 2023-11-28T12:09:31.216 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQCO12VljkopBBAAR62fve9Sjku9pqyTv1pQXg==", 2023-11-28T12:09:31.216 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T12:09:31.216 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-11-28T12:09:31.216 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow r", 2023-11-28T12:09:31.216 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rw pool=cephfs_data" 2023-11-28T12:09:31.216 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T12:09:31.217 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T12:09:31.217 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T12:09:31.217 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.1", 2023-11-28T12:09:31.217 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQCO12Vl1B+WExAAEsX9UkIk23pAuPUuKpyIIg==", 2023-11-28T12:09:31.217 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T12:09:31.217 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-11-28T12:09:31.217 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow r", 2023-11-28T12:09:31.217 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow rw", 2023-11-28T12:09:31.217 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rwx" 2023-11-28T12:09:31.217 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T12:09:31.217 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T12:09:31.217 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T12:09:31.218 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.2", 2023-11-28T12:09:31.218 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQCO12Vl3HDpCxAA4joXCEwKG9hndZHR0vziiw==", 2023-11-28T12:09:31.218 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T12:09:31.218 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-11-28T12:09:31.218 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow r", 2023-11-28T12:09:31.218 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow rw", 2023-11-28T12:09:31.218 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rwx" 2023-11-28T12:09:31.218 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T12:09:31.218 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T12:09:31.218 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T12:09:31.218 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.3", 2023-11-28T12:09:31.218 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQCO12VlqGtSGxAAWLALZhfUpjq0VBH/ACtOSA==", 2023-11-28T12:09:31.218 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T12:09:31.219 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-11-28T12:09:31.219 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow r", 2023-11-28T12:09:31.219 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow rw", 2023-11-28T12:09:31.219 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rwx" 2023-11-28T12:09:31.219 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T12:09:31.219 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T12:09:31.219 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T12:09:31.219 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.admin", 2023-11-28T12:09:31.219 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQCM12VlaZq7FBAATQ9oiWZS9FzJAahvR3R41g==", 2023-11-28T12:09:31.219 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T12:09:31.219 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-11-28T12:09:31.219 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-11-28T12:09:31.219 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-11-28T12:09:31.220 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-11-28T12:09:31.220 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T12:09:31.220 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T12:09:31.220 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T12:09:31.220 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mgr.x", 2023-11-28T12:09:31.220 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQCN12VlWJ4LCBAAY0cfxIlr/nfBfr8TP7L96w==", 2023-11-28T12:09:31.220 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T12:09:31.220 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-11-28T12:09:31.220 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile mgr", 2023-11-28T12:09:31.220 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-11-28T12:09:31.220 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T12:09:31.220 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T12:09:31.220 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T12:09:31.221 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mgr.y", 2023-11-28T12:09:31.221 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQCM12VlY8eOOxAAR6xl4mDL9yOV6aeCuYBojQ==", 2023-11-28T12:09:31.221 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-11-28T12:09:31.221 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-11-28T12:09:31.221 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile mgr", 2023-11-28T12:09:31.221 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-11-28T12:09:31.221 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T12:09:31.221 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T12:09:31.221 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-11-28T12:09:31.221 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-11-28T12:09:31.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.205+0000 7f7178dff700 1 -- 172.21.15.45:0/3374067736 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f71540682f0 msgr2=0x7f715406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:31.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.205+0000 7f7178dff700 1 --2- 172.21.15.45:0/3374067736 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f71540682f0 0x7f715406a7a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f7164000f60 tx=0x7f7164007e70 comp rx=0 tx=0).stop 2023-11-28T12:09:31.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.205+0000 7f7178dff700 1 -- 172.21.15.45:0/3374067736 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f717415c9b0 msgr2=0x7f7174151400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:31.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.205+0000 7f7178dff700 1 --2- 172.21.15.45:0/3374067736 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f717415c9b0 0x7f7174151400 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f715c00e810 tx=0x7f715c00eb20 comp rx=0 tx=0).stop 2023-11-28T12:09:31.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.205+0000 7f7178dff700 1 -- 172.21.15.45:0/3374067736 shutdown_connections 2023-11-28T12:09:31.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.205+0000 7f7178dff700 1 --2- 172.21.15.45:0/3374067736 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f71540682f0 0x7f715406a7a0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:31.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.205+0000 7f7178dff700 1 --2- 172.21.15.45:0/3374067736 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f71740d2320 0x7f7174146540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:31.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.205+0000 7f7178dff700 1 --2- 172.21.15.45:0/3374067736 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7174161340 0x7f7174157800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:31.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.205+0000 7f7178dff700 1 --2- 172.21.15.45:0/3374067736 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f717415c9b0 0x7f7174151400 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:31.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.205+0000 7f7178dff700 1 -- 172.21.15.45:0/3374067736 >> 172.21.15.45:0/3374067736 conn(0x7f7174072600 msgr2=0x7f717415f8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:31.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.205+0000 7f7178dff700 1 -- 172.21.15.45:0/3374067736 shutdown_connections 2023-11-28T12:09:31.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.206+0000 7f7178dff700 1 -- 172.21.15.45:0/3374067736 wait complete. 2023-11-28T12:09:31.225 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T12:09:31.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.428+0000 7f362e9ff700 1 Processor -- start 2023-11-28T12:09:31.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.428+0000 7f362e9ff700 1 -- start start 2023-11-28T12:09:31.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.429+0000 7f362e9ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3628161340 0x7f36280d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:31.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.429+0000 7f362e9ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36280d1950 con 0x7f362815c9b0 2023-11-28T12:09:31.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.429+0000 7f362e9ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36280b5520 con 0x7f36280d2320 2023-11-28T12:09:31.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.429+0000 7f362e9ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36280b5800 con 0x7f3628161340 2023-11-28T12:09:31.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.430+0000 7f3627fff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f362815c9b0 0x7f36280b4bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:43622/0 (socket says 172.21.15.45:43622) 2023-11-28T12:09:31.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.430+0000 7f3627fff700 1 -- 172.21.15.45:0/1699528846 learned_addr learned my addr 172.21.15.45:0/1699528846 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:09:31.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.430+0000 7f36277fe700 1 --2- 172.21.15.45:0/1699528846 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3628161340 0x7f36280d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:31.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.430+0000 7f3626ffd700 1 -- 172.21.15.45:0/1699528846 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 85441396 0 0) 0x7f36280d1950 con 0x7f362815c9b0 2023-11-28T12:09:31.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.430+0000 7f3626ffd700 1 -- 172.21.15.45:0/1699528846 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36100035b0 con 0x7f362815c9b0 2023-11-28T12:09:31.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.430+0000 7f3626ffd700 1 -- 172.21.15.45:0/1699528846 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 9836038 0 0) 0x7f36100035b0 con 0x7f362815c9b0 2023-11-28T12:09:31.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.430+0000 7f3626ffd700 1 -- 172.21.15.45:0/1699528846 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3628161340 msgr2=0x7f36280d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:31.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.430+0000 7f3626ffd700 1 --2- 172.21.15.45:0/1699528846 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3628161340 0x7f36280d1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:31.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.430+0000 7f3626ffd700 1 -- 172.21.15.45:0/1699528846 >> v1:172.21.15.152:6789/0 conn(0x7f36280d2320 legacy=0x7f36280cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:31.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.430+0000 7f3626ffd700 1 -- 172.21.15.45:0/1699528846 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36280d1300 con 0x7f362815c9b0 2023-11-28T12:09:31.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.430+0000 7f3626ffd700 1 -- 172.21.15.45:0/1699528846 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3460218165 0 0) 0x7f3618001670 con 0x7f362815c9b0 2023-11-28T12:09:31.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.430+0000 7f3626ffd700 1 -- 172.21.15.45:0/1699528846 >> v1:172.21.15.45:6789/0 conn(0x7f362815c9b0 legacy=0x7f36280b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:31.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.431+0000 7f3626ffd700 1 --2- 172.21.15.45:0/1699528846 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3628161340 0x7f3610003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:31.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.431+0000 7f3626ffd700 1 --2- 172.21.15.45:0/1699528846 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3610003fb0 0x7f3610004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:31.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.431+0000 7f3626ffd700 1 --2- 172.21.15.45:0/1699528846 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3610004d90 0x7f3610005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:31.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.431+0000 7f3626ffd700 1 -- 172.21.15.45:0/1699528846 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36280b5800 con 0x7f3610004d90 2023-11-28T12:09:31.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.431+0000 7f3626ffd700 1 -- 172.21.15.45:0/1699528846 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f361000bba0 con 0x7f3610003fb0 2023-11-28T12:09:31.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.431+0000 7f3626ffd700 1 -- 172.21.15.45:0/1699528846 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f361000bd60 con 0x7f3628161340 2023-11-28T12:09:31.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.431+0000 7f362cf9c700 1 --2- 172.21.15.45:0/1699528846 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3610004d90 0x7f3610005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:31.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.431+0000 7f3627fff700 1 --2- 172.21.15.45:0/1699528846 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3628161340 0x7f3610003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:31.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.431+0000 7f36277fe700 1 --2- 172.21.15.45:0/1699528846 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3610003fb0 0x7f3610004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:31.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.431+0000 7f362cf9c700 1 -- 172.21.15.45:0/1699528846 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3628161340 msgr2=0x7f3610003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:31.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.431+0000 7f362cf9c700 1 --2- 172.21.15.45:0/1699528846 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3628161340 0x7f3610003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:31.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.431+0000 7f362cf9c700 1 -- 172.21.15.45:0/1699528846 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3610003fb0 msgr2=0x7f3610004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:31.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.431+0000 7f362cf9c700 1 --2- 172.21.15.45:0/1699528846 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3610003fb0 0x7f3610004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:31.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.431+0000 7f362cf9c700 1 -- 172.21.15.45:0/1699528846 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36100035b0 con 0x7f3610004d90 2023-11-28T12:09:31.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.432+0000 7f362cf9c700 1 --2- 172.21.15.45:0/1699528846 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3610004d90 0x7f3610005200 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f362000c160 tx=0x7f3610005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17b9894ecce577d3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:31.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.432+0000 7f3626ffd700 1 -- 172.21.15.45:0/1699528846 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3620001db0 con 0x7f3610004d90 2023-11-28T12:09:31.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.432+0000 7f3626ffd700 1 -- 172.21.15.45:0/1699528846 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f362000cca0 con 0x7f3610004d90 2023-11-28T12:09:31.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.432+0000 7f3626ffd700 1 -- 172.21.15.45:0/1699528846 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3620003c40 con 0x7f3610004d90 2023-11-28T12:09:31.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.432+0000 7f362e9ff700 1 -- 172.21.15.45:0/1699528846 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3610004d90 msgr2=0x7f3610005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:31.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.432+0000 7f362e9ff700 1 --2- 172.21.15.45:0/1699528846 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3610004d90 0x7f3610005200 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f362000c160 tx=0x7f3610005880 comp rx=0 tx=0).stop 2023-11-28T12:09:31.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.432+0000 7f362cf9c700 1 -- 172.21.15.45:0/1699528846 reap_dead start 2023-11-28T12:09:31.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.432+0000 7f362e9ff700 1 -- 172.21.15.45:0/1699528846 shutdown_connections 2023-11-28T12:09:31.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.432+0000 7f362e9ff700 1 -- 172.21.15.45:0/1699528846 >> 172.21.15.45:0/1699528846 conn(0x7f3628072600 msgr2=0x7f36280cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:31.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.432+0000 7f362e9ff700 1 -- 172.21.15.45:0/1699528846 shutdown_connections 2023-11-28T12:09:31.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.433+0000 7f362e9ff700 1 -- 172.21.15.45:0/1699528846 wait complete. 2023-11-28T12:09:31.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.434+0000 7f362e9ff700 1 Processor -- start 2023-11-28T12:09:31.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.434+0000 7f362e9ff700 1 -- start start 2023-11-28T12:09:31.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.435+0000 7f362e9ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3610004d90 0x7f3628157850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:31.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.435+0000 7f362e9ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3628159420 0x7f3628159890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:31.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.435+0000 7f362e9ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36280c6ca0 0x7f36280c7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:31.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.435+0000 7f362e9ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3628159dd0 con 0x7f36280c6ca0 2023-11-28T12:09:31.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.435+0000 7f362e9ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36280c7990 con 0x7f3628159420 2023-11-28T12:09:31.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.435+0000 7f362e9ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36280c7c70 con 0x7f3610004d90 2023-11-28T12:09:31.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.436+0000 7f362cf9c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36280c6ca0 0x7f36280c7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:31.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.436+0000 7f362cf9c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36280c6ca0 0x7f36280c7110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57060/0 (socket says 172.21.15.45:57060) 2023-11-28T12:09:31.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.436+0000 7f362cf9c700 1 -- 172.21.15.45:0/3710746686 learned_addr learned my addr 172.21.15.45:0/3710746686 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:09:31.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.436+0000 7f3627fff700 1 --2- 172.21.15.45:0/3710746686 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3610004d90 0x7f3628157850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:31.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.436+0000 7f36277fe700 1 --2- 172.21.15.45:0/3710746686 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3628159420 0x7f3628159890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:31.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.436+0000 7f362cf9c700 1 -- 172.21.15.45:0/3710746686 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3610004d90 msgr2=0x7f3628157850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:31.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.436+0000 7f362cf9c700 1 --2- 172.21.15.45:0/3710746686 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3610004d90 0x7f3628157850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:31.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.436+0000 7f362cf9c700 1 -- 172.21.15.45:0/3710746686 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3628159420 msgr2=0x7f3628159890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:31.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.436+0000 7f362cf9c700 1 --2- 172.21.15.45:0/3710746686 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3628159420 0x7f3628159890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:31.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.436+0000 7f362cf9c700 1 -- 172.21.15.45:0/3710746686 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f362815cd80 con 0x7f36280c6ca0 2023-11-28T12:09:31.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.436+0000 7f36277fe700 1 --2- 172.21.15.45:0/3710746686 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3628159420 0x7f3628159890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:09:31.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.436+0000 7f362cf9c700 1 --2- 172.21.15.45:0/3710746686 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36280c6ca0 0x7f36280c7110 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f3620004000 tx=0x7f36200014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:31.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.436+0000 7f3624ff9700 1 -- 172.21.15.45:0/3710746686 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3620003c10 con 0x7f36280c6ca0 2023-11-28T12:09:31.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.436+0000 7f3624ff9700 1 -- 172.21.15.45:0/3710746686 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3620003d70 con 0x7f36280c6ca0 2023-11-28T12:09:31.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.437+0000 7f3624ff9700 1 -- 172.21.15.45:0/3710746686 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36200052f0 con 0x7f36280c6ca0 2023-11-28T12:09:31.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.437+0000 7f362e9ff700 1 -- 172.21.15.45:0/3710746686 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36280d15e0 con 0x7f36280c6ca0 2023-11-28T12:09:31.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.437+0000 7f362e9ff700 1 -- 172.21.15.45:0/3710746686 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f362815cf10 con 0x7f36280c6ca0 2023-11-28T12:09:31.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.438+0000 7f362e9ff700 1 -- 172.21.15.45:0/3710746686 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36280745c0 con 0x7f36280c6ca0 2023-11-28T12:09:31.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.439+0000 7f3624ff9700 1 -- 172.21.15.45:0/3710746686 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f3620010050 con 0x7f36280c6ca0 2023-11-28T12:09:31.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.439+0000 7f3624ff9700 1 --2- 172.21.15.45:0/3710746686 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f36140682f0 0x7f361406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:31.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.440+0000 7f3624ff9700 1 -- 172.21.15.45:0/3710746686 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f36200869e0 con 0x7f36280c6ca0 2023-11-28T12:09:31.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.440+0000 7f3627fff700 1 --2- 172.21.15.45:0/3710746686 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f36140682f0 0x7f361406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:31.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.441+0000 7f3627fff700 1 --2- 172.21.15.45:0/3710746686 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f36140682f0 0x7f361406a7a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f362815a220 tx=0x7f3618000f80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:31.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.444+0000 7f3624ff9700 1 -- 172.21.15.45:0/3710746686 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f36200534a0 con 0x7f36280c6ca0 2023-11-28T12:09:31.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.644+0000 7f362e9ff700 1 -- 172.21.15.45:0/3710746686 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f36281e8b90 con 0x7f36280c6ca0 2023-11-28T12:09:31.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.645+0000 7f3624ff9700 1 -- 172.21.15.45:0/3710746686 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) v1 ==== 74+0+14209 (secure 0 0 0) 0x7f3620017020 con 0x7f36280c6ca0 2023-11-28T12:09:31.646 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:09:31.646 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":57,"fsid":"bd7c37f1-f7c6-4778-b845-52cf2aa6e366","created":"2023-11-28T12:06:09.045075+0000","modified":"2023-11-28T12:09:30.628604+0000","last_up_change":"2023-11-28T12:06:21.282227+0000","last_in_change":"2023-11-28T12:06:12.560924+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T12:06:21.807108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T12:06:22.491009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d0cdd8a-87fd-4f2c-91bd-47bdfa661905","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":115843},{"type":"v1","addr":"172.21.15.45:6808","nonce":115843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":115843},{"type":"v1","addr":"172.21.15.45:6811","nonce":115843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":115843},{"type":"v1","addr":"172.21.15.45:6815","nonce":115843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":115843},{"type":"v1","addr":"172.21.15.45:6813","nonce":115843}]},"public_addr":"172.21.15.45:6808/115843","cluster_addr":"172.21.15.45:6811/115843","heartbeat_back_addr":"172.21.15.45:6815/115843","heartbeat_front_addr":"172.21.15.45:6813/115843","state":["exists","up"]},{"osd":1,"uuid":"c5de4ebd-9ec5-40b3-9caa-9b706fab4c76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":115842},{"type":"v1","addr":"172.21.15.45:6801","nonce":115842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":115842},{"type":"v1","addr":"172.21.15.45:6803","nonce":115842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6807","nonce":115842},{"type":"v1","addr":"172.21.15.45:6809","nonce":115842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":115842},{"type":"v1","addr":"172.21.15.45:6805","nonce":115842}]},"public_addr":"172.21.15.45:6801/115842","cluster_addr":"172.21.15.45:6803/115842","heartbeat_back_addr":"172.21.15.45:6809/115842","heartbeat_front_addr":"172.21.15.45:6805/115842","state":["exists","up"]},{"osd":2,"uuid":"9f4b36b2-65d2-40e7-9fe6-a2991afa71c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":115850},{"type":"v1","addr":"172.21.15.45:6819","nonce":115850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":115850},{"type":"v1","addr":"172.21.15.45:6823","nonce":115850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":115850},{"type":"v1","addr":"172.21.15.45:6831","nonce":115850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":115850},{"type":"v1","addr":"172.21.15.45:6828","nonce":115850}]},"public_addr":"172.21.15.45:6819/115850","cluster_addr":"172.21.15.45:6823/115850","heartbeat_back_addr":"172.21.15.45:6831/115850","heartbeat_front_addr":"172.21.15.45:6828/115850","state":["exists","up"]},{"osd":3,"uuid":"6fe7ef05-4e0d-426c-bf94-44b51d4d550b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":115848},{"type":"v1","addr":"172.21.15.45:6818","nonce":115848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":115848},{"type":"v1","addr":"172.21.15.45:6822","nonce":115848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6827","nonce":115848},{"type":"v1","addr":"172.21.15.45:6829","nonce":115848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":115848},{"type":"v1","addr":"172.21.15.45:6825","nonce":115848}]},"public_addr":"172.21.15.45:6818/115848","cluster_addr":"172.21.15.45:6822/115848","heartbeat_back_addr":"172.21.15.45:6829/115848","heartbeat_front_addr":"172.21.15.45:6825/115848","state":["exists","up"]},{"osd":4,"uuid":"fa403c08-d8a1-4a3a-8384-cb465c1a654c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":116092},{"type":"v1","addr":"172.21.15.152:6801","nonce":116092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":116092},{"type":"v1","addr":"172.21.15.152:6803","nonce":116092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":116092},{"type":"v1","addr":"172.21.15.152:6807","nonce":116092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":116092},{"type":"v1","addr":"172.21.15.152:6805","nonce":116092}]},"public_addr":"172.21.15.152:6801/116092","cluster_addr":"172.21.15.152:6803/116092","heartbeat_back_addr":"172.21.15.152:6807/116092","heartbeat_front_addr":"172.21.15.152:6805/116092","state":["exists","up"]},{"osd":5,"uuid":"399fc450-39fa-43a6-bf80-0b8bcb41bd95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6815","nonce":116093},{"type":"v1","addr":"172.21.15.152:6817","nonce":116093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":116093},{"type":"v1","addr":"172.21.15.152:6819","nonce":116093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":116093},{"type":"v1","addr":"172.21.15.152:6823","nonce":116093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":116093},{"type":"v1","addr":"172.21.15.152:6821","nonce":116093}]},"public_addr":"172.21.15.152:6817/116093","cluster_addr":"172.21.15.152:6819/116093","heartbeat_back_addr":"172.21.15.152:6823/116093","heartbeat_front_addr":"172.21.15.152:6821/116093","state":["exists","up"]},{"osd":6,"uuid":"e59a4017-2d23-4627-836b-e25b2d3ddaaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":116094},{"type":"v1","addr":"172.21.15.152:6809","nonce":116094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":116094},{"type":"v1","addr":"172.21.15.152:6811","nonce":116094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":116094},{"type":"v1","addr":"172.21.15.152:6816","nonce":116094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":116094},{"type":"v1","addr":"172.21.15.152:6813","nonce":116094}]},"public_addr":"172.21.15.152:6809/116094","cluster_addr":"172.21.15.152:6811/116094","heartbeat_back_addr":"172.21.15.152:6816/116094","heartbeat_front_addr":"172.21.15.152:6813/116094","state":["exists","up"]},{"osd":7,"uuid":"8d7f9d4b-bf08-4670-8591-388c0f012a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":116097},{"type":"v1","addr":"172.21.15.152:6825","nonce":116097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":116097},{"type":"v1","addr":"172.21.15.152:6827","nonce":116097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":116097},{"type":"v1","addr":"172.21.15.152:6831","nonce":116097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":116097},{"type":"v1","addr":"172.21.15.152:6829","nonce":116097}]},"public_addr":"172.21.15.152:6825/116097","cluster_addr":"172.21.15.152:6827/116097","heartbeat_back_addr":"172.21.15.152:6831/116097","heartbeat_front_addr":"172.21.15.152:6829/116097","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.937710+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.865423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.159434+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.913090+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.131647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.966255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.972583+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.177209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T12:09:31.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.648+0000 7f362e9ff700 1 -- 172.21.15.45:0/3710746686 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f36140682f0 msgr2=0x7f361406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:31.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.648+0000 7f362e9ff700 1 --2- 172.21.15.45:0/3710746686 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f36140682f0 0x7f361406a7a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f362815a220 tx=0x7f3618000f80 comp rx=0 tx=0).stop 2023-11-28T12:09:31.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.648+0000 7f362e9ff700 1 -- 172.21.15.45:0/3710746686 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36280c6ca0 msgr2=0x7f36280c7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:31.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.648+0000 7f362e9ff700 1 --2- 172.21.15.45:0/3710746686 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36280c6ca0 0x7f36280c7110 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f3620004000 tx=0x7f36200014a0 comp rx=0 tx=0).stop 2023-11-28T12:09:31.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.648+0000 7f362e9ff700 1 -- 172.21.15.45:0/3710746686 shutdown_connections 2023-11-28T12:09:31.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.648+0000 7f362e9ff700 1 --2- 172.21.15.45:0/3710746686 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f36140682f0 0x7f361406a7a0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:31.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.648+0000 7f362e9ff700 1 --2- 172.21.15.45:0/3710746686 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36280c6ca0 0x7f36280c7110 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:31.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.648+0000 7f362e9ff700 1 --2- 172.21.15.45:0/3710746686 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3610004d90 0x7f3628157850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:31.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.648+0000 7f362e9ff700 1 --2- 172.21.15.45:0/3710746686 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3628159420 0x7f3628159890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:31.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.648+0000 7f362e9ff700 1 -- 172.21.15.45:0/3710746686 >> 172.21.15.45:0/3710746686 conn(0x7f3628072600 msgr2=0x7f36280b60a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:31.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.648+0000 7f362e9ff700 1 -- 172.21.15.45:0/3710746686 shutdown_connections 2023-11-28T12:09:31.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.648+0000 7f362e9ff700 1 -- 172.21.15.45:0/3710746686 wait complete. 2023-11-28T12:09:31.667 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-28T12:06:21.807108+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-28T12:06:22.491009+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T12:09:31.667 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T12:09:31.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.874+0000 7fa065dff700 1 Processor -- start 2023-11-28T12:09:31.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.874+0000 7fa065dff700 1 -- start start 2023-11-28T12:09:31.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.875+0000 7fa065dff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fa06015c9b0 0x7fa0600b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:31.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.875+0000 7fa065dff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa0600cd7c0 0x7fa0600cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:31.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.875+0000 7fa065dff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0600d1950 con 0x7fa060161340 2023-11-28T12:09:31.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.875+0000 7fa065dff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0600b5800 con 0x7fa06015c9b0 2023-11-28T12:09:31.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.875+0000 7fa065dff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0600ce140 con 0x7fa0600cd7c0 2023-11-28T12:09:31.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.876+0000 7fa05effd700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fa060161340 0x7fa0600d1de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:43636/0 (socket says 172.21.15.45:43636) 2023-11-28T12:09:31.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.876+0000 7fa05effd700 1 -- 172.21.15.45:0/840909069 learned_addr learned my addr 172.21.15.45:0/840909069 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:09:31.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.876+0000 7fa05f7fe700 1 --2- 172.21.15.45:0/840909069 >> v2:172.21.15.152:3300/0 conn(0x7fa06015c9b0 0x7fa0600b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:31.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.876+0000 7fa05ffff700 1 --2- 172.21.15.45:0/840909069 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa0600cd7c0 0x7fa0600cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:31.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.876+0000 7fa05e7fc700 1 -- 172.21.15.45:0/840909069 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2698099527 0 0) 0x7fa0600d1950 con 0x7fa060161340 2023-11-28T12:09:31.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.876+0000 7fa05e7fc700 1 -- 172.21.15.45:0/840909069 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0480035b0 con 0x7fa060161340 2023-11-28T12:09:31.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.876+0000 7fa05e7fc700 1 -- 172.21.15.45:0/840909069 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3167068709 0 0) 0x7fa0480035b0 con 0x7fa060161340 2023-11-28T12:09:31.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.876+0000 7fa05e7fc700 1 -- 172.21.15.45:0/840909069 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa0600cd7c0 msgr2=0x7fa0600cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:31.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.876+0000 7fa05e7fc700 1 --2- 172.21.15.45:0/840909069 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa0600cd7c0 0x7fa0600cdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:31.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.876+0000 7fa05e7fc700 1 -- 172.21.15.45:0/840909069 >> v2:172.21.15.152:3300/0 conn(0x7fa06015c9b0 msgr2=0x7fa0600b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:31.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.876+0000 7fa05e7fc700 1 --2- 172.21.15.45:0/840909069 >> v2:172.21.15.152:3300/0 conn(0x7fa06015c9b0 0x7fa0600b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:31.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.876+0000 7fa05e7fc700 1 -- 172.21.15.45:0/840909069 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0600d24f0 con 0x7fa060161340 2023-11-28T12:09:31.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.876+0000 7fa05e7fc700 1 -- 172.21.15.45:0/840909069 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3460218165 0 0) 0x7fa054001670 con 0x7fa060161340 2023-11-28T12:09:31.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.876+0000 7fa05e7fc700 1 -- 172.21.15.45:0/840909069 >> v1:172.21.15.45:6789/0 conn(0x7fa060161340 legacy=0x7fa0600d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:31.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.876+0000 7fa05e7fc700 1 --2- 172.21.15.45:0/840909069 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa048003a00 0x7fa048003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:31.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.876+0000 7fa05e7fc700 1 --2- 172.21.15.45:0/840909069 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa048004850 0x7fa048004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:31.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.876+0000 7fa05e7fc700 1 --2- 172.21.15.45:0/840909069 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa0600cd7c0 0x7fa048005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:31.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.877+0000 7fa05e7fc700 1 -- 172.21.15.45:0/840909069 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0600b5800 con 0x7fa048004850 2023-11-28T12:09:31.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.877+0000 7fa05e7fc700 1 -- 172.21.15.45:0/840909069 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0600ce140 con 0x7fa048003a00 2023-11-28T12:09:31.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.877+0000 7fa05e7fc700 1 -- 172.21.15.45:0/840909069 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa04800ba60 con 0x7fa0600cd7c0 2023-11-28T12:09:31.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.877+0000 7fa05effd700 1 --2- 172.21.15.45:0/840909069 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa048004850 0x7fa048004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:31.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.877+0000 7fa05f7fe700 1 --2- 172.21.15.45:0/840909069 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa048003a00 0x7fa048003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:31.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.877+0000 7fa05ffff700 1 --2- 172.21.15.45:0/840909069 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa0600cd7c0 0x7fa048005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:31.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.877+0000 7fa05effd700 1 -- 172.21.15.45:0/840909069 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa0600cd7c0 msgr2=0x7fa048005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:31.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.877+0000 7fa05effd700 1 --2- 172.21.15.45:0/840909069 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa0600cd7c0 0x7fa048005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:31.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.877+0000 7fa05effd700 1 -- 172.21.15.45:0/840909069 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa048003a00 msgr2=0x7fa048003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:31.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.877+0000 7fa05effd700 1 --2- 172.21.15.45:0/840909069 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa048003a00 0x7fa048003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:31.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.877+0000 7fa05effd700 1 -- 172.21.15.45:0/840909069 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0480035b0 con 0x7fa048004850 2023-11-28T12:09:31.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.877+0000 7fa05effd700 1 --2- 172.21.15.45:0/840909069 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa048004850 0x7fa048004cc0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fa05400c240 tx=0x7fa048005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13291c69936c884d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:31.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.878+0000 7fa05e7fc700 1 -- 172.21.15.45:0/840909069 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa05400cd40 con 0x7fa048004850 2023-11-28T12:09:31.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.878+0000 7fa05e7fc700 1 -- 172.21.15.45:0/840909069 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa054005960 con 0x7fa048004850 2023-11-28T12:09:31.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.878+0000 7fa05e7fc700 1 -- 172.21.15.45:0/840909069 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa05400cea0 con 0x7fa048004850 2023-11-28T12:09:31.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.878+0000 7fa065dff700 1 -- 172.21.15.45:0/840909069 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa048004850 msgr2=0x7fa048004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:31.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.878+0000 7fa065dff700 1 --2- 172.21.15.45:0/840909069 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa048004850 0x7fa048004cc0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fa05400c240 tx=0x7fa048005880 comp rx=0 tx=0).stop 2023-11-28T12:09:31.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.878+0000 7fa05ffff700 1 -- 172.21.15.45:0/840909069 reap_dead start 2023-11-28T12:09:31.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.878+0000 7fa065dff700 1 -- 172.21.15.45:0/840909069 shutdown_connections 2023-11-28T12:09:31.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.878+0000 7fa065dff700 1 -- 172.21.15.45:0/840909069 >> 172.21.15.45:0/840909069 conn(0x7fa060072600 msgr2=0x7fa0600cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:31.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.878+0000 7fa065dff700 1 -- 172.21.15.45:0/840909069 shutdown_connections 2023-11-28T12:09:31.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.878+0000 7fa065dff700 1 -- 172.21.15.45:0/840909069 wait complete. 2023-11-28T12:09:31.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.880+0000 7fa065dff700 1 Processor -- start 2023-11-28T12:09:31.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.880+0000 7fa065dff700 1 -- start start 2023-11-28T12:09:31.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.881+0000 7fa065dff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa048004850 0x7fa06014d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:31.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.881+0000 7fa065dff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0600cc3c0 0x7fa0600ca240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:31.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.881+0000 7fa065dff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa0600cc830 0x7fa0600ca780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:31.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.881+0000 7fa065dff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0600cbfa0 con 0x7fa0600cc3c0 2023-11-28T12:09:31.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.881+0000 7fa065dff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa060157710 con 0x7fa048004850 2023-11-28T12:09:31.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.881+0000 7fa065dff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0600cae00 con 0x7fa0600cc830 2023-11-28T12:09:31.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.881+0000 7fa05effd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0600cc3c0 0x7fa0600ca240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:31.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.881+0000 7fa05effd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0600cc3c0 0x7fa0600ca240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57074/0 (socket says 172.21.15.45:57074) 2023-11-28T12:09:31.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.881+0000 7fa05effd700 1 -- 172.21.15.45:0/3665350614 learned_addr learned my addr 172.21.15.45:0/3665350614 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:09:31.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.881+0000 7fa05f7fe700 1 --2- 172.21.15.45:0/3665350614 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa048004850 0x7fa06014d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:31.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.882+0000 7fa05ffff700 1 --2- 172.21.15.45:0/3665350614 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa0600cc830 0x7fa0600ca780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:31.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.882+0000 7fa05effd700 1 -- 172.21.15.45:0/3665350614 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa0600cc830 msgr2=0x7fa0600ca780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:31.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.882+0000 7fa05effd700 1 --2- 172.21.15.45:0/3665350614 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa0600cc830 0x7fa0600ca780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:31.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.882+0000 7fa05effd700 1 -- 172.21.15.45:0/3665350614 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa048004850 msgr2=0x7fa06014d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:31.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.882+0000 7fa05effd700 1 --2- 172.21.15.45:0/3665350614 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa048004850 0x7fa06014d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:31.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.882+0000 7fa05effd700 1 -- 172.21.15.45:0/3665350614 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0600d1300 con 0x7fa0600cc3c0 2023-11-28T12:09:31.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.882+0000 7fa05effd700 1 --2- 172.21.15.45:0/3665350614 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0600cc3c0 0x7fa0600ca240 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fa054001eb0 tx=0x7fa054000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:31.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.882+0000 7fa047fff700 1 -- 172.21.15.45:0/3665350614 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa054007b90 con 0x7fa0600cc3c0 2023-11-28T12:09:31.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.882+0000 7fa047fff700 1 -- 172.21.15.45:0/3665350614 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa054004870 con 0x7fa0600cc3c0 2023-11-28T12:09:31.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.882+0000 7fa065dff700 1 -- 172.21.15.45:0/3665350614 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0600b5520 con 0x7fa0600cc3c0 2023-11-28T12:09:31.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.882+0000 7fa047fff700 1 -- 172.21.15.45:0/3665350614 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa054004c20 con 0x7fa0600cc3c0 2023-11-28T12:09:31.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.883+0000 7fa065dff700 1 -- 172.21.15.45:0/3665350614 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0600d15e0 con 0x7fa0600cc3c0 2023-11-28T12:09:31.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.883+0000 7fa065dff700 1 -- 172.21.15.45:0/3665350614 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0600745c0 con 0x7fa0600cc3c0 2023-11-28T12:09:31.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.884+0000 7fa047fff700 1 -- 172.21.15.45:0/3665350614 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fa054024030 con 0x7fa0600cc3c0 2023-11-28T12:09:31.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.885+0000 7fa047fff700 1 --2- 172.21.15.45:0/3665350614 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fa04c0682f0 0x7fa04c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:31.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.886+0000 7fa047fff700 1 -- 172.21.15.45:0/3665350614 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fa054086d60 con 0x7fa0600cc3c0 2023-11-28T12:09:31.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.886+0000 7fa05f7fe700 1 --2- 172.21.15.45:0/3665350614 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fa04c0682f0 0x7fa04c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:31.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.886+0000 7fa05f7fe700 1 --2- 172.21.15.45:0/3665350614 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fa04c0682f0 0x7fa04c06a7a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa0600cb370 tx=0x7fa050009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:31.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:31.889+0000 7fa047fff700 1 -- 172.21.15.45:0/3665350614 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fa054053820 con 0x7fa0600cc3c0 2023-11-28T12:09:32.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.094+0000 7fa065dff700 1 -- 172.21.15.45:0/3665350614 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa0600d08a0 con 0x7fa0600cc3c0 2023-11-28T12:09:32.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.094+0000 7fa047fff700 1 -- 172.21.15.45:0/3665350614 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v57) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa054056e40 con 0x7fa0600cc3c0 2023-11-28T12:09:32.095 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-11-28T12:09:32.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.097+0000 7fa065dff700 1 -- 172.21.15.45:0/3665350614 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fa04c0682f0 msgr2=0x7fa04c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:32.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.097+0000 7fa065dff700 1 --2- 172.21.15.45:0/3665350614 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fa04c0682f0 0x7fa04c06a7a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa0600cb370 tx=0x7fa050009210 comp rx=0 tx=0).stop 2023-11-28T12:09:32.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.097+0000 7fa065dff700 1 -- 172.21.15.45:0/3665350614 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0600cc3c0 msgr2=0x7fa0600ca240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:32.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.097+0000 7fa065dff700 1 --2- 172.21.15.45:0/3665350614 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0600cc3c0 0x7fa0600ca240 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fa054001eb0 tx=0x7fa054000fe0 comp rx=0 tx=0).stop 2023-11-28T12:09:32.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.097+0000 7fa065dff700 1 -- 172.21.15.45:0/3665350614 shutdown_connections 2023-11-28T12:09:32.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.097+0000 7fa065dff700 1 --2- 172.21.15.45:0/3665350614 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fa04c0682f0 0x7fa04c06a7a0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:32.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.097+0000 7fa065dff700 1 --2- 172.21.15.45:0/3665350614 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa048004850 0x7fa06014d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:32.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.097+0000 7fa065dff700 1 --2- 172.21.15.45:0/3665350614 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa0600cc830 0x7fa0600ca780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:32.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.097+0000 7fa065dff700 1 --2- 172.21.15.45:0/3665350614 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0600cc3c0 0x7fa0600ca240 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:32.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.097+0000 7fa065dff700 1 -- 172.21.15.45:0/3665350614 >> 172.21.15.45:0/3665350614 conn(0x7fa060072600 msgr2=0x7fa06015bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:32.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.097+0000 7fa065dff700 1 -- 172.21.15.45:0/3665350614 shutdown_connections 2023-11-28T12:09:32.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.097+0000 7fa065dff700 1 -- 172.21.15.45:0/3665350614 wait complete. 2023-11-28T12:09:32.116 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T12:09:32.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.322+0000 7fb250dff700 1 Processor -- start 2023-11-28T12:09:32.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.322+0000 7fb250dff700 1 -- start start 2023-11-28T12:09:32.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.323+0000 7fb250dff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb24c15c9b0 0x7fb24c0b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:32.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.323+0000 7fb250dff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb24c0d1950 con 0x7fb24c0cd7c0 2023-11-28T12:09:32.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.323+0000 7fb250dff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb24c0d24f0 con 0x7fb24c161340 2023-11-28T12:09:32.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.323+0000 7fb250dff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb24c0b5800 con 0x7fb24c15c9b0 2023-11-28T12:09:32.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.323+0000 7fb24a59c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb24c15c9b0 0x7fb24c0b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:32.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.323+0000 7fb24ad9d700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fb24c0cd7c0 0x7fb24c0b5fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:54828/0 (socket says 172.21.15.45:54828) 2023-11-28T12:09:32.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.323+0000 7fb24ad9d700 1 -- 172.21.15.45:0/3196407601 learned_addr learned my addr 172.21.15.45:0/3196407601 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:09:32.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.324+0000 7fb24a59c700 1 -- 172.21.15.45:0/3196407601 >> v1:172.21.15.152:6789/0 conn(0x7fb24c161340 legacy=0x7fb24c0d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:32.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.324+0000 7fb24a59c700 1 -- 172.21.15.45:0/3196407601 >> v1:172.21.15.45:6789/0 conn(0x7fb24c0cd7c0 legacy=0x7fb24c0b5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:32.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.324+0000 7fb24a59c700 1 -- 172.21.15.45:0/3196407601 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb24c0b5520 con 0x7fb24c15c9b0 2023-11-28T12:09:32.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.324+0000 7fb24959a700 1 -- 172.21.15.45:0/3196407601 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1812286841 0 0) 0x7fb24c0d1950 con 0x7fb24c0cd7c0 2023-11-28T12:09:32.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.324+0000 7fb24a59c700 1 --2- 172.21.15.45:0/3196407601 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb24c15c9b0 0x7fb24c0b4bf0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fb23c009840 tx=0x7fb23c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebc9927d4e3e1320 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:32.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.324+0000 7fb24959a700 1 -- 172.21.15.45:0/3196407601 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb23c011830 con 0x7fb24c15c9b0 2023-11-28T12:09:32.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.324+0000 7fb24959a700 1 -- 172.21.15.45:0/3196407601 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb23c011990 con 0x7fb24c15c9b0 2023-11-28T12:09:32.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.324+0000 7fb24959a700 1 -- 172.21.15.45:0/3196407601 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb23c011d20 con 0x7fb24c15c9b0 2023-11-28T12:09:32.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.325+0000 7fb250dff700 1 -- 172.21.15.45:0/3196407601 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb24c15c9b0 msgr2=0x7fb24c0b4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:32.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.325+0000 7fb250dff700 1 --2- 172.21.15.45:0/3196407601 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb24c15c9b0 0x7fb24c0b4bf0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fb23c009840 tx=0x7fb23c009b50 comp rx=0 tx=0).stop 2023-11-28T12:09:32.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.325+0000 7fb250dff700 1 -- 172.21.15.45:0/3196407601 shutdown_connections 2023-11-28T12:09:32.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.325+0000 7fb250dff700 1 --2- 172.21.15.45:0/3196407601 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb24c15c9b0 0x7fb24c0b4bf0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:32.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.325+0000 7fb250dff700 1 -- 172.21.15.45:0/3196407601 >> 172.21.15.45:0/3196407601 conn(0x7fb24c072600 msgr2=0x7fb24c0cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:32.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.325+0000 7fb250dff700 1 -- 172.21.15.45:0/3196407601 shutdown_connections 2023-11-28T12:09:32.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.325+0000 7fb250dff700 1 -- 172.21.15.45:0/3196407601 wait complete. 2023-11-28T12:09:32.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.327+0000 7fb250dff700 1 Processor -- start 2023-11-28T12:09:32.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.327+0000 7fb250dff700 1 -- start start 2023-11-28T12:09:32.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.328+0000 7fb250dff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb24c0cd7c0 0x7fb24c1f2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:32.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.328+0000 7fb250dff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb24c15c9b0 0x7fb24c0c92b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:32.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.328+0000 7fb250dff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb24c161340 0x7fb24c0c78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:32.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.328+0000 7fb250dff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb24c1f2eb0 con 0x7fb24c161340 2023-11-28T12:09:32.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.328+0000 7fb250dff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb24c0ca050 con 0x7fb24c0cd7c0 2023-11-28T12:09:32.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.328+0000 7fb250dff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb24c0c97f0 con 0x7fb24c15c9b0 2023-11-28T12:09:32.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.328+0000 7fb24ad9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb24c161340 0x7fb24c0c78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:32.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.328+0000 7fb24ad9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb24c161340 0x7fb24c0c78d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49666/0 (socket says 172.21.15.45:49666) 2023-11-28T12:09:32.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.328+0000 7fb24ad9d700 1 -- 172.21.15.45:0/1903053583 learned_addr learned my addr 172.21.15.45:0/1903053583 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:09:32.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.328+0000 7fb24a59c700 1 --2- 172.21.15.45:0/1903053583 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb24c0cd7c0 0x7fb24c1f2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:32.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.328+0000 7fb249d9b700 1 --2- 172.21.15.45:0/1903053583 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb24c15c9b0 0x7fb24c0c92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:32.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.329+0000 7fb24ad9d700 1 -- 172.21.15.45:0/1903053583 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb24c15c9b0 msgr2=0x7fb24c0c92b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:32.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.329+0000 7fb24ad9d700 1 --2- 172.21.15.45:0/1903053583 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb24c15c9b0 0x7fb24c0c92b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:32.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.329+0000 7fb24ad9d700 1 -- 172.21.15.45:0/1903053583 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb24c0cd7c0 msgr2=0x7fb24c1f2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:32.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.329+0000 7fb24ad9d700 1 --2- 172.21.15.45:0/1903053583 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb24c0cd7c0 0x7fb24c1f2970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:32.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.329+0000 7fb24ad9d700 1 -- 172.21.15.45:0/1903053583 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb23c0094a0 con 0x7fb24c161340 2023-11-28T12:09:32.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.329+0000 7fb24ad9d700 1 --2- 172.21.15.45:0/1903053583 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb24c161340 0x7fb24c0c78d0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fb24400cba0 tx=0x7fb24400ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:32.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.329+0000 7fb23affd700 1 -- 172.21.15.45:0/1903053583 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb24400aaa0 con 0x7fb24c161340 2023-11-28T12:09:32.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.329+0000 7fb23affd700 1 -- 172.21.15.45:0/1903053583 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb24400ac20 con 0x7fb24c161340 2023-11-28T12:09:32.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.329+0000 7fb250dff700 1 -- 172.21.15.45:0/1903053583 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb24c0d15e0 con 0x7fb24c161340 2023-11-28T12:09:32.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.329+0000 7fb23affd700 1 -- 172.21.15.45:0/1903053583 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2440070d0 con 0x7fb24c161340 2023-11-28T12:09:32.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.329+0000 7fb250dff700 1 -- 172.21.15.45:0/1903053583 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb24c0d1300 con 0x7fb24c161340 2023-11-28T12:09:32.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.330+0000 7fb250dff700 1 -- 172.21.15.45:0/1903053583 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb24c0b5130 con 0x7fb24c161340 2023-11-28T12:09:32.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.331+0000 7fb23affd700 1 -- 172.21.15.45:0/1903053583 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fb244010070 con 0x7fb24c161340 2023-11-28T12:09:32.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.332+0000 7fb23affd700 1 --2- 172.21.15.45:0/1903053583 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb22c0682f0 0x7fb22c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:32.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.332+0000 7fb23affd700 1 -- 172.21.15.45:0/1903053583 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fb244085380 con 0x7fb24c161340 2023-11-28T12:09:32.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.333+0000 7fb24a59c700 1 --2- 172.21.15.45:0/1903053583 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb22c0682f0 0x7fb22c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:32.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.333+0000 7fb24a59c700 1 --2- 172.21.15.45:0/1903053583 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb22c0682f0 0x7fb22c06a7a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb23c0090b0 tx=0x7fb23c01c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:32.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.336+0000 7fb23affd700 1 -- 172.21.15.45:0/1903053583 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fb244051e40 con 0x7fb24c161340 2023-11-28T12:09:32.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.536+0000 7fb250dff700 1 -- 172.21.15.45:0/1903053583 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb24c0745c0 con 0x7fb24c161340 2023-11-28T12:09:32.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.536+0000 7fb23affd700 1 -- 172.21.15.45:0/1903053583 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v57) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb2440180a0 con 0x7fb24c161340 2023-11-28T12:09:32.537 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-11-28T12:09:32.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.538+0000 7fb250dff700 1 -- 172.21.15.45:0/1903053583 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb22c0682f0 msgr2=0x7fb22c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:32.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.538+0000 7fb250dff700 1 --2- 172.21.15.45:0/1903053583 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb22c0682f0 0x7fb22c06a7a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb23c0090b0 tx=0x7fb23c01c040 comp rx=0 tx=0).stop 2023-11-28T12:09:32.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.538+0000 7fb250dff700 1 -- 172.21.15.45:0/1903053583 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb24c161340 msgr2=0x7fb24c0c78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:32.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.538+0000 7fb250dff700 1 --2- 172.21.15.45:0/1903053583 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb24c161340 0x7fb24c0c78d0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fb24400cba0 tx=0x7fb24400ceb0 comp rx=0 tx=0).stop 2023-11-28T12:09:32.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.538+0000 7fb250dff700 1 -- 172.21.15.45:0/1903053583 shutdown_connections 2023-11-28T12:09:32.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.538+0000 7fb250dff700 1 --2- 172.21.15.45:0/1903053583 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb22c0682f0 0x7fb22c06a7a0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:32.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.538+0000 7fb250dff700 1 --2- 172.21.15.45:0/1903053583 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb24c0cd7c0 0x7fb24c1f2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:32.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.538+0000 7fb250dff700 1 --2- 172.21.15.45:0/1903053583 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb24c161340 0x7fb24c0c78d0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:32.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.538+0000 7fb250dff700 1 --2- 172.21.15.45:0/1903053583 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb24c15c9b0 0x7fb24c0c92b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:32.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.538+0000 7fb250dff700 1 -- 172.21.15.45:0/1903053583 >> 172.21.15.45:0/1903053583 conn(0x7fb24c072600 msgr2=0x7fb24c15ab70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:32.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.538+0000 7fb250dff700 1 -- 172.21.15.45:0/1903053583 shutdown_connections 2023-11-28T12:09:32.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.538+0000 7fb250dff700 1 -- 172.21.15.45:0/1903053583 wait complete. 2023-11-28T12:09:32.557 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-28T12:09:32.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.760+0000 7fabd63ff700 1 Processor -- start 2023-11-28T12:09:32.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.760+0000 7fabd63ff700 1 -- start start 2023-11-28T12:09:32.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.761+0000 7fabd63ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fabd015c9b0 0x7fabd00b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:32.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.761+0000 7fabd63ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fabd0161340 0x7fabd00d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:32.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.761+0000 7fabd63ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabd00d1950 con 0x7fabd00d2320 2023-11-28T12:09:32.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.761+0000 7fabd63ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabd00b5800 con 0x7fabd0161340 2023-11-28T12:09:32.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.761+0000 7fabd63ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabd00b5520 con 0x7fabd015c9b0 2023-11-28T12:09:32.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.762+0000 7fabcf7fe700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fabd0161340 0x7fabd00d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:32.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.762+0000 7fabcffff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fabd015c9b0 0x7fabd00b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:32.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.762+0000 7fabcffff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fabd015c9b0 0x7fabd00b4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.45:43850/0 (socket says 172.21.15.45:43850) 2023-11-28T12:09:32.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.762+0000 7fabd499c700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fabd00d2320 0x7fabd00cd7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.45:41530/0 (socket says 172.21.15.45:41530) 2023-11-28T12:09:32.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.762+0000 7fabcffff700 1 -- 172.21.15.45:0/2620412626 learned_addr learned my addr 172.21.15.45:0/2620412626 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:09:32.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.762+0000 7fabcffff700 1 -- 172.21.15.45:0/2620412626 >> v2:172.21.15.152:3300/0 conn(0x7fabd0161340 msgr2=0x7fabd00d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:32.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.762+0000 7fabcffff700 1 --2- 172.21.15.45:0/2620412626 >> v2:172.21.15.152:3300/0 conn(0x7fabd0161340 0x7fabd00d1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:32.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.762+0000 7fabcffff700 1 -- 172.21.15.45:0/2620412626 >> v1:172.21.15.152:6789/0 conn(0x7fabd00d2320 legacy=0x7fabd00cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:32.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.762+0000 7fabcffff700 1 -- 172.21.15.45:0/2620412626 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabd00d1300 con 0x7fabd015c9b0 2023-11-28T12:09:32.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.762+0000 7fabcf7fe700 1 --2- 172.21.15.45:0/2620412626 >> v2:172.21.15.152:3300/0 conn(0x7fabd0161340 0x7fabd00d1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:09:32.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.763+0000 7fabcffff700 1 --2- 172.21.15.45:0/2620412626 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fabd015c9b0 0x7fabd00b4bf0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fabc00098f0 tx=0x7fabc0009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b6aa919a15d9db4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:32.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.763+0000 7fabceffd700 1 -- 172.21.15.45:0/2620412626 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc0011830 con 0x7fabd015c9b0 2023-11-28T12:09:32.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.763+0000 7fabceffd700 1 -- 172.21.15.45:0/2620412626 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabc0011990 con 0x7fabd015c9b0 2023-11-28T12:09:32.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.763+0000 7fabceffd700 1 -- 172.21.15.45:0/2620412626 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc0011d20 con 0x7fabd015c9b0 2023-11-28T12:09:32.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.764+0000 7fabd63ff700 1 -- 172.21.15.45:0/2620412626 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fabd015c9b0 msgr2=0x7fabd00b4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:32.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.764+0000 7fabd63ff700 1 --2- 172.21.15.45:0/2620412626 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fabd015c9b0 0x7fabd00b4bf0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fabc00098f0 tx=0x7fabc0009c00 comp rx=0 tx=0).stop 2023-11-28T12:09:32.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.764+0000 7fabd63ff700 1 -- 172.21.15.45:0/2620412626 shutdown_connections 2023-11-28T12:09:32.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.764+0000 7fabd63ff700 1 --2- 172.21.15.45:0/2620412626 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fabd015c9b0 0x7fabd00b4bf0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:32.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.764+0000 7fabd63ff700 1 --2- 172.21.15.45:0/2620412626 >> v2:172.21.15.152:3300/0 conn(0x7fabd0161340 0x7fabd00d1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:32.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.764+0000 7fabd63ff700 1 -- 172.21.15.45:0/2620412626 >> 172.21.15.45:0/2620412626 conn(0x7fabd0072600 msgr2=0x7fabd00cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:32.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.764+0000 7fabd63ff700 1 -- 172.21.15.45:0/2620412626 shutdown_connections 2023-11-28T12:09:32.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.764+0000 7fabd63ff700 1 -- 172.21.15.45:0/2620412626 wait complete. 2023-11-28T12:09:32.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.765+0000 7fabd63ff700 1 Processor -- start 2023-11-28T12:09:32.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.766+0000 7fabd63ff700 1 -- start start 2023-11-28T12:09:32.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.766+0000 7fabd63ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fabd00d2320 0x7fabd01465b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:32.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.767+0000 7fabd63ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fabd015c9b0 0x7fabd0157870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:32.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.767+0000 7fabd63ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fabd0161340 0x7fabd0155670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:32.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.767+0000 7fabd63ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabd0146af0 con 0x7fabd0161340 2023-11-28T12:09:32.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.767+0000 7fabd63ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabd0155050 con 0x7fabd015c9b0 2023-11-28T12:09:32.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.767+0000 7fabd63ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabd00c7010 con 0x7fabd00d2320 2023-11-28T12:09:32.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.767+0000 7fabd499c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fabd0161340 0x7fabd0155670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:32.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.767+0000 7fabd499c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fabd0161340 0x7fabd0155670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49668/0 (socket says 172.21.15.45:49668) 2023-11-28T12:09:32.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.767+0000 7fabd499c700 1 -- 172.21.15.45:0/76635286 learned_addr learned my addr 172.21.15.45:0/76635286 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:09:32.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.767+0000 7fabcffff700 1 --2- 172.21.15.45:0/76635286 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fabd00d2320 0x7fabd01465b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:32.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.767+0000 7fabcf7fe700 1 --2- 172.21.15.45:0/76635286 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fabd015c9b0 0x7fabd0157870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:32.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.767+0000 7fabd499c700 1 -- 172.21.15.45:0/76635286 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fabd00d2320 msgr2=0x7fabd01465b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:32.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.767+0000 7fabd499c700 1 --2- 172.21.15.45:0/76635286 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fabd00d2320 0x7fabd01465b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:32.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.767+0000 7fabd499c700 1 -- 172.21.15.45:0/76635286 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fabd015c9b0 msgr2=0x7fabd0157870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:32.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.767+0000 7fabd499c700 1 --2- 172.21.15.45:0/76635286 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fabd015c9b0 0x7fabd0157870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:32.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.767+0000 7fabd499c700 1 -- 172.21.15.45:0/76635286 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabc40094a0 con 0x7fabd0161340 2023-11-28T12:09:32.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.768+0000 7fabd499c700 1 --2- 172.21.15.45:0/76635286 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fabd0161340 0x7fabd0155670 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fabc800cbc0 tx=0x7fabc800ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:32.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.768+0000 7fabccff9700 1 -- 172.21.15.45:0/76635286 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc800a9e0 con 0x7fabd0161340 2023-11-28T12:09:32.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.768+0000 7fabccff9700 1 -- 172.21.15.45:0/76635286 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabc800ab40 con 0x7fabd0161340 2023-11-28T12:09:32.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.768+0000 7fabd63ff700 1 -- 172.21.15.45:0/76635286 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabc0009550 con 0x7fabd0161340 2023-11-28T12:09:32.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.768+0000 7fabccff9700 1 -- 172.21.15.45:0/76635286 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc8007070 con 0x7fabd0161340 2023-11-28T12:09:32.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.768+0000 7fabd63ff700 1 -- 172.21.15.45:0/76635286 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabd00b5130 con 0x7fabd0161340 2023-11-28T12:09:32.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.769+0000 7fabd63ff700 1 -- 172.21.15.45:0/76635286 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabd00d15e0 con 0x7fabd0161340 2023-11-28T12:09:32.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.770+0000 7fabccff9700 1 -- 172.21.15.45:0/76635286 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fabc8019030 con 0x7fabd0161340 2023-11-28T12:09:32.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.771+0000 7fabccff9700 1 --2- 172.21.15.45:0/76635286 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fabbc0682f0 0x7fabbc06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:32.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.771+0000 7fabccff9700 1 -- 172.21.15.45:0/76635286 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fabc8085470 con 0x7fabd0161340 2023-11-28T12:09:32.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.772+0000 7fabcffff700 1 --2- 172.21.15.45:0/76635286 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fabbc0682f0 0x7fabbc06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:32.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.772+0000 7fabcffff700 1 --2- 172.21.15.45:0/76635286 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fabbc0682f0 0x7fabbc06a7a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fabc0009c40 tx=0x7fabc0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:32.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.775+0000 7fabccff9700 1 -- 172.21.15.45:0/76635286 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fabc804b5e0 con 0x7fabd0161340 2023-11-28T12:09:32.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.980+0000 7fabd63ff700 1 -- 172.21.15.45:0/76635286 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fabd00b52c0 con 0x7fabd0161340 2023-11-28T12:09:32.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.981+0000 7fabccff9700 1 -- 172.21.15.45:0/76635286 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v57) v1 ==== 84+0+126 (secure 0 0 0) 0x7fabc8017090 con 0x7fabd0161340 2023-11-28T12:09:32.982 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:09:32.982 INFO:teuthology.orchestra.run.smithi045.stdout:[ 2023-11-28T12:09:32.982 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T12:09:32.982 INFO:teuthology.orchestra.run.smithi045.stdout: "poolnum": 1, 2023-11-28T12:09:32.982 INFO:teuthology.orchestra.run.smithi045.stdout: "poolname": "rbd" 2023-11-28T12:09:32.982 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T12:09:32.982 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T12:09:32.982 INFO:teuthology.orchestra.run.smithi045.stdout: "poolnum": 2, 2023-11-28T12:09:32.982 INFO:teuthology.orchestra.run.smithi045.stdout: "poolname": ".mgr" 2023-11-28T12:09:32.982 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T12:09:32.982 INFO:teuthology.orchestra.run.smithi045.stdout:] 2023-11-28T12:09:32.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.983+0000 7fabd63ff700 1 -- 172.21.15.45:0/76635286 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fabbc0682f0 msgr2=0x7fabbc06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:32.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.983+0000 7fabd63ff700 1 --2- 172.21.15.45:0/76635286 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fabbc0682f0 0x7fabbc06a7a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fabc0009c40 tx=0x7fabc0008030 comp rx=0 tx=0).stop 2023-11-28T12:09:32.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.983+0000 7fabd63ff700 1 -- 172.21.15.45:0/76635286 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fabd0161340 msgr2=0x7fabd0155670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:32.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.983+0000 7fabd63ff700 1 --2- 172.21.15.45:0/76635286 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fabd0161340 0x7fabd0155670 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fabc800cbc0 tx=0x7fabc800ced0 comp rx=0 tx=0).stop 2023-11-28T12:09:32.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.983+0000 7fabd63ff700 1 -- 172.21.15.45:0/76635286 shutdown_connections 2023-11-28T12:09:32.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.983+0000 7fabd63ff700 1 --2- 172.21.15.45:0/76635286 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fabbc0682f0 0x7fabbc06a7a0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:32.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.983+0000 7fabd63ff700 1 --2- 172.21.15.45:0/76635286 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fabd0161340 0x7fabd0155670 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:32.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.983+0000 7fabd63ff700 1 --2- 172.21.15.45:0/76635286 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fabd00d2320 0x7fabd01465b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:32.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.983+0000 7fabd63ff700 1 --2- 172.21.15.45:0/76635286 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fabd015c9b0 0x7fabd0157870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:32.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.983+0000 7fabd63ff700 1 -- 172.21.15.45:0/76635286 >> 172.21.15.45:0/76635286 conn(0x7fabd0072600 msgr2=0x7fabd015d070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:32.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.983+0000 7fabd63ff700 1 -- 172.21.15.45:0/76635286 shutdown_connections 2023-11-28T12:09:32.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:32.983+0000 7fabd63ff700 1 -- 172.21.15.45:0/76635286 wait complete. 2023-11-28T12:09:33.004 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-28T12:09:33.004 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-28T12:09:33.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:33.215+0000 7fbd7c5ff700 1 Processor -- start 2023-11-28T12:09:33.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:33.215+0000 7fbd7c5ff700 1 -- start start 2023-11-28T12:09:33.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:33.216+0000 7fbd7c5ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbd7415a760 0x7fbd74161200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:33.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:33.216+0000 7fbd7c5ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fbd740cded0 0x7fbd740b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:33.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:33.216+0000 7fbd7c5ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd7415e0a0 con 0x7fbd7415dc30 2023-11-28T12:09:33.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:33.216+0000 7fbd7c5ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd7415ab30 con 0x7fbd740cded0 2023-11-28T12:09:33.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:33.216+0000 7fbd7c5ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd74160d70 con 0x7fbd7415a760 2023-11-28T12:09:33.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:33.217+0000 7fbd7ab9c700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fbd740cded0 0x7fbd740b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:33.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:33.217+0000 7fbd7a39b700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbd7415a760 0x7fbd74161200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:33.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:33.217+0000 7fbd7ab9c700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fbd740cded0 0x7fbd740b4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.45:60674/0 (socket says 172.21.15.45:60674) 2023-11-28T12:09:33.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:33.217+0000 7fbd7ab9c700 1 -- 172.21.15.45:0/2217187552 learned_addr learned my addr 172.21.15.45:0/2217187552 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:09:33.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:33.217+0000 7fbd79b9a700 1 --1- 172.21.15.45:0/2217187552 >> v1:172.21.15.152:6789/0 conn(0x7fbd7415dc30 0x7fbd740cd7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.45:41534/0 (socket says 172.21.15.45:41534) 2023-11-28T12:09:33.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:33.217+0000 7fbd7ab9c700 1 -- 172.21.15.45:0/2217187552 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbd7415a760 msgr2=0x7fbd74161200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:33.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:33.217+0000 7fbd7ab9c700 1 --2- 172.21.15.45:0/2217187552 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbd7415a760 0x7fbd74161200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:33.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:33.217+0000 7fbd7ab9c700 1 -- 172.21.15.45:0/2217187552 >> v1:172.21.15.152:6789/0 conn(0x7fbd7415dc30 legacy=0x7fbd740cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:33.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:33.217+0000 7fbd7ab9c700 1 -- 172.21.15.45:0/2217187552 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd740b5130 con 0x7fbd740cded0 2023-11-28T12:09:33.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:33.217+0000 7fbd7ab9c700 1 --2- 172.21.15.45:0/2217187552 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd740cded0 0x7fbd740b4bf0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c009e50 tx=0x7fbd6c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98e63c390360fbdb server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:33.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:33.218+0000 7fbd79399700 1 -- 172.21.15.45:0/2217187552 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd6c00e070 con 0x7fbd740cded0 2023-11-28T12:09:33.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:33.218+0000 7fbd79399700 1 -- 172.21.15.45:0/2217187552 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd6c00b910 con 0x7fbd740cded0 2023-11-28T12:09:33.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:33.218+0000 7fbd79399700 1 -- 172.21.15.45:0/2217187552 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd6c00bcc0 con 0x7fbd740cded0 2023-11-28T12:09:33.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:33.218+0000 7fbd7c5ff700 1 -- 172.21.15.45:0/2217187552 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd740cded0 msgr2=0x7fbd740b4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:33.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:33.218+0000 7fbd7c5ff700 1 --2- 172.21.15.45:0/2217187552 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd740cded0 0x7fbd740b4bf0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c009e50 tx=0x7fbd6c00b330 comp rx=0 tx=0).stop 2023-11-28T12:09:33.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:33.218+0000 7fbd7c5ff700 1 -- 172.21.15.45:0/2217187552 shutdown_connections 2023-11-28T12:09:33.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:33.218+0000 7fbd7c5ff700 1 --2- 172.21.15.45:0/2217187552 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbd7415a760 0x7fbd74161200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:33.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:33.218+0000 7fbd7c5ff700 1 --2- 172.21.15.45:0/2217187552 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd740cded0 0x7fbd740b4bf0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:33.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:33.218+0000 7fbd7c5ff700 1 -- 172.21.15.45:0/2217187552 >> 172.21.15.45:0/2217187552 conn(0x7fbd74072620 msgr2=0x7fbd740cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:33.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:33.219+0000 7fbd7c5ff700 1 -- 172.21.15.45:0/2217187552 shutdown_connections 2023-11-28T12:09:33.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:33.219+0000 7fbd7c5ff700 1 -- 172.21.15.45:0/2217187552 wait complete. 2023-11-28T12:09:33.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:33.220+0000 7fbd7c5ff700 1 Processor -- start 2023-11-28T12:09:33.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:33.220+0000 7fbd7c5ff700 1 -- start start 2023-11-28T12:09:33.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:33.221+0000 7fbd7c5ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbd740cded0 0x7fbd740b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:33.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:33.221+0000 7fbd7c5ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd7415a760 0x7fbd741533d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:33.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:33.221+0000 7fbd7c5ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd7415dc30 0x7fbd7415b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:33.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:33.221+0000 7fbd7c5ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd7415c700 con 0x7fbd7415a760 2023-11-28T12:09:33.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:33.221+0000 7fbd7c5ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd740c6e40 con 0x7fbd7415dc30 2023-11-28T12:09:33.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:33.221+0000 7fbd7c5ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd7415bbc0 con 0x7fbd740cded0 2023-11-28T12:09:33.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:33.222+0000 7fbd79b9a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd7415a760 0x7fbd741533d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:33.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:33.222+0000 7fbd79b9a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd7415a760 0x7fbd741533d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49672/0 (socket says 172.21.15.45:49672) 2023-11-28T12:09:33.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:33.222+0000 7fbd79b9a700 1 -- 172.21.15.45:0/181604845 learned_addr learned my addr 172.21.15.45:0/181604845 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:09:33.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:33.222+0000 7fbd7a39b700 1 --2- 172.21.15.45:0/181604845 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbd740cded0 0x7fbd740b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:33.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:33.222+0000 7fbd7ab9c700 1 --2- 172.21.15.45:0/181604845 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd7415dc30 0x7fbd7415b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:33.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:33.222+0000 7fbd79b9a700 1 -- 172.21.15.45:0/181604845 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbd740cded0 msgr2=0x7fbd740b8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:33.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:33.222+0000 7fbd79b9a700 1 --2- 172.21.15.45:0/181604845 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbd740cded0 0x7fbd740b8b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:33.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:33.222+0000 7fbd79b9a700 1 -- 172.21.15.45:0/181604845 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd7415dc30 msgr2=0x7fbd7415b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:33.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:33.222+0000 7fbd79b9a700 1 --2- 172.21.15.45:0/181604845 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd7415dc30 0x7fbd7415b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:33.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:33.222+0000 7fbd79b9a700 1 -- 172.21.15.45:0/181604845 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd6c009b30 con 0x7fbd7415a760 2023-11-28T12:09:33.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:33.222+0000 7fbd79b9a700 1 --2- 172.21.15.45:0/181604845 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd7415a760 0x7fbd741533d0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fbd6400c500 tx=0x7fbd6400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:33.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:33.223+0000 7fbd6affd700 1 -- 172.21.15.45:0/181604845 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd64005cb0 con 0x7fbd7415a760 2023-11-28T12:09:33.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:33.223+0000 7fbd6affd700 1 -- 172.21.15.45:0/181604845 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd64005e10 con 0x7fbd7415a760 2023-11-28T12:09:33.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:33.223+0000 7fbd6affd700 1 -- 172.21.15.45:0/181604845 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd640072d0 con 0x7fbd7415a760 2023-11-28T12:09:33.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:33.223+0000 7fbd7c5ff700 1 -- 172.21.15.45:0/181604845 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd740b5670 con 0x7fbd7415a760 2023-11-28T12:09:33.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:33.223+0000 7fbd7c5ff700 1 -- 172.21.15.45:0/181604845 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd740b5390 con 0x7fbd7415a760 2023-11-28T12:09:33.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:33.224+0000 7fbd7c5ff700 1 -- 172.21.15.45:0/181604845 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd74160720 con 0x7fbd7415a760 2023-11-28T12:09:33.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:33.225+0000 7fbd6affd700 1 -- 172.21.15.45:0/181604845 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fbd64019030 con 0x7fbd7415a760 2023-11-28T12:09:33.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:33.226+0000 7fbd6affd700 1 --2- 172.21.15.45:0/181604845 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fbd580682f0 0x7fbd5806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:33.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:33.226+0000 7fbd6affd700 1 -- 172.21.15.45:0/181604845 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fbd64084ad0 con 0x7fbd7415a760 2023-11-28T12:09:33.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:33.227+0000 7fbd7a39b700 1 --2- 172.21.15.45:0/181604845 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fbd580682f0 0x7fbd5806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:33.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:33.227+0000 7fbd7a39b700 1 --2- 172.21.15.45:0/181604845 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fbd580682f0 0x7fbd5806a7a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fbd70009be0 tx=0x7fbd70009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:33.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:33.230+0000 7fbd6affd700 1 -- 172.21.15.45:0/181604845 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fbd6404b5e0 con 0x7fbd7415a760 2023-11-28T12:09:33.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:33.435+0000 7fbd7c5ff700 1 -- 172.21.15.45:0/181604845 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fbd7404e620 con 0x7fbd7415a760 2023-11-28T12:09:34.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:34.045+0000 7fbd6affd700 1 -- 172.21.15.45:0/181604845 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v58) v1 ==== 138+0+0 (secure 0 0 0) 0x7fbd64017020 con 0x7fbd7415a760 2023-11-28T12:09:34.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:34.048+0000 7fbd7c5ff700 1 -- 172.21.15.45:0/181604845 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fbd580682f0 msgr2=0x7fbd5806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:34.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:34.048+0000 7fbd7c5ff700 1 --2- 172.21.15.45:0/181604845 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fbd580682f0 0x7fbd5806a7a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fbd70009be0 tx=0x7fbd70009210 comp rx=0 tx=0).stop 2023-11-28T12:09:34.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:34.048+0000 7fbd7c5ff700 1 -- 172.21.15.45:0/181604845 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd7415a760 msgr2=0x7fbd741533d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:34.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:34.048+0000 7fbd7c5ff700 1 --2- 172.21.15.45:0/181604845 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd7415a760 0x7fbd741533d0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fbd6400c500 tx=0x7fbd6400c810 comp rx=0 tx=0).stop 2023-11-28T12:09:34.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:34.048+0000 7fbd7c5ff700 1 -- 172.21.15.45:0/181604845 shutdown_connections 2023-11-28T12:09:34.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:34.048+0000 7fbd7c5ff700 1 --2- 172.21.15.45:0/181604845 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fbd580682f0 0x7fbd5806a7a0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:34.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:34.048+0000 7fbd7c5ff700 1 --2- 172.21.15.45:0/181604845 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd7415dc30 0x7fbd7415b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:34.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:34.048+0000 7fbd7c5ff700 1 --2- 172.21.15.45:0/181604845 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbd740cded0 0x7fbd740b8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:34.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:34.048+0000 7fbd7c5ff700 1 --2- 172.21.15.45:0/181604845 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd7415a760 0x7fbd741533d0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:34.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:34.048+0000 7fbd7c5ff700 1 -- 172.21.15.45:0/181604845 >> 172.21.15.45:0/181604845 conn(0x7fbd74072620 msgr2=0x7fbd7415f6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:34.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:34.049+0000 7fbd7c5ff700 1 -- 172.21.15.45:0/181604845 shutdown_connections 2023-11-28T12:09:34.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:34.049+0000 7fbd7c5ff700 1 -- 172.21.15.45:0/181604845 wait complete. 2023-11-28T12:09:34.052 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' created 2023-11-28T12:09:34.078 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-28T12:09:34.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:34.292+0000 7f1dd25ff700 1 Processor -- start 2023-11-28T12:09:34.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:34.292+0000 7f1dd25ff700 1 -- start start 2023-11-28T12:09:34.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:34.293+0000 7f1dd25ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f1dcc161340 0x7f1dcc0d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:34.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:34.293+0000 7f1dd25ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dcc0d1950 con 0x7f1dcc15c9b0 2023-11-28T12:09:34.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:34.294+0000 7f1dd25ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dcc0b5520 con 0x7f1dcc0d2320 2023-11-28T12:09:34.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:34.294+0000 7f1dd25ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dcc0b5800 con 0x7f1dcc161340 2023-11-28T12:09:34.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:34.294+0000 7f1dcbfff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f1dcc15c9b0 0x7f1dcc0b4bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:54844/0 (socket says 172.21.15.45:54844) 2023-11-28T12:09:34.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:34.294+0000 7f1dcbfff700 1 -- 172.21.15.45:0/2062493320 learned_addr learned my addr 172.21.15.45:0/2062493320 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:09:34.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:34.294+0000 7f1dcb7fe700 1 --2- 172.21.15.45:0/2062493320 >> v2:172.21.15.152:3300/0 conn(0x7f1dcc161340 0x7f1dcc0d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:34.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:34.294+0000 7f1dcaffd700 1 -- 172.21.15.45:0/2062493320 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2913533296 0 0) 0x7f1dcc0d1950 con 0x7f1dcc15c9b0 2023-11-28T12:09:34.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:34.294+0000 7f1dcaffd700 1 -- 172.21.15.45:0/2062493320 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1db40035b0 con 0x7f1dcc15c9b0 2023-11-28T12:09:34.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:34.294+0000 7f1dcaffd700 1 -- 172.21.15.45:0/2062493320 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3371007870 0 0) 0x7f1dcc0b5520 con 0x7f1dcc0d2320 2023-11-28T12:09:34.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:34.294+0000 7f1dcaffd700 1 -- 172.21.15.45:0/2062493320 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1dcc0d1950 con 0x7f1dcc0d2320 2023-11-28T12:09:34.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:34.295+0000 7f1dcb7fe700 1 -- 172.21.15.45:0/2062493320 >> v1:172.21.15.152:6789/0 conn(0x7f1dcc0d2320 legacy=0x7f1dcc0cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:34.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:34.295+0000 7f1dcb7fe700 1 -- 172.21.15.45:0/2062493320 >> v1:172.21.15.45:6789/0 conn(0x7f1dcc15c9b0 legacy=0x7f1dcc0b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:34.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:34.295+0000 7f1dcb7fe700 1 -- 172.21.15.45:0/2062493320 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dcc0d1300 con 0x7f1dcc161340 2023-11-28T12:09:34.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:34.295+0000 7f1dcb7fe700 1 --2- 172.21.15.45:0/2062493320 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1dcc161340 0x7f1dcc0d1de0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f1dc0009840 tx=0x7f1dc0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dba788363924b50e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:34.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:34.295+0000 7f1dcaffd700 1 -- 172.21.15.45:0/2062493320 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc0011830 con 0x7f1dcc161340 2023-11-28T12:09:34.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:34.295+0000 7f1dcaffd700 1 -- 172.21.15.45:0/2062493320 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dc0011990 con 0x7f1dcc161340 2023-11-28T12:09:34.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:34.295+0000 7f1dcaffd700 1 -- 172.21.15.45:0/2062493320 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc0011d20 con 0x7f1dcc161340 2023-11-28T12:09:34.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:34.296+0000 7f1dd25ff700 1 -- 172.21.15.45:0/2062493320 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1dcc161340 msgr2=0x7f1dcc0d1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:34.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:34.296+0000 7f1dd25ff700 1 --2- 172.21.15.45:0/2062493320 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1dcc161340 0x7f1dcc0d1de0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f1dc0009840 tx=0x7f1dc0009b50 comp rx=0 tx=0).stop 2023-11-28T12:09:34.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:34.296+0000 7f1dd25ff700 1 -- 172.21.15.45:0/2062493320 shutdown_connections 2023-11-28T12:09:34.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:34.296+0000 7f1dd25ff700 1 --2- 172.21.15.45:0/2062493320 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1dcc161340 0x7f1dcc0d1de0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:34.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:34.296+0000 7f1dd25ff700 1 -- 172.21.15.45:0/2062493320 >> 172.21.15.45:0/2062493320 conn(0x7f1dcc072600 msgr2=0x7f1dcc0cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:34.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:34.296+0000 7f1dd25ff700 1 -- 172.21.15.45:0/2062493320 shutdown_connections 2023-11-28T12:09:34.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:34.296+0000 7f1dd25ff700 1 -- 172.21.15.45:0/2062493320 wait complete. 2023-11-28T12:09:34.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:34.298+0000 7f1dd25ff700 1 Processor -- start 2023-11-28T12:09:34.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:34.298+0000 7f1dd25ff700 1 -- start start 2023-11-28T12:09:34.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:34.299+0000 7f1dd25ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1dcc0d2320 0x7f1dcc157380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:34.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:34.299+0000 7f1dd25ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1dcc15c9b0 0x7f1dcc1e8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:34.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:34.299+0000 7f1dd25ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1dcc161340 0x7f1dcc1e6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:34.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:34.299+0000 7f1dd25ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dcc15e910 con 0x7f1dcc161340 2023-11-28T12:09:34.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:34.299+0000 7f1dd25ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dcc15d230 con 0x7f1dcc0d2320 2023-11-28T12:09:34.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:34.299+0000 7f1dd25ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dcc1e6760 con 0x7f1dcc15c9b0 2023-11-28T12:09:34.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:34.299+0000 7f1dd0b9c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1dcc161340 0x7f1dcc1e6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:34.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:34.299+0000 7f1dd0b9c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1dcc161340 0x7f1dcc1e6ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49688/0 (socket says 172.21.15.45:49688) 2023-11-28T12:09:34.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:34.299+0000 7f1dd0b9c700 1 -- 172.21.15.45:0/536063324 learned_addr learned my addr 172.21.15.45:0/536063324 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:09:34.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:34.299+0000 7f1dcbfff700 1 --2- 172.21.15.45:0/536063324 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1dcc0d2320 0x7f1dcc157380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:34.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:34.299+0000 7f1dcb7fe700 1 --2- 172.21.15.45:0/536063324 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1dcc15c9b0 0x7f1dcc1e8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:34.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:34.300+0000 7f1dd0b9c700 1 -- 172.21.15.45:0/536063324 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1dcc15c9b0 msgr2=0x7f1dcc1e8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:34.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:34.300+0000 7f1dd0b9c700 1 --2- 172.21.15.45:0/536063324 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1dcc15c9b0 0x7f1dcc1e8e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:34.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:34.300+0000 7f1dd0b9c700 1 -- 172.21.15.45:0/536063324 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1dcc0d2320 msgr2=0x7f1dcc157380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:34.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:34.300+0000 7f1dd0b9c700 1 --2- 172.21.15.45:0/536063324 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1dcc0d2320 0x7f1dcc157380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:34.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:34.300+0000 7f1dd0b9c700 1 -- 172.21.15.45:0/536063324 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dc00094a0 con 0x7f1dcc161340 2023-11-28T12:09:34.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:34.300+0000 7f1dd0b9c700 1 --2- 172.21.15.45:0/536063324 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1dcc161340 0x7f1dcc1e6ce0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f1dc400cc50 tx=0x7f1dc400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:34.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:34.300+0000 7f1dc8ff9700 1 -- 172.21.15.45:0/536063324 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc4003c00 con 0x7f1dcc161340 2023-11-28T12:09:34.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:34.300+0000 7f1dc8ff9700 1 -- 172.21.15.45:0/536063324 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dc4003d60 con 0x7f1dcc161340 2023-11-28T12:09:34.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:34.300+0000 7f1dc8ff9700 1 -- 172.21.15.45:0/536063324 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc400aab0 con 0x7f1dcc161340 2023-11-28T12:09:34.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:34.300+0000 7f1dd25ff700 1 -- 172.21.15.45:0/536063324 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dcc15cd80 con 0x7f1dcc161340 2023-11-28T12:09:34.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:34.300+0000 7f1dd25ff700 1 -- 172.21.15.45:0/536063324 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dcc0d15e0 con 0x7f1dcc161340 2023-11-28T12:09:34.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:34.301+0000 7f1dd25ff700 1 -- 172.21.15.45:0/536063324 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dcc15cf10 con 0x7f1dcc161340 2023-11-28T12:09:34.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:34.303+0000 7f1dc8ff9700 1 -- 172.21.15.45:0/536063324 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f1dc4010050 con 0x7f1dcc161340 2023-11-28T12:09:34.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:34.303+0000 7f1dc8ff9700 1 --2- 172.21.15.45:0/536063324 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f1db80682f0 0x7f1db806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:34.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:34.303+0000 7f1dc8ff9700 1 -- 172.21.15.45:0/536063324 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f1dc4085980 con 0x7f1dcc161340 2023-11-28T12:09:34.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:34.304+0000 7f1dcbfff700 1 --2- 172.21.15.45:0/536063324 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f1db80682f0 0x7f1db806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:34.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:34.305+0000 7f1dcbfff700 1 --2- 172.21.15.45:0/536063324 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f1db80682f0 0x7f1db806a7a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc007fd0 tx=0x7f1dbc007dc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:34.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:34.308+0000 7f1dc8ff9700 1 -- 172.21.15.45:0/536063324 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f1dc40523c0 con 0x7f1dcc161340 2023-11-28T12:09:34.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:34.510+0000 7f1dd25ff700 1 -- 172.21.15.45:0/536063324 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f1dcc0745c0 con 0x7f1dcc161340 2023-11-28T12:09:35.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.049+0000 7f1dc8ff9700 1 -- 172.21.15.45:0/536063324 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v59) v1 ==== 170+0+0 (secure 0 0 0) 0x7f1dc40559e0 con 0x7f1dcc161340 2023-11-28T12:09:35.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.054+0000 7f1dd25ff700 1 -- 172.21.15.45:0/536063324 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f1db80682f0 msgr2=0x7f1db806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:35.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.054+0000 7f1dd25ff700 1 --2- 172.21.15.45:0/536063324 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f1db80682f0 0x7f1db806a7a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc007fd0 tx=0x7f1dbc007dc0 comp rx=0 tx=0).stop 2023-11-28T12:09:35.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.054+0000 7f1dd25ff700 1 -- 172.21.15.45:0/536063324 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1dcc161340 msgr2=0x7f1dcc1e6ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:35.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.054+0000 7f1dd25ff700 1 --2- 172.21.15.45:0/536063324 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1dcc161340 0x7f1dcc1e6ce0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f1dc400cc50 tx=0x7f1dc400cf60 comp rx=0 tx=0).stop 2023-11-28T12:09:35.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.055+0000 7f1dd25ff700 1 -- 172.21.15.45:0/536063324 shutdown_connections 2023-11-28T12:09:35.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.055+0000 7f1dd25ff700 1 --2- 172.21.15.45:0/536063324 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f1db80682f0 0x7f1db806a7a0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:35.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.055+0000 7f1dd25ff700 1 --2- 172.21.15.45:0/536063324 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1dcc0d2320 0x7f1dcc157380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:35.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.055+0000 7f1dd25ff700 1 --2- 172.21.15.45:0/536063324 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1dcc161340 0x7f1dcc1e6ce0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:35.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.055+0000 7f1dd25ff700 1 --2- 172.21.15.45:0/536063324 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1dcc15c9b0 0x7f1dcc1e8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:35.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.055+0000 7f1dd25ff700 1 -- 172.21.15.45:0/536063324 >> 172.21.15.45:0/536063324 conn(0x7f1dcc072600 msgr2=0x7f1dcc0b5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:35.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.056+0000 7f1dd25ff700 1 -- 172.21.15.45:0/536063324 shutdown_connections 2023-11-28T12:09:35.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.056+0000 7f1dd25ff700 1 -- 172.21.15.45:0/536063324 wait complete. 2023-11-28T12:09:35.064 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' created 2023-11-28T12:09:35.092 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-28T12:09:35.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.300+0000 7ff8e09ff700 1 Processor -- start 2023-11-28T12:09:35.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.300+0000 7ff8e09ff700 1 -- start start 2023-11-28T12:09:35.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.302+0000 7ff8e09ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ff8dc0ce3c0 0x7ff8dc071530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:35.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.302+0000 7ff8e09ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff8dc0cbea0 0x7ff8dc06cde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:35.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.302+0000 7ff8e09ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8dc0cd2e0 con 0x7ff8dc15cd10 2023-11-28T12:09:35.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.302+0000 7ff8e09ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8dc0cf250 con 0x7ff8dc0cbea0 2023-11-28T12:09:35.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.302+0000 7ff8e09ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8dc15d0e0 con 0x7ff8dc0ce3c0 2023-11-28T12:09:35.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.302+0000 7ff8da59c700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ff8dc15cd10 0x7ff8dc0cdcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:54848/0 (socket says 172.21.15.45:54848) 2023-11-28T12:09:35.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.302+0000 7ff8da59c700 1 -- 172.21.15.45:0/1614996605 learned_addr learned my addr 172.21.15.45:0/1614996605 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:09:35.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.302+0000 7ff8dad9d700 1 --2- 172.21.15.45:0/1614996605 >> v2:172.21.15.45:3300/0 conn(0x7ff8dc0cbea0 0x7ff8dc06cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:35.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.302+0000 7ff8d3fff700 1 --2- 172.21.15.45:0/1614996605 >> v2:172.21.15.152:3300/0 conn(0x7ff8dc0ce3c0 0x7ff8dc071530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:35.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.302+0000 7ff8d9d9b700 1 -- 172.21.15.45:0/1614996605 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1265168115 0 0) 0x7ff8dc0cd2e0 con 0x7ff8dc15cd10 2023-11-28T12:09:35.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.302+0000 7ff8dad9d700 1 -- 172.21.15.45:0/1614996605 >> v2:172.21.15.152:3300/0 conn(0x7ff8dc0ce3c0 msgr2=0x7ff8dc071530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:35.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.303+0000 7ff8dad9d700 1 --2- 172.21.15.45:0/1614996605 >> v2:172.21.15.152:3300/0 conn(0x7ff8dc0ce3c0 0x7ff8dc071530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:35.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.303+0000 7ff8dad9d700 1 -- 172.21.15.45:0/1614996605 >> v1:172.21.15.45:6789/0 conn(0x7ff8dc15cd10 legacy=0x7ff8dc0cdcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:35.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.303+0000 7ff8dad9d700 1 -- 172.21.15.45:0/1614996605 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8dc0cc3f0 con 0x7ff8dc0cbea0 2023-11-28T12:09:35.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.303+0000 7ff8dad9d700 1 --2- 172.21.15.45:0/1614996605 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8dc0cbea0 0x7ff8dc06cde0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc0af8c0 tx=0x7ff8d400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f78c18443f015eb server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:35.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.303+0000 7ff8d9d9b700 1 -- 172.21.15.45:0/1614996605 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d400e070 con 0x7ff8dc0cbea0 2023-11-28T12:09:35.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.303+0000 7ff8d9d9b700 1 -- 172.21.15.45:0/1614996605 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8d400bbd0 con 0x7ff8dc0cbea0 2023-11-28T12:09:35.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.303+0000 7ff8d9d9b700 1 -- 172.21.15.45:0/1614996605 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d4012430 con 0x7ff8dc0cbea0 2023-11-28T12:09:35.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.303+0000 7ff8e09ff700 1 -- 172.21.15.45:0/1614996605 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8dc0cbea0 msgr2=0x7ff8dc06cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:35.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.303+0000 7ff8e09ff700 1 --2- 172.21.15.45:0/1614996605 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8dc0cbea0 0x7ff8dc06cde0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc0af8c0 tx=0x7ff8d400b330 comp rx=0 tx=0).stop 2023-11-28T12:09:35.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.304+0000 7ff8e09ff700 1 -- 172.21.15.45:0/1614996605 shutdown_connections 2023-11-28T12:09:35.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.304+0000 7ff8e09ff700 1 --2- 172.21.15.45:0/1614996605 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8dc0cbea0 0x7ff8dc06cde0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:35.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.304+0000 7ff8e09ff700 1 --2- 172.21.15.45:0/1614996605 >> v2:172.21.15.152:3300/0 conn(0x7ff8dc0ce3c0 0x7ff8dc071530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:35.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.304+0000 7ff8e09ff700 1 -- 172.21.15.45:0/1614996605 >> 172.21.15.45:0/1614996605 conn(0x7ff8dc06b380 msgr2=0x7ff8dc06b780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:35.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.304+0000 7ff8e09ff700 1 -- 172.21.15.45:0/1614996605 shutdown_connections 2023-11-28T12:09:35.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.304+0000 7ff8e09ff700 1 -- 172.21.15.45:0/1614996605 wait complete. 2023-11-28T12:09:35.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.305+0000 7ff8e09ff700 1 Processor -- start 2023-11-28T12:09:35.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.306+0000 7ff8e09ff700 1 -- start start 2023-11-28T12:09:35.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.307+0000 7ff8e09ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff8dc0cbea0 0x7ff8dc0b2330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:35.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.307+0000 7ff8e09ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8dc0ce3c0 0x7ff8dc15b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:35.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.307+0000 7ff8e09ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff8dc15cd10 0x7ff8dc0c3970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:35.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.307+0000 7ff8e09ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8dc15a250 con 0x7ff8dc0ce3c0 2023-11-28T12:09:35.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.307+0000 7ff8e09ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8dc15a4c0 con 0x7ff8dc0cbea0 2023-11-28T12:09:35.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.307+0000 7ff8e09ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8dc15a7a0 con 0x7ff8dc15cd10 2023-11-28T12:09:35.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.307+0000 7ff8d3fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8dc0ce3c0 0x7ff8dc15b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:35.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.307+0000 7ff8d3fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8dc0ce3c0 0x7ff8dc15b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49700/0 (socket says 172.21.15.45:49700) 2023-11-28T12:09:35.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.307+0000 7ff8d3fff700 1 -- 172.21.15.45:0/3288394202 learned_addr learned my addr 172.21.15.45:0/3288394202 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:09:35.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.307+0000 7ff8da59c700 1 --2- 172.21.15.45:0/3288394202 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff8dc0cbea0 0x7ff8dc0b2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:35.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.307+0000 7ff8dad9d700 1 --2- 172.21.15.45:0/3288394202 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff8dc15cd10 0x7ff8dc0c3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:35.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.307+0000 7ff8d3fff700 1 -- 172.21.15.45:0/3288394202 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff8dc15cd10 msgr2=0x7ff8dc0c3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:35.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.307+0000 7ff8d3fff700 1 --2- 172.21.15.45:0/3288394202 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff8dc15cd10 0x7ff8dc0c3970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:35.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.307+0000 7ff8d3fff700 1 -- 172.21.15.45:0/3288394202 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff8dc0cbea0 msgr2=0x7ff8dc0b2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:35.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.307+0000 7ff8d3fff700 1 --2- 172.21.15.45:0/3288394202 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff8dc0cbea0 0x7ff8dc0b2330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:35.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.307+0000 7ff8d3fff700 1 -- 172.21.15.45:0/3288394202 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8d4009a70 con 0x7ff8dc0ce3c0 2023-11-28T12:09:35.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.307+0000 7ff8da59c700 1 --2- 172.21.15.45:0/3288394202 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff8dc0cbea0 0x7ff8dc0b2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:09:35.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.308+0000 7ff8d3fff700 1 --2- 172.21.15.45:0/3288394202 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8dc0ce3c0 0x7ff8dc15b280 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7ff8c400e810 tx=0x7ff8c400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:35.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.308+0000 7ff8d2ffd700 1 -- 172.21.15.45:0/3288394202 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c4013610 con 0x7ff8dc0ce3c0 2023-11-28T12:09:35.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.308+0000 7ff8d2ffd700 1 -- 172.21.15.45:0/3288394202 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8c4013770 con 0x7ff8dc0ce3c0 2023-11-28T12:09:35.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.308+0000 7ff8e09ff700 1 -- 172.21.15.45:0/3288394202 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8dc0cc9b0 con 0x7ff8dc0ce3c0 2023-11-28T12:09:35.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.308+0000 7ff8d2ffd700 1 -- 172.21.15.45:0/3288394202 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c4013b00 con 0x7ff8dc0ce3c0 2023-11-28T12:09:35.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.308+0000 7ff8e09ff700 1 -- 172.21.15.45:0/3288394202 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8dc0cc6d0 con 0x7ff8dc0ce3c0 2023-11-28T12:09:35.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.309+0000 7ff8e09ff700 1 -- 172.21.15.45:0/3288394202 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8dc0ccc90 con 0x7ff8dc0ce3c0 2023-11-28T12:09:35.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.310+0000 7ff8d2ffd700 1 -- 172.21.15.45:0/3288394202 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7ff8c4023070 con 0x7ff8dc0ce3c0 2023-11-28T12:09:35.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.311+0000 7ff8d2ffd700 1 --2- 172.21.15.45:0/3288394202 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7ff8bc0682f0 0x7ff8bc06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:35.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.311+0000 7ff8d2ffd700 1 -- 172.21.15.45:0/3288394202 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5962+0+0 (secure 0 0 0) 0x7ff8c4085a10 con 0x7ff8dc0ce3c0 2023-11-28T12:09:35.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.312+0000 7ff8da59c700 1 --2- 172.21.15.45:0/3288394202 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7ff8bc0682f0 0x7ff8bc06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:35.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.312+0000 7ff8da59c700 1 --2- 172.21.15.45:0/3288394202 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7ff8bc0682f0 0x7ff8bc06a7a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ff8cc000f60 tx=0x7ff8cc007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:35.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.316+0000 7ff8d2ffd700 1 -- 172.21.15.45:0/3288394202 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7ff8c40521e0 con 0x7ff8dc0ce3c0 2023-11-28T12:09:35.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.570+0000 7ff8e09ff700 1 -- 172.21.15.45:0/3288394202 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7ff8dc0745c0 con 0x7ff8dc0ce3c0 2023-11-28T12:09:35.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.577+0000 7ff8d2ffd700 1 -- 172.21.15.45:0/3288394202 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 9 and data pool 10 v28) v1 ==== 173+0+0 (secure 0 0 0) 0x7ff8c4055800 con 0x7ff8dc0ce3c0 2023-11-28T12:09:35.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.584+0000 7ff8e09ff700 1 -- 172.21.15.45:0/3288394202 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7ff8bc0682f0 msgr2=0x7ff8bc06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:35.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.584+0000 7ff8e09ff700 1 --2- 172.21.15.45:0/3288394202 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7ff8bc0682f0 0x7ff8bc06a7a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ff8cc000f60 tx=0x7ff8cc007d30 comp rx=0 tx=0).stop 2023-11-28T12:09:35.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.584+0000 7ff8e09ff700 1 -- 172.21.15.45:0/3288394202 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8dc0ce3c0 msgr2=0x7ff8dc15b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:35.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.584+0000 7ff8e09ff700 1 --2- 172.21.15.45:0/3288394202 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8dc0ce3c0 0x7ff8dc15b280 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7ff8c400e810 tx=0x7ff8c400ebd0 comp rx=0 tx=0).stop 2023-11-28T12:09:35.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.585+0000 7ff8e09ff700 1 -- 172.21.15.45:0/3288394202 shutdown_connections 2023-11-28T12:09:35.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.585+0000 7ff8e09ff700 1 --2- 172.21.15.45:0/3288394202 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7ff8bc0682f0 0x7ff8bc06a7a0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:35.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.585+0000 7ff8e09ff700 1 --2- 172.21.15.45:0/3288394202 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff8dc0cbea0 0x7ff8dc0b2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:35.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.585+0000 7ff8e09ff700 1 --2- 172.21.15.45:0/3288394202 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff8dc15cd10 0x7ff8dc0c3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:35.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.585+0000 7ff8e09ff700 1 --2- 172.21.15.45:0/3288394202 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8dc0ce3c0 0x7ff8dc15b280 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:35.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.585+0000 7ff8e09ff700 1 -- 172.21.15.45:0/3288394202 >> 172.21.15.45:0/3288394202 conn(0x7ff8dc06b380 msgr2=0x7ff8dc06b750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:35.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.586+0000 7ff8e09ff700 1 -- 172.21.15.45:0/3288394202 shutdown_connections 2023-11-28T12:09:35.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.586+0000 7ff8e09ff700 1 -- 172.21.15.45:0/3288394202 wait complete. 2023-11-28T12:09:35.591 INFO:teuthology.orchestra.run.smithi045.stderr:new fs with metadata pool 9 and data pool 10 2023-11-28T12:09:35.618 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T12:09:35.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.821+0000 7fb23a7ff700 1 Processor -- start 2023-11-28T12:09:35.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.821+0000 7fb23a7ff700 1 -- start start 2023-11-28T12:09:35.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.822+0000 7fb23a7ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb234161340 0x7fb2340d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:35.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.822+0000 7fb23a7ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2340d1950 con 0x7fb2340d2320 2023-11-28T12:09:35.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.822+0000 7fb23a7ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2340b5520 con 0x7fb23415c9b0 2023-11-28T12:09:35.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.822+0000 7fb23a7ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2340b5800 con 0x7fb234161340 2023-11-28T12:09:35.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.822+0000 7fb2337fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb234161340 0x7fb2340d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:35.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.823+0000 7fb238d9c700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fb2340d2320 0x7fb2340cd7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:54862/0 (socket says 172.21.15.45:54862) 2023-11-28T12:09:35.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.823+0000 7fb238d9c700 1 -- 172.21.15.45:0/4269749297 learned_addr learned my addr 172.21.15.45:0/4269749297 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:09:35.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.823+0000 7fb2337fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb234161340 0x7fb2340d1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49706/0 (socket says 172.21.15.45:49706) 2023-11-28T12:09:35.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.823+0000 7fb2337fe700 1 -- 172.21.15.45:0/4269749297 >> v1:172.21.15.152:6789/0 conn(0x7fb23415c9b0 legacy=0x7fb2340b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:35.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.823+0000 7fb2337fe700 1 -- 172.21.15.45:0/4269749297 >> v1:172.21.15.45:6789/0 conn(0x7fb2340d2320 legacy=0x7fb2340cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:35.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.823+0000 7fb2337fe700 1 -- 172.21.15.45:0/4269749297 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2340d1300 con 0x7fb234161340 2023-11-28T12:09:35.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.823+0000 7fb232ffd700 1 -- 172.21.15.45:0/4269749297 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1371514984 0 0) 0x7fb2340d1950 con 0x7fb2340d2320 2023-11-28T12:09:35.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.823+0000 7fb2337fe700 1 --2- 172.21.15.45:0/4269749297 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb234161340 0x7fb2340d1de0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fb228009840 tx=0x7fb228009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfc26549280959c2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:35.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.824+0000 7fb232ffd700 1 -- 172.21.15.45:0/4269749297 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb228004230 con 0x7fb234161340 2023-11-28T12:09:35.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.824+0000 7fb232ffd700 1 -- 172.21.15.45:0/4269749297 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb228004390 con 0x7fb234161340 2023-11-28T12:09:35.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.824+0000 7fb232ffd700 1 -- 172.21.15.45:0/4269749297 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2280036a0 con 0x7fb234161340 2023-11-28T12:09:35.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.824+0000 7fb23a7ff700 1 -- 172.21.15.45:0/4269749297 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb234161340 msgr2=0x7fb2340d1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:35.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.824+0000 7fb23a7ff700 1 --2- 172.21.15.45:0/4269749297 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb234161340 0x7fb2340d1de0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fb228009840 tx=0x7fb228009b50 comp rx=0 tx=0).stop 2023-11-28T12:09:35.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.824+0000 7fb23a7ff700 1 -- 172.21.15.45:0/4269749297 shutdown_connections 2023-11-28T12:09:35.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.824+0000 7fb23a7ff700 1 --2- 172.21.15.45:0/4269749297 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb234161340 0x7fb2340d1de0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:35.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.824+0000 7fb23a7ff700 1 -- 172.21.15.45:0/4269749297 >> 172.21.15.45:0/4269749297 conn(0x7fb234072600 msgr2=0x7fb2340cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:35.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.824+0000 7fb23a7ff700 1 -- 172.21.15.45:0/4269749297 shutdown_connections 2023-11-28T12:09:35.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.824+0000 7fb23a7ff700 1 -- 172.21.15.45:0/4269749297 wait complete. 2023-11-28T12:09:35.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.826+0000 7fb23a7ff700 1 Processor -- start 2023-11-28T12:09:35.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.826+0000 7fb23a7ff700 1 -- start start 2023-11-28T12:09:35.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.827+0000 7fb23a7ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb2340d2320 0x7fb234157730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:35.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.827+0000 7fb23a7ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb23415c9b0 0x7fb2340c8e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:35.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.827+0000 7fb23a7ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb234161340 0x7fb2340c93b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:35.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.827+0000 7fb23a7ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2341f3400 con 0x7fb234161340 2023-11-28T12:09:35.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.827+0000 7fb23a7ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2341f3120 con 0x7fb2340d2320 2023-11-28T12:09:35.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.827+0000 7fb23a7ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb234145e60 con 0x7fb23415c9b0 2023-11-28T12:09:35.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.828+0000 7fb238d9c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb234161340 0x7fb2340c93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:35.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.828+0000 7fb238d9c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb234161340 0x7fb2340c93b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49710/0 (socket says 172.21.15.45:49710) 2023-11-28T12:09:35.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.828+0000 7fb238d9c700 1 -- 172.21.15.45:0/4118061430 learned_addr learned my addr 172.21.15.45:0/4118061430 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:09:35.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.828+0000 7fb233fff700 1 --2- 172.21.15.45:0/4118061430 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb2340d2320 0x7fb234157730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:35.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.828+0000 7fb2337fe700 1 --2- 172.21.15.45:0/4118061430 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb23415c9b0 0x7fb2340c8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:35.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.828+0000 7fb238d9c700 1 -- 172.21.15.45:0/4118061430 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb23415c9b0 msgr2=0x7fb2340c8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:35.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.828+0000 7fb238d9c700 1 --2- 172.21.15.45:0/4118061430 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb23415c9b0 0x7fb2340c8e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:35.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.828+0000 7fb238d9c700 1 -- 172.21.15.45:0/4118061430 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb2340d2320 msgr2=0x7fb234157730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:35.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.828+0000 7fb238d9c700 1 --2- 172.21.15.45:0/4118061430 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb2340d2320 0x7fb234157730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:35.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.828+0000 7fb238d9c700 1 -- 172.21.15.45:0/4118061430 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2280094a0 con 0x7fb234161340 2023-11-28T12:09:35.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.828+0000 7fb238d9c700 1 --2- 172.21.15.45:0/4118061430 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb234161340 0x7fb2340c93b0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fb22c00cb30 tx=0x7fb22c00ce40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:35.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.828+0000 7fb230ff9700 1 -- 172.21.15.45:0/4118061430 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb22c00a9e0 con 0x7fb234161340 2023-11-28T12:09:35.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.828+0000 7fb230ff9700 1 -- 172.21.15.45:0/4118061430 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb22c00ab80 con 0x7fb234161340 2023-11-28T12:09:35.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.828+0000 7fb23a7ff700 1 -- 172.21.15.45:0/4118061430 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb23415cd80 con 0x7fb234161340 2023-11-28T12:09:35.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.828+0000 7fb230ff9700 1 -- 172.21.15.45:0/4118061430 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb22c0070d0 con 0x7fb234161340 2023-11-28T12:09:35.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.829+0000 7fb23a7ff700 1 -- 172.21.15.45:0/4118061430 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2340d15e0 con 0x7fb234161340 2023-11-28T12:09:35.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.830+0000 7fb23a7ff700 1 -- 172.21.15.45:0/4118061430 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb23415cf10 con 0x7fb234161340 2023-11-28T12:09:35.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.831+0000 7fb230ff9700 1 -- 172.21.15.45:0/4118061430 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fb22c010070 con 0x7fb234161340 2023-11-28T12:09:35.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.832+0000 7fb230ff9700 1 --2- 172.21.15.45:0/4118061430 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb2200682f0 0x7fb22006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:35.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.832+0000 7fb230ff9700 1 -- 172.21.15.45:0/4118061430 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb22c085680 con 0x7fb234161340 2023-11-28T12:09:35.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.832+0000 7fb233fff700 1 --2- 172.21.15.45:0/4118061430 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb2200682f0 0x7fb22006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:35.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.833+0000 7fb233fff700 1 --2- 172.21.15.45:0/4118061430 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb2200682f0 0x7fb22006a7a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fb2340b6ab0 tx=0x7fb224007ec0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:35.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:35.836+0000 7fb230ff9700 1 -- 172.21.15.45:0/4118061430 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fb22c051df0 con 0x7fb234161340 2023-11-28T12:09:36.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.037+0000 7fb23a7ff700 1 -- 172.21.15.45:0/4118061430 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb234145cc0 con 0x7fb234161340 2023-11-28T12:09:36.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.038+0000 7fb230ff9700 1 -- 172.21.15.45:0/4118061430 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+17876 (secure 0 0 0) 0x7fb234145cc0 con 0x7fb234161340 2023-11-28T12:09:36.039 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:09:36.039 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":60,"fsid":"bd7c37f1-f7c6-4778-b845-52cf2aa6e366","created":"2023-11-28T12:06:09.045075+0000","modified":"2023-11-28T12:09:35.571480+0000","last_up_change":"2023-11-28T12:06:21.282227+0000","last_in_change":"2023-11-28T12:06:12.560924+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T12:06:21.807108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T12:06:22.491009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-11-28T12:09:33.476735+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-11-28T12:09:34.551527+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d0cdd8a-87fd-4f2c-91bd-47bdfa661905","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":115843},{"type":"v1","addr":"172.21.15.45:6808","nonce":115843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":115843},{"type":"v1","addr":"172.21.15.45:6811","nonce":115843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":115843},{"type":"v1","addr":"172.21.15.45:6815","nonce":115843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":115843},{"type":"v1","addr":"172.21.15.45:6813","nonce":115843}]},"public_addr":"172.21.15.45:6808/115843","cluster_addr":"172.21.15.45:6811/115843","heartbeat_back_addr":"172.21.15.45:6815/115843","heartbeat_front_addr":"172.21.15.45:6813/115843","state":["exists","up"]},{"osd":1,"uuid":"c5de4ebd-9ec5-40b3-9caa-9b706fab4c76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":115842},{"type":"v1","addr":"172.21.15.45:6801","nonce":115842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":115842},{"type":"v1","addr":"172.21.15.45:6803","nonce":115842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6807","nonce":115842},{"type":"v1","addr":"172.21.15.45:6809","nonce":115842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":115842},{"type":"v1","addr":"172.21.15.45:6805","nonce":115842}]},"public_addr":"172.21.15.45:6801/115842","cluster_addr":"172.21.15.45:6803/115842","heartbeat_back_addr":"172.21.15.45:6809/115842","heartbeat_front_addr":"172.21.15.45:6805/115842","state":["exists","up"]},{"osd":2,"uuid":"9f4b36b2-65d2-40e7-9fe6-a2991afa71c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":115850},{"type":"v1","addr":"172.21.15.45:6819","nonce":115850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":115850},{"type":"v1","addr":"172.21.15.45:6823","nonce":115850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":115850},{"type":"v1","addr":"172.21.15.45:6831","nonce":115850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":115850},{"type":"v1","addr":"172.21.15.45:6828","nonce":115850}]},"public_addr":"172.21.15.45:6819/115850","cluster_addr":"172.21.15.45:6823/115850","heartbeat_back_addr":"172.21.15.45:6831/115850","heartbeat_front_addr":"172.21.15.45:6828/115850","state":["exists","up"]},{"osd":3,"uuid":"6fe7ef05-4e0d-426c-bf94-44b51d4d550b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":115848},{"type":"v1","addr":"172.21.15.45:6818","nonce":115848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":115848},{"type":"v1","addr":"172.21.15.45:6822","nonce":115848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6827","nonce":115848},{"type":"v1","addr":"172.21.15.45:6829","nonce":115848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":115848},{"type":"v1","addr":"172.21.15.45:6825","nonce":115848}]},"public_addr":"172.21.15.45:6818/115848","cluster_addr":"172.21.15.45:6822/115848","heartbeat_back_addr":"172.21.15.45:6829/115848","heartbeat_front_addr":"172.21.15.45:6825/115848","state":["exists","up"]},{"osd":4,"uuid":"fa403c08-d8a1-4a3a-8384-cb465c1a654c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":116092},{"type":"v1","addr":"172.21.15.152:6801","nonce":116092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":116092},{"type":"v1","addr":"172.21.15.152:6803","nonce":116092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":116092},{"type":"v1","addr":"172.21.15.152:6807","nonce":116092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":116092},{"type":"v1","addr":"172.21.15.152:6805","nonce":116092}]},"public_addr":"172.21.15.152:6801/116092","cluster_addr":"172.21.15.152:6803/116092","heartbeat_back_addr":"172.21.15.152:6807/116092","heartbeat_front_addr":"172.21.15.152:6805/116092","state":["exists","up"]},{"osd":5,"uuid":"399fc450-39fa-43a6-bf80-0b8bcb41bd95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6815","nonce":116093},{"type":"v1","addr":"172.21.15.152:6817","nonce":116093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":116093},{"type":"v1","addr":"172.21.15.152:6819","nonce":116093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":116093},{"type":"v1","addr":"172.21.15.152:6823","nonce":116093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":116093},{"type":"v1","addr":"172.21.15.152:6821","nonce":116093}]},"public_addr":"172.21.15.152:6817/116093","cluster_addr":"172.21.15.152:6819/116093","heartbeat_back_addr":"172.21.15.152:6823/116093","heartbeat_front_addr":"172.21.15.152:6821/116093","state":["exists","up"]},{"osd":6,"uuid":"e59a4017-2d23-4627-836b-e25b2d3ddaaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":116094},{"type":"v1","addr":"172.21.15.152:6809","nonce":116094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":116094},{"type":"v1","addr":"172.21.15.152:6811","nonce":116094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":116094},{"type":"v1","addr":"172.21.15.152:6816","nonce":116094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":116094},{"type":"v1","addr":"172.21.15.152:6813","nonce":116094}]},"public_addr":"172.21.15.152:6809/116094","cluster_addr":"172.21.15.152:6811/116094","heartbeat_back_addr":"172.21.15.152:6816/116094","heartbeat_front_addr":"172.21.15.152:6813/116094","state":["exists","up"]},{"osd":7,"uuid":"8d7f9d4b-bf08-4670-8591-388c0f012a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":116097},{"type":"v1","addr":"172.21.15.152:6825","nonce":116097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":116097},{"type":"v1","addr":"172.21.15.152:6827","nonce":116097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":116097},{"type":"v1","addr":"172.21.15.152:6831","nonce":116097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":116097},{"type":"v1","addr":"172.21.15.152:6829","nonce":116097}]},"public_addr":"172.21.15.152:6825/116097","cluster_addr":"172.21.15.152:6827/116097","heartbeat_back_addr":"172.21.15.152:6831/116097","heartbeat_front_addr":"172.21.15.152:6829/116097","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.937710+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.865423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.159434+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.913090+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.131647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.966255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.972583+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.177209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T12:09:36.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.040+0000 7fb23a7ff700 1 -- 172.21.15.45:0/4118061430 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb2200682f0 msgr2=0x7fb22006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:36.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.040+0000 7fb23a7ff700 1 --2- 172.21.15.45:0/4118061430 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb2200682f0 0x7fb22006a7a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fb2340b6ab0 tx=0x7fb224007ec0 comp rx=0 tx=0).stop 2023-11-28T12:09:36.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.040+0000 7fb23a7ff700 1 -- 172.21.15.45:0/4118061430 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb234161340 msgr2=0x7fb2340c93b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:36.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.040+0000 7fb23a7ff700 1 --2- 172.21.15.45:0/4118061430 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb234161340 0x7fb2340c93b0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fb22c00cb30 tx=0x7fb22c00ce40 comp rx=0 tx=0).stop 2023-11-28T12:09:36.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.040+0000 7fb23a7ff700 1 -- 172.21.15.45:0/4118061430 shutdown_connections 2023-11-28T12:09:36.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.040+0000 7fb23a7ff700 1 --2- 172.21.15.45:0/4118061430 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb2200682f0 0x7fb22006a7a0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:36.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.040+0000 7fb23a7ff700 1 --2- 172.21.15.45:0/4118061430 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb2340d2320 0x7fb234157730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:36.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.040+0000 7fb23a7ff700 1 --2- 172.21.15.45:0/4118061430 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb234161340 0x7fb2340c93b0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:36.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.040+0000 7fb23a7ff700 1 --2- 172.21.15.45:0/4118061430 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb23415c9b0 0x7fb2340c8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:36.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.040+0000 7fb23a7ff700 1 -- 172.21.15.45:0/4118061430 >> 172.21.15.45:0/4118061430 conn(0x7fb234072600 msgr2=0x7fb23406a900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:36.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.041+0000 7fb23a7ff700 1 -- 172.21.15.45:0/4118061430 shutdown_connections 2023-11-28T12:09:36.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.041+0000 7fb23a7ff700 1 -- 172.21.15.45:0/4118061430 wait complete. 2023-11-28T12:09:36.060 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T12:09:36.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.264+0000 7f086a5ff700 1 Processor -- start 2023-11-28T12:09:36.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.264+0000 7f086a5ff700 1 -- start start 2023-11-28T12:09:36.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.265+0000 7f086a5ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0864161340 0x7f08640d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:36.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.265+0000 7f086a5ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f08640d2320 0x7f08640cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:36.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.265+0000 7f086a5ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08640d1950 con 0x7f086415c9b0 2023-11-28T12:09:36.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.265+0000 7f086a5ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08640b5800 con 0x7f0864161340 2023-11-28T12:09:36.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.265+0000 7f086a5ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08640b5300 con 0x7f08640d2320 2023-11-28T12:09:36.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.266+0000 7f0863fff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f086415c9b0 0x7f08640b4bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:54870/0 (socket says 172.21.15.45:54870) 2023-11-28T12:09:36.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.266+0000 7f0863fff700 1 -- 172.21.15.45:0/2400265918 learned_addr learned my addr 172.21.15.45:0/2400265918 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:09:36.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.266+0000 7f08637fe700 1 --2- 172.21.15.45:0/2400265918 >> v2:172.21.15.45:3300/0 conn(0x7f0864161340 0x7f08640d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:36.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.266+0000 7f08637fe700 1 -- 172.21.15.45:0/2400265918 >> v2:172.21.15.152:3300/0 conn(0x7f08640d2320 msgr2=0x7f08640cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:36.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.266+0000 7f0868b9c700 1 --2- 172.21.15.45:0/2400265918 >> v2:172.21.15.152:3300/0 conn(0x7f08640d2320 0x7f08640cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:36.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.266+0000 7f0862ffd700 1 -- 172.21.15.45:0/2400265918 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1481330833 0 0) 0x7f08640d1950 con 0x7f086415c9b0 2023-11-28T12:09:36.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.266+0000 7f08637fe700 1 --2- 172.21.15.45:0/2400265918 >> v2:172.21.15.152:3300/0 conn(0x7f08640d2320 0x7f08640cd7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:36.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.266+0000 7f08637fe700 1 -- 172.21.15.45:0/2400265918 >> v1:172.21.15.45:6789/0 conn(0x7f086415c9b0 legacy=0x7f08640b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:36.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.266+0000 7f08637fe700 1 -- 172.21.15.45:0/2400265918 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08640b5520 con 0x7f0864161340 2023-11-28T12:09:36.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.266+0000 7f08637fe700 1 --2- 172.21.15.45:0/2400265918 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0864161340 0x7f08640d1de0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f086406c170 tx=0x7f0858009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c8d291e5cdada08 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:36.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.267+0000 7f0862ffd700 1 -- 172.21.15.45:0/2400265918 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0858011830 con 0x7f0864161340 2023-11-28T12:09:36.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.267+0000 7f0862ffd700 1 -- 172.21.15.45:0/2400265918 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0858011990 con 0x7f0864161340 2023-11-28T12:09:36.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.267+0000 7f0862ffd700 1 -- 172.21.15.45:0/2400265918 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0858011d20 con 0x7f0864161340 2023-11-28T12:09:36.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.267+0000 7f086a5ff700 1 -- 172.21.15.45:0/2400265918 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0864161340 msgr2=0x7f08640d1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:36.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.267+0000 7f086a5ff700 1 --2- 172.21.15.45:0/2400265918 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0864161340 0x7f08640d1de0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f086406c170 tx=0x7f0858009b50 comp rx=0 tx=0).stop 2023-11-28T12:09:36.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.267+0000 7f086a5ff700 1 -- 172.21.15.45:0/2400265918 shutdown_connections 2023-11-28T12:09:36.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.267+0000 7f086a5ff700 1 --2- 172.21.15.45:0/2400265918 >> v2:172.21.15.152:3300/0 conn(0x7f08640d2320 0x7f08640cd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:36.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.267+0000 7f086a5ff700 1 --2- 172.21.15.45:0/2400265918 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0864161340 0x7f08640d1de0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:36.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.267+0000 7f086a5ff700 1 -- 172.21.15.45:0/2400265918 >> 172.21.15.45:0/2400265918 conn(0x7f0864072600 msgr2=0x7f08640cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:36.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.267+0000 7f086a5ff700 1 -- 172.21.15.45:0/2400265918 shutdown_connections 2023-11-28T12:09:36.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.267+0000 7f086a5ff700 1 -- 172.21.15.45:0/2400265918 wait complete. 2023-11-28T12:09:36.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.269+0000 7f086a5ff700 1 Processor -- start 2023-11-28T12:09:36.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.269+0000 7f086a5ff700 1 -- start start 2023-11-28T12:09:36.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.270+0000 7f086a5ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08640d2320 0x7f08641e6460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:36.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.270+0000 7f086a5ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f086415c9b0 0x7f0864156b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:36.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.270+0000 7f086a5ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0864161340 0x7f086406a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:36.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.270+0000 7f086a5ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08641f2590 con 0x7f08640d2320 2023-11-28T12:09:36.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.270+0000 7f086a5ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08641e6af0 con 0x7f0864161340 2023-11-28T12:09:36.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.270+0000 7f086a5ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08641e6dd0 con 0x7f086415c9b0 2023-11-28T12:09:36.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.270+0000 7f0863fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08640d2320 0x7f08641e6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:36.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.270+0000 7f0863fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08640d2320 0x7f08641e6460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49728/0 (socket says 172.21.15.45:49728) 2023-11-28T12:09:36.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.270+0000 7f0863fff700 1 -- 172.21.15.45:0/2222452193 learned_addr learned my addr 172.21.15.45:0/2222452193 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:09:36.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.271+0000 7f0868b9c700 1 --2- 172.21.15.45:0/2222452193 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0864161340 0x7f086406a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:36.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.271+0000 7f08637fe700 1 --2- 172.21.15.45:0/2222452193 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f086415c9b0 0x7f0864156b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:36.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.271+0000 7f0863fff700 1 -- 172.21.15.45:0/2222452193 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f086415c9b0 msgr2=0x7f0864156b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:36.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.271+0000 7f0863fff700 1 --2- 172.21.15.45:0/2222452193 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f086415c9b0 0x7f0864156b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:36.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.271+0000 7f0863fff700 1 -- 172.21.15.45:0/2222452193 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0864161340 msgr2=0x7f086406a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:36.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.271+0000 7f0863fff700 1 --2- 172.21.15.45:0/2222452193 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0864161340 0x7f086406a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:36.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.271+0000 7f0863fff700 1 -- 172.21.15.45:0/2222452193 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08580094a0 con 0x7f08640d2320 2023-11-28T12:09:36.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.271+0000 7f08637fe700 1 --2- 172.21.15.45:0/2222452193 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f086415c9b0 0x7f0864156b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:09:36.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.271+0000 7f0868b9c700 1 --2- 172.21.15.45:0/2222452193 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0864161340 0x7f086406a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:09:36.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.271+0000 7f0863fff700 1 --2- 172.21.15.45:0/2222452193 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08640d2320 0x7f08641e6460 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f085400c550 tx=0x7f085400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:36.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.271+0000 7f0860ff9700 1 -- 172.21.15.45:0/2222452193 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0854004c80 con 0x7f08640d2320 2023-11-28T12:09:36.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.271+0000 7f0860ff9700 1 -- 172.21.15.45:0/2222452193 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0854004e00 con 0x7f08640d2320 2023-11-28T12:09:36.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.271+0000 7f0860ff9700 1 -- 172.21.15.45:0/2222452193 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0854007310 con 0x7f08640d2320 2023-11-28T12:09:36.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.271+0000 7f086a5ff700 1 -- 172.21.15.45:0/2222452193 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08640d15e0 con 0x7f08640d2320 2023-11-28T12:09:36.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.272+0000 7f086a5ff700 1 -- 172.21.15.45:0/2222452193 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08640d1300 con 0x7f08640d2320 2023-11-28T12:09:36.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.273+0000 7f086a5ff700 1 -- 172.21.15.45:0/2222452193 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f086415cd80 con 0x7f08640d2320 2023-11-28T12:09:36.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.273+0000 7f0860ff9700 1 -- 172.21.15.45:0/2222452193 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f085401a020 con 0x7f08640d2320 2023-11-28T12:09:36.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.274+0000 7f0860ff9700 1 --2- 172.21.15.45:0/2222452193 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f08500682f0 0x7f085006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:36.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.274+0000 7f0860ff9700 1 -- 172.21.15.45:0/2222452193 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0854085930 con 0x7f08640d2320 2023-11-28T12:09:36.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.275+0000 7f08637fe700 1 --2- 172.21.15.45:0/2222452193 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f08500682f0 0x7f085006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:36.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.275+0000 7f08637fe700 1 --2- 172.21.15.45:0/2222452193 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f08500682f0 0x7f085006a7a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f08580097c0 tx=0x7f0858008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:36.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.278+0000 7f0860ff9700 1 -- 172.21.15.45:0/2222452193 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f0854052150 con 0x7f08640d2320 2023-11-28T12:09:36.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.483+0000 7f086a5ff700 1 -- 172.21.15.45:0/2222452193 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f08641e72c0 con 0x7f08640d2320 2023-11-28T12:09:36.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.484+0000 7f0860ff9700 1 -- 172.21.15.45:0/2222452193 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+17876 (secure 0 0 0) 0x7f0854055770 con 0x7f08640d2320 2023-11-28T12:09:36.485 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:09:36.485 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":60,"fsid":"bd7c37f1-f7c6-4778-b845-52cf2aa6e366","created":"2023-11-28T12:06:09.045075+0000","modified":"2023-11-28T12:09:35.571480+0000","last_up_change":"2023-11-28T12:06:21.282227+0000","last_in_change":"2023-11-28T12:06:12.560924+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T12:06:21.807108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T12:06:22.491009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-11-28T12:09:33.476735+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-11-28T12:09:34.551527+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d0cdd8a-87fd-4f2c-91bd-47bdfa661905","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":115843},{"type":"v1","addr":"172.21.15.45:6808","nonce":115843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":115843},{"type":"v1","addr":"172.21.15.45:6811","nonce":115843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":115843},{"type":"v1","addr":"172.21.15.45:6815","nonce":115843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":115843},{"type":"v1","addr":"172.21.15.45:6813","nonce":115843}]},"public_addr":"172.21.15.45:6808/115843","cluster_addr":"172.21.15.45:6811/115843","heartbeat_back_addr":"172.21.15.45:6815/115843","heartbeat_front_addr":"172.21.15.45:6813/115843","state":["exists","up"]},{"osd":1,"uuid":"c5de4ebd-9ec5-40b3-9caa-9b706fab4c76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":115842},{"type":"v1","addr":"172.21.15.45:6801","nonce":115842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":115842},{"type":"v1","addr":"172.21.15.45:6803","nonce":115842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6807","nonce":115842},{"type":"v1","addr":"172.21.15.45:6809","nonce":115842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":115842},{"type":"v1","addr":"172.21.15.45:6805","nonce":115842}]},"public_addr":"172.21.15.45:6801/115842","cluster_addr":"172.21.15.45:6803/115842","heartbeat_back_addr":"172.21.15.45:6809/115842","heartbeat_front_addr":"172.21.15.45:6805/115842","state":["exists","up"]},{"osd":2,"uuid":"9f4b36b2-65d2-40e7-9fe6-a2991afa71c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":115850},{"type":"v1","addr":"172.21.15.45:6819","nonce":115850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":115850},{"type":"v1","addr":"172.21.15.45:6823","nonce":115850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":115850},{"type":"v1","addr":"172.21.15.45:6831","nonce":115850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":115850},{"type":"v1","addr":"172.21.15.45:6828","nonce":115850}]},"public_addr":"172.21.15.45:6819/115850","cluster_addr":"172.21.15.45:6823/115850","heartbeat_back_addr":"172.21.15.45:6831/115850","heartbeat_front_addr":"172.21.15.45:6828/115850","state":["exists","up"]},{"osd":3,"uuid":"6fe7ef05-4e0d-426c-bf94-44b51d4d550b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":115848},{"type":"v1","addr":"172.21.15.45:6818","nonce":115848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":115848},{"type":"v1","addr":"172.21.15.45:6822","nonce":115848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6827","nonce":115848},{"type":"v1","addr":"172.21.15.45:6829","nonce":115848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":115848},{"type":"v1","addr":"172.21.15.45:6825","nonce":115848}]},"public_addr":"172.21.15.45:6818/115848","cluster_addr":"172.21.15.45:6822/115848","heartbeat_back_addr":"172.21.15.45:6829/115848","heartbeat_front_addr":"172.21.15.45:6825/115848","state":["exists","up"]},{"osd":4,"uuid":"fa403c08-d8a1-4a3a-8384-cb465c1a654c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":116092},{"type":"v1","addr":"172.21.15.152:6801","nonce":116092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":116092},{"type":"v1","addr":"172.21.15.152:6803","nonce":116092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":116092},{"type":"v1","addr":"172.21.15.152:6807","nonce":116092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":116092},{"type":"v1","addr":"172.21.15.152:6805","nonce":116092}]},"public_addr":"172.21.15.152:6801/116092","cluster_addr":"172.21.15.152:6803/116092","heartbeat_back_addr":"172.21.15.152:6807/116092","heartbeat_front_addr":"172.21.15.152:6805/116092","state":["exists","up"]},{"osd":5,"uuid":"399fc450-39fa-43a6-bf80-0b8bcb41bd95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6815","nonce":116093},{"type":"v1","addr":"172.21.15.152:6817","nonce":116093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":116093},{"type":"v1","addr":"172.21.15.152:6819","nonce":116093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":116093},{"type":"v1","addr":"172.21.15.152:6823","nonce":116093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":116093},{"type":"v1","addr":"172.21.15.152:6821","nonce":116093}]},"public_addr":"172.21.15.152:6817/116093","cluster_addr":"172.21.15.152:6819/116093","heartbeat_back_addr":"172.21.15.152:6823/116093","heartbeat_front_addr":"172.21.15.152:6821/116093","state":["exists","up"]},{"osd":6,"uuid":"e59a4017-2d23-4627-836b-e25b2d3ddaaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":116094},{"type":"v1","addr":"172.21.15.152:6809","nonce":116094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":116094},{"type":"v1","addr":"172.21.15.152:6811","nonce":116094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":116094},{"type":"v1","addr":"172.21.15.152:6816","nonce":116094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":116094},{"type":"v1","addr":"172.21.15.152:6813","nonce":116094}]},"public_addr":"172.21.15.152:6809/116094","cluster_addr":"172.21.15.152:6811/116094","heartbeat_back_addr":"172.21.15.152:6816/116094","heartbeat_front_addr":"172.21.15.152:6813/116094","state":["exists","up"]},{"osd":7,"uuid":"8d7f9d4b-bf08-4670-8591-388c0f012a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":116097},{"type":"v1","addr":"172.21.15.152:6825","nonce":116097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":116097},{"type":"v1","addr":"172.21.15.152:6827","nonce":116097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":116097},{"type":"v1","addr":"172.21.15.152:6831","nonce":116097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":116097},{"type":"v1","addr":"172.21.15.152:6829","nonce":116097}]},"public_addr":"172.21.15.152:6825/116097","cluster_addr":"172.21.15.152:6827/116097","heartbeat_back_addr":"172.21.15.152:6831/116097","heartbeat_front_addr":"172.21.15.152:6829/116097","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.937710+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.865423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.159434+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.913090+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.131647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.966255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.972583+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.177209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T12:09:36.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.486+0000 7f086a5ff700 1 -- 172.21.15.45:0/2222452193 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f08500682f0 msgr2=0x7f085006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:36.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.486+0000 7f086a5ff700 1 --2- 172.21.15.45:0/2222452193 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f08500682f0 0x7f085006a7a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f08580097c0 tx=0x7f0858008030 comp rx=0 tx=0).stop 2023-11-28T12:09:36.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.486+0000 7f086a5ff700 1 -- 172.21.15.45:0/2222452193 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08640d2320 msgr2=0x7f08641e6460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:36.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.486+0000 7f086a5ff700 1 --2- 172.21.15.45:0/2222452193 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08640d2320 0x7f08641e6460 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f085400c550 tx=0x7f085400c910 comp rx=0 tx=0).stop 2023-11-28T12:09:36.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.486+0000 7f086a5ff700 1 -- 172.21.15.45:0/2222452193 shutdown_connections 2023-11-28T12:09:36.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.486+0000 7f086a5ff700 1 --2- 172.21.15.45:0/2222452193 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f08500682f0 0x7f085006a7a0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:36.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.486+0000 7f086a5ff700 1 --2- 172.21.15.45:0/2222452193 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0864161340 0x7f086406a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:36.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.486+0000 7f086a5ff700 1 --2- 172.21.15.45:0/2222452193 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08640d2320 0x7f08641e6460 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:36.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.486+0000 7f086a5ff700 1 --2- 172.21.15.45:0/2222452193 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f086415c9b0 0x7f0864156b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:36.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.486+0000 7f086a5ff700 1 -- 172.21.15.45:0/2222452193 >> 172.21.15.45:0/2222452193 conn(0x7f0864072600 msgr2=0x7f08640b6010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:36.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.486+0000 7f086a5ff700 1 -- 172.21.15.45:0/2222452193 shutdown_connections 2023-11-28T12:09:36.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.486+0000 7f086a5ff700 1 -- 172.21.15.45:0/2222452193 wait complete. 2023-11-28T12:09:36.506 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-28T12:09:36.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.715+0000 7fadf1fff700 1 Processor -- start 2023-11-28T12:09:36.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.715+0000 7fadf1fff700 1 -- start start 2023-11-28T12:09:36.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.716+0000 7fadf1fff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fadec161340 0x7fadec0d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:36.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.716+0000 7fadf1fff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadec0d1950 con 0x7fadec0d2320 2023-11-28T12:09:36.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.716+0000 7fadf1fff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadec0b5520 con 0x7fadec15c9b0 2023-11-28T12:09:36.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.716+0000 7fadf1fff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadec0b5800 con 0x7fadec161340 2023-11-28T12:09:36.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.716+0000 7fadebfff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fadec0d2320 0x7fadec0cd7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:54878/0 (socket says 172.21.15.45:54878) 2023-11-28T12:09:36.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.716+0000 7fadebfff700 1 -- 172.21.15.45:0/1074609985 learned_addr learned my addr 172.21.15.45:0/1074609985 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:09:36.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.716+0000 7fadeaffd700 1 --2- 172.21.15.45:0/1074609985 >> v2:172.21.15.152:3300/0 conn(0x7fadec161340 0x7fadec0d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:36.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.717+0000 7fadea7fc700 1 -- 172.21.15.45:0/1074609985 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3092074808 0 0) 0x7fadec0d1950 con 0x7fadec0d2320 2023-11-28T12:09:36.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.717+0000 7fadea7fc700 1 -- 172.21.15.45:0/1074609985 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fadd40035b0 con 0x7fadec0d2320 2023-11-28T12:09:36.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.717+0000 7fadea7fc700 1 -- 172.21.15.45:0/1074609985 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3605209504 0 0) 0x7fadec0b5520 con 0x7fadec15c9b0 2023-11-28T12:09:36.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.717+0000 7fadea7fc700 1 -- 172.21.15.45:0/1074609985 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fadec0d1950 con 0x7fadec15c9b0 2023-11-28T12:09:36.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.717+0000 7fadea7fc700 1 -- 172.21.15.45:0/1074609985 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2591605009 0 0) 0x7fadd40035b0 con 0x7fadec0d2320 2023-11-28T12:09:36.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.717+0000 7fadeaffd700 1 -- 172.21.15.45:0/1074609985 >> v1:172.21.15.152:6789/0 conn(0x7fadec15c9b0 legacy=0x7fadec0b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:36.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.717+0000 7fadeaffd700 1 -- 172.21.15.45:0/1074609985 >> v1:172.21.15.45:6789/0 conn(0x7fadec0d2320 legacy=0x7fadec0cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:36.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.717+0000 7fadeaffd700 1 -- 172.21.15.45:0/1074609985 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadec0d1300 con 0x7fadec161340 2023-11-28T12:09:36.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.717+0000 7fadeaffd700 1 --2- 172.21.15.45:0/1074609985 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fadec161340 0x7fadec0d1de0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fade0009840 tx=0x7fade0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3bf3ff8430496a99 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:36.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.718+0000 7fadea7fc700 1 -- 172.21.15.45:0/1074609985 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade40019f0 con 0x7fadec161340 2023-11-28T12:09:36.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.718+0000 7fadea7fc700 1 -- 172.21.15.45:0/1074609985 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fade0004030 con 0x7fadec161340 2023-11-28T12:09:36.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.718+0000 7fadea7fc700 1 -- 172.21.15.45:0/1074609985 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade00043c0 con 0x7fadec161340 2023-11-28T12:09:36.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.718+0000 7fadf1fff700 1 -- 172.21.15.45:0/1074609985 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fadec161340 msgr2=0x7fadec0d1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:36.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.718+0000 7fadf1fff700 1 --2- 172.21.15.45:0/1074609985 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fadec161340 0x7fadec0d1de0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fade0009840 tx=0x7fade0009b50 comp rx=0 tx=0).stop 2023-11-28T12:09:36.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.718+0000 7fadf1fff700 1 -- 172.21.15.45:0/1074609985 shutdown_connections 2023-11-28T12:09:36.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.718+0000 7fadf1fff700 1 --2- 172.21.15.45:0/1074609985 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fadec161340 0x7fadec0d1de0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:36.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.718+0000 7fadf1fff700 1 -- 172.21.15.45:0/1074609985 >> 172.21.15.45:0/1074609985 conn(0x7fadec072600 msgr2=0x7fadec0cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:36.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.718+0000 7fadf1fff700 1 -- 172.21.15.45:0/1074609985 shutdown_connections 2023-11-28T12:09:36.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.719+0000 7fadf1fff700 1 -- 172.21.15.45:0/1074609985 wait complete. 2023-11-28T12:09:36.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.720+0000 7fadf1fff700 1 Processor -- start 2023-11-28T12:09:36.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.720+0000 7fadf1fff700 1 -- start start 2023-11-28T12:09:36.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.721+0000 7fadf1fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fadec0d2320 0x7fadec0c9780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:36.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.721+0000 7fadf1fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fadec15c9b0 0x7fadec14a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:36.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.721+0000 7fadf1fff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fadec161340 0x7fadec0b7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:36.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.721+0000 7fadf1fff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadec157a30 con 0x7fadec15c9b0 2023-11-28T12:09:36.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.721+0000 7fadf1fff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadec0c78b0 con 0x7fadec0d2320 2023-11-28T12:09:36.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.721+0000 7fadf1fff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadec0c8ca0 con 0x7fadec161340 2023-11-28T12:09:36.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.721+0000 7fadeaffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fadec15c9b0 0x7fadec14a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:36.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.722+0000 7fadeaffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fadec15c9b0 0x7fadec14a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49732/0 (socket says 172.21.15.45:49732) 2023-11-28T12:09:36.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.722+0000 7fadeaffd700 1 -- 172.21.15.45:0/2945167125 learned_addr learned my addr 172.21.15.45:0/2945167125 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:09:36.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.722+0000 7fadeb7fe700 1 --2- 172.21.15.45:0/2945167125 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fadec0d2320 0x7fadec0c9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:36.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.722+0000 7fadebfff700 1 --2- 172.21.15.45:0/2945167125 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fadec161340 0x7fadec0b7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:36.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.722+0000 7fadeaffd700 1 -- 172.21.15.45:0/2945167125 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fadec161340 msgr2=0x7fadec0b7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:36.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.722+0000 7fadeaffd700 1 --2- 172.21.15.45:0/2945167125 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fadec161340 0x7fadec0b7a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:36.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.722+0000 7fadeaffd700 1 -- 172.21.15.45:0/2945167125 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fadec0d2320 msgr2=0x7fadec0c9780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:36.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.722+0000 7fadeaffd700 1 --2- 172.21.15.45:0/2945167125 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fadec0d2320 0x7fadec0c9780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:36.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.722+0000 7fadeaffd700 1 -- 172.21.15.45:0/2945167125 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fade00094a0 con 0x7fadec15c9b0 2023-11-28T12:09:36.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.722+0000 7fadeb7fe700 1 --2- 172.21.15.45:0/2945167125 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fadec0d2320 0x7fadec0c9780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:09:36.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.722+0000 7fadeaffd700 1 --2- 172.21.15.45:0/2945167125 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fadec15c9b0 0x7fadec14a450 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fade000a010 tx=0x7fade0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:36.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.722+0000 7fadd3fff700 1 -- 172.21.15.45:0/2945167125 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade0003db0 con 0x7fadec15c9b0 2023-11-28T12:09:36.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.722+0000 7fadd3fff700 1 -- 172.21.15.45:0/2945167125 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fade001f070 con 0x7fadec15c9b0 2023-11-28T12:09:36.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.722+0000 7fadd3fff700 1 -- 172.21.15.45:0/2945167125 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade0011870 con 0x7fadec15c9b0 2023-11-28T12:09:36.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.722+0000 7fadf1fff700 1 -- 172.21.15.45:0/2945167125 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadec15cd80 con 0x7fadec15c9b0 2023-11-28T12:09:36.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.723+0000 7fadf1fff700 1 -- 172.21.15.45:0/2945167125 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadec0d15e0 con 0x7fadec15c9b0 2023-11-28T12:09:36.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.724+0000 7fadf1fff700 1 -- 172.21.15.45:0/2945167125 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadec15cf10 con 0x7fadec15c9b0 2023-11-28T12:09:36.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.725+0000 7fadd3fff700 1 -- 172.21.15.45:0/2945167125 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fade002a020 con 0x7fadec15c9b0 2023-11-28T12:09:36.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.725+0000 7fadd3fff700 1 --2- 172.21.15.45:0/2945167125 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fadd80682f0 0x7fadd806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:36.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.725+0000 7fadd3fff700 1 -- 172.21.15.45:0/2945167125 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fade0087290 con 0x7fadec15c9b0 2023-11-28T12:09:36.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.726+0000 7fadeb7fe700 1 --2- 172.21.15.45:0/2945167125 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fadd80682f0 0x7fadd806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:36.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.727+0000 7fadeb7fe700 1 --2- 172.21.15.45:0/2945167125 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fadd80682f0 0x7fadd806a7a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7faddc0011e0 tx=0x7faddc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:36.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.730+0000 7fadd3fff700 1 -- 172.21.15.45:0/2945167125 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fade0053a00 con 0x7fadec15c9b0 2023-11-28T12:09:36.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:36.977+0000 7fadf1fff700 1 -- 172.21.15.45:0/2945167125 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fadec0745c0 con 0x7fadec15c9b0 2023-11-28T12:09:37.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:37.583+0000 7fadd3fff700 1 -- 172.21.15.45:0/2945167125 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v31) v1 ==== 118+0+0 (secure 0 0 0) 0x7fade0057020 con 0x7fadec15c9b0 2023-11-28T12:09:37.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:37.585+0000 7fadf1fff700 1 -- 172.21.15.45:0/2945167125 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fadd80682f0 msgr2=0x7fadd806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:37.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:37.585+0000 7fadf1fff700 1 --2- 172.21.15.45:0/2945167125 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fadd80682f0 0x7fadd806a7a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7faddc0011e0 tx=0x7faddc009040 comp rx=0 tx=0).stop 2023-11-28T12:09:37.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:37.586+0000 7fadf1fff700 1 -- 172.21.15.45:0/2945167125 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fadec15c9b0 msgr2=0x7fadec14a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:37.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:37.586+0000 7fadf1fff700 1 --2- 172.21.15.45:0/2945167125 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fadec15c9b0 0x7fadec14a450 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fade000a010 tx=0x7fade0004750 comp rx=0 tx=0).stop 2023-11-28T12:09:37.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:37.586+0000 7fadf1fff700 1 -- 172.21.15.45:0/2945167125 shutdown_connections 2023-11-28T12:09:37.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:37.586+0000 7fadf1fff700 1 --2- 172.21.15.45:0/2945167125 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fadd80682f0 0x7fadd806a7a0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:37.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:37.586+0000 7fadf1fff700 1 --2- 172.21.15.45:0/2945167125 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fadec0d2320 0x7fadec0c9780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:37.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:37.586+0000 7fadf1fff700 1 --2- 172.21.15.45:0/2945167125 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fadec161340 0x7fadec0b7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:37.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:37.586+0000 7fadf1fff700 1 --2- 172.21.15.45:0/2945167125 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fadec15c9b0 0x7fadec14a450 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:37.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:37.586+0000 7fadf1fff700 1 -- 172.21.15.45:0/2945167125 >> 172.21.15.45:0/2945167125 conn(0x7fadec072600 msgr2=0x7fadec160610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:37.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:37.586+0000 7fadf1fff700 1 -- 172.21.15.45:0/2945167125 shutdown_connections 2023-11-28T12:09:37.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:37.586+0000 7fadf1fff700 1 -- 172.21.15.45:0/2945167125 wait complete. 2023-11-28T12:09:37.606 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-28T12:09:37.606 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-28T12:09:37.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:37.816+0000 7f03595ff700 1 Processor -- start 2023-11-28T12:09:37.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:37.816+0000 7f03595ff700 1 -- start start 2023-11-28T12:09:37.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:37.817+0000 7f03595ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f035415c9b0 0x7f03540b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:37.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:37.817+0000 7f03595ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f0354161340 0x7f03540d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:37.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:37.817+0000 7f03595ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f03540d2320 0x7f03540cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:37.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:37.817+0000 7f03595ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03540b5800 con 0x7f035415c9b0 2023-11-28T12:09:37.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:37.817+0000 7f03595ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03540d1950 con 0x7f0354161340 2023-11-28T12:09:37.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:37.817+0000 7f03595ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03540b5520 con 0x7f03540d2320 2023-11-28T12:09:37.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:37.818+0000 7f0352ffd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f035415c9b0 0x7f03540b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:37.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:37.818+0000 7f0352ffd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f035415c9b0 0x7f03540b4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49738/0 (socket says 172.21.15.45:49738) 2023-11-28T12:09:37.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:37.818+0000 7f0352ffd700 1 -- 172.21.15.45:0/305875943 learned_addr learned my addr 172.21.15.45:0/305875943 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:09:37.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:37.818+0000 7f03537fe700 1 --2- 172.21.15.45:0/305875943 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f03540d2320 0x7f03540cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:37.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:37.818+0000 7f03527fc700 1 --2- 172.21.15.45:0/305875943 >> v2:172.21.15.152:3300/0 conn(0x7f0354161340 0x7f03540d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:37.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:37.818+0000 7f0352ffd700 1 -- 172.21.15.45:0/305875943 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f03540d2320 msgr2=0x7f03540cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:37.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:37.818+0000 7f0352ffd700 1 --2- 172.21.15.45:0/305875943 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f03540d2320 0x7f03540cd7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:37.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:37.818+0000 7f0352ffd700 1 -- 172.21.15.45:0/305875943 >> v2:172.21.15.152:3300/0 conn(0x7f0354161340 msgr2=0x7f03540d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:37.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:37.818+0000 7f0352ffd700 1 --2- 172.21.15.45:0/305875943 >> v2:172.21.15.152:3300/0 conn(0x7f0354161340 0x7f03540d1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:37.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:37.818+0000 7f0352ffd700 1 -- 172.21.15.45:0/305875943 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03540d1300 con 0x7f035415c9b0 2023-11-28T12:09:37.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:37.818+0000 7f03537fe700 1 --2- 172.21.15.45:0/305875943 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f03540d2320 0x7f03540cd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:09:37.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:37.818+0000 7f03527fc700 1 --2- 172.21.15.45:0/305875943 >> v2:172.21.15.152:3300/0 conn(0x7f0354161340 0x7f03540d1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:09:37.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:37.818+0000 7f0352ffd700 1 --2- 172.21.15.45:0/305875943 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f035415c9b0 0x7f03540b4bf0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f03540685c0 tx=0x7f0344009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4571dc00567ee5d4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:37.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:37.819+0000 7f0351ffb700 1 -- 172.21.15.45:0/305875943 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f034400b870 con 0x7f035415c9b0 2023-11-28T12:09:37.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:37.819+0000 7f0351ffb700 1 -- 172.21.15.45:0/305875943 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f034400b9d0 con 0x7f035415c9b0 2023-11-28T12:09:37.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:37.819+0000 7f0351ffb700 1 -- 172.21.15.45:0/305875943 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f034400bd60 con 0x7f035415c9b0 2023-11-28T12:09:37.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:37.819+0000 7f03595ff700 1 -- 172.21.15.45:0/305875943 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f035415c9b0 msgr2=0x7f03540b4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:37.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:37.819+0000 7f03595ff700 1 --2- 172.21.15.45:0/305875943 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f035415c9b0 0x7f03540b4bf0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f03540685c0 tx=0x7f0344009bd0 comp rx=0 tx=0).stop 2023-11-28T12:09:37.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:37.819+0000 7f03595ff700 1 -- 172.21.15.45:0/305875943 shutdown_connections 2023-11-28T12:09:37.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:37.819+0000 7f03595ff700 1 --2- 172.21.15.45:0/305875943 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f03540d2320 0x7f03540cd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:37.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:37.819+0000 7f03595ff700 1 --2- 172.21.15.45:0/305875943 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f035415c9b0 0x7f03540b4bf0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:37.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:37.819+0000 7f03595ff700 1 --2- 172.21.15.45:0/305875943 >> v2:172.21.15.152:3300/0 conn(0x7f0354161340 0x7f03540d1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:37.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:37.819+0000 7f03595ff700 1 -- 172.21.15.45:0/305875943 >> 172.21.15.45:0/305875943 conn(0x7f0354072600 msgr2=0x7f03540cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:37.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:37.819+0000 7f03595ff700 1 -- 172.21.15.45:0/305875943 shutdown_connections 2023-11-28T12:09:37.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:37.819+0000 7f03595ff700 1 -- 172.21.15.45:0/305875943 wait complete. 2023-11-28T12:09:37.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:37.821+0000 7f03595ff700 1 Processor -- start 2023-11-28T12:09:37.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:37.821+0000 7f03595ff700 1 -- start start 2023-11-28T12:09:37.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:37.822+0000 7f03595ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f03540d2320 0x7f03541f2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:37.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:37.822+0000 7f03595ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f035415c9b0 0x7f0354155db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:37.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:37.822+0000 7f03595ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0354161340 0x7f0354157670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:37.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:37.822+0000 7f03595ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0354157ec0 con 0x7f0354161340 2023-11-28T12:09:37.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:37.822+0000 7f03595ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0354152d20 con 0x7f03540d2320 2023-11-28T12:09:37.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:37.822+0000 7f03595ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0354153000 con 0x7f035415c9b0 2023-11-28T12:09:37.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:37.822+0000 7f03537fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0354161340 0x7f0354157670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:37.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:37.822+0000 7f03537fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0354161340 0x7f0354157670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49742/0 (socket says 172.21.15.45:49742) 2023-11-28T12:09:37.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:37.822+0000 7f03537fe700 1 -- 172.21.15.45:0/3616787690 learned_addr learned my addr 172.21.15.45:0/3616787690 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:09:37.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:37.822+0000 7f0352ffd700 1 --2- 172.21.15.45:0/3616787690 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f03540d2320 0x7f03541f2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:37.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:37.822+0000 7f03527fc700 1 --2- 172.21.15.45:0/3616787690 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f035415c9b0 0x7f0354155db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:37.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:37.823+0000 7f03537fe700 1 -- 172.21.15.45:0/3616787690 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f035415c9b0 msgr2=0x7f0354155db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:37.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:37.823+0000 7f03537fe700 1 --2- 172.21.15.45:0/3616787690 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f035415c9b0 0x7f0354155db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:37.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:37.823+0000 7f03537fe700 1 -- 172.21.15.45:0/3616787690 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f03540d2320 msgr2=0x7f03541f2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:37.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:37.823+0000 7f03537fe700 1 --2- 172.21.15.45:0/3616787690 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f03540d2320 0x7f03541f2970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:37.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:37.823+0000 7f03537fe700 1 -- 172.21.15.45:0/3616787690 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0344009550 con 0x7f0354161340 2023-11-28T12:09:37.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:37.823+0000 7f03537fe700 1 --2- 172.21.15.45:0/3616787690 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0354161340 0x7f0354157670 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f034c00cd80 tx=0x7f034c00a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:37.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:37.823+0000 7f033b7fe700 1 -- 172.21.15.45:0/3616787690 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f034c00f480 con 0x7f0354161340 2023-11-28T12:09:37.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:37.823+0000 7f033b7fe700 1 -- 172.21.15.45:0/3616787690 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f034c00f600 con 0x7f0354161340 2023-11-28T12:09:37.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:37.823+0000 7f033b7fe700 1 -- 172.21.15.45:0/3616787690 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f034c00f9b0 con 0x7f0354161340 2023-11-28T12:09:37.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:37.823+0000 7f03595ff700 1 -- 172.21.15.45:0/3616787690 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03540b5130 con 0x7f0354161340 2023-11-28T12:09:37.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:37.823+0000 7f03595ff700 1 -- 172.21.15.45:0/3616787690 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03540d15e0 con 0x7f0354161340 2023-11-28T12:09:37.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:37.825+0000 7f03595ff700 1 -- 172.21.15.45:0/3616787690 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03540b52c0 con 0x7f0354161340 2023-11-28T12:09:37.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:37.825+0000 7f033b7fe700 1 -- 172.21.15.45:0/3616787690 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f034c009030 con 0x7f0354161340 2023-11-28T12:09:37.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:37.827+0000 7f033b7fe700 1 --2- 172.21.15.45:0/3616787690 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f03400682f0 0x7f034006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:37.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:37.827+0000 7f033b7fe700 1 -- 172.21.15.45:0/3616787690 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f034c0865f0 con 0x7f0354161340 2023-11-28T12:09:37.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:37.827+0000 7f0352ffd700 1 --2- 172.21.15.45:0/3616787690 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f03400682f0 0x7f034006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:37.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:37.828+0000 7f0352ffd700 1 --2- 172.21.15.45:0/3616787690 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f03400682f0 0x7f034006a7a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f0344000c00 tx=0x7f0344008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:37.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:37.831+0000 7f033b7fe700 1 -- 172.21.15.45:0/3616787690 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f034c052d60 con 0x7f0354161340 2023-11-28T12:09:38.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:38.079+0000 7f03595ff700 1 -- 172.21.15.45:0/3616787690 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f03540745c0 con 0x7f0354161340 2023-11-28T12:09:38.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:38.584+0000 7f033b7fe700 1 -- 172.21.15.45:0/3616787690 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v32) v1 ==== 122+0+0 (secure 0 0 0) 0x7f034c056380 con 0x7f0354161340 2023-11-28T12:09:38.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:38.587+0000 7f03595ff700 1 -- 172.21.15.45:0/3616787690 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f03400682f0 msgr2=0x7f034006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:38.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:38.587+0000 7f03595ff700 1 --2- 172.21.15.45:0/3616787690 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f03400682f0 0x7f034006a7a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f0344000c00 tx=0x7f0344008030 comp rx=0 tx=0).stop 2023-11-28T12:09:38.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:38.587+0000 7f03595ff700 1 -- 172.21.15.45:0/3616787690 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0354161340 msgr2=0x7f0354157670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:38.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:38.587+0000 7f03595ff700 1 --2- 172.21.15.45:0/3616787690 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0354161340 0x7f0354157670 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f034c00cd80 tx=0x7f034c00a560 comp rx=0 tx=0).stop 2023-11-28T12:09:38.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:38.587+0000 7f03595ff700 1 -- 172.21.15.45:0/3616787690 shutdown_connections 2023-11-28T12:09:38.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:38.587+0000 7f03595ff700 1 --2- 172.21.15.45:0/3616787690 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f03400682f0 0x7f034006a7a0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:38.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:38.587+0000 7f03595ff700 1 --2- 172.21.15.45:0/3616787690 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f03540d2320 0x7f03541f2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:38.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:38.587+0000 7f03595ff700 1 --2- 172.21.15.45:0/3616787690 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0354161340 0x7f0354157670 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:38.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:38.587+0000 7f03595ff700 1 --2- 172.21.15.45:0/3616787690 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f035415c9b0 0x7f0354155db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:38.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:38.587+0000 7f03595ff700 1 -- 172.21.15.45:0/3616787690 >> 172.21.15.45:0/3616787690 conn(0x7f0354072600 msgr2=0x7f03540b5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:38.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:38.587+0000 7f03595ff700 1 -- 172.21.15.45:0/3616787690 shutdown_connections 2023-11-28T12:09:38.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:38.587+0000 7f03595ff700 1 -- 172.21.15.45:0/3616787690 wait complete. 2023-11-28T12:09:38.607 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-28T12:09:38.607 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T12:09:38.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:38.813+0000 7f1dc9dff700 1 Processor -- start 2023-11-28T12:09:38.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:38.813+0000 7f1dc9dff700 1 -- start start 2023-11-28T12:09:38.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:38.814+0000 7f1dc9dff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1dc4159490 0x7f1dc40b0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:38.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:38.814+0000 7f1dc9dff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dc40ccc00 con 0x7f1dc4159860 2023-11-28T12:09:38.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:38.814+0000 7f1dc9dff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dc40ccec0 con 0x7f1dc40cdc80 2023-11-28T12:09:38.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:38.814+0000 7f1dc9dff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc40cd1a0 con 0x7f1dc4159490 2023-11-28T12:09:38.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:38.815+0000 7f1dc2ffd700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f1dc4159860 0x7f1dc40c94c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:54888/0 (socket says 172.21.15.45:54888) 2023-11-28T12:09:38.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:38.815+0000 7f1dc2ffd700 1 -- 172.21.15.45:0/2642911511 learned_addr learned my addr 172.21.15.45:0/2642911511 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:09:38.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:38.815+0000 7f1dc37fe700 1 --2- 172.21.15.45:0/2642911511 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1dc4159490 0x7f1dc40b0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:38.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:38.815+0000 7f1dc27fc700 1 -- 172.21.15.45:0/2642911511 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3113844794 0 0) 0x7f1dc40ccc00 con 0x7f1dc4159860 2023-11-28T12:09:38.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:38.815+0000 7f1dc27fc700 1 -- 172.21.15.45:0/2642911511 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1dac0035b0 con 0x7f1dc4159860 2023-11-28T12:09:38.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:38.815+0000 7f1dc37fe700 1 -- 172.21.15.45:0/2642911511 >> v1:172.21.15.152:6789/0 conn(0x7f1dc40cdc80 legacy=0x7f1dc406fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:38.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:38.815+0000 7f1dc27fc700 1 -- 172.21.15.45:0/2642911511 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3133748306 0 0) 0x7f1dc40ccec0 con 0x7f1dc40cdc80 2023-11-28T12:09:38.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:38.815+0000 7f1dc37fe700 1 -- 172.21.15.45:0/2642911511 >> v1:172.21.15.45:6789/0 conn(0x7f1dc4159860 legacy=0x7f1dc40c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:38.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:38.815+0000 7f1dc37fe700 1 -- 172.21.15.45:0/2642911511 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dc40cd480 con 0x7f1dc4159490 2023-11-28T12:09:38.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:38.816+0000 7f1dc37fe700 1 --2- 172.21.15.45:0/2642911511 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1dc4159490 0x7f1dc40b0670 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1db4009870 tx=0x7f1db4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f920a64c388d094b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:38.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:38.816+0000 7f1dc27fc700 1 -- 172.21.15.45:0/2642911511 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db4011830 con 0x7f1dc4159490 2023-11-28T12:09:38.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:38.816+0000 7f1dc27fc700 1 -- 172.21.15.45:0/2642911511 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1db4011990 con 0x7f1dc4159490 2023-11-28T12:09:38.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:38.816+0000 7f1dc27fc700 1 -- 172.21.15.45:0/2642911511 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db4011d20 con 0x7f1dc4159490 2023-11-28T12:09:38.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:38.816+0000 7f1dc9dff700 1 -- 172.21.15.45:0/2642911511 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1dc4159490 msgr2=0x7f1dc40b0670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:38.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:38.816+0000 7f1dc9dff700 1 --2- 172.21.15.45:0/2642911511 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1dc4159490 0x7f1dc40b0670 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1db4009870 tx=0x7f1db4009b80 comp rx=0 tx=0).stop 2023-11-28T12:09:38.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:38.817+0000 7f1dc9dff700 1 -- 172.21.15.45:0/2642911511 shutdown_connections 2023-11-28T12:09:38.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:38.817+0000 7f1dc9dff700 1 --2- 172.21.15.45:0/2642911511 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1dc4159490 0x7f1dc40b0670 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:38.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:38.817+0000 7f1dc9dff700 1 -- 172.21.15.45:0/2642911511 >> 172.21.15.45:0/2642911511 conn(0x7f1dc40cb670 msgr2=0x7f1dc40cba70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:38.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:38.817+0000 7f1dc9dff700 1 -- 172.21.15.45:0/2642911511 shutdown_connections 2023-11-28T12:09:38.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:38.817+0000 7f1dc9dff700 1 -- 172.21.15.45:0/2642911511 wait complete. 2023-11-28T12:09:38.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:38.819+0000 7f1dc9dff700 1 Processor -- start 2023-11-28T12:09:38.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:38.819+0000 7f1dc9dff700 1 -- start start 2023-11-28T12:09:38.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:38.820+0000 7f1dc9dff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1dc40cdc80 0x7f1dc41509e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:38.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:38.821+0000 7f1dc9dff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1dc4159490 0x7f1dc414dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:38.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:38.821+0000 7f1dc9dff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1dc40c4530 0x7f1dc414e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:38.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:38.821+0000 7f1dc9dff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc4157310 con 0x7f1dc40c4530 2023-11-28T12:09:38.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:38.821+0000 7f1dc9dff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc4153190 con 0x7f1dc40cdc80 2023-11-28T12:09:38.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:38.821+0000 7f1dc9dff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc4153d10 con 0x7f1dc4159490 2023-11-28T12:09:38.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:38.821+0000 7f1dc3fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1dc40c4530 0x7f1dc414e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:38.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:38.821+0000 7f1dc3fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1dc40c4530 0x7f1dc414e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49758/0 (socket says 172.21.15.45:49758) 2023-11-28T12:09:38.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:38.821+0000 7f1dc3fff700 1 -- 172.21.15.45:0/1053251736 learned_addr learned my addr 172.21.15.45:0/1053251736 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:09:38.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:38.821+0000 7f1dc37fe700 1 --2- 172.21.15.45:0/1053251736 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1dc40cdc80 0x7f1dc41509e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:38.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:38.821+0000 7f1dc2ffd700 1 --2- 172.21.15.45:0/1053251736 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1dc4159490 0x7f1dc414dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:38.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:38.821+0000 7f1dc3fff700 1 -- 172.21.15.45:0/1053251736 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1dc4159490 msgr2=0x7f1dc414dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:38.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:38.821+0000 7f1dc3fff700 1 --2- 172.21.15.45:0/1053251736 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1dc4159490 0x7f1dc414dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:38.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:38.821+0000 7f1dc3fff700 1 -- 172.21.15.45:0/1053251736 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1dc40cdc80 msgr2=0x7f1dc41509e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:38.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:38.821+0000 7f1dc3fff700 1 --2- 172.21.15.45:0/1053251736 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1dc40cdc80 0x7f1dc41509e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:38.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:38.821+0000 7f1dc3fff700 1 -- 172.21.15.45:0/1053251736 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1db40094a0 con 0x7f1dc40c4530 2023-11-28T12:09:38.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:38.821+0000 7f1dc2ffd700 1 --2- 172.21.15.45:0/1053251736 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1dc4159490 0x7f1dc414dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:09:38.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:38.822+0000 7f1dc3fff700 1 --2- 172.21.15.45:0/1053251736 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1dc40c4530 0x7f1dc414e320 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc00c870 tx=0x7f1dbc00cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:38.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:38.822+0000 7f1dabfff700 1 -- 172.21.15.45:0/1053251736 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dbc003e30 con 0x7f1dc40c4530 2023-11-28T12:09:38.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:38.822+0000 7f1dabfff700 1 -- 172.21.15.45:0/1053251736 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dbc005070 con 0x7f1dc40c4530 2023-11-28T12:09:38.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:38.822+0000 7f1dc9dff700 1 -- 172.21.15.45:0/1053251736 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dc40b0bb0 con 0x7f1dc40c4530 2023-11-28T12:09:38.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:38.822+0000 7f1dabfff700 1 -- 172.21.15.45:0/1053251736 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dbc005420 con 0x7f1dc40c4530 2023-11-28T12:09:38.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:38.822+0000 7f1dc9dff700 1 -- 172.21.15.45:0/1053251736 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dc40cd760 con 0x7f1dc40c4530 2023-11-28T12:09:38.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:38.823+0000 7f1dc9dff700 1 -- 172.21.15.45:0/1053251736 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dc40b0d40 con 0x7f1dc40c4530 2023-11-28T12:09:38.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:38.824+0000 7f1dabfff700 1 -- 172.21.15.45:0/1053251736 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f1dbc019030 con 0x7f1dc40c4530 2023-11-28T12:09:38.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:38.825+0000 7f1dabfff700 1 --2- 172.21.15.45:0/1053251736 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f1db00682f0 0x7f1db006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:38.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:38.825+0000 7f1dabfff700 1 -- 172.21.15.45:0/1053251736 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1dbc085380 con 0x7f1dc40c4530 2023-11-28T12:09:38.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:38.825+0000 7f1dc37fe700 1 --2- 172.21.15.45:0/1053251736 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f1db00682f0 0x7f1db006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:38.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:38.826+0000 7f1dc37fe700 1 --2- 172.21.15.45:0/1053251736 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f1db00682f0 0x7f1db006a7a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f1db40097c0 tx=0x7f1db401c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:38.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:38.829+0000 7f1dabfff700 1 -- 172.21.15.45:0/1053251736 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f1dbc051af0 con 0x7f1dc40c4530 2023-11-28T12:09:39.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.074+0000 7f1dc9dff700 1 -- 172.21.15.45:0/1053251736 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1dc40745c0 con 0x7f1dc40c4530 2023-11-28T12:09:39.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.075+0000 7f1dabfff700 1 -- 172.21.15.45:0/1053251736 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4649 (secure 0 0 0) 0x7f1dbc017090 con 0x7f1dc40c4530 2023-11-28T12:09:39.075 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:09:39.075 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5423,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6836/735970231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":735970231},{"type":"v1","addr":"172.21.15.152:6836","nonce":735970231}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5797,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/3354918087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6835","nonce":3354918087},{"type":"v1","addr":"172.21.15.152:6837","nonce":3354918087}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5806,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/275804060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":275804060},{"type":"v1","addr":"172.21.15.45:6835","nonce":275804060}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T12:09:35.571815+0000","modified":"2023-11-28T12:09:38.581286+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5979},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5979":{"gid":5979,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6833/3784258337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":3784258337},{"type":"v1","addr":"172.21.15.45:6833","nonce":3784258337}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-28T12:09:39.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.077+0000 7f1dc9dff700 1 -- 172.21.15.45:0/1053251736 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f1db00682f0 msgr2=0x7f1db006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:39.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.077+0000 7f1dc9dff700 1 --2- 172.21.15.45:0/1053251736 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f1db00682f0 0x7f1db006a7a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f1db40097c0 tx=0x7f1db401c040 comp rx=0 tx=0).stop 2023-11-28T12:09:39.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.077+0000 7f1dc9dff700 1 -- 172.21.15.45:0/1053251736 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1dc40c4530 msgr2=0x7f1dc414e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:39.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.077+0000 7f1dc9dff700 1 --2- 172.21.15.45:0/1053251736 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1dc40c4530 0x7f1dc414e320 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc00c870 tx=0x7f1dbc00cb80 comp rx=0 tx=0).stop 2023-11-28T12:09:39.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.077+0000 7f1dc9dff700 1 -- 172.21.15.45:0/1053251736 shutdown_connections 2023-11-28T12:09:39.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.077+0000 7f1dc9dff700 1 --2- 172.21.15.45:0/1053251736 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f1db00682f0 0x7f1db006a7a0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:39.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.077+0000 7f1dc9dff700 1 --2- 172.21.15.45:0/1053251736 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1dc40cdc80 0x7f1dc41509e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:39.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.077+0000 7f1dc9dff700 1 --2- 172.21.15.45:0/1053251736 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1dc40c4530 0x7f1dc414e320 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:39.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.077+0000 7f1dc9dff700 1 --2- 172.21.15.45:0/1053251736 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f1dc4159490 0x7f1dc414dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:39.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.077+0000 7f1dc9dff700 1 -- 172.21.15.45:0/1053251736 >> 172.21.15.45:0/1053251736 conn(0x7f1dc40cb670 msgr2=0x7f1dc406b820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:39.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.077+0000 7f1dc9dff700 1 -- 172.21.15.45:0/1053251736 shutdown_connections 2023-11-28T12:09:39.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.077+0000 7f1dc9dff700 1 -- 172.21.15.45:0/1053251736 wait complete. 2023-11-28T12:09:39.079 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 32 2023-11-28T12:09:39.096 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T12:09:39.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.299+0000 7f1830dff700 1 Processor -- start 2023-11-28T12:09:39.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.299+0000 7f1830dff700 1 -- start start 2023-11-28T12:09:39.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.300+0000 7f1830dff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f182c0b20b0 0x7f182c0b0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:39.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.300+0000 7f1830dff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f182c0b0230 con 0x7f182c0d1330 2023-11-28T12:09:39.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.301+0000 7f1830dff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f182c0b4570 con 0x7f182c0d01b0 2023-11-28T12:09:39.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.301+0000 7f1830dff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f182c15cec0 con 0x7f182c0b20b0 2023-11-28T12:09:39.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.301+0000 7f1823fff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f182c0d1330 0x7f182c0b06c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:54900/0 (socket says 172.21.15.45:54900) 2023-11-28T12:09:39.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.301+0000 7f1823fff700 1 -- 172.21.15.45:0/3186960053 learned_addr learned my addr 172.21.15.45:0/3186960053 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:09:39.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.301+0000 7f182ad9d700 1 --2- 172.21.15.45:0/3186960053 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f182c0b20b0 0x7f182c0b0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:39.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.301+0000 7f1829d9b700 1 -- 172.21.15.45:0/3186960053 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4203532449 0 0) 0x7f182c0b0230 con 0x7f182c0d1330 2023-11-28T12:09:39.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.301+0000 7f1829d9b700 1 -- 172.21.15.45:0/3186960053 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18180035b0 con 0x7f182c0d1330 2023-11-28T12:09:39.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.301+0000 7f1829d9b700 1 -- 172.21.15.45:0/3186960053 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2967306811 0 0) 0x7f182c0b4570 con 0x7f182c0d01b0 2023-11-28T12:09:39.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.301+0000 7f1829d9b700 1 -- 172.21.15.45:0/3186960053 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f182c0b0230 con 0x7f182c0d01b0 2023-11-28T12:09:39.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.301+0000 7f182ad9d700 1 -- 172.21.15.45:0/3186960053 >> v1:172.21.15.152:6789/0 conn(0x7f182c0d01b0 legacy=0x7f182c0d0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:39.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.301+0000 7f182ad9d700 1 -- 172.21.15.45:0/3186960053 >> v1:172.21.15.45:6789/0 conn(0x7f182c0d1330 legacy=0x7f182c0b06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:39.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.301+0000 7f182ad9d700 1 -- 172.21.15.45:0/3186960053 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f182c0b4850 con 0x7f182c0b20b0 2023-11-28T12:09:39.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.302+0000 7f182ad9d700 1 --2- 172.21.15.45:0/3186960053 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f182c0b20b0 0x7f182c0b0dd0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1824009dc0 tx=0x7f182400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7102b3cb8ccad77d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:39.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.302+0000 7f1829d9b700 1 -- 172.21.15.45:0/3186960053 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f182400e070 con 0x7f182c0b20b0 2023-11-28T12:09:39.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.302+0000 7f1829d9b700 1 -- 172.21.15.45:0/3186960053 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f182400bb20 con 0x7f182c0b20b0 2023-11-28T12:09:39.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.302+0000 7f1829d9b700 1 -- 172.21.15.45:0/3186960053 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1824012430 con 0x7f182c0b20b0 2023-11-28T12:09:39.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.302+0000 7f1830dff700 1 -- 172.21.15.45:0/3186960053 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f182c0b20b0 msgr2=0x7f182c0b0dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:39.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.302+0000 7f1830dff700 1 --2- 172.21.15.45:0/3186960053 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f182c0b20b0 0x7f182c0b0dd0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1824009dc0 tx=0x7f182400b330 comp rx=0 tx=0).stop 2023-11-28T12:09:39.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.303+0000 7f1830dff700 1 -- 172.21.15.45:0/3186960053 shutdown_connections 2023-11-28T12:09:39.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.303+0000 7f1830dff700 1 --2- 172.21.15.45:0/3186960053 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f182c0b20b0 0x7f182c0b0dd0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:39.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.303+0000 7f1830dff700 1 -- 172.21.15.45:0/3186960053 >> 172.21.15.45:0/3186960053 conn(0x7f182c09c3f0 msgr2=0x7f182c0d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:39.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.303+0000 7f1830dff700 1 -- 172.21.15.45:0/3186960053 shutdown_connections 2023-11-28T12:09:39.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.303+0000 7f1830dff700 1 -- 172.21.15.45:0/3186960053 wait complete. 2023-11-28T12:09:39.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.304+0000 7f1830dff700 1 Processor -- start 2023-11-28T12:09:39.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.305+0000 7f1830dff700 1 -- start start 2023-11-28T12:09:39.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.305+0000 7f1830dff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f182c0b20b0 0x7f182c15b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:39.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.305+0000 7f1830dff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f182c0d01b0 0x7f182c06b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:39.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.305+0000 7f1830dff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f182c0d1330 0x7f182c06b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:39.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.305+0000 7f1830dff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f182c1f66b0 con 0x7f182c0b20b0 2023-11-28T12:09:39.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.305+0000 7f1830dff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f182c0b69c0 con 0x7f182c0d01b0 2023-11-28T12:09:39.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.305+0000 7f1830dff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f182c0b6020 con 0x7f182c0d1330 2023-11-28T12:09:39.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.306+0000 7f182a59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f182c0b20b0 0x7f182c15b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:39.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.306+0000 7f182a59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f182c0b20b0 0x7f182c15b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49768/0 (socket says 172.21.15.45:49768) 2023-11-28T12:09:39.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.306+0000 7f182a59c700 1 -- 172.21.15.45:0/2487976905 learned_addr learned my addr 172.21.15.45:0/2487976905 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:09:39.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.306+0000 7f1823fff700 1 --2- 172.21.15.45:0/2487976905 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f182c0d01b0 0x7f182c06b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:39.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.306+0000 7f182ad9d700 1 --2- 172.21.15.45:0/2487976905 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f182c0d1330 0x7f182c06b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:39.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.306+0000 7f182a59c700 1 -- 172.21.15.45:0/2487976905 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f182c0d1330 msgr2=0x7f182c06b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:39.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.306+0000 7f182a59c700 1 --2- 172.21.15.45:0/2487976905 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f182c0d1330 0x7f182c06b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:39.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.306+0000 7f182a59c700 1 -- 172.21.15.45:0/2487976905 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f182c0d01b0 msgr2=0x7f182c06b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:39.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.306+0000 7f182a59c700 1 --2- 172.21.15.45:0/2487976905 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f182c0d01b0 0x7f182c06b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:39.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.306+0000 7f182a59c700 1 -- 172.21.15.45:0/2487976905 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1824009a70 con 0x7f182c0b20b0 2023-11-28T12:09:39.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.306+0000 7f182a59c700 1 --2- 172.21.15.45:0/2487976905 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f182c0b20b0 0x7f182c15b600 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f181c00c520 tx=0x7f181c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:39.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.307+0000 7f1822ffd700 1 -- 172.21.15.45:0/2487976905 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f181c0052d0 con 0x7f182c0b20b0 2023-11-28T12:09:39.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.307+0000 7f1822ffd700 1 -- 172.21.15.45:0/2487976905 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f181c005430 con 0x7f182c0b20b0 2023-11-28T12:09:39.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.307+0000 7f1822ffd700 1 -- 172.21.15.45:0/2487976905 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f181c0038c0 con 0x7f182c0b20b0 2023-11-28T12:09:39.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.307+0000 7f1830dff700 1 -- 172.21.15.45:0/2487976905 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f182c0afec0 con 0x7f182c0b20b0 2023-11-28T12:09:39.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.307+0000 7f1830dff700 1 -- 172.21.15.45:0/2487976905 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f182c0afbe0 con 0x7f182c0b20b0 2023-11-28T12:09:39.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.308+0000 7f1830dff700 1 -- 172.21.15.45:0/2487976905 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f182c0b2600 con 0x7f182c0b20b0 2023-11-28T12:09:39.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.309+0000 7f1822ffd700 1 -- 172.21.15.45:0/2487976905 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f181c019030 con 0x7f182c0b20b0 2023-11-28T12:09:39.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.309+0000 7f1822ffd700 1 --2- 172.21.15.45:0/2487976905 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f180c0682f0 0x7f180c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:39.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.310+0000 7f1822ffd700 1 -- 172.21.15.45:0/2487976905 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f181c085060 con 0x7f182c0b20b0 2023-11-28T12:09:39.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.310+0000 7f1823fff700 1 --2- 172.21.15.45:0/2487976905 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f180c0682f0 0x7f180c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:39.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.311+0000 7f1823fff700 1 --2- 172.21.15.45:0/2487976905 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f180c0682f0 0x7f180c06a7a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f182c0664b0 tx=0x7f1814007dc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:39.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.314+0000 7f1822ffd700 1 -- 172.21.15.45:0/2487976905 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f181c0517d0 con 0x7f182c0b20b0 2023-11-28T12:09:39.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.518+0000 7f1830dff700 1 -- 172.21.15.45:0/2487976905 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f182c068690 con 0x7f182c0b20b0 2023-11-28T12:09:39.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.519+0000 7f1822ffd700 1 -- 172.21.15.45:0/2487976905 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+17863 (secure 0 0 0) 0x7f181c054df0 con 0x7f182c0b20b0 2023-11-28T12:09:39.520 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:09:39.521 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":61,"fsid":"bd7c37f1-f7c6-4778-b845-52cf2aa6e366","created":"2023-11-28T12:06:09.045075+0000","modified":"2023-11-28T12:09:36.574318+0000","last_up_change":"2023-11-28T12:06:21.282227+0000","last_in_change":"2023-11-28T12:06:12.560924+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T12:06:21.807108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T12:06:22.491009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-11-28T12:09:33.476735+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-11-28T12:09:34.551527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d0cdd8a-87fd-4f2c-91bd-47bdfa661905","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":115843},{"type":"v1","addr":"172.21.15.45:6808","nonce":115843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":115843},{"type":"v1","addr":"172.21.15.45:6811","nonce":115843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":115843},{"type":"v1","addr":"172.21.15.45:6815","nonce":115843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":115843},{"type":"v1","addr":"172.21.15.45:6813","nonce":115843}]},"public_addr":"172.21.15.45:6808/115843","cluster_addr":"172.21.15.45:6811/115843","heartbeat_back_addr":"172.21.15.45:6815/115843","heartbeat_front_addr":"172.21.15.45:6813/115843","state":["exists","up"]},{"osd":1,"uuid":"c5de4ebd-9ec5-40b3-9caa-9b706fab4c76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":115842},{"type":"v1","addr":"172.21.15.45:6801","nonce":115842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":115842},{"type":"v1","addr":"172.21.15.45:6803","nonce":115842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6807","nonce":115842},{"type":"v1","addr":"172.21.15.45:6809","nonce":115842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":115842},{"type":"v1","addr":"172.21.15.45:6805","nonce":115842}]},"public_addr":"172.21.15.45:6801/115842","cluster_addr":"172.21.15.45:6803/115842","heartbeat_back_addr":"172.21.15.45:6809/115842","heartbeat_front_addr":"172.21.15.45:6805/115842","state":["exists","up"]},{"osd":2,"uuid":"9f4b36b2-65d2-40e7-9fe6-a2991afa71c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":115850},{"type":"v1","addr":"172.21.15.45:6819","nonce":115850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":115850},{"type":"v1","addr":"172.21.15.45:6823","nonce":115850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":115850},{"type":"v1","addr":"172.21.15.45:6831","nonce":115850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":115850},{"type":"v1","addr":"172.21.15.45:6828","nonce":115850}]},"public_addr":"172.21.15.45:6819/115850","cluster_addr":"172.21.15.45:6823/115850","heartbeat_back_addr":"172.21.15.45:6831/115850","heartbeat_front_addr":"172.21.15.45:6828/115850","state":["exists","up"]},{"osd":3,"uuid":"6fe7ef05-4e0d-426c-bf94-44b51d4d550b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":115848},{"type":"v1","addr":"172.21.15.45:6818","nonce":115848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":115848},{"type":"v1","addr":"172.21.15.45:6822","nonce":115848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6827","nonce":115848},{"type":"v1","addr":"172.21.15.45:6829","nonce":115848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":115848},{"type":"v1","addr":"172.21.15.45:6825","nonce":115848}]},"public_addr":"172.21.15.45:6818/115848","cluster_addr":"172.21.15.45:6822/115848","heartbeat_back_addr":"172.21.15.45:6829/115848","heartbeat_front_addr":"172.21.15.45:6825/115848","state":["exists","up"]},{"osd":4,"uuid":"fa403c08-d8a1-4a3a-8384-cb465c1a654c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":116092},{"type":"v1","addr":"172.21.15.152:6801","nonce":116092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":116092},{"type":"v1","addr":"172.21.15.152:6803","nonce":116092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":116092},{"type":"v1","addr":"172.21.15.152:6807","nonce":116092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":116092},{"type":"v1","addr":"172.21.15.152:6805","nonce":116092}]},"public_addr":"172.21.15.152:6801/116092","cluster_addr":"172.21.15.152:6803/116092","heartbeat_back_addr":"172.21.15.152:6807/116092","heartbeat_front_addr":"172.21.15.152:6805/116092","state":["exists","up"]},{"osd":5,"uuid":"399fc450-39fa-43a6-bf80-0b8bcb41bd95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6815","nonce":116093},{"type":"v1","addr":"172.21.15.152:6817","nonce":116093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":116093},{"type":"v1","addr":"172.21.15.152:6819","nonce":116093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":116093},{"type":"v1","addr":"172.21.15.152:6823","nonce":116093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":116093},{"type":"v1","addr":"172.21.15.152:6821","nonce":116093}]},"public_addr":"172.21.15.152:6817/116093","cluster_addr":"172.21.15.152:6819/116093","heartbeat_back_addr":"172.21.15.152:6823/116093","heartbeat_front_addr":"172.21.15.152:6821/116093","state":["exists","up"]},{"osd":6,"uuid":"e59a4017-2d23-4627-836b-e25b2d3ddaaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":116094},{"type":"v1","addr":"172.21.15.152:6809","nonce":116094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":116094},{"type":"v1","addr":"172.21.15.152:6811","nonce":116094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":116094},{"type":"v1","addr":"172.21.15.152:6816","nonce":116094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":116094},{"type":"v1","addr":"172.21.15.152:6813","nonce":116094}]},"public_addr":"172.21.15.152:6809/116094","cluster_addr":"172.21.15.152:6811/116094","heartbeat_back_addr":"172.21.15.152:6816/116094","heartbeat_front_addr":"172.21.15.152:6813/116094","state":["exists","up"]},{"osd":7,"uuid":"8d7f9d4b-bf08-4670-8591-388c0f012a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":116097},{"type":"v1","addr":"172.21.15.152:6825","nonce":116097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":116097},{"type":"v1","addr":"172.21.15.152:6827","nonce":116097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":116097},{"type":"v1","addr":"172.21.15.152:6831","nonce":116097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":116097},{"type":"v1","addr":"172.21.15.152:6829","nonce":116097}]},"public_addr":"172.21.15.152:6825/116097","cluster_addr":"172.21.15.152:6827/116097","heartbeat_back_addr":"172.21.15.152:6831/116097","heartbeat_front_addr":"172.21.15.152:6829/116097","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.937710+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.865423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.159434+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.913090+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.131647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.966255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.972583+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.177209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T12:09:39.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.522+0000 7f1830dff700 1 -- 172.21.15.45:0/2487976905 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f180c0682f0 msgr2=0x7f180c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:39.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.522+0000 7f1830dff700 1 --2- 172.21.15.45:0/2487976905 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f180c0682f0 0x7f180c06a7a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f182c0664b0 tx=0x7f1814007dc0 comp rx=0 tx=0).stop 2023-11-28T12:09:39.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.522+0000 7f1830dff700 1 -- 172.21.15.45:0/2487976905 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f182c0b20b0 msgr2=0x7f182c15b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:39.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.522+0000 7f1830dff700 1 --2- 172.21.15.45:0/2487976905 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f182c0b20b0 0x7f182c15b600 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f181c00c520 tx=0x7f181c00c830 comp rx=0 tx=0).stop 2023-11-28T12:09:39.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.522+0000 7f1830dff700 1 -- 172.21.15.45:0/2487976905 shutdown_connections 2023-11-28T12:09:39.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.522+0000 7f1830dff700 1 --2- 172.21.15.45:0/2487976905 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f180c0682f0 0x7f180c06a7a0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:39.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.522+0000 7f1830dff700 1 --2- 172.21.15.45:0/2487976905 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f182c0d1330 0x7f182c06b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:39.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.522+0000 7f1830dff700 1 --2- 172.21.15.45:0/2487976905 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f182c0b20b0 0x7f182c15b600 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:39.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.522+0000 7f1830dff700 1 --2- 172.21.15.45:0/2487976905 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f182c0d01b0 0x7f182c06b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:39.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.522+0000 7f1830dff700 1 -- 172.21.15.45:0/2487976905 >> 172.21.15.45:0/2487976905 conn(0x7f182c09c3f0 msgr2=0x7f182c06c450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:39.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.522+0000 7f1830dff700 1 -- 172.21.15.45:0/2487976905 shutdown_connections 2023-11-28T12:09:39.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.522+0000 7f1830dff700 1 -- 172.21.15.45:0/2487976905 wait complete. 2023-11-28T12:09:39.541 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-28T12:09:39.542 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T12:09:39.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.745+0000 7fbfdbfff700 1 Processor -- start 2023-11-28T12:09:39.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.745+0000 7fbfdbfff700 1 -- start start 2023-11-28T12:09:39.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.746+0000 7fbfdbfff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbfd415c9b0 0x7fbfd40b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:39.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.746+0000 7fbfdbfff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbfd40cd7c0 0x7fbfd40cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:39.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.746+0000 7fbfdbfff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfd40d1950 con 0x7fbfd4161340 2023-11-28T12:09:39.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.747+0000 7fbfdbfff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfd40b5800 con 0x7fbfd415c9b0 2023-11-28T12:09:39.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.747+0000 7fbfdbfff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd40ce140 con 0x7fbfd40cd7c0 2023-11-28T12:09:39.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.747+0000 7fbfd9d9b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbfd415c9b0 0x7fbfd40b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:39.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.747+0000 7fbfd959a700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fbfd4161340 0x7fbfd40d1de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:54902/0 (socket says 172.21.15.45:54902) 2023-11-28T12:09:39.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.747+0000 7fbfd959a700 1 -- 172.21.15.45:0/304291862 learned_addr learned my addr 172.21.15.45:0/304291862 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:09:39.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.747+0000 7fbfda59c700 1 --2- 172.21.15.45:0/304291862 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbfd40cd7c0 0x7fbfd40cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:39.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.747+0000 7fbfd9d9b700 1 -- 172.21.15.45:0/304291862 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbfd40cd7c0 msgr2=0x7fbfd40cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:39.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.747+0000 7fbfd9d9b700 1 --2- 172.21.15.45:0/304291862 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbfd40cd7c0 0x7fbfd40cdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:39.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.747+0000 7fbfd9d9b700 1 -- 172.21.15.45:0/304291862 >> v1:172.21.15.45:6789/0 conn(0x7fbfd4161340 legacy=0x7fbfd40d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:39.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.747+0000 7fbfd9d9b700 1 -- 172.21.15.45:0/304291862 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfd40d24f0 con 0x7fbfd415c9b0 2023-11-28T12:09:39.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.748+0000 7fbfd9d9b700 1 --2- 172.21.15.45:0/304291862 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfd415c9b0 0x7fbfd40b4bf0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fbfd0009840 tx=0x7fbfd0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=657a5b74f22cff28 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:39.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.748+0000 7fbfd8d99700 1 -- 172.21.15.45:0/304291862 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd0011830 con 0x7fbfd415c9b0 2023-11-28T12:09:39.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.748+0000 7fbfd8d99700 1 -- 172.21.15.45:0/304291862 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfd0011990 con 0x7fbfd415c9b0 2023-11-28T12:09:39.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.748+0000 7fbfd8d99700 1 -- 172.21.15.45:0/304291862 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd0011d20 con 0x7fbfd415c9b0 2023-11-28T12:09:39.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.748+0000 7fbfdbfff700 1 -- 172.21.15.45:0/304291862 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfd415c9b0 msgr2=0x7fbfd40b4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:39.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.748+0000 7fbfdbfff700 1 --2- 172.21.15.45:0/304291862 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfd415c9b0 0x7fbfd40b4bf0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fbfd0009840 tx=0x7fbfd0009b50 comp rx=0 tx=0).stop 2023-11-28T12:09:39.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.748+0000 7fbfdbfff700 1 -- 172.21.15.45:0/304291862 shutdown_connections 2023-11-28T12:09:39.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.748+0000 7fbfdbfff700 1 --2- 172.21.15.45:0/304291862 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbfd40cd7c0 0x7fbfd40cdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:39.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.749+0000 7fbfdbfff700 1 --2- 172.21.15.45:0/304291862 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfd415c9b0 0x7fbfd40b4bf0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:39.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.749+0000 7fbfdbfff700 1 -- 172.21.15.45:0/304291862 >> 172.21.15.45:0/304291862 conn(0x7fbfd4072600 msgr2=0x7fbfd40cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:39.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.749+0000 7fbfdbfff700 1 -- 172.21.15.45:0/304291862 shutdown_connections 2023-11-28T12:09:39.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.749+0000 7fbfdbfff700 1 -- 172.21.15.45:0/304291862 wait complete. 2023-11-28T12:09:39.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.750+0000 7fbfdbfff700 1 Processor -- start 2023-11-28T12:09:39.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.750+0000 7fbfdbfff700 1 -- start start 2023-11-28T12:09:39.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.751+0000 7fbfdbfff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbfd40cd7c0 0x7fbfd4147430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:39.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.751+0000 7fbfdbfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfd415c9b0 0x7fbfd41e6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:39.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.751+0000 7fbfdbfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbfd4161340 0x7fbfd4159560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:39.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.751+0000 7fbfdbfff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd40c6780 con 0x7fbfd415c9b0 2023-11-28T12:09:39.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.751+0000 7fbfdbfff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd4147970 con 0x7fbfd4161340 2023-11-28T12:09:39.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.751+0000 7fbfdbfff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd41e6d60 con 0x7fbfd40cd7c0 2023-11-28T12:09:39.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.752+0000 7fbfd959a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfd415c9b0 0x7fbfd41e6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:39.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.752+0000 7fbfd959a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfd415c9b0 0x7fbfd41e6480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49784/0 (socket says 172.21.15.45:49784) 2023-11-28T12:09:39.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.752+0000 7fbfd959a700 1 -- 172.21.15.45:0/1968439226 learned_addr learned my addr 172.21.15.45:0/1968439226 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:09:39.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.752+0000 7fbfd9d9b700 1 --2- 172.21.15.45:0/1968439226 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbfd40cd7c0 0x7fbfd4147430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:39.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.752+0000 7fbfda59c700 1 --2- 172.21.15.45:0/1968439226 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbfd4161340 0x7fbfd4159560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:39.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.752+0000 7fbfd959a700 1 -- 172.21.15.45:0/1968439226 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbfd40cd7c0 msgr2=0x7fbfd4147430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:39.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.752+0000 7fbfd959a700 1 --2- 172.21.15.45:0/1968439226 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbfd40cd7c0 0x7fbfd4147430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:39.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.752+0000 7fbfd959a700 1 -- 172.21.15.45:0/1968439226 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbfd4161340 msgr2=0x7fbfd4159560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:39.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.752+0000 7fbfd959a700 1 --2- 172.21.15.45:0/1968439226 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbfd4161340 0x7fbfd4159560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:39.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.752+0000 7fbfd959a700 1 -- 172.21.15.45:0/1968439226 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfd00094a0 con 0x7fbfd415c9b0 2023-11-28T12:09:39.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.752+0000 7fbfd959a700 1 --2- 172.21.15.45:0/1968439226 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfd415c9b0 0x7fbfd41e6480 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fbfc400c520 tx=0x7fbfc400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:39.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.753+0000 7fbfca7fc700 1 -- 172.21.15.45:0/1968439226 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc4005d70 con 0x7fbfd415c9b0 2023-11-28T12:09:39.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.753+0000 7fbfca7fc700 1 -- 172.21.15.45:0/1968439226 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfc40070d0 con 0x7fbfd415c9b0 2023-11-28T12:09:39.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.753+0000 7fbfca7fc700 1 -- 172.21.15.45:0/1968439226 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc4007440 con 0x7fbfd415c9b0 2023-11-28T12:09:39.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.753+0000 7fbfdbfff700 1 -- 172.21.15.45:0/1968439226 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfd40d1300 con 0x7fbfd415c9b0 2023-11-28T12:09:39.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.753+0000 7fbfdbfff700 1 -- 172.21.15.45:0/1968439226 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfd40b5520 con 0x7fbfd415c9b0 2023-11-28T12:09:39.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.754+0000 7fbfdbfff700 1 -- 172.21.15.45:0/1968439226 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfd40d15e0 con 0x7fbfd415c9b0 2023-11-28T12:09:39.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.755+0000 7fbfca7fc700 1 -- 172.21.15.45:0/1968439226 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fbfc4019030 con 0x7fbfd415c9b0 2023-11-28T12:09:39.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.756+0000 7fbfca7fc700 1 --2- 172.21.15.45:0/1968439226 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fbfb80682f0 0x7fbfb806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:39.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.756+0000 7fbfca7fc700 1 -- 172.21.15.45:0/1968439226 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbfc4084eb0 con 0x7fbfd415c9b0 2023-11-28T12:09:39.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.756+0000 7fbfd9d9b700 1 --2- 172.21.15.45:0/1968439226 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fbfb80682f0 0x7fbfb806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:39.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.757+0000 7fbfd9d9b700 1 --2- 172.21.15.45:0/1968439226 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fbfb80682f0 0x7fbfb806a7a0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fbfd00090b0 tx=0x7fbfd001c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:39.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.760+0000 7fbfca7fc700 1 -- 172.21.15.45:0/1968439226 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fbfc404b5e0 con 0x7fbfd415c9b0 2023-11-28T12:09:39.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.956+0000 7fbfdbfff700 1 -- 172.21.15.45:0/1968439226 --> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbfd40745c0 con 0x7fbfb80682f0 2023-11-28T12:09:39.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.967+0000 7fbfca7fc700 1 -- 172.21.15.45:0/1968439226 <== mgr.4100 v2:172.21.15.152:6832/115389 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311177 (secure 0 0 0) 0x7fbfd40745c0 con 0x7fbfb80682f0 2023-11-28T12:09:39.973 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:09:39.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.972+0000 7fbfdbfff700 1 -- 172.21.15.45:0/1968439226 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fbfb80682f0 msgr2=0x7fbfb806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:39.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.972+0000 7fbfdbfff700 1 --2- 172.21.15.45:0/1968439226 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fbfb80682f0 0x7fbfb806a7a0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fbfd00090b0 tx=0x7fbfd001c040 comp rx=0 tx=0).stop 2023-11-28T12:09:39.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.972+0000 7fbfdbfff700 1 -- 172.21.15.45:0/1968439226 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfd415c9b0 msgr2=0x7fbfd41e6480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:39.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.972+0000 7fbfdbfff700 1 --2- 172.21.15.45:0/1968439226 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfd415c9b0 0x7fbfd41e6480 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fbfc400c520 tx=0x7fbfc400c830 comp rx=0 tx=0).stop 2023-11-28T12:09:39.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.972+0000 7fbfdbfff700 1 -- 172.21.15.45:0/1968439226 shutdown_connections 2023-11-28T12:09:39.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.972+0000 7fbfdbfff700 1 --2- 172.21.15.45:0/1968439226 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fbfb80682f0 0x7fbfb806a7a0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:39.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.972+0000 7fbfdbfff700 1 --2- 172.21.15.45:0/1968439226 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbfd4161340 0x7fbfd4159560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:39.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.972+0000 7fbfdbfff700 1 --2- 172.21.15.45:0/1968439226 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbfd40cd7c0 0x7fbfd4147430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:39.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.972+0000 7fbfdbfff700 1 --2- 172.21.15.45:0/1968439226 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbfd415c9b0 0x7fbfd41e6480 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:39.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.972+0000 7fbfdbfff700 1 -- 172.21.15.45:0/1968439226 >> 172.21.15.45:0/1968439226 conn(0x7fbfd4072600 msgr2=0x7fbfd40b5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:39.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.972+0000 7fbfdbfff700 1 -- 172.21.15.45:0/1968439226 shutdown_connections 2023-11-28T12:09:39.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:39.972+0000 7fbfdbfff700 1 -- 172.21.15.45:0/1968439226 wait complete. 2023-11-28T12:09:39.977 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-11-28T12:09:39.990 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":153,"stamp":"2023-11-28T12:09:38.472821+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":98816,"kb_used_data":6848,"kb_used_omap":0,"kb_used_meta":91904,"kb_avail":754875904,"statfs":{"total":773094113280,"available":772992925696,"internally_reserved":0,"allocated":7012352,"data_stored":3731130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":94109696},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.427562"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.598042+0000","last_change":"2023-11-28T12:09:35.595116+0000","last_active":"2023-11-28T12:09:35.598042+0000","last_peered":"2023-11-28T12:09:35.598042+0000","last_clean":"2023-11-28T12:09:35.598042+0000","last_became_active":"2023-11-28T12:09:35.594780+0000","last_became_peered":"2023-11-28T12:09:35.594780+0000","last_unstale":"2023-11-28T12:09:35.598042+0000","last_undegraded":"2023-11-28T12:09:35.598042+0000","last_fullsized":"2023-11-28T12:09:35.598042+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:01:48.350829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.601563+0000","last_change":"2023-11-28T12:09:35.597748+0000","last_active":"2023-11-28T12:09:35.601563+0000","last_peered":"2023-11-28T12:09:35.601563+0000","last_clean":"2023-11-28T12:09:35.601563+0000","last_became_active":"2023-11-28T12:09:35.597176+0000","last_became_peered":"2023-11-28T12:09:35.597176+0000","last_unstale":"2023-11-28T12:09:35.601563+0000","last_undegraded":"2023-11-28T12:09:35.601563+0000","last_fullsized":"2023-11-28T12:09:35.601563+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:35:55.989102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.606251+0000","last_change":"2023-11-28T12:09:35.600872+0000","last_active":"2023-11-28T12:09:35.606251+0000","last_peered":"2023-11-28T12:09:35.606251+0000","last_clean":"2023-11-28T12:09:35.606251+0000","last_became_active":"2023-11-28T12:09:35.600525+0000","last_became_peered":"2023-11-28T12:09:35.600525+0000","last_unstale":"2023-11-28T12:09:35.606251+0000","last_undegraded":"2023-11-28T12:09:35.606251+0000","last_fullsized":"2023-11-28T12:09:35.606251+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:15:08.714733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.602872+0000","last_change":"2023-11-28T12:09:35.594238+0000","last_active":"2023-11-28T12:09:35.602872+0000","last_peered":"2023-11-28T12:09:35.602872+0000","last_clean":"2023-11-28T12:09:35.602872+0000","last_became_active":"2023-11-28T12:09:35.593902+0000","last_became_peered":"2023-11-28T12:09:35.593902+0000","last_unstale":"2023-11-28T12:09:35.602872+0000","last_undegraded":"2023-11-28T12:09:35.602872+0000","last_fullsized":"2023-11-28T12:09:35.602872+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:15:08.714733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.603818+0000","last_change":"2023-11-28T12:09:35.595889+0000","last_active":"2023-11-28T12:09:35.603818+0000","last_peered":"2023-11-28T12:09:35.603818+0000","last_clean":"2023-11-28T12:09:35.603818+0000","last_became_active":"2023-11-28T12:09:35.595563+0000","last_became_peered":"2023-11-28T12:09:35.595563+0000","last_unstale":"2023-11-28T12:09:35.603818+0000","last_undegraded":"2023-11-28T12:09:35.603818+0000","last_fullsized":"2023-11-28T12:09:35.603818+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:24:50.601237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.597237+0000","last_change":"2023-11-28T12:09:35.592497+0000","last_active":"2023-11-28T12:09:35.597237+0000","last_peered":"2023-11-28T12:09:35.597237+0000","last_clean":"2023-11-28T12:09:35.597237+0000","last_became_active":"2023-11-28T12:09:35.592221+0000","last_became_peered":"2023-11-28T12:09:35.592221+0000","last_unstale":"2023-11-28T12:09:35.597237+0000","last_undegraded":"2023-11-28T12:09:35.597237+0000","last_fullsized":"2023-11-28T12:09:35.597237+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:11:59.216802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.606986+0000","last_change":"2023-11-28T12:09:35.605258+0000","last_active":"2023-11-28T12:09:35.606986+0000","last_peered":"2023-11-28T12:09:35.606986+0000","last_clean":"2023-11-28T12:09:35.606986+0000","last_became_active":"2023-11-28T12:09:35.604947+0000","last_became_peered":"2023-11-28T12:09:35.604947+0000","last_unstale":"2023-11-28T12:09:35.606986+0000","last_undegraded":"2023-11-28T12:09:35.606986+0000","last_fullsized":"2023-11-28T12:09:35.606986+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:21:35.214839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.614298+0000","last_change":"2023-11-28T12:09:35.605373+0000","last_active":"2023-11-28T12:09:35.614298+0000","last_peered":"2023-11-28T12:09:35.614298+0000","last_clean":"2023-11-28T12:09:35.614298+0000","last_became_active":"2023-11-28T12:09:35.605020+0000","last_became_peered":"2023-11-28T12:09:35.605020+0000","last_unstale":"2023-11-28T12:09:35.614298+0000","last_undegraded":"2023-11-28T12:09:35.614298+0000","last_fullsized":"2023-11-28T12:09:35.614298+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:12:47.813018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.607132+0000","last_change":"2023-11-28T12:09:35.603326+0000","last_active":"2023-11-28T12:09:35.607132+0000","last_peered":"2023-11-28T12:09:35.607132+0000","last_clean":"2023-11-28T12:09:35.607132+0000","last_became_active":"2023-11-28T12:09:35.602989+0000","last_became_peered":"2023-11-28T12:09:35.602989+0000","last_unstale":"2023-11-28T12:09:35.607132+0000","last_undegraded":"2023-11-28T12:09:35.607132+0000","last_fullsized":"2023-11-28T12:09:35.607132+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:22:03.453096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.597410+0000","last_change":"2023-11-28T12:09:35.592496+0000","last_active":"2023-11-28T12:09:35.597410+0000","last_peered":"2023-11-28T12:09:35.597410+0000","last_clean":"2023-11-28T12:09:35.597410+0000","last_became_active":"2023-11-28T12:09:35.591718+0000","last_became_peered":"2023-11-28T12:09:35.591718+0000","last_unstale":"2023-11-28T12:09:35.597410+0000","last_undegraded":"2023-11-28T12:09:35.597410+0000","last_fullsized":"2023-11-28T12:09:35.597410+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:28:37.665904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.602481+0000","last_change":"2023-11-28T12:09:35.593530+0000","last_active":"2023-11-28T12:09:35.602481+0000","last_peered":"2023-11-28T12:09:35.602481+0000","last_clean":"2023-11-28T12:09:35.602481+0000","last_became_active":"2023-11-28T12:09:35.591417+0000","last_became_peered":"2023-11-28T12:09:35.591417+0000","last_unstale":"2023-11-28T12:09:35.602481+0000","last_undegraded":"2023-11-28T12:09:35.602481+0000","last_fullsized":"2023-11-28T12:09:35.602481+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:19:11.426595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.612162+0000","last_change":"2023-11-28T12:09:35.602549+0000","last_active":"2023-11-28T12:09:35.612162+0000","last_peered":"2023-11-28T12:09:35.612162+0000","last_clean":"2023-11-28T12:09:35.612162+0000","last_became_active":"2023-11-28T12:09:35.602239+0000","last_became_peered":"2023-11-28T12:09:35.602239+0000","last_unstale":"2023-11-28T12:09:35.612162+0000","last_undegraded":"2023-11-28T12:09:35.612162+0000","last_fullsized":"2023-11-28T12:09:35.612162+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:02:15.142274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.598036+0000","last_change":"2023-11-28T12:09:35.593191+0000","last_active":"2023-11-28T12:09:35.598036+0000","last_peered":"2023-11-28T12:09:35.598036+0000","last_clean":"2023-11-28T12:09:35.598036+0000","last_became_active":"2023-11-28T12:09:35.592918+0000","last_became_peered":"2023-11-28T12:09:35.592918+0000","last_unstale":"2023-11-28T12:09:35.598036+0000","last_undegraded":"2023-11-28T12:09:35.598036+0000","last_fullsized":"2023-11-28T12:09:35.598036+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:08:23.743352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.605232+0000","last_change":"2023-11-28T12:09:35.599407+0000","last_active":"2023-11-28T12:09:35.605232+0000","last_peered":"2023-11-28T12:09:35.605232+0000","last_clean":"2023-11-28T12:09:35.605232+0000","last_became_active":"2023-11-28T12:09:35.599127+0000","last_became_peered":"2023-11-28T12:09:35.599127+0000","last_unstale":"2023-11-28T12:09:35.605232+0000","last_undegraded":"2023-11-28T12:09:35.605232+0000","last_fullsized":"2023-11-28T12:09:35.605232+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:20:46.437910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.604218+0000","last_change":"2023-11-28T12:09:35.599100+0000","last_active":"2023-11-28T12:09:35.604218+0000","last_peered":"2023-11-28T12:09:35.604218+0000","last_clean":"2023-11-28T12:09:35.604218+0000","last_became_active":"2023-11-28T12:09:35.598659+0000","last_became_peered":"2023-11-28T12:09:35.598659+0000","last_unstale":"2023-11-28T12:09:35.604218+0000","last_undegraded":"2023-11-28T12:09:35.604218+0000","last_fullsized":"2023-11-28T12:09:35.604218+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:19:34.215973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.602583+0000","last_change":"2023-11-28T12:09:35.599123+0000","last_active":"2023-11-28T12:09:35.602583+0000","last_peered":"2023-11-28T12:09:35.602583+0000","last_clean":"2023-11-28T12:09:35.602583+0000","last_became_active":"2023-11-28T12:09:35.595879+0000","last_became_peered":"2023-11-28T12:09:35.595879+0000","last_unstale":"2023-11-28T12:09:35.602583+0000","last_undegraded":"2023-11-28T12:09:35.602583+0000","last_fullsized":"2023-11-28T12:09:35.602583+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:41:18.178376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.601612+0000","last_change":"2023-11-28T12:09:35.597330+0000","last_active":"2023-11-28T12:09:35.601612+0000","last_peered":"2023-11-28T12:09:35.601612+0000","last_clean":"2023-11-28T12:09:35.601612+0000","last_became_active":"2023-11-28T12:09:35.596902+0000","last_became_peered":"2023-11-28T12:09:35.596902+0000","last_unstale":"2023-11-28T12:09:35.601612+0000","last_undegraded":"2023-11-28T12:09:35.601612+0000","last_fullsized":"2023-11-28T12:09:35.601612+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:46:05.667553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.603200+0000","last_change":"2023-11-28T12:09:35.597284+0000","last_active":"2023-11-28T12:09:35.603200+0000","last_peered":"2023-11-28T12:09:35.603200+0000","last_clean":"2023-11-28T12:09:35.603200+0000","last_became_active":"2023-11-28T12:09:35.596818+0000","last_became_peered":"2023-11-28T12:09:35.596818+0000","last_unstale":"2023-11-28T12:09:35.603200+0000","last_undegraded":"2023-11-28T12:09:35.603200+0000","last_fullsized":"2023-11-28T12:09:35.603200+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:02:15.142274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.603921+0000","last_change":"2023-11-28T12:09:35.597932+0000","last_active":"2023-11-28T12:09:35.603921+0000","last_peered":"2023-11-28T12:09:35.603921+0000","last_clean":"2023-11-28T12:09:35.603921+0000","last_became_active":"2023-11-28T12:09:35.597500+0000","last_became_peered":"2023-11-28T12:09:35.597500+0000","last_unstale":"2023-11-28T12:09:35.603921+0000","last_undegraded":"2023-11-28T12:09:35.603921+0000","last_fullsized":"2023-11-28T12:09:35.603921+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:43:19.346774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.588823+0000","last_change":"2023-11-28T12:09:35.586753+0000","last_active":"2023-11-28T12:09:35.588823+0000","last_peered":"2023-11-28T12:09:35.588823+0000","last_clean":"2023-11-28T12:09:35.588823+0000","last_became_active":"2023-11-28T12:09:35.586448+0000","last_became_peered":"2023-11-28T12:09:35.586448+0000","last_unstale":"2023-11-28T12:09:35.588823+0000","last_undegraded":"2023-11-28T12:09:35.588823+0000","last_fullsized":"2023-11-28T12:09:35.588823+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:29:48.091827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.614176+0000","last_change":"2023-11-28T12:09:35.604141+0000","last_active":"2023-11-28T12:09:35.614176+0000","last_peered":"2023-11-28T12:09:35.614176+0000","last_clean":"2023-11-28T12:09:35.614176+0000","last_became_active":"2023-11-28T12:09:35.603876+0000","last_became_peered":"2023-11-28T12:09:35.603876+0000","last_unstale":"2023-11-28T12:09:35.614176+0000","last_undegraded":"2023-11-28T12:09:35.614176+0000","last_fullsized":"2023-11-28T12:09:35.614176+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:26:24.199422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.596351+0000","last_change":"2023-11-28T12:09:35.590633+0000","last_active":"2023-11-28T12:09:35.596351+0000","last_peered":"2023-11-28T12:09:35.596351+0000","last_clean":"2023-11-28T12:09:35.596351+0000","last_became_active":"2023-11-28T12:09:35.590361+0000","last_became_peered":"2023-11-28T12:09:35.590361+0000","last_unstale":"2023-11-28T12:09:35.596351+0000","last_undegraded":"2023-11-28T12:09:35.596351+0000","last_fullsized":"2023-11-28T12:09:35.596351+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:55:47.755954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.601238+0000","last_change":"2023-11-28T12:09:35.596799+0000","last_active":"2023-11-28T12:09:35.601238+0000","last_peered":"2023-11-28T12:09:35.601238+0000","last_clean":"2023-11-28T12:09:35.601238+0000","last_became_active":"2023-11-28T12:09:35.596511+0000","last_became_peered":"2023-11-28T12:09:35.596511+0000","last_unstale":"2023-11-28T12:09:35.601238+0000","last_undegraded":"2023-11-28T12:09:35.601238+0000","last_fullsized":"2023-11-28T12:09:35.601238+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:46:42.416906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.604282+0000","last_change":"2023-11-28T12:09:35.600348+0000","last_active":"2023-11-28T12:09:35.604282+0000","last_peered":"2023-11-28T12:09:35.604282+0000","last_clean":"2023-11-28T12:09:35.604282+0000","last_became_active":"2023-11-28T12:09:35.599977+0000","last_became_peered":"2023-11-28T12:09:35.599977+0000","last_unstale":"2023-11-28T12:09:35.604282+0000","last_undegraded":"2023-11-28T12:09:35.604282+0000","last_fullsized":"2023-11-28T12:09:35.604282+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:58:50.322217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.614270+0000","last_change":"2023-11-28T12:09:35.605095+0000","last_active":"2023-11-28T12:09:35.614270+0000","last_peered":"2023-11-28T12:09:35.614270+0000","last_clean":"2023-11-28T12:09:35.614270+0000","last_became_active":"2023-11-28T12:09:35.604455+0000","last_became_peered":"2023-11-28T12:09:35.604455+0000","last_unstale":"2023-11-28T12:09:35.614270+0000","last_undegraded":"2023-11-28T12:09:35.614270+0000","last_fullsized":"2023-11-28T12:09:35.614270+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:13:37.049227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.614338+0000","last_change":"2023-11-28T12:09:35.605602+0000","last_active":"2023-11-28T12:09:35.614338+0000","last_peered":"2023-11-28T12:09:35.614338+0000","last_clean":"2023-11-28T12:09:35.614338+0000","last_became_active":"2023-11-28T12:09:35.605066+0000","last_became_peered":"2023-11-28T12:09:35.605066+0000","last_unstale":"2023-11-28T12:09:35.614338+0000","last_undegraded":"2023-11-28T12:09:35.614338+0000","last_fullsized":"2023-11-28T12:09:35.614338+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:19:11.426595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.604163+0000","last_change":"2023-11-28T12:09:35.599439+0000","last_active":"2023-11-28T12:09:35.604163+0000","last_peered":"2023-11-28T12:09:35.604163+0000","last_clean":"2023-11-28T12:09:35.604163+0000","last_became_active":"2023-11-28T12:09:35.599175+0000","last_became_peered":"2023-11-28T12:09:35.599175+0000","last_unstale":"2023-11-28T12:09:35.604163+0000","last_undegraded":"2023-11-28T12:09:35.604163+0000","last_fullsized":"2023-11-28T12:09:35.604163+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:13:37.049227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.607483+0000","last_change":"2023-11-28T12:09:35.606174+0000","last_active":"2023-11-28T12:09:35.607483+0000","last_peered":"2023-11-28T12:09:35.607483+0000","last_clean":"2023-11-28T12:09:35.607483+0000","last_became_active":"2023-11-28T12:09:35.605465+0000","last_became_peered":"2023-11-28T12:09:35.605465+0000","last_unstale":"2023-11-28T12:09:35.607483+0000","last_undegraded":"2023-11-28T12:09:35.607483+0000","last_fullsized":"2023-11-28T12:09:35.607483+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:34:17.964248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.604168+0000","last_change":"2023-11-28T12:09:35.598037+0000","last_active":"2023-11-28T12:09:35.604168+0000","last_peered":"2023-11-28T12:09:35.604168+0000","last_clean":"2023-11-28T12:09:35.604168+0000","last_became_active":"2023-11-28T12:09:35.597630+0000","last_became_peered":"2023-11-28T12:09:35.597630+0000","last_unstale":"2023-11-28T12:09:35.604168+0000","last_undegraded":"2023-11-28T12:09:35.604168+0000","last_fullsized":"2023-11-28T12:09:35.604168+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:42:27.807000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.614363+0000","last_change":"2023-11-28T12:09:35.609588+0000","last_active":"2023-11-28T12:09:35.614363+0000","last_peered":"2023-11-28T12:09:35.614363+0000","last_clean":"2023-11-28T12:09:35.614363+0000","last_became_active":"2023-11-28T12:09:35.607007+0000","last_became_peered":"2023-11-28T12:09:35.607007+0000","last_unstale":"2023-11-28T12:09:35.614363+0000","last_undegraded":"2023-11-28T12:09:35.614363+0000","last_fullsized":"2023-11-28T12:09:35.614363+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:56:16.059248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.606023+0000","last_change":"2023-11-28T12:09:35.602114+0000","last_active":"2023-11-28T12:09:35.606023+0000","last_peered":"2023-11-28T12:09:35.606023+0000","last_clean":"2023-11-28T12:09:35.606023+0000","last_became_active":"2023-11-28T12:09:35.598483+0000","last_became_peered":"2023-11-28T12:09:35.598483+0000","last_unstale":"2023-11-28T12:09:35.606023+0000","last_undegraded":"2023-11-28T12:09:35.606023+0000","last_fullsized":"2023-11-28T12:09:35.606023+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:56:16.059248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.601798+0000","last_change":"2023-11-28T12:09:35.595357+0000","last_active":"2023-11-28T12:09:35.601798+0000","last_peered":"2023-11-28T12:09:35.601798+0000","last_clean":"2023-11-28T12:09:35.601798+0000","last_became_active":"2023-11-28T12:09:35.595053+0000","last_became_peered":"2023-11-28T12:09:35.595053+0000","last_unstale":"2023-11-28T12:09:35.601798+0000","last_undegraded":"2023-11-28T12:09:35.601798+0000","last_fullsized":"2023-11-28T12:09:35.601798+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:26:23.256385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.603702+0000","last_change":"2023-11-28T12:09:35.596958+0000","last_active":"2023-11-28T12:09:35.603702+0000","last_peered":"2023-11-28T12:09:35.603702+0000","last_clean":"2023-11-28T12:09:35.603702+0000","last_became_active":"2023-11-28T12:09:35.596693+0000","last_became_peered":"2023-11-28T12:09:35.596693+0000","last_unstale":"2023-11-28T12:09:35.603702+0000","last_undegraded":"2023-11-28T12:09:35.603702+0000","last_fullsized":"2023-11-28T12:09:35.603702+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:11:13.531310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"60'4","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.607168+0000","last_change":"2023-11-28T12:09:35.073218+0000","last_active":"2023-11-28T12:09:35.607168+0000","last_peered":"2023-11-28T12:09:35.607168+0000","last_clean":"2023-11-28T12:09:35.607168+0000","last_became_active":"2023-11-28T12:09:35.072943+0000","last_became_peered":"2023-11-28T12:09:35.072943+0000","last_unstale":"2023-11-28T12:09:35.607168+0000","last_undegraded":"2023-11-28T12:09:35.607168+0000","last_fullsized":"2023-11-28T12:09:35.607168+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_clean_scrub_stamp":"2023-11-28T12:09:34.041090+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:47:41.658363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.602503+0000","last_change":"2023-11-28T12:09:35.593833+0000","last_active":"2023-11-28T12:09:35.602503+0000","last_peered":"2023-11-28T12:09:35.602503+0000","last_clean":"2023-11-28T12:09:35.602503+0000","last_became_active":"2023-11-28T12:09:35.591321+0000","last_became_peered":"2023-11-28T12:09:35.591321+0000","last_unstale":"2023-11-28T12:09:35.602503+0000","last_undegraded":"2023-11-28T12:09:35.602503+0000","last_fullsized":"2023-11-28T12:09:35.602503+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:08:23.743352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"60'1","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.608472+0000","last_change":"2023-11-28T12:09:35.066239+0000","last_active":"2023-11-28T12:09:35.608472+0000","last_peered":"2023-11-28T12:09:35.608472+0000","last_clean":"2023-11-28T12:09:35.608472+0000","last_became_active":"2023-11-28T12:09:35.065267+0000","last_became_peered":"2023-11-28T12:09:35.065267+0000","last_unstale":"2023-11-28T12:09:35.608472+0000","last_undegraded":"2023-11-28T12:09:35.608472+0000","last_fullsized":"2023-11-28T12:09:35.608472+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_clean_scrub_stamp":"2023-11-28T12:09:34.041090+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:58:49.319390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.604475+0000","last_change":"2023-11-28T12:09:35.596127+0000","last_active":"2023-11-28T12:09:35.604475+0000","last_peered":"2023-11-28T12:09:35.604475+0000","last_clean":"2023-11-28T12:09:35.604475+0000","last_became_active":"2023-11-28T12:09:35.595839+0000","last_became_peered":"2023-11-28T12:09:35.595839+0000","last_unstale":"2023-11-28T12:09:35.604475+0000","last_undegraded":"2023-11-28T12:09:35.604475+0000","last_fullsized":"2023-11-28T12:09:35.604475+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:42:58.688632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"60'2","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.603643+0000","last_change":"2023-11-28T12:09:35.071352+0000","last_active":"2023-11-28T12:09:35.603643+0000","last_peered":"2023-11-28T12:09:35.603643+0000","last_clean":"2023-11-28T12:09:35.603643+0000","last_became_active":"2023-11-28T12:09:35.070486+0000","last_became_peered":"2023-11-28T12:09:35.070486+0000","last_unstale":"2023-11-28T12:09:35.603643+0000","last_undegraded":"2023-11-28T12:09:35.603643+0000","last_fullsized":"2023-11-28T12:09:35.603643+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_clean_scrub_stamp":"2023-11-28T12:09:34.041090+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:19:33.213147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.605831+0000","last_change":"2023-11-28T12:09:35.595369+0000","last_active":"2023-11-28T12:09:35.605831+0000","last_peered":"2023-11-28T12:09:35.605831+0000","last_clean":"2023-11-28T12:09:35.605831+0000","last_became_active":"2023-11-28T12:09:35.595094+0000","last_became_peered":"2023-11-28T12:09:35.595094+0000","last_unstale":"2023-11-28T12:09:35.605831+0000","last_undegraded":"2023-11-28T12:09:35.605831+0000","last_fullsized":"2023-11-28T12:09:35.605831+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:46:42.416906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"60'2","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.605646+0000","last_change":"2023-11-28T12:09:35.067283+0000","last_active":"2023-11-28T12:09:35.605646+0000","last_peered":"2023-11-28T12:09:35.605646+0000","last_clean":"2023-11-28T12:09:35.605646+0000","last_became_active":"2023-11-28T12:09:35.067009+0000","last_became_peered":"2023-11-28T12:09:35.067009+0000","last_unstale":"2023-11-28T12:09:35.605646+0000","last_undegraded":"2023-11-28T12:09:35.605646+0000","last_fullsized":"2023-11-28T12:09:35.605646+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_clean_scrub_stamp":"2023-11-28T12:09:34.041090+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:42:26.804173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.602601+0000","last_change":"2023-11-28T12:09:35.600462+0000","last_active":"2023-11-28T12:09:35.602601+0000","last_peered":"2023-11-28T12:09:35.602601+0000","last_clean":"2023-11-28T12:09:35.602601+0000","last_became_active":"2023-11-28T12:09:35.599343+0000","last_became_peered":"2023-11-28T12:09:35.599343+0000","last_unstale":"2023-11-28T12:09:35.602601+0000","last_undegraded":"2023-11-28T12:09:35.602601+0000","last_fullsized":"2023-11-28T12:09:35.602601+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:01:42.019908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"60'1","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.604184+0000","last_change":"2023-11-28T12:09:35.058384+0000","last_active":"2023-11-28T12:09:35.604184+0000","last_peered":"2023-11-28T12:09:35.604184+0000","last_clean":"2023-11-28T12:09:35.604184+0000","last_became_active":"2023-11-28T12:09:35.058078+0000","last_became_peered":"2023-11-28T12:09:35.058078+0000","last_unstale":"2023-11-28T12:09:35.604184+0000","last_undegraded":"2023-11-28T12:09:35.604184+0000","last_fullsized":"2023-11-28T12:09:35.604184+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_clean_scrub_stamp":"2023-11-28T12:09:34.041090+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:04:30.813868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.601468+0000","last_change":"2023-11-28T12:09:35.597995+0000","last_active":"2023-11-28T12:09:35.601468+0000","last_peered":"2023-11-28T12:09:35.601468+0000","last_clean":"2023-11-28T12:09:35.601468+0000","last_became_active":"2023-11-28T12:09:35.596778+0000","last_became_peered":"2023-11-28T12:09:35.596778+0000","last_unstale":"2023-11-28T12:09:35.601468+0000","last_undegraded":"2023-11-28T12:09:35.601468+0000","last_fullsized":"2023-11-28T12:09:35.601468+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:38:35.572106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"60'1","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.601438+0000","last_change":"2023-11-28T12:09:35.072987+0000","last_active":"2023-11-28T12:09:35.601438+0000","last_peered":"2023-11-28T12:09:35.601438+0000","last_clean":"2023-11-28T12:09:35.601438+0000","last_became_active":"2023-11-28T12:09:35.067900+0000","last_became_peered":"2023-11-28T12:09:35.067900+0000","last_unstale":"2023-11-28T12:09:35.601438+0000","last_undegraded":"2023-11-28T12:09:35.601438+0000","last_fullsized":"2023-11-28T12:09:35.601438+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_clean_scrub_stamp":"2023-11-28T12:09:34.041090+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:15:07.711906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.603930+0000","last_change":"2023-11-28T12:09:35.595743+0000","last_active":"2023-11-28T12:09:35.603930+0000","last_peered":"2023-11-28T12:09:35.603930+0000","last_clean":"2023-11-28T12:09:35.603930+0000","last_became_active":"2023-11-28T12:09:35.595443+0000","last_became_peered":"2023-11-28T12:09:35.595443+0000","last_unstale":"2023-11-28T12:09:35.603930+0000","last_undegraded":"2023-11-28T12:09:35.603930+0000","last_fullsized":"2023-11-28T12:09:35.603930+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:34:36.189661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.576611+0000","last_change":"2023-11-28T12:09:35.071465+0000","last_active":"2023-11-28T12:09:35.576611+0000","last_peered":"2023-11-28T12:09:35.576611+0000","last_clean":"2023-11-28T12:09:35.576611+0000","last_became_active":"2023-11-28T12:09:35.071101+0000","last_became_peered":"2023-11-28T12:09:35.071101+0000","last_unstale":"2023-11-28T12:09:35.576611+0000","last_undegraded":"2023-11-28T12:09:35.576611+0000","last_fullsized":"2023-11-28T12:09:35.576611+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_clean_scrub_stamp":"2023-11-28T12:09:34.041090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:13:36.046400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.599221+0000","last_change":"2023-11-28T12:09:35.593571+0000","last_active":"2023-11-28T12:09:35.599221+0000","last_peered":"2023-11-28T12:09:35.599221+0000","last_clean":"2023-11-28T12:09:35.599221+0000","last_became_active":"2023-11-28T12:09:35.593312+0000","last_became_peered":"2023-11-28T12:09:35.593312+0000","last_unstale":"2023-11-28T12:09:35.599221+0000","last_undegraded":"2023-11-28T12:09:35.599221+0000","last_fullsized":"2023-11-28T12:09:35.599221+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:49:52.632769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.580268+0000","last_change":"2023-11-28T12:09:35.076438+0000","last_active":"2023-11-28T12:09:35.580268+0000","last_peered":"2023-11-28T12:09:35.580268+0000","last_clean":"2023-11-28T12:09:35.580268+0000","last_became_active":"2023-11-28T12:09:35.074033+0000","last_became_peered":"2023-11-28T12:09:35.074033+0000","last_unstale":"2023-11-28T12:09:35.580268+0000","last_undegraded":"2023-11-28T12:09:35.580268+0000","last_fullsized":"2023-11-28T12:09:35.580268+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_clean_scrub_stamp":"2023-11-28T12:09:34.041090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:59:01.370346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.608534+0000","last_change":"2023-11-28T12:09:35.606365+0000","last_active":"2023-11-28T12:09:35.608534+0000","last_peered":"2023-11-28T12:09:35.608534+0000","last_clean":"2023-11-28T12:09:35.608534+0000","last_became_active":"2023-11-28T12:09:35.605899+0000","last_became_peered":"2023-11-28T12:09:35.605899+0000","last_unstale":"2023-11-28T12:09:35.608534+0000","last_undegraded":"2023-11-28T12:09:35.608534+0000","last_fullsized":"2023-11-28T12:09:35.608534+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:11:13.531310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.586897+0000","last_change":"2023-11-28T12:09:35.077535+0000","last_active":"2023-11-28T12:09:35.586897+0000","last_peered":"2023-11-28T12:09:35.586897+0000","last_clean":"2023-11-28T12:09:35.586897+0000","last_became_active":"2023-11-28T12:09:35.077273+0000","last_became_peered":"2023-11-28T12:09:35.077273+0000","last_unstale":"2023-11-28T12:09:35.586897+0000","last_undegraded":"2023-11-28T12:09:35.586897+0000","last_fullsized":"2023-11-28T12:09:35.586897+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_clean_scrub_stamp":"2023-11-28T12:09:34.041090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:01:47.348003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.602136+0000","last_change":"2023-11-28T12:09:35.600835+0000","last_active":"2023-11-28T12:09:35.602136+0000","last_peered":"2023-11-28T12:09:35.602136+0000","last_clean":"2023-11-28T12:09:35.602136+0000","last_became_active":"2023-11-28T12:09:35.600300+0000","last_became_peered":"2023-11-28T12:09:35.600300+0000","last_unstale":"2023-11-28T12:09:35.602136+0000","last_undegraded":"2023-11-28T12:09:35.602136+0000","last_fullsized":"2023-11-28T12:09:35.602136+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:22:03.453096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.587639+0000","last_change":"2023-11-28T12:09:35.072627+0000","last_active":"2023-11-28T12:09:35.587639+0000","last_peered":"2023-11-28T12:09:35.587639+0000","last_clean":"2023-11-28T12:09:35.587639+0000","last_became_active":"2023-11-28T12:09:35.072353+0000","last_became_peered":"2023-11-28T12:09:35.072353+0000","last_unstale":"2023-11-28T12:09:35.587639+0000","last_undegraded":"2023-11-28T12:09:35.587639+0000","last_fullsized":"2023-11-28T12:09:35.587639+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_clean_scrub_stamp":"2023-11-28T12:09:34.041090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:10:44.467012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.602910+0000","last_change":"2023-11-28T12:09:35.593031+0000","last_active":"2023-11-28T12:09:35.602910+0000","last_peered":"2023-11-28T12:09:35.602910+0000","last_clean":"2023-11-28T12:09:35.602910+0000","last_became_active":"2023-11-28T12:09:35.592778+0000","last_became_peered":"2023-11-28T12:09:35.592778+0000","last_unstale":"2023-11-28T12:09:35.602910+0000","last_undegraded":"2023-11-28T12:09:35.602910+0000","last_fullsized":"2023-11-28T12:09:35.602910+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:01:48.350829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"60'3","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.614654+0000","last_change":"2023-11-28T12:09:35.075883+0000","last_active":"2023-11-28T12:09:35.614654+0000","last_peered":"2023-11-28T12:09:35.614654+0000","last_clean":"2023-11-28T12:09:35.614654+0000","last_became_active":"2023-11-28T12:09:35.075571+0000","last_became_peered":"2023-11-28T12:09:35.075571+0000","last_unstale":"2023-11-28T12:09:35.614654+0000","last_undegraded":"2023-11-28T12:09:35.614654+0000","last_fullsized":"2023-11-28T12:09:35.614654+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_clean_scrub_stamp":"2023-11-28T12:09:34.041090+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:11:12.528484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.601411+0000","last_change":"2023-11-28T12:09:35.593656+0000","last_active":"2023-11-28T12:09:35.601411+0000","last_peered":"2023-11-28T12:09:35.601411+0000","last_clean":"2023-11-28T12:09:35.601411+0000","last_became_active":"2023-11-28T12:09:35.591170+0000","last_became_peered":"2023-11-28T12:09:35.591170+0000","last_unstale":"2023-11-28T12:09:35.601411+0000","last_undegraded":"2023-11-28T12:09:35.601411+0000","last_fullsized":"2023-11-28T12:09:35.601411+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:26:24.199422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"60'6","reported_seq":16,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.614588+0000","last_change":"2023-11-28T12:09:35.071862+0000","last_active":"2023-11-28T12:09:35.614588+0000","last_peered":"2023-11-28T12:09:35.614588+0000","last_clean":"2023-11-28T12:09:35.614588+0000","last_became_active":"2023-11-28T12:09:35.071534+0000","last_became_peered":"2023-11-28T12:09:35.071534+0000","last_unstale":"2023-11-28T12:09:35.614588+0000","last_undegraded":"2023-11-28T12:09:35.614588+0000","last_fullsized":"2023-11-28T12:09:35.614588+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_clean_scrub_stamp":"2023-11-28T12:09:34.041090+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:47:37.925397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.603597+0000","last_change":"2023-11-28T12:09:35.598095+0000","last_active":"2023-11-28T12:09:35.603597+0000","last_peered":"2023-11-28T12:09:35.603597+0000","last_clean":"2023-11-28T12:09:35.603597+0000","last_became_active":"2023-11-28T12:09:35.597832+0000","last_became_peered":"2023-11-28T12:09:35.597832+0000","last_unstale":"2023-11-28T12:09:35.603597+0000","last_undegraded":"2023-11-28T12:09:35.603597+0000","last_fullsized":"2023-11-28T12:09:35.603597+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:04:31.816695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"60'2","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.614572+0000","last_change":"2023-11-28T12:09:35.080855+0000","last_active":"2023-11-28T12:09:35.614572+0000","last_peered":"2023-11-28T12:09:35.614572+0000","last_clean":"2023-11-28T12:09:35.614572+0000","last_became_active":"2023-11-28T12:09:35.080537+0000","last_became_peered":"2023-11-28T12:09:35.080537+0000","last_unstale":"2023-11-28T12:09:35.614572+0000","last_undegraded":"2023-11-28T12:09:35.614572+0000","last_fullsized":"2023-11-28T12:09:35.614572+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_clean_scrub_stamp":"2023-11-28T12:09:34.041090+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:46:04.664726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.611411+0000","last_change":"2023-11-28T12:09:35.599129+0000","last_active":"2023-11-28T12:09:35.611411+0000","last_peered":"2023-11-28T12:09:35.611411+0000","last_clean":"2023-11-28T12:09:35.611411+0000","last_became_active":"2023-11-28T12:09:35.595096+0000","last_became_peered":"2023-11-28T12:09:35.595096+0000","last_unstale":"2023-11-28T12:09:35.611411+0000","last_undegraded":"2023-11-28T12:09:35.611411+0000","last_fullsized":"2023-11-28T12:09:35.611411+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:03:59.390461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.587825+0000","last_change":"2023-11-28T12:09:35.071394+0000","last_active":"2023-11-28T12:09:35.587825+0000","last_peered":"2023-11-28T12:09:35.587825+0000","last_clean":"2023-11-28T12:09:35.587825+0000","last_became_active":"2023-11-28T12:09:35.069623+0000","last_became_peered":"2023-11-28T12:09:35.069623+0000","last_unstale":"2023-11-28T12:09:35.587825+0000","last_undegraded":"2023-11-28T12:09:35.587825+0000","last_fullsized":"2023-11-28T12:09:35.587825+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_clean_scrub_stamp":"2023-11-28T12:09:34.041090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:49:09.687206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.603947+0000","last_change":"2023-11-28T12:09:35.597968+0000","last_active":"2023-11-28T12:09:35.603947+0000","last_peered":"2023-11-28T12:09:35.603947+0000","last_clean":"2023-11-28T12:09:35.603947+0000","last_became_active":"2023-11-28T12:09:35.597701+0000","last_became_peered":"2023-11-28T12:09:35.597701+0000","last_unstale":"2023-11-28T12:09:35.603947+0000","last_undegraded":"2023-11-28T12:09:35.603947+0000","last_fullsized":"2023-11-28T12:09:35.603947+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:24:37.443174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.587976+0000","last_change":"2023-11-28T12:09:35.077932+0000","last_active":"2023-11-28T12:09:35.587976+0000","last_peered":"2023-11-28T12:09:35.587976+0000","last_clean":"2023-11-28T12:09:35.587976+0000","last_became_active":"2023-11-28T12:09:35.077592+0000","last_became_peered":"2023-11-28T12:09:35.077592+0000","last_unstale":"2023-11-28T12:09:35.587976+0000","last_undegraded":"2023-11-28T12:09:35.587976+0000","last_fullsized":"2023-11-28T12:09:35.587976+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_clean_scrub_stamp":"2023-11-28T12:09:34.041090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:24:49.598410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.607508+0000","last_change":"2023-11-28T12:09:35.600167+0000","last_active":"2023-11-28T12:09:35.607508+0000","last_peered":"2023-11-28T12:09:35.607508+0000","last_clean":"2023-11-28T12:09:35.607508+0000","last_became_active":"2023-11-28T12:09:35.596651+0000","last_became_peered":"2023-11-28T12:09:35.596651+0000","last_unstale":"2023-11-28T12:09:35.607508+0000","last_undegraded":"2023-11-28T12:09:35.607508+0000","last_fullsized":"2023-11-28T12:09:35.607508+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:24:50.601237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"60'8","reported_seq":18,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.617281+0000","last_change":"2023-11-28T12:09:35.065438+0000","last_active":"2023-11-28T12:09:35.617281+0000","last_peered":"2023-11-28T12:09:35.617281+0000","last_clean":"2023-11-28T12:09:35.617281+0000","last_became_active":"2023-11-28T12:09:35.065145+0000","last_became_peered":"2023-11-28T12:09:35.065145+0000","last_unstale":"2023-11-28T12:09:35.617281+0000","last_undegraded":"2023-11-28T12:09:35.617281+0000","last_fullsized":"2023-11-28T12:09:35.617281+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_clean_scrub_stamp":"2023-11-28T12:09:34.041090+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:43:18.343948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.602354+0000","last_change":"2023-11-28T12:09:35.594675+0000","last_active":"2023-11-28T12:09:35.602354+0000","last_peered":"2023-11-28T12:09:35.602354+0000","last_clean":"2023-11-28T12:09:35.602354+0000","last_became_active":"2023-11-28T12:09:35.594375+0000","last_became_peered":"2023-11-28T12:09:35.594375+0000","last_unstale":"2023-11-28T12:09:35.602354+0000","last_undegraded":"2023-11-28T12:09:35.602354+0000","last_fullsized":"2023-11-28T12:09:35.602354+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:23:47.188533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"60'2","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.607456+0000","last_change":"2023-11-28T12:09:35.072202+0000","last_active":"2023-11-28T12:09:35.607456+0000","last_peered":"2023-11-28T12:09:35.607456+0000","last_clean":"2023-11-28T12:09:35.607456+0000","last_became_active":"2023-11-28T12:09:35.071917+0000","last_became_peered":"2023-11-28T12:09:35.071917+0000","last_unstale":"2023-11-28T12:09:35.607456+0000","last_undegraded":"2023-11-28T12:09:35.607456+0000","last_fullsized":"2023-11-28T12:09:35.607456+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_clean_scrub_stamp":"2023-11-28T12:09:34.041090+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:11:51.987592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.604930+0000","last_change":"2023-11-28T12:09:35.603636+0000","last_active":"2023-11-28T12:09:35.604930+0000","last_peered":"2023-11-28T12:09:35.604930+0000","last_clean":"2023-11-28T12:09:35.604930+0000","last_became_active":"2023-11-28T12:09:35.603342+0000","last_became_peered":"2023-11-28T12:09:35.603342+0000","last_unstale":"2023-11-28T12:09:35.604930+0000","last_undegraded":"2023-11-28T12:09:35.604930+0000","last_fullsized":"2023-11-28T12:09:35.604930+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:02:11.686264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.588892+0000","last_change":"2023-11-28T12:09:35.065491+0000","last_active":"2023-11-28T12:09:35.588892+0000","last_peered":"2023-11-28T12:09:35.588892+0000","last_clean":"2023-11-28T12:09:35.588892+0000","last_became_active":"2023-11-28T12:09:35.065222+0000","last_became_peered":"2023-11-28T12:09:35.065222+0000","last_unstale":"2023-11-28T12:09:35.588892+0000","last_undegraded":"2023-11-28T12:09:35.588892+0000","last_fullsized":"2023-11-28T12:09:35.588892+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_clean_scrub_stamp":"2023-11-28T12:09:34.041090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:41:01.122493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.612055+0000","last_change":"2023-11-28T12:09:35.601153+0000","last_active":"2023-11-28T12:09:35.612055+0000","last_peered":"2023-11-28T12:09:35.612055+0000","last_clean":"2023-11-28T12:09:35.612055+0000","last_became_active":"2023-11-28T12:09:35.600810+0000","last_became_peered":"2023-11-28T12:09:35.600810+0000","last_unstale":"2023-11-28T12:09:35.612055+0000","last_undegraded":"2023-11-28T12:09:35.612055+0000","last_fullsized":"2023-11-28T12:09:35.612055+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:19:19.390237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.581404+0000","last_change":"2023-11-28T12:09:35.070255+0000","last_active":"2023-11-28T12:09:35.581404+0000","last_peered":"2023-11-28T12:09:35.581404+0000","last_clean":"2023-11-28T12:09:35.581404+0000","last_became_active":"2023-11-28T12:09:35.069816+0000","last_became_peered":"2023-11-28T12:09:35.069816+0000","last_unstale":"2023-11-28T12:09:35.581404+0000","last_undegraded":"2023-11-28T12:09:35.581404+0000","last_fullsized":"2023-11-28T12:09:35.581404+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_clean_scrub_stamp":"2023-11-28T12:09:34.041090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:40:08.857650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.602412+0000","last_change":"2023-11-28T12:09:35.589168+0000","last_active":"2023-11-28T12:09:35.602412+0000","last_peered":"2023-11-28T12:09:35.602412+0000","last_clean":"2023-11-28T12:09:35.602412+0000","last_became_active":"2023-11-28T12:09:35.588800+0000","last_became_peered":"2023-11-28T12:09:35.588800+0000","last_unstale":"2023-11-28T12:09:35.602412+0000","last_undegraded":"2023-11-28T12:09:35.602412+0000","last_fullsized":"2023-11-28T12:09:35.602412+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:12:45.259759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.591534+0000","last_change":"2023-11-28T12:09:35.069619+0000","last_active":"2023-11-28T12:09:35.591534+0000","last_peered":"2023-11-28T12:09:35.591534+0000","last_clean":"2023-11-28T12:09:35.591534+0000","last_became_active":"2023-11-28T12:09:35.069339+0000","last_became_peered":"2023-11-28T12:09:35.069339+0000","last_unstale":"2023-11-28T12:09:35.591534+0000","last_undegraded":"2023-11-28T12:09:35.591534+0000","last_fullsized":"2023-11-28T12:09:35.591534+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_clean_scrub_stamp":"2023-11-28T12:09:34.041090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:34:35.186834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.601665+0000","last_change":"2023-11-28T12:09:35.591228+0000","last_active":"2023-11-28T12:09:35.601665+0000","last_peered":"2023-11-28T12:09:35.601665+0000","last_clean":"2023-11-28T12:09:35.601665+0000","last_became_active":"2023-11-28T12:09:35.590935+0000","last_became_peered":"2023-11-28T12:09:35.590935+0000","last_unstale":"2023-11-28T12:09:35.601665+0000","last_undegraded":"2023-11-28T12:09:35.601665+0000","last_fullsized":"2023-11-28T12:09:35.601665+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:18:38.493867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.585025+0000","last_change":"2023-11-28T12:09:35.078059+0000","last_active":"2023-11-28T12:09:35.585025+0000","last_peered":"2023-11-28T12:09:35.585025+0000","last_clean":"2023-11-28T12:09:35.585025+0000","last_became_active":"2023-11-28T12:09:35.077732+0000","last_became_peered":"2023-11-28T12:09:35.077732+0000","last_unstale":"2023-11-28T12:09:35.585025+0000","last_undegraded":"2023-11-28T12:09:35.585025+0000","last_fullsized":"2023-11-28T12:09:35.585025+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_clean_scrub_stamp":"2023-11-28T12:09:34.041090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:34:16.961421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.603347+0000","last_change":"2023-11-28T12:09:35.596833+0000","last_active":"2023-11-28T12:09:35.603347+0000","last_peered":"2023-11-28T12:09:35.603347+0000","last_clean":"2023-11-28T12:09:35.603347+0000","last_became_active":"2023-11-28T12:09:35.596559+0000","last_became_peered":"2023-11-28T12:09:35.596559+0000","last_unstale":"2023-11-28T12:09:35.603347+0000","last_undegraded":"2023-11-28T12:09:35.603347+0000","last_fullsized":"2023-11-28T12:09:35.603347+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:20:46.437910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.576414+0000","last_change":"2023-11-28T12:09:35.067580+0000","last_active":"2023-11-28T12:09:35.576414+0000","last_peered":"2023-11-28T12:09:35.576414+0000","last_clean":"2023-11-28T12:09:35.576414+0000","last_became_active":"2023-11-28T12:09:35.067228+0000","last_became_peered":"2023-11-28T12:09:35.067228+0000","last_unstale":"2023-11-28T12:09:35.576414+0000","last_undegraded":"2023-11-28T12:09:35.576414+0000","last_fullsized":"2023-11-28T12:09:35.576414+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_clean_scrub_stamp":"2023-11-28T12:09:34.041090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:26:23.196595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.600062+0000","last_change":"2023-11-28T12:09:35.595420+0000","last_active":"2023-11-28T12:09:35.600062+0000","last_peered":"2023-11-28T12:09:35.600062+0000","last_clean":"2023-11-28T12:09:35.600062+0000","last_became_active":"2023-11-28T12:09:35.595119+0000","last_became_peered":"2023-11-28T12:09:35.595119+0000","last_unstale":"2023-11-28T12:09:35.600062+0000","last_undegraded":"2023-11-28T12:09:35.600062+0000","last_fullsized":"2023-11-28T12:09:35.600062+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:22:45.640742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.576718+0000","last_change":"2023-11-28T12:09:35.071056+0000","last_active":"2023-11-28T12:09:35.576718+0000","last_peered":"2023-11-28T12:09:35.576718+0000","last_clean":"2023-11-28T12:09:35.576718+0000","last_became_active":"2023-11-28T12:09:35.070355+0000","last_became_peered":"2023-11-28T12:09:35.070355+0000","last_unstale":"2023-11-28T12:09:35.576718+0000","last_undegraded":"2023-11-28T12:09:35.576718+0000","last_fullsized":"2023-11-28T12:09:35.576718+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_clean_scrub_stamp":"2023-11-28T12:09:34.041090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:08:22.740526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.600040+0000","last_change":"2023-11-28T12:09:35.595214+0000","last_active":"2023-11-28T12:09:35.600040+0000","last_peered":"2023-11-28T12:09:35.600040+0000","last_clean":"2023-11-28T12:09:35.600040+0000","last_became_active":"2023-11-28T12:09:35.594941+0000","last_became_peered":"2023-11-28T12:09:35.594941+0000","last_unstale":"2023-11-28T12:09:35.600040+0000","last_undegraded":"2023-11-28T12:09:35.600040+0000","last_fullsized":"2023-11-28T12:09:35.600040+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:03:43.700658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.584256+0000","last_change":"2023-11-28T12:09:35.078706+0000","last_active":"2023-11-28T12:09:35.584256+0000","last_peered":"2023-11-28T12:09:35.584256+0000","last_clean":"2023-11-28T12:09:35.584256+0000","last_became_active":"2023-11-28T12:09:35.077816+0000","last_became_peered":"2023-11-28T12:09:35.077816+0000","last_unstale":"2023-11-28T12:09:35.584256+0000","last_undegraded":"2023-11-28T12:09:35.584256+0000","last_fullsized":"2023-11-28T12:09:35.584256+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_clean_scrub_stamp":"2023-11-28T12:09:34.041090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:34:04.419751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.597000+0000","last_change":"2023-11-28T12:09:35.592038+0000","last_active":"2023-11-28T12:09:35.597000+0000","last_peered":"2023-11-28T12:09:35.597000+0000","last_clean":"2023-11-28T12:09:35.597000+0000","last_became_active":"2023-11-28T12:09:35.591737+0000","last_became_peered":"2023-11-28T12:09:35.591737+0000","last_unstale":"2023-11-28T12:09:35.597000+0000","last_undegraded":"2023-11-28T12:09:35.597000+0000","last_fullsized":"2023-11-28T12:09:35.597000+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:03:59.390461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"60'1","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.614562+0000","last_change":"2023-11-28T12:09:35.077440+0000","last_active":"2023-11-28T12:09:35.614562+0000","last_peered":"2023-11-28T12:09:35.614562+0000","last_clean":"2023-11-28T12:09:35.614562+0000","last_became_active":"2023-11-28T12:09:35.076989+0000","last_became_peered":"2023-11-28T12:09:35.076989+0000","last_unstale":"2023-11-28T12:09:35.614562+0000","last_undegraded":"2023-11-28T12:09:35.614562+0000","last_fullsized":"2023-11-28T12:09:35.614562+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_clean_scrub_stamp":"2023-11-28T12:09:34.041090+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:38:34.569280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":45,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.061297+0000","last_change":"2023-11-28T12:06:23.961595+0000","last_active":"2023-11-28T12:09:35.061297+0000","last_peered":"2023-11-28T12:09:35.061297+0000","last_clean":"2023-11-28T12:09:35.061297+0000","last_became_active":"2023-11-28T12:06:23.961257+0000","last_became_peered":"2023-11-28T12:06:23.961257+0000","last_unstale":"2023-11-28T12:09:35.061297+0000","last_undegraded":"2023-11-28T12:09:35.061297+0000","last_fullsized":"2023-11-28T12:09:35.061297+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:30:40.200095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.602391+0000","last_change":"2023-11-28T12:09:35.588425+0000","last_active":"2023-11-28T12:09:35.602391+0000","last_peered":"2023-11-28T12:09:35.602391+0000","last_clean":"2023-11-28T12:09:35.602391+0000","last_became_active":"2023-11-28T12:09:35.587631+0000","last_became_peered":"2023-11-28T12:09:35.587631+0000","last_unstale":"2023-11-28T12:09:35.602391+0000","last_undegraded":"2023-11-28T12:09:35.602391+0000","last_fullsized":"2023-11-28T12:09:35.602391+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:22:45.640742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.577515+0000","last_change":"2023-11-28T12:09:35.070612+0000","last_active":"2023-11-28T12:09:35.577515+0000","last_peered":"2023-11-28T12:09:35.577515+0000","last_clean":"2023-11-28T12:09:35.577515+0000","last_became_active":"2023-11-28T12:09:35.070337+0000","last_became_peered":"2023-11-28T12:09:35.070337+0000","last_unstale":"2023-11-28T12:09:35.577515+0000","last_undegraded":"2023-11-28T12:09:35.577515+0000","last_fullsized":"2023-11-28T12:09:35.577515+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_clean_scrub_stamp":"2023-11-28T12:09:34.041090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:56:15.056422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":48,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.054947+0000","last_change":"2023-11-28T12:06:23.517505+0000","last_active":"2023-11-28T12:09:35.054947+0000","last_peered":"2023-11-28T12:09:35.054947+0000","last_clean":"2023-11-28T12:09:35.054947+0000","last_became_active":"2023-11-28T12:06:23.517151+0000","last_became_peered":"2023-11-28T12:06:23.517151+0000","last_unstale":"2023-11-28T12:09:35.054947+0000","last_undegraded":"2023-11-28T12:09:35.054947+0000","last_fullsized":"2023-11-28T12:09:35.054947+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:30:40.200095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.601778+0000","last_change":"2023-11-28T12:09:35.594782+0000","last_active":"2023-11-28T12:09:35.601778+0000","last_peered":"2023-11-28T12:09:35.601778+0000","last_clean":"2023-11-28T12:09:35.601778+0000","last_became_active":"2023-11-28T12:09:35.592544+0000","last_became_peered":"2023-11-28T12:09:35.592544+0000","last_unstale":"2023-11-28T12:09:35.601778+0000","last_undegraded":"2023-11-28T12:09:35.601778+0000","last_fullsized":"2023-11-28T12:09:35.601778+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:22:08.701139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"60'2","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.604338+0000","last_change":"2023-11-28T12:09:35.076189+0000","last_active":"2023-11-28T12:09:35.604338+0000","last_peered":"2023-11-28T12:09:35.604338+0000","last_clean":"2023-11-28T12:09:35.604338+0000","last_became_active":"2023-11-28T12:09:35.075835+0000","last_became_peered":"2023-11-28T12:09:35.075835+0000","last_unstale":"2023-11-28T12:09:35.604338+0000","last_undegraded":"2023-11-28T12:09:35.604338+0000","last_fullsized":"2023-11-28T12:09:35.604338+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_clean_scrub_stamp":"2023-11-28T12:09:34.041090+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:04:30.813868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":47,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.069525+0000","last_change":"2023-11-28T12:06:23.517967+0000","last_active":"2023-11-28T12:09:35.069525+0000","last_peered":"2023-11-28T12:09:35.069525+0000","last_clean":"2023-11-28T12:09:35.069525+0000","last_became_active":"2023-11-28T12:06:23.517495+0000","last_became_peered":"2023-11-28T12:06:23.517495+0000","last_unstale":"2023-11-28T12:09:35.069525+0000","last_undegraded":"2023-11-28T12:09:35.069525+0000","last_fullsized":"2023-11-28T12:09:35.069525+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:51:06.844441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":199,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.070319+0000","last_change":"2023-11-28T12:06:23.513472+0000","last_active":"2023-11-28T12:09:35.070319+0000","last_peered":"2023-11-28T12:09:35.070319+0000","last_clean":"2023-11-28T12:09:35.070319+0000","last_became_active":"2023-11-28T12:06:23.513150+0000","last_became_peered":"2023-11-28T12:06:23.513150+0000","last_unstale":"2023-11-28T12:09:35.070319+0000","last_undegraded":"2023-11-28T12:09:35.070319+0000","last_fullsized":"2023-11-28T12:09:35.070319+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:34:18.653049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.614304+0000","last_change":"2023-11-28T12:09:35.605306+0000","last_active":"2023-11-28T12:09:35.614304+0000","last_peered":"2023-11-28T12:09:35.614304+0000","last_clean":"2023-11-28T12:09:35.614304+0000","last_became_active":"2023-11-28T12:09:35.604953+0000","last_became_peered":"2023-11-28T12:09:35.604953+0000","last_unstale":"2023-11-28T12:09:35.614304+0000","last_undegraded":"2023-11-28T12:09:35.614304+0000","last_fullsized":"2023-11-28T12:09:35.614304+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:15:08.714733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.587925+0000","last_change":"2023-11-28T12:09:35.069783+0000","last_active":"2023-11-28T12:09:35.587925+0000","last_peered":"2023-11-28T12:09:35.587925+0000","last_clean":"2023-11-28T12:09:35.587925+0000","last_became_active":"2023-11-28T12:09:35.069494+0000","last_became_peered":"2023-11-28T12:09:35.069494+0000","last_unstale":"2023-11-28T12:09:35.587925+0000","last_undegraded":"2023-11-28T12:09:35.587925+0000","last_fullsized":"2023-11-28T12:09:35.587925+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_clean_scrub_stamp":"2023-11-28T12:09:34.041090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:18:37.491041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":49,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.071150+0000","last_change":"2023-11-28T12:06:23.903708+0000","last_active":"2023-11-28T12:09:35.071150+0000","last_peered":"2023-11-28T12:09:35.071150+0000","last_clean":"2023-11-28T12:09:35.071150+0000","last_became_active":"2023-11-28T12:06:23.903399+0000","last_became_peered":"2023-11-28T12:06:23.903399+0000","last_unstale":"2023-11-28T12:09:35.071150+0000","last_undegraded":"2023-11-28T12:09:35.071150+0000","last_fullsized":"2023-11-28T12:09:35.071150+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:31:13.187145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.603836+0000","last_change":"2023-11-28T12:09:35.599538+0000","last_active":"2023-11-28T12:09:35.603836+0000","last_peered":"2023-11-28T12:09:35.603836+0000","last_clean":"2023-11-28T12:09:35.603836+0000","last_became_active":"2023-11-28T12:09:35.599169+0000","last_became_peered":"2023-11-28T12:09:35.599169+0000","last_unstale":"2023-11-28T12:09:35.603836+0000","last_undegraded":"2023-11-28T12:09:35.603836+0000","last_fullsized":"2023-11-28T12:09:35.603836+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:46:05.667553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.576252+0000","last_change":"2023-11-28T12:09:35.057603+0000","last_active":"2023-11-28T12:09:35.576252+0000","last_peered":"2023-11-28T12:09:35.576252+0000","last_clean":"2023-11-28T12:09:35.576252+0000","last_became_active":"2023-11-28T12:09:35.057301+0000","last_became_peered":"2023-11-28T12:09:35.057301+0000","last_unstale":"2023-11-28T12:09:35.576252+0000","last_undegraded":"2023-11-28T12:09:35.576252+0000","last_fullsized":"2023-11-28T12:09:35.576252+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_clean_scrub_stamp":"2023-11-28T12:09:34.041090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:20:45.435083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":49,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.070136+0000","last_change":"2023-11-28T12:06:23.903662+0000","last_active":"2023-11-28T12:09:35.070136+0000","last_peered":"2023-11-28T12:09:35.070136+0000","last_clean":"2023-11-28T12:09:35.070136+0000","last_became_active":"2023-11-28T12:06:23.903354+0000","last_became_peered":"2023-11-28T12:06:23.903354+0000","last_unstale":"2023-11-28T12:09:35.070136+0000","last_undegraded":"2023-11-28T12:09:35.070136+0000","last_fullsized":"2023-11-28T12:09:35.070136+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:02:07.694087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.603909+0000","last_change":"2023-11-28T12:09:35.595620+0000","last_active":"2023-11-28T12:09:35.603909+0000","last_peered":"2023-11-28T12:09:35.603909+0000","last_clean":"2023-11-28T12:09:35.603909+0000","last_became_active":"2023-11-28T12:09:35.595298+0000","last_became_peered":"2023-11-28T12:09:35.595298+0000","last_unstale":"2023-11-28T12:09:35.603909+0000","last_undegraded":"2023-11-28T12:09:35.603909+0000","last_fullsized":"2023-11-28T12:09:35.603909+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:47:42.661190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.580120+0000","last_change":"2023-11-28T12:09:35.066099+0000","last_active":"2023-11-28T12:09:35.580120+0000","last_peered":"2023-11-28T12:09:35.580120+0000","last_clean":"2023-11-28T12:09:35.580120+0000","last_became_active":"2023-11-28T12:09:35.065809+0000","last_became_peered":"2023-11-28T12:09:35.065809+0000","last_unstale":"2023-11-28T12:09:35.580120+0000","last_undegraded":"2023-11-28T12:09:35.580120+0000","last_fullsized":"2023-11-28T12:09:35.580120+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_clean_scrub_stamp":"2023-11-28T12:09:34.041090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:15:14.332696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":50,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.061997+0000","last_change":"2023-11-28T12:06:23.903797+0000","last_active":"2023-11-28T12:09:35.061997+0000","last_peered":"2023-11-28T12:09:35.061997+0000","last_clean":"2023-11-28T12:09:35.061997+0000","last_became_active":"2023-11-28T12:06:23.903475+0000","last_became_peered":"2023-11-28T12:06:23.903475+0000","last_unstale":"2023-11-28T12:09:35.061997+0000","last_undegraded":"2023-11-28T12:09:35.061997+0000","last_fullsized":"2023-11-28T12:09:35.061997+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:51:06.844441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.603466+0000","last_change":"2023-11-28T12:09:35.594467+0000","last_active":"2023-11-28T12:09:35.603466+0000","last_peered":"2023-11-28T12:09:35.603466+0000","last_clean":"2023-11-28T12:09:35.603466+0000","last_became_active":"2023-11-28T12:09:35.594019+0000","last_became_peered":"2023-11-28T12:09:35.594019+0000","last_unstale":"2023-11-28T12:09:35.603466+0000","last_undegraded":"2023-11-28T12:09:35.603466+0000","last_fullsized":"2023-11-28T12:09:35.603466+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:38:35.572106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"60'2","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.617180+0000","last_change":"2023-11-28T12:09:35.078464+0000","last_active":"2023-11-28T12:09:35.617180+0000","last_peered":"2023-11-28T12:09:35.617180+0000","last_clean":"2023-11-28T12:09:35.617180+0000","last_became_active":"2023-11-28T12:09:35.078171+0000","last_became_peered":"2023-11-28T12:09:35.078171+0000","last_unstale":"2023-11-28T12:09:35.617180+0000","last_undegraded":"2023-11-28T12:09:35.617180+0000","last_fullsized":"2023-11-28T12:09:35.617180+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_clean_scrub_stamp":"2023-11-28T12:09:34.041090+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:12:46.810191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":55,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.066255+0000","last_change":"2023-11-28T12:06:23.903983+0000","last_active":"2023-11-28T12:09:35.066255+0000","last_peered":"2023-11-28T12:09:35.066255+0000","last_clean":"2023-11-28T12:09:35.066255+0000","last_became_active":"2023-11-28T12:06:23.903511+0000","last_became_peered":"2023-11-28T12:06:23.903511+0000","last_unstale":"2023-11-28T12:09:35.066255+0000","last_undegraded":"2023-11-28T12:09:35.066255+0000","last_fullsized":"2023-11-28T12:09:35.066255+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:31:13.187145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.603947+0000","last_change":"2023-11-28T12:09:35.597524+0000","last_active":"2023-11-28T12:09:35.603947+0000","last_peered":"2023-11-28T12:09:35.603947+0000","last_clean":"2023-11-28T12:09:35.603947+0000","last_became_active":"2023-11-28T12:09:35.597227+0000","last_became_peered":"2023-11-28T12:09:35.597227+0000","last_unstale":"2023-11-28T12:09:35.603947+0000","last_undegraded":"2023-11-28T12:09:35.603947+0000","last_fullsized":"2023-11-28T12:09:35.603947+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:15:15.335523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"60'1","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.611480+0000","last_change":"2023-11-28T12:09:35.073201+0000","last_active":"2023-11-28T12:09:35.611480+0000","last_peered":"2023-11-28T12:09:35.611480+0000","last_clean":"2023-11-28T12:09:35.611480+0000","last_became_active":"2023-11-28T12:09:35.072899+0000","last_became_peered":"2023-11-28T12:09:35.072899+0000","last_unstale":"2023-11-28T12:09:35.611480+0000","last_undegraded":"2023-11-28T12:09:35.611480+0000","last_fullsized":"2023-11-28T12:09:35.611480+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_clean_scrub_stamp":"2023-11-28T12:09:34.041090+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:25:59.054395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":55,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.067409+0000","last_change":"2023-11-28T12:06:23.517246+0000","last_active":"2023-11-28T12:09:35.067409+0000","last_peered":"2023-11-28T12:09:35.067409+0000","last_clean":"2023-11-28T12:09:35.067409+0000","last_became_active":"2023-11-28T12:06:23.516854+0000","last_became_peered":"2023-11-28T12:06:23.516854+0000","last_unstale":"2023-11-28T12:09:35.067409+0000","last_undegraded":"2023-11-28T12:09:35.067409+0000","last_fullsized":"2023-11-28T12:09:35.067409+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:51:06.844441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574891,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14876,"kb_used_data":1300,"kb_used_omap":0,"kb_used_meta":13568,"kb_avail":94356964,"statfs":{"total":96636764160,"available":96621531136,"internally_reserved":0,"allocated":1331200,"data_stored":909685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13893632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:09:25 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.64800000000000002,"15min":0.629},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.86399999999999999,"5min":1.141,"15min":1.141},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.69099999999999995,"15min":0.70399999999999996},"min":{"1min":0.38,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.94499999999999995,"5min":2.7469999999999999,"15min":2.7469999999999999},"last":0.438}]},{"osd":1,"last update":"Tue Nov 28 12:09:25 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.64500000000000002,"15min":0.62},"min":{"1min":0.45700000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.92800000000000005,"5min":1,"15min":1},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.621,"15min":0.60399999999999998},"min":{"1min":0.44900000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.98299999999999998,"5min":1.171,"15min":1.171},"last":0.61799999999999999}]},{"osd":2,"last update":"Tue Nov 28 12:09:25 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70499999999999996,"15min":0.70299999999999996},"min":{"1min":0.53900000000000003,"5min":0.441,"15min":0.441},"max":{"1min":0.92900000000000005,"5min":1.819,"15min":1.819},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.75900000000000001,"15min":0.75700000000000001},"min":{"1min":0.56899999999999995,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.92300000000000004,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":0.56399999999999995}]},{"osd":3,"last update":"Tue Nov 28 12:09:25 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.69299999999999995,"15min":0.68300000000000005},"min":{"1min":0.437,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.92100000000000004,"5min":0.999,"15min":0.999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.745,"15min":0.72899999999999998},"min":{"1min":0.55400000000000005,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0009999999999999,"5min":1.103,"15min":1.103},"last":0.63800000000000001}]},{"osd":4,"last update":"Tue Nov 28 12:09:25 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.60999999999999999,"15min":0.61599999999999999},"min":{"1min":0.433,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.81100000000000005,"5min":0.878,"15min":0.878},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.45600000000000002,"5min":0.442,"15min":0.442},"max":{"1min":1,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.745}]},{"osd":5,"last update":"Tue Nov 28 12:09:25 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.66200000000000003,"15min":0.66600000000000004},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.85299999999999998,"5min":1.044,"15min":1.044},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.72099999999999997,"15min":0.72899999999999998},"min":{"1min":0.50900000000000001,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.98199999999999998,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.66400000000000003}]},{"osd":6,"last update":"Tue Nov 28 12:09:25 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.65300000000000002,"15min":0.66800000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.872,"5min":1.012,"15min":1.012},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.75800000000000001,"15min":0.76900000000000002},"min":{"1min":0.53600000000000003,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.028,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.71099999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574889,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9356,"kb_used_data":708,"kb_used_omap":0,"kb_used_meta":8640,"kb_avail":94362484,"statfs":{"total":96636764160,"available":96627183616,"internally_reserved":0,"allocated":724992,"data_stored":318591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8847360},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:09:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.59199999999999997,"15min":0.58299999999999996},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.63,"5min":0.60499999999999998,"15min":0.59799999999999998},"min":{"1min":0.41499999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.74399999999999999}]},{"osd":1,"last update":"Tue Nov 28 12:09:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.64700000000000002,"15min":0.63400000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.70199999999999996,"15min":0.70499999999999996},"min":{"1min":0.60199999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.75800000000000001}]},{"osd":2,"last update":"Tue Nov 28 12:09:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.64000000000000001,"15min":0.63200000000000001},"min":{"1min":0.495,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.65000000000000002,"15min":0.64200000000000002},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.77300000000000002}]},{"osd":3,"last update":"Tue Nov 28 12:09:27 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.71699999999999997,"15min":0.72199999999999998},"min":{"1min":0.51600000000000001,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.72799999999999998,"15min":0.71999999999999997},"min":{"1min":0.53900000000000003,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.80500000000000005}]},{"osd":4,"last update":"Tue Nov 28 12:09:27 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.66800000000000004,"15min":0.67400000000000004},"min":{"1min":0.48199999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.94199999999999995,"5min":1.054,"15min":1.054},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.67700000000000005,"15min":0.67900000000000005},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.69399999999999995}]},{"osd":5,"last update":"Tue Nov 28 12:09:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68500000000000005,"15min":0.69499999999999995},"min":{"1min":0.42799999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76600000000000001,"15min":0.77100000000000002},"min":{"1min":0.52800000000000002,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.60699999999999998}]},{"osd":7,"last update":"Tue Nov 28 12:09:27 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.73999999999999999,"15min":0.752},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.95899999999999996,"5min":1.008,"15min":1.008},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.71799999999999997,"15min":0.72699999999999998},"min":{"1min":0.48099999999999998,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.96099999999999997,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.64800000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574891,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14632,"kb_used_data":1312,"kb_used_omap":0,"kb_used_meta":13312,"kb_avail":94357208,"statfs":{"total":96636764160,"available":96621780992,"internally_reserved":0,"allocated":1343488,"data_stored":911221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13631488},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.42899999999999999,"15min":0.437},"min":{"1min":0.30599999999999999,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.76800000000000002,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.48599999999999999,"15min":0.497},"min":{"1min":0.36399999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.64300000000000002,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.47999999999999998}]},{"osd":2,"last update":"Tue Nov 28 12:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.46800000000000003,"15min":0.47299999999999998},"min":{"1min":0.32300000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.70699999999999996,"5min":1.111,"15min":1.111},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48399999999999999,"15min":0.49399999999999999},"min":{"1min":0.35299999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.61799999999999999,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.46100000000000002}]},{"osd":3,"last update":"Tue Nov 28 12:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.57999999999999996,"15min":0.57699999999999996},"min":{"1min":0.45500000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.749,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.56899999999999995,"15min":0.55900000000000005},"min":{"1min":0.442,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.85399999999999998,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.51400000000000001}]},{"osd":4,"last update":"Tue Nov 28 12:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.71599999999999997,"15min":0.70799999999999996},"min":{"1min":0.58699999999999997,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.96299999999999997,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.749,"15min":0.753},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.93600000000000005,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.59599999999999997}]},{"osd":5,"last update":"Tue Nov 28 12:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.56999999999999995,"5min":0.496,"15min":0.496},"max":{"1min":0.95399999999999996,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.75800000000000001,"15min":0.76000000000000001},"min":{"1min":0.59399999999999997,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.008,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.57599999999999996}]},{"osd":6,"last update":"Tue Nov 28 12:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.77000000000000002,"15min":0.77600000000000002},"min":{"1min":0.61099999999999999,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.92500000000000004,"5min":1.21,"15min":1.21},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.80200000000000005,"15min":0.80600000000000005},"min":{"1min":0.66600000000000004,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.002,"5min":1.502,"15min":1.502},"last":0.63600000000000001}]},{"osd":7,"last update":"Tue Nov 28 12:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.69899999999999995,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.038,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.78200000000000003,"15min":0.78000000000000003},"min":{"1min":0.63800000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.98399999999999999,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.63}]}]},{"osd":0,"up_from":13,"seq":55834574889,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13636,"kb_used_data":700,"kb_used_omap":0,"kb_used_meta":12928,"kb_avail":94358204,"statfs":{"total":96636764160,"available":96622800896,"internally_reserved":0,"allocated":716800,"data_stored":317196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13238272},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 12:09:25 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.39200000000000002,"15min":0.38400000000000001},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.53900000000000003,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.48699999999999999,"15min":0.499},"min":{"1min":0.35299999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.68899999999999995,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.34200000000000003}]},{"osd":2,"last update":"Tue Nov 28 12:09:25 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.47599999999999998,"15min":0.47799999999999998},"min":{"1min":0.35299999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.64600000000000002,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.53400000000000003,"15min":0.54600000000000004},"min":{"1min":0.41699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.60499999999999998,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.39200000000000002}]},{"osd":3,"last update":"Tue Nov 28 12:09:25 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.52200000000000002,"15min":0.52600000000000002},"min":{"1min":0.34599999999999997,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.63300000000000001,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.59799999999999998,"15min":0.60799999999999998},"min":{"1min":0.45500000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.73399999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.55100000000000005}]},{"osd":4,"last update":"Tue Nov 28 12:09:25 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.79000000000000004,"15min":0.79600000000000004},"min":{"1min":0.60899999999999999,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.0620000000000001,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77600000000000002,"15min":0.77700000000000002},"min":{"1min":0.66300000000000003,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.97699999999999998,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.84199999999999997}]},{"osd":5,"last update":"Tue Nov 28 12:09:25 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.81799999999999995,"15min":0.83199999999999996},"min":{"1min":0.64600000000000002,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.018,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.753},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.81100000000000005,"15min":0.81299999999999994},"min":{"1min":0.64400000000000002,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.0049999999999999,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.86899999999999999}]},{"osd":6,"last update":"Tue Nov 28 12:09:25 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.80700000000000005,"15min":0.81000000000000005},"min":{"1min":0.65700000000000003,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.0429999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83599999999999997,"15min":0.84999999999999998},"min":{"1min":0.70799999999999996,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.157,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.88300000000000001}]},{"osd":7,"last update":"Tue Nov 28 12:09:25 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.84999999999999998,"15min":0.86099999999999999},"min":{"1min":0.68500000000000005,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.109,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.81000000000000005,"15min":0.81299999999999994},"min":{"1min":0.629,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.0509999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.82999999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574890,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13448,"kb_used_data":704,"kb_used_omap":0,"kb_used_meta":12736,"kb_avail":94358392,"statfs":{"total":96636764160,"available":96622993408,"internally_reserved":0,"allocated":720896,"data_stored":318557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13041664},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:09:25 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.439,"15min":0.437},"min":{"1min":0.32300000000000001,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.71699999999999997,"5min":0.745,"15min":0.745},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45500000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.67500000000000004,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":1.4770000000000001}]},{"osd":1,"last update":"Tue Nov 28 12:09:25 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.49299999999999999,"15min":0.48799999999999999},"min":{"1min":0.39900000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.67900000000000005,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.376},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.51200000000000001,"15min":0.51100000000000001},"min":{"1min":0.38200000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.71399999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":1.589}]},{"osd":3,"last update":"Tue Nov 28 12:09:25 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.47799999999999998,"15min":0.47999999999999998},"min":{"1min":0.32200000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":1.762},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55900000000000005,"15min":0.56699999999999995},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.81100000000000005,"5min":0.876,"15min":0.876},"last":0.42999999999999999}]},{"osd":4,"last update":"Tue Nov 28 12:09:25 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.83199999999999996,"15min":0.83099999999999996},"min":{"1min":0.61499999999999999,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.0900000000000001,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.82099999999999995,"15min":0.82299999999999995},"min":{"1min":0.65000000000000002,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":1.534}]},{"osd":5,"last update":"Tue Nov 28 12:09:25 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.75800000000000001,"15min":0.748},"min":{"1min":0.60199999999999998,"5min":0.497,"15min":0.497},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":1.6259999999999999},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.79100000000000004,"15min":0.79000000000000004},"min":{"1min":0.54600000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.044,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.57899999999999996}]},{"osd":6,"last update":"Tue Nov 28 12:09:25 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.79300000000000004,"15min":0.78900000000000003},"min":{"1min":0.56999999999999995,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":1.9219999999999999},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.80200000000000005,"15min":0.79200000000000004},"min":{"1min":0.51700000000000002,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":1.698}]},{"osd":7,"last update":"Tue Nov 28 12:09:25 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.81000000000000005,"15min":0.80900000000000005},"min":{"1min":0.60299999999999998,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.131,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":1.9830000000000001},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.071,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":1.804}]}]},{"osd":3,"up_from":13,"seq":55834574889,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13828,"kb_used_data":700,"kb_used_omap":0,"kb_used_meta":13120,"kb_avail":94358012,"statfs":{"total":96636764160,"available":96622604288,"internally_reserved":0,"allocated":716800,"data_stored":317196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13434880},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:09:29 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.437,"15min":0.44},"min":{"1min":0.29899999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.57599999999999996,"5min":0.622,"15min":0.622},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.503,"5min":0.45600000000000002,"15min":0.45000000000000001},"min":{"1min":0.318,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.68899999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.441}]},{"osd":1,"last update":"Tue Nov 28 12:09:29 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.434,"15min":0.42599999999999999},"min":{"1min":0.30599999999999999,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.504,"5min":0.52000000000000002,"15min":0.53100000000000003},"min":{"1min":0.42699999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.60599999999999998,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.48999999999999999}]},{"osd":2,"last update":"Tue Nov 28 12:09:29 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.52400000000000002,"15min":0.52200000000000002},"min":{"1min":0.42499999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.75700000000000001,"5min":1.022,"15min":1.022},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.56599999999999995,"15min":0.56999999999999995},"min":{"1min":0.45300000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.66000000000000003,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.61299999999999999}]},{"osd":4,"last update":"Tue Nov 28 12:09:29 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.71599999999999997,"15min":0.70599999999999996},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.71799999999999997,"15min":0.71299999999999997},"min":{"1min":0.64500000000000002,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.66000000000000003}]},{"osd":5,"last update":"Tue Nov 28 12:09:29 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.75700000000000001,"15min":0.753},"min":{"1min":0.67000000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.77000000000000002,"15min":0.77800000000000002},"min":{"1min":0.66000000000000003,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.02,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.67600000000000005}]},{"osd":6,"last update":"Tue Nov 28 12:09:29 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.77400000000000002,"15min":0.77000000000000002},"min":{"1min":0.61099999999999999,"5min":0.498,"15min":0.498},"max":{"1min":1.004,"5min":1.026,"15min":1.026},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.78600000000000003,"15min":0.78400000000000003},"min":{"1min":0.60699999999999998,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.0760000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.54800000000000004}]},{"osd":7,"last update":"Tue Nov 28 12:09:29 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.78800000000000003,"15min":0.79000000000000004},"min":{"1min":0.629,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.097,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.80200000000000005,"15min":0.79800000000000004},"min":{"1min":0.64500000000000002,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.149,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.627}]}]},{"osd":4,"up_from":13,"seq":55834574889,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9556,"kb_used_data":716,"kb_used_omap":0,"kb_used_meta":8832,"kb_avail":94362284,"statfs":{"total":96636764160,"available":96626978816,"internally_reserved":0,"allocated":733184,"data_stored":320105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9043968},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:09:26 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.65200000000000002,"15min":0.65000000000000002},"min":{"1min":0.47199999999999998,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.871,"5min":1.044,"15min":1.044},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.65600000000000003,"15min":0.65500000000000003},"min":{"1min":0.46500000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.88500000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.55500000000000005}]},{"osd":1,"last update":"Tue Nov 28 12:09:26 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.67400000000000004,"15min":0.66800000000000004},"min":{"1min":0.50600000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.68100000000000005,"15min":0.68500000000000005},"min":{"1min":0.51000000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.99199999999999999,"5min":1.097,"15min":1.097},"last":0.628}]},{"osd":2,"last update":"Tue Nov 28 12:09:26 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.71199999999999997,"15min":0.71699999999999997},"min":{"1min":0.59099999999999997,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.86699999999999999,"5min":1.125,"15min":1.125},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.73499999999999999,"15min":0.74099999999999999},"min":{"1min":0.57099999999999995,"5min":0.435,"15min":0.435},"max":{"1min":0.92400000000000004,"5min":1.143,"15min":1.143},"last":0.72399999999999998}]},{"osd":3,"last update":"Tue Nov 28 12:09:26 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.67700000000000005,"15min":0.68000000000000005},"min":{"1min":0.55000000000000004,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.97199999999999998,"5min":1.093,"15min":1.093},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.76000000000000001,"15min":0.77600000000000002},"min":{"1min":0.625,"5min":0.5,"15min":0.5},"max":{"1min":0.95299999999999996,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.67200000000000004}]},{"osd":5,"last update":"Tue Nov 28 12:09:26 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.69399999999999995,"15min":0.71999999999999997},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.76700000000000002,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.69499999999999995,"15min":0.70999999999999996},"min":{"1min":0.46200000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.874,"5min":1.296,"15min":1.296},"last":0.60899999999999999}]},{"osd":6,"last update":"Tue Nov 28 12:09:26 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.73499999999999999,"15min":0.751},"min":{"1min":0.49099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.91300000000000003,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.79100000000000004,"15min":0.81399999999999995},"min":{"1min":0.51500000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.93400000000000005,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.751}]},{"osd":7,"last update":"Tue Nov 28 12:09:26 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.76600000000000001,"15min":0.79200000000000004},"min":{"1min":0.54700000000000004,"5min":0.499,"15min":0.499},"max":{"1min":0.92600000000000005,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.82399999999999995,"15min":0.84999999999999998},"min":{"1min":0.56999999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.0449999999999999,"5min":1.28,"15min":1.28},"last":0.58499999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574890,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9484,"kb_used_data":708,"kb_used_omap":0,"kb_used_meta":8768,"kb_avail":94362356,"statfs":{"total":96636764160,"available":96627052544,"internally_reserved":0,"allocated":724992,"data_stored":318579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8978432},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:09:28 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.65500000000000003,"15min":0.64800000000000002},"min":{"1min":0.51300000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.88300000000000001,"5min":1.204,"15min":1.204},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.70699999999999996,"15min":0.69599999999999995},"min":{"1min":0.56100000000000005,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.89900000000000002,"5min":1.048,"15min":1.048},"last":0.73899999999999999}]},{"osd":1,"last update":"Tue Nov 28 12:09:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.621,"15min":0.59399999999999997},"min":{"1min":0.47499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.84799999999999998,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.753},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.628,"15min":0.60799999999999998},"min":{"1min":0.45700000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.878,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.61699999999999999}]},{"osd":2,"last update":"Tue Nov 28 12:09:28 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67400000000000004,"15min":0.68000000000000005},"min":{"1min":0.48399999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.79700000000000004,"5min":1.173,"15min":1.173},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.68700000000000006,"15min":0.69099999999999995},"min":{"1min":0.47199999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.89000000000000001,"5min":1.298,"15min":1.298},"last":0.66800000000000004}]},{"osd":3,"last update":"Tue Nov 28 12:09:28 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.69399999999999995,"15min":0.69099999999999995},"min":{"1min":0.49299999999999999,"5min":0.438,"15min":0.438},"max":{"1min":0.86799999999999999,"5min":1.093,"15min":1.093},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.755,"5min":0.745,"15min":0.747},"min":{"1min":0.57099999999999995,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.91900000000000004,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.70599999999999996}]},{"osd":4,"last update":"Tue Nov 28 12:09:28 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.68000000000000005,"15min":0.70099999999999996},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.81100000000000005,"5min":1.141,"15min":1.141},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.53700000000000003,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.92400000000000004,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.627}]},{"osd":6,"last update":"Tue Nov 28 12:09:28 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.72599999999999998,"15min":0.752},"min":{"1min":0.438,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.89500000000000002,"5min":1.264,"15min":1.264},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.63,"5min":0.70899999999999996,"15min":0.72299999999999998},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.91300000000000003,"5min":0.997,"15min":0.997},"last":0.56399999999999995}]},{"osd":7,"last update":"Tue Nov 28 12:09:28 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.73099999999999998,"15min":0.752},"min":{"1min":0.48399999999999999,"5min":0.435,"15min":0.435},"max":{"1min":0.93300000000000005,"5min":1.173,"15min":1.173},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.76300000000000001,"15min":0.78300000000000003},"min":{"1min":0.56000000000000005,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.88300000000000001,"5min":1.008,"15min":1.008},"last":0.58599999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T12:09:39.996 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T12:09:40.032 INFO:tasks.ceph.mds.c.smithi045.stderr:2023-11-28T12:09:40.032+0000 7fc2815f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-28T12:09:40.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.235+0000 7fabbd3ff700 1 Processor -- start 2023-11-28T12:09:40.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.235+0000 7fabbd3ff700 1 -- start start 2023-11-28T12:09:40.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.236+0000 7fabbd3ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fabb815c9b0 0x7fabb80b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:40.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.236+0000 7fabbd3ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fabb8161340 0x7fabb80d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:40.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.236+0000 7fabbd3ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabb80d1950 con 0x7fabb80d2320 2023-11-28T12:09:40.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.236+0000 7fabbd3ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabb80b5800 con 0x7fabb815c9b0 2023-11-28T12:09:40.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.236+0000 7fabbd3ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabb80b5520 con 0x7fabb8161340 2023-11-28T12:09:40.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.237+0000 7fabb67fc700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fabb8161340 0x7fabb80d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:40.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.237+0000 7fabb6ffd700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fabb815c9b0 0x7fabb80b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:40.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.237+0000 7fabb6ffd700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fabb815c9b0 0x7fabb80b4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.45:60822/0 (socket says 172.21.15.45:60822) 2023-11-28T12:09:40.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.237+0000 7fabb77fe700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fabb80d2320 0x7fabb80cd7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.45:41586/0 (socket says 172.21.15.45:41586) 2023-11-28T12:09:40.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.237+0000 7fabb6ffd700 1 -- 172.21.15.45:0/167111103 learned_addr learned my addr 172.21.15.45:0/167111103 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:09:40.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.237+0000 7fabb6ffd700 1 -- 172.21.15.45:0/167111103 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fabb8161340 msgr2=0x7fabb80d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:40.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.237+0000 7fabb6ffd700 1 --2- 172.21.15.45:0/167111103 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fabb8161340 0x7fabb80d1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:40.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.237+0000 7fabb6ffd700 1 -- 172.21.15.45:0/167111103 >> v1:172.21.15.152:6789/0 conn(0x7fabb80d2320 legacy=0x7fabb80cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:40.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.237+0000 7fabb6ffd700 1 -- 172.21.15.45:0/167111103 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabb80d1300 con 0x7fabb815c9b0 2023-11-28T12:09:40.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.237+0000 7fabb6ffd700 1 --2- 172.21.15.45:0/167111103 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fabb815c9b0 0x7fabb80b4bf0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7faba80098f0 tx=0x7faba8009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf09062af6c72e49 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:40.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.238+0000 7fabb5ffb700 1 -- 172.21.15.45:0/167111103 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faba8011830 con 0x7fabb815c9b0 2023-11-28T12:09:40.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.238+0000 7fabb5ffb700 1 -- 172.21.15.45:0/167111103 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faba8011990 con 0x7fabb815c9b0 2023-11-28T12:09:40.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.238+0000 7fabb5ffb700 1 -- 172.21.15.45:0/167111103 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faba8011d20 con 0x7fabb815c9b0 2023-11-28T12:09:40.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.238+0000 7fabbd3ff700 1 -- 172.21.15.45:0/167111103 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fabb815c9b0 msgr2=0x7fabb80b4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:40.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.238+0000 7fabbd3ff700 1 --2- 172.21.15.45:0/167111103 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fabb815c9b0 0x7fabb80b4bf0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7faba80098f0 tx=0x7faba8009c00 comp rx=0 tx=0).stop 2023-11-28T12:09:40.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.238+0000 7fabbd3ff700 1 -- 172.21.15.45:0/167111103 shutdown_connections 2023-11-28T12:09:40.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.238+0000 7fabbd3ff700 1 --2- 172.21.15.45:0/167111103 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fabb815c9b0 0x7fabb80b4bf0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:40.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.238+0000 7fabbd3ff700 1 --2- 172.21.15.45:0/167111103 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fabb8161340 0x7fabb80d1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:40.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.238+0000 7fabbd3ff700 1 -- 172.21.15.45:0/167111103 >> 172.21.15.45:0/167111103 conn(0x7fabb8072600 msgr2=0x7fabb80cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:40.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.239+0000 7fabbd3ff700 1 -- 172.21.15.45:0/167111103 shutdown_connections 2023-11-28T12:09:40.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.239+0000 7fabbd3ff700 1 -- 172.21.15.45:0/167111103 wait complete. 2023-11-28T12:09:40.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.241+0000 7fabbd3ff700 1 Processor -- start 2023-11-28T12:09:40.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.241+0000 7fabbd3ff700 1 -- start start 2023-11-28T12:09:40.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.242+0000 7fabbd3ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fabb80d2320 0x7fabb80c8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:40.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.242+0000 7fabbd3ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fabb815c9b0 0x7fabb81e8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:40.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.242+0000 7fabbd3ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fabb8161340 0x7fabb814e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:40.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.242+0000 7fabbd3ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabb81e8f60 con 0x7fabb8161340 2023-11-28T12:09:40.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.242+0000 7fabbd3ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabb80c9890 con 0x7fabb80d2320 2023-11-28T12:09:40.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.242+0000 7fabbd3ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabb80c8c80 con 0x7fabb815c9b0 2023-11-28T12:09:40.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.243+0000 7fabb77fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fabb8161340 0x7fabb814e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:40.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.243+0000 7fabb77fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fabb8161340 0x7fabb814e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49792/0 (socket says 172.21.15.45:49792) 2023-11-28T12:09:40.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.243+0000 7fabb77fe700 1 -- 172.21.15.45:0/488486260 learned_addr learned my addr 172.21.15.45:0/488486260 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:09:40.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.243+0000 7fabb67fc700 1 --2- 172.21.15.45:0/488486260 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fabb815c9b0 0x7fabb81e8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:40.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.243+0000 7fabb6ffd700 1 --2- 172.21.15.45:0/488486260 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fabb80d2320 0x7fabb80c8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:40.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.243+0000 7fabb77fe700 1 -- 172.21.15.45:0/488486260 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fabb815c9b0 msgr2=0x7fabb81e8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:40.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.243+0000 7fabb77fe700 1 --2- 172.21.15.45:0/488486260 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fabb815c9b0 0x7fabb81e8a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:40.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.243+0000 7fabb77fe700 1 -- 172.21.15.45:0/488486260 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fabb80d2320 msgr2=0x7fabb80c8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:40.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.243+0000 7fabb77fe700 1 --2- 172.21.15.45:0/488486260 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fabb80d2320 0x7fabb80c8610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:40.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.243+0000 7fabb77fe700 1 -- 172.21.15.45:0/488486260 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faba8009550 con 0x7fabb8161340 2023-11-28T12:09:40.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.244+0000 7fabb77fe700 1 --2- 172.21.15.45:0/488486260 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fabb8161340 0x7fabb814e4c0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fabb000cbc0 tx=0x7fabb000ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:40.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.244+0000 7fab9f7fe700 1 -- 172.21.15.45:0/488486260 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb000a9e0 con 0x7fabb8161340 2023-11-28T12:09:40.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.244+0000 7fab9f7fe700 1 -- 172.21.15.45:0/488486260 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabb000ab40 con 0x7fabb8161340 2023-11-28T12:09:40.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.244+0000 7fab9f7fe700 1 -- 172.21.15.45:0/488486260 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb0007070 con 0x7fabb8161340 2023-11-28T12:09:40.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.244+0000 7fabbd3ff700 1 -- 172.21.15.45:0/488486260 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabb80b5130 con 0x7fabb8161340 2023-11-28T12:09:40.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.244+0000 7fabbd3ff700 1 -- 172.21.15.45:0/488486260 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabb80d15e0 con 0x7fabb8161340 2023-11-28T12:09:40.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.245+0000 7fabbd3ff700 1 -- 172.21.15.45:0/488486260 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabb80b52c0 con 0x7fabb8161340 2023-11-28T12:09:40.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.246+0000 7fab9f7fe700 1 -- 172.21.15.45:0/488486260 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fabb0019030 con 0x7fabb8161340 2023-11-28T12:09:40.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.247+0000 7fab9f7fe700 1 --2- 172.21.15.45:0/488486260 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7faba40682f0 0x7faba406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:40.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.247+0000 7fab9f7fe700 1 -- 172.21.15.45:0/488486260 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fabb0085690 con 0x7fabb8161340 2023-11-28T12:09:40.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.247+0000 7fabb6ffd700 1 --2- 172.21.15.45:0/488486260 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7faba40682f0 0x7faba406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:40.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.248+0000 7fabb6ffd700 1 --2- 172.21.15.45:0/488486260 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7faba40682f0 0x7faba406a7a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7faba8009c40 tx=0x7faba8008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:40.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.251+0000 7fab9f7fe700 1 -- 172.21.15.45:0/488486260 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fabb004b5e0 con 0x7fabb8161340 2023-11-28T12:09:40.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.450+0000 7fabbd3ff700 1 -- 172.21.15.45:0/488486260 --> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fabb80745c0 con 0x7faba40682f0 2023-11-28T12:09:40.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.460+0000 7fab9f7fe700 1 -- 172.21.15.45:0/488486260 <== mgr.4100 v2:172.21.15.152:6832/115389 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311177 (secure 0 0 0) 0x7fabb80745c0 con 0x7faba40682f0 2023-11-28T12:09:40.464 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:09:40.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.464+0000 7fabbd3ff700 1 -- 172.21.15.45:0/488486260 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7faba40682f0 msgr2=0x7faba406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:40.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.464+0000 7fabbd3ff700 1 --2- 172.21.15.45:0/488486260 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7faba40682f0 0x7faba406a7a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7faba8009c40 tx=0x7faba8008030 comp rx=0 tx=0).stop 2023-11-28T12:09:40.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.464+0000 7fabbd3ff700 1 -- 172.21.15.45:0/488486260 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fabb8161340 msgr2=0x7fabb814e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:40.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.464+0000 7fabbd3ff700 1 --2- 172.21.15.45:0/488486260 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fabb8161340 0x7fabb814e4c0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fabb000cbc0 tx=0x7fabb000ced0 comp rx=0 tx=0).stop 2023-11-28T12:09:40.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.464+0000 7fabbd3ff700 1 -- 172.21.15.45:0/488486260 shutdown_connections 2023-11-28T12:09:40.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.464+0000 7fabbd3ff700 1 --2- 172.21.15.45:0/488486260 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7faba40682f0 0x7faba406a7a0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:40.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.464+0000 7fabbd3ff700 1 --2- 172.21.15.45:0/488486260 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fabb80d2320 0x7fabb80c8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:40.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.464+0000 7fabbd3ff700 1 --2- 172.21.15.45:0/488486260 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fabb8161340 0x7fabb814e4c0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:40.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.464+0000 7fabbd3ff700 1 --2- 172.21.15.45:0/488486260 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fabb815c9b0 0x7fabb81e8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:40.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.465+0000 7fabbd3ff700 1 -- 172.21.15.45:0/488486260 >> 172.21.15.45:0/488486260 conn(0x7fabb8072600 msgr2=0x7fabb80b8a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:40.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.465+0000 7fabbd3ff700 1 -- 172.21.15.45:0/488486260 shutdown_connections 2023-11-28T12:09:40.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.465+0000 7fabbd3ff700 1 -- 172.21.15.45:0/488486260 wait complete. 2023-11-28T12:09:40.468 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-11-28T12:09:40.484 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":153,"stamp":"2023-11-28T12:09:38.472821+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":98816,"kb_used_data":6848,"kb_used_omap":0,"kb_used_meta":91904,"kb_avail":754875904,"statfs":{"total":773094113280,"available":772992925696,"internally_reserved":0,"allocated":7012352,"data_stored":3731130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":94109696},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.427562"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.598042+0000","last_change":"2023-11-28T12:09:35.595116+0000","last_active":"2023-11-28T12:09:35.598042+0000","last_peered":"2023-11-28T12:09:35.598042+0000","last_clean":"2023-11-28T12:09:35.598042+0000","last_became_active":"2023-11-28T12:09:35.594780+0000","last_became_peered":"2023-11-28T12:09:35.594780+0000","last_unstale":"2023-11-28T12:09:35.598042+0000","last_undegraded":"2023-11-28T12:09:35.598042+0000","last_fullsized":"2023-11-28T12:09:35.598042+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:01:48.350829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.601563+0000","last_change":"2023-11-28T12:09:35.597748+0000","last_active":"2023-11-28T12:09:35.601563+0000","last_peered":"2023-11-28T12:09:35.601563+0000","last_clean":"2023-11-28T12:09:35.601563+0000","last_became_active":"2023-11-28T12:09:35.597176+0000","last_became_peered":"2023-11-28T12:09:35.597176+0000","last_unstale":"2023-11-28T12:09:35.601563+0000","last_undegraded":"2023-11-28T12:09:35.601563+0000","last_fullsized":"2023-11-28T12:09:35.601563+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:35:55.989102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.606251+0000","last_change":"2023-11-28T12:09:35.600872+0000","last_active":"2023-11-28T12:09:35.606251+0000","last_peered":"2023-11-28T12:09:35.606251+0000","last_clean":"2023-11-28T12:09:35.606251+0000","last_became_active":"2023-11-28T12:09:35.600525+0000","last_became_peered":"2023-11-28T12:09:35.600525+0000","last_unstale":"2023-11-28T12:09:35.606251+0000","last_undegraded":"2023-11-28T12:09:35.606251+0000","last_fullsized":"2023-11-28T12:09:35.606251+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:15:08.714733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.602872+0000","last_change":"2023-11-28T12:09:35.594238+0000","last_active":"2023-11-28T12:09:35.602872+0000","last_peered":"2023-11-28T12:09:35.602872+0000","last_clean":"2023-11-28T12:09:35.602872+0000","last_became_active":"2023-11-28T12:09:35.593902+0000","last_became_peered":"2023-11-28T12:09:35.593902+0000","last_unstale":"2023-11-28T12:09:35.602872+0000","last_undegraded":"2023-11-28T12:09:35.602872+0000","last_fullsized":"2023-11-28T12:09:35.602872+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:15:08.714733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.603818+0000","last_change":"2023-11-28T12:09:35.595889+0000","last_active":"2023-11-28T12:09:35.603818+0000","last_peered":"2023-11-28T12:09:35.603818+0000","last_clean":"2023-11-28T12:09:35.603818+0000","last_became_active":"2023-11-28T12:09:35.595563+0000","last_became_peered":"2023-11-28T12:09:35.595563+0000","last_unstale":"2023-11-28T12:09:35.603818+0000","last_undegraded":"2023-11-28T12:09:35.603818+0000","last_fullsized":"2023-11-28T12:09:35.603818+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:24:50.601237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.597237+0000","last_change":"2023-11-28T12:09:35.592497+0000","last_active":"2023-11-28T12:09:35.597237+0000","last_peered":"2023-11-28T12:09:35.597237+0000","last_clean":"2023-11-28T12:09:35.597237+0000","last_became_active":"2023-11-28T12:09:35.592221+0000","last_became_peered":"2023-11-28T12:09:35.592221+0000","last_unstale":"2023-11-28T12:09:35.597237+0000","last_undegraded":"2023-11-28T12:09:35.597237+0000","last_fullsized":"2023-11-28T12:09:35.597237+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:11:59.216802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.606986+0000","last_change":"2023-11-28T12:09:35.605258+0000","last_active":"2023-11-28T12:09:35.606986+0000","last_peered":"2023-11-28T12:09:35.606986+0000","last_clean":"2023-11-28T12:09:35.606986+0000","last_became_active":"2023-11-28T12:09:35.604947+0000","last_became_peered":"2023-11-28T12:09:35.604947+0000","last_unstale":"2023-11-28T12:09:35.606986+0000","last_undegraded":"2023-11-28T12:09:35.606986+0000","last_fullsized":"2023-11-28T12:09:35.606986+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:21:35.214839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.614298+0000","last_change":"2023-11-28T12:09:35.605373+0000","last_active":"2023-11-28T12:09:35.614298+0000","last_peered":"2023-11-28T12:09:35.614298+0000","last_clean":"2023-11-28T12:09:35.614298+0000","last_became_active":"2023-11-28T12:09:35.605020+0000","last_became_peered":"2023-11-28T12:09:35.605020+0000","last_unstale":"2023-11-28T12:09:35.614298+0000","last_undegraded":"2023-11-28T12:09:35.614298+0000","last_fullsized":"2023-11-28T12:09:35.614298+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:12:47.813018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.607132+0000","last_change":"2023-11-28T12:09:35.603326+0000","last_active":"2023-11-28T12:09:35.607132+0000","last_peered":"2023-11-28T12:09:35.607132+0000","last_clean":"2023-11-28T12:09:35.607132+0000","last_became_active":"2023-11-28T12:09:35.602989+0000","last_became_peered":"2023-11-28T12:09:35.602989+0000","last_unstale":"2023-11-28T12:09:35.607132+0000","last_undegraded":"2023-11-28T12:09:35.607132+0000","last_fullsized":"2023-11-28T12:09:35.607132+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:22:03.453096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.597410+0000","last_change":"2023-11-28T12:09:35.592496+0000","last_active":"2023-11-28T12:09:35.597410+0000","last_peered":"2023-11-28T12:09:35.597410+0000","last_clean":"2023-11-28T12:09:35.597410+0000","last_became_active":"2023-11-28T12:09:35.591718+0000","last_became_peered":"2023-11-28T12:09:35.591718+0000","last_unstale":"2023-11-28T12:09:35.597410+0000","last_undegraded":"2023-11-28T12:09:35.597410+0000","last_fullsized":"2023-11-28T12:09:35.597410+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:28:37.665904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.602481+0000","last_change":"2023-11-28T12:09:35.593530+0000","last_active":"2023-11-28T12:09:35.602481+0000","last_peered":"2023-11-28T12:09:35.602481+0000","last_clean":"2023-11-28T12:09:35.602481+0000","last_became_active":"2023-11-28T12:09:35.591417+0000","last_became_peered":"2023-11-28T12:09:35.591417+0000","last_unstale":"2023-11-28T12:09:35.602481+0000","last_undegraded":"2023-11-28T12:09:35.602481+0000","last_fullsized":"2023-11-28T12:09:35.602481+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:19:11.426595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.612162+0000","last_change":"2023-11-28T12:09:35.602549+0000","last_active":"2023-11-28T12:09:35.612162+0000","last_peered":"2023-11-28T12:09:35.612162+0000","last_clean":"2023-11-28T12:09:35.612162+0000","last_became_active":"2023-11-28T12:09:35.602239+0000","last_became_peered":"2023-11-28T12:09:35.602239+0000","last_unstale":"2023-11-28T12:09:35.612162+0000","last_undegraded":"2023-11-28T12:09:35.612162+0000","last_fullsized":"2023-11-28T12:09:35.612162+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:02:15.142274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.598036+0000","last_change":"2023-11-28T12:09:35.593191+0000","last_active":"2023-11-28T12:09:35.598036+0000","last_peered":"2023-11-28T12:09:35.598036+0000","last_clean":"2023-11-28T12:09:35.598036+0000","last_became_active":"2023-11-28T12:09:35.592918+0000","last_became_peered":"2023-11-28T12:09:35.592918+0000","last_unstale":"2023-11-28T12:09:35.598036+0000","last_undegraded":"2023-11-28T12:09:35.598036+0000","last_fullsized":"2023-11-28T12:09:35.598036+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:08:23.743352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.605232+0000","last_change":"2023-11-28T12:09:35.599407+0000","last_active":"2023-11-28T12:09:35.605232+0000","last_peered":"2023-11-28T12:09:35.605232+0000","last_clean":"2023-11-28T12:09:35.605232+0000","last_became_active":"2023-11-28T12:09:35.599127+0000","last_became_peered":"2023-11-28T12:09:35.599127+0000","last_unstale":"2023-11-28T12:09:35.605232+0000","last_undegraded":"2023-11-28T12:09:35.605232+0000","last_fullsized":"2023-11-28T12:09:35.605232+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:20:46.437910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.604218+0000","last_change":"2023-11-28T12:09:35.599100+0000","last_active":"2023-11-28T12:09:35.604218+0000","last_peered":"2023-11-28T12:09:35.604218+0000","last_clean":"2023-11-28T12:09:35.604218+0000","last_became_active":"2023-11-28T12:09:35.598659+0000","last_became_peered":"2023-11-28T12:09:35.598659+0000","last_unstale":"2023-11-28T12:09:35.604218+0000","last_undegraded":"2023-11-28T12:09:35.604218+0000","last_fullsized":"2023-11-28T12:09:35.604218+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:19:34.215973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.602583+0000","last_change":"2023-11-28T12:09:35.599123+0000","last_active":"2023-11-28T12:09:35.602583+0000","last_peered":"2023-11-28T12:09:35.602583+0000","last_clean":"2023-11-28T12:09:35.602583+0000","last_became_active":"2023-11-28T12:09:35.595879+0000","last_became_peered":"2023-11-28T12:09:35.595879+0000","last_unstale":"2023-11-28T12:09:35.602583+0000","last_undegraded":"2023-11-28T12:09:35.602583+0000","last_fullsized":"2023-11-28T12:09:35.602583+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:41:18.178376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.601612+0000","last_change":"2023-11-28T12:09:35.597330+0000","last_active":"2023-11-28T12:09:35.601612+0000","last_peered":"2023-11-28T12:09:35.601612+0000","last_clean":"2023-11-28T12:09:35.601612+0000","last_became_active":"2023-11-28T12:09:35.596902+0000","last_became_peered":"2023-11-28T12:09:35.596902+0000","last_unstale":"2023-11-28T12:09:35.601612+0000","last_undegraded":"2023-11-28T12:09:35.601612+0000","last_fullsized":"2023-11-28T12:09:35.601612+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:46:05.667553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.603200+0000","last_change":"2023-11-28T12:09:35.597284+0000","last_active":"2023-11-28T12:09:35.603200+0000","last_peered":"2023-11-28T12:09:35.603200+0000","last_clean":"2023-11-28T12:09:35.603200+0000","last_became_active":"2023-11-28T12:09:35.596818+0000","last_became_peered":"2023-11-28T12:09:35.596818+0000","last_unstale":"2023-11-28T12:09:35.603200+0000","last_undegraded":"2023-11-28T12:09:35.603200+0000","last_fullsized":"2023-11-28T12:09:35.603200+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:02:15.142274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.603921+0000","last_change":"2023-11-28T12:09:35.597932+0000","last_active":"2023-11-28T12:09:35.603921+0000","last_peered":"2023-11-28T12:09:35.603921+0000","last_clean":"2023-11-28T12:09:35.603921+0000","last_became_active":"2023-11-28T12:09:35.597500+0000","last_became_peered":"2023-11-28T12:09:35.597500+0000","last_unstale":"2023-11-28T12:09:35.603921+0000","last_undegraded":"2023-11-28T12:09:35.603921+0000","last_fullsized":"2023-11-28T12:09:35.603921+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:43:19.346774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.588823+0000","last_change":"2023-11-28T12:09:35.586753+0000","last_active":"2023-11-28T12:09:35.588823+0000","last_peered":"2023-11-28T12:09:35.588823+0000","last_clean":"2023-11-28T12:09:35.588823+0000","last_became_active":"2023-11-28T12:09:35.586448+0000","last_became_peered":"2023-11-28T12:09:35.586448+0000","last_unstale":"2023-11-28T12:09:35.588823+0000","last_undegraded":"2023-11-28T12:09:35.588823+0000","last_fullsized":"2023-11-28T12:09:35.588823+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:29:48.091827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.614176+0000","last_change":"2023-11-28T12:09:35.604141+0000","last_active":"2023-11-28T12:09:35.614176+0000","last_peered":"2023-11-28T12:09:35.614176+0000","last_clean":"2023-11-28T12:09:35.614176+0000","last_became_active":"2023-11-28T12:09:35.603876+0000","last_became_peered":"2023-11-28T12:09:35.603876+0000","last_unstale":"2023-11-28T12:09:35.614176+0000","last_undegraded":"2023-11-28T12:09:35.614176+0000","last_fullsized":"2023-11-28T12:09:35.614176+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:26:24.199422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.596351+0000","last_change":"2023-11-28T12:09:35.590633+0000","last_active":"2023-11-28T12:09:35.596351+0000","last_peered":"2023-11-28T12:09:35.596351+0000","last_clean":"2023-11-28T12:09:35.596351+0000","last_became_active":"2023-11-28T12:09:35.590361+0000","last_became_peered":"2023-11-28T12:09:35.590361+0000","last_unstale":"2023-11-28T12:09:35.596351+0000","last_undegraded":"2023-11-28T12:09:35.596351+0000","last_fullsized":"2023-11-28T12:09:35.596351+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:55:47.755954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.601238+0000","last_change":"2023-11-28T12:09:35.596799+0000","last_active":"2023-11-28T12:09:35.601238+0000","last_peered":"2023-11-28T12:09:35.601238+0000","last_clean":"2023-11-28T12:09:35.601238+0000","last_became_active":"2023-11-28T12:09:35.596511+0000","last_became_peered":"2023-11-28T12:09:35.596511+0000","last_unstale":"2023-11-28T12:09:35.601238+0000","last_undegraded":"2023-11-28T12:09:35.601238+0000","last_fullsized":"2023-11-28T12:09:35.601238+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:46:42.416906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.604282+0000","last_change":"2023-11-28T12:09:35.600348+0000","last_active":"2023-11-28T12:09:35.604282+0000","last_peered":"2023-11-28T12:09:35.604282+0000","last_clean":"2023-11-28T12:09:35.604282+0000","last_became_active":"2023-11-28T12:09:35.599977+0000","last_became_peered":"2023-11-28T12:09:35.599977+0000","last_unstale":"2023-11-28T12:09:35.604282+0000","last_undegraded":"2023-11-28T12:09:35.604282+0000","last_fullsized":"2023-11-28T12:09:35.604282+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:58:50.322217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.614270+0000","last_change":"2023-11-28T12:09:35.605095+0000","last_active":"2023-11-28T12:09:35.614270+0000","last_peered":"2023-11-28T12:09:35.614270+0000","last_clean":"2023-11-28T12:09:35.614270+0000","last_became_active":"2023-11-28T12:09:35.604455+0000","last_became_peered":"2023-11-28T12:09:35.604455+0000","last_unstale":"2023-11-28T12:09:35.614270+0000","last_undegraded":"2023-11-28T12:09:35.614270+0000","last_fullsized":"2023-11-28T12:09:35.614270+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:13:37.049227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.614338+0000","last_change":"2023-11-28T12:09:35.605602+0000","last_active":"2023-11-28T12:09:35.614338+0000","last_peered":"2023-11-28T12:09:35.614338+0000","last_clean":"2023-11-28T12:09:35.614338+0000","last_became_active":"2023-11-28T12:09:35.605066+0000","last_became_peered":"2023-11-28T12:09:35.605066+0000","last_unstale":"2023-11-28T12:09:35.614338+0000","last_undegraded":"2023-11-28T12:09:35.614338+0000","last_fullsized":"2023-11-28T12:09:35.614338+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:19:11.426595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.604163+0000","last_change":"2023-11-28T12:09:35.599439+0000","last_active":"2023-11-28T12:09:35.604163+0000","last_peered":"2023-11-28T12:09:35.604163+0000","last_clean":"2023-11-28T12:09:35.604163+0000","last_became_active":"2023-11-28T12:09:35.599175+0000","last_became_peered":"2023-11-28T12:09:35.599175+0000","last_unstale":"2023-11-28T12:09:35.604163+0000","last_undegraded":"2023-11-28T12:09:35.604163+0000","last_fullsized":"2023-11-28T12:09:35.604163+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:13:37.049227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.607483+0000","last_change":"2023-11-28T12:09:35.606174+0000","last_active":"2023-11-28T12:09:35.607483+0000","last_peered":"2023-11-28T12:09:35.607483+0000","last_clean":"2023-11-28T12:09:35.607483+0000","last_became_active":"2023-11-28T12:09:35.605465+0000","last_became_peered":"2023-11-28T12:09:35.605465+0000","last_unstale":"2023-11-28T12:09:35.607483+0000","last_undegraded":"2023-11-28T12:09:35.607483+0000","last_fullsized":"2023-11-28T12:09:35.607483+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:34:17.964248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.604168+0000","last_change":"2023-11-28T12:09:35.598037+0000","last_active":"2023-11-28T12:09:35.604168+0000","last_peered":"2023-11-28T12:09:35.604168+0000","last_clean":"2023-11-28T12:09:35.604168+0000","last_became_active":"2023-11-28T12:09:35.597630+0000","last_became_peered":"2023-11-28T12:09:35.597630+0000","last_unstale":"2023-11-28T12:09:35.604168+0000","last_undegraded":"2023-11-28T12:09:35.604168+0000","last_fullsized":"2023-11-28T12:09:35.604168+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:42:27.807000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.614363+0000","last_change":"2023-11-28T12:09:35.609588+0000","last_active":"2023-11-28T12:09:35.614363+0000","last_peered":"2023-11-28T12:09:35.614363+0000","last_clean":"2023-11-28T12:09:35.614363+0000","last_became_active":"2023-11-28T12:09:35.607007+0000","last_became_peered":"2023-11-28T12:09:35.607007+0000","last_unstale":"2023-11-28T12:09:35.614363+0000","last_undegraded":"2023-11-28T12:09:35.614363+0000","last_fullsized":"2023-11-28T12:09:35.614363+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:56:16.059248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.606023+0000","last_change":"2023-11-28T12:09:35.602114+0000","last_active":"2023-11-28T12:09:35.606023+0000","last_peered":"2023-11-28T12:09:35.606023+0000","last_clean":"2023-11-28T12:09:35.606023+0000","last_became_active":"2023-11-28T12:09:35.598483+0000","last_became_peered":"2023-11-28T12:09:35.598483+0000","last_unstale":"2023-11-28T12:09:35.606023+0000","last_undegraded":"2023-11-28T12:09:35.606023+0000","last_fullsized":"2023-11-28T12:09:35.606023+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:56:16.059248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.601798+0000","last_change":"2023-11-28T12:09:35.595357+0000","last_active":"2023-11-28T12:09:35.601798+0000","last_peered":"2023-11-28T12:09:35.601798+0000","last_clean":"2023-11-28T12:09:35.601798+0000","last_became_active":"2023-11-28T12:09:35.595053+0000","last_became_peered":"2023-11-28T12:09:35.595053+0000","last_unstale":"2023-11-28T12:09:35.601798+0000","last_undegraded":"2023-11-28T12:09:35.601798+0000","last_fullsized":"2023-11-28T12:09:35.601798+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:26:23.256385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.603702+0000","last_change":"2023-11-28T12:09:35.596958+0000","last_active":"2023-11-28T12:09:35.603702+0000","last_peered":"2023-11-28T12:09:35.603702+0000","last_clean":"2023-11-28T12:09:35.603702+0000","last_became_active":"2023-11-28T12:09:35.596693+0000","last_became_peered":"2023-11-28T12:09:35.596693+0000","last_unstale":"2023-11-28T12:09:35.603702+0000","last_undegraded":"2023-11-28T12:09:35.603702+0000","last_fullsized":"2023-11-28T12:09:35.603702+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:11:13.531310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"60'4","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.607168+0000","last_change":"2023-11-28T12:09:35.073218+0000","last_active":"2023-11-28T12:09:35.607168+0000","last_peered":"2023-11-28T12:09:35.607168+0000","last_clean":"2023-11-28T12:09:35.607168+0000","last_became_active":"2023-11-28T12:09:35.072943+0000","last_became_peered":"2023-11-28T12:09:35.072943+0000","last_unstale":"2023-11-28T12:09:35.607168+0000","last_undegraded":"2023-11-28T12:09:35.607168+0000","last_fullsized":"2023-11-28T12:09:35.607168+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_clean_scrub_stamp":"2023-11-28T12:09:34.041090+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:47:41.658363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.602503+0000","last_change":"2023-11-28T12:09:35.593833+0000","last_active":"2023-11-28T12:09:35.602503+0000","last_peered":"2023-11-28T12:09:35.602503+0000","last_clean":"2023-11-28T12:09:35.602503+0000","last_became_active":"2023-11-28T12:09:35.591321+0000","last_became_peered":"2023-11-28T12:09:35.591321+0000","last_unstale":"2023-11-28T12:09:35.602503+0000","last_undegraded":"2023-11-28T12:09:35.602503+0000","last_fullsized":"2023-11-28T12:09:35.602503+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:08:23.743352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"60'1","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.608472+0000","last_change":"2023-11-28T12:09:35.066239+0000","last_active":"2023-11-28T12:09:35.608472+0000","last_peered":"2023-11-28T12:09:35.608472+0000","last_clean":"2023-11-28T12:09:35.608472+0000","last_became_active":"2023-11-28T12:09:35.065267+0000","last_became_peered":"2023-11-28T12:09:35.065267+0000","last_unstale":"2023-11-28T12:09:35.608472+0000","last_undegraded":"2023-11-28T12:09:35.608472+0000","last_fullsized":"2023-11-28T12:09:35.608472+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_clean_scrub_stamp":"2023-11-28T12:09:34.041090+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:58:49.319390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.604475+0000","last_change":"2023-11-28T12:09:35.596127+0000","last_active":"2023-11-28T12:09:35.604475+0000","last_peered":"2023-11-28T12:09:35.604475+0000","last_clean":"2023-11-28T12:09:35.604475+0000","last_became_active":"2023-11-28T12:09:35.595839+0000","last_became_peered":"2023-11-28T12:09:35.595839+0000","last_unstale":"2023-11-28T12:09:35.604475+0000","last_undegraded":"2023-11-28T12:09:35.604475+0000","last_fullsized":"2023-11-28T12:09:35.604475+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:42:58.688632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"60'2","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.603643+0000","last_change":"2023-11-28T12:09:35.071352+0000","last_active":"2023-11-28T12:09:35.603643+0000","last_peered":"2023-11-28T12:09:35.603643+0000","last_clean":"2023-11-28T12:09:35.603643+0000","last_became_active":"2023-11-28T12:09:35.070486+0000","last_became_peered":"2023-11-28T12:09:35.070486+0000","last_unstale":"2023-11-28T12:09:35.603643+0000","last_undegraded":"2023-11-28T12:09:35.603643+0000","last_fullsized":"2023-11-28T12:09:35.603643+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_clean_scrub_stamp":"2023-11-28T12:09:34.041090+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:19:33.213147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.605831+0000","last_change":"2023-11-28T12:09:35.595369+0000","last_active":"2023-11-28T12:09:35.605831+0000","last_peered":"2023-11-28T12:09:35.605831+0000","last_clean":"2023-11-28T12:09:35.605831+0000","last_became_active":"2023-11-28T12:09:35.595094+0000","last_became_peered":"2023-11-28T12:09:35.595094+0000","last_unstale":"2023-11-28T12:09:35.605831+0000","last_undegraded":"2023-11-28T12:09:35.605831+0000","last_fullsized":"2023-11-28T12:09:35.605831+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:46:42.416906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"60'2","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.605646+0000","last_change":"2023-11-28T12:09:35.067283+0000","last_active":"2023-11-28T12:09:35.605646+0000","last_peered":"2023-11-28T12:09:35.605646+0000","last_clean":"2023-11-28T12:09:35.605646+0000","last_became_active":"2023-11-28T12:09:35.067009+0000","last_became_peered":"2023-11-28T12:09:35.067009+0000","last_unstale":"2023-11-28T12:09:35.605646+0000","last_undegraded":"2023-11-28T12:09:35.605646+0000","last_fullsized":"2023-11-28T12:09:35.605646+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_clean_scrub_stamp":"2023-11-28T12:09:34.041090+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:42:26.804173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.602601+0000","last_change":"2023-11-28T12:09:35.600462+0000","last_active":"2023-11-28T12:09:35.602601+0000","last_peered":"2023-11-28T12:09:35.602601+0000","last_clean":"2023-11-28T12:09:35.602601+0000","last_became_active":"2023-11-28T12:09:35.599343+0000","last_became_peered":"2023-11-28T12:09:35.599343+0000","last_unstale":"2023-11-28T12:09:35.602601+0000","last_undegraded":"2023-11-28T12:09:35.602601+0000","last_fullsized":"2023-11-28T12:09:35.602601+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:01:42.019908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"60'1","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.604184+0000","last_change":"2023-11-28T12:09:35.058384+0000","last_active":"2023-11-28T12:09:35.604184+0000","last_peered":"2023-11-28T12:09:35.604184+0000","last_clean":"2023-11-28T12:09:35.604184+0000","last_became_active":"2023-11-28T12:09:35.058078+0000","last_became_peered":"2023-11-28T12:09:35.058078+0000","last_unstale":"2023-11-28T12:09:35.604184+0000","last_undegraded":"2023-11-28T12:09:35.604184+0000","last_fullsized":"2023-11-28T12:09:35.604184+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_clean_scrub_stamp":"2023-11-28T12:09:34.041090+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:04:30.813868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.601468+0000","last_change":"2023-11-28T12:09:35.597995+0000","last_active":"2023-11-28T12:09:35.601468+0000","last_peered":"2023-11-28T12:09:35.601468+0000","last_clean":"2023-11-28T12:09:35.601468+0000","last_became_active":"2023-11-28T12:09:35.596778+0000","last_became_peered":"2023-11-28T12:09:35.596778+0000","last_unstale":"2023-11-28T12:09:35.601468+0000","last_undegraded":"2023-11-28T12:09:35.601468+0000","last_fullsized":"2023-11-28T12:09:35.601468+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:38:35.572106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"60'1","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.601438+0000","last_change":"2023-11-28T12:09:35.072987+0000","last_active":"2023-11-28T12:09:35.601438+0000","last_peered":"2023-11-28T12:09:35.601438+0000","last_clean":"2023-11-28T12:09:35.601438+0000","last_became_active":"2023-11-28T12:09:35.067900+0000","last_became_peered":"2023-11-28T12:09:35.067900+0000","last_unstale":"2023-11-28T12:09:35.601438+0000","last_undegraded":"2023-11-28T12:09:35.601438+0000","last_fullsized":"2023-11-28T12:09:35.601438+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_clean_scrub_stamp":"2023-11-28T12:09:34.041090+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:15:07.711906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.603930+0000","last_change":"2023-11-28T12:09:35.595743+0000","last_active":"2023-11-28T12:09:35.603930+0000","last_peered":"2023-11-28T12:09:35.603930+0000","last_clean":"2023-11-28T12:09:35.603930+0000","last_became_active":"2023-11-28T12:09:35.595443+0000","last_became_peered":"2023-11-28T12:09:35.595443+0000","last_unstale":"2023-11-28T12:09:35.603930+0000","last_undegraded":"2023-11-28T12:09:35.603930+0000","last_fullsized":"2023-11-28T12:09:35.603930+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:34:36.189661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.576611+0000","last_change":"2023-11-28T12:09:35.071465+0000","last_active":"2023-11-28T12:09:35.576611+0000","last_peered":"2023-11-28T12:09:35.576611+0000","last_clean":"2023-11-28T12:09:35.576611+0000","last_became_active":"2023-11-28T12:09:35.071101+0000","last_became_peered":"2023-11-28T12:09:35.071101+0000","last_unstale":"2023-11-28T12:09:35.576611+0000","last_undegraded":"2023-11-28T12:09:35.576611+0000","last_fullsized":"2023-11-28T12:09:35.576611+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_clean_scrub_stamp":"2023-11-28T12:09:34.041090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:13:36.046400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.599221+0000","last_change":"2023-11-28T12:09:35.593571+0000","last_active":"2023-11-28T12:09:35.599221+0000","last_peered":"2023-11-28T12:09:35.599221+0000","last_clean":"2023-11-28T12:09:35.599221+0000","last_became_active":"2023-11-28T12:09:35.593312+0000","last_became_peered":"2023-11-28T12:09:35.593312+0000","last_unstale":"2023-11-28T12:09:35.599221+0000","last_undegraded":"2023-11-28T12:09:35.599221+0000","last_fullsized":"2023-11-28T12:09:35.599221+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:49:52.632769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.580268+0000","last_change":"2023-11-28T12:09:35.076438+0000","last_active":"2023-11-28T12:09:35.580268+0000","last_peered":"2023-11-28T12:09:35.580268+0000","last_clean":"2023-11-28T12:09:35.580268+0000","last_became_active":"2023-11-28T12:09:35.074033+0000","last_became_peered":"2023-11-28T12:09:35.074033+0000","last_unstale":"2023-11-28T12:09:35.580268+0000","last_undegraded":"2023-11-28T12:09:35.580268+0000","last_fullsized":"2023-11-28T12:09:35.580268+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_clean_scrub_stamp":"2023-11-28T12:09:34.041090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:59:01.370346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.608534+0000","last_change":"2023-11-28T12:09:35.606365+0000","last_active":"2023-11-28T12:09:35.608534+0000","last_peered":"2023-11-28T12:09:35.608534+0000","last_clean":"2023-11-28T12:09:35.608534+0000","last_became_active":"2023-11-28T12:09:35.605899+0000","last_became_peered":"2023-11-28T12:09:35.605899+0000","last_unstale":"2023-11-28T12:09:35.608534+0000","last_undegraded":"2023-11-28T12:09:35.608534+0000","last_fullsized":"2023-11-28T12:09:35.608534+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:11:13.531310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.586897+0000","last_change":"2023-11-28T12:09:35.077535+0000","last_active":"2023-11-28T12:09:35.586897+0000","last_peered":"2023-11-28T12:09:35.586897+0000","last_clean":"2023-11-28T12:09:35.586897+0000","last_became_active":"2023-11-28T12:09:35.077273+0000","last_became_peered":"2023-11-28T12:09:35.077273+0000","last_unstale":"2023-11-28T12:09:35.586897+0000","last_undegraded":"2023-11-28T12:09:35.586897+0000","last_fullsized":"2023-11-28T12:09:35.586897+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_clean_scrub_stamp":"2023-11-28T12:09:34.041090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:01:47.348003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.602136+0000","last_change":"2023-11-28T12:09:35.600835+0000","last_active":"2023-11-28T12:09:35.602136+0000","last_peered":"2023-11-28T12:09:35.602136+0000","last_clean":"2023-11-28T12:09:35.602136+0000","last_became_active":"2023-11-28T12:09:35.600300+0000","last_became_peered":"2023-11-28T12:09:35.600300+0000","last_unstale":"2023-11-28T12:09:35.602136+0000","last_undegraded":"2023-11-28T12:09:35.602136+0000","last_fullsized":"2023-11-28T12:09:35.602136+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:22:03.453096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.587639+0000","last_change":"2023-11-28T12:09:35.072627+0000","last_active":"2023-11-28T12:09:35.587639+0000","last_peered":"2023-11-28T12:09:35.587639+0000","last_clean":"2023-11-28T12:09:35.587639+0000","last_became_active":"2023-11-28T12:09:35.072353+0000","last_became_peered":"2023-11-28T12:09:35.072353+0000","last_unstale":"2023-11-28T12:09:35.587639+0000","last_undegraded":"2023-11-28T12:09:35.587639+0000","last_fullsized":"2023-11-28T12:09:35.587639+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_clean_scrub_stamp":"2023-11-28T12:09:34.041090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:10:44.467012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.602910+0000","last_change":"2023-11-28T12:09:35.593031+0000","last_active":"2023-11-28T12:09:35.602910+0000","last_peered":"2023-11-28T12:09:35.602910+0000","last_clean":"2023-11-28T12:09:35.602910+0000","last_became_active":"2023-11-28T12:09:35.592778+0000","last_became_peered":"2023-11-28T12:09:35.592778+0000","last_unstale":"2023-11-28T12:09:35.602910+0000","last_undegraded":"2023-11-28T12:09:35.602910+0000","last_fullsized":"2023-11-28T12:09:35.602910+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:01:48.350829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"60'3","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.614654+0000","last_change":"2023-11-28T12:09:35.075883+0000","last_active":"2023-11-28T12:09:35.614654+0000","last_peered":"2023-11-28T12:09:35.614654+0000","last_clean":"2023-11-28T12:09:35.614654+0000","last_became_active":"2023-11-28T12:09:35.075571+0000","last_became_peered":"2023-11-28T12:09:35.075571+0000","last_unstale":"2023-11-28T12:09:35.614654+0000","last_undegraded":"2023-11-28T12:09:35.614654+0000","last_fullsized":"2023-11-28T12:09:35.614654+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_clean_scrub_stamp":"2023-11-28T12:09:34.041090+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:11:12.528484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.601411+0000","last_change":"2023-11-28T12:09:35.593656+0000","last_active":"2023-11-28T12:09:35.601411+0000","last_peered":"2023-11-28T12:09:35.601411+0000","last_clean":"2023-11-28T12:09:35.601411+0000","last_became_active":"2023-11-28T12:09:35.591170+0000","last_became_peered":"2023-11-28T12:09:35.591170+0000","last_unstale":"2023-11-28T12:09:35.601411+0000","last_undegraded":"2023-11-28T12:09:35.601411+0000","last_fullsized":"2023-11-28T12:09:35.601411+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:26:24.199422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"60'6","reported_seq":16,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.614588+0000","last_change":"2023-11-28T12:09:35.071862+0000","last_active":"2023-11-28T12:09:35.614588+0000","last_peered":"2023-11-28T12:09:35.614588+0000","last_clean":"2023-11-28T12:09:35.614588+0000","last_became_active":"2023-11-28T12:09:35.071534+0000","last_became_peered":"2023-11-28T12:09:35.071534+0000","last_unstale":"2023-11-28T12:09:35.614588+0000","last_undegraded":"2023-11-28T12:09:35.614588+0000","last_fullsized":"2023-11-28T12:09:35.614588+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_clean_scrub_stamp":"2023-11-28T12:09:34.041090+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:47:37.925397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.603597+0000","last_change":"2023-11-28T12:09:35.598095+0000","last_active":"2023-11-28T12:09:35.603597+0000","last_peered":"2023-11-28T12:09:35.603597+0000","last_clean":"2023-11-28T12:09:35.603597+0000","last_became_active":"2023-11-28T12:09:35.597832+0000","last_became_peered":"2023-11-28T12:09:35.597832+0000","last_unstale":"2023-11-28T12:09:35.603597+0000","last_undegraded":"2023-11-28T12:09:35.603597+0000","last_fullsized":"2023-11-28T12:09:35.603597+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:04:31.816695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"60'2","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.614572+0000","last_change":"2023-11-28T12:09:35.080855+0000","last_active":"2023-11-28T12:09:35.614572+0000","last_peered":"2023-11-28T12:09:35.614572+0000","last_clean":"2023-11-28T12:09:35.614572+0000","last_became_active":"2023-11-28T12:09:35.080537+0000","last_became_peered":"2023-11-28T12:09:35.080537+0000","last_unstale":"2023-11-28T12:09:35.614572+0000","last_undegraded":"2023-11-28T12:09:35.614572+0000","last_fullsized":"2023-11-28T12:09:35.614572+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_clean_scrub_stamp":"2023-11-28T12:09:34.041090+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:46:04.664726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.611411+0000","last_change":"2023-11-28T12:09:35.599129+0000","last_active":"2023-11-28T12:09:35.611411+0000","last_peered":"2023-11-28T12:09:35.611411+0000","last_clean":"2023-11-28T12:09:35.611411+0000","last_became_active":"2023-11-28T12:09:35.595096+0000","last_became_peered":"2023-11-28T12:09:35.595096+0000","last_unstale":"2023-11-28T12:09:35.611411+0000","last_undegraded":"2023-11-28T12:09:35.611411+0000","last_fullsized":"2023-11-28T12:09:35.611411+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:03:59.390461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.587825+0000","last_change":"2023-11-28T12:09:35.071394+0000","last_active":"2023-11-28T12:09:35.587825+0000","last_peered":"2023-11-28T12:09:35.587825+0000","last_clean":"2023-11-28T12:09:35.587825+0000","last_became_active":"2023-11-28T12:09:35.069623+0000","last_became_peered":"2023-11-28T12:09:35.069623+0000","last_unstale":"2023-11-28T12:09:35.587825+0000","last_undegraded":"2023-11-28T12:09:35.587825+0000","last_fullsized":"2023-11-28T12:09:35.587825+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_clean_scrub_stamp":"2023-11-28T12:09:34.041090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:49:09.687206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.603947+0000","last_change":"2023-11-28T12:09:35.597968+0000","last_active":"2023-11-28T12:09:35.603947+0000","last_peered":"2023-11-28T12:09:35.603947+0000","last_clean":"2023-11-28T12:09:35.603947+0000","last_became_active":"2023-11-28T12:09:35.597701+0000","last_became_peered":"2023-11-28T12:09:35.597701+0000","last_unstale":"2023-11-28T12:09:35.603947+0000","last_undegraded":"2023-11-28T12:09:35.603947+0000","last_fullsized":"2023-11-28T12:09:35.603947+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:24:37.443174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.587976+0000","last_change":"2023-11-28T12:09:35.077932+0000","last_active":"2023-11-28T12:09:35.587976+0000","last_peered":"2023-11-28T12:09:35.587976+0000","last_clean":"2023-11-28T12:09:35.587976+0000","last_became_active":"2023-11-28T12:09:35.077592+0000","last_became_peered":"2023-11-28T12:09:35.077592+0000","last_unstale":"2023-11-28T12:09:35.587976+0000","last_undegraded":"2023-11-28T12:09:35.587976+0000","last_fullsized":"2023-11-28T12:09:35.587976+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_clean_scrub_stamp":"2023-11-28T12:09:34.041090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:24:49.598410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.607508+0000","last_change":"2023-11-28T12:09:35.600167+0000","last_active":"2023-11-28T12:09:35.607508+0000","last_peered":"2023-11-28T12:09:35.607508+0000","last_clean":"2023-11-28T12:09:35.607508+0000","last_became_active":"2023-11-28T12:09:35.596651+0000","last_became_peered":"2023-11-28T12:09:35.596651+0000","last_unstale":"2023-11-28T12:09:35.607508+0000","last_undegraded":"2023-11-28T12:09:35.607508+0000","last_fullsized":"2023-11-28T12:09:35.607508+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:24:50.601237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"60'8","reported_seq":18,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.617281+0000","last_change":"2023-11-28T12:09:35.065438+0000","last_active":"2023-11-28T12:09:35.617281+0000","last_peered":"2023-11-28T12:09:35.617281+0000","last_clean":"2023-11-28T12:09:35.617281+0000","last_became_active":"2023-11-28T12:09:35.065145+0000","last_became_peered":"2023-11-28T12:09:35.065145+0000","last_unstale":"2023-11-28T12:09:35.617281+0000","last_undegraded":"2023-11-28T12:09:35.617281+0000","last_fullsized":"2023-11-28T12:09:35.617281+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_clean_scrub_stamp":"2023-11-28T12:09:34.041090+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:43:18.343948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.602354+0000","last_change":"2023-11-28T12:09:35.594675+0000","last_active":"2023-11-28T12:09:35.602354+0000","last_peered":"2023-11-28T12:09:35.602354+0000","last_clean":"2023-11-28T12:09:35.602354+0000","last_became_active":"2023-11-28T12:09:35.594375+0000","last_became_peered":"2023-11-28T12:09:35.594375+0000","last_unstale":"2023-11-28T12:09:35.602354+0000","last_undegraded":"2023-11-28T12:09:35.602354+0000","last_fullsized":"2023-11-28T12:09:35.602354+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:23:47.188533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"60'2","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.607456+0000","last_change":"2023-11-28T12:09:35.072202+0000","last_active":"2023-11-28T12:09:35.607456+0000","last_peered":"2023-11-28T12:09:35.607456+0000","last_clean":"2023-11-28T12:09:35.607456+0000","last_became_active":"2023-11-28T12:09:35.071917+0000","last_became_peered":"2023-11-28T12:09:35.071917+0000","last_unstale":"2023-11-28T12:09:35.607456+0000","last_undegraded":"2023-11-28T12:09:35.607456+0000","last_fullsized":"2023-11-28T12:09:35.607456+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_clean_scrub_stamp":"2023-11-28T12:09:34.041090+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:11:51.987592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.604930+0000","last_change":"2023-11-28T12:09:35.603636+0000","last_active":"2023-11-28T12:09:35.604930+0000","last_peered":"2023-11-28T12:09:35.604930+0000","last_clean":"2023-11-28T12:09:35.604930+0000","last_became_active":"2023-11-28T12:09:35.603342+0000","last_became_peered":"2023-11-28T12:09:35.603342+0000","last_unstale":"2023-11-28T12:09:35.604930+0000","last_undegraded":"2023-11-28T12:09:35.604930+0000","last_fullsized":"2023-11-28T12:09:35.604930+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:02:11.686264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.588892+0000","last_change":"2023-11-28T12:09:35.065491+0000","last_active":"2023-11-28T12:09:35.588892+0000","last_peered":"2023-11-28T12:09:35.588892+0000","last_clean":"2023-11-28T12:09:35.588892+0000","last_became_active":"2023-11-28T12:09:35.065222+0000","last_became_peered":"2023-11-28T12:09:35.065222+0000","last_unstale":"2023-11-28T12:09:35.588892+0000","last_undegraded":"2023-11-28T12:09:35.588892+0000","last_fullsized":"2023-11-28T12:09:35.588892+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_clean_scrub_stamp":"2023-11-28T12:09:34.041090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:41:01.122493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.612055+0000","last_change":"2023-11-28T12:09:35.601153+0000","last_active":"2023-11-28T12:09:35.612055+0000","last_peered":"2023-11-28T12:09:35.612055+0000","last_clean":"2023-11-28T12:09:35.612055+0000","last_became_active":"2023-11-28T12:09:35.600810+0000","last_became_peered":"2023-11-28T12:09:35.600810+0000","last_unstale":"2023-11-28T12:09:35.612055+0000","last_undegraded":"2023-11-28T12:09:35.612055+0000","last_fullsized":"2023-11-28T12:09:35.612055+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:19:19.390237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.581404+0000","last_change":"2023-11-28T12:09:35.070255+0000","last_active":"2023-11-28T12:09:35.581404+0000","last_peered":"2023-11-28T12:09:35.581404+0000","last_clean":"2023-11-28T12:09:35.581404+0000","last_became_active":"2023-11-28T12:09:35.069816+0000","last_became_peered":"2023-11-28T12:09:35.069816+0000","last_unstale":"2023-11-28T12:09:35.581404+0000","last_undegraded":"2023-11-28T12:09:35.581404+0000","last_fullsized":"2023-11-28T12:09:35.581404+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_clean_scrub_stamp":"2023-11-28T12:09:34.041090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:40:08.857650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.602412+0000","last_change":"2023-11-28T12:09:35.589168+0000","last_active":"2023-11-28T12:09:35.602412+0000","last_peered":"2023-11-28T12:09:35.602412+0000","last_clean":"2023-11-28T12:09:35.602412+0000","last_became_active":"2023-11-28T12:09:35.588800+0000","last_became_peered":"2023-11-28T12:09:35.588800+0000","last_unstale":"2023-11-28T12:09:35.602412+0000","last_undegraded":"2023-11-28T12:09:35.602412+0000","last_fullsized":"2023-11-28T12:09:35.602412+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T14:12:45.259759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.591534+0000","last_change":"2023-11-28T12:09:35.069619+0000","last_active":"2023-11-28T12:09:35.591534+0000","last_peered":"2023-11-28T12:09:35.591534+0000","last_clean":"2023-11-28T12:09:35.591534+0000","last_became_active":"2023-11-28T12:09:35.069339+0000","last_became_peered":"2023-11-28T12:09:35.069339+0000","last_unstale":"2023-11-28T12:09:35.591534+0000","last_undegraded":"2023-11-28T12:09:35.591534+0000","last_fullsized":"2023-11-28T12:09:35.591534+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_clean_scrub_stamp":"2023-11-28T12:09:34.041090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:34:35.186834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.601665+0000","last_change":"2023-11-28T12:09:35.591228+0000","last_active":"2023-11-28T12:09:35.601665+0000","last_peered":"2023-11-28T12:09:35.601665+0000","last_clean":"2023-11-28T12:09:35.601665+0000","last_became_active":"2023-11-28T12:09:35.590935+0000","last_became_peered":"2023-11-28T12:09:35.590935+0000","last_unstale":"2023-11-28T12:09:35.601665+0000","last_undegraded":"2023-11-28T12:09:35.601665+0000","last_fullsized":"2023-11-28T12:09:35.601665+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:18:38.493867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.585025+0000","last_change":"2023-11-28T12:09:35.078059+0000","last_active":"2023-11-28T12:09:35.585025+0000","last_peered":"2023-11-28T12:09:35.585025+0000","last_clean":"2023-11-28T12:09:35.585025+0000","last_became_active":"2023-11-28T12:09:35.077732+0000","last_became_peered":"2023-11-28T12:09:35.077732+0000","last_unstale":"2023-11-28T12:09:35.585025+0000","last_undegraded":"2023-11-28T12:09:35.585025+0000","last_fullsized":"2023-11-28T12:09:35.585025+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_clean_scrub_stamp":"2023-11-28T12:09:34.041090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:34:16.961421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.603347+0000","last_change":"2023-11-28T12:09:35.596833+0000","last_active":"2023-11-28T12:09:35.603347+0000","last_peered":"2023-11-28T12:09:35.603347+0000","last_clean":"2023-11-28T12:09:35.603347+0000","last_became_active":"2023-11-28T12:09:35.596559+0000","last_became_peered":"2023-11-28T12:09:35.596559+0000","last_unstale":"2023-11-28T12:09:35.603347+0000","last_undegraded":"2023-11-28T12:09:35.603347+0000","last_fullsized":"2023-11-28T12:09:35.603347+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:20:46.437910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.576414+0000","last_change":"2023-11-28T12:09:35.067580+0000","last_active":"2023-11-28T12:09:35.576414+0000","last_peered":"2023-11-28T12:09:35.576414+0000","last_clean":"2023-11-28T12:09:35.576414+0000","last_became_active":"2023-11-28T12:09:35.067228+0000","last_became_peered":"2023-11-28T12:09:35.067228+0000","last_unstale":"2023-11-28T12:09:35.576414+0000","last_undegraded":"2023-11-28T12:09:35.576414+0000","last_fullsized":"2023-11-28T12:09:35.576414+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_clean_scrub_stamp":"2023-11-28T12:09:34.041090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:26:23.196595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.600062+0000","last_change":"2023-11-28T12:09:35.595420+0000","last_active":"2023-11-28T12:09:35.600062+0000","last_peered":"2023-11-28T12:09:35.600062+0000","last_clean":"2023-11-28T12:09:35.600062+0000","last_became_active":"2023-11-28T12:09:35.595119+0000","last_became_peered":"2023-11-28T12:09:35.595119+0000","last_unstale":"2023-11-28T12:09:35.600062+0000","last_undegraded":"2023-11-28T12:09:35.600062+0000","last_fullsized":"2023-11-28T12:09:35.600062+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:22:45.640742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.576718+0000","last_change":"2023-11-28T12:09:35.071056+0000","last_active":"2023-11-28T12:09:35.576718+0000","last_peered":"2023-11-28T12:09:35.576718+0000","last_clean":"2023-11-28T12:09:35.576718+0000","last_became_active":"2023-11-28T12:09:35.070355+0000","last_became_peered":"2023-11-28T12:09:35.070355+0000","last_unstale":"2023-11-28T12:09:35.576718+0000","last_undegraded":"2023-11-28T12:09:35.576718+0000","last_fullsized":"2023-11-28T12:09:35.576718+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_clean_scrub_stamp":"2023-11-28T12:09:34.041090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:08:22.740526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.600040+0000","last_change":"2023-11-28T12:09:35.595214+0000","last_active":"2023-11-28T12:09:35.600040+0000","last_peered":"2023-11-28T12:09:35.600040+0000","last_clean":"2023-11-28T12:09:35.600040+0000","last_became_active":"2023-11-28T12:09:35.594941+0000","last_became_peered":"2023-11-28T12:09:35.594941+0000","last_unstale":"2023-11-28T12:09:35.600040+0000","last_undegraded":"2023-11-28T12:09:35.600040+0000","last_fullsized":"2023-11-28T12:09:35.600040+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:03:43.700658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.584256+0000","last_change":"2023-11-28T12:09:35.078706+0000","last_active":"2023-11-28T12:09:35.584256+0000","last_peered":"2023-11-28T12:09:35.584256+0000","last_clean":"2023-11-28T12:09:35.584256+0000","last_became_active":"2023-11-28T12:09:35.077816+0000","last_became_peered":"2023-11-28T12:09:35.077816+0000","last_unstale":"2023-11-28T12:09:35.584256+0000","last_undegraded":"2023-11-28T12:09:35.584256+0000","last_fullsized":"2023-11-28T12:09:35.584256+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_clean_scrub_stamp":"2023-11-28T12:09:34.041090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:34:04.419751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.597000+0000","last_change":"2023-11-28T12:09:35.592038+0000","last_active":"2023-11-28T12:09:35.597000+0000","last_peered":"2023-11-28T12:09:35.597000+0000","last_clean":"2023-11-28T12:09:35.597000+0000","last_became_active":"2023-11-28T12:09:35.591737+0000","last_became_peered":"2023-11-28T12:09:35.591737+0000","last_unstale":"2023-11-28T12:09:35.597000+0000","last_undegraded":"2023-11-28T12:09:35.597000+0000","last_fullsized":"2023-11-28T12:09:35.597000+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:03:59.390461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"60'1","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.614562+0000","last_change":"2023-11-28T12:09:35.077440+0000","last_active":"2023-11-28T12:09:35.614562+0000","last_peered":"2023-11-28T12:09:35.614562+0000","last_clean":"2023-11-28T12:09:35.614562+0000","last_became_active":"2023-11-28T12:09:35.076989+0000","last_became_peered":"2023-11-28T12:09:35.076989+0000","last_unstale":"2023-11-28T12:09:35.614562+0000","last_undegraded":"2023-11-28T12:09:35.614562+0000","last_fullsized":"2023-11-28T12:09:35.614562+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_clean_scrub_stamp":"2023-11-28T12:09:34.041090+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:38:34.569280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":45,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.061297+0000","last_change":"2023-11-28T12:06:23.961595+0000","last_active":"2023-11-28T12:09:35.061297+0000","last_peered":"2023-11-28T12:09:35.061297+0000","last_clean":"2023-11-28T12:09:35.061297+0000","last_became_active":"2023-11-28T12:06:23.961257+0000","last_became_peered":"2023-11-28T12:06:23.961257+0000","last_unstale":"2023-11-28T12:09:35.061297+0000","last_undegraded":"2023-11-28T12:09:35.061297+0000","last_fullsized":"2023-11-28T12:09:35.061297+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:30:40.200095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.602391+0000","last_change":"2023-11-28T12:09:35.588425+0000","last_active":"2023-11-28T12:09:35.602391+0000","last_peered":"2023-11-28T12:09:35.602391+0000","last_clean":"2023-11-28T12:09:35.602391+0000","last_became_active":"2023-11-28T12:09:35.587631+0000","last_became_peered":"2023-11-28T12:09:35.587631+0000","last_unstale":"2023-11-28T12:09:35.602391+0000","last_undegraded":"2023-11-28T12:09:35.602391+0000","last_fullsized":"2023-11-28T12:09:35.602391+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:22:45.640742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.577515+0000","last_change":"2023-11-28T12:09:35.070612+0000","last_active":"2023-11-28T12:09:35.577515+0000","last_peered":"2023-11-28T12:09:35.577515+0000","last_clean":"2023-11-28T12:09:35.577515+0000","last_became_active":"2023-11-28T12:09:35.070337+0000","last_became_peered":"2023-11-28T12:09:35.070337+0000","last_unstale":"2023-11-28T12:09:35.577515+0000","last_undegraded":"2023-11-28T12:09:35.577515+0000","last_fullsized":"2023-11-28T12:09:35.577515+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_clean_scrub_stamp":"2023-11-28T12:09:34.041090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:56:15.056422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":48,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.054947+0000","last_change":"2023-11-28T12:06:23.517505+0000","last_active":"2023-11-28T12:09:35.054947+0000","last_peered":"2023-11-28T12:09:35.054947+0000","last_clean":"2023-11-28T12:09:35.054947+0000","last_became_active":"2023-11-28T12:06:23.517151+0000","last_became_peered":"2023-11-28T12:06:23.517151+0000","last_unstale":"2023-11-28T12:09:35.054947+0000","last_undegraded":"2023-11-28T12:09:35.054947+0000","last_fullsized":"2023-11-28T12:09:35.054947+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:30:40.200095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.601778+0000","last_change":"2023-11-28T12:09:35.594782+0000","last_active":"2023-11-28T12:09:35.601778+0000","last_peered":"2023-11-28T12:09:35.601778+0000","last_clean":"2023-11-28T12:09:35.601778+0000","last_became_active":"2023-11-28T12:09:35.592544+0000","last_became_peered":"2023-11-28T12:09:35.592544+0000","last_unstale":"2023-11-28T12:09:35.601778+0000","last_undegraded":"2023-11-28T12:09:35.601778+0000","last_fullsized":"2023-11-28T12:09:35.601778+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:22:08.701139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"60'2","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.604338+0000","last_change":"2023-11-28T12:09:35.076189+0000","last_active":"2023-11-28T12:09:35.604338+0000","last_peered":"2023-11-28T12:09:35.604338+0000","last_clean":"2023-11-28T12:09:35.604338+0000","last_became_active":"2023-11-28T12:09:35.075835+0000","last_became_peered":"2023-11-28T12:09:35.075835+0000","last_unstale":"2023-11-28T12:09:35.604338+0000","last_undegraded":"2023-11-28T12:09:35.604338+0000","last_fullsized":"2023-11-28T12:09:35.604338+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_clean_scrub_stamp":"2023-11-28T12:09:34.041090+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T17:04:30.813868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":47,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.069525+0000","last_change":"2023-11-28T12:06:23.517967+0000","last_active":"2023-11-28T12:09:35.069525+0000","last_peered":"2023-11-28T12:09:35.069525+0000","last_clean":"2023-11-28T12:09:35.069525+0000","last_became_active":"2023-11-28T12:06:23.517495+0000","last_became_peered":"2023-11-28T12:06:23.517495+0000","last_unstale":"2023-11-28T12:09:35.069525+0000","last_undegraded":"2023-11-28T12:09:35.069525+0000","last_fullsized":"2023-11-28T12:09:35.069525+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:51:06.844441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":199,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.070319+0000","last_change":"2023-11-28T12:06:23.513472+0000","last_active":"2023-11-28T12:09:35.070319+0000","last_peered":"2023-11-28T12:09:35.070319+0000","last_clean":"2023-11-28T12:09:35.070319+0000","last_became_active":"2023-11-28T12:06:23.513150+0000","last_became_peered":"2023-11-28T12:06:23.513150+0000","last_unstale":"2023-11-28T12:09:35.070319+0000","last_undegraded":"2023-11-28T12:09:35.070319+0000","last_fullsized":"2023-11-28T12:09:35.070319+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:34:18.653049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.614304+0000","last_change":"2023-11-28T12:09:35.605306+0000","last_active":"2023-11-28T12:09:35.614304+0000","last_peered":"2023-11-28T12:09:35.614304+0000","last_clean":"2023-11-28T12:09:35.614304+0000","last_became_active":"2023-11-28T12:09:35.604953+0000","last_became_peered":"2023-11-28T12:09:35.604953+0000","last_unstale":"2023-11-28T12:09:35.614304+0000","last_undegraded":"2023-11-28T12:09:35.614304+0000","last_fullsized":"2023-11-28T12:09:35.614304+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:15:08.714733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.587925+0000","last_change":"2023-11-28T12:09:35.069783+0000","last_active":"2023-11-28T12:09:35.587925+0000","last_peered":"2023-11-28T12:09:35.587925+0000","last_clean":"2023-11-28T12:09:35.587925+0000","last_became_active":"2023-11-28T12:09:35.069494+0000","last_became_peered":"2023-11-28T12:09:35.069494+0000","last_unstale":"2023-11-28T12:09:35.587925+0000","last_undegraded":"2023-11-28T12:09:35.587925+0000","last_fullsized":"2023-11-28T12:09:35.587925+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_clean_scrub_stamp":"2023-11-28T12:09:34.041090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:18:37.491041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":49,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.071150+0000","last_change":"2023-11-28T12:06:23.903708+0000","last_active":"2023-11-28T12:09:35.071150+0000","last_peered":"2023-11-28T12:09:35.071150+0000","last_clean":"2023-11-28T12:09:35.071150+0000","last_became_active":"2023-11-28T12:06:23.903399+0000","last_became_peered":"2023-11-28T12:06:23.903399+0000","last_unstale":"2023-11-28T12:09:35.071150+0000","last_undegraded":"2023-11-28T12:09:35.071150+0000","last_fullsized":"2023-11-28T12:09:35.071150+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:31:13.187145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.603836+0000","last_change":"2023-11-28T12:09:35.599538+0000","last_active":"2023-11-28T12:09:35.603836+0000","last_peered":"2023-11-28T12:09:35.603836+0000","last_clean":"2023-11-28T12:09:35.603836+0000","last_became_active":"2023-11-28T12:09:35.599169+0000","last_became_peered":"2023-11-28T12:09:35.599169+0000","last_unstale":"2023-11-28T12:09:35.603836+0000","last_undegraded":"2023-11-28T12:09:35.603836+0000","last_fullsized":"2023-11-28T12:09:35.603836+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:46:05.667553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.576252+0000","last_change":"2023-11-28T12:09:35.057603+0000","last_active":"2023-11-28T12:09:35.576252+0000","last_peered":"2023-11-28T12:09:35.576252+0000","last_clean":"2023-11-28T12:09:35.576252+0000","last_became_active":"2023-11-28T12:09:35.057301+0000","last_became_peered":"2023-11-28T12:09:35.057301+0000","last_unstale":"2023-11-28T12:09:35.576252+0000","last_undegraded":"2023-11-28T12:09:35.576252+0000","last_fullsized":"2023-11-28T12:09:35.576252+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_clean_scrub_stamp":"2023-11-28T12:09:34.041090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:20:45.435083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":49,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.070136+0000","last_change":"2023-11-28T12:06:23.903662+0000","last_active":"2023-11-28T12:09:35.070136+0000","last_peered":"2023-11-28T12:09:35.070136+0000","last_clean":"2023-11-28T12:09:35.070136+0000","last_became_active":"2023-11-28T12:06:23.903354+0000","last_became_peered":"2023-11-28T12:06:23.903354+0000","last_unstale":"2023-11-28T12:09:35.070136+0000","last_undegraded":"2023-11-28T12:09:35.070136+0000","last_fullsized":"2023-11-28T12:09:35.070136+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:02:07.694087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.603909+0000","last_change":"2023-11-28T12:09:35.595620+0000","last_active":"2023-11-28T12:09:35.603909+0000","last_peered":"2023-11-28T12:09:35.603909+0000","last_clean":"2023-11-28T12:09:35.603909+0000","last_became_active":"2023-11-28T12:09:35.595298+0000","last_became_peered":"2023-11-28T12:09:35.595298+0000","last_unstale":"2023-11-28T12:09:35.603909+0000","last_undegraded":"2023-11-28T12:09:35.603909+0000","last_fullsized":"2023-11-28T12:09:35.603909+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T13:47:42.661190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.580120+0000","last_change":"2023-11-28T12:09:35.066099+0000","last_active":"2023-11-28T12:09:35.580120+0000","last_peered":"2023-11-28T12:09:35.580120+0000","last_clean":"2023-11-28T12:09:35.580120+0000","last_became_active":"2023-11-28T12:09:35.065809+0000","last_became_peered":"2023-11-28T12:09:35.065809+0000","last_unstale":"2023-11-28T12:09:35.580120+0000","last_undegraded":"2023-11-28T12:09:35.580120+0000","last_fullsized":"2023-11-28T12:09:35.580120+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_clean_scrub_stamp":"2023-11-28T12:09:34.041090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:15:14.332696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":50,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.061997+0000","last_change":"2023-11-28T12:06:23.903797+0000","last_active":"2023-11-28T12:09:35.061997+0000","last_peered":"2023-11-28T12:09:35.061997+0000","last_clean":"2023-11-28T12:09:35.061997+0000","last_became_active":"2023-11-28T12:06:23.903475+0000","last_became_peered":"2023-11-28T12:06:23.903475+0000","last_unstale":"2023-11-28T12:09:35.061997+0000","last_undegraded":"2023-11-28T12:09:35.061997+0000","last_fullsized":"2023-11-28T12:09:35.061997+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:51:06.844441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.603466+0000","last_change":"2023-11-28T12:09:35.594467+0000","last_active":"2023-11-28T12:09:35.603466+0000","last_peered":"2023-11-28T12:09:35.603466+0000","last_clean":"2023-11-28T12:09:35.603466+0000","last_became_active":"2023-11-28T12:09:35.594019+0000","last_became_peered":"2023-11-28T12:09:35.594019+0000","last_unstale":"2023-11-28T12:09:35.603466+0000","last_undegraded":"2023-11-28T12:09:35.603466+0000","last_fullsized":"2023-11-28T12:09:35.603466+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:38:35.572106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"60'2","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.617180+0000","last_change":"2023-11-28T12:09:35.078464+0000","last_active":"2023-11-28T12:09:35.617180+0000","last_peered":"2023-11-28T12:09:35.617180+0000","last_clean":"2023-11-28T12:09:35.617180+0000","last_became_active":"2023-11-28T12:09:35.078171+0000","last_became_peered":"2023-11-28T12:09:35.078171+0000","last_unstale":"2023-11-28T12:09:35.617180+0000","last_undegraded":"2023-11-28T12:09:35.617180+0000","last_fullsized":"2023-11-28T12:09:35.617180+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_clean_scrub_stamp":"2023-11-28T12:09:34.041090+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:12:46.810191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":55,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.066255+0000","last_change":"2023-11-28T12:06:23.903983+0000","last_active":"2023-11-28T12:09:35.066255+0000","last_peered":"2023-11-28T12:09:35.066255+0000","last_clean":"2023-11-28T12:09:35.066255+0000","last_became_active":"2023-11-28T12:06:23.903511+0000","last_became_peered":"2023-11-28T12:06:23.903511+0000","last_unstale":"2023-11-28T12:09:35.066255+0000","last_undegraded":"2023-11-28T12:09:35.066255+0000","last_fullsized":"2023-11-28T12:09:35.066255+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:31:13.187145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.603947+0000","last_change":"2023-11-28T12:09:35.597524+0000","last_active":"2023-11-28T12:09:35.603947+0000","last_peered":"2023-11-28T12:09:35.603947+0000","last_clean":"2023-11-28T12:09:35.603947+0000","last_became_active":"2023-11-28T12:09:35.597227+0000","last_became_peered":"2023-11-28T12:09:35.597227+0000","last_unstale":"2023-11-28T12:09:35.603947+0000","last_undegraded":"2023-11-28T12:09:35.603947+0000","last_fullsized":"2023-11-28T12:09:35.603947+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:35.043916+0000","last_clean_scrub_stamp":"2023-11-28T12:09:35.043916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:15:15.335523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"60'1","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.611480+0000","last_change":"2023-11-28T12:09:35.073201+0000","last_active":"2023-11-28T12:09:35.611480+0000","last_peered":"2023-11-28T12:09:35.611480+0000","last_clean":"2023-11-28T12:09:35.611480+0000","last_became_active":"2023-11-28T12:09:35.072899+0000","last_became_peered":"2023-11-28T12:09:35.072899+0000","last_unstale":"2023-11-28T12:09:35.611480+0000","last_undegraded":"2023-11-28T12:09:35.611480+0000","last_fullsized":"2023-11-28T12:09:35.611480+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:09:34.041090+0000","last_clean_scrub_stamp":"2023-11-28T12:09:34.041090+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:25:59.054395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":55,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-28T12:09:35.067409+0000","last_change":"2023-11-28T12:06:23.517246+0000","last_active":"2023-11-28T12:09:35.067409+0000","last_peered":"2023-11-28T12:09:35.067409+0000","last_clean":"2023-11-28T12:09:35.067409+0000","last_became_active":"2023-11-28T12:06:23.516854+0000","last_became_peered":"2023-11-28T12:06:23.516854+0000","last_unstale":"2023-11-28T12:09:35.067409+0000","last_undegraded":"2023-11-28T12:09:35.067409+0000","last_fullsized":"2023-11-28T12:09:35.067409+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:51:06.844441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574891,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14876,"kb_used_data":1300,"kb_used_omap":0,"kb_used_meta":13568,"kb_avail":94356964,"statfs":{"total":96636764160,"available":96621531136,"internally_reserved":0,"allocated":1331200,"data_stored":909685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13893632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:09:25 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.64800000000000002,"15min":0.629},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.86399999999999999,"5min":1.141,"15min":1.141},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.69099999999999995,"15min":0.70399999999999996},"min":{"1min":0.38,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.94499999999999995,"5min":2.7469999999999999,"15min":2.7469999999999999},"last":0.438}]},{"osd":1,"last update":"Tue Nov 28 12:09:25 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.64500000000000002,"15min":0.62},"min":{"1min":0.45700000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.92800000000000005,"5min":1,"15min":1},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.621,"15min":0.60399999999999998},"min":{"1min":0.44900000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.98299999999999998,"5min":1.171,"15min":1.171},"last":0.61799999999999999}]},{"osd":2,"last update":"Tue Nov 28 12:09:25 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70499999999999996,"15min":0.70299999999999996},"min":{"1min":0.53900000000000003,"5min":0.441,"15min":0.441},"max":{"1min":0.92900000000000005,"5min":1.819,"15min":1.819},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.75900000000000001,"15min":0.75700000000000001},"min":{"1min":0.56899999999999995,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.92300000000000004,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":0.56399999999999995}]},{"osd":3,"last update":"Tue Nov 28 12:09:25 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.69299999999999995,"15min":0.68300000000000005},"min":{"1min":0.437,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.92100000000000004,"5min":0.999,"15min":0.999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.745,"15min":0.72899999999999998},"min":{"1min":0.55400000000000005,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0009999999999999,"5min":1.103,"15min":1.103},"last":0.63800000000000001}]},{"osd":4,"last update":"Tue Nov 28 12:09:25 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.60999999999999999,"15min":0.61599999999999999},"min":{"1min":0.433,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.81100000000000005,"5min":0.878,"15min":0.878},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.45600000000000002,"5min":0.442,"15min":0.442},"max":{"1min":1,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.745}]},{"osd":5,"last update":"Tue Nov 28 12:09:25 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.66200000000000003,"15min":0.66600000000000004},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.85299999999999998,"5min":1.044,"15min":1.044},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.72099999999999997,"15min":0.72899999999999998},"min":{"1min":0.50900000000000001,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.98199999999999998,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.66400000000000003}]},{"osd":6,"last update":"Tue Nov 28 12:09:25 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.65300000000000002,"15min":0.66800000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.872,"5min":1.012,"15min":1.012},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.75800000000000001,"15min":0.76900000000000002},"min":{"1min":0.53600000000000003,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.028,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.71099999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574889,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9356,"kb_used_data":708,"kb_used_omap":0,"kb_used_meta":8640,"kb_avail":94362484,"statfs":{"total":96636764160,"available":96627183616,"internally_reserved":0,"allocated":724992,"data_stored":318591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8847360},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:09:27 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.59199999999999997,"15min":0.58299999999999996},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.63,"5min":0.60499999999999998,"15min":0.59799999999999998},"min":{"1min":0.41499999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.74399999999999999}]},{"osd":1,"last update":"Tue Nov 28 12:09:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.64700000000000002,"15min":0.63400000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.70199999999999996,"15min":0.70499999999999996},"min":{"1min":0.60199999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.75800000000000001}]},{"osd":2,"last update":"Tue Nov 28 12:09:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.64000000000000001,"15min":0.63200000000000001},"min":{"1min":0.495,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.65000000000000002,"15min":0.64200000000000002},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.77300000000000002}]},{"osd":3,"last update":"Tue Nov 28 12:09:27 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.71699999999999997,"15min":0.72199999999999998},"min":{"1min":0.51600000000000001,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.72799999999999998,"15min":0.71999999999999997},"min":{"1min":0.53900000000000003,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.80500000000000005}]},{"osd":4,"last update":"Tue Nov 28 12:09:27 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.66800000000000004,"15min":0.67400000000000004},"min":{"1min":0.48199999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.94199999999999995,"5min":1.054,"15min":1.054},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.67700000000000005,"15min":0.67900000000000005},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.69399999999999995}]},{"osd":5,"last update":"Tue Nov 28 12:09:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68500000000000005,"15min":0.69499999999999995},"min":{"1min":0.42799999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76600000000000001,"15min":0.77100000000000002},"min":{"1min":0.52800000000000002,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.60699999999999998}]},{"osd":7,"last update":"Tue Nov 28 12:09:27 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.73999999999999999,"15min":0.752},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.95899999999999996,"5min":1.008,"15min":1.008},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.71799999999999997,"15min":0.72699999999999998},"min":{"1min":0.48099999999999998,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.96099999999999997,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.64800000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574891,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14632,"kb_used_data":1312,"kb_used_omap":0,"kb_used_meta":13312,"kb_avail":94357208,"statfs":{"total":96636764160,"available":96621780992,"internally_reserved":0,"allocated":1343488,"data_stored":911221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13631488},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.42899999999999999,"15min":0.437},"min":{"1min":0.30599999999999999,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.76800000000000002,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.48599999999999999,"15min":0.497},"min":{"1min":0.36399999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.64300000000000002,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.47999999999999998}]},{"osd":2,"last update":"Tue Nov 28 12:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.46800000000000003,"15min":0.47299999999999998},"min":{"1min":0.32300000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.70699999999999996,"5min":1.111,"15min":1.111},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48399999999999999,"15min":0.49399999999999999},"min":{"1min":0.35299999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.61799999999999999,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.46100000000000002}]},{"osd":3,"last update":"Tue Nov 28 12:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.57999999999999996,"15min":0.57699999999999996},"min":{"1min":0.45500000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.749,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.56899999999999995,"15min":0.55900000000000005},"min":{"1min":0.442,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.85399999999999998,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.51400000000000001}]},{"osd":4,"last update":"Tue Nov 28 12:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.71599999999999997,"15min":0.70799999999999996},"min":{"1min":0.58699999999999997,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.96299999999999997,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.749,"15min":0.753},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.93600000000000005,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.59599999999999997}]},{"osd":5,"last update":"Tue Nov 28 12:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.56999999999999995,"5min":0.496,"15min":0.496},"max":{"1min":0.95399999999999996,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.75800000000000001,"15min":0.76000000000000001},"min":{"1min":0.59399999999999997,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.008,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.57599999999999996}]},{"osd":6,"last update":"Tue Nov 28 12:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.77000000000000002,"15min":0.77600000000000002},"min":{"1min":0.61099999999999999,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.92500000000000004,"5min":1.21,"15min":1.21},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.80200000000000005,"15min":0.80600000000000005},"min":{"1min":0.66600000000000004,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.002,"5min":1.502,"15min":1.502},"last":0.63600000000000001}]},{"osd":7,"last update":"Tue Nov 28 12:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.69899999999999995,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.038,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.78200000000000003,"15min":0.78000000000000003},"min":{"1min":0.63800000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.98399999999999999,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.63}]}]},{"osd":0,"up_from":13,"seq":55834574889,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13636,"kb_used_data":700,"kb_used_omap":0,"kb_used_meta":12928,"kb_avail":94358204,"statfs":{"total":96636764160,"available":96622800896,"internally_reserved":0,"allocated":716800,"data_stored":317196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13238272},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 12:09:25 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.39200000000000002,"15min":0.38400000000000001},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.53900000000000003,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.48699999999999999,"15min":0.499},"min":{"1min":0.35299999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.68899999999999995,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.34200000000000003}]},{"osd":2,"last update":"Tue Nov 28 12:09:25 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.47599999999999998,"15min":0.47799999999999998},"min":{"1min":0.35299999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.64600000000000002,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.53400000000000003,"15min":0.54600000000000004},"min":{"1min":0.41699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.60499999999999998,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.39200000000000002}]},{"osd":3,"last update":"Tue Nov 28 12:09:25 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.52200000000000002,"15min":0.52600000000000002},"min":{"1min":0.34599999999999997,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.63300000000000001,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.59799999999999998,"15min":0.60799999999999998},"min":{"1min":0.45500000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.73399999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.55100000000000005}]},{"osd":4,"last update":"Tue Nov 28 12:09:25 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.79000000000000004,"15min":0.79600000000000004},"min":{"1min":0.60899999999999999,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.0620000000000001,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77600000000000002,"15min":0.77700000000000002},"min":{"1min":0.66300000000000003,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.97699999999999998,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.84199999999999997}]},{"osd":5,"last update":"Tue Nov 28 12:09:25 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.81799999999999995,"15min":0.83199999999999996},"min":{"1min":0.64600000000000002,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.018,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.753},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.81100000000000005,"15min":0.81299999999999994},"min":{"1min":0.64400000000000002,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.0049999999999999,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.86899999999999999}]},{"osd":6,"last update":"Tue Nov 28 12:09:25 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.80700000000000005,"15min":0.81000000000000005},"min":{"1min":0.65700000000000003,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.0429999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83599999999999997,"15min":0.84999999999999998},"min":{"1min":0.70799999999999996,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.157,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.88300000000000001}]},{"osd":7,"last update":"Tue Nov 28 12:09:25 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.84999999999999998,"15min":0.86099999999999999},"min":{"1min":0.68500000000000005,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.109,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.81000000000000005,"15min":0.81299999999999994},"min":{"1min":0.629,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.0509999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.82999999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574890,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13448,"kb_used_data":704,"kb_used_omap":0,"kb_used_meta":12736,"kb_avail":94358392,"statfs":{"total":96636764160,"available":96622993408,"internally_reserved":0,"allocated":720896,"data_stored":318557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13041664},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:09:25 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.439,"15min":0.437},"min":{"1min":0.32300000000000001,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.71699999999999997,"5min":0.745,"15min":0.745},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45500000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.67500000000000004,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":1.4770000000000001}]},{"osd":1,"last update":"Tue Nov 28 12:09:25 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.49299999999999999,"15min":0.48799999999999999},"min":{"1min":0.39900000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.67900000000000005,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.376},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.51200000000000001,"15min":0.51100000000000001},"min":{"1min":0.38200000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.71399999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":1.589}]},{"osd":3,"last update":"Tue Nov 28 12:09:25 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.47799999999999998,"15min":0.47999999999999998},"min":{"1min":0.32200000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":1.762},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55900000000000005,"15min":0.56699999999999995},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.81100000000000005,"5min":0.876,"15min":0.876},"last":0.42999999999999999}]},{"osd":4,"last update":"Tue Nov 28 12:09:25 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.83199999999999996,"15min":0.83099999999999996},"min":{"1min":0.61499999999999999,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.0900000000000001,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.82099999999999995,"15min":0.82299999999999995},"min":{"1min":0.65000000000000002,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":1.534}]},{"osd":5,"last update":"Tue Nov 28 12:09:25 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.75800000000000001,"15min":0.748},"min":{"1min":0.60199999999999998,"5min":0.497,"15min":0.497},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":1.6259999999999999},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.79100000000000004,"15min":0.79000000000000004},"min":{"1min":0.54600000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.044,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.57899999999999996}]},{"osd":6,"last update":"Tue Nov 28 12:09:25 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.79300000000000004,"15min":0.78900000000000003},"min":{"1min":0.56999999999999995,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":1.9219999999999999},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.80200000000000005,"15min":0.79200000000000004},"min":{"1min":0.51700000000000002,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":1.698}]},{"osd":7,"last update":"Tue Nov 28 12:09:25 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.81000000000000005,"15min":0.80900000000000005},"min":{"1min":0.60299999999999998,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.131,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":1.9830000000000001},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.071,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":1.804}]}]},{"osd":3,"up_from":13,"seq":55834574889,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13828,"kb_used_data":700,"kb_used_omap":0,"kb_used_meta":13120,"kb_avail":94358012,"statfs":{"total":96636764160,"available":96622604288,"internally_reserved":0,"allocated":716800,"data_stored":317196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13434880},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:09:29 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.437,"15min":0.44},"min":{"1min":0.29899999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.57599999999999996,"5min":0.622,"15min":0.622},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.503,"5min":0.45600000000000002,"15min":0.45000000000000001},"min":{"1min":0.318,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.68899999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.441}]},{"osd":1,"last update":"Tue Nov 28 12:09:29 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.434,"15min":0.42599999999999999},"min":{"1min":0.30599999999999999,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.504,"5min":0.52000000000000002,"15min":0.53100000000000003},"min":{"1min":0.42699999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.60599999999999998,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.48999999999999999}]},{"osd":2,"last update":"Tue Nov 28 12:09:29 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.52400000000000002,"15min":0.52200000000000002},"min":{"1min":0.42499999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.75700000000000001,"5min":1.022,"15min":1.022},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.56599999999999995,"15min":0.56999999999999995},"min":{"1min":0.45300000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.66000000000000003,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.61299999999999999}]},{"osd":4,"last update":"Tue Nov 28 12:09:29 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.71599999999999997,"15min":0.70599999999999996},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.71799999999999997,"15min":0.71299999999999997},"min":{"1min":0.64500000000000002,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.66000000000000003}]},{"osd":5,"last update":"Tue Nov 28 12:09:29 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.75700000000000001,"15min":0.753},"min":{"1min":0.67000000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.77000000000000002,"15min":0.77800000000000002},"min":{"1min":0.66000000000000003,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.02,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.67600000000000005}]},{"osd":6,"last update":"Tue Nov 28 12:09:29 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.77400000000000002,"15min":0.77000000000000002},"min":{"1min":0.61099999999999999,"5min":0.498,"15min":0.498},"max":{"1min":1.004,"5min":1.026,"15min":1.026},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.78600000000000003,"15min":0.78400000000000003},"min":{"1min":0.60699999999999998,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.0760000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.54800000000000004}]},{"osd":7,"last update":"Tue Nov 28 12:09:29 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.78800000000000003,"15min":0.79000000000000004},"min":{"1min":0.629,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.097,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.80200000000000005,"15min":0.79800000000000004},"min":{"1min":0.64500000000000002,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.149,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.627}]}]},{"osd":4,"up_from":13,"seq":55834574889,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9556,"kb_used_data":716,"kb_used_omap":0,"kb_used_meta":8832,"kb_avail":94362284,"statfs":{"total":96636764160,"available":96626978816,"internally_reserved":0,"allocated":733184,"data_stored":320105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9043968},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:09:26 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.65200000000000002,"15min":0.65000000000000002},"min":{"1min":0.47199999999999998,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.871,"5min":1.044,"15min":1.044},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.65600000000000003,"15min":0.65500000000000003},"min":{"1min":0.46500000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.88500000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.55500000000000005}]},{"osd":1,"last update":"Tue Nov 28 12:09:26 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.67400000000000004,"15min":0.66800000000000004},"min":{"1min":0.50600000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.68100000000000005,"15min":0.68500000000000005},"min":{"1min":0.51000000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.99199999999999999,"5min":1.097,"15min":1.097},"last":0.628}]},{"osd":2,"last update":"Tue Nov 28 12:09:26 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.71199999999999997,"15min":0.71699999999999997},"min":{"1min":0.59099999999999997,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.86699999999999999,"5min":1.125,"15min":1.125},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.73499999999999999,"15min":0.74099999999999999},"min":{"1min":0.57099999999999995,"5min":0.435,"15min":0.435},"max":{"1min":0.92400000000000004,"5min":1.143,"15min":1.143},"last":0.72399999999999998}]},{"osd":3,"last update":"Tue Nov 28 12:09:26 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.67700000000000005,"15min":0.68000000000000005},"min":{"1min":0.55000000000000004,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.97199999999999998,"5min":1.093,"15min":1.093},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.76000000000000001,"15min":0.77600000000000002},"min":{"1min":0.625,"5min":0.5,"15min":0.5},"max":{"1min":0.95299999999999996,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.67200000000000004}]},{"osd":5,"last update":"Tue Nov 28 12:09:26 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.69399999999999995,"15min":0.71999999999999997},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.76700000000000002,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.69499999999999995,"15min":0.70999999999999996},"min":{"1min":0.46200000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.874,"5min":1.296,"15min":1.296},"last":0.60899999999999999}]},{"osd":6,"last update":"Tue Nov 28 12:09:26 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.73499999999999999,"15min":0.751},"min":{"1min":0.49099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.91300000000000003,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.79100000000000004,"15min":0.81399999999999995},"min":{"1min":0.51500000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.93400000000000005,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.751}]},{"osd":7,"last update":"Tue Nov 28 12:09:26 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.76600000000000001,"15min":0.79200000000000004},"min":{"1min":0.54700000000000004,"5min":0.499,"15min":0.499},"max":{"1min":0.92600000000000005,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.82399999999999995,"15min":0.84999999999999998},"min":{"1min":0.56999999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.0449999999999999,"5min":1.28,"15min":1.28},"last":0.58499999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574890,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9484,"kb_used_data":708,"kb_used_omap":0,"kb_used_meta":8768,"kb_avail":94362356,"statfs":{"total":96636764160,"available":96627052544,"internally_reserved":0,"allocated":724992,"data_stored":318579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8978432},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:09:28 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.65500000000000003,"15min":0.64800000000000002},"min":{"1min":0.51300000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.88300000000000001,"5min":1.204,"15min":1.204},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.70699999999999996,"15min":0.69599999999999995},"min":{"1min":0.56100000000000005,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.89900000000000002,"5min":1.048,"15min":1.048},"last":0.73899999999999999}]},{"osd":1,"last update":"Tue Nov 28 12:09:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.621,"15min":0.59399999999999997},"min":{"1min":0.47499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.84799999999999998,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.753},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.628,"15min":0.60799999999999998},"min":{"1min":0.45700000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.878,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.61699999999999999}]},{"osd":2,"last update":"Tue Nov 28 12:09:28 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67400000000000004,"15min":0.68000000000000005},"min":{"1min":0.48399999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.79700000000000004,"5min":1.173,"15min":1.173},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.68700000000000006,"15min":0.69099999999999995},"min":{"1min":0.47199999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.89000000000000001,"5min":1.298,"15min":1.298},"last":0.66800000000000004}]},{"osd":3,"last update":"Tue Nov 28 12:09:28 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.69399999999999995,"15min":0.69099999999999995},"min":{"1min":0.49299999999999999,"5min":0.438,"15min":0.438},"max":{"1min":0.86799999999999999,"5min":1.093,"15min":1.093},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.755,"5min":0.745,"15min":0.747},"min":{"1min":0.57099999999999995,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.91900000000000004,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.70599999999999996}]},{"osd":4,"last update":"Tue Nov 28 12:09:28 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.68000000000000005,"15min":0.70099999999999996},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.81100000000000005,"5min":1.141,"15min":1.141},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.53700000000000003,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.92400000000000004,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.627}]},{"osd":6,"last update":"Tue Nov 28 12:09:28 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.72599999999999998,"15min":0.752},"min":{"1min":0.438,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.89500000000000002,"5min":1.264,"15min":1.264},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.63,"5min":0.70899999999999996,"15min":0.72299999999999998},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.91300000000000003,"5min":0.997,"15min":0.997},"last":0.56399999999999995}]},{"osd":7,"last update":"Tue Nov 28 12:09:28 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.73099999999999998,"15min":0.752},"min":{"1min":0.48399999999999999,"5min":0.435,"15min":0.435},"max":{"1min":0.93300000000000005,"5min":1.173,"15min":1.173},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.76300000000000001,"15min":0.78300000000000003},"min":{"1min":0.56000000000000005,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.88300000000000001,"5min":1.008,"15min":1.008},"last":0.58599999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T12:09:40.489 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-28T12:09:40.489 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw pool=cephfs_data' mds allow 2023-11-28T12:09:40.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.736+0000 7f035a1ff700 1 Processor -- start 2023-11-28T12:09:40.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.737+0000 7f035a1ff700 1 -- start start 2023-11-28T12:09:40.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.738+0000 7f035a1ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f03540cd7c0 0x7f03540cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:40.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.738+0000 7f035a1ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03540d1950 con 0x7f035415c9b0 2023-11-28T12:09:40.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.738+0000 7f035a1ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03540ce140 con 0x7f0354161340 2023-11-28T12:09:40.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.738+0000 7f035a1ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03540b5800 con 0x7f03540cd7c0 2023-11-28T12:09:40.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.738+0000 7f03537fe700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f035415c9b0 0x7f03540b4bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:54910/0 (socket says 172.21.15.45:54910) 2023-11-28T12:09:40.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.738+0000 7f03537fe700 1 -- 172.21.15.45:0/1993512543 learned_addr learned my addr 172.21.15.45:0/1993512543 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:09:40.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.738+0000 7f0353fff700 1 --2- 172.21.15.45:0/1993512543 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f03540cd7c0 0x7f03540cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:40.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.738+0000 7f03527fc700 1 -- 172.21.15.45:0/1993512543 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 494900616 0 0) 0x7f03540d1950 con 0x7f035415c9b0 2023-11-28T12:09:40.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.739+0000 7f03527fc700 1 -- 172.21.15.45:0/1993512543 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f033c0035b0 con 0x7f035415c9b0 2023-11-28T12:09:40.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.739+0000 7f03527fc700 1 -- 172.21.15.45:0/1993512543 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 596655223 0 0) 0x7f03540ce140 con 0x7f0354161340 2023-11-28T12:09:40.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.739+0000 7f03527fc700 1 -- 172.21.15.45:0/1993512543 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03540d1950 con 0x7f0354161340 2023-11-28T12:09:40.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.739+0000 7f03527fc700 1 -- 172.21.15.45:0/1993512543 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2512691859 0 0) 0x7f033c0035b0 con 0x7f035415c9b0 2023-11-28T12:09:40.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.739+0000 7f03527fc700 1 -- 172.21.15.45:0/1993512543 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f03540cd7c0 msgr2=0x7f03540cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:40.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.739+0000 7f03527fc700 1 --2- 172.21.15.45:0/1993512543 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f03540cd7c0 0x7f03540cdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:40.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.739+0000 7f03527fc700 1 -- 172.21.15.45:0/1993512543 >> v1:172.21.15.152:6789/0 conn(0x7f0354161340 legacy=0x7f03540d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:40.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.739+0000 7f03527fc700 1 -- 172.21.15.45:0/1993512543 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03540d24f0 con 0x7f035415c9b0 2023-11-28T12:09:40.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.739+0000 7f03527fc700 1 -- 172.21.15.45:0/1993512543 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3460218165 0 0) 0x7f0344001670 con 0x7f035415c9b0 2023-11-28T12:09:40.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.739+0000 7f03527fc700 1 -- 172.21.15.45:0/1993512543 >> v1:172.21.15.45:6789/0 conn(0x7f035415c9b0 legacy=0x7f03540b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:40.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.739+0000 7f03527fc700 1 --2- 172.21.15.45:0/1993512543 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f033c003bc0 0x7f033c003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:40.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.739+0000 7f03527fc700 1 --2- 172.21.15.45:0/1993512543 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f033c004850 0x7f033c004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:40.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.739+0000 7f03527fc700 1 --2- 172.21.15.45:0/1993512543 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f03540cd7c0 0x7f033c005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:40.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.739+0000 7f03527fc700 1 -- 172.21.15.45:0/1993512543 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03540b5800 con 0x7f033c004850 2023-11-28T12:09:40.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.739+0000 7f03527fc700 1 -- 172.21.15.45:0/1993512543 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f033c00bb20 con 0x7f033c003bc0 2023-11-28T12:09:40.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.739+0000 7f03527fc700 1 -- 172.21.15.45:0/1993512543 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f033c00bce0 con 0x7f03540cd7c0 2023-11-28T12:09:40.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.739+0000 7f0352ffd700 1 --2- 172.21.15.45:0/1993512543 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f033c004850 0x7f033c004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:40.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.739+0000 7f03537fe700 1 --2- 172.21.15.45:0/1993512543 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f033c003bc0 0x7f033c003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:40.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.739+0000 7f0353fff700 1 --2- 172.21.15.45:0/1993512543 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f03540cd7c0 0x7f033c005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:40.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.740+0000 7f0352ffd700 1 -- 172.21.15.45:0/1993512543 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f03540cd7c0 msgr2=0x7f033c005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:40.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.740+0000 7f0352ffd700 1 --2- 172.21.15.45:0/1993512543 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f03540cd7c0 0x7f033c005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:40.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.740+0000 7f0352ffd700 1 -- 172.21.15.45:0/1993512543 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f033c003bc0 msgr2=0x7f033c003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:40.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.740+0000 7f0352ffd700 1 --2- 172.21.15.45:0/1993512543 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f033c003bc0 0x7f033c003fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:40.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.740+0000 7f0352ffd700 1 -- 172.21.15.45:0/1993512543 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f033c0035b0 con 0x7f033c004850 2023-11-28T12:09:40.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.740+0000 7f0352ffd700 1 --2- 172.21.15.45:0/1993512543 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f033c004850 0x7f033c004cc0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f0348001940 tx=0x7f033c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdd808e46d035611 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:40.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.740+0000 7f03527fc700 1 -- 172.21.15.45:0/1993512543 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0348001430 con 0x7f033c004850 2023-11-28T12:09:40.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.740+0000 7f03527fc700 1 -- 172.21.15.45:0/1993512543 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0348001d70 con 0x7f033c004850 2023-11-28T12:09:40.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.740+0000 7f03527fc700 1 -- 172.21.15.45:0/1993512543 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0348005510 con 0x7f033c004850 2023-11-28T12:09:40.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.741+0000 7f035a1ff700 1 -- 172.21.15.45:0/1993512543 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f033c004850 msgr2=0x7f033c004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:40.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.741+0000 7f035a1ff700 1 --2- 172.21.15.45:0/1993512543 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f033c004850 0x7f033c004cc0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f0348001940 tx=0x7f033c005880 comp rx=0 tx=0).stop 2023-11-28T12:09:40.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.741+0000 7f0353fff700 1 -- 172.21.15.45:0/1993512543 reap_dead start 2023-11-28T12:09:40.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.741+0000 7f035a1ff700 1 -- 172.21.15.45:0/1993512543 shutdown_connections 2023-11-28T12:09:40.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.741+0000 7f035a1ff700 1 -- 172.21.15.45:0/1993512543 >> 172.21.15.45:0/1993512543 conn(0x7f0354072600 msgr2=0x7f03540cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:40.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.741+0000 7f035a1ff700 1 -- 172.21.15.45:0/1993512543 shutdown_connections 2023-11-28T12:09:40.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.741+0000 7f035a1ff700 1 -- 172.21.15.45:0/1993512543 wait complete. 2023-11-28T12:09:40.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.743+0000 7f035a1ff700 1 Processor -- start 2023-11-28T12:09:40.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.744+0000 7f035a1ff700 1 -- start start 2023-11-28T12:09:40.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.745+0000 7f035a1ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f033c004850 0x7f03540cb530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:40.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.745+0000 7f035a1ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0354153d30 0x7f03540cce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:40.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.745+0000 7f035a1ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03540cd380 0x7f035415e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:40.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.745+0000 7f035a1ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03540c9b80 con 0x7f03540cd380 2023-11-28T12:09:40.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.745+0000 7f035a1ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03540cba70 con 0x7f0354153d30 2023-11-28T12:09:40.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.745+0000 7f035a1ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03540ca240 con 0x7f033c004850 2023-11-28T12:09:40.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.745+0000 7f0353fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03540cd380 0x7f035415e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:40.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.745+0000 7f0353fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03540cd380 0x7f035415e480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49810/0 (socket says 172.21.15.45:49810) 2023-11-28T12:09:40.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.745+0000 7f0353fff700 1 -- 172.21.15.45:0/2285175527 learned_addr learned my addr 172.21.15.45:0/2285175527 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:09:40.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.745+0000 7f03537fe700 1 --2- 172.21.15.45:0/2285175527 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f033c004850 0x7f03540cb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:40.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.745+0000 7f0352ffd700 1 --2- 172.21.15.45:0/2285175527 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0354153d30 0x7f03540cce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:40.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.746+0000 7f0353fff700 1 -- 172.21.15.45:0/2285175527 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f033c004850 msgr2=0x7f03540cb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:40.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.746+0000 7f0353fff700 1 --2- 172.21.15.45:0/2285175527 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f033c004850 0x7f03540cb530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:40.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.746+0000 7f0353fff700 1 -- 172.21.15.45:0/2285175527 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0354153d30 msgr2=0x7f03540cce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:40.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.746+0000 7f0353fff700 1 --2- 172.21.15.45:0/2285175527 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0354153d30 0x7f03540cce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:40.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.746+0000 7f0353fff700 1 -- 172.21.15.45:0/2285175527 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03540d1300 con 0x7f03540cd380 2023-11-28T12:09:40.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.746+0000 7f03537fe700 1 --2- 172.21.15.45:0/2285175527 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f033c004850 0x7f03540cb530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:09:40.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.746+0000 7f0352ffd700 1 --2- 172.21.15.45:0/2285175527 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0354153d30 0x7f03540cce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:09:40.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.746+0000 7f0353fff700 1 --2- 172.21.15.45:0/2285175527 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03540cd380 0x7f035415e480 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f035406bbb0 tx=0x7f034c00f490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:40.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.746+0000 7f033bfff700 1 -- 172.21.15.45:0/2285175527 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f034c00e040 con 0x7f03540cd380 2023-11-28T12:09:40.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.746+0000 7f033bfff700 1 -- 172.21.15.45:0/2285175527 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f034c00f040 con 0x7f03540cd380 2023-11-28T12:09:40.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.746+0000 7f035a1ff700 1 -- 172.21.15.45:0/2285175527 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03540b5520 con 0x7f03540cd380 2023-11-28T12:09:40.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.746+0000 7f033bfff700 1 -- 172.21.15.45:0/2285175527 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f034c015430 con 0x7f03540cd380 2023-11-28T12:09:40.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.746+0000 7f035a1ff700 1 -- 172.21.15.45:0/2285175527 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03540d15e0 con 0x7f03540cd380 2023-11-28T12:09:40.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.747+0000 7f035a1ff700 1 -- 172.21.15.45:0/2285175527 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03540745c0 con 0x7f03540cd380 2023-11-28T12:09:40.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.748+0000 7f033bfff700 1 -- 172.21.15.45:0/2285175527 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f034c015590 con 0x7f03540cd380 2023-11-28T12:09:40.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.749+0000 7f033bfff700 1 --2- 172.21.15.45:0/2285175527 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f03400682f0 0x7f034006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:40.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.749+0000 7f033bfff700 1 -- 172.21.15.45:0/2285175527 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f034c086420 con 0x7f03540cd380 2023-11-28T12:09:40.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.750+0000 7f03537fe700 1 --2- 172.21.15.45:0/2285175527 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f03400682f0 0x7f034006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:40.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.750+0000 7f03537fe700 1 --2- 172.21.15.45:0/2285175527 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f03400682f0 0x7f034006a7a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f0344001eb0 tx=0x7f0344009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:40.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:40.753+0000 7f033bfff700 1 -- 172.21.15.45:0/2285175527 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f034c052b90 con 0x7f03540cd380 2023-11-28T12:09:41.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.034+0000 7f035a1ff700 1 -- 172.21.15.45:0/2285175527 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs_data", "mds", "allow"]} v 0) v1 -- 0x7f03540d08a0 con 0x7f03540cd380 2023-11-28T12:09:41.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.039+0000 7f033bfff700 1 -- 172.21.15.45:0/2285175527 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs_data", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 184+0+0 (secure 0 0 0) 0x7f034c0561b0 con 0x7f03540cd380 2023-11-28T12:09:41.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.041+0000 7f035a1ff700 1 -- 172.21.15.45:0/2285175527 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f03400682f0 msgr2=0x7f034006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:41.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.041+0000 7f035a1ff700 1 --2- 172.21.15.45:0/2285175527 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f03400682f0 0x7f034006a7a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f0344001eb0 tx=0x7f0344009040 comp rx=0 tx=0).stop 2023-11-28T12:09:41.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.041+0000 7f035a1ff700 1 -- 172.21.15.45:0/2285175527 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03540cd380 msgr2=0x7f035415e480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:41.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.041+0000 7f035a1ff700 1 --2- 172.21.15.45:0/2285175527 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03540cd380 0x7f035415e480 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f035406bbb0 tx=0x7f034c00f490 comp rx=0 tx=0).stop 2023-11-28T12:09:41.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.041+0000 7f035a1ff700 1 -- 172.21.15.45:0/2285175527 shutdown_connections 2023-11-28T12:09:41.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.041+0000 7f035a1ff700 1 --2- 172.21.15.45:0/2285175527 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f03400682f0 0x7f034006a7a0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:41.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.041+0000 7f035a1ff700 1 --2- 172.21.15.45:0/2285175527 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03540cd380 0x7f035415e480 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:41.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.041+0000 7f035a1ff700 1 --2- 172.21.15.45:0/2285175527 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f033c004850 0x7f03540cb530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:41.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.041+0000 7f035a1ff700 1 --2- 172.21.15.45:0/2285175527 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0354153d30 0x7f03540cce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:41.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.041+0000 7f035a1ff700 1 -- 172.21.15.45:0/2285175527 >> 172.21.15.45:0/2285175527 conn(0x7f0354072600 msgr2=0x7f03540b88f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:41.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.041+0000 7f035a1ff700 1 -- 172.21.15.45:0/2285175527 shutdown_connections 2023-11-28T12:09:41.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.041+0000 7f035a1ff700 1 -- 172.21.15.45:0/2285175527 wait complete. 2023-11-28T12:09:41.043 INFO:teuthology.orchestra.run.smithi045.stderr:updated caps for client.0 2023-11-28T12:09:41.060 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T12:09:41.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.263+0000 7f97ed3ff700 1 Processor -- start 2023-11-28T12:09:41.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.263+0000 7f97ed3ff700 1 -- start start 2023-11-28T12:09:41.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.264+0000 7f97ed3ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f97e80d01b0 0x7f97e80d0c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:41.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.264+0000 7f97ed3ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f97e80b16d0 0x7f97e80d1160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:41.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.264+0000 7f97ed3ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97e80b0230 con 0x7f97e80b20b0 2023-11-28T12:09:41.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.264+0000 7f97ed3ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97e815cec0 con 0x7f97e80b16d0 2023-11-28T12:09:41.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.264+0000 7f97ed3ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97e80b4570 con 0x7f97e80d01b0 2023-11-28T12:09:41.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.264+0000 7f97e67fc700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f97e80b20b0 0x7f97e80b29b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:54920/0 (socket says 172.21.15.45:54920) 2023-11-28T12:09:41.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.264+0000 7f97e67fc700 1 -- 172.21.15.45:0/526177196 learned_addr learned my addr 172.21.15.45:0/526177196 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:09:41.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.265+0000 7f97e6ffd700 1 --2- 172.21.15.45:0/526177196 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f97e80d01b0 0x7f97e80d0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:41.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.265+0000 7f97e77fe700 1 --2- 172.21.15.45:0/526177196 >> v2:172.21.15.152:3300/0 conn(0x7f97e80b16d0 0x7f97e80d1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:41.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.265+0000 7f97e5ffb700 1 -- 172.21.15.45:0/526177196 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 237660725 0 0) 0x7f97e80b0230 con 0x7f97e80b20b0 2023-11-28T12:09:41.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.265+0000 7f97e5ffb700 1 -- 172.21.15.45:0/526177196 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97d00035b0 con 0x7f97e80b20b0 2023-11-28T12:09:41.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.265+0000 7f97e5ffb700 1 -- 172.21.15.45:0/526177196 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3489547041 0 0) 0x7f97d00035b0 con 0x7f97e80b20b0 2023-11-28T12:09:41.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.265+0000 7f97e5ffb700 1 -- 172.21.15.45:0/526177196 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f97e80d01b0 msgr2=0x7f97e80d0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:41.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.265+0000 7f97e5ffb700 1 --2- 172.21.15.45:0/526177196 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f97e80d01b0 0x7f97e80d0c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:41.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.265+0000 7f97e5ffb700 1 -- 172.21.15.45:0/526177196 >> v2:172.21.15.152:3300/0 conn(0x7f97e80b16d0 msgr2=0x7f97e80d1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:41.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.265+0000 7f97e5ffb700 1 --2- 172.21.15.45:0/526177196 >> v2:172.21.15.152:3300/0 conn(0x7f97e80b16d0 0x7f97e80d1160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:41.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.265+0000 7f97e5ffb700 1 -- 172.21.15.45:0/526177196 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97e80b4850 con 0x7f97e80b20b0 2023-11-28T12:09:41.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.265+0000 7f97e5ffb700 1 -- 172.21.15.45:0/526177196 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3460218165 0 0) 0x7f97dc001670 con 0x7f97e80b20b0 2023-11-28T12:09:41.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.265+0000 7f97e5ffb700 1 -- 172.21.15.45:0/526177196 >> v1:172.21.15.45:6789/0 conn(0x7f97e80b20b0 legacy=0x7f97e80b29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:41.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.265+0000 7f97e5ffb700 1 --2- 172.21.15.45:0/526177196 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97d0003a00 0x7f97d0003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:41.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.265+0000 7f97e5ffb700 1 --2- 172.21.15.45:0/526177196 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f97e80d01b0 0x7f97d0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:41.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.265+0000 7f97e5ffb700 1 --2- 172.21.15.45:0/526177196 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f97d0004d90 0x7f97d0005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:41.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.265+0000 7f97e5ffb700 1 -- 172.21.15.45:0/526177196 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97e815cec0 con 0x7f97d0003a00 2023-11-28T12:09:41.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.265+0000 7f97e5ffb700 1 -- 172.21.15.45:0/526177196 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97e80b4570 con 0x7f97d0004d90 2023-11-28T12:09:41.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.265+0000 7f97e5ffb700 1 -- 172.21.15.45:0/526177196 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97d000ba10 con 0x7f97e80d01b0 2023-11-28T12:09:41.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.266+0000 7f97e6ffd700 1 --2- 172.21.15.45:0/526177196 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97d0003a00 0x7f97d0003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:41.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.266+0000 7f97e77fe700 1 --2- 172.21.15.45:0/526177196 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f97d0004d90 0x7f97d0005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:41.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.266+0000 7f97e67fc700 1 --2- 172.21.15.45:0/526177196 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f97e80d01b0 0x7f97d0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:41.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.266+0000 7f97e6ffd700 1 -- 172.21.15.45:0/526177196 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f97e80d01b0 msgr2=0x7f97d0004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:41.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.266+0000 7f97e6ffd700 1 --2- 172.21.15.45:0/526177196 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f97e80d01b0 0x7f97d0004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:41.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.266+0000 7f97e6ffd700 1 -- 172.21.15.45:0/526177196 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f97d0004d90 msgr2=0x7f97d0005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:41.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.266+0000 7f97e6ffd700 1 --2- 172.21.15.45:0/526177196 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f97d0004d90 0x7f97d0005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:41.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.266+0000 7f97e6ffd700 1 -- 172.21.15.45:0/526177196 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97d00035b0 con 0x7f97d0003a00 2023-11-28T12:09:41.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.266+0000 7f97e77fe700 1 --2- 172.21.15.45:0/526177196 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f97d0004d90 0x7f97d0005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:09:41.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.266+0000 7f97e6ffd700 1 --2- 172.21.15.45:0/526177196 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97d0003a00 0x7f97d0003e10 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f97d8009b60 tx=0x7f97d0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fa4c9c2f8e38aaa server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:41.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.266+0000 7f97e5ffb700 1 -- 172.21.15.45:0/526177196 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d800e660 con 0x7f97d0003a00 2023-11-28T12:09:41.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.266+0000 7f97e5ffb700 1 -- 172.21.15.45:0/526177196 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97d800e7c0 con 0x7f97d0003a00 2023-11-28T12:09:41.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.266+0000 7f97e5ffb700 1 -- 172.21.15.45:0/526177196 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d800eb30 con 0x7f97d0003a00 2023-11-28T12:09:41.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.267+0000 7f97ed3ff700 1 -- 172.21.15.45:0/526177196 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97d0003a00 msgr2=0x7f97d0003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:41.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.267+0000 7f97ed3ff700 1 --2- 172.21.15.45:0/526177196 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97d0003a00 0x7f97d0003e10 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f97d8009b60 tx=0x7f97d0005880 comp rx=0 tx=0).stop 2023-11-28T12:09:41.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.267+0000 7f97e77fe700 1 -- 172.21.15.45:0/526177196 reap_dead start 2023-11-28T12:09:41.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.267+0000 7f97ed3ff700 1 -- 172.21.15.45:0/526177196 shutdown_connections 2023-11-28T12:09:41.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.267+0000 7f97ed3ff700 1 -- 172.21.15.45:0/526177196 >> 172.21.15.45:0/526177196 conn(0x7f97e809c3f0 msgr2=0x7f97e80d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:41.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.267+0000 7f97ed3ff700 1 -- 172.21.15.45:0/526177196 shutdown_connections 2023-11-28T12:09:41.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.267+0000 7f97ed3ff700 1 -- 172.21.15.45:0/526177196 wait complete. 2023-11-28T12:09:41.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.269+0000 7f97ed3ff700 1 Processor -- start 2023-11-28T12:09:41.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.269+0000 7f97ed3ff700 1 -- start start 2023-11-28T12:09:41.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.270+0000 7f97ed3ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f97d0003a00 0x7f97e80b6d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:41.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.270+0000 7f97ed3ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f97e80b5e80 0x7f97e80cb560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:41.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.270+0000 7f97ed3ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97e80cbaa0 0x7f97e80cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:41.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.270+0000 7f97ed3ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97e80c6f90 con 0x7f97e80cbaa0 2023-11-28T12:09:41.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.270+0000 7f97ed3ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97e80cc480 con 0x7f97d0003a00 2023-11-28T12:09:41.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.270+0000 7f97ed3ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97e80cc900 con 0x7f97e80b5e80 2023-11-28T12:09:41.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.270+0000 7f97e77fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97e80cbaa0 0x7f97e80cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:41.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.270+0000 7f97e77fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97e80cbaa0 0x7f97e80cbf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49824/0 (socket says 172.21.15.45:49824) 2023-11-28T12:09:41.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.270+0000 7f97e77fe700 1 -- 172.21.15.45:0/2226225480 learned_addr learned my addr 172.21.15.45:0/2226225480 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:09:41.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.270+0000 7f97e6ffd700 1 --2- 172.21.15.45:0/2226225480 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f97d0003a00 0x7f97e80b6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:41.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.271+0000 7f97e67fc700 1 --2- 172.21.15.45:0/2226225480 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f97e80b5e80 0x7f97e80cb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:41.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.271+0000 7f97e77fe700 1 -- 172.21.15.45:0/2226225480 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f97e80b5e80 msgr2=0x7f97e80cb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:41.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.271+0000 7f97e77fe700 1 --2- 172.21.15.45:0/2226225480 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f97e80b5e80 0x7f97e80cb560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:41.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.271+0000 7f97e77fe700 1 -- 172.21.15.45:0/2226225480 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f97d0003a00 msgr2=0x7f97e80b6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:41.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.271+0000 7f97e77fe700 1 --2- 172.21.15.45:0/2226225480 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f97d0003a00 0x7f97e80b6d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:41.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.271+0000 7f97e77fe700 1 -- 172.21.15.45:0/2226225480 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97e80afec0 con 0x7f97e80cbaa0 2023-11-28T12:09:41.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.271+0000 7f97e77fe700 1 --2- 172.21.15.45:0/2226225480 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97e80cbaa0 0x7f97e80cbf40 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f97e80b5be0 tx=0x7f97e00104a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:41.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.271+0000 7f97cf7fe700 1 -- 172.21.15.45:0/2226225480 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e001b070 con 0x7f97e80cbaa0 2023-11-28T12:09:41.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.271+0000 7f97cf7fe700 1 -- 172.21.15.45:0/2226225480 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97e000f040 con 0x7f97e80cbaa0 2023-11-28T12:09:41.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.271+0000 7f97ed3ff700 1 -- 172.21.15.45:0/2226225480 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97e80afbe0 con 0x7f97e80cbaa0 2023-11-28T12:09:41.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.271+0000 7f97cf7fe700 1 -- 172.21.15.45:0/2226225480 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e000e050 con 0x7f97e80cbaa0 2023-11-28T12:09:41.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.271+0000 7f97ed3ff700 1 -- 172.21.15.45:0/2226225480 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97e80b2600 con 0x7f97e80cbaa0 2023-11-28T12:09:41.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.272+0000 7f97ed3ff700 1 -- 172.21.15.45:0/2226225480 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97e80c7140 con 0x7f97e80cbaa0 2023-11-28T12:09:41.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.273+0000 7f97cf7fe700 1 -- 172.21.15.45:0/2226225480 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f97e0010db0 con 0x7f97e80cbaa0 2023-11-28T12:09:41.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.274+0000 7f97cf7fe700 1 --2- 172.21.15.45:0/2226225480 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f97d40682f0 0x7f97d406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:41.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.274+0000 7f97cf7fe700 1 -- 172.21.15.45:0/2226225480 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f97e0085f40 con 0x7f97e80cbaa0 2023-11-28T12:09:41.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.275+0000 7f97e6ffd700 1 --2- 172.21.15.45:0/2226225480 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f97d40682f0 0x7f97d406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:41.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.275+0000 7f97e6ffd700 1 --2- 172.21.15.45:0/2226225480 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f97d40682f0 0x7f97d406a7a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f97d80090b0 tx=0x7f97d8008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:41.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.278+0000 7f97cf7fe700 1 -- 172.21.15.45:0/2226225480 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f97e80c7140 con 0x7f97e80cbaa0 2023-11-28T12:09:41.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.523+0000 7f97ed3ff700 1 -- 172.21.15.45:0/2226225480 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f97e8068690 con 0x7f97e80cbaa0 2023-11-28T12:09:41.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.524+0000 7f97cf7fe700 1 -- 172.21.15.45:0/2226225480 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4649 (secure 0 0 0) 0x7f97e00526b0 con 0x7f97e80cbaa0 2023-11-28T12:09:41.524 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:09:41.524 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5423,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6836/735970231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":735970231},{"type":"v1","addr":"172.21.15.152:6836","nonce":735970231}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5797,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/3354918087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6835","nonce":3354918087},{"type":"v1","addr":"172.21.15.152:6837","nonce":3354918087}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5806,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/275804060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":275804060},{"type":"v1","addr":"172.21.15.45:6835","nonce":275804060}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T12:09:35.571815+0000","modified":"2023-11-28T12:09:38.581286+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5979},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5979":{"gid":5979,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6833/3784258337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":3784258337},{"type":"v1","addr":"172.21.15.45:6833","nonce":3784258337}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-28T12:09:41.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.526+0000 7f97ed3ff700 1 -- 172.21.15.45:0/2226225480 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f97d40682f0 msgr2=0x7f97d406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:41.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.526+0000 7f97ed3ff700 1 --2- 172.21.15.45:0/2226225480 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f97d40682f0 0x7f97d406a7a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f97d80090b0 tx=0x7f97d8008030 comp rx=0 tx=0).stop 2023-11-28T12:09:41.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.526+0000 7f97ed3ff700 1 -- 172.21.15.45:0/2226225480 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97e80cbaa0 msgr2=0x7f97e80cbf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:41.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.526+0000 7f97ed3ff700 1 --2- 172.21.15.45:0/2226225480 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97e80cbaa0 0x7f97e80cbf40 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f97e80b5be0 tx=0x7f97e00104a0 comp rx=0 tx=0).stop 2023-11-28T12:09:41.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.526+0000 7f97ed3ff700 1 -- 172.21.15.45:0/2226225480 shutdown_connections 2023-11-28T12:09:41.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.526+0000 7f97ed3ff700 1 --2- 172.21.15.45:0/2226225480 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f97d40682f0 0x7f97d406a7a0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:41.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.526+0000 7f97ed3ff700 1 --2- 172.21.15.45:0/2226225480 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f97d0003a00 0x7f97e80b6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:41.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.526+0000 7f97ed3ff700 1 --2- 172.21.15.45:0/2226225480 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97e80cbaa0 0x7f97e80cbf40 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:41.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.526+0000 7f97ed3ff700 1 --2- 172.21.15.45:0/2226225480 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f97e80b5e80 0x7f97e80cb560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:41.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.526+0000 7f97ed3ff700 1 -- 172.21.15.45:0/2226225480 >> 172.21.15.45:0/2226225480 conn(0x7f97e809c3f0 msgr2=0x7f97e815c350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:41.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.526+0000 7f97ed3ff700 1 -- 172.21.15.45:0/2226225480 shutdown_connections 2023-11-28T12:09:41.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:41.526+0000 7f97ed3ff700 1 -- 172.21.15.45:0/2226225480 wait complete. 2023-11-28T12:09:41.528 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 32 2023-11-28T12:09:41.948 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 32, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-28T12:09:35.571815+0000', 'modified': '2023-11-28T12:09:38.581286+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5979}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5979': {'gid': 5979, 'name': 'c', 'rank': 0, 'incarnation': 28, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.45:6833/3784258337', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.45:6832', 'nonce': 3784258337}, {'type': 'v1', 'addr': '172.21.15.45:6833', 'nonce': 3784258337}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-28T12:09:41.948 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-28T12:09:41.948 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-28T12:09:42.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.156+0000 7f52385ff700 1 Processor -- start 2023-11-28T12:09:42.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.156+0000 7f52385ff700 1 -- start start 2023-11-28T12:09:42.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.158+0000 7f52385ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5230161340 0x7f52300d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:42.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.158+0000 7f52385ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f52300d2320 0x7f52300cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:42.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.158+0000 7f52385ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52300d1950 con 0x7f523015c9b0 2023-11-28T12:09:42.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.158+0000 7f52385ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52300b5800 con 0x7f52300d2320 2023-11-28T12:09:42.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.158+0000 7f52385ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52300b5300 con 0x7f5230161340 2023-11-28T12:09:42.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.158+0000 7f5235b9a700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5230161340 0x7f52300d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:42.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.158+0000 7f5236b9c700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f52300d2320 0x7f52300cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:42.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.158+0000 7f5235b9a700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5230161340 0x7f52300d1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.45:53332/0 (socket says 172.21.15.45:53332) 2023-11-28T12:09:42.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.158+0000 7f523639b700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f523015c9b0 0x7f52300b4bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.45:35740/0 (socket says 172.21.15.45:35740) 2023-11-28T12:09:42.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.158+0000 7f5236b9c700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f52300d2320 0x7f52300cd7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.45:43476/0 (socket says 172.21.15.45:43476) 2023-11-28T12:09:42.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.158+0000 7f523639b700 1 -- 172.21.15.45:0/2117540792 learned_addr learned my addr 172.21.15.45:0/2117540792 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:09:42.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.159+0000 7f5235399700 1 -- 172.21.15.45:0/2117540792 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1517555359 0 0) 0x7f52300d1950 con 0x7f523015c9b0 2023-11-28T12:09:42.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.159+0000 7f5235399700 1 -- 172.21.15.45:0/2117540792 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f521c0035b0 con 0x7f523015c9b0 2023-11-28T12:09:42.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.159+0000 7f5235b9a700 1 -- 172.21.15.45:0/2117540792 >> v2:172.21.15.152:3300/0 conn(0x7f52300d2320 msgr2=0x7f52300cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:42.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.159+0000 7f5235b9a700 1 --2- 172.21.15.45:0/2117540792 >> v2:172.21.15.152:3300/0 conn(0x7f52300d2320 0x7f52300cd7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:42.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.159+0000 7f5235b9a700 1 -- 172.21.15.45:0/2117540792 >> v1:172.21.15.152:6789/0 conn(0x7f523015c9b0 legacy=0x7f52300b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:42.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.159+0000 7f5235b9a700 1 -- 172.21.15.45:0/2117540792 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52300b5520 con 0x7f5230161340 2023-11-28T12:09:42.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.159+0000 7f5236b9c700 1 --2- 172.21.15.45:0/2117540792 >> v2:172.21.15.152:3300/0 conn(0x7f52300d2320 0x7f52300cd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:09:42.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.159+0000 7f5235b9a700 1 --2- 172.21.15.45:0/2117540792 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5230161340 0x7f52300d1de0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5220009840 tx=0x7f5220009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a55711bfd942d6a4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:42.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.159+0000 7f5235399700 1 -- 172.21.15.45:0/2117540792 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5220011830 con 0x7f5230161340 2023-11-28T12:09:42.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.160+0000 7f5235399700 1 -- 172.21.15.45:0/2117540792 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5220011990 con 0x7f5230161340 2023-11-28T12:09:42.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.160+0000 7f5235399700 1 -- 172.21.15.45:0/2117540792 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5220011d20 con 0x7f5230161340 2023-11-28T12:09:42.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.160+0000 7f52385ff700 1 -- 172.21.15.45:0/2117540792 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5230161340 msgr2=0x7f52300d1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:42.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.160+0000 7f52385ff700 1 --2- 172.21.15.45:0/2117540792 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5230161340 0x7f52300d1de0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5220009840 tx=0x7f5220009b50 comp rx=0 tx=0).stop 2023-11-28T12:09:42.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.160+0000 7f52385ff700 1 -- 172.21.15.45:0/2117540792 shutdown_connections 2023-11-28T12:09:42.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.160+0000 7f52385ff700 1 --2- 172.21.15.45:0/2117540792 >> v2:172.21.15.152:3300/0 conn(0x7f52300d2320 0x7f52300cd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:42.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.160+0000 7f52385ff700 1 --2- 172.21.15.45:0/2117540792 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5230161340 0x7f52300d1de0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:42.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.160+0000 7f52385ff700 1 -- 172.21.15.45:0/2117540792 >> 172.21.15.45:0/2117540792 conn(0x7f5230072600 msgr2=0x7f52300cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:42.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.160+0000 7f52385ff700 1 -- 172.21.15.45:0/2117540792 shutdown_connections 2023-11-28T12:09:42.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.160+0000 7f52385ff700 1 -- 172.21.15.45:0/2117540792 wait complete. 2023-11-28T12:09:42.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.162+0000 7f52385ff700 1 Processor -- start 2023-11-28T12:09:42.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.162+0000 7f52385ff700 1 -- start start 2023-11-28T12:09:42.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.163+0000 7f52385ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f52300d2320 0x7f52300c5da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:42.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.163+0000 7f52385ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f523015c9b0 0x7f52300b7c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:42.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.163+0000 7f52385ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5230161340 0x7f52300b8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:42.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.163+0000 7f52385ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5230155c30 con 0x7f5230161340 2023-11-28T12:09:42.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.163+0000 7f52385ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5230155f10 con 0x7f523015c9b0 2023-11-28T12:09:42.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.163+0000 7f52385ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5230152b50 con 0x7f52300d2320 2023-11-28T12:09:42.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.163+0000 7f5235b9a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f523015c9b0 0x7f52300b7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:42.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.163+0000 7f5236b9c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5230161340 0x7f52300b8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:42.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.163+0000 7f5235b9a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f523015c9b0 0x7f52300b7c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.45:43486/0 (socket says 172.21.15.45:43486) 2023-11-28T12:09:42.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.163+0000 7f5235b9a700 1 -- 172.21.15.45:0/3912310045 learned_addr learned my addr 172.21.15.45:0/3912310045 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:09:42.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.163+0000 7f523639b700 1 --2- 172.21.15.45:0/3912310045 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f52300d2320 0x7f52300c5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:42.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.164+0000 7f5235b9a700 1 -- 172.21.15.45:0/3912310045 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f52300d2320 msgr2=0x7f52300c5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:42.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.164+0000 7f5235b9a700 1 --2- 172.21.15.45:0/3912310045 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f52300d2320 0x7f52300c5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:42.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.164+0000 7f5235b9a700 1 -- 172.21.15.45:0/3912310045 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5230161340 msgr2=0x7f52300b8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:42.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.164+0000 7f5235b9a700 1 --2- 172.21.15.45:0/3912310045 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5230161340 0x7f52300b8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:42.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.164+0000 7f5235b9a700 1 -- 172.21.15.45:0/3912310045 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5228009a70 con 0x7f523015c9b0 2023-11-28T12:09:42.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.164+0000 7f5236b9c700 1 --2- 172.21.15.45:0/3912310045 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5230161340 0x7f52300b8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:09:42.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.164+0000 7f5235b9a700 1 --2- 172.21.15.45:0/3912310045 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f523015c9b0 0x7f52300b7c50 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5220009fd0 tx=0x7f5220004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:42.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.165+0000 7f5226ffd700 1 -- 172.21.15.45:0/3912310045 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5220004550 con 0x7f523015c9b0 2023-11-28T12:09:42.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.165+0000 7f5226ffd700 1 -- 172.21.15.45:0/3912310045 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f522001f070 con 0x7f523015c9b0 2023-11-28T12:09:42.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.165+0000 7f5226ffd700 1 -- 172.21.15.45:0/3912310045 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52200038c0 con 0x7f523015c9b0 2023-11-28T12:09:42.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.165+0000 7f52385ff700 1 -- 172.21.15.45:0/3912310045 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52200094a0 con 0x7f523015c9b0 2023-11-28T12:09:42.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.165+0000 7f52385ff700 1 -- 172.21.15.45:0/3912310045 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52300d15e0 con 0x7f523015c9b0 2023-11-28T12:09:42.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.168+0000 7f5226ffd700 1 -- 172.21.15.45:0/3912310045 <== mon.1 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f522000f050 con 0x7f523015c9b0 2023-11-28T12:09:42.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.169+0000 7f5226ffd700 1 --2- 172.21.15.45:0/3912310045 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f52140682f0 0x7f521406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:42.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.169+0000 7f5226ffd700 1 -- 172.21.15.45:0/3912310045 <== mon.1 v2:172.21.15.152:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5220021070 con 0x7f523015c9b0 2023-11-28T12:09:42.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.169+0000 7f523639b700 1 --2- 172.21.15.45:0/3912310045 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f52140682f0 0x7f521406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:42.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.170+0000 7f523639b700 1 --2- 172.21.15.45:0/3912310045 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f52140682f0 0x7f521406a7a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f522c007fd0 tx=0x7f522c007dc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:42.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.171+0000 7f524be7eb80 1 Processor -- start 2023-11-28T12:09:42.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.171+0000 7f524be7eb80 1 -- start start 2023-11-28T12:09:42.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.172+0000 7f524be7eb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563f4dccbf50 0x563f4dc859f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:42.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.172+0000 7f524be7eb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f4dcc2ac0 0x563f4dccc320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:42.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.172+0000 7f524be7eb80 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x563f4dcae660 0x563f4dc86b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:42.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.172+0000 7f524be7eb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f4dc03de0 con 0x563f4dccbf50 2023-11-28T12:09:42.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.172+0000 7f524be7eb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f4db70140 con 0x563f4dcc2ac0 2023-11-28T12:09:42.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.172+0000 7f524be7eb80 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x563f4dbdedb0 con 0x563f4dcae660 2023-11-28T12:09:42.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.172+0000 7f523639b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563f4dccbf50 0x563f4dc859f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:42.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.172+0000 7f523639b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563f4dccbf50 0x563f4dc859f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51490/0 (socket says 172.21.15.45:51490) 2023-11-28T12:09:42.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.172+0000 7f523639b700 1 -- 172.21.15.45:0/3351417102 learned_addr learned my addr 172.21.15.45:0/3351417102 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:09:42.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.172+0000 7f5235b9a700 1 --2- 172.21.15.45:0/3351417102 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f4dcc2ac0 0x563f4dccc320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:42.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.172+0000 7f5236b9c700 1 --2- 172.21.15.45:0/3351417102 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x563f4dcae660 0x563f4dc86b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:42.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.172+0000 7f523639b700 1 -- 172.21.15.45:0/3351417102 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x563f4dcae660 msgr2=0x563f4dc86b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:42.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.172+0000 7f523639b700 1 --2- 172.21.15.45:0/3351417102 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x563f4dcae660 0x563f4dc86b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:42.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.172+0000 7f523639b700 1 -- 172.21.15.45:0/3351417102 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f4dcc2ac0 msgr2=0x563f4dccc320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:42.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.172+0000 7f523639b700 1 --2- 172.21.15.45:0/3351417102 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f4dcc2ac0 0x563f4dccc320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:42.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.172+0000 7f523639b700 1 -- 172.21.15.45:0/3351417102 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563f4d9cc790 con 0x563f4dccbf50 2023-11-28T12:09:42.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.173+0000 7f523639b700 1 --2- 172.21.15.45:0/3351417102 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563f4dccbf50 0x563f4dc859f0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f522c001590 tx=0x7f522c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d323993e3fc22da server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:42.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.173+0000 7f5213fff700 1 -- 172.21.15.45:0/3351417102 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522c001c60 con 0x563f4dccbf50 2023-11-28T12:09:42.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.173+0000 7f5213fff700 1 -- 172.21.15.45:0/3351417102 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f522c0058e0 con 0x563f4dccbf50 2023-11-28T12:09:42.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.173+0000 7f5213fff700 1 -- 172.21.15.45:0/3351417102 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522c005c50 con 0x563f4dccbf50 2023-11-28T12:09:42.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.173+0000 7f524be7eb80 1 -- 172.21.15.45:0/3351417102 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563f4dccbf50 msgr2=0x563f4dc859f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:42.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.173+0000 7f524be7eb80 1 --2- 172.21.15.45:0/3351417102 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563f4dccbf50 0x563f4dc859f0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f522c001590 tx=0x7f522c012000 comp rx=0 tx=0).stop 2023-11-28T12:09:42.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.174+0000 7f524be7eb80 1 -- 172.21.15.45:0/3351417102 shutdown_connections 2023-11-28T12:09:42.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.174+0000 7f524be7eb80 1 --2- 172.21.15.45:0/3351417102 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x563f4dcae660 0x563f4dc86b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:42.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.174+0000 7f524be7eb80 1 --2- 172.21.15.45:0/3351417102 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563f4dccbf50 0x563f4dc859f0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:42.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.174+0000 7f524be7eb80 1 --2- 172.21.15.45:0/3351417102 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f4dcc2ac0 0x563f4dccc320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:42.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.174+0000 7f524be7eb80 1 -- 172.21.15.45:0/3351417102 >> 172.21.15.45:0/3351417102 conn(0x563f4dc7bd20 msgr2=0x563f4dc84f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:42.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.174+0000 7f524be7eb80 1 -- 172.21.15.45:0/3351417102 shutdown_connections 2023-11-28T12:09:42.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.174+0000 7f524be7eb80 1 -- 172.21.15.45:0/3351417102 wait complete. 2023-11-28T12:09:42.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.174+0000 7f524be7eb80 1 -- start start 2023-11-28T12:09:42.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.175+0000 7f524be7eb80 1 Processor -- start 2023-11-28T12:09:42.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.176+0000 7f524be7eb80 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x563f4dcae660 0x563f4dcb3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:42.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.176+0000 7f524be7eb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f4dcc2ac0 0x563f4dcc51c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:42.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.176+0000 7f524be7eb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563f4dccbf50 0x563f4dcc5700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:42.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.176+0000 7f524be7eb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f4dbd8120 con 0x563f4dccbf50 2023-11-28T12:09:42.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.176+0000 7f524be7eb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f4d9cd390 con 0x563f4dcc2ac0 2023-11-28T12:09:42.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.176+0000 7f524be7eb80 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x563f4db70340 con 0x563f4dcae660 2023-11-28T12:09:42.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.176+0000 7f524be7eb80 10 client.0 _ll_register_callbacks cb 0x563f4db76400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T12:09:42.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.176+0000 7f5236b9c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563f4dccbf50 0x563f4dcc5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:42.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.176+0000 7f5236b9c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563f4dccbf50 0x563f4dcc5700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51494/0 (socket says 172.21.15.45:51494) 2023-11-28T12:09:42.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.176+0000 7f5236b9c700 1 -- 172.21.15.45:0/261589201 learned_addr learned my addr 172.21.15.45:0/261589201 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:09:42.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.176+0000 7f523639b700 1 --2- 172.21.15.45:0/261589201 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x563f4dcae660 0x563f4dcb3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:42.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.176+0000 7f5235b9a700 1 --2- 172.21.15.45:0/261589201 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f4dcc2ac0 0x563f4dcc51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:42.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.176+0000 7f5236b9c700 1 -- 172.21.15.45:0/261589201 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x563f4dcae660 msgr2=0x563f4dcb3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:42.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.176+0000 7f5236b9c700 1 --2- 172.21.15.45:0/261589201 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x563f4dcae660 0x563f4dcb3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:42.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.176+0000 7f5236b9c700 1 -- 172.21.15.45:0/261589201 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f4dcc2ac0 msgr2=0x563f4dcc51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:42.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.176+0000 7f5236b9c700 1 --2- 172.21.15.45:0/261589201 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f4dcc2ac0 0x563f4dcc51c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:42.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.176+0000 7f5236b9c700 1 -- 172.21.15.45:0/261589201 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f521c0035b0 con 0x563f4dccbf50 2023-11-28T12:09:42.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.177+0000 7f5236b9c700 1 --2- 172.21.15.45:0/261589201 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563f4dccbf50 0x563f4dcc5700 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f5228004690 tx=0x7f522800e4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ad11e4e82f6b46a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:42.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.177+0000 7f52117fa700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-11-28T12:09:42.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.177+0000 7f52117fa700 1 -- 172.21.15.45:0/261589201 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522801e400 con 0x563f4dccbf50 2023-11-28T12:09:42.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.177+0000 7f52117fa700 1 -- 172.21.15.45:0/261589201 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(61..61 src has 1..61) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f522801fd70 con 0x563f4dccbf50 2023-11-28T12:09:42.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.177+0000 7f524be7eb80 1 -- 172.21.15.45:0/261589201 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563f4dbdc030 con 0x563f4dccbf50 2023-11-28T12:09:42.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.177+0000 7f52117fa700 1 -- 172.21.15.45:0/261589201 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5228016400 con 0x563f4dccbf50 2023-11-28T12:09:42.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.177+0000 7f524be7eb80 10 client.6120 fetch_fsmap learned FSMap version 32 2023-11-28T12:09:42.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.177+0000 7f524be7eb80 1 -- 172.21.15.45:0/261589201 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x563f4dab90a0 con 0x563f4dccbf50 2023-11-28T12:09:42.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.177+0000 7f52117fa700 1 -- 172.21.15.45:0/261589201 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563f4dbdc030 con 0x563f4dccbf50 2023-11-28T12:09:42.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.178+0000 7f52117fa700 1 -- 172.21.15.45:0/261589201 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 32) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f522801c070 con 0x563f4dccbf50 2023-11-28T12:09:42.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.178+0000 7f524be7eb80 10 client.6120 fetch_fsmap finished waiting for FSMap version 32 2023-11-28T12:09:42.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.178+0000 7f524be7eb80 10 client.6120 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-28T12:09:42.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.178+0000 7f524be7eb80 20 client.6120 populate_metadata read hostname 'smithi045' 2023-11-28T12:09:42.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.178+0000 7f524be7eb80 1 --2- 172.21.15.45:0/261589201 >> [v2:172.21.15.45:6832/3784258337,v1:172.21.15.45:6833/3784258337] conn(0x563f4dcb4170 0x563f4dce88d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:42.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.178+0000 7f524be7eb80 4 client.6120 mds_command: new command op to 5979 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-28T12:09:42.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.178+0000 7f524be7eb80 1 -- 172.21.15.45:0/261589201 --> [v2:172.21.15.45:6832/3784258337,v1:172.21.15.45:6833/3784258337] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563f4da27ef0 con 0x563f4dcb4170 2023-11-28T12:09:42.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.178+0000 7f523639b700 1 --2- 172.21.15.45:0/261589201 >> [v2:172.21.15.45:6832/3784258337,v1:172.21.15.45:6833/3784258337] conn(0x563f4dcb4170 0x563f4dce88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:42.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.179+0000 7f52117fa700 10 client.6120 ms_handle_connect on v2:172.21.15.45:6832/3784258337 2023-11-28T12:09:42.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.179+0000 7f523639b700 1 --2- 172.21.15.45:0/261589201 >> [v2:172.21.15.45:6832/3784258337,v1:172.21.15.45:6833/3784258337] conn(0x563f4dcb4170 0x563f4dce88d0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f1b3eab6ef241a2 server_cookie=37a4e86bf89b2f98 in_seq=0 out_seq=0 2023-11-28T12:09:42.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.179+0000 7f52117fa700 1 -- 172.21.15.45:0/261589201 <== mds.0 v2:172.21.15.45:6832/3784258337 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x563f4da27ef0 con 0x563f4dcb4170 2023-11-28T12:09:42.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.179+0000 7f52117fa700 10 client.6120 handle_command_reply: tid=0 2023-11-28T12:09:42.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.179+0000 7f524be7eb80 1 client.6120 shutdown 2023-11-28T12:09:42.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.180+0000 7f524be7eb80 1 -- 172.21.15.45:0/261589201 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563f4dccbf50 msgr2=0x563f4dcc5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:42.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.180+0000 7f524be7eb80 1 --2- 172.21.15.45:0/261589201 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563f4dccbf50 0x563f4dcc5700 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f5228004690 tx=0x7f522800e4f0 comp rx=0 tx=0).stop 2023-11-28T12:09:42.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.180+0000 7f524be7eb80 1 -- 172.21.15.45:0/261589201 shutdown_connections 2023-11-28T12:09:42.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.180+0000 7f524be7eb80 1 --2- 172.21.15.45:0/261589201 >> [v2:172.21.15.45:6832/3784258337,v1:172.21.15.45:6833/3784258337] conn(0x563f4dcb4170 0x563f4dce88d0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:42.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.180+0000 7f524be7eb80 1 --2- 172.21.15.45:0/261589201 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563f4dccbf50 0x563f4dcc5700 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:42.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.180+0000 7f524be7eb80 1 --2- 172.21.15.45:0/261589201 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x563f4dcae660 0x563f4dcb3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:42.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.180+0000 7f524be7eb80 1 --2- 172.21.15.45:0/261589201 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f4dcc2ac0 0x563f4dcc51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:42.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.180+0000 7f52117fa700 0 client.6120 ms_handle_reset on v2:172.21.15.45:6832/3784258337 2023-11-28T12:09:42.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.180+0000 7f524be7eb80 1 -- 172.21.15.45:0/261589201 >> 172.21.15.45:0/261589201 conn(0x563f4dc7bd20 msgr2=0x563f4dc80ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:42.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.180+0000 7f524be7eb80 1 -- 172.21.15.45:0/261589201 shutdown_connections 2023-11-28T12:09:42.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.180+0000 7f524be7eb80 1 -- 172.21.15.45:0/261589201 wait complete. 2023-11-28T12:09:42.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.180+0000 7f524be7eb80 20 client.6120 trim_cache size 0 max 16384 2023-11-28T12:09:42.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.198+0000 7f524be7eb80 1 Processor -- start 2023-11-28T12:09:42.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.198+0000 7f524be7eb80 1 -- start start 2023-11-28T12:09:42.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.199+0000 7f524be7eb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563f4dcae660 0x563f4dccff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:42.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.199+0000 7f524be7eb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f4dcc2ac0 0x563f4dc80d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:42.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.199+0000 7f524be7eb80 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x563f4dccbf50 0x563f4dcb3650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:42.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.199+0000 7f524be7eb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f4dcc3030 con 0x563f4dcae660 2023-11-28T12:09:42.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.199+0000 7f524be7eb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f4dcecef0 con 0x563f4dcc2ac0 2023-11-28T12:09:42.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.199+0000 7f524be7eb80 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x563f4dcda660 con 0x563f4dccbf50 2023-11-28T12:09:42.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.200+0000 7f523639b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563f4dcae660 0x563f4dccff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:42.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.200+0000 7f523639b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563f4dcae660 0x563f4dccff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51496/0 (socket says 172.21.15.45:51496) 2023-11-28T12:09:42.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.200+0000 7f523639b700 1 -- 172.21.15.45:0/4183927546 learned_addr learned my addr 172.21.15.45:0/4183927546 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:09:42.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.200+0000 7f5235b9a700 1 --2- 172.21.15.45:0/4183927546 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f4dcc2ac0 0x563f4dc80d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:42.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.200+0000 7f5236b9c700 1 --2- 172.21.15.45:0/4183927546 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x563f4dccbf50 0x563f4dcb3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:42.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.200+0000 7f523639b700 1 -- 172.21.15.45:0/4183927546 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x563f4dccbf50 msgr2=0x563f4dcb3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:42.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.200+0000 7f523639b700 1 --2- 172.21.15.45:0/4183927546 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x563f4dccbf50 0x563f4dcb3650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:42.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.200+0000 7f523639b700 1 -- 172.21.15.45:0/4183927546 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f4dcc2ac0 msgr2=0x563f4dc80d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:42.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.200+0000 7f523639b700 1 --2- 172.21.15.45:0/4183927546 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f4dcc2ac0 0x563f4dc80d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:42.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.200+0000 7f523639b700 1 -- 172.21.15.45:0/4183927546 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563f4db9f2e0 con 0x563f4dcae660 2023-11-28T12:09:42.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.200+0000 7f5235b9a700 1 --2- 172.21.15.45:0/4183927546 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f4dcc2ac0 0x563f4dc80d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:09:42.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.200+0000 7f5236b9c700 1 --2- 172.21.15.45:0/4183927546 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x563f4dccbf50 0x563f4dcb3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:09:42.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.200+0000 7f523639b700 1 --2- 172.21.15.45:0/4183927546 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563f4dcae660 0x563f4dccff90 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f522c024040 tx=0x7f522c01e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7f0e86ff299992 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:42.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.200+0000 7f5224bff700 1 -- 172.21.15.45:0/4183927546 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522c033070 con 0x563f4dcae660 2023-11-28T12:09:42.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.200+0000 7f5224bff700 1 -- 172.21.15.45:0/4183927546 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f522c0331d0 con 0x563f4dcae660 2023-11-28T12:09:42.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.200+0000 7f5224bff700 1 -- 172.21.15.45:0/4183927546 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522c005a50 con 0x563f4dcae660 2023-11-28T12:09:42.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.201+0000 7f524be7eb80 1 -- 172.21.15.45:0/4183927546 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563f4dcae660 msgr2=0x563f4dccff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:42.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.201+0000 7f524be7eb80 1 --2- 172.21.15.45:0/4183927546 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563f4dcae660 0x563f4dccff90 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f522c024040 tx=0x7f522c01e000 comp rx=0 tx=0).stop 2023-11-28T12:09:42.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.201+0000 7f524be7eb80 1 -- 172.21.15.45:0/4183927546 shutdown_connections 2023-11-28T12:09:42.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.201+0000 7f524be7eb80 1 --2- 172.21.15.45:0/4183927546 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x563f4dccbf50 0x563f4dcb3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:42.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.201+0000 7f524be7eb80 1 --2- 172.21.15.45:0/4183927546 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563f4dcae660 0x563f4dccff90 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:42.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.201+0000 7f524be7eb80 1 --2- 172.21.15.45:0/4183927546 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f4dcc2ac0 0x563f4dc80d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:42.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.201+0000 7f524be7eb80 1 -- 172.21.15.45:0/4183927546 >> 172.21.15.45:0/4183927546 conn(0x563f4dc7bd20 msgr2=0x563f4dc81810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:42.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.201+0000 7f524be7eb80 1 -- 172.21.15.45:0/4183927546 shutdown_connections 2023-11-28T12:09:42.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.201+0000 7f524be7eb80 1 -- 172.21.15.45:0/4183927546 wait complete. 2023-11-28T12:09:42.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.202+0000 7f524be7eb80 1 -- start start 2023-11-28T12:09:42.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.202+0000 7f524be7eb80 1 Processor -- start 2023-11-28T12:09:42.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.203+0000 7f524be7eb80 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x563f4dcae660 0x563f4dd2aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:42.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.203+0000 7f524be7eb80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563f4dcc2ac0 0x563f4dcc51a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:42.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.203+0000 7f524be7eb80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f4dccbf50 0x563f4dcb3030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:42.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.203+0000 7f524be7eb80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f4dcb3ab0 con 0x563f4dcc2ac0 2023-11-28T12:09:42.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.203+0000 7f524be7eb80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f4dd30fc0 con 0x563f4dccbf50 2023-11-28T12:09:42.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.203+0000 7f524be7eb80 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x563f4dcc56e0 con 0x563f4dcae660 2023-11-28T12:09:42.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.203+0000 7f524be7eb80 10 client.0 _ll_register_callbacks cb 0x563f4db76400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T12:09:42.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.203+0000 7f5235b9a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563f4dcc2ac0 0x563f4dcc51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:42.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.203+0000 7f5235b9a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563f4dcc2ac0 0x563f4dcc51a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51512/0 (socket says 172.21.15.45:51512) 2023-11-28T12:09:42.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.203+0000 7f5235b9a700 1 -- 172.21.15.45:0/888163635 learned_addr learned my addr 172.21.15.45:0/888163635 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:09:42.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.203+0000 7f5236b9c700 1 --2- 172.21.15.45:0/888163635 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f4dccbf50 0x563f4dcb3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:42.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.203+0000 7f523639b700 1 --2- 172.21.15.45:0/888163635 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x563f4dcae660 0x563f4dd2aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:42.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.204+0000 7f5235b9a700 1 -- 172.21.15.45:0/888163635 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x563f4dcae660 msgr2=0x563f4dd2aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:42.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.204+0000 7f5235b9a700 1 --2- 172.21.15.45:0/888163635 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x563f4dcae660 0x563f4dd2aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:42.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.204+0000 7f5235b9a700 1 -- 172.21.15.45:0/888163635 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f4dccbf50 msgr2=0x563f4dcb3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:42.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.204+0000 7f5235b9a700 1 --2- 172.21.15.45:0/888163635 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f4dccbf50 0x563f4dcb3030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:42.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.204+0000 7f5235b9a700 1 -- 172.21.15.45:0/888163635 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563f4d9cc790 con 0x563f4dcc2ac0 2023-11-28T12:09:42.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.204+0000 7f5235b9a700 1 --2- 172.21.15.45:0/888163635 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563f4dcc2ac0 0x563f4dcc51a0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f522005f4a0 tx=0x7f5220053d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65a61757dff6364d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:42.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.204+0000 7f52117fa700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-11-28T12:09:42.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.204+0000 7f52117fa700 1 -- 172.21.15.45:0/888163635 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522005f540 con 0x563f4dcc2ac0 2023-11-28T12:09:42.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.204+0000 7f524be7eb80 1 -- 172.21.15.45:0/888163635 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f522c0058e0 con 0x563f4dcc2ac0 2023-11-28T12:09:42.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.204+0000 7f52117fa700 1 -- 172.21.15.45:0/888163635 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(61..61 src has 1..61) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f522007fe40 con 0x563f4dcc2ac0 2023-11-28T12:09:42.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.204+0000 7f52117fa700 1 -- 172.21.15.45:0/888163635 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f522005f6a0 con 0x563f4dcc2ac0 2023-11-28T12:09:42.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.204+0000 7f524be7eb80 10 client.6126 fetch_fsmap learned FSMap version 32 2023-11-28T12:09:42.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.204+0000 7f524be7eb80 1 -- 172.21.15.45:0/888163635 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x563f4da2d1d0 con 0x563f4dcc2ac0 2023-11-28T12:09:42.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.204+0000 7f52117fa700 1 -- 172.21.15.45:0/888163635 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f522c0058e0 con 0x563f4dcc2ac0 2023-11-28T12:09:42.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.205+0000 7f52117fa700 1 -- 172.21.15.45:0/888163635 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 32) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f52200870b0 con 0x563f4dcc2ac0 2023-11-28T12:09:42.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.205+0000 7f524be7eb80 10 client.6126 fetch_fsmap finished waiting for FSMap version 32 2023-11-28T12:09:42.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.205+0000 7f524be7eb80 10 client.6126 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-28T12:09:42.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.205+0000 7f524be7eb80 20 client.6126 populate_metadata read hostname 'smithi045' 2023-11-28T12:09:42.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.205+0000 7f524be7eb80 1 --2- 172.21.15.45:0/888163635 >> [v2:172.21.15.45:6832/3784258337,v1:172.21.15.45:6833/3784258337] conn(0x563f4dcc8260 0x563f4dcc8630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:42.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.205+0000 7f524be7eb80 4 client.6126 mds_command: new command op to 5979 tid=0[{"prefix": "status"}] 2023-11-28T12:09:42.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.205+0000 7f524be7eb80 1 -- 172.21.15.45:0/888163635 --> [v2:172.21.15.45:6832/3784258337,v1:172.21.15.45:6833/3784258337] -- command(tid 0: {"prefix": "status"}) v1 -- 0x563f4da5d040 con 0x563f4dcc8260 2023-11-28T12:09:42.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.205+0000 7f523639b700 1 --2- 172.21.15.45:0/888163635 >> [v2:172.21.15.45:6832/3784258337,v1:172.21.15.45:6833/3784258337] conn(0x563f4dcc8260 0x563f4dcc8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:42.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.205+0000 7f523639b700 1 --2- 172.21.15.45:0/888163635 >> [v2:172.21.15.45:6832/3784258337,v1:172.21.15.45:6833/3784258337] conn(0x563f4dcc8260 0x563f4dcc8630 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc10fca28e32fc92 server_cookie=a6e8c79a5d7038e9 in_seq=0 out_seq=0 2023-11-28T12:09:42.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.205+0000 7f52117fa700 10 client.6126 ms_handle_connect on v2:172.21.15.45:6832/3784258337 2023-11-28T12:09:42.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.206+0000 7f52117fa700 1 -- 172.21.15.45:0/888163635 <== mds.0 v2:172.21.15.45:6832/3784258337 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x563f4da5d040 con 0x563f4dcc8260 2023-11-28T12:09:42.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.206+0000 7f52117fa700 10 client.6126 handle_command_reply: tid=0 2023-11-28T12:09:42.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.206+0000 7f524be7eb80 1 client.6126 shutdown 2023-11-28T12:09:42.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.206+0000 7f524be7eb80 1 -- 172.21.15.45:0/888163635 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563f4dcc2ac0 msgr2=0x563f4dcc51a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:42.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.206+0000 7f524be7eb80 1 --2- 172.21.15.45:0/888163635 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563f4dcc2ac0 0x563f4dcc51a0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f522005f4a0 tx=0x7f5220053d00 comp rx=0 tx=0).stop 2023-11-28T12:09:42.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.206+0000 7f524be7eb80 1 -- 172.21.15.45:0/888163635 shutdown_connections 2023-11-28T12:09:42.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.206+0000 7f524be7eb80 1 --2- 172.21.15.45:0/888163635 >> [v2:172.21.15.45:6832/3784258337,v1:172.21.15.45:6833/3784258337] conn(0x563f4dcc8260 0x563f4dcc8630 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:42.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.206+0000 7f524be7eb80 1 --2- 172.21.15.45:0/888163635 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x563f4dccbf50 0x563f4dcb3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:42.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.206+0000 7f524be7eb80 1 --2- 172.21.15.45:0/888163635 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x563f4dcae660 0x563f4dd2aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:42.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.206+0000 7f52117fa700 0 client.6126 ms_handle_reset on v2:172.21.15.45:6832/3784258337 2023-11-28T12:09:42.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.206+0000 7f524be7eb80 1 --2- 172.21.15.45:0/888163635 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563f4dcc2ac0 0x563f4dcc51a0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:42.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.206+0000 7f524be7eb80 1 -- 172.21.15.45:0/888163635 >> 172.21.15.45:0/888163635 conn(0x563f4dc7bd20 msgr2=0x563f4dcb0780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:42.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.206+0000 7f524be7eb80 1 -- 172.21.15.45:0/888163635 shutdown_connections 2023-11-28T12:09:42.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.206+0000 7f524be7eb80 1 -- 172.21.15.45:0/888163635 wait complete. 2023-11-28T12:09:42.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.206+0000 7f524be7eb80 20 client.6126 trim_cache size 0 max 16384 2023-11-28T12:09:42.213 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-11-28T12:09:42.213 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_fsid": "bd7c37f1-f7c6-4778-b845-52cf2aa6e366", 2023-11-28T12:09:42.213 INFO:teuthology.orchestra.run.smithi045.stdout: "whoami": 0, 2023-11-28T12:09:42.214 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 5979, 2023-11-28T12:09:42.214 INFO:teuthology.orchestra.run.smithi045.stdout: "want_state": "up:active", 2023-11-28T12:09:42.214 INFO:teuthology.orchestra.run.smithi045.stdout: "state": "up:active", 2023-11-28T12:09:42.214 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs", 2023-11-28T12:09:42.214 INFO:teuthology.orchestra.run.smithi045.stdout: "rank_uptime": 6.632092793, 2023-11-28T12:09:42.214 INFO:teuthology.orchestra.run.smithi045.stdout: "mdsmap_epoch": 32, 2023-11-28T12:09:42.214 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch": 61, 2023-11-28T12:09:42.214 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch_barrier": 61, 2023-11-28T12:09:42.214 INFO:teuthology.orchestra.run.smithi045.stdout: "uptime": 12.603790529999999 2023-11-28T12:09:42.214 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-11-28T12:09:42.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.207+0000 7f52385ff700 1 -- 172.21.15.45:0/3912310045 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f52140682f0 msgr2=0x7f521406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:42.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.207+0000 7f52385ff700 1 --2- 172.21.15.45:0/3912310045 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f52140682f0 0x7f521406a7a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f522c007fd0 tx=0x7f522c007dc0 comp rx=0 tx=0).stop 2023-11-28T12:09:42.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.207+0000 7f52385ff700 1 -- 172.21.15.45:0/3912310045 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f523015c9b0 msgr2=0x7f52300b7c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:42.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.207+0000 7f52385ff700 1 --2- 172.21.15.45:0/3912310045 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f523015c9b0 0x7f52300b7c50 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5220009fd0 tx=0x7f5220004750 comp rx=0 tx=0).stop 2023-11-28T12:09:42.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.207+0000 7f52385ff700 1 -- 172.21.15.45:0/3912310045 shutdown_connections 2023-11-28T12:09:42.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.207+0000 7f52385ff700 1 --2- 172.21.15.45:0/3912310045 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f52140682f0 0x7f521406a7a0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:42.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.207+0000 7f52385ff700 1 --2- 172.21.15.45:0/3912310045 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5230161340 0x7f52300b8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:42.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.207+0000 7f52385ff700 1 --2- 172.21.15.45:0/3912310045 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f52300d2320 0x7f52300c5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:42.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.207+0000 7f52385ff700 1 --2- 172.21.15.45:0/3912310045 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f523015c9b0 0x7f52300b7c50 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:42.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.207+0000 7f52385ff700 1 -- 172.21.15.45:0/3912310045 >> 172.21.15.45:0/3912310045 conn(0x7f5230072600 msgr2=0x7f52300b6080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:42.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.207+0000 7f52385ff700 1 -- 172.21.15.45:0/3912310045 shutdown_connections 2023-11-28T12:09:42.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.207+0000 7f52385ff700 1 -- 172.21.15.45:0/3912310045 wait complete. 2023-11-28T12:09:42.225 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T12:09:42.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.427+0000 7f5ca15ff700 1 Processor -- start 2023-11-28T12:09:42.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.427+0000 7f5ca15ff700 1 -- start start 2023-11-28T12:09:42.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.428+0000 7f5ca15ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f5c9c161340 0x7f5c9c0d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:42.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.429+0000 7f5ca15ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5c9c0d2320 0x7f5c9c0cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:42.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.429+0000 7f5ca15ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c9c0d1950 con 0x7f5c9c15c9b0 2023-11-28T12:09:42.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.429+0000 7f5ca15ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c9c0b5800 con 0x7f5c9c161340 2023-11-28T12:09:42.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.429+0000 7f5ca15ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c9c0b5300 con 0x7f5c9c0d2320 2023-11-28T12:09:42.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.429+0000 7f5c9a7fc700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f5c9c161340 0x7f5c9c0d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:42.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.429+0000 7f5c9b7fe700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5c9c0d2320 0x7f5c9c0cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:42.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.429+0000 7f5c9b7fe700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5c9c0d2320 0x7f5c9c0cd7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.45:53404/0 (socket says 172.21.15.45:53404) 2023-11-28T12:09:42.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.429+0000 7f5c9a7fc700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f5c9c161340 0x7f5c9c0d1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.45:43534/0 (socket says 172.21.15.45:43534) 2023-11-28T12:09:42.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.429+0000 7f5c9b7fe700 1 -- 172.21.15.45:0/3278873474 learned_addr learned my addr 172.21.15.45:0/3278873474 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:09:42.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.430+0000 7f5c9a7fc700 1 -- 172.21.15.45:0/3278873474 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5c9c0d2320 msgr2=0x7f5c9c0cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:42.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.430+0000 7f5c9a7fc700 1 --2- 172.21.15.45:0/3278873474 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5c9c0d2320 0x7f5c9c0cd7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:42.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.430+0000 7f5c9a7fc700 1 -- 172.21.15.45:0/3278873474 >> v1:172.21.15.152:6789/0 conn(0x7f5c9c15c9b0 legacy=0x7f5c9c0b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:42.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.430+0000 7f5c9a7fc700 1 -- 172.21.15.45:0/3278873474 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c9c0b5520 con 0x7f5c9c161340 2023-11-28T12:09:42.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.430+0000 7f5c9b7fe700 1 --2- 172.21.15.45:0/3278873474 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5c9c0d2320 0x7f5c9c0cd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:09:42.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.430+0000 7f5c9a7fc700 1 --2- 172.21.15.45:0/3278873474 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c9c161340 0x7f5c9c0d1de0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f5c90009840 tx=0x7f5c90009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6642d86fc450ce5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:42.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.430+0000 7f5c99ffb700 1 -- 172.21.15.45:0/3278873474 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c90011830 con 0x7f5c9c161340 2023-11-28T12:09:42.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.430+0000 7f5c99ffb700 1 -- 172.21.15.45:0/3278873474 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c90011990 con 0x7f5c9c161340 2023-11-28T12:09:42.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.430+0000 7f5c99ffb700 1 -- 172.21.15.45:0/3278873474 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c90011d20 con 0x7f5c9c161340 2023-11-28T12:09:42.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.431+0000 7f5ca15ff700 1 -- 172.21.15.45:0/3278873474 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c9c161340 msgr2=0x7f5c9c0d1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:42.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.431+0000 7f5ca15ff700 1 --2- 172.21.15.45:0/3278873474 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c9c161340 0x7f5c9c0d1de0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f5c90009840 tx=0x7f5c90009b50 comp rx=0 tx=0).stop 2023-11-28T12:09:42.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.431+0000 7f5ca15ff700 1 -- 172.21.15.45:0/3278873474 shutdown_connections 2023-11-28T12:09:42.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.431+0000 7f5ca15ff700 1 --2- 172.21.15.45:0/3278873474 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5c9c0d2320 0x7f5c9c0cd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:42.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.431+0000 7f5ca15ff700 1 --2- 172.21.15.45:0/3278873474 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c9c161340 0x7f5c9c0d1de0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:42.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.431+0000 7f5ca15ff700 1 -- 172.21.15.45:0/3278873474 >> 172.21.15.45:0/3278873474 conn(0x7f5c9c072600 msgr2=0x7f5c9c0cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:42.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.431+0000 7f5ca15ff700 1 -- 172.21.15.45:0/3278873474 shutdown_connections 2023-11-28T12:09:42.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.431+0000 7f5ca15ff700 1 -- 172.21.15.45:0/3278873474 wait complete. 2023-11-28T12:09:42.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.433+0000 7f5ca15ff700 1 Processor -- start 2023-11-28T12:09:42.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.433+0000 7f5ca15ff700 1 -- start start 2023-11-28T12:09:42.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.434+0000 7f5ca15ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c9c0d2320 0x7f5c9c1f5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:42.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.434+0000 7f5ca15ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c9c15c9b0 0x7f5c9c1e7630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:42.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.434+0000 7f5ca15ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5c9c161340 0x7f5c9c155930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:42.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.434+0000 7f5ca15ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c9c1f5ed0 con 0x7f5c9c15c9b0 2023-11-28T12:09:42.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.434+0000 7f5ca15ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c9c1e6590 con 0x7f5c9c0d2320 2023-11-28T12:09:42.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.434+0000 7f5ca15ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c9c1e6870 con 0x7f5c9c161340 2023-11-28T12:09:42.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.434+0000 7f5c9a7fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c9c15c9b0 0x7f5c9c1e7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:42.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.434+0000 7f5c9a7fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c9c15c9b0 0x7f5c9c1e7630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51516/0 (socket says 172.21.15.45:51516) 2023-11-28T12:09:42.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.434+0000 7f5c9a7fc700 1 -- 172.21.15.45:0/1007772522 learned_addr learned my addr 172.21.15.45:0/1007772522 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:09:42.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.434+0000 7f5c9affd700 1 --2- 172.21.15.45:0/1007772522 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c9c0d2320 0x7f5c9c1f5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:42.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.434+0000 7f5c9b7fe700 1 --2- 172.21.15.45:0/1007772522 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5c9c161340 0x7f5c9c155930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:42.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.434+0000 7f5c9a7fc700 1 -- 172.21.15.45:0/1007772522 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5c9c161340 msgr2=0x7f5c9c155930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:42.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.434+0000 7f5c9a7fc700 1 --2- 172.21.15.45:0/1007772522 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5c9c161340 0x7f5c9c155930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:42.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.434+0000 7f5c9a7fc700 1 -- 172.21.15.45:0/1007772522 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c9c0d2320 msgr2=0x7f5c9c1f5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:42.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.434+0000 7f5c9a7fc700 1 --2- 172.21.15.45:0/1007772522 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c9c0d2320 0x7f5c9c1f5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:42.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.434+0000 7f5c9a7fc700 1 -- 172.21.15.45:0/1007772522 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c94009b30 con 0x7f5c9c15c9b0 2023-11-28T12:09:42.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.435+0000 7f5c9a7fc700 1 --2- 172.21.15.45:0/1007772522 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c9c15c9b0 0x7f5c9c1e7630 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f5c90009fd0 tx=0x7f5c90004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:42.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.435+0000 7f5c837fe700 1 -- 172.21.15.45:0/1007772522 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c900036a0 con 0x7f5c9c15c9b0 2023-11-28T12:09:42.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.435+0000 7f5c837fe700 1 -- 172.21.15.45:0/1007772522 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c9001f070 con 0x7f5c9c15c9b0 2023-11-28T12:09:42.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.435+0000 7f5c837fe700 1 -- 172.21.15.45:0/1007772522 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c90003a60 con 0x7f5c9c15c9b0 2023-11-28T12:09:42.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.435+0000 7f5ca15ff700 1 -- 172.21.15.45:0/1007772522 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c900094a0 con 0x7f5c9c15c9b0 2023-11-28T12:09:42.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.435+0000 7f5ca15ff700 1 -- 172.21.15.45:0/1007772522 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c9c0d15e0 con 0x7f5c9c15c9b0 2023-11-28T12:09:42.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.436+0000 7f5ca15ff700 1 -- 172.21.15.45:0/1007772522 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c9c0d1300 con 0x7f5c9c15c9b0 2023-11-28T12:09:42.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.437+0000 7f5c837fe700 1 -- 172.21.15.45:0/1007772522 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f5c9000f050 con 0x7f5c9c15c9b0 2023-11-28T12:09:42.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.438+0000 7f5c837fe700 1 --2- 172.21.15.45:0/1007772522 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5c880682f0 0x7f5c8806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:42.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.438+0000 7f5c837fe700 1 -- 172.21.15.45:0/1007772522 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5c90021070 con 0x7f5c9c15c9b0 2023-11-28T12:09:42.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.438+0000 7f5c9affd700 1 --2- 172.21.15.45:0/1007772522 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5c880682f0 0x7f5c8806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:42.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.439+0000 7f5c9affd700 1 --2- 172.21.15.45:0/1007772522 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5c880682f0 0x7f5c8806a7a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c154f10 tx=0x7f5c8c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:42.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.442+0000 7f5c837fe700 1 -- 172.21.15.45:0/1007772522 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f5c90053e50 con 0x7f5c9c15c9b0 2023-11-28T12:09:42.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.690+0000 7f5ca15ff700 1 -- 172.21.15.45:0/1007772522 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5c9c15cd80 con 0x7f5c9c15c9b0 2023-11-28T12:09:42.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.691+0000 7f5c837fe700 1 -- 172.21.15.45:0/1007772522 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v32) v1 ==== 53+0+73 (secure 0 0 0) 0x7f5c90057470 con 0x7f5c9c15c9b0 2023-11-28T12:09:42.692 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-28T12:09:42.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.693+0000 7f5ca15ff700 1 -- 172.21.15.45:0/1007772522 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5c880682f0 msgr2=0x7f5c8806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:42.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.693+0000 7f5ca15ff700 1 --2- 172.21.15.45:0/1007772522 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5c880682f0 0x7f5c8806a7a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c154f10 tx=0x7f5c8c009040 comp rx=0 tx=0).stop 2023-11-28T12:09:42.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.693+0000 7f5ca15ff700 1 -- 172.21.15.45:0/1007772522 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c9c15c9b0 msgr2=0x7f5c9c1e7630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:42.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.693+0000 7f5ca15ff700 1 --2- 172.21.15.45:0/1007772522 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c9c15c9b0 0x7f5c9c1e7630 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f5c90009fd0 tx=0x7f5c90004750 comp rx=0 tx=0).stop 2023-11-28T12:09:42.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.693+0000 7f5ca15ff700 1 -- 172.21.15.45:0/1007772522 shutdown_connections 2023-11-28T12:09:42.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.693+0000 7f5ca15ff700 1 --2- 172.21.15.45:0/1007772522 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5c880682f0 0x7f5c8806a7a0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:42.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.693+0000 7f5ca15ff700 1 --2- 172.21.15.45:0/1007772522 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c9c0d2320 0x7f5c9c1f5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:42.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.693+0000 7f5ca15ff700 1 --2- 172.21.15.45:0/1007772522 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5c9c161340 0x7f5c9c155930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:42.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.693+0000 7f5ca15ff700 1 --2- 172.21.15.45:0/1007772522 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c9c15c9b0 0x7f5c9c1e7630 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:42.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.693+0000 7f5ca15ff700 1 -- 172.21.15.45:0/1007772522 >> 172.21.15.45:0/1007772522 conn(0x7f5c9c072600 msgr2=0x7f5c9c0b5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:42.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.693+0000 7f5ca15ff700 1 -- 172.21.15.45:0/1007772522 shutdown_connections 2023-11-28T12:09:42.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:42.693+0000 7f5ca15ff700 1 -- 172.21.15.45:0/1007772522 wait complete. 2023-11-28T12:09:42.712 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-28T12:09:42.712 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T12:09:42.712 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi045.front.sepia.ceph.com 2023-11-28T12:09:42.712 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-28T12:09:42.712 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-28T12:09:42.712 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-28T12:09:42.712 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-28T12:09:42.712 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T12:09:42.712 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T12:09:42.713 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:09:42.713 DEBUG:teuthology.orchestra.run.smithi045:> ip addr 2023-11-28T12:09:42.760 INFO:teuthology.orchestra.run.smithi045.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T12:09:42.761 INFO:teuthology.orchestra.run.smithi045.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T12:09:42.761 INFO:teuthology.orchestra.run.smithi045.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T12:09:42.761 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T12:09:42.761 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 ::1/128 scope host 2023-11-28T12:09:42.761 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T12:09:42.761 INFO:teuthology.orchestra.run.smithi045.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-28T12:09:42.761 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a6 brd ff:ff:ff:ff:ff:ff 2023-11-28T12:09:42.761 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f0 2023-11-28T12:09:42.761 INFO:teuthology.orchestra.run.smithi045.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-28T12:09:42.761 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a7 brd ff:ff:ff:ff:ff:ff 2023-11-28T12:09:42.761 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f1 2023-11-28T12:09:42.762 INFO:teuthology.orchestra.run.smithi045.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T12:09:42.762 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:be brd ff:ff:ff:ff:ff:ff 2023-11-28T12:09:42.762 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f0 2023-11-28T12:09:42.762 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.21.15.45/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-11-28T12:09:42.762 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft 41806sec preferred_lft 41806sec 2023-11-28T12:09:42.762 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::ec4:7aff:febd:12be/64 scope link 2023-11-28T12:09:42.762 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T12:09:42.763 INFO:teuthology.orchestra.run.smithi045.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-28T12:09:42.763 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:bf brd ff:ff:ff:ff:ff:ff 2023-11-28T12:09:42.763 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f1 2023-11-28T12:09:42.763 INFO:teuthology.orchestra.run.smithi045.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T12:09:42.763 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 22:47:66:33:f5:4d brd ff:ff:ff:ff:ff:ff 2023-11-28T12:09:42.763 INFO:teuthology.orchestra.run.smithi045.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-28T12:09:42.763 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T12:09:42.763 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::c479:bdff:fe23:e158/64 scope link 2023-11-28T12:09:42.763 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T12:09:42.764 INFO:teuthology.orchestra.run.smithi045.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T12:09:42.764 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 62:87:bf:4a:62:2a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T12:09:42.764 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::6087:bfff:fe4a:622a/64 scope link 2023-11-28T12:09:42.764 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T12:09:42.764 INFO:teuthology.orchestra.run.smithi045.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T12:09:42.764 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 22:47:66:33:f5:4d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T12:09:42.764 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::2047:66ff:fe33:f54d/64 scope link 2023-11-28T12:09:42.764 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-11-28T12:09:42.764 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:09:42.765 DEBUG:teuthology.orchestra.run.smithi045:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T12:09:42.870 INFO:teuthology.orchestra.run.smithi045.stdout:1 2023-11-28T12:09:42.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:09:42.873 DEBUG:teuthology.orchestra.run.smithi045:> route 2023-11-28T12:09:42.922 INFO:teuthology.orchestra.run.smithi045.stdout:Kernel IP routing table 2023-11-28T12:09:42.923 INFO:teuthology.orchestra.run.smithi045.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T12:09:42.923 INFO:teuthology.orchestra.run.smithi045.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-11-28T12:09:42.923 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-11-28T12:09:42.923 INFO:teuthology.orchestra.run.smithi045.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T12:09:42.923 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:09:42.923 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-11-28T12:09:42.924 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-11-28T12:09:42.924 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-28T12:09:42.924 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-28T12:09:42.924 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-28T12:09:42.924 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-11-28T12:09:43.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:09:43.098 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2023-11-28T12:09:43.145 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-28T12:09:43.145 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-28T12:09:43.146 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T12:09:43.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:09:43.147 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set brx.0 up 2023-11-28T12:09:43.219 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T12:09:43.219 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-28T12:09:43.266 INFO:teuthology.orchestra.run.smithi045.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-28T12:09:43.267 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T12:09:43.267 DEBUG:teuthology.orchestra.run.smithi045:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-28T12:09:43.352 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-28T12:09:43.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:09:43.352 DEBUG:teuthology.orchestra.run.smithi045:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-28T12:09:43.500 INFO:teuthology.orchestra.run.smithi045.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-28T12:09:43.500 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-28T12:09:43.500 INFO:teuthology.orchestra.run.smithi045.stdout:invalid new device string format 2023-11-28T12:09:43.516 INFO:teuthology.orchestra.run.smithi045.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-28T12:09:43.516 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-28T12:09:43.516 INFO:teuthology.orchestra.run.smithi045.stdout:invalid new device string format 2023-11-28T12:09:43.516 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: resolved to: "172.21.15.45:3300,172.21.15.152:3300,172.21.15.152:3301" 2023-11-28T12:09:43.517 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-28T12:09:43.540 INFO:teuthology.orchestra.run.smithi045.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-28T12:09:43.540 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-28T12:09:43.540 INFO:teuthology.orchestra.run.smithi045.stdout:invalid new device string format 2023-11-28T12:09:43.540 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: resolved to: "172.21.15.45:3300,172.21.15.152:3300,172.21.15.152:3301" 2023-11-28T12:09:43.541 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-28T12:09:43.541 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: resolved to: "172.21.15.45:6789,172.21.15.152:6789,172.21.15.152:6790" 2023-11-28T12:09:43.541 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.45:6789,172.21.15.152:6789,172.21.15.152:6790:/ 2023-11-28T12:09:43.541 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=bd7c37f1-f7c6-4778-b845-52cf2aa6e366" will pass to kernel 2023-11-28T12:09:43.546 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-28T12:09:43.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:09:43.547 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-28T12:09:43.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:09:43.621 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-28T12:09:43.722 INFO:teuthology.orchestra.run.smithi045.stdout:client5950 2023-11-28T12:09:43.722 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T12:09:43.722 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T12:09:43.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:09:43.769 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir dir_test) 2023-11-28T12:09:43.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:09:43.863 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch dir_test/file) 2023-11-28T12:09:43.912 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits daemon-helper kill python3 -c ' 2023-11-28T12:09:43.912 DEBUG:teuthology.orchestra.run.smithi045:> import os 2023-11-28T12:09:43.912 DEBUG:teuthology.orchestra.run.smithi045:> import stat 2023-11-28T12:09:43.913 DEBUG:teuthology.orchestra.run.smithi045:> 2023-11-28T12:09:43.913 DEBUG:teuthology.orchestra.run.smithi045:> print(os.stat("/home/ubuntu/cephtest/mnt.0/dir_test/file").st_ino) 2023-11-28T12:09:43.913 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-11-28T12:09:44.029 INFO:teuthology.orchestra.run.smithi045.stdout:1099511627777 2023-11-28T12:09:44.214 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T12:09:44.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.457+0000 7f334ddff700 1 Processor -- start 2023-11-28T12:09:44.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.457+0000 7f334ddff700 1 -- start start 2023-11-28T12:09:44.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.458+0000 7f334ddff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f33480cd7c0 0x7f33480cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:44.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.458+0000 7f334ddff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33480d1950 con 0x7f3348161340 2023-11-28T12:09:44.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.458+0000 7f334ddff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33480ce140 con 0x7f334815c9b0 2023-11-28T12:09:44.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.458+0000 7f334ddff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33480b5800 con 0x7f33480cd7c0 2023-11-28T12:09:44.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.458+0000 7f333ffff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f3348161340 0x7f33480d1de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:52554/0 (socket says 172.21.15.45:52554) 2023-11-28T12:09:44.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.458+0000 7f333ffff700 1 -- 172.21.15.45:0/928299482 learned_addr learned my addr 172.21.15.45:0/928299482 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:09:44.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.459+0000 7f3347fff700 1 --2- 172.21.15.45:0/928299482 >> v2:172.21.15.152:3300/0 conn(0x7f33480cd7c0 0x7f33480cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:44.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.459+0000 7f3346ffd700 1 -- 172.21.15.45:0/928299482 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1727311757 0 0) 0x7f33480d1950 con 0x7f3348161340 2023-11-28T12:09:44.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.459+0000 7f3346ffd700 1 -- 172.21.15.45:0/928299482 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33340035b0 con 0x7f3348161340 2023-11-28T12:09:44.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.459+0000 7f3346ffd700 1 -- 172.21.15.45:0/928299482 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2331666600 0 0) 0x7f33480ce140 con 0x7f334815c9b0 2023-11-28T12:09:44.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.459+0000 7f3346ffd700 1 -- 172.21.15.45:0/928299482 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33480d1950 con 0x7f334815c9b0 2023-11-28T12:09:44.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.459+0000 7f3346ffd700 1 -- 172.21.15.45:0/928299482 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 948251180 0 0) 0x7f33340035b0 con 0x7f3348161340 2023-11-28T12:09:44.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.459+0000 7f3346ffd700 1 -- 172.21.15.45:0/928299482 >> v2:172.21.15.152:3300/0 conn(0x7f33480cd7c0 msgr2=0x7f33480cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:44.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.459+0000 7f3346ffd700 1 --2- 172.21.15.45:0/928299482 >> v2:172.21.15.152:3300/0 conn(0x7f33480cd7c0 0x7f33480cdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:44.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.459+0000 7f3346ffd700 1 -- 172.21.15.45:0/928299482 >> v1:172.21.15.152:6789/0 conn(0x7f334815c9b0 legacy=0x7f33480b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:44.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.459+0000 7f3346ffd700 1 -- 172.21.15.45:0/928299482 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33480d24f0 con 0x7f3348161340 2023-11-28T12:09:44.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.459+0000 7f3346ffd700 1 -- 172.21.15.45:0/928299482 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3460218165 0 0) 0x7f3330001670 con 0x7f3348161340 2023-11-28T12:09:44.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.459+0000 7f3346ffd700 1 -- 172.21.15.45:0/928299482 >> v1:172.21.15.45:6789/0 conn(0x7f3348161340 legacy=0x7f33480d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:44.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.459+0000 7f3346ffd700 1 --2- 172.21.15.45:0/928299482 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3334003be0 0x7f3334003fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:44.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.459+0000 7f3346ffd700 1 --2- 172.21.15.45:0/928299482 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3334004850 0x7f3334004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:44.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.459+0000 7f3346ffd700 1 --2- 172.21.15.45:0/928299482 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3334005250 0x7f333400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:44.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.459+0000 7f3346ffd700 1 -- 172.21.15.45:0/928299482 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33480b5800 con 0x7f3334005250 2023-11-28T12:09:44.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.459+0000 7f3346ffd700 1 -- 172.21.15.45:0/928299482 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f333400c160 con 0x7f3334004850 2023-11-28T12:09:44.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.459+0000 7f3346ffd700 1 -- 172.21.15.45:0/928299482 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f333400c320 con 0x7f3334003be0 2023-11-28T12:09:44.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.459+0000 7f3347fff700 1 --2- 172.21.15.45:0/928299482 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3334005250 0x7f333400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:44.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.460+0000 7f333ffff700 1 --2- 172.21.15.45:0/928299482 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3334004850 0x7f3334004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:44.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.460+0000 7f33477fe700 1 --2- 172.21.15.45:0/928299482 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3334003be0 0x7f3334003fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:44.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.460+0000 7f3347fff700 1 -- 172.21.15.45:0/928299482 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3334003be0 msgr2=0x7f3334003fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:44.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.460+0000 7f3347fff700 1 --2- 172.21.15.45:0/928299482 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3334003be0 0x7f3334003fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:44.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.460+0000 7f3347fff700 1 -- 172.21.15.45:0/928299482 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3334004850 msgr2=0x7f3334004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:44.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.460+0000 7f3347fff700 1 --2- 172.21.15.45:0/928299482 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3334004850 0x7f3334004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:44.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.460+0000 7f3347fff700 1 -- 172.21.15.45:0/928299482 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33340035b0 con 0x7f3334005250 2023-11-28T12:09:44.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.460+0000 7f3347fff700 1 -- 172.21.15.45:0/928299482 reap_dead start 2023-11-28T12:09:44.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.460+0000 7f3347fff700 1 --2- 172.21.15.45:0/928299482 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3334005250 0x7f333400ba10 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f3340009f90 tx=0x7f3334005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b6b841cb1b0ce3a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:44.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.460+0000 7f3346ffd700 1 -- 172.21.15.45:0/928299482 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3340003a20 con 0x7f3334005250 2023-11-28T12:09:44.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.460+0000 7f3346ffd700 1 -- 172.21.15.45:0/928299482 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f334000f040 con 0x7f3334005250 2023-11-28T12:09:44.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.460+0000 7f3346ffd700 1 -- 172.21.15.45:0/928299482 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3340003dc0 con 0x7f3334005250 2023-11-28T12:09:44.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.461+0000 7f334ddff700 1 -- 172.21.15.45:0/928299482 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3334005250 msgr2=0x7f333400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:44.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.461+0000 7f334ddff700 1 --2- 172.21.15.45:0/928299482 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3334005250 0x7f333400ba10 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f3340009f90 tx=0x7f3334005880 comp rx=0 tx=0).stop 2023-11-28T12:09:44.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.461+0000 7f334ddff700 1 -- 172.21.15.45:0/928299482 shutdown_connections 2023-11-28T12:09:44.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.461+0000 7f334ddff700 1 --2- 172.21.15.45:0/928299482 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3334005250 0x7f333400ba10 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:44.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.461+0000 7f334ddff700 1 -- 172.21.15.45:0/928299482 >> 172.21.15.45:0/928299482 conn(0x7f3348072600 msgr2=0x7f33480cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:44.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.461+0000 7f334ddff700 1 -- 172.21.15.45:0/928299482 shutdown_connections 2023-11-28T12:09:44.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.461+0000 7f334ddff700 1 -- 172.21.15.45:0/928299482 wait complete. 2023-11-28T12:09:44.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.463+0000 7f334ddff700 1 Processor -- start 2023-11-28T12:09:44.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.463+0000 7f334ddff700 1 -- start start 2023-11-28T12:09:44.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.464+0000 7f334ddff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3334005250 0x7f33480cbee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:44.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.464+0000 7f334ddff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3348157970 0x7f33480c7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:44.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.464+0000 7f334ddff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f33480c7cd0 0x7f33480c95f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:44.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.464+0000 7f334ddff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33480c8140 con 0x7f3334005250 2023-11-28T12:09:44.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.464+0000 7f334ddff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33481f3520 con 0x7f3348157970 2023-11-28T12:09:44.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.464+0000 7f334ddff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33481f2650 con 0x7f33480c7cd0 2023-11-28T12:09:44.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.464+0000 7f33477fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3334005250 0x7f33480cbee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:44.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.464+0000 7f33477fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3334005250 0x7f33480cbee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51532/0 (socket says 172.21.15.45:51532) 2023-11-28T12:09:44.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.464+0000 7f33477fe700 1 -- 172.21.15.45:0/4130204802 learned_addr learned my addr 172.21.15.45:0/4130204802 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:09:44.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.464+0000 7f333ffff700 1 --2- 172.21.15.45:0/4130204802 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3348157970 0x7f33480c7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:44.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.464+0000 7f3347fff700 1 --2- 172.21.15.45:0/4130204802 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f33480c7cd0 0x7f33480c95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:44.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.465+0000 7f33477fe700 1 -- 172.21.15.45:0/4130204802 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f33480c7cd0 msgr2=0x7f33480c95f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:44.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.465+0000 7f33477fe700 1 --2- 172.21.15.45:0/4130204802 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f33480c7cd0 0x7f33480c95f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:44.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.465+0000 7f33477fe700 1 -- 172.21.15.45:0/4130204802 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3348157970 msgr2=0x7f33480c7790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:44.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.465+0000 7f33477fe700 1 --2- 172.21.15.45:0/4130204802 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3348157970 0x7f33480c7790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:44.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.465+0000 7f33477fe700 1 -- 172.21.15.45:0/4130204802 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33480d1300 con 0x7f3334005250 2023-11-28T12:09:44.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.465+0000 7f333ffff700 1 --2- 172.21.15.45:0/4130204802 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3348157970 0x7f33480c7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:09:44.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.465+0000 7f3347fff700 1 --2- 172.21.15.45:0/4130204802 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f33480c7cd0 0x7f33480c95f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:09:44.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.465+0000 7f33477fe700 1 --2- 172.21.15.45:0/4130204802 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3334005250 0x7f33480cbee0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f333800f770 tx=0x7f333800fb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:44.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.465+0000 7f3344ff9700 1 -- 172.21.15.45:0/4130204802 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3338005320 con 0x7f3334005250 2023-11-28T12:09:44.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.465+0000 7f3344ff9700 1 -- 172.21.15.45:0/4130204802 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33380054a0 con 0x7f3334005250 2023-11-28T12:09:44.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.465+0000 7f3344ff9700 1 -- 172.21.15.45:0/4130204802 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3338006aa0 con 0x7f3334005250 2023-11-28T12:09:44.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.465+0000 7f334ddff700 1 -- 172.21.15.45:0/4130204802 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33480b5520 con 0x7f3334005250 2023-11-28T12:09:44.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.465+0000 7f334ddff700 1 -- 172.21.15.45:0/4130204802 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33480d15e0 con 0x7f3334005250 2023-11-28T12:09:44.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.466+0000 7f334ddff700 1 -- 172.21.15.45:0/4130204802 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33480745c0 con 0x7f3334005250 2023-11-28T12:09:44.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.467+0000 7f3344ff9700 1 -- 172.21.15.45:0/4130204802 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f3338006c00 con 0x7f3334005250 2023-11-28T12:09:44.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.468+0000 7f3344ff9700 1 --2- 172.21.15.45:0/4130204802 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f33280682f0 0x7f332806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:44.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.468+0000 7f3344ff9700 1 -- 172.21.15.45:0/4130204802 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3338085410 con 0x7f3334005250 2023-11-28T12:09:44.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.468+0000 7f333ffff700 1 --2- 172.21.15.45:0/4130204802 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f33280682f0 0x7f332806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:44.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.469+0000 7f333ffff700 1 --2- 172.21.15.45:0/4130204802 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f33280682f0 0x7f332806a7a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f3348160ea0 tx=0x7f3330009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:44.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.472+0000 7f3344ff9700 1 -- 172.21.15.45:0/4130204802 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f3338051b80 con 0x7f3334005250 2023-11-28T12:09:44.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.720+0000 7f334ddff700 1 -- 172.21.15.45:0/4130204802 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f33480d08a0 con 0x7f3334005250 2023-11-28T12:09:44.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.720+0000 7f3344ff9700 1 -- 172.21.15.45:0/4130204802 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4649 (secure 0 0 0) 0x7f33380551a0 con 0x7f3334005250 2023-11-28T12:09:44.721 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:09:44.721 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5423,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6836/735970231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":735970231},{"type":"v1","addr":"172.21.15.152:6836","nonce":735970231}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5797,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/3354918087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6835","nonce":3354918087},{"type":"v1","addr":"172.21.15.152:6837","nonce":3354918087}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5806,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/275804060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":275804060},{"type":"v1","addr":"172.21.15.45:6835","nonce":275804060}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T12:09:35.571815+0000","modified":"2023-11-28T12:09:38.581286+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5979},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5979":{"gid":5979,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6833/3784258337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":3784258337},{"type":"v1","addr":"172.21.15.45:6833","nonce":3784258337}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-28T12:09:44.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.722+0000 7f334ddff700 1 -- 172.21.15.45:0/4130204802 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f33280682f0 msgr2=0x7f332806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:44.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.722+0000 7f334ddff700 1 --2- 172.21.15.45:0/4130204802 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f33280682f0 0x7f332806a7a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f3348160ea0 tx=0x7f3330009040 comp rx=0 tx=0).stop 2023-11-28T12:09:44.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.723+0000 7f334ddff700 1 -- 172.21.15.45:0/4130204802 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3334005250 msgr2=0x7f33480cbee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:44.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.723+0000 7f334ddff700 1 --2- 172.21.15.45:0/4130204802 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3334005250 0x7f33480cbee0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f333800f770 tx=0x7f333800fb30 comp rx=0 tx=0).stop 2023-11-28T12:09:44.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.723+0000 7f334ddff700 1 -- 172.21.15.45:0/4130204802 shutdown_connections 2023-11-28T12:09:44.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.723+0000 7f334ddff700 1 --2- 172.21.15.45:0/4130204802 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f33280682f0 0x7f332806a7a0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:44.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.723+0000 7f334ddff700 1 --2- 172.21.15.45:0/4130204802 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f33480c7cd0 0x7f33480c95f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:44.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.723+0000 7f334ddff700 1 --2- 172.21.15.45:0/4130204802 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3334005250 0x7f33480cbee0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:44.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.723+0000 7f334ddff700 1 --2- 172.21.15.45:0/4130204802 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3348157970 0x7f33480c7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:44.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.723+0000 7f334ddff700 1 -- 172.21.15.45:0/4130204802 >> 172.21.15.45:0/4130204802 conn(0x7f3348072600 msgr2=0x7f33480b7350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:44.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.723+0000 7f334ddff700 1 -- 172.21.15.45:0/4130204802 shutdown_connections 2023-11-28T12:09:44.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:44.723+0000 7f334ddff700 1 -- 172.21.15.45:0/4130204802 wait complete. 2023-11-28T12:09:44.726 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 32 2023-11-28T12:09:44.742 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2023-11-28T12:09:44.978 INFO:teuthology.orchestra.run.smithi045.stdout:{"message":"","return_code":0} 2023-11-28T12:09:44.978 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2023-11-28T12:09:44.978 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2023-11-28T12:09:45.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.068+0000 7f8752f160c0 1 Processor -- start 2023-11-28T12:09:45.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.068+0000 7f8752f160c0 1 -- start start 2023-11-28T12:09:45.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.069+0000 7f8752f160c0 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aa14c0a510 0x55aa14ce5430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:45.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.069+0000 7f8752f160c0 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55aa14c0b5b0 0x55aa14c51330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:45.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.069+0000 7f8752f160c0 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa14c50c00 0x55aa14c0c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:45.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.069+0000 7f8752f160c0 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa14b45fe0 con 0x55aa14c50c00 2023-11-28T12:09:45.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.069+0000 7f8752f160c0 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa14c57210 con 0x55aa14c0a510 2023-11-28T12:09:45.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.069+0000 7f8752f160c0 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x55aa14c57480 con 0x55aa14c0b5b0 2023-11-28T12:09:45.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.069+0000 7f8744d9c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa14c50c00 0x55aa14c0c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:45.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.069+0000 7f8744d9c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa14c50c00 0x55aa14c0c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51546/0 (socket says 172.21.15.45:51546) 2023-11-28T12:09:45.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.069+0000 7f8744d9c700 1 -- 172.21.15.45:0/2587809198 learned_addr learned my addr 172.21.15.45:0/2587809198 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:09:45.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.069+0000 7f8743d9a700 1 --2- 172.21.15.45:0/2587809198 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55aa14c0b5b0 0x55aa14c51330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:45.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.069+0000 7f874459b700 1 --2- 172.21.15.45:0/2587809198 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aa14c0a510 0x55aa14ce5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:45.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.070+0000 7f8744d9c700 1 -- 172.21.15.45:0/2587809198 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55aa14c0b5b0 msgr2=0x55aa14c51330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:45.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.070+0000 7f8744d9c700 1 --2- 172.21.15.45:0/2587809198 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55aa14c0b5b0 0x55aa14c51330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:45.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.070+0000 7f8744d9c700 1 -- 172.21.15.45:0/2587809198 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aa14c0a510 msgr2=0x55aa14ce5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:45.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.070+0000 7f8744d9c700 1 --2- 172.21.15.45:0/2587809198 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aa14c0a510 0x55aa14ce5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:45.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.070+0000 7f8744d9c700 1 -- 172.21.15.45:0/2587809198 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f873c00a100 con 0x55aa14c50c00 2023-11-28T12:09:45.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.070+0000 7f874459b700 1 --2- 172.21.15.45:0/2587809198 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aa14c0a510 0x55aa14ce5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:09:45.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.070+0000 7f8744d9c700 1 --2- 172.21.15.45:0/2587809198 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa14c50c00 0x55aa14c0c760 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f873c00a810 tx=0x7f873c005d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b8c34ca958c3620 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:45.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.070+0000 7f8742d98700 1 -- 172.21.15.45:0/2587809198 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f873c00a360 con 0x55aa14c50c00 2023-11-28T12:09:45.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.070+0000 7f8742d98700 1 -- 172.21.15.45:0/2587809198 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f873c012660 con 0x55aa14c50c00 2023-11-28T12:09:45.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.070+0000 7f8742d98700 1 -- 172.21.15.45:0/2587809198 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f873c012a10 con 0x55aa14c50c00 2023-11-28T12:09:45.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.071+0000 7f8752f160c0 1 -- 172.21.15.45:0/2587809198 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa14c50c00 msgr2=0x55aa14c0c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:45.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.071+0000 7f8752f160c0 1 --2- 172.21.15.45:0/2587809198 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa14c50c00 0x55aa14c0c760 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f873c00a810 tx=0x7f873c005d80 comp rx=0 tx=0).stop 2023-11-28T12:09:45.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.071+0000 7f8752f160c0 1 -- 172.21.15.45:0/2587809198 shutdown_connections 2023-11-28T12:09:45.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.071+0000 7f8752f160c0 1 --2- 172.21.15.45:0/2587809198 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aa14c0a510 0x55aa14ce5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:45.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.071+0000 7f8752f160c0 1 --2- 172.21.15.45:0/2587809198 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa14c50c00 0x55aa14c0c760 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:45.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.071+0000 7f8752f160c0 1 --2- 172.21.15.45:0/2587809198 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55aa14c0b5b0 0x55aa14c51330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:45.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.071+0000 7f8752f160c0 1 -- 172.21.15.45:0/2587809198 >> 172.21.15.45:0/2587809198 conn(0x55aa14c57890 msgr2=0x55aa14c56170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:45.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.071+0000 7f8752f160c0 1 -- 172.21.15.45:0/2587809198 shutdown_connections 2023-11-28T12:09:45.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.071+0000 7f8752f160c0 1 -- 172.21.15.45:0/2587809198 wait complete. 2023-11-28T12:09:45.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.072+0000 7f8752f160c0 1 Processor -- start 2023-11-28T12:09:45.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.072+0000 7f8752f160c0 1 -- start start 2023-11-28T12:09:45.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.073+0000 7f8752f160c0 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aa14c0a510 0x55aa14c0cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:45.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.073+0000 7f8752f160c0 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa14c0b5b0 0x55aa14cd6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:45.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.073+0000 7f8752f160c0 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55aa14c50c00 0x55aa14ce6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:45.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.073+0000 7f8752f160c0 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa14d6d810 con 0x55aa14c0b5b0 2023-11-28T12:09:45.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.073+0000 7f8752f160c0 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa14d6cc00 con 0x55aa14c0a510 2023-11-28T12:09:45.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.073+0000 7f8752f160c0 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x55aa14d6cee0 con 0x55aa14c50c00 2023-11-28T12:09:45.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.073+0000 7f8743d9a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa14c0b5b0 0x55aa14cd6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:45.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.073+0000 7f8743d9a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa14c0b5b0 0x55aa14cd6330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51558/0 (socket says 172.21.15.45:51558) 2023-11-28T12:09:45.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.073+0000 7f8743d9a700 1 -- 172.21.15.45:0/1121849739 learned_addr learned my addr 172.21.15.45:0/1121849739 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:09:45.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.073+0000 7f8743d9a700 1 -- 172.21.15.45:0/1121849739 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55aa14c50c00 msgr2=0x55aa14ce6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:45.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.073+0000 7f8743d9a700 1 --2- 172.21.15.45:0/1121849739 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55aa14c50c00 0x55aa14ce6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:45.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.073+0000 7f8743d9a700 1 -- 172.21.15.45:0/1121849739 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aa14c0a510 msgr2=0x55aa14c0cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:45.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.073+0000 7f8743d9a700 1 --2- 172.21.15.45:0/1121849739 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55aa14c0a510 0x55aa14c0cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:45.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.073+0000 7f8743d9a700 1 -- 172.21.15.45:0/1121849739 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aa14b784f0 con 0x55aa14c0b5b0 2023-11-28T12:09:45.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.074+0000 7f8743d9a700 1 --2- 172.21.15.45:0/1121849739 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa14c0b5b0 0x55aa14cd6330 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f873800efd0 tx=0x7f873800c640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:45.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.074+0000 7f8741d96700 1 -- 172.21.15.45:0/1121849739 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f873800f650 con 0x55aa14c0b5b0 2023-11-28T12:09:45.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.074+0000 7f8741d96700 1 -- 172.21.15.45:0/1121849739 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f873800f7b0 con 0x55aa14c0b5b0 2023-11-28T12:09:45.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.074+0000 7f8741d96700 1 -- 172.21.15.45:0/1121849739 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f873800fb60 con 0x55aa14c0b5b0 2023-11-28T12:09:45.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.074+0000 7f8752f160c0 1 -- 172.21.15.45:0/1121849739 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f873c00a4c0 con 0x55aa14c0b5b0 2023-11-28T12:09:45.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.074+0000 7f8752f160c0 1 -- 172.21.15.45:0/1121849739 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55aa14b51830 con 0x55aa14c0b5b0 2023-11-28T12:09:45.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.076+0000 7f8741d96700 1 -- 172.21.15.45:0/1121849739 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f873801f070 con 0x55aa14c0b5b0 2023-11-28T12:09:45.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.077+0000 7f8741d96700 1 --2- 172.21.15.45:0/1121849739 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f8730066c40 0x7f87300690f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:45.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.077+0000 7f8741d96700 1 -- 172.21.15.45:0/1121849739 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f87380850b0 con 0x55aa14c0b5b0 2023-11-28T12:09:45.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.077+0000 7f8752f160c0 1 --2- 172.21.15.45:0/1121849739 >> [v2:172.21.15.152:6808/116094,v1:172.21.15.152:6809/116094] conn(0x55aa14c3d510 0x55aa14d6e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:45.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.077+0000 7f8752f160c0 1 -- 172.21.15.45:0/1121849739 --> [v2:172.21.15.152:6808/116094,v1:172.21.15.152:6809/116094] -- osd_op(unknown.0.0:1 10.7 10:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61) v8 -- 0x55aa14d6e6f0 con 0x55aa14c3d510 2023-11-28T12:09:45.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.077+0000 7f874459b700 1 --2- 172.21.15.45:0/1121849739 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f8730066c40 0x7f87300690f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:45.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.077+0000 7f8744d9c700 1 --2- 172.21.15.45:0/1121849739 >> [v2:172.21.15.152:6808/116094,v1:172.21.15.152:6809/116094] conn(0x55aa14c3d510 0x55aa14d6e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:45.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.078+0000 7f8744d9c700 1 --2- 172.21.15.45:0/1121849739 >> [v2:172.21.15.152:6808/116094,v1:172.21.15.152:6809/116094] conn(0x55aa14c3d510 0x55aa14d6e1b0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:45.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.078+0000 7f874459b700 1 --2- 172.21.15.45:0/1121849739 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f8730066c40 0x7f87300690f0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f873400a440 tx=0x7f873400d000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:45.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.079+0000 7f8744d9c700 1 -- 172.21.15.45:0/1121849739 <== osd.6 v2:172.21.15.152:6808/116094 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (94) out=94b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+94 (crc 0 0 0) 0x7f873c012950 con 0x55aa14c3d510 2023-11-28T12:09:45.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.079+0000 7f8752f160c0 1 -- 172.21.15.45:0/1121849739 >> [v2:172.21.15.152:6808/116094,v1:172.21.15.152:6809/116094] conn(0x55aa14c3d510 msgr2=0x55aa14d6e1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:45.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.079+0000 7f8752f160c0 1 --2- 172.21.15.45:0/1121849739 >> [v2:172.21.15.152:6808/116094,v1:172.21.15.152:6809/116094] conn(0x55aa14c3d510 0x55aa14d6e1b0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:45.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.079+0000 7f8752f160c0 1 -- 172.21.15.45:0/1121849739 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f8730066c40 msgr2=0x7f87300690f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:45.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.079+0000 7f8752f160c0 1 --2- 172.21.15.45:0/1121849739 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f8730066c40 0x7f87300690f0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f873400a440 tx=0x7f873400d000 comp rx=0 tx=0).stop 2023-11-28T12:09:45.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.079+0000 7f8752f160c0 1 -- 172.21.15.45:0/1121849739 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa14c0b5b0 msgr2=0x55aa14cd6330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:45.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.079+0000 7f8752f160c0 1 --2- 172.21.15.45:0/1121849739 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa14c0b5b0 0x55aa14cd6330 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f873800efd0 tx=0x7f873800c640 comp rx=0 tx=0).stop 2023-11-28T12:09:45.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.079+0000 7f8744d9c700 1 -- 172.21.15.45:0/1121849739 reap_dead start 2023-11-28T12:09:45.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.079+0000 7f8752f160c0 1 -- 172.21.15.45:0/1121849739 shutdown_connections 2023-11-28T12:09:45.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.079+0000 7f8752f160c0 1 -- 172.21.15.45:0/1121849739 >> 172.21.15.45:0/1121849739 conn(0x55aa14c57890 msgr2=0x55aa14c55f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:45.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.079+0000 7f8752f160c0 1 -- 172.21.15.45:0/1121849739 shutdown_connections 2023-11-28T12:09:45.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.079+0000 7f8752f160c0 1 -- 172.21.15.45:0/1121849739 wait complete. 2023-11-28T12:09:45.085 INFO:teuthology.orchestra.run.smithi045.stdout:Xfiledir_test 2023-11-28T12:09:45.085 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:09:45.086 DEBUG:teuthology.orchestra.run.smithi045:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2023-11-28T12:09:45.199 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-11-28T12:09:45.200 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511627777, 2023-11-28T12:09:45.200 INFO:teuthology.orchestra.run.smithi045.stdout: "ancestors": [ 2023-11-28T12:09:45.200 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T12:09:45.200 INFO:teuthology.orchestra.run.smithi045.stdout: "dirino": 1099511627776, 2023-11-28T12:09:45.200 INFO:teuthology.orchestra.run.smithi045.stdout: "dname": "file", 2023-11-28T12:09:45.200 INFO:teuthology.orchestra.run.smithi045.stdout: "version": 2 2023-11-28T12:09:45.201 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-11-28T12:09:45.201 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T12:09:45.201 INFO:teuthology.orchestra.run.smithi045.stdout: "dirino": 1, 2023-11-28T12:09:45.201 INFO:teuthology.orchestra.run.smithi045.stdout: "dname": "dir_test", 2023-11-28T12:09:45.201 INFO:teuthology.orchestra.run.smithi045.stdout: "version": 4 2023-11-28T12:09:45.201 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T12:09:45.201 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2023-11-28T12:09:45.201 INFO:teuthology.orchestra.run.smithi045.stdout: "pool": 10, 2023-11-28T12:09:45.202 INFO:teuthology.orchestra.run.smithi045.stdout: "old_pools": [] 2023-11-28T12:09:45.202 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-11-28T12:09:45.202 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:09:45.204 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data setxattr 10000000001.00000000 parent 'The backtrace is corrupted' 2023-11-28T12:09:45.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.295+0000 7f19a7cb90c0 1 Processor -- start 2023-11-28T12:09:45.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.295+0000 7f19a7cb90c0 1 -- start start 2023-11-28T12:09:45.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.296+0000 7f19a7cb90c0 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557248ce5310 0x557248ce3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:45.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.296+0000 7f19a7cb90c0 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x557248ce56e0 0x557248ce00c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:45.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.296+0000 7f19a7cb90c0 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557248ce97a0 0x557248ce0600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:45.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.296+0000 7f19a7cb90c0 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x557248b47fe0 con 0x557248ce5310 2023-11-28T12:09:45.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.296+0000 7f19a7cb90c0 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x557248ce1f20 con 0x557248ce97a0 2023-11-28T12:09:45.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.296+0000 7f19a7cb90c0 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x557248ce87e0 con 0x557248ce56e0 2023-11-28T12:09:45.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.296+0000 7f199939b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557248ce5310 0x557248ce3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:45.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.296+0000 7f199939b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557248ce5310 0x557248ce3b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51564/0 (socket says 172.21.15.45:51564) 2023-11-28T12:09:45.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.296+0000 7f1998b9a700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x557248ce56e0 0x557248ce00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:45.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.296+0000 7f199939b700 1 -- 172.21.15.45:0/3987211761 learned_addr learned my addr 172.21.15.45:0/3987211761 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:09:45.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.296+0000 7f1999b9c700 1 --2- 172.21.15.45:0/3987211761 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557248ce97a0 0x557248ce0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:45.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.297+0000 7f199939b700 1 -- 172.21.15.45:0/3987211761 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x557248ce56e0 msgr2=0x557248ce00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:45.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.297+0000 7f199939b700 1 --2- 172.21.15.45:0/3987211761 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x557248ce56e0 0x557248ce00c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:45.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.297+0000 7f199939b700 1 -- 172.21.15.45:0/3987211761 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557248ce97a0 msgr2=0x557248ce0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:45.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.297+0000 7f199939b700 1 --2- 172.21.15.45:0/3987211761 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557248ce97a0 0x557248ce0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:45.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.297+0000 7f199939b700 1 -- 172.21.15.45:0/3987211761 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1990005d20 con 0x557248ce5310 2023-11-28T12:09:45.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.297+0000 7f199939b700 1 --2- 172.21.15.45:0/3987211761 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557248ce5310 0x557248ce3b20 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f198c00b2e0 tx=0x7f198c00b5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aead84e8c92e66b8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:45.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.297+0000 7f198b7fe700 1 -- 172.21.15.45:0/3987211761 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198c014070 con 0x557248ce5310 2023-11-28T12:09:45.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.297+0000 7f198b7fe700 1 -- 172.21.15.45:0/3987211761 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f198c00f3f0 con 0x557248ce5310 2023-11-28T12:09:45.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.297+0000 7f198b7fe700 1 -- 172.21.15.45:0/3987211761 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198c00f760 con 0x557248ce5310 2023-11-28T12:09:45.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.298+0000 7f19a7cb90c0 1 -- 172.21.15.45:0/3987211761 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557248ce5310 msgr2=0x557248ce3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:45.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.298+0000 7f19a7cb90c0 1 --2- 172.21.15.45:0/3987211761 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557248ce5310 0x557248ce3b20 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f198c00b2e0 tx=0x7f198c00b5f0 comp rx=0 tx=0).stop 2023-11-28T12:09:45.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.298+0000 7f19a7cb90c0 1 -- 172.21.15.45:0/3987211761 shutdown_connections 2023-11-28T12:09:45.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.298+0000 7f19a7cb90c0 1 --2- 172.21.15.45:0/3987211761 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557248ce97a0 0x557248ce0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:45.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.298+0000 7f19a7cb90c0 1 --2- 172.21.15.45:0/3987211761 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557248ce5310 0x557248ce3b20 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:45.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.298+0000 7f19a7cb90c0 1 --2- 172.21.15.45:0/3987211761 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x557248ce56e0 0x557248ce00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:45.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.298+0000 7f19a7cb90c0 1 -- 172.21.15.45:0/3987211761 >> 172.21.15.45:0/3987211761 conn(0x557248c3c190 msgr2=0x557248c58e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:45.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.298+0000 7f19a7cb90c0 1 -- 172.21.15.45:0/3987211761 shutdown_connections 2023-11-28T12:09:45.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.298+0000 7f19a7cb90c0 1 -- 172.21.15.45:0/3987211761 wait complete. 2023-11-28T12:09:45.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.299+0000 7f19a7cb90c0 1 Processor -- start 2023-11-28T12:09:45.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.299+0000 7f19a7cb90c0 1 -- start start 2023-11-28T12:09:45.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.300+0000 7f19a7cb90c0 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x557248ce5310 0x557248c355e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:45.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.300+0000 7f19a7cb90c0 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557248ce56e0 0x557248ce8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:45.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.300+0000 7f19a7cb90c0 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557248ce97a0 0x557248cda740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:45.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.300+0000 7f19a7cb90c0 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x557248ce8640 con 0x557248ce56e0 2023-11-28T12:09:45.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.300+0000 7f19a7cb90c0 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x557248c35c70 con 0x557248ce97a0 2023-11-28T12:09:45.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.300+0000 7f19a7cb90c0 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x557248c35f50 con 0x557248ce5310 2023-11-28T12:09:45.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.300+0000 7f1998b9a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557248ce56e0 0x557248ce8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:45.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.300+0000 7f1998b9a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557248ce56e0 0x557248ce8100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51580/0 (socket says 172.21.15.45:51580) 2023-11-28T12:09:45.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.300+0000 7f1998b9a700 1 -- 172.21.15.45:0/2664051538 learned_addr learned my addr 172.21.15.45:0/2664051538 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:09:45.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.300+0000 7f199939b700 1 --2- 172.21.15.45:0/2664051538 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x557248ce5310 0x557248c355e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:45.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.300+0000 7f1999b9c700 1 --2- 172.21.15.45:0/2664051538 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557248ce97a0 0x557248cda740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:45.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.300+0000 7f1998b9a700 1 -- 172.21.15.45:0/2664051538 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x557248ce5310 msgr2=0x557248c355e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:45.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.300+0000 7f1998b9a700 1 --2- 172.21.15.45:0/2664051538 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x557248ce5310 0x557248c355e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:45.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.300+0000 7f1998b9a700 1 -- 172.21.15.45:0/2664051538 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557248ce97a0 msgr2=0x557248cda740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:45.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.300+0000 7f1998b9a700 1 --2- 172.21.15.45:0/2664051538 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557248ce97a0 0x557248cda740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:45.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.300+0000 7f1998b9a700 1 -- 172.21.15.45:0/2664051538 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f198c001c10 con 0x557248ce56e0 2023-11-28T12:09:45.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.300+0000 7f199939b700 1 --2- 172.21.15.45:0/2664051538 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x557248ce5310 0x557248c355e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:09:45.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.300+0000 7f1999b9c700 1 --2- 172.21.15.45:0/2664051538 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557248ce97a0 0x557248cda740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:09:45.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.301+0000 7f1998b9a700 1 --2- 172.21.15.45:0/2664051538 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557248ce56e0 0x557248ce8100 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f1990008a10 tx=0x7f1990008dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:45.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.301+0000 7f198a7fc700 1 -- 172.21.15.45:0/2664051538 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199000f040 con 0x557248ce56e0 2023-11-28T12:09:45.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.301+0000 7f198a7fc700 1 -- 172.21.15.45:0/2664051538 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1990010ab0 con 0x557248ce56e0 2023-11-28T12:09:45.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.301+0000 7f19a7cb90c0 1 -- 172.21.15.45:0/2664051538 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557248b53830 con 0x557248ce56e0 2023-11-28T12:09:45.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.301+0000 7f198a7fc700 1 -- 172.21.15.45:0/2664051538 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1990010e20 con 0x557248ce56e0 2023-11-28T12:09:45.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.301+0000 7f19a7cb90c0 1 -- 172.21.15.45:0/2664051538 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f199400a100 con 0x557248ce56e0 2023-11-28T12:09:45.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.303+0000 7f198a7fc700 1 -- 172.21.15.45:0/2664051538 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f1990025070 con 0x557248ce56e0 2023-11-28T12:09:45.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.304+0000 7f198a7fc700 1 --2- 172.21.15.45:0/2664051538 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f197c066c10 0x7f197c0690c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:45.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.304+0000 7f198a7fc700 1 -- 172.21.15.45:0/2664051538 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1990085420 con 0x557248ce56e0 2023-11-28T12:09:45.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.304+0000 7f19a7cb90c0 1 --2- 172.21.15.45:0/2664051538 >> [v2:172.21.15.152:6808/116094,v1:172.21.15.152:6809/116094] conn(0x557248d7b3a0 0x557248d7b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:45.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.304+0000 7f19a7cb90c0 1 -- 172.21.15.45:0/2664051538 --> [v2:172.21.15.152:6808/116094,v1:172.21.15.152:6809/116094] -- osd_op(unknown.0.0:1 10.7 10:e2e07930:::10000000001.00000000:head [setxattr parent (26) in=32b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61) v8 -- 0x557248c57660 con 0x557248d7b3a0 2023-11-28T12:09:45.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.304+0000 7f199939b700 1 --2- 172.21.15.45:0/2664051538 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f197c066c10 0x7f197c0690c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:45.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.305+0000 7f1999b9c700 1 --2- 172.21.15.45:0/2664051538 >> [v2:172.21.15.152:6808/116094,v1:172.21.15.152:6809/116094] conn(0x557248d7b3a0 0x557248d7b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:45.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.305+0000 7f199939b700 1 --2- 172.21.15.45:0/2664051538 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f197c066c10 0x7f197c0690c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f198c00b2e0 tx=0x7f198c008000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:45.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.305+0000 7f1999b9c700 1 --2- 172.21.15.45:0/2664051538 >> [v2:172.21.15.152:6808/116094,v1:172.21.15.152:6809/116094] conn(0x557248d7b3a0 0x557248d7b810 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:45.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.307+0000 7f1999b9c700 1 -- 172.21.15.45:0/2664051538 <== osd.6 v2:172.21.15.152:6808/116094 1 ==== osd_op_reply(1 10000000001.00000000 [setxattr (26)] v61'2 uv2 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f199400fa60 con 0x557248d7b3a0 2023-11-28T12:09:45.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.307+0000 7f19a7cb90c0 1 -- 172.21.15.45:0/2664051538 >> [v2:172.21.15.152:6808/116094,v1:172.21.15.152:6809/116094] conn(0x557248d7b3a0 msgr2=0x557248d7b810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:45.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.307+0000 7f19a7cb90c0 1 --2- 172.21.15.45:0/2664051538 >> [v2:172.21.15.152:6808/116094,v1:172.21.15.152:6809/116094] conn(0x557248d7b3a0 0x557248d7b810 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:45.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.307+0000 7f19a7cb90c0 1 -- 172.21.15.45:0/2664051538 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f197c066c10 msgr2=0x7f197c0690c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:45.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.307+0000 7f19a7cb90c0 1 --2- 172.21.15.45:0/2664051538 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f197c066c10 0x7f197c0690c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f198c00b2e0 tx=0x7f198c008000 comp rx=0 tx=0).stop 2023-11-28T12:09:45.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.307+0000 7f19a7cb90c0 1 -- 172.21.15.45:0/2664051538 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557248ce56e0 msgr2=0x557248ce8100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:45.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.307+0000 7f19a7cb90c0 1 --2- 172.21.15.45:0/2664051538 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557248ce56e0 0x557248ce8100 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f1990008a10 tx=0x7f1990008dd0 comp rx=0 tx=0).stop 2023-11-28T12:09:45.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.307+0000 7f1999b9c700 1 -- 172.21.15.45:0/2664051538 reap_dead start 2023-11-28T12:09:45.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.307+0000 7f19a7cb90c0 1 -- 172.21.15.45:0/2664051538 shutdown_connections 2023-11-28T12:09:45.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.307+0000 7f19a7cb90c0 1 -- 172.21.15.45:0/2664051538 >> 172.21.15.45:0/2664051538 conn(0x557248c3c190 msgr2=0x557248c58e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:45.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.307+0000 7f19a7cb90c0 1 -- 172.21.15.45:0/2664051538 shutdown_connections 2023-11-28T12:09:45.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.307+0000 7f19a7cb90c0 1 -- 172.21.15.45:0/2664051538 wait complete. 2023-11-28T12:09:45.313 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:0 scrub start / recursive 2023-11-28T12:09:45.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.520+0000 7fae19bff700 1 Processor -- start 2023-11-28T12:09:45.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.520+0000 7fae19bff700 1 -- start start 2023-11-28T12:09:45.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.521+0000 7fae19bff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fae1415a760 0x7fae14161200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:45.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.521+0000 7fae19bff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fae1415dc30 0x7fae140b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:45.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.521+0000 7fae19bff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fae140cd7c0 0x7fae140cdc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:45.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.521+0000 7fae19bff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae140ce180 con 0x7fae1415dc30 2023-11-28T12:09:45.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.521+0000 7fae19bff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae1415ab30 con 0x7fae1415a760 2023-11-28T12:09:45.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.521+0000 7fae19bff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae1415e0a0 con 0x7fae140cd7c0 2023-11-28T12:09:45.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.522+0000 7fae12ffd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fae1415dc30 0x7fae140b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:45.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.522+0000 7fae12ffd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fae1415dc30 0x7fae140b4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51592/0 (socket says 172.21.15.45:51592) 2023-11-28T12:09:45.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.522+0000 7fae12ffd700 1 -- 172.21.15.45:0/3492302936 learned_addr learned my addr 172.21.15.45:0/3492302936 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:09:45.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.522+0000 7fae13fff700 1 --2- 172.21.15.45:0/3492302936 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fae140cd7c0 0x7fae140cdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:45.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.522+0000 7fae137fe700 1 --2- 172.21.15.45:0/3492302936 >> v2:172.21.15.152:3300/0 conn(0x7fae1415a760 0x7fae14161200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:45.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.522+0000 7fae12ffd700 1 -- 172.21.15.45:0/3492302936 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fae140cd7c0 msgr2=0x7fae140cdc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:45.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.522+0000 7fae12ffd700 1 --2- 172.21.15.45:0/3492302936 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fae140cd7c0 0x7fae140cdc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:45.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.522+0000 7fae12ffd700 1 -- 172.21.15.45:0/3492302936 >> v2:172.21.15.152:3300/0 conn(0x7fae1415a760 msgr2=0x7fae14161200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:45.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.522+0000 7fae12ffd700 1 --2- 172.21.15.45:0/3492302936 >> v2:172.21.15.152:3300/0 conn(0x7fae1415a760 0x7fae14161200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:45.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.522+0000 7fae12ffd700 1 -- 172.21.15.45:0/3492302936 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae14160d70 con 0x7fae1415dc30 2023-11-28T12:09:45.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.522+0000 7fae13fff700 1 --2- 172.21.15.45:0/3492302936 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fae140cd7c0 0x7fae140cdc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:09:45.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.522+0000 7fae12ffd700 1 --2- 172.21.15.45:0/3492302936 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fae1415dc30 0x7fae140b4bf0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fae1408bff0 tx=0x7fae08009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ab59caba7abaac5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:45.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.523+0000 7fae127fc700 1 -- 172.21.15.45:0/3492302936 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae0800b860 con 0x7fae1415dc30 2023-11-28T12:09:45.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.523+0000 7fae127fc700 1 -- 172.21.15.45:0/3492302936 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae0800b9c0 con 0x7fae1415dc30 2023-11-28T12:09:45.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.523+0000 7fae127fc700 1 -- 172.21.15.45:0/3492302936 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae0800bd50 con 0x7fae1415dc30 2023-11-28T12:09:45.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.523+0000 7fae19bff700 1 -- 172.21.15.45:0/3492302936 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fae1415dc30 msgr2=0x7fae140b4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:45.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.523+0000 7fae19bff700 1 --2- 172.21.15.45:0/3492302936 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fae1415dc30 0x7fae140b4bf0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fae1408bff0 tx=0x7fae08009c00 comp rx=0 tx=0).stop 2023-11-28T12:09:45.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.523+0000 7fae19bff700 1 -- 172.21.15.45:0/3492302936 shutdown_connections 2023-11-28T12:09:45.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.523+0000 7fae19bff700 1 --2- 172.21.15.45:0/3492302936 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fae140cd7c0 0x7fae140cdc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:45.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.523+0000 7fae19bff700 1 --2- 172.21.15.45:0/3492302936 >> v2:172.21.15.152:3300/0 conn(0x7fae1415a760 0x7fae14161200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:45.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.523+0000 7fae19bff700 1 --2- 172.21.15.45:0/3492302936 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fae1415dc30 0x7fae140b4bf0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:45.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.523+0000 7fae19bff700 1 -- 172.21.15.45:0/3492302936 >> 172.21.15.45:0/3492302936 conn(0x7fae14072620 msgr2=0x7fae140cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:45.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.523+0000 7fae19bff700 1 -- 172.21.15.45:0/3492302936 shutdown_connections 2023-11-28T12:09:45.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.523+0000 7fae19bff700 1 -- 172.21.15.45:0/3492302936 wait complete. 2023-11-28T12:09:45.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.525+0000 7fae19bff700 1 Processor -- start 2023-11-28T12:09:45.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.525+0000 7fae19bff700 1 -- start start 2023-11-28T12:09:45.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.526+0000 7fae19bff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae140cd7c0 0x7fae1414b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:45.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.526+0000 7fae19bff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fae1415a760 0x7fae140b89f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:45.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.526+0000 7fae19bff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fae1415dc30 0x7fae141f5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:45.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.526+0000 7fae19bff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae140ccc70 con 0x7fae1415dc30 2023-11-28T12:09:45.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.526+0000 7fae19bff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae140cc060 con 0x7fae140cd7c0 2023-11-28T12:09:45.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.526+0000 7fae19bff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae140cc340 con 0x7fae1415a760 2023-11-28T12:09:45.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.526+0000 7fae13fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fae1415dc30 0x7fae141f5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:45.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.527+0000 7fae13fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fae1415dc30 0x7fae141f5c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51596/0 (socket says 172.21.15.45:51596) 2023-11-28T12:09:45.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.527+0000 7fae13fff700 1 -- 172.21.15.45:0/1246541231 learned_addr learned my addr 172.21.15.45:0/1246541231 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:09:45.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.527+0000 7fae12ffd700 1 --2- 172.21.15.45:0/1246541231 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fae1415a760 0x7fae140b89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:45.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.527+0000 7fae137fe700 1 --2- 172.21.15.45:0/1246541231 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae140cd7c0 0x7fae1414b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:45.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.527+0000 7fae13fff700 1 -- 172.21.15.45:0/1246541231 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fae1415a760 msgr2=0x7fae140b89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:45.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.527+0000 7fae13fff700 1 --2- 172.21.15.45:0/1246541231 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fae1415a760 0x7fae140b89f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:45.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.527+0000 7fae13fff700 1 -- 172.21.15.45:0/1246541231 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae140cd7c0 msgr2=0x7fae1414b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:45.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.527+0000 7fae13fff700 1 --2- 172.21.15.45:0/1246541231 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae140cd7c0 0x7fae1414b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:45.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.527+0000 7fae13fff700 1 -- 172.21.15.45:0/1246541231 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae08009550 con 0x7fae1415dc30 2023-11-28T12:09:45.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.527+0000 7fae13fff700 1 --2- 172.21.15.45:0/1246541231 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fae1415dc30 0x7fae141f5c20 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fae0c007df0 tx=0x7fae0c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:45.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.527+0000 7fadfbfff700 1 -- 172.21.15.45:0/1246541231 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae0c00dd20 con 0x7fae1415dc30 2023-11-28T12:09:45.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.528+0000 7fadfbfff700 1 -- 172.21.15.45:0/1246541231 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae0c00f040 con 0x7fae1415dc30 2023-11-28T12:09:45.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.528+0000 7fae19bff700 1 -- 172.21.15.45:0/1246541231 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae140b5390 con 0x7fae1415dc30 2023-11-28T12:09:45.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.528+0000 7fadfbfff700 1 -- 172.21.15.45:0/1246541231 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae0c003c60 con 0x7fae1415dc30 2023-11-28T12:09:45.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.528+0000 7fae19bff700 1 -- 172.21.15.45:0/1246541231 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae140b5130 con 0x7fae1415dc30 2023-11-28T12:09:45.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.530+0000 7fadfbfff700 1 -- 172.21.15.45:0/1246541231 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fae0c01c030 con 0x7fae1415dc30 2023-11-28T12:09:45.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.531+0000 7fadfbfff700 1 --2- 172.21.15.45:0/1246541231 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fae000682f0 0x7fae0006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:45.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.531+0000 7fadfbfff700 1 -- 172.21.15.45:0/1246541231 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fae0c085b20 con 0x7fae1415dc30 2023-11-28T12:09:45.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.531+0000 7fae137fe700 1 --2- 172.21.15.45:0/1246541231 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fae000682f0 0x7fae0006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:45.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.532+0000 7fae137fe700 1 --2- 172.21.15.45:0/1246541231 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fae000682f0 0x7fae0006a7a0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fae04006b20 tx=0x7fae04008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:45.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.533+0000 7fae2d483b80 1 Processor -- start 2023-11-28T12:09:45.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.533+0000 7fae2d483b80 1 -- start start 2023-11-28T12:09:45.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.534+0000 7fae2d483b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557c641e5000 0x557c6419eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:45.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.534+0000 7fae2d483b80 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x557c641dbb70 0x557c641e53d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:45.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.534+0000 7fae2d483b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557c641c7710 0x557c6419fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:45.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.534+0000 7fae2d483b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c6411ce90 con 0x557c641e5000 2023-11-28T12:09:45.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.534+0000 7fae2d483b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c640891f0 con 0x557c641c7710 2023-11-28T12:09:45.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.534+0000 7fae2d483b80 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x557c640f7e60 con 0x557c641dbb70 2023-11-28T12:09:45.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.534+0000 7fae137fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557c641e5000 0x557c6419eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:45.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.534+0000 7fae137fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557c641e5000 0x557c6419eaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51606/0 (socket says 172.21.15.45:51606) 2023-11-28T12:09:45.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.534+0000 7fae137fe700 1 -- 172.21.15.45:0/3946657029 learned_addr learned my addr 172.21.15.45:0/3946657029 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:09:45.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.534+0000 7fae13fff700 1 --2- 172.21.15.45:0/3946657029 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557c641c7710 0x557c6419fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:45.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.534+0000 7fae12ffd700 1 --2- 172.21.15.45:0/3946657029 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x557c641dbb70 0x557c641e53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:45.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.534+0000 7fae137fe700 1 -- 172.21.15.45:0/3946657029 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x557c641dbb70 msgr2=0x557c641e53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:45.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.534+0000 7fae137fe700 1 --2- 172.21.15.45:0/3946657029 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x557c641dbb70 0x557c641e53d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:45.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.534+0000 7fae137fe700 1 -- 172.21.15.45:0/3946657029 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557c641c7710 msgr2=0x557c6419fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:45.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.534+0000 7fae137fe700 1 --2- 172.21.15.45:0/3946657029 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557c641c7710 0x557c6419fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:45.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.534+0000 7fae137fe700 1 -- 172.21.15.45:0/3946657029 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557c63ee5840 con 0x557c641e5000 2023-11-28T12:09:45.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.535+0000 7fae137fe700 1 --2- 172.21.15.45:0/3946657029 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557c641e5000 0x557c6419eaa0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fae04011910 tx=0x7fae04014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a83a957c9b8c15a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:45.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.535+0000 7fadf97fa700 1 -- 172.21.15.45:0/3946657029 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae04025070 con 0x557c641e5000 2023-11-28T12:09:45.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.535+0000 7fadf97fa700 1 -- 172.21.15.45:0/3946657029 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae04005a20 con 0x557c641e5000 2023-11-28T12:09:45.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.535+0000 7fadf97fa700 1 -- 172.21.15.45:0/3946657029 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae04009e70 con 0x557c641e5000 2023-11-28T12:09:45.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.536+0000 7fae2d483b80 1 -- 172.21.15.45:0/3946657029 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557c641e5000 msgr2=0x557c6419eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:45.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.536+0000 7fae2d483b80 1 --2- 172.21.15.45:0/3946657029 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557c641e5000 0x557c6419eaa0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fae04011910 tx=0x7fae04014000 comp rx=0 tx=0).stop 2023-11-28T12:09:45.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.536+0000 7fae2d483b80 1 -- 172.21.15.45:0/3946657029 shutdown_connections 2023-11-28T12:09:45.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.536+0000 7fae2d483b80 1 --2- 172.21.15.45:0/3946657029 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557c641c7710 0x557c6419fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:45.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.536+0000 7fae2d483b80 1 --2- 172.21.15.45:0/3946657029 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557c641e5000 0x557c6419eaa0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:45.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.536+0000 7fae2d483b80 1 --2- 172.21.15.45:0/3946657029 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x557c641dbb70 0x557c641e53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:45.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.536+0000 7fae2d483b80 1 -- 172.21.15.45:0/3946657029 >> 172.21.15.45:0/3946657029 conn(0x557c64194dd0 msgr2=0x557c6419dfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:45.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.536+0000 7fae2d483b80 1 -- 172.21.15.45:0/3946657029 shutdown_connections 2023-11-28T12:09:45.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.536+0000 7fae2d483b80 1 -- 172.21.15.45:0/3946657029 wait complete. 2023-11-28T12:09:45.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.537+0000 7fae2d483b80 1 -- start start 2023-11-28T12:09:45.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.537+0000 7fae2d483b80 1 Processor -- start 2023-11-28T12:09:45.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.538+0000 7fae2d483b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557c641c7710 0x557c641c26f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:45.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.538+0000 7fae2d483b80 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x557c641dbb70 0x557c641c2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:45.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.538+0000 7fae2d483b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557c641e5000 0x557c641e14a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:45.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.538+0000 7fae2d483b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c640f11d0 con 0x557c641e5000 2023-11-28T12:09:45.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.538+0000 7fae2d483b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c63ee6440 con 0x557c641c7710 2023-11-28T12:09:45.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.538+0000 7fae2d483b80 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x557c640893f0 con 0x557c641dbb70 2023-11-28T12:09:45.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.538+0000 7fae2d483b80 10 client.0 _ll_register_callbacks cb 0x557c6408f4b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T12:09:45.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.538+0000 7fae13fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557c641e5000 0x557c641e14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:45.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.538+0000 7fae13fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557c641e5000 0x557c641e14a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51616/0 (socket says 172.21.15.45:51616) 2023-11-28T12:09:45.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.538+0000 7fae13fff700 1 -- 172.21.15.45:0/4227141835 learned_addr learned my addr 172.21.15.45:0/4227141835 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:09:45.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.538+0000 7fae137fe700 1 --2- 172.21.15.45:0/4227141835 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557c641c7710 0x557c641c26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:45.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.538+0000 7fae12ffd700 1 --2- 172.21.15.45:0/4227141835 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x557c641dbb70 0x557c641c2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:45.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.539+0000 7fae13fff700 1 -- 172.21.15.45:0/4227141835 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x557c641dbb70 msgr2=0x557c641c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:45.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.539+0000 7fae13fff700 1 --2- 172.21.15.45:0/4227141835 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x557c641dbb70 0x557c641c2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:45.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.539+0000 7fae13fff700 1 -- 172.21.15.45:0/4227141835 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557c641c7710 msgr2=0x557c641c26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:45.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.539+0000 7fae13fff700 1 --2- 172.21.15.45:0/4227141835 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557c641c7710 0x557c641c26f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:45.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.539+0000 7fae13fff700 1 -- 172.21.15.45:0/4227141835 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae0400e040 con 0x557c641e5000 2023-11-28T12:09:45.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.539+0000 7fae13fff700 1 --2- 172.21.15.45:0/4227141835 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557c641e5000 0x557c641e14a0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fae0c00d700 tx=0x7fae0c0555f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42aabffaa599f8e4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:45.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.539+0000 7fadf27fc700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-11-28T12:09:45.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.539+0000 7fadf27fc700 1 -- 172.21.15.45:0/4227141835 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae0c055060 con 0x557c641e5000 2023-11-28T12:09:45.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.539+0000 7fadf27fc700 1 -- 172.21.15.45:0/4227141835 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(61..61 src has 1..61) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fae0c0551c0 con 0x557c641e5000 2023-11-28T12:09:45.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.539+0000 7fae2d483b80 1 -- 172.21.15.45:0/4227141835 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557c640f50e0 con 0x557c641e5000 2023-11-28T12:09:45.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.539+0000 7fadf27fc700 1 -- 172.21.15.45:0/4227141835 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fae0c055380 con 0x557c641e5000 2023-11-28T12:09:45.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.539+0000 7fae2d483b80 10 client.6159 fetch_fsmap learned FSMap version 32 2023-11-28T12:09:45.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.539+0000 7fae2d483b80 1 -- 172.21.15.45:0/4227141835 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x557c63fd2150 con 0x557c641e5000 2023-11-28T12:09:45.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.539+0000 7fadf27fc700 1 -- 172.21.15.45:0/4227141835 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557c640f50e0 con 0x557c641e5000 2023-11-28T12:09:45.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.539+0000 7fadf27fc700 1 -- 172.21.15.45:0/4227141835 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 32) v1 ==== 3106+0+0 (secure 0 0 0) 0x7fae0c056e10 con 0x557c641e5000 2023-11-28T12:09:45.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.540+0000 7fae2d483b80 10 client.6159 fetch_fsmap finished waiting for FSMap version 32 2023-11-28T12:09:45.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.540+0000 7fae2d483b80 10 client.6159 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.c 2023-11-28T12:09:45.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.540+0000 7fae2d483b80 20 client.6159 populate_metadata read hostname 'smithi045' 2023-11-28T12:09:45.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.540+0000 7fae2d483b80 1 --2- 172.21.15.45:0/4227141835 >> [v2:172.21.15.45:6832/3784258337,v1:172.21.15.45:6833/3784258337] conn(0x557c641e1ed0 0x557c641df300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:45.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.540+0000 7fae2d483b80 4 client.6159 mds_command: new command op to 5979 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-28T12:09:45.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.540+0000 7fae2d483b80 1 -- 172.21.15.45:0/4227141835 --> [v2:172.21.15.45:6832/3784258337,v1:172.21.15.45:6833/3784258337] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557c63f40fa0 con 0x557c641e1ed0 2023-11-28T12:09:45.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.540+0000 7fae137fe700 1 --2- 172.21.15.45:0/4227141835 >> [v2:172.21.15.45:6832/3784258337,v1:172.21.15.45:6833/3784258337] conn(0x557c641e1ed0 0x557c641df300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:45.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.540+0000 7fadf27fc700 10 client.6159 ms_handle_connect on v2:172.21.15.45:6832/3784258337 2023-11-28T12:09:45.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.540+0000 7fae137fe700 1 --2- 172.21.15.45:0/4227141835 >> [v2:172.21.15.45:6832/3784258337,v1:172.21.15.45:6833/3784258337] conn(0x557c641e1ed0 0x557c641df300 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a8f1526e53075c3 server_cookie=935668c1ce97f0c1 in_seq=0 out_seq=0 2023-11-28T12:09:45.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.541+0000 7fadf27fc700 1 -- 172.21.15.45:0/4227141835 <== mds.0 v2:172.21.15.45:6832/3784258337 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x557c63f40fa0 con 0x557c641e1ed0 2023-11-28T12:09:45.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.541+0000 7fadf27fc700 10 client.6159 handle_command_reply: tid=0 2023-11-28T12:09:45.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.541+0000 7fae2d483b80 1 client.6159 shutdown 2023-11-28T12:09:45.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.541+0000 7fae2d483b80 1 -- 172.21.15.45:0/4227141835 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557c641e5000 msgr2=0x557c641e14a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:45.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.541+0000 7fae2d483b80 1 --2- 172.21.15.45:0/4227141835 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557c641e5000 0x557c641e14a0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fae0c00d700 tx=0x7fae0c0555f0 comp rx=0 tx=0).stop 2023-11-28T12:09:45.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.541+0000 7fae2d483b80 1 -- 172.21.15.45:0/4227141835 shutdown_connections 2023-11-28T12:09:45.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.541+0000 7fae2d483b80 1 --2- 172.21.15.45:0/4227141835 >> [v2:172.21.15.45:6832/3784258337,v1:172.21.15.45:6833/3784258337] conn(0x557c641e1ed0 0x557c641df300 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:45.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.541+0000 7fae2d483b80 1 --2- 172.21.15.45:0/4227141835 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557c641c7710 0x557c641c26f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:45.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.541+0000 7fae2d483b80 1 --2- 172.21.15.45:0/4227141835 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557c641e5000 0x557c641e14a0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:45.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.541+0000 7fadf27fc700 0 client.6159 ms_handle_reset on v2:172.21.15.45:6832/3784258337 2023-11-28T12:09:45.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.541+0000 7fae2d483b80 1 --2- 172.21.15.45:0/4227141835 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x557c641dbb70 0x557c641c2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:45.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.541+0000 7fae2d483b80 1 -- 172.21.15.45:0/4227141835 >> 172.21.15.45:0/4227141835 conn(0x557c64194dd0 msgr2=0x557c6419a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:45.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.542+0000 7fae2d483b80 1 -- 172.21.15.45:0/4227141835 shutdown_connections 2023-11-28T12:09:45.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.542+0000 7fae2d483b80 1 -- 172.21.15.45:0/4227141835 wait complete. 2023-11-28T12:09:45.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.542+0000 7fae2d483b80 20 client.6159 trim_cache size 0 max 16384 2023-11-28T12:09:45.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.559+0000 7fae2d483b80 1 Processor -- start 2023-11-28T12:09:45.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.559+0000 7fae2d483b80 1 -- start start 2023-11-28T12:09:45.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.560+0000 7fae2d483b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557c64194dd0 0x557c641c62b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:45.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.560+0000 7fae2d483b80 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x557c641c7710 0x557c641a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:45.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.560+0000 7fae2d483b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557c641dbb70 0x557c641de800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:45.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.560+0000 7fae2d483b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c641a1b30 con 0x557c64194dd0 2023-11-28T12:09:45.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.560+0000 7fae2d483b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c6419aab0 con 0x557c641dbb70 2023-11-28T12:09:45.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.560+0000 7fae2d483b80 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x557c641a10b0 con 0x557c641c7710 2023-11-28T12:09:45.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.560+0000 7fae137fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557c64194dd0 0x557c641c62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:45.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.560+0000 7fae137fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557c64194dd0 0x557c641c62b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51620/0 (socket says 172.21.15.45:51620) 2023-11-28T12:09:45.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.560+0000 7fae137fe700 1 -- 172.21.15.45:0/4101783388 learned_addr learned my addr 172.21.15.45:0/4101783388 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:09:45.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.560+0000 7fae12ffd700 1 --2- 172.21.15.45:0/4101783388 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x557c641c7710 0x557c641a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:45.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.560+0000 7fae13fff700 1 --2- 172.21.15.45:0/4101783388 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557c641dbb70 0x557c641de800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:45.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.560+0000 7fae137fe700 1 -- 172.21.15.45:0/4101783388 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x557c641c7710 msgr2=0x557c641a15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:45.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.560+0000 7fae137fe700 1 --2- 172.21.15.45:0/4101783388 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x557c641c7710 0x557c641a15f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:45.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.561+0000 7fae137fe700 1 -- 172.21.15.45:0/4101783388 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557c641dbb70 msgr2=0x557c641de800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:45.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.561+0000 7fae137fe700 1 --2- 172.21.15.45:0/4101783388 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557c641dbb70 0x557c641de800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:45.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.561+0000 7fae137fe700 1 -- 172.21.15.45:0/4101783388 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557c640b8390 con 0x557c64194dd0 2023-11-28T12:09:45.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.561+0000 7fae13fff700 1 --2- 172.21.15.45:0/4101783388 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557c641dbb70 0x557c641de800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:09:45.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.561+0000 7fae137fe700 1 --2- 172.21.15.45:0/4101783388 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557c64194dd0 0x557c641c62b0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fae04022000 tx=0x7fae04016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b47115c606f1086 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:45.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.561+0000 7fadf9ffb700 1 -- 172.21.15.45:0/4101783388 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae04031070 con 0x557c64194dd0 2023-11-28T12:09:45.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.561+0000 7fadf9ffb700 1 -- 172.21.15.45:0/4101783388 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae04032040 con 0x557c64194dd0 2023-11-28T12:09:45.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.561+0000 7fadf9ffb700 1 -- 172.21.15.45:0/4101783388 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae04025040 con 0x557c64194dd0 2023-11-28T12:09:45.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.562+0000 7fae2d483b80 1 -- 172.21.15.45:0/4101783388 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557c64194dd0 msgr2=0x557c641c62b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:45.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.562+0000 7fae2d483b80 1 --2- 172.21.15.45:0/4101783388 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557c64194dd0 0x557c641c62b0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fae04022000 tx=0x7fae04016000 comp rx=0 tx=0).stop 2023-11-28T12:09:45.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.562+0000 7fae2d483b80 1 -- 172.21.15.45:0/4101783388 shutdown_connections 2023-11-28T12:09:45.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.562+0000 7fae2d483b80 1 --2- 172.21.15.45:0/4101783388 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557c641dbb70 0x557c641de800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:45.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.562+0000 7fae2d483b80 1 --2- 172.21.15.45:0/4101783388 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557c64194dd0 0x557c641c62b0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:45.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.562+0000 7fae2d483b80 1 --2- 172.21.15.45:0/4101783388 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x557c641c7710 0x557c641a15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:45.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.562+0000 7fae2d483b80 1 -- 172.21.15.45:0/4101783388 >> 172.21.15.45:0/4101783388 conn(0x557c641e1610 msgr2=0x557c6419f610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:45.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.562+0000 7fae2d483b80 1 -- 172.21.15.45:0/4101783388 shutdown_connections 2023-11-28T12:09:45.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.562+0000 7fae2d483b80 1 -- 172.21.15.45:0/4101783388 wait complete. 2023-11-28T12:09:45.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.562+0000 7fae2d483b80 1 -- start start 2023-11-28T12:09:45.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.563+0000 7fae2d483b80 1 Processor -- start 2023-11-28T12:09:45.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.564+0000 7fae2d483b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557c64194dd0 0x557c64243a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:45.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.564+0000 7fae2d483b80 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x557c641c7710 0x557c64203780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:45.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.564+0000 7fae2d483b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557c641dbb70 0x557c641de890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:45.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.564+0000 7fae2d483b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c641e01d0 con 0x557c64194dd0 2023-11-28T12:09:45.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.564+0000 7fae2d483b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c64204190 con 0x557c641dbb70 2023-11-28T12:09:45.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.564+0000 7fae2d483b80 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x557c641db890 con 0x557c641c7710 2023-11-28T12:09:45.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.564+0000 7fae2d483b80 10 client.0 _ll_register_callbacks cb 0x557c6408f4b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T12:09:45.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.564+0000 7fae137fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557c64194dd0 0x557c64243a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:45.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.564+0000 7fae137fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557c64194dd0 0x557c64243a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51626/0 (socket says 172.21.15.45:51626) 2023-11-28T12:09:45.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.564+0000 7fae137fe700 1 -- 172.21.15.45:0/2474580730 learned_addr learned my addr 172.21.15.45:0/2474580730 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:09:45.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.564+0000 7fae12ffd700 1 --2- 172.21.15.45:0/2474580730 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x557c641c7710 0x557c64203780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:45.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.564+0000 7fae13fff700 1 --2- 172.21.15.45:0/2474580730 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557c641dbb70 0x557c641de890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:45.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.564+0000 7fae137fe700 1 -- 172.21.15.45:0/2474580730 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x557c641c7710 msgr2=0x557c64203780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:45.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.564+0000 7fae137fe700 1 --2- 172.21.15.45:0/2474580730 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x557c641c7710 0x557c64203780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:45.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.564+0000 7fae137fe700 1 -- 172.21.15.45:0/2474580730 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557c641dbb70 msgr2=0x557c641de890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:45.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.564+0000 7fae137fe700 1 --2- 172.21.15.45:0/2474580730 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557c641dbb70 0x557c641de890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:45.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.564+0000 7fae137fe700 1 -- 172.21.15.45:0/2474580730 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557c63ee5840 con 0x557c64194dd0 2023-11-28T12:09:45.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.564+0000 7fae12ffd700 1 --2- 172.21.15.45:0/2474580730 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x557c641c7710 0x557c64203780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:09:45.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.564+0000 7fae13fff700 1 --2- 172.21.15.45:0/2474580730 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557c641dbb70 0x557c641de890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:09:45.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.564+0000 7fae137fe700 1 --2- 172.21.15.45:0/2474580730 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557c64194dd0 0x557c64243a60 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fae04011f00 tx=0x7fae040047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7807c2b2aae1a41c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:45.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.564+0000 7fadf27fc700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-11-28T12:09:45.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.565+0000 7fadf27fc700 1 -- 172.21.15.45:0/2474580730 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae04025030 con 0x557c64194dd0 2023-11-28T12:09:45.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.565+0000 7fadf27fc700 1 -- 172.21.15.45:0/2474580730 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(61..61 src has 1..61) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fae040038a0 con 0x557c64194dd0 2023-11-28T12:09:45.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.565+0000 7fae2d483b80 1 -- 172.21.15.45:0/2474580730 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fae04005a20 con 0x557c64194dd0 2023-11-28T12:09:45.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.565+0000 7fadf27fc700 1 -- 172.21.15.45:0/2474580730 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fae04031070 con 0x557c64194dd0 2023-11-28T12:09:45.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.565+0000 7fae2d483b80 10 client.6165 fetch_fsmap learned FSMap version 32 2023-11-28T12:09:45.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.565+0000 7fae2d483b80 1 -- 172.21.15.45:0/2474580730 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x557c63f46280 con 0x557c64194dd0 2023-11-28T12:09:45.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.565+0000 7fadf27fc700 1 -- 172.21.15.45:0/2474580730 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae04005a20 con 0x557c64194dd0 2023-11-28T12:09:45.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.565+0000 7fadf27fc700 1 -- 172.21.15.45:0/2474580730 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 32) v1 ==== 3106+0+0 (secure 0 0 0) 0x7fae04003a60 con 0x557c64194dd0 2023-11-28T12:09:45.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.565+0000 7fae2d483b80 10 client.6165 fetch_fsmap finished waiting for FSMap version 32 2023-11-28T12:09:45.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.565+0000 7fae2d483b80 10 client.6165 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.c 2023-11-28T12:09:45.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.565+0000 7fae2d483b80 20 client.6165 populate_metadata read hostname 'smithi045' 2023-11-28T12:09:45.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.565+0000 7fae2d483b80 1 --2- 172.21.15.45:0/2474580730 >> [v2:172.21.15.45:6832/3784258337,v1:172.21.15.45:6833/3784258337] conn(0x557c641e5000 0x557c642014b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:45.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.565+0000 7fae2d483b80 4 client.6165 mds_command: new command op to 5979 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["recursive"]}] 2023-11-28T12:09:45.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.565+0000 7fae2d483b80 1 -- 172.21.15.45:0/2474580730 --> [v2:172.21.15.45:6832/3784258337,v1:172.21.15.45:6833/3784258337] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["recursive"]}) v1 -- 0x557c63f760f0 con 0x557c641e5000 2023-11-28T12:09:45.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.566+0000 7fae12ffd700 1 --2- 172.21.15.45:0/2474580730 >> [v2:172.21.15.45:6832/3784258337,v1:172.21.15.45:6833/3784258337] conn(0x557c641e5000 0x557c642014b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:45.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.566+0000 7fae12ffd700 1 --2- 172.21.15.45:0/2474580730 >> [v2:172.21.15.45:6832/3784258337,v1:172.21.15.45:6833/3784258337] conn(0x557c641e5000 0x557c642014b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=522df08ac3600413 server_cookie=17263c7d42020e2d in_seq=0 out_seq=0 2023-11-28T12:09:45.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.566+0000 7fadf27fc700 10 client.6165 ms_handle_connect on v2:172.21.15.45:6832/3784258337 2023-11-28T12:09:45.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.567+0000 7fadf27fc700 1 -- 172.21.15.45:0/2474580730 <== mds.0 v2:172.21.15.45:6832/3784258337 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x557c63f760f0 con 0x557c641e5000 2023-11-28T12:09:45.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.567+0000 7fadf27fc700 10 client.6165 handle_command_reply: tid=0 2023-11-28T12:09:45.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.567+0000 7fae2d483b80 1 client.6165 shutdown 2023-11-28T12:09:45.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.567+0000 7fae2d483b80 1 -- 172.21.15.45:0/2474580730 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557c64194dd0 msgr2=0x557c64243a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:45.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.567+0000 7fae2d483b80 1 --2- 172.21.15.45:0/2474580730 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557c64194dd0 0x557c64243a60 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fae04011f00 tx=0x7fae040047c0 comp rx=0 tx=0).stop 2023-11-28T12:09:45.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.567+0000 7fae2d483b80 1 -- 172.21.15.45:0/2474580730 shutdown_connections 2023-11-28T12:09:45.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.567+0000 7fae2d483b80 1 --2- 172.21.15.45:0/2474580730 >> [v2:172.21.15.45:6832/3784258337,v1:172.21.15.45:6833/3784258337] conn(0x557c641e5000 0x557c642014b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:45.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.567+0000 7fae2d483b80 1 --2- 172.21.15.45:0/2474580730 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x557c641dbb70 0x557c641de890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:45.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.567+0000 7fae2d483b80 1 --2- 172.21.15.45:0/2474580730 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557c64194dd0 0x557c64243a60 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:45.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.567+0000 7fae2d483b80 1 --2- 172.21.15.45:0/2474580730 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x557c641c7710 0x557c64203780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:45.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.567+0000 7fae2d483b80 1 -- 172.21.15.45:0/2474580730 >> 172.21.15.45:0/2474580730 conn(0x557c641e1610 msgr2=0x557c6419a0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:45.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.567+0000 7fadf27fc700 0 client.6165 ms_handle_reset on v2:172.21.15.45:6832/3784258337 2023-11-28T12:09:45.574 INFO:tasks.ceph.mds.c.smithi045.stderr:2023-11-28T12:09:45.567+0000 7fc27ddea700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /dir_test/file auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={5950=0-4194304@1} caps={5950=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=5950 | request=0 caps=1 dirtyparent=0 dirty=0 authpin=1 scrubqueue=0 0x55b67b17d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(10)0x10000000001:[<0x10000000000/file v2>,<0x1/dir_test v4>]//[]","error_str":"failed to decode on-disk backtrace (26 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-11-28T12:09:45.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.567+0000 7fae2d483b80 1 -- 172.21.15.45:0/2474580730 shutdown_connections 2023-11-28T12:09:45.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.568+0000 7fae2d483b80 1 -- 172.21.15.45:0/2474580730 wait complete. 2023-11-28T12:09:45.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.568+0000 7fae2d483b80 20 client.6165 trim_cache size 0 max 16384 2023-11-28T12:09:45.575 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-11-28T12:09:45.575 INFO:teuthology.orchestra.run.smithi045.stdout: "return_code": 0, 2023-11-28T12:09:45.576 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_tag": "81073e82-5230-49ee-b46b-c7c77867f3aa", 2023-11-28T12:09:45.576 INFO:teuthology.orchestra.run.smithi045.stdout: "mode": "asynchronous" 2023-11-28T12:09:45.576 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-11-28T12:09:45.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.568+0000 7fae19bff700 1 -- 172.21.15.45:0/1246541231 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fae000682f0 msgr2=0x7fae0006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:45.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.568+0000 7fae19bff700 1 --2- 172.21.15.45:0/1246541231 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fae000682f0 0x7fae0006a7a0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fae04006b20 tx=0x7fae04008040 comp rx=0 tx=0).stop 2023-11-28T12:09:45.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.568+0000 7fae19bff700 1 -- 172.21.15.45:0/1246541231 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fae1415dc30 msgr2=0x7fae141f5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:45.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.568+0000 7fae19bff700 1 --2- 172.21.15.45:0/1246541231 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fae1415dc30 0x7fae141f5c20 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fae0c007df0 tx=0x7fae0c00d3b0 comp rx=0 tx=0).stop 2023-11-28T12:09:45.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.568+0000 7fae19bff700 1 -- 172.21.15.45:0/1246541231 shutdown_connections 2023-11-28T12:09:45.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.568+0000 7fae19bff700 1 --2- 172.21.15.45:0/1246541231 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fae000682f0 0x7fae0006a7a0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:45.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.568+0000 7fae19bff700 1 --2- 172.21.15.45:0/1246541231 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae140cd7c0 0x7fae1414b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:45.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.568+0000 7fae19bff700 1 --2- 172.21.15.45:0/1246541231 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fae1415dc30 0x7fae141f5c20 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:45.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.568+0000 7fae19bff700 1 --2- 172.21.15.45:0/1246541231 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fae1415a760 0x7fae140b89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:45.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.568+0000 7fae19bff700 1 -- 172.21.15.45:0/1246541231 >> 172.21.15.45:0/1246541231 conn(0x7fae14072620 msgr2=0x7fae1415fb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:45.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.569+0000 7fae19bff700 1 -- 172.21.15.45:0/1246541231 shutdown_connections 2023-11-28T12:09:45.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.569+0000 7fae19bff700 1 -- 172.21.15.45:0/1246541231 wait complete. 2023-11-28T12:09:45.587 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:0 scrub status 2023-11-28T12:09:45.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.791+0000 7f5113fff700 1 Processor -- start 2023-11-28T12:09:45.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.791+0000 7f5113fff700 1 -- start start 2023-11-28T12:09:45.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.793+0000 7f5113fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f510c161340 0x7f510c0d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:45.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.793+0000 7f5113fff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f510c0d2320 0x7f510c0cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:45.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.793+0000 7f5113fff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f510c0d1950 con 0x7f510c15c9b0 2023-11-28T12:09:45.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.793+0000 7f5113fff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f510c0b5800 con 0x7f510c161340 2023-11-28T12:09:45.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.793+0000 7f5113fff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f510c0b5300 con 0x7f510c0d2320 2023-11-28T12:09:45.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.793+0000 7f511159a700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f510c161340 0x7f510c0d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:45.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.793+0000 7f5111d9b700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f510c15c9b0 0x7f510c0b4bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:52570/0 (socket says 172.21.15.45:52570) 2023-11-28T12:09:45.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.793+0000 7f5111d9b700 1 -- 172.21.15.45:0/2237029667 learned_addr learned my addr 172.21.15.45:0/2237029667 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:09:45.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.793+0000 7f511259c700 1 --2- 172.21.15.45:0/2237029667 >> v2:172.21.15.152:3300/0 conn(0x7f510c0d2320 0x7f510c0cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:45.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.793+0000 7f511159a700 1 -- 172.21.15.45:0/2237029667 >> v2:172.21.15.152:3300/0 conn(0x7f510c0d2320 msgr2=0x7f510c0cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:45.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.793+0000 7f511159a700 1 --2- 172.21.15.45:0/2237029667 >> v2:172.21.15.152:3300/0 conn(0x7f510c0d2320 0x7f510c0cd7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:45.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.793+0000 7f511159a700 1 -- 172.21.15.45:0/2237029667 >> v1:172.21.15.45:6789/0 conn(0x7f510c15c9b0 legacy=0x7f510c0b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:45.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.793+0000 7f511159a700 1 -- 172.21.15.45:0/2237029667 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f510c0b5520 con 0x7f510c161340 2023-11-28T12:09:45.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.793+0000 7f5110d99700 1 -- 172.21.15.45:0/2237029667 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2836771114 0 0) 0x7f510c0d1950 con 0x7f510c15c9b0 2023-11-28T12:09:45.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.794+0000 7f511159a700 1 --2- 172.21.15.45:0/2237029667 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f510c161340 0x7f510c0d1de0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f510c06c170 tx=0x7f50fc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bff2dd12c35d16e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:45.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.794+0000 7f5110d99700 1 -- 172.21.15.45:0/2237029667 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50fc011830 con 0x7f510c161340 2023-11-28T12:09:45.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.794+0000 7f5110d99700 1 -- 172.21.15.45:0/2237029667 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50fc011990 con 0x7f510c161340 2023-11-28T12:09:45.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.794+0000 7f5110d99700 1 -- 172.21.15.45:0/2237029667 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50fc011d20 con 0x7f510c161340 2023-11-28T12:09:45.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.794+0000 7f5113fff700 1 -- 172.21.15.45:0/2237029667 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f510c161340 msgr2=0x7f510c0d1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:45.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.794+0000 7f5113fff700 1 --2- 172.21.15.45:0/2237029667 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f510c161340 0x7f510c0d1de0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f510c06c170 tx=0x7f50fc009b50 comp rx=0 tx=0).stop 2023-11-28T12:09:45.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.795+0000 7f5113fff700 1 -- 172.21.15.45:0/2237029667 shutdown_connections 2023-11-28T12:09:45.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.795+0000 7f5113fff700 1 --2- 172.21.15.45:0/2237029667 >> v2:172.21.15.152:3300/0 conn(0x7f510c0d2320 0x7f510c0cd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:45.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.795+0000 7f5113fff700 1 --2- 172.21.15.45:0/2237029667 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f510c161340 0x7f510c0d1de0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:45.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.795+0000 7f5113fff700 1 -- 172.21.15.45:0/2237029667 >> 172.21.15.45:0/2237029667 conn(0x7f510c072600 msgr2=0x7f510c0cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:45.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.795+0000 7f5113fff700 1 -- 172.21.15.45:0/2237029667 shutdown_connections 2023-11-28T12:09:45.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.795+0000 7f5113fff700 1 -- 172.21.15.45:0/2237029667 wait complete. 2023-11-28T12:09:45.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.797+0000 7f5113fff700 1 Processor -- start 2023-11-28T12:09:45.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.797+0000 7f5113fff700 1 -- start start 2023-11-28T12:09:45.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.798+0000 7f5113fff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f510c0d2320 0x7f510c0c80a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:45.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.798+0000 7f5113fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f510c15c9b0 0x7f510c0b7d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:45.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.799+0000 7f5113fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f510c161340 0x7f510c0b8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:45.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.799+0000 7f5113fff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f510c0c7980 con 0x7f510c161340 2023-11-28T12:09:45.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.799+0000 7f5113fff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f510c0c6d40 con 0x7f510c15c9b0 2023-11-28T12:09:45.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.799+0000 7f5113fff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f510c0c6fe0 con 0x7f510c0d2320 2023-11-28T12:09:45.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.799+0000 7f511259c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f510c161340 0x7f510c0b8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:45.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.799+0000 7f511259c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f510c161340 0x7f510c0b8260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51654/0 (socket says 172.21.15.45:51654) 2023-11-28T12:09:45.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.799+0000 7f511259c700 1 -- 172.21.15.45:0/1679702112 learned_addr learned my addr 172.21.15.45:0/1679702112 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:09:45.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.799+0000 7f5111d9b700 1 --2- 172.21.15.45:0/1679702112 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f510c0d2320 0x7f510c0c80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:45.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.799+0000 7f511159a700 1 --2- 172.21.15.45:0/1679702112 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f510c15c9b0 0x7f510c0b7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:45.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.799+0000 7f511259c700 1 -- 172.21.15.45:0/1679702112 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f510c0d2320 msgr2=0x7f510c0c80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:45.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.799+0000 7f511259c700 1 --2- 172.21.15.45:0/1679702112 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f510c0d2320 0x7f510c0c80a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:45.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.799+0000 7f511259c700 1 -- 172.21.15.45:0/1679702112 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f510c15c9b0 msgr2=0x7f510c0b7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:45.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.799+0000 7f511259c700 1 --2- 172.21.15.45:0/1679702112 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f510c15c9b0 0x7f510c0b7d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:45.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.799+0000 7f511259c700 1 -- 172.21.15.45:0/1679702112 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50fc0094a0 con 0x7f510c161340 2023-11-28T12:09:45.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.799+0000 7f511159a700 1 --2- 172.21.15.45:0/1679702112 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f510c15c9b0 0x7f510c0b7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:09:45.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.799+0000 7f5111d9b700 1 --2- 172.21.15.45:0/1679702112 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f510c0d2320 0x7f510c0c80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:09:45.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.799+0000 7f511259c700 1 --2- 172.21.15.45:0/1679702112 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f510c161340 0x7f510c0b8260 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f5104009fd0 tx=0x7f510400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:45.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.800+0000 7f51027fc700 1 -- 172.21.15.45:0/1679702112 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f510400ede0 con 0x7f510c161340 2023-11-28T12:09:45.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.800+0000 7f51027fc700 1 -- 172.21.15.45:0/1679702112 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5104014420 con 0x7f510c161340 2023-11-28T12:09:45.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.800+0000 7f51027fc700 1 -- 172.21.15.45:0/1679702112 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51040147d0 con 0x7f510c161340 2023-11-28T12:09:45.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.800+0000 7f5113fff700 1 -- 172.21.15.45:0/1679702112 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f510c0d15e0 con 0x7f510c161340 2023-11-28T12:09:45.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.800+0000 7f5113fff700 1 -- 172.21.15.45:0/1679702112 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f510c0d1300 con 0x7f510c161340 2023-11-28T12:09:45.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.802+0000 7f51027fc700 1 -- 172.21.15.45:0/1679702112 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f5104012050 con 0x7f510c161340 2023-11-28T12:09:45.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.803+0000 7f51027fc700 1 --2- 172.21.15.45:0/1679702112 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f50f00682f0 0x7f50f006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:45.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.803+0000 7f51027fc700 1 -- 172.21.15.45:0/1679702112 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f51040863a0 con 0x7f510c161340 2023-11-28T12:09:45.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.803+0000 7f5111d9b700 1 --2- 172.21.15.45:0/1679702112 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f50f00682f0 0x7f50f006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:45.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.804+0000 7f5111d9b700 1 --2- 172.21.15.45:0/1679702112 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f50f00682f0 0x7f50f006a7a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f5108007fd0 tx=0x7f5108009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:45.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.805+0000 7f5127853b80 1 Processor -- start 2023-11-28T12:09:45.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.805+0000 7f5127853b80 1 -- start start 2023-11-28T12:09:45.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.806+0000 7f5127853b80 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x565022929fa0 0x5650228e3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:45.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.806+0000 7f5127853b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565022920b10 0x56502292a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:45.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.806+0000 7f5127853b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56502290c6b0 0x5650228e4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:45.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.806+0000 7f5127853b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x565022861e30 con 0x565022920b10 2023-11-28T12:09:45.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.806+0000 7f5127853b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650227ce190 con 0x56502290c6b0 2023-11-28T12:09:45.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.806+0000 7f5127853b80 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x56502283ce00 con 0x565022929fa0 2023-11-28T12:09:45.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.806+0000 7f511159a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565022920b10 0x56502292a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:45.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.806+0000 7f511159a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565022920b10 0x56502292a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51662/0 (socket says 172.21.15.45:51662) 2023-11-28T12:09:45.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.806+0000 7f511159a700 1 -- 172.21.15.45:0/2201970116 learned_addr learned my addr 172.21.15.45:0/2201970116 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:09:45.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.806+0000 7f511259c700 1 --2- 172.21.15.45:0/2201970116 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56502290c6b0 0x5650228e4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:45.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.806+0000 7f5111d9b700 1 --2- 172.21.15.45:0/2201970116 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x565022929fa0 0x5650228e3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:45.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.806+0000 7f511159a700 1 -- 172.21.15.45:0/2201970116 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x565022929fa0 msgr2=0x5650228e3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:45.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.807+0000 7f511159a700 1 --2- 172.21.15.45:0/2201970116 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x565022929fa0 0x5650228e3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:45.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.807+0000 7f511159a700 1 -- 172.21.15.45:0/2201970116 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56502290c6b0 msgr2=0x5650228e4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:45.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.807+0000 7f511159a700 1 --2- 172.21.15.45:0/2201970116 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56502290c6b0 0x5650228e4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:45.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.807+0000 7f511159a700 1 -- 172.21.15.45:0/2201970116 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56502262a7e0 con 0x565022920b10 2023-11-28T12:09:45.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.807+0000 7f511159a700 1 --2- 172.21.15.45:0/2201970116 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565022920b10 0x56502292a370 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f50fc013000 tx=0x7f50fc008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b2b2ca532545855 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:45.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.807+0000 7f50ef7fe700 1 -- 172.21.15.45:0/2201970116 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50fc0116b0 con 0x565022920b10 2023-11-28T12:09:45.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.807+0000 7f50ef7fe700 1 -- 172.21.15.45:0/2201970116 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50fc011810 con 0x565022920b10 2023-11-28T12:09:45.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.807+0000 7f50ef7fe700 1 -- 172.21.15.45:0/2201970116 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50fc011d00 con 0x565022920b10 2023-11-28T12:09:45.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.808+0000 7f5127853b80 1 -- 172.21.15.45:0/2201970116 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565022920b10 msgr2=0x56502292a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:45.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.808+0000 7f5127853b80 1 --2- 172.21.15.45:0/2201970116 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565022920b10 0x56502292a370 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f50fc013000 tx=0x7f50fc008030 comp rx=0 tx=0).stop 2023-11-28T12:09:45.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.808+0000 7f5127853b80 1 -- 172.21.15.45:0/2201970116 shutdown_connections 2023-11-28T12:09:45.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.808+0000 7f5127853b80 1 --2- 172.21.15.45:0/2201970116 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56502290c6b0 0x5650228e4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:45.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.808+0000 7f5127853b80 1 --2- 172.21.15.45:0/2201970116 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x565022929fa0 0x5650228e3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:45.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.808+0000 7f5127853b80 1 --2- 172.21.15.45:0/2201970116 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565022920b10 0x56502292a370 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:45.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.808+0000 7f5127853b80 1 -- 172.21.15.45:0/2201970116 >> 172.21.15.45:0/2201970116 conn(0x5650228d9d70 msgr2=0x5650228e2f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:45.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.808+0000 7f5127853b80 1 -- 172.21.15.45:0/2201970116 shutdown_connections 2023-11-28T12:09:45.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.808+0000 7f5127853b80 1 -- 172.21.15.45:0/2201970116 wait complete. 2023-11-28T12:09:45.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.809+0000 7f5127853b80 1 -- start start 2023-11-28T12:09:45.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.809+0000 7f5127853b80 1 Processor -- start 2023-11-28T12:09:45.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.810+0000 7f5127853b80 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x56502290c6b0 0x565022907840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:45.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.810+0000 7f5127853b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565022920b10 0x565022925100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:45.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.810+0000 7f5127853b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565022929fa0 0x565022920f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:45.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.810+0000 7f5127853b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x565022836170 con 0x565022929fa0 2023-11-28T12:09:45.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.810+0000 7f5127853b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x56502262b3e0 con 0x565022920b10 2023-11-28T12:09:45.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.810+0000 7f5127853b80 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x5650227ce390 con 0x56502290c6b0 2023-11-28T12:09:45.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.810+0000 7f5127853b80 10 client.0 _ll_register_callbacks cb 0x5650227d4450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T12:09:45.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.810+0000 7f511259c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565022929fa0 0x565022920f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:45.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.810+0000 7f5111d9b700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x56502290c6b0 0x565022907840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:45.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.810+0000 7f511159a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565022920b10 0x565022925100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:45.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.810+0000 7f511259c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565022929fa0 0x565022920f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51664/0 (socket says 172.21.15.45:51664) 2023-11-28T12:09:45.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.810+0000 7f511259c700 1 -- 172.21.15.45:0/972389285 learned_addr learned my addr 172.21.15.45:0/972389285 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:09:45.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.811+0000 7f511259c700 1 -- 172.21.15.45:0/972389285 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x56502290c6b0 msgr2=0x565022907840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:45.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.811+0000 7f511259c700 1 --2- 172.21.15.45:0/972389285 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x56502290c6b0 0x565022907840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:45.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.811+0000 7f511259c700 1 -- 172.21.15.45:0/972389285 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565022920b10 msgr2=0x565022925100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:45.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.811+0000 7f511259c700 1 --2- 172.21.15.45:0/972389285 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565022920b10 0x565022925100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:45.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.811+0000 7f511259c700 1 -- 172.21.15.45:0/972389285 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f510c0b5520 con 0x565022929fa0 2023-11-28T12:09:45.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.811+0000 7f511259c700 1 --2- 172.21.15.45:0/972389285 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565022929fa0 0x565022920f80 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f510405e330 tx=0x7f510405e860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbf9a7e83719a2c7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:45.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.811+0000 7f50ecff9700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-11-28T12:09:45.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.811+0000 7f50ecff9700 1 -- 172.21.15.45:0/972389285 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f510405e5d0 con 0x565022929fa0 2023-11-28T12:09:45.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.811+0000 7f50ecff9700 1 -- 172.21.15.45:0/972389285 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(61..61 src has 1..61) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f510405c0c0 con 0x565022929fa0 2023-11-28T12:09:45.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.811+0000 7f5127853b80 1 -- 172.21.15.45:0/972389285 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x565022685f40 con 0x565022929fa0 2023-11-28T12:09:45.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.811+0000 7f50ecff9700 1 -- 172.21.15.45:0/972389285 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f510405c280 con 0x565022929fa0 2023-11-28T12:09:45.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.811+0000 7f5127853b80 10 client.6180 fetch_fsmap learned FSMap version 32 2023-11-28T12:09:45.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.812+0000 7f5127853b80 1 -- 172.21.15.45:0/972389285 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x5650227170f0 con 0x565022929fa0 2023-11-28T12:09:45.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.812+0000 7f50ecff9700 1 -- 172.21.15.45:0/972389285 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5104062070 con 0x565022929fa0 2023-11-28T12:09:45.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.812+0000 7f50ecff9700 1 -- 172.21.15.45:0/972389285 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 32) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f5104057b60 con 0x565022929fa0 2023-11-28T12:09:45.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.812+0000 7f5127853b80 10 client.6180 fetch_fsmap finished waiting for FSMap version 32 2023-11-28T12:09:45.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.812+0000 7f5127853b80 10 client.6180 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.c 2023-11-28T12:09:45.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.812+0000 7f5127853b80 20 client.6180 populate_metadata read hostname 'smithi045' 2023-11-28T12:09:45.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.812+0000 7f5127853b80 1 --2- 172.21.15.45:0/972389285 >> [v2:172.21.15.45:6832/3784258337,v1:172.21.15.45:6833/3784258337] conn(0x565022939b60 0x5650229260d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:45.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.812+0000 7f5127853b80 4 client.6180 mds_command: new command op to 5979 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-28T12:09:45.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.812+0000 7f5127853b80 1 -- 172.21.15.45:0/972389285 --> [v2:172.21.15.45:6832/3784258337,v1:172.21.15.45:6833/3784258337] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5650226bb090 con 0x565022939b60 2023-11-28T12:09:45.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.812+0000 7f5111d9b700 1 --2- 172.21.15.45:0/972389285 >> [v2:172.21.15.45:6832/3784258337,v1:172.21.15.45:6833/3784258337] conn(0x565022939b60 0x5650229260d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:45.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.813+0000 7f5111d9b700 1 --2- 172.21.15.45:0/972389285 >> [v2:172.21.15.45:6832/3784258337,v1:172.21.15.45:6833/3784258337] conn(0x565022939b60 0x5650229260d0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4471c2e9ffa36fb server_cookie=df9dd412e7287c5b in_seq=0 out_seq=0 2023-11-28T12:09:45.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.813+0000 7f50ecff9700 10 client.6180 ms_handle_connect on v2:172.21.15.45:6832/3784258337 2023-11-28T12:09:45.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.813+0000 7f50ecff9700 1 -- 172.21.15.45:0/972389285 <== mds.0 v2:172.21.15.45:6832/3784258337 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x5650226bb090 con 0x565022939b60 2023-11-28T12:09:45.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.813+0000 7f50ecff9700 10 client.6180 handle_command_reply: tid=0 2023-11-28T12:09:45.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.813+0000 7f5127853b80 1 client.6180 shutdown 2023-11-28T12:09:45.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.814+0000 7f5127853b80 1 -- 172.21.15.45:0/972389285 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565022929fa0 msgr2=0x565022920f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:45.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.814+0000 7f5127853b80 1 --2- 172.21.15.45:0/972389285 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565022929fa0 0x565022920f80 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f510405e330 tx=0x7f510405e860 comp rx=0 tx=0).stop 2023-11-28T12:09:45.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.814+0000 7f5127853b80 1 -- 172.21.15.45:0/972389285 shutdown_connections 2023-11-28T12:09:45.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.814+0000 7f5127853b80 1 --2- 172.21.15.45:0/972389285 >> [v2:172.21.15.45:6832/3784258337,v1:172.21.15.45:6833/3784258337] conn(0x565022939b60 0x5650229260d0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:45.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.814+0000 7f5127853b80 1 --2- 172.21.15.45:0/972389285 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565022929fa0 0x565022920f80 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:45.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.814+0000 7f5127853b80 1 --2- 172.21.15.45:0/972389285 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x56502290c6b0 0x565022907840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:45.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.814+0000 7f5127853b80 1 --2- 172.21.15.45:0/972389285 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565022920b10 0x565022925100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:45.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.814+0000 7f5127853b80 1 -- 172.21.15.45:0/972389285 >> 172.21.15.45:0/972389285 conn(0x5650228d9d70 msgr2=0x56502290bcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:45.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.814+0000 7f50ecff9700 0 client.6180 ms_handle_reset on v2:172.21.15.45:6832/3784258337 2023-11-28T12:09:45.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.814+0000 7f5127853b80 1 -- 172.21.15.45:0/972389285 shutdown_connections 2023-11-28T12:09:45.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.814+0000 7f5127853b80 1 -- 172.21.15.45:0/972389285 wait complete. 2023-11-28T12:09:45.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.814+0000 7f5127853b80 20 client.6180 trim_cache size 0 max 16384 2023-11-28T12:09:45.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.831+0000 7f5127853b80 1 Processor -- start 2023-11-28T12:09:45.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.831+0000 7f5127853b80 1 -- start start 2023-11-28T12:09:45.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.832+0000 7f5127853b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56502290c6b0 0x5650229383c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:45.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.833+0000 7f5127853b80 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x565022920b10 0x565022923090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:45.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.833+0000 7f5127853b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565022929fa0 0x5650229202a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:45.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.833+0000 7f5127853b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650228e09e0 con 0x565022929fa0 2023-11-28T12:09:45.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.833+0000 7f5127853b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x565022939fd0 con 0x56502290c6b0 2023-11-28T12:09:45.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.833+0000 7f5127853b80 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x5650228df000 con 0x565022920b10 2023-11-28T12:09:45.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.833+0000 7f511259c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565022929fa0 0x5650229202a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:45.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.833+0000 7f511259c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565022929fa0 0x5650229202a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51680/0 (socket says 172.21.15.45:51680) 2023-11-28T12:09:45.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.833+0000 7f511259c700 1 -- 172.21.15.45:0/3178731818 learned_addr learned my addr 172.21.15.45:0/3178731818 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:09:45.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.833+0000 7f5111d9b700 1 --2- 172.21.15.45:0/3178731818 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56502290c6b0 0x5650229383c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:45.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.833+0000 7f511159a700 1 --2- 172.21.15.45:0/3178731818 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x565022920b10 0x565022923090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:45.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.833+0000 7f511259c700 1 -- 172.21.15.45:0/3178731818 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x565022920b10 msgr2=0x565022923090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:45.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.833+0000 7f511259c700 1 --2- 172.21.15.45:0/3178731818 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x565022920b10 0x565022923090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:45.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.833+0000 7f511259c700 1 -- 172.21.15.45:0/3178731818 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56502290c6b0 msgr2=0x5650229383c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:45.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.833+0000 7f511259c700 1 --2- 172.21.15.45:0/3178731818 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56502290c6b0 0x5650229383c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:45.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.833+0000 7f511259c700 1 -- 172.21.15.45:0/3178731818 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5650227fd330 con 0x565022929fa0 2023-11-28T12:09:45.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.833+0000 7f5111d9b700 1 --2- 172.21.15.45:0/3178731818 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56502290c6b0 0x5650229383c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:09:45.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.833+0000 7f511159a700 1 --2- 172.21.15.45:0/3178731818 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x565022920b10 0x565022923090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:09:45.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.834+0000 7f511259c700 1 --2- 172.21.15.45:0/3178731818 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565022929fa0 0x5650229202a0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f5104052cd0 tx=0x7f510405c050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c428c3878ff3989 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:45.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.834+0000 7f50effff700 1 -- 172.21.15.45:0/3178731818 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f510405e3d0 con 0x565022929fa0 2023-11-28T12:09:45.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.834+0000 7f50effff700 1 -- 172.21.15.45:0/3178731818 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5104062070 con 0x565022929fa0 2023-11-28T12:09:45.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.834+0000 7f50effff700 1 -- 172.21.15.45:0/3178731818 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f510405c0c0 con 0x565022929fa0 2023-11-28T12:09:45.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.834+0000 7f5127853b80 1 -- 172.21.15.45:0/3178731818 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565022929fa0 msgr2=0x5650229202a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:45.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.834+0000 7f5127853b80 1 --2- 172.21.15.45:0/3178731818 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565022929fa0 0x5650229202a0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f5104052cd0 tx=0x7f510405c050 comp rx=0 tx=0).stop 2023-11-28T12:09:45.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.834+0000 7f5127853b80 1 -- 172.21.15.45:0/3178731818 shutdown_connections 2023-11-28T12:09:45.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.834+0000 7f5127853b80 1 --2- 172.21.15.45:0/3178731818 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x56502290c6b0 0x5650229383c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:45.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.834+0000 7f5127853b80 1 --2- 172.21.15.45:0/3178731818 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565022929fa0 0x5650229202a0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:45.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.834+0000 7f5127853b80 1 --2- 172.21.15.45:0/3178731818 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x565022920b10 0x565022923090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:45.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.834+0000 7f5127853b80 1 -- 172.21.15.45:0/3178731818 >> 172.21.15.45:0/3178731818 conn(0x5650228d9d70 msgr2=0x565022912be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:45.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.834+0000 7f5127853b80 1 -- 172.21.15.45:0/3178731818 shutdown_connections 2023-11-28T12:09:45.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.834+0000 7f5127853b80 1 -- 172.21.15.45:0/3178731818 wait complete. 2023-11-28T12:09:45.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.835+0000 7f5127853b80 1 -- start start 2023-11-28T12:09:45.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.835+0000 7f5127853b80 1 Processor -- start 2023-11-28T12:09:45.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.836+0000 7f5127853b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56502290c6b0 0x5650229866b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:45.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.836+0000 7f5127853b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565022920b10 0x56502290b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:45.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.836+0000 7f5127853b80 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x565022929fa0 0x565022982370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:45.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.836+0000 7f5127853b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650228e2b40 con 0x56502290c6b0 2023-11-28T12:09:45.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.836+0000 7f5127853b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x56502290bba0 con 0x565022920b10 2023-11-28T12:09:45.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.836+0000 7f5127853b80 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x565022922680 con 0x565022929fa0 2023-11-28T12:09:45.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.836+0000 7f5127853b80 10 client.0 _ll_register_callbacks cb 0x5650227d4450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T12:09:45.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.836+0000 7f5111d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56502290c6b0 0x5650229866b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:45.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.837+0000 7f5111d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56502290c6b0 0x5650229866b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51696/0 (socket says 172.21.15.45:51696) 2023-11-28T12:09:45.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.837+0000 7f5111d9b700 1 -- 172.21.15.45:0/429142780 learned_addr learned my addr 172.21.15.45:0/429142780 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:09:45.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.837+0000 7f511259c700 1 --2- 172.21.15.45:0/429142780 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x565022929fa0 0x565022982370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:45.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.837+0000 7f511159a700 1 --2- 172.21.15.45:0/429142780 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565022920b10 0x56502290b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:45.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.837+0000 7f5111d9b700 1 -- 172.21.15.45:0/429142780 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x565022929fa0 msgr2=0x565022982370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:45.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.837+0000 7f5111d9b700 1 --2- 172.21.15.45:0/429142780 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x565022929fa0 0x565022982370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:45.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.837+0000 7f5111d9b700 1 -- 172.21.15.45:0/429142780 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565022920b10 msgr2=0x56502290b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:09:45.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.837+0000 7f5111d9b700 1 --2- 172.21.15.45:0/429142780 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565022920b10 0x56502290b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:45.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.837+0000 7f5111d9b700 1 -- 172.21.15.45:0/429142780 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5650227170f0 con 0x56502290c6b0 2023-11-28T12:09:45.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.837+0000 7f5111d9b700 1 --2- 172.21.15.45:0/429142780 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56502290c6b0 0x5650229866b0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x56502293a450 tx=0x7f5108010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b397d3821b216efc server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:09:45.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.837+0000 7f50ecff9700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-11-28T12:09:45.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.837+0000 7f50ecff9700 1 -- 172.21.15.45:0/429142780 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51080076c0 con 0x56502290c6b0 2023-11-28T12:09:45.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.837+0000 7f50ecff9700 1 -- 172.21.15.45:0/429142780 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(61..61 src has 1..61) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f51080269c0 con 0x56502290c6b0 2023-11-28T12:09:45.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.837+0000 7f5127853b80 1 -- 172.21.15.45:0/429142780 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56502283a080 con 0x56502290c6b0 2023-11-28T12:09:45.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.838+0000 7f50ecff9700 1 -- 172.21.15.45:0/429142780 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5108026b80 con 0x56502290c6b0 2023-11-28T12:09:45.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.838+0000 7f5127853b80 10 client.6186 fetch_fsmap learned FSMap version 32 2023-11-28T12:09:45.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.838+0000 7f5127853b80 1 -- 172.21.15.45:0/429142780 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x56502268b220 con 0x56502290c6b0 2023-11-28T12:09:45.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.838+0000 7f50ecff9700 1 -- 172.21.15.45:0/429142780 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56502283a080 con 0x56502290c6b0 2023-11-28T12:09:45.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.838+0000 7f50ecff9700 1 -- 172.21.15.45:0/429142780 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 32) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f510801f070 con 0x56502290c6b0 2023-11-28T12:09:45.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.838+0000 7f5127853b80 10 client.6186 fetch_fsmap finished waiting for FSMap version 32 2023-11-28T12:09:45.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.838+0000 7f5127853b80 10 client.6186 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.c 2023-11-28T12:09:45.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.838+0000 7f5127853b80 20 client.6186 populate_metadata read hostname 'smithi045' 2023-11-28T12:09:45.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.838+0000 7f5127853b80 1 --2- 172.21.15.45:0/429142780 >> [v2:172.21.15.45:6832/3784258337,v1:172.21.15.45:6833/3784258337] conn(0x5650228e12d0 0x5650229828b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:09:45.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.838+0000 7f5127853b80 4 client.6186 mds_command: new command op to 5979 tid=0[{"prefix": "scrub status"}] 2023-11-28T12:09:45.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.838+0000 7f5127853b80 1 -- 172.21.15.45:0/429142780 --> [v2:172.21.15.45:6832/3784258337,v1:172.21.15.45:6833/3784258337] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x565022778410 con 0x5650228e12d0 2023-11-28T12:09:45.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.838+0000 7f511159a700 1 --2- 172.21.15.45:0/429142780 >> [v2:172.21.15.45:6832/3784258337,v1:172.21.15.45:6833/3784258337] conn(0x5650228e12d0 0x5650229828b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:09:45.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.839+0000 7f511159a700 1 --2- 172.21.15.45:0/429142780 >> [v2:172.21.15.45:6832/3784258337,v1:172.21.15.45:6833/3784258337] conn(0x5650228e12d0 0x5650229828b0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cfa557e2a1c7b474 server_cookie=dd682900cd1ad0e3 in_seq=0 out_seq=0 2023-11-28T12:09:45.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.839+0000 7f50ecff9700 10 client.6186 ms_handle_connect on v2:172.21.15.45:6832/3784258337 2023-11-28T12:09:45.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.839+0000 7f50ecff9700 1 -- 172.21.15.45:0/429142780 <== mds.0 v2:172.21.15.45:6832/3784258337 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+253 (crc 0 0 0) 0x565022778410 con 0x5650228e12d0 2023-11-28T12:09:45.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.839+0000 7f50ecff9700 10 client.6186 handle_command_reply: tid=0 2023-11-28T12:09:45.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.839+0000 7f5127853b80 1 client.6186 shutdown 2023-11-28T12:09:45.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.839+0000 7f5127853b80 1 -- 172.21.15.45:0/429142780 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56502290c6b0 msgr2=0x5650229866b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:45.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.839+0000 7f5127853b80 1 --2- 172.21.15.45:0/429142780 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56502290c6b0 0x5650229866b0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x56502293a450 tx=0x7f5108010000 comp rx=0 tx=0).stop 2023-11-28T12:09:45.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.839+0000 7f5127853b80 1 -- 172.21.15.45:0/429142780 shutdown_connections 2023-11-28T12:09:45.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.839+0000 7f5127853b80 1 --2- 172.21.15.45:0/429142780 >> [v2:172.21.15.45:6832/3784258337,v1:172.21.15.45:6833/3784258337] conn(0x5650228e12d0 0x5650229828b0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:45.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.839+0000 7f5127853b80 1 --2- 172.21.15.45:0/429142780 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x565022929fa0 0x565022982370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:45.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.839+0000 7f5127853b80 1 --2- 172.21.15.45:0/429142780 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56502290c6b0 0x5650229866b0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:45.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.839+0000 7f50ecff9700 0 client.6186 ms_handle_reset on v2:172.21.15.45:6832/3784258337 2023-11-28T12:09:45.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.839+0000 7f5127853b80 1 --2- 172.21.15.45:0/429142780 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x565022920b10 0x56502290b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:45.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.839+0000 7f5127853b80 1 -- 172.21.15.45:0/429142780 >> 172.21.15.45:0/429142780 conn(0x5650228d9d70 msgr2=0x5650229219b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:45.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.839+0000 7f5127853b80 1 -- 172.21.15.45:0/429142780 shutdown_connections 2023-11-28T12:09:45.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.839+0000 7f5127853b80 1 -- 172.21.15.45:0/429142780 wait complete. 2023-11-28T12:09:45.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.840+0000 7f5127853b80 20 client.6186 trim_cache size 0 max 16384 2023-11-28T12:09:45.845 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-11-28T12:09:45.846 INFO:teuthology.orchestra.run.smithi045.stdout: "status": "IDLE (waiting for more scrubs)", 2023-11-28T12:09:45.846 INFO:teuthology.orchestra.run.smithi045.stdout: "scrubs": { 2023-11-28T12:09:45.846 INFO:teuthology.orchestra.run.smithi045.stdout: "81073e82-5230-49ee-b46b-c7c77867f3aa": { 2023-11-28T12:09:45.846 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/", 2023-11-28T12:09:45.846 INFO:teuthology.orchestra.run.smithi045.stdout: "tag": "81073e82-5230-49ee-b46b-c7c77867f3aa", 2023-11-28T12:09:45.846 INFO:teuthology.orchestra.run.smithi045.stdout: "options": "recursive" 2023-11-28T12:09:45.846 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T12:09:45.846 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T12:09:45.846 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-11-28T12:09:45.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.840+0000 7f5113fff700 1 -- 172.21.15.45:0/1679702112 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f50f00682f0 msgr2=0x7f50f006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:45.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.840+0000 7f5113fff700 1 --2- 172.21.15.45:0/1679702112 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f50f00682f0 0x7f50f006a7a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f5108007fd0 tx=0x7f5108009040 comp rx=0 tx=0).stop 2023-11-28T12:09:45.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.840+0000 7f5113fff700 1 -- 172.21.15.45:0/1679702112 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f510c161340 msgr2=0x7f510c0b8260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:09:45.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.840+0000 7f5113fff700 1 --2- 172.21.15.45:0/1679702112 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f510c161340 0x7f510c0b8260 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f5104009fd0 tx=0x7f510400e3c0 comp rx=0 tx=0).stop 2023-11-28T12:09:45.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.840+0000 7f5113fff700 1 -- 172.21.15.45:0/1679702112 shutdown_connections 2023-11-28T12:09:45.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.840+0000 7f5113fff700 1 --2- 172.21.15.45:0/1679702112 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f50f00682f0 0x7f50f006a7a0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:45.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.840+0000 7f5113fff700 1 --2- 172.21.15.45:0/1679702112 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f510c161340 0x7f510c0b8260 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:45.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.840+0000 7f5113fff700 1 --2- 172.21.15.45:0/1679702112 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f510c0d2320 0x7f510c0c80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:45.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.840+0000 7f5113fff700 1 --2- 172.21.15.45:0/1679702112 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f510c15c9b0 0x7f510c0b7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:09:45.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.840+0000 7f5113fff700 1 -- 172.21.15.45:0/1679702112 >> 172.21.15.45:0/1679702112 conn(0x7f510c072600 msgr2=0x7f510c0b6110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:09:45.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.840+0000 7f5113fff700 1 -- 172.21.15.45:0/1679702112 shutdown_connections 2023-11-28T12:09:45.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:09:45.840+0000 7f5113fff700 1 -- 172.21.15.45:0/1679702112 wait complete. 2023-11-28T12:09:45.858 INFO:tasks.cephfs.filesystem:scrub status for tag:81073e82-5230-49ee-b46b-c7c77867f3aa - {'path': '/', 'tag': '81073e82-5230-49ee-b46b-c7c77867f3aa', 'options': 'recursive'} 2023-11-28T12:09:51.897 INFO:tasks.ceph.mon.a.smithi045.stderr:2023-11-28T12:09:51.896+0000 7fe5533f9700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2023-11-28T12:10:00.000 INFO:tasks.ceph.mon.a.smithi045.stderr:2023-11-28T12:09:59.999+0000 7fe5533f9700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 MDSs report damaged metadata 2023-11-28T12:10:00.641 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T12:10:00.646 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T12:10:15.859 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:0 scrub status 2023-11-28T12:10:16.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.076+0000 7f7c8c5ff700 1 Processor -- start 2023-11-28T12:10:16.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.076+0000 7f7c8c5ff700 1 -- start start 2023-11-28T12:10:16.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.077+0000 7f7c8c5ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7c84070c50 0x7f7c840b0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:16.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.077+0000 7f7c8c5ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c8415e1a0 con 0x7f7c840b0bb0 2023-11-28T12:10:16.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.077+0000 7f7c8c5ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c840b0fd0 con 0x7f7c84158200 2023-11-28T12:10:16.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.077+0000 7f7c8c5ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c8415f070 con 0x7f7c84070c50 2023-11-28T12:10:16.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.078+0000 7f7c8ab9c700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f7c840b0bb0 0x7f7c8415add0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:38772/0 (socket says 172.21.15.45:38772) 2023-11-28T12:10:16.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.078+0000 7f7c8ab9c700 1 -- 172.21.15.45:0/1185549564 learned_addr learned my addr 172.21.15.45:0/1185549564 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:10:16.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.078+0000 7f7c89b9a700 1 --2- 172.21.15.45:0/1185549564 >> v2:172.21.15.45:3300/0 conn(0x7f7c84070c50 0x7f7c840b0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:10:16.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.078+0000 7f7c89399700 1 -- 172.21.15.45:0/1185549564 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1878326702 0 0) 0x7f7c8415e1a0 con 0x7f7c840b0bb0 2023-11-28T12:10:16.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.078+0000 7f7c89399700 1 -- 172.21.15.45:0/1185549564 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c700035b0 con 0x7f7c840b0bb0 2023-11-28T12:10:16.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.078+0000 7f7c89b9a700 1 -- 172.21.15.45:0/1185549564 >> v1:172.21.15.152:6789/0 conn(0x7f7c84158200 legacy=0x7f7c840caa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:10:16.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.078+0000 7f7c89b9a700 1 -- 172.21.15.45:0/1185549564 >> v1:172.21.15.45:6789/0 conn(0x7f7c840b0bb0 legacy=0x7f7c8415add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:10:16.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.078+0000 7f7c89b9a700 1 -- 172.21.15.45:0/1185549564 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c840cb180 con 0x7f7c84070c50 2023-11-28T12:10:16.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.079+0000 7f7c89b9a700 1 --2- 172.21.15.45:0/1185549564 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c84070c50 0x7f7c840b0670 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f7c74009840 tx=0x7f7c74009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35b6c20e8c223e16 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:10:16.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.079+0000 7f7c89399700 1 -- 172.21.15.45:0/1185549564 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c74011830 con 0x7f7c84070c50 2023-11-28T12:10:16.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.079+0000 7f7c89399700 1 -- 172.21.15.45:0/1185549564 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c74011990 con 0x7f7c84070c50 2023-11-28T12:10:16.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.079+0000 7f7c89399700 1 -- 172.21.15.45:0/1185549564 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c74011d20 con 0x7f7c84070c50 2023-11-28T12:10:16.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.080+0000 7f7c8c5ff700 1 -- 172.21.15.45:0/1185549564 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c84070c50 msgr2=0x7f7c840b0670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:10:16.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.080+0000 7f7c8c5ff700 1 --2- 172.21.15.45:0/1185549564 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c84070c50 0x7f7c840b0670 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f7c74009840 tx=0x7f7c74009b50 comp rx=0 tx=0).stop 2023-11-28T12:10:16.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.080+0000 7f7c8c5ff700 1 -- 172.21.15.45:0/1185549564 shutdown_connections 2023-11-28T12:10:16.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.080+0000 7f7c8c5ff700 1 --2- 172.21.15.45:0/1185549564 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c84070c50 0x7f7c840b0670 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:16.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.080+0000 7f7c8c5ff700 1 -- 172.21.15.45:0/1185549564 >> 172.21.15.45:0/1185549564 conn(0x7f7c840cb670 msgr2=0x7f7c840cba70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:10:16.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.080+0000 7f7c8c5ff700 1 -- 172.21.15.45:0/1185549564 shutdown_connections 2023-11-28T12:10:16.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.080+0000 7f7c8c5ff700 1 -- 172.21.15.45:0/1185549564 wait complete. 2023-11-28T12:10:16.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.082+0000 7f7c8c5ff700 1 Processor -- start 2023-11-28T12:10:16.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.082+0000 7f7c8c5ff700 1 -- start start 2023-11-28T12:10:16.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.083+0000 7f7c8c5ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7c84070c50 0x7f7c840c4850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:16.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.083+0000 7f7c8c5ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c840b0bb0 0x7f7c84156ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:16.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.083+0000 7f7c8c5ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c84158200 0x7f7c840ad090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:16.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.083+0000 7f7c8c5ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c841f6560 con 0x7f7c840b0bb0 2023-11-28T12:10:16.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.083+0000 7f7c8c5ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c84156200 con 0x7f7c84158200 2023-11-28T12:10:16.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.083+0000 7f7c8c5ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c841564e0 con 0x7f7c84070c50 2023-11-28T12:10:16.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.083+0000 7f7c89b9a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c840b0bb0 0x7f7c84156ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:10:16.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.083+0000 7f7c89b9a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c840b0bb0 0x7f7c84156ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60864/0 (socket says 172.21.15.45:60864) 2023-11-28T12:10:16.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.083+0000 7f7c89b9a700 1 -- 172.21.15.45:0/77251745 learned_addr learned my addr 172.21.15.45:0/77251745 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:10:16.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.083+0000 7f7c8ab9c700 1 --2- 172.21.15.45:0/77251745 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c84158200 0x7f7c840ad090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:10:16.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.083+0000 7f7c8a39b700 1 --2- 172.21.15.45:0/77251745 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7c84070c50 0x7f7c840c4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:10:16.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.084+0000 7f7c89b9a700 1 -- 172.21.15.45:0/77251745 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7c84070c50 msgr2=0x7f7c840c4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:10:16.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.084+0000 7f7c89b9a700 1 --2- 172.21.15.45:0/77251745 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7c84070c50 0x7f7c840c4850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:16.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.084+0000 7f7c89b9a700 1 -- 172.21.15.45:0/77251745 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c84158200 msgr2=0x7f7c840ad090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:10:16.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.084+0000 7f7c89b9a700 1 --2- 172.21.15.45:0/77251745 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c84158200 0x7f7c840ad090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:16.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.084+0000 7f7c89b9a700 1 -- 172.21.15.45:0/77251745 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c740094a0 con 0x7f7c840b0bb0 2023-11-28T12:10:16.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.084+0000 7f7c8a39b700 1 --2- 172.21.15.45:0/77251745 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7c84070c50 0x7f7c840c4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:10:16.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.084+0000 7f7c89b9a700 1 --2- 172.21.15.45:0/77251745 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c840b0bb0 0x7f7c84156ce0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f7c74009fd0 tx=0x7f7c74004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:10:16.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.084+0000 7f7c7affd700 1 -- 172.21.15.45:0/77251745 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c740036a0 con 0x7f7c840b0bb0 2023-11-28T12:10:16.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.084+0000 7f7c7affd700 1 -- 172.21.15.45:0/77251745 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c7401f070 con 0x7f7c840b0bb0 2023-11-28T12:10:16.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.084+0000 7f7c7affd700 1 -- 172.21.15.45:0/77251745 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c74003a20 con 0x7f7c840b0bb0 2023-11-28T12:10:16.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.084+0000 7f7c8c5ff700 1 -- 172.21.15.45:0/77251745 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c841585d0 con 0x7f7c840b0bb0 2023-11-28T12:10:16.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.084+0000 7f7c8c5ff700 1 -- 172.21.15.45:0/77251745 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c840710f0 con 0x7f7c840b0bb0 2023-11-28T12:10:16.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.086+0000 7f7c7affd700 1 -- 172.21.15.45:0/77251745 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f7c7400f050 con 0x7f7c840b0bb0 2023-11-28T12:10:16.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.087+0000 7f7c7affd700 1 --2- 172.21.15.45:0/77251745 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f7c680682f0 0x7f7c6806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:16.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.087+0000 7f7c7affd700 1 -- 172.21.15.45:0/77251745 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7c74021070 con 0x7f7c840b0bb0 2023-11-28T12:10:16.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.088+0000 7f7c8a39b700 1 --2- 172.21.15.45:0/77251745 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f7c680682f0 0x7f7c6806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:10:16.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.088+0000 7f7c8a39b700 1 --2- 172.21.15.45:0/77251745 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f7c680682f0 0x7f7c6806a7a0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f7c80000f60 tx=0x7f7c80009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:10:16.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.089+0000 7f7c9ff62b80 1 Processor -- start 2023-11-28T12:10:16.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.090+0000 7f7c9ff62b80 1 -- start start 2023-11-28T12:10:16.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.091+0000 7f7c9ff62b80 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55ace258afa0 0x55ace2544a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:16.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.091+0000 7f7c9ff62b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ace2581b10 0x55ace258b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:16.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.091+0000 7f7c9ff62b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ace256d6b0 0x55ace2545bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:16.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.091+0000 7f7c9ff62b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ace24c2e30 con 0x55ace256d6b0 2023-11-28T12:10:16.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.091+0000 7f7c9ff62b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ace242f190 con 0x55ace2581b10 2023-11-28T12:10:16.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.091+0000 7f7c9ff62b80 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ace249de00 con 0x55ace258afa0 2023-11-28T12:10:16.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.091+0000 7f7c8ab9c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ace256d6b0 0x55ace2545bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:10:16.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.091+0000 7f7c8ab9c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ace256d6b0 0x55ace2545bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60868/0 (socket says 172.21.15.45:60868) 2023-11-28T12:10:16.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.091+0000 7f7c8ab9c700 1 -- 172.21.15.45:0/1317273219 learned_addr learned my addr 172.21.15.45:0/1317273219 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:10:16.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.091+0000 7f7c8a39b700 1 --2- 172.21.15.45:0/1317273219 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55ace258afa0 0x55ace2544a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:10:16.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.091+0000 7f7c89b9a700 1 --2- 172.21.15.45:0/1317273219 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ace2581b10 0x55ace258b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:10:16.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.091+0000 7f7c8ab9c700 1 -- 172.21.15.45:0/1317273219 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55ace258afa0 msgr2=0x55ace2544a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:10:16.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.091+0000 7f7c8ab9c700 1 --2- 172.21.15.45:0/1317273219 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55ace258afa0 0x55ace2544a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:16.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.091+0000 7f7c8ab9c700 1 -- 172.21.15.45:0/1317273219 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ace2581b10 msgr2=0x55ace258b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:10:16.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.091+0000 7f7c8ab9c700 1 --2- 172.21.15.45:0/1317273219 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ace2581b10 0x55ace258b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:16.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.091+0000 7f7c8ab9c700 1 -- 172.21.15.45:0/1317273219 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ace228b7e0 con 0x55ace256d6b0 2023-11-28T12:10:16.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.091+0000 7f7c8a39b700 1 --2- 172.21.15.45:0/1317273219 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55ace258afa0 0x55ace2544a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:10:16.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.092+0000 7f7c8ab9c700 1 --2- 172.21.15.45:0/1317273219 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ace256d6b0 0x55ace2545bb0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f7c7c002210 tx=0x7f7c7c007320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b7dcfcad3b55cb8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:10:16.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.092+0000 7f7c67fff700 1 -- 172.21.15.45:0/1317273219 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c7c007ba0 con 0x55ace256d6b0 2023-11-28T12:10:16.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.092+0000 7f7c67fff700 1 -- 172.21.15.45:0/1317273219 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c7c0133f0 con 0x55ace256d6b0 2023-11-28T12:10:16.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.092+0000 7f7c67fff700 1 -- 172.21.15.45:0/1317273219 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c7c013760 con 0x55ace256d6b0 2023-11-28T12:10:16.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.092+0000 7f7c9ff62b80 1 -- 172.21.15.45:0/1317273219 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ace256d6b0 msgr2=0x55ace2545bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:10:16.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.092+0000 7f7c9ff62b80 1 --2- 172.21.15.45:0/1317273219 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ace256d6b0 0x55ace2545bb0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f7c7c002210 tx=0x7f7c7c007320 comp rx=0 tx=0).stop 2023-11-28T12:10:16.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.093+0000 7f7c9ff62b80 1 -- 172.21.15.45:0/1317273219 shutdown_connections 2023-11-28T12:10:16.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.093+0000 7f7c9ff62b80 1 --2- 172.21.15.45:0/1317273219 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ace256d6b0 0x55ace2545bb0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:16.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.093+0000 7f7c9ff62b80 1 --2- 172.21.15.45:0/1317273219 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55ace258afa0 0x55ace2544a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:16.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.093+0000 7f7c9ff62b80 1 --2- 172.21.15.45:0/1317273219 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ace2581b10 0x55ace258b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:16.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.093+0000 7f7c9ff62b80 1 -- 172.21.15.45:0/1317273219 >> 172.21.15.45:0/1317273219 conn(0x55ace253ad70 msgr2=0x55ace2543f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:10:16.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.093+0000 7f7c9ff62b80 1 -- 172.21.15.45:0/1317273219 shutdown_connections 2023-11-28T12:10:16.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.093+0000 7f7c9ff62b80 1 -- 172.21.15.45:0/1317273219 wait complete. 2023-11-28T12:10:16.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.093+0000 7f7c9ff62b80 1 -- start start 2023-11-28T12:10:16.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.094+0000 7f7c9ff62b80 1 Processor -- start 2023-11-28T12:10:16.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.096+0000 7f7c9ff62b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ace256d6b0 0x55ace25844e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:16.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.096+0000 7f7c9ff62b80 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55ace2581b10 0x55ace2584a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:16.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.096+0000 7f7c9ff62b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ace258afa0 0x55ace256b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:16.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.096+0000 7f7c9ff62b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ace2497170 con 0x55ace258afa0 2023-11-28T12:10:16.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.096+0000 7f7c9ff62b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ace228c3e0 con 0x55ace256d6b0 2023-11-28T12:10:16.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.096+0000 7f7c9ff62b80 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ace242f390 con 0x55ace2581b10 2023-11-28T12:10:16.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.096+0000 7f7c9ff62b80 10 client.0 _ll_register_callbacks cb 0x55ace2435450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T12:10:16.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.096+0000 7f7c8ab9c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ace258afa0 0x55ace256b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:10:16.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.096+0000 7f7c8ab9c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ace258afa0 0x55ace256b7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60880/0 (socket says 172.21.15.45:60880) 2023-11-28T12:10:16.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.096+0000 7f7c8ab9c700 1 -- 172.21.15.45:0/3184522948 learned_addr learned my addr 172.21.15.45:0/3184522948 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:10:16.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.096+0000 7f7c8ab9c700 1 -- 172.21.15.45:0/3184522948 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55ace2581b10 msgr2=0x55ace2584a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:10:16.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.096+0000 7f7c8a39b700 1 --2- 172.21.15.45:0/3184522948 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ace256d6b0 0x55ace25844e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:10:16.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.096+0000 7f7c89b9a700 1 --2- 172.21.15.45:0/3184522948 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55ace2581b10 0x55ace2584a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:10:16.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.096+0000 7f7c8ab9c700 1 --2- 172.21.15.45:0/3184522948 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55ace2581b10 0x55ace2584a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:16.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.096+0000 7f7c8ab9c700 1 -- 172.21.15.45:0/3184522948 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ace256d6b0 msgr2=0x55ace25844e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:10:16.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.096+0000 7f7c8ab9c700 1 --2- 172.21.15.45:0/3184522948 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ace256d6b0 0x55ace25844e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:16.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.096+0000 7f7c8ab9c700 1 -- 172.21.15.45:0/3184522948 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c700035b0 con 0x55ace258afa0 2023-11-28T12:10:16.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.096+0000 7f7c89b9a700 1 --2- 172.21.15.45:0/3184522948 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55ace2581b10 0x55ace2584a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:10:16.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.096+0000 7f7c8a39b700 1 --2- 172.21.15.45:0/3184522948 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ace256d6b0 0x55ace25844e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:10:16.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.097+0000 7f7c8ab9c700 1 --2- 172.21.15.45:0/3184522948 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ace258afa0 0x55ace256b7b0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f7c7c001580 tx=0x7f7c7c001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74230b7100fde109 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:10:16.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.097+0000 7f7c657fa700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-11-28T12:10:16.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.097+0000 7f7c657fa700 1 -- 172.21.15.45:0/3184522948 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c7c007ba0 con 0x55ace258afa0 2023-11-28T12:10:16.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.097+0000 7f7c657fa700 1 -- 172.21.15.45:0/3184522948 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(61..61 src has 1..61) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7c7c01e820 con 0x55ace258afa0 2023-11-28T12:10:16.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.097+0000 7f7c9ff62b80 1 -- 172.21.15.45:0/3184522948 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ace249b080 con 0x55ace258afa0 2023-11-28T12:10:16.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.097+0000 7f7c657fa700 1 -- 172.21.15.45:0/3184522948 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7c7c01e9e0 con 0x55ace258afa0 2023-11-28T12:10:16.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.097+0000 7f7c9ff62b80 10 client.6201 fetch_fsmap learned FSMap version 33 2023-11-28T12:10:16.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.097+0000 7f7c9ff62b80 1 -- 172.21.15.45:0/3184522948 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=2+}) v3 -- 0x55ace23780f0 con 0x55ace258afa0 2023-11-28T12:10:16.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.097+0000 7f7c657fa700 1 -- 172.21.15.45:0/3184522948 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ace249b080 con 0x55ace258afa0 2023-11-28T12:10:16.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.098+0000 7f7c657fa700 1 -- 172.21.15.45:0/3184522948 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 33) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f7c7c012070 con 0x55ace258afa0 2023-11-28T12:10:16.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.098+0000 7f7c9ff62b80 10 client.6201 fetch_fsmap finished waiting for FSMap version 33 2023-11-28T12:10:16.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.098+0000 7f7c9ff62b80 10 client.6201 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.c 2023-11-28T12:10:16.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.098+0000 7f7c9ff62b80 20 client.6201 populate_metadata read hostname 'smithi045' 2023-11-28T12:10:16.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.098+0000 7f7c9ff62b80 1 --2- 172.21.15.45:0/3184522948 >> [v2:172.21.15.45:6832/3784258337,v1:172.21.15.45:6833/3784258337] conn(0x55ace256c1e0 0x55ace258bb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:16.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.098+0000 7f7c9ff62b80 4 client.6201 mds_command: new command op to 5979 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-28T12:10:16.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.098+0000 7f7c9ff62b80 1 -- 172.21.15.45:0/3184522948 --> [v2:172.21.15.45:6832/3784258337,v1:172.21.15.45:6833/3784258337] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ace22e6f40 con 0x55ace256c1e0 2023-11-28T12:10:16.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.098+0000 7f7c8a39b700 1 --2- 172.21.15.45:0/3184522948 >> [v2:172.21.15.45:6832/3784258337,v1:172.21.15.45:6833/3784258337] conn(0x55ace256c1e0 0x55ace258bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:10:16.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.098+0000 7f7c657fa700 10 client.6201 ms_handle_connect on v2:172.21.15.45:6832/3784258337 2023-11-28T12:10:16.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.098+0000 7f7c8a39b700 1 --2- 172.21.15.45:0/3184522948 >> [v2:172.21.15.45:6832/3784258337,v1:172.21.15.45:6833/3784258337] conn(0x55ace256c1e0 0x55ace258bb30 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e0da15e29840f3c0 server_cookie=6370a2bee1d834cf in_seq=0 out_seq=0 2023-11-28T12:10:16.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.099+0000 7f7c657fa700 1 -- 172.21.15.45:0/3184522948 <== mds.0 v2:172.21.15.45:6832/3784258337 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x55ace22e6f40 con 0x55ace256c1e0 2023-11-28T12:10:16.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.099+0000 7f7c657fa700 10 client.6201 handle_command_reply: tid=0 2023-11-28T12:10:16.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.099+0000 7f7c9ff62b80 1 client.6201 shutdown 2023-11-28T12:10:16.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.099+0000 7f7c9ff62b80 1 -- 172.21.15.45:0/3184522948 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ace258afa0 msgr2=0x55ace256b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:10:16.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.099+0000 7f7c9ff62b80 1 --2- 172.21.15.45:0/3184522948 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ace258afa0 0x55ace256b7b0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f7c7c001580 tx=0x7f7c7c001250 comp rx=0 tx=0).stop 2023-11-28T12:10:16.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.099+0000 7f7c9ff62b80 1 -- 172.21.15.45:0/3184522948 shutdown_connections 2023-11-28T12:10:16.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.099+0000 7f7c9ff62b80 1 --2- 172.21.15.45:0/3184522948 >> [v2:172.21.15.45:6832/3784258337,v1:172.21.15.45:6833/3784258337] conn(0x55ace256c1e0 0x55ace258bb30 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:16.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.100+0000 7f7c9ff62b80 1 --2- 172.21.15.45:0/3184522948 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ace256d6b0 0x55ace25844e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:16.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.100+0000 7f7c9ff62b80 1 --2- 172.21.15.45:0/3184522948 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ace258afa0 0x55ace256b7b0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:16.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.100+0000 7f7c9ff62b80 1 --2- 172.21.15.45:0/3184522948 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55ace2581b10 0x55ace2584a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:16.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.100+0000 7f7c9ff62b80 1 -- 172.21.15.45:0/3184522948 >> 172.21.15.45:0/3184522948 conn(0x55ace253ad70 msgr2=0x55ace253ff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:10:16.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.100+0000 7f7c657fa700 0 client.6201 ms_handle_reset on v2:172.21.15.45:6832/3784258337 2023-11-28T12:10:16.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.100+0000 7f7c9ff62b80 1 -- 172.21.15.45:0/3184522948 shutdown_connections 2023-11-28T12:10:16.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.100+0000 7f7c9ff62b80 1 -- 172.21.15.45:0/3184522948 wait complete. 2023-11-28T12:10:16.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.100+0000 7f7c9ff62b80 20 client.6201 trim_cache size 0 max 16384 2023-11-28T12:10:16.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.117+0000 7f7c9ff62b80 1 Processor -- start 2023-11-28T12:10:16.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.117+0000 7f7c9ff62b80 1 -- start start 2023-11-28T12:10:16.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.118+0000 7f7c9ff62b80 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55ace256d6b0 0x55ace25995d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:16.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.118+0000 7f7c9ff62b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ace2581b10 0x55ace253fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:16.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.118+0000 7f7c9ff62b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ace258afa0 0x55ace25402c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:16.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.118+0000 7f7c9ff62b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ace256c900 con 0x55ace2581b10 2023-11-28T12:10:16.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.118+0000 7f7c9ff62b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ace2544060 con 0x55ace258afa0 2023-11-28T12:10:16.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.118+0000 7f7c9ff62b80 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ace2588050 con 0x55ace256d6b0 2023-11-28T12:10:16.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.118+0000 7f7c89b9a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ace2581b10 0x55ace253fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:10:16.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.118+0000 7f7c89b9a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ace2581b10 0x55ace253fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60882/0 (socket says 172.21.15.45:60882) 2023-11-28T12:10:16.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.118+0000 7f7c89b9a700 1 -- 172.21.15.45:0/297632119 learned_addr learned my addr 172.21.15.45:0/297632119 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:10:16.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.118+0000 7f7c8ab9c700 1 --2- 172.21.15.45:0/297632119 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ace258afa0 0x55ace25402c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:10:16.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.119+0000 7f7c8a39b700 1 --2- 172.21.15.45:0/297632119 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55ace256d6b0 0x55ace25995d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:10:16.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.119+0000 7f7c89b9a700 1 -- 172.21.15.45:0/297632119 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55ace256d6b0 msgr2=0x55ace25995d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:10:16.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.119+0000 7f7c89b9a700 1 --2- 172.21.15.45:0/297632119 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55ace256d6b0 0x55ace25995d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:16.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.119+0000 7f7c89b9a700 1 -- 172.21.15.45:0/297632119 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ace258afa0 msgr2=0x55ace25402c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:10:16.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.119+0000 7f7c89b9a700 1 --2- 172.21.15.45:0/297632119 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ace258afa0 0x55ace25402c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:16.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.119+0000 7f7c89b9a700 1 -- 172.21.15.45:0/297632119 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ace245e330 con 0x55ace2581b10 2023-11-28T12:10:16.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.119+0000 7f7c8ab9c700 1 --2- 172.21.15.45:0/297632119 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ace258afa0 0x55ace25402c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:10:16.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.119+0000 7f7c89b9a700 1 --2- 172.21.15.45:0/297632119 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ace2581b10 0x55ace253fd80 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f7c7405f620 tx=0x7f7c74087040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaa8f9b3cca2cb39 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:10:16.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.119+0000 7f7c78bff700 1 -- 172.21.15.45:0/297632119 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c74056fb0 con 0x55ace2581b10 2023-11-28T12:10:16.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.119+0000 7f7c78bff700 1 -- 172.21.15.45:0/297632119 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c74057110 con 0x55ace2581b10 2023-11-28T12:10:16.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.119+0000 7f7c78bff700 1 -- 172.21.15.45:0/297632119 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c74057280 con 0x55ace2581b10 2023-11-28T12:10:16.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.120+0000 7f7c9ff62b80 1 -- 172.21.15.45:0/297632119 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ace2581b10 msgr2=0x55ace253fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:10:16.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.120+0000 7f7c9ff62b80 1 --2- 172.21.15.45:0/297632119 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ace2581b10 0x55ace253fd80 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f7c7405f620 tx=0x7f7c74087040 comp rx=0 tx=0).stop 2023-11-28T12:10:16.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.120+0000 7f7c9ff62b80 1 -- 172.21.15.45:0/297632119 shutdown_connections 2023-11-28T12:10:16.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.120+0000 7f7c9ff62b80 1 --2- 172.21.15.45:0/297632119 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ace258afa0 0x55ace25402c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:16.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.120+0000 7f7c9ff62b80 1 --2- 172.21.15.45:0/297632119 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55ace256d6b0 0x55ace25995d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:16.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.120+0000 7f7c9ff62b80 1 --2- 172.21.15.45:0/297632119 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ace2581b10 0x55ace253fd80 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:16.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.120+0000 7f7c9ff62b80 1 -- 172.21.15.45:0/297632119 >> 172.21.15.45:0/297632119 conn(0x55ace253ad70 msgr2=0x55ace256b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:10:16.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.120+0000 7f7c9ff62b80 1 -- 172.21.15.45:0/297632119 shutdown_connections 2023-11-28T12:10:16.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.120+0000 7f7c9ff62b80 1 -- 172.21.15.45:0/297632119 wait complete. 2023-11-28T12:10:16.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.120+0000 7f7c9ff62b80 1 -- start start 2023-11-28T12:10:16.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.121+0000 7f7c9ff62b80 1 Processor -- start 2023-11-28T12:10:16.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.122+0000 7f7c9ff62b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ace256d6b0 0x55ace2570cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:16.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.122+0000 7f7c9ff62b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ace2581b10 0x55ace25d8650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:16.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.122+0000 7f7c9ff62b80 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55ace258afa0 0x55ace256a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:16.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.122+0000 7f7c9ff62b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ace2571200 con 0x55ace256d6b0 2023-11-28T12:10:16.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.122+0000 7f7c9ff62b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ace2571660 con 0x55ace2581b10 2023-11-28T12:10:16.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.122+0000 7f7c9ff62b80 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ace253f180 con 0x55ace258afa0 2023-11-28T12:10:16.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.122+0000 7f7c9ff62b80 10 client.0 _ll_register_callbacks cb 0x7f7c7c002080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T12:10:16.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.122+0000 7f7c8a39b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ace256d6b0 0x55ace2570cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:10:16.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.122+0000 7f7c8a39b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ace256d6b0 0x55ace2570cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60896/0 (socket says 172.21.15.45:60896) 2023-11-28T12:10:16.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.122+0000 7f7c8a39b700 1 -- 172.21.15.45:0/3567775287 learned_addr learned my addr 172.21.15.45:0/3567775287 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:10:16.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.122+0000 7f7c8ab9c700 1 --2- 172.21.15.45:0/3567775287 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55ace258afa0 0x55ace256a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:10:16.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.122+0000 7f7c89b9a700 1 --2- 172.21.15.45:0/3567775287 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ace2581b10 0x55ace25d8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:10:16.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.122+0000 7f7c8a39b700 1 -- 172.21.15.45:0/3567775287 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55ace258afa0 msgr2=0x55ace256a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:10:16.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.122+0000 7f7c8a39b700 1 --2- 172.21.15.45:0/3567775287 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55ace258afa0 0x55ace256a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:16.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.122+0000 7f7c8a39b700 1 -- 172.21.15.45:0/3567775287 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ace2581b10 msgr2=0x55ace25d8650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:10:16.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.122+0000 7f7c8a39b700 1 --2- 172.21.15.45:0/3567775287 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ace2581b10 0x55ace25d8650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:16.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.122+0000 7f7c8a39b700 1 -- 172.21.15.45:0/3567775287 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c840710f0 con 0x55ace256d6b0 2023-11-28T12:10:16.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.123+0000 7f7c8a39b700 1 --2- 172.21.15.45:0/3567775287 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ace256d6b0 0x55ace2570cc0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f7c80001e80 tx=0x7f7c80000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5b46c9159b89e22 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:10:16.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.123+0000 7f7c657fa700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-11-28T12:10:16.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.123+0000 7f7c657fa700 1 -- 172.21.15.45:0/3567775287 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c8001a040 con 0x55ace256d6b0 2023-11-28T12:10:16.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.123+0000 7f7c657fa700 1 -- 172.21.15.45:0/3567775287 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(61..61 src has 1..61) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7c80003e40 con 0x55ace256d6b0 2023-11-28T12:10:16.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.123+0000 7f7c9ff62b80 1 -- 172.21.15.45:0/3567775287 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7c7c0133f0 con 0x55ace256d6b0 2023-11-28T12:10:16.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.123+0000 7f7c657fa700 1 -- 172.21.15.45:0/3567775287 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7c800238c0 con 0x55ace256d6b0 2023-11-28T12:10:16.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.123+0000 7f7c9ff62b80 10 client.6207 fetch_fsmap learned FSMap version 33 2023-11-28T12:10:16.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.123+0000 7f7c9ff62b80 1 -- 172.21.15.45:0/3567775287 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=2+}) v3 -- 0x55ace22ec220 con 0x55ace256d6b0 2023-11-28T12:10:16.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.123+0000 7f7c657fa700 1 -- 172.21.15.45:0/3567775287 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c7c0133f0 con 0x55ace256d6b0 2023-11-28T12:10:16.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.123+0000 7f7c657fa700 1 -- 172.21.15.45:0/3567775287 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 33) v1 ==== 3106+0+0 (secure 0 0 0) 0x7f7c80023a20 con 0x55ace256d6b0 2023-11-28T12:10:16.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.123+0000 7f7c9ff62b80 10 client.6207 fetch_fsmap finished waiting for FSMap version 33 2023-11-28T12:10:16.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.124+0000 7f7c9ff62b80 10 client.6207 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.c 2023-11-28T12:10:16.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.124+0000 7f7c9ff62b80 20 client.6207 populate_metadata read hostname 'smithi045' 2023-11-28T12:10:16.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.124+0000 7f7c9ff62b80 1 --2- 172.21.15.45:0/3567775287 >> [v2:172.21.15.45:6832/3784258337,v1:172.21.15.45:6833/3784258337] conn(0x55ace256abe0 0x55ace2589510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:16.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.124+0000 7f7c9ff62b80 4 client.6207 mds_command: new command op to 5979 tid=0[{"prefix": "scrub status"}] 2023-11-28T12:10:16.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.124+0000 7f7c9ff62b80 1 -- 172.21.15.45:0/3567775287 --> [v2:172.21.15.45:6832/3784258337,v1:172.21.15.45:6833/3784258337] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55ace231c090 con 0x55ace256abe0 2023-11-28T12:10:16.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.124+0000 7f7c89b9a700 1 --2- 172.21.15.45:0/3567775287 >> [v2:172.21.15.45:6832/3784258337,v1:172.21.15.45:6833/3784258337] conn(0x55ace256abe0 0x55ace2589510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:10:16.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.124+0000 7f7c89b9a700 1 --2- 172.21.15.45:0/3567775287 >> [v2:172.21.15.45:6832/3784258337,v1:172.21.15.45:6833/3784258337] conn(0x55ace256abe0 0x55ace2589510 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=85926f8e8b6c7f3f server_cookie=3aedccf938a1ac5e in_seq=0 out_seq=0 2023-11-28T12:10:16.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.124+0000 7f7c657fa700 10 client.6207 ms_handle_connect on v2:172.21.15.45:6832/3784258337 2023-11-28T12:10:16.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.124+0000 7f7c657fa700 1 -- 172.21.15.45:0/3567775287 <== mds.0 v2:172.21.15.45:6832/3784258337 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55ace231c090 con 0x55ace256abe0 2023-11-28T12:10:16.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.124+0000 7f7c657fa700 10 client.6207 handle_command_reply: tid=0 2023-11-28T12:10:16.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.124+0000 7f7c9ff62b80 1 client.6207 shutdown 2023-11-28T12:10:16.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.125+0000 7f7c9ff62b80 1 -- 172.21.15.45:0/3567775287 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ace256d6b0 msgr2=0x55ace2570cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:10:16.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.125+0000 7f7c9ff62b80 1 --2- 172.21.15.45:0/3567775287 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ace256d6b0 0x55ace2570cc0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f7c80001e80 tx=0x7f7c80000ed0 comp rx=0 tx=0).stop 2023-11-28T12:10:16.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.125+0000 7f7c9ff62b80 1 -- 172.21.15.45:0/3567775287 shutdown_connections 2023-11-28T12:10:16.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.125+0000 7f7c9ff62b80 1 --2- 172.21.15.45:0/3567775287 >> [v2:172.21.15.45:6832/3784258337,v1:172.21.15.45:6833/3784258337] conn(0x55ace256abe0 0x55ace2589510 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:16.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.125+0000 7f7c9ff62b80 1 --2- 172.21.15.45:0/3567775287 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x55ace258afa0 0x55ace256a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:16.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.125+0000 7f7c9ff62b80 1 --2- 172.21.15.45:0/3567775287 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ace256d6b0 0x55ace2570cc0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:16.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.125+0000 7f7c9ff62b80 1 --2- 172.21.15.45:0/3567775287 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55ace2581b10 0x55ace25d8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:16.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.125+0000 7f7c657fa700 0 client.6207 ms_handle_reset on v2:172.21.15.45:6832/3784258337 2023-11-28T12:10:16.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.125+0000 7f7c9ff62b80 1 -- 172.21.15.45:0/3567775287 >> 172.21.15.45:0/3567775287 conn(0x55ace253ad70 msgr2=0x55ace258b370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:10:16.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.125+0000 7f7c9ff62b80 1 -- 172.21.15.45:0/3567775287 shutdown_connections 2023-11-28T12:10:16.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.125+0000 7f7c9ff62b80 1 -- 172.21.15.45:0/3567775287 wait complete. 2023-11-28T12:10:16.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.125+0000 7f7c9ff62b80 20 client.6207 trim_cache size 0 max 16384 2023-11-28T12:10:16.133 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-11-28T12:10:16.133 INFO:teuthology.orchestra.run.smithi045.stdout: "status": "no active scrubs running", 2023-11-28T12:10:16.133 INFO:teuthology.orchestra.run.smithi045.stdout: "scrubs": {} 2023-11-28T12:10:16.133 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-11-28T12:10:16.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.126+0000 7f7c8c5ff700 1 -- 172.21.15.45:0/77251745 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f7c680682f0 msgr2=0x7f7c6806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:10:16.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.126+0000 7f7c8c5ff700 1 --2- 172.21.15.45:0/77251745 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f7c680682f0 0x7f7c6806a7a0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f7c80000f60 tx=0x7f7c80009040 comp rx=0 tx=0).stop 2023-11-28T12:10:16.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.126+0000 7f7c8c5ff700 1 -- 172.21.15.45:0/77251745 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c840b0bb0 msgr2=0x7f7c84156ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:10:16.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.126+0000 7f7c8c5ff700 1 --2- 172.21.15.45:0/77251745 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c840b0bb0 0x7f7c84156ce0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f7c74009fd0 tx=0x7f7c74004750 comp rx=0 tx=0).stop 2023-11-28T12:10:16.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.126+0000 7f7c8c5ff700 1 -- 172.21.15.45:0/77251745 shutdown_connections 2023-11-28T12:10:16.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.126+0000 7f7c8c5ff700 1 --2- 172.21.15.45:0/77251745 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f7c680682f0 0x7f7c6806a7a0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:16.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.126+0000 7f7c8c5ff700 1 --2- 172.21.15.45:0/77251745 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c84158200 0x7f7c840ad090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:16.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.126+0000 7f7c8c5ff700 1 --2- 172.21.15.45:0/77251745 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7c84070c50 0x7f7c840c4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:16.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.126+0000 7f7c8c5ff700 1 --2- 172.21.15.45:0/77251745 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c840b0bb0 0x7f7c84156ce0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:16.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.126+0000 7f7c8c5ff700 1 -- 172.21.15.45:0/77251745 >> 172.21.15.45:0/77251745 conn(0x7f7c840cb670 msgr2=0x7f7c840cc730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:10:16.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.126+0000 7f7c8c5ff700 1 -- 172.21.15.45:0/77251745 shutdown_connections 2023-11-28T12:10:16.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.126+0000 7f7c8c5ff700 1 -- 172.21.15.45:0/77251745 wait complete. 2023-11-28T12:10:16.144 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-11-28T12:10:16.145 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T12:10:16.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.347+0000 7f0593dff700 1 Processor -- start 2023-11-28T12:10:16.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.347+0000 7f0593dff700 1 -- start start 2023-11-28T12:10:16.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.348+0000 7f0593dff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f058c159490 0x7f058c0b0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:16.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.348+0000 7f0593dff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f058c0cdc80 0x7f058c0b0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:16.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.349+0000 7f0593dff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f058c0ccc00 con 0x7f058c159860 2023-11-28T12:10:16.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.349+0000 7f0593dff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f058c0ccec0 con 0x7f058c0cdc80 2023-11-28T12:10:16.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.349+0000 7f0593dff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f058c0cd1a0 con 0x7f058c159490 2023-11-28T12:10:16.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.349+0000 7f059139a700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f058c159860 0x7f058c0c94c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:38786/0 (socket says 172.21.15.45:38786) 2023-11-28T12:10:16.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.349+0000 7f059139a700 1 -- 172.21.15.45:0/1879252962 learned_addr learned my addr 172.21.15.45:0/1879252962 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:10:16.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.349+0000 7f0591b9b700 1 --2- 172.21.15.45:0/1879252962 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f058c159490 0x7f058c0b0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:10:16.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.349+0000 7f059239c700 1 --2- 172.21.15.45:0/1879252962 >> v2:172.21.15.152:3300/0 conn(0x7f058c0cdc80 0x7f058c0b0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:10:16.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.349+0000 7f0590b99700 1 -- 172.21.15.45:0/1879252962 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3805028482 0 0) 0x7f058c0ccc00 con 0x7f058c159860 2023-11-28T12:10:16.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.349+0000 7f0590b99700 1 -- 172.21.15.45:0/1879252962 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05780035b0 con 0x7f058c159860 2023-11-28T12:10:16.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.350+0000 7f0590b99700 1 -- 172.21.15.45:0/1879252962 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3331586951 0 0) 0x7f05780035b0 con 0x7f058c159860 2023-11-28T12:10:16.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.350+0000 7f0590b99700 1 -- 172.21.15.45:0/1879252962 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f058c159490 msgr2=0x7f058c0b0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:10:16.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.350+0000 7f0590b99700 1 --2- 172.21.15.45:0/1879252962 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f058c159490 0x7f058c0b0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:16.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.350+0000 7f0590b99700 1 -- 172.21.15.45:0/1879252962 >> v2:172.21.15.152:3300/0 conn(0x7f058c0cdc80 msgr2=0x7f058c0b0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:10:16.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.350+0000 7f0590b99700 1 --2- 172.21.15.45:0/1879252962 >> v2:172.21.15.152:3300/0 conn(0x7f058c0cdc80 0x7f058c0b0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:16.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.350+0000 7f0590b99700 1 -- 172.21.15.45:0/1879252962 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f058c0cd480 con 0x7f058c159860 2023-11-28T12:10:16.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.350+0000 7f0590b99700 1 -- 172.21.15.45:0/1879252962 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3460218165 0 0) 0x7f057c001670 con 0x7f058c159860 2023-11-28T12:10:16.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.350+0000 7f059239c700 1 --2- 172.21.15.45:0/1879252962 >> v2:172.21.15.152:3300/0 conn(0x7f058c0cdc80 0x7f058c0b0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:10:16.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.350+0000 7f0590b99700 1 -- 172.21.15.45:0/1879252962 >> v1:172.21.15.45:6789/0 conn(0x7f058c159860 legacy=0x7f058c0c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:10:16.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.350+0000 7f0590b99700 1 --2- 172.21.15.45:0/1879252962 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0578003a00 0x7f0578003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:16.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.350+0000 7f0590b99700 1 --2- 172.21.15.45:0/1879252962 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0578004850 0x7f0578004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:16.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.350+0000 7f0590b99700 1 --2- 172.21.15.45:0/1879252962 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f058c159490 0x7f0578005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:16.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.350+0000 7f0590b99700 1 -- 172.21.15.45:0/1879252962 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f058c0ccec0 con 0x7f0578004850 2023-11-28T12:10:16.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.350+0000 7f0590b99700 1 -- 172.21.15.45:0/1879252962 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f058c0cd1a0 con 0x7f0578003a00 2023-11-28T12:10:16.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.350+0000 7f0590b99700 1 -- 172.21.15.45:0/1879252962 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f057800ba10 con 0x7f058c159490 2023-11-28T12:10:16.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.350+0000 7f059139a700 1 --2- 172.21.15.45:0/1879252962 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0578004850 0x7f0578004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:10:16.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.350+0000 7f0591b9b700 1 --2- 172.21.15.45:0/1879252962 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0578003a00 0x7f0578003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:10:16.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.350+0000 7f059239c700 1 --2- 172.21.15.45:0/1879252962 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f058c159490 0x7f0578005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:10:16.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.351+0000 7f0591b9b700 1 -- 172.21.15.45:0/1879252962 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f058c159490 msgr2=0x7f0578005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:10:16.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.351+0000 7f0591b9b700 1 --2- 172.21.15.45:0/1879252962 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f058c159490 0x7f0578005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:16.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.351+0000 7f0591b9b700 1 -- 172.21.15.45:0/1879252962 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0578004850 msgr2=0x7f0578004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:10:16.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.351+0000 7f0591b9b700 1 --2- 172.21.15.45:0/1879252962 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0578004850 0x7f0578004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:16.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.351+0000 7f0591b9b700 1 -- 172.21.15.45:0/1879252962 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05780035b0 con 0x7f0578003a00 2023-11-28T12:10:16.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.351+0000 7f059139a700 1 --2- 172.21.15.45:0/1879252962 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0578004850 0x7f0578004cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:10:16.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.351+0000 7f0591b9b700 1 --2- 172.21.15.45:0/1879252962 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0578003a00 0x7f0578003e10 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f0588009b90 tx=0x7f0578005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c46cea3503582c4b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:10:16.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.351+0000 7f0590b99700 1 -- 172.21.15.45:0/1879252962 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f058800e6c0 con 0x7f0578003a00 2023-11-28T12:10:16.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.351+0000 7f0590b99700 1 -- 172.21.15.45:0/1879252962 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f058800e820 con 0x7f0578003a00 2023-11-28T12:10:16.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.351+0000 7f0590b99700 1 -- 172.21.15.45:0/1879252962 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f058800eb90 con 0x7f0578003a00 2023-11-28T12:10:16.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.352+0000 7f0593dff700 1 -- 172.21.15.45:0/1879252962 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0578003a00 msgr2=0x7f0578003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:10:16.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.352+0000 7f0593dff700 1 --2- 172.21.15.45:0/1879252962 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0578003a00 0x7f0578003e10 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f0588009b90 tx=0x7f0578005880 comp rx=0 tx=0).stop 2023-11-28T12:10:16.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.352+0000 7f059239c700 1 -- 172.21.15.45:0/1879252962 reap_dead start 2023-11-28T12:10:16.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.352+0000 7f0593dff700 1 -- 172.21.15.45:0/1879252962 shutdown_connections 2023-11-28T12:10:16.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.352+0000 7f0593dff700 1 -- 172.21.15.45:0/1879252962 >> 172.21.15.45:0/1879252962 conn(0x7f058c0cb670 msgr2=0x7f058c0cba70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:10:16.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.352+0000 7f0593dff700 1 -- 172.21.15.45:0/1879252962 shutdown_connections 2023-11-28T12:10:16.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.352+0000 7f0593dff700 1 -- 172.21.15.45:0/1879252962 wait complete. 2023-11-28T12:10:16.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.354+0000 7f0593dff700 1 Processor -- start 2023-11-28T12:10:16.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.354+0000 7f0593dff700 1 -- start start 2023-11-28T12:10:16.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.355+0000 7f0593dff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0578003a00 0x7f058c06fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:16.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.355+0000 7f0593dff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f058c0ade10 0x7f058c0c4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:16.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.355+0000 7f0593dff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f058c0b4100 0x7f058c0b4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:16.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.355+0000 7f0593dff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f058c0b3430 con 0x7f058c0ade10 2023-11-28T12:10:16.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.355+0000 7f0593dff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f058c0c4b90 con 0x7f058c0b4100 2023-11-28T12:10:16.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.355+0000 7f0593dff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f058c0703f0 con 0x7f0578003a00 2023-11-28T12:10:16.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.355+0000 7f059139a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f058c0ade10 0x7f058c0c4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:10:16.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.355+0000 7f059139a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f058c0ade10 0x7f058c0c4650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60928/0 (socket says 172.21.15.45:60928) 2023-11-28T12:10:16.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.355+0000 7f059139a700 1 -- 172.21.15.45:0/2704768600 learned_addr learned my addr 172.21.15.45:0/2704768600 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:10:16.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.355+0000 7f0591b9b700 1 --2- 172.21.15.45:0/2704768600 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0578003a00 0x7f058c06fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:10:16.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.355+0000 7f059239c700 1 --2- 172.21.15.45:0/2704768600 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f058c0b4100 0x7f058c0b4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:10:16.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.356+0000 7f059139a700 1 -- 172.21.15.45:0/2704768600 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0578003a00 msgr2=0x7f058c06fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:10:16.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.356+0000 7f059139a700 1 --2- 172.21.15.45:0/2704768600 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0578003a00 0x7f058c06fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:16.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.356+0000 7f059139a700 1 -- 172.21.15.45:0/2704768600 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f058c0b4100 msgr2=0x7f058c0b4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:10:16.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.356+0000 7f059139a700 1 --2- 172.21.15.45:0/2704768600 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f058c0b4100 0x7f058c0b4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:16.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.356+0000 7f059139a700 1 -- 172.21.15.45:0/2704768600 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f058c0b0670 con 0x7f058c0ade10 2023-11-28T12:10:16.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.356+0000 7f059139a700 1 --2- 172.21.15.45:0/2704768600 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f058c0ade10 0x7f058c0c4650 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f057c001c20 tx=0x7f057c0075f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:10:16.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.356+0000 7f05827fc700 1 -- 172.21.15.45:0/2704768600 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f057c00f660 con 0x7f058c0ade10 2023-11-28T12:10:16.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.356+0000 7f05827fc700 1 -- 172.21.15.45:0/2704768600 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f057c00f7c0 con 0x7f058c0ade10 2023-11-28T12:10:16.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.356+0000 7f0593dff700 1 -- 172.21.15.45:0/2704768600 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f058c0cd760 con 0x7f058c0ade10 2023-11-28T12:10:16.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.356+0000 7f05827fc700 1 -- 172.21.15.45:0/2704768600 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f057c00fb50 con 0x7f058c0ade10 2023-11-28T12:10:16.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.356+0000 7f0593dff700 1 -- 172.21.15.45:0/2704768600 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f058c0b0800 con 0x7f058c0ade10 2023-11-28T12:10:16.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.357+0000 7f0593dff700 1 -- 172.21.15.45:0/2704768600 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f058c0745c0 con 0x7f058c0ade10 2023-11-28T12:10:16.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.358+0000 7f05827fc700 1 -- 172.21.15.45:0/2704768600 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f057c01c030 con 0x7f058c0ade10 2023-11-28T12:10:16.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.359+0000 7f05827fc700 1 --2- 172.21.15.45:0/2704768600 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f05700682f0 0x7f057006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:16.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.359+0000 7f05827fc700 1 -- 172.21.15.45:0/2704768600 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f057c0856f0 con 0x7f058c0ade10 2023-11-28T12:10:16.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.360+0000 7f0591b9b700 1 --2- 172.21.15.45:0/2704768600 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f05700682f0 0x7f057006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:10:16.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.361+0000 7f0591b9b700 1 --2- 172.21.15.45:0/2704768600 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f05700682f0 0x7f057006a7a0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f05880090b0 tx=0x7f0588008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:10:16.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.364+0000 7f05827fc700 1 -- 172.21.15.45:0/2704768600 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f057c051e60 con 0x7f058c0ade10 2023-11-28T12:10:16.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.612+0000 7f0593dff700 1 -- 172.21.15.45:0/2704768600 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f058c15dfc0 con 0x7f058c0ade10 2023-11-28T12:10:16.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.613+0000 7f05827fc700 1 -- 172.21.15.45:0/2704768600 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+4649 (secure 0 0 0) 0x7f057c055480 con 0x7f058c0ade10 2023-11-28T12:10:16.616 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:10:16.616 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":33,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5423,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6836/735970231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":735970231},{"type":"v1","addr":"172.21.15.152:6836","nonce":735970231}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5797,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/3354918087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6835","nonce":3354918087},{"type":"v1","addr":"172.21.15.152:6837","nonce":3354918087}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5806,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/275804060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":275804060},{"type":"v1","addr":"172.21.15.45:6835","nonce":275804060}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T12:09:35.571815+0000","modified":"2023-11-28T12:09:51.897203+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5979},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5979":{"gid":5979,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":7,"addr":"172.21.15.45:6833/3784258337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":3784258337},{"type":"v1","addr":"172.21.15.45:6833","nonce":3784258337}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-28T12:10:16.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.615+0000 7f0593dff700 1 -- 172.21.15.45:0/2704768600 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f05700682f0 msgr2=0x7f057006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:10:16.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.615+0000 7f0593dff700 1 --2- 172.21.15.45:0/2704768600 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f05700682f0 0x7f057006a7a0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f05880090b0 tx=0x7f0588008030 comp rx=0 tx=0).stop 2023-11-28T12:10:16.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.615+0000 7f0593dff700 1 -- 172.21.15.45:0/2704768600 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f058c0ade10 msgr2=0x7f058c0c4650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:10:16.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.615+0000 7f0593dff700 1 --2- 172.21.15.45:0/2704768600 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f058c0ade10 0x7f058c0c4650 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f057c001c20 tx=0x7f057c0075f0 comp rx=0 tx=0).stop 2023-11-28T12:10:16.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.615+0000 7f0593dff700 1 -- 172.21.15.45:0/2704768600 shutdown_connections 2023-11-28T12:10:16.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.615+0000 7f0593dff700 1 --2- 172.21.15.45:0/2704768600 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f05700682f0 0x7f057006a7a0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:16.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.615+0000 7f0593dff700 1 --2- 172.21.15.45:0/2704768600 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f058c0b4100 0x7f058c0b4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:16.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.616+0000 7f0593dff700 1 --2- 172.21.15.45:0/2704768600 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0578003a00 0x7f058c06fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:16.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.616+0000 7f0593dff700 1 --2- 172.21.15.45:0/2704768600 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f058c0ade10 0x7f058c0c4650 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:16.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.616+0000 7f0593dff700 1 -- 172.21.15.45:0/2704768600 >> 172.21.15.45:0/2704768600 conn(0x7f058c0cb670 msgr2=0x7f058c06bd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:10:16.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.616+0000 7f0593dff700 1 -- 172.21.15.45:0/2704768600 shutdown_connections 2023-11-28T12:10:16.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.616+0000 7f0593dff700 1 -- 172.21.15.45:0/2704768600 wait complete. 2023-11-28T12:10:16.623 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 33 2023-11-28T12:10:16.639 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c damage ls --format=json-pretty 2023-11-28T12:10:16.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.843+0000 7fdf33bff700 1 Processor -- start 2023-11-28T12:10:16.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.843+0000 7fdf33bff700 1 -- start start 2023-11-28T12:10:16.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.844+0000 7fdf33bff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fdf2c161340 0x7fdf2c0d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:16.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.844+0000 7fdf33bff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fdf2c0d2320 0x7fdf2c0cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:16.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.844+0000 7fdf33bff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf2c0d1950 con 0x7fdf2c15c9b0 2023-11-28T12:10:16.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.844+0000 7fdf33bff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf2c0b5800 con 0x7fdf2c0d2320 2023-11-28T12:10:16.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.844+0000 7fdf33bff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf2c0b5300 con 0x7fdf2c161340 2023-11-28T12:10:16.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.844+0000 7fdf3219c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fdf2c0d2320 0x7fdf2c0cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:10:16.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.844+0000 7fdf3199b700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fdf2c15c9b0 0x7fdf2c0b4bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:38798/0 (socket says 172.21.15.45:38798) 2023-11-28T12:10:16.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.844+0000 7fdf3199b700 1 -- 172.21.15.45:0/2337085047 learned_addr learned my addr 172.21.15.45:0/2337085047 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:10:16.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.845+0000 7fdf3219c700 1 -- 172.21.15.45:0/2337085047 >> v2:172.21.15.152:3300/0 conn(0x7fdf2c161340 msgr2=0x7fdf2c0d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:10:16.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.845+0000 7fdf3219c700 1 --2- 172.21.15.45:0/2337085047 >> v2:172.21.15.152:3300/0 conn(0x7fdf2c161340 0x7fdf2c0d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:16.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.845+0000 7fdf3219c700 1 -- 172.21.15.45:0/2337085047 >> v1:172.21.15.45:6789/0 conn(0x7fdf2c15c9b0 legacy=0x7fdf2c0b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:10:16.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.845+0000 7fdf3219c700 1 -- 172.21.15.45:0/2337085047 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf2c0b5520 con 0x7fdf2c0d2320 2023-11-28T12:10:16.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.845+0000 7fdf30999700 1 -- 172.21.15.45:0/2337085047 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4146178472 0 0) 0x7fdf2c0d1950 con 0x7fdf2c15c9b0 2023-11-28T12:10:16.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.845+0000 7fdf3219c700 1 --2- 172.21.15.45:0/2337085047 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf2c0d2320 0x7fdf2c0cd7c0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c0685c0 tx=0x7fdf2400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cce44cb30d412766 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:10:16.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.845+0000 7fdf30999700 1 -- 172.21.15.45:0/2337085047 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf2400e070 con 0x7fdf2c0d2320 2023-11-28T12:10:16.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.845+0000 7fdf30999700 1 -- 172.21.15.45:0/2337085047 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf2400bb90 con 0x7fdf2c0d2320 2023-11-28T12:10:16.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.845+0000 7fdf30999700 1 -- 172.21.15.45:0/2337085047 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf24012430 con 0x7fdf2c0d2320 2023-11-28T12:10:16.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.846+0000 7fdf33bff700 1 -- 172.21.15.45:0/2337085047 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf2c0d2320 msgr2=0x7fdf2c0cd7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:10:16.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.846+0000 7fdf33bff700 1 --2- 172.21.15.45:0/2337085047 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf2c0d2320 0x7fdf2c0cd7c0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c0685c0 tx=0x7fdf2400b330 comp rx=0 tx=0).stop 2023-11-28T12:10:16.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.846+0000 7fdf33bff700 1 -- 172.21.15.45:0/2337085047 shutdown_connections 2023-11-28T12:10:16.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.846+0000 7fdf33bff700 1 --2- 172.21.15.45:0/2337085047 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf2c0d2320 0x7fdf2c0cd7c0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:16.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.846+0000 7fdf33bff700 1 --2- 172.21.15.45:0/2337085047 >> v2:172.21.15.152:3300/0 conn(0x7fdf2c161340 0x7fdf2c0d1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:16.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.846+0000 7fdf33bff700 1 -- 172.21.15.45:0/2337085047 >> 172.21.15.45:0/2337085047 conn(0x7fdf2c072600 msgr2=0x7fdf2c0cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:10:16.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.846+0000 7fdf33bff700 1 -- 172.21.15.45:0/2337085047 shutdown_connections 2023-11-28T12:10:16.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.846+0000 7fdf33bff700 1 -- 172.21.15.45:0/2337085047 wait complete. 2023-11-28T12:10:16.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.848+0000 7fdf33bff700 1 Processor -- start 2023-11-28T12:10:16.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.849+0000 7fdf33bff700 1 -- start start 2023-11-28T12:10:16.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.850+0000 7fdf33bff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf2c0d2320 0x7fdf2c1570e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:16.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.850+0000 7fdf33bff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf2c15c9b0 0x7fdf2c1e7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:16.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.850+0000 7fdf33bff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdf2c161340 0x7fdf2c15f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:16.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.850+0000 7fdf33bff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf2c0c8c50 con 0x7fdf2c0d2320 2023-11-28T12:10:16.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.850+0000 7fdf33bff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf2c0c7bb0 con 0x7fdf2c15c9b0 2023-11-28T12:10:16.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.850+0000 7fdf33bff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf2c0c7e90 con 0x7fdf2c161340 2023-11-28T12:10:16.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.850+0000 7fdf3199b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf2c0d2320 0x7fdf2c1570e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:10:16.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.850+0000 7fdf3199b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf2c0d2320 0x7fdf2c1570e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60958/0 (socket says 172.21.15.45:60958) 2023-11-28T12:10:16.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.850+0000 7fdf3199b700 1 -- 172.21.15.45:0/1436265863 learned_addr learned my addr 172.21.15.45:0/1436265863 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:10:16.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.850+0000 7fdf3119a700 1 --2- 172.21.15.45:0/1436265863 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf2c15c9b0 0x7fdf2c1e7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:10:16.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.850+0000 7fdf3219c700 1 --2- 172.21.15.45:0/1436265863 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdf2c161340 0x7fdf2c15f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:10:16.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.850+0000 7fdf3199b700 1 -- 172.21.15.45:0/1436265863 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdf2c161340 msgr2=0x7fdf2c15f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:10:16.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.850+0000 7fdf3199b700 1 --2- 172.21.15.45:0/1436265863 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdf2c161340 0x7fdf2c15f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:16.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.850+0000 7fdf3199b700 1 -- 172.21.15.45:0/1436265863 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf2c15c9b0 msgr2=0x7fdf2c1e7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:10:16.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.850+0000 7fdf3199b700 1 --2- 172.21.15.45:0/1436265863 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf2c15c9b0 0x7fdf2c1e7f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:16.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.850+0000 7fdf3199b700 1 -- 172.21.15.45:0/1436265863 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf24009a70 con 0x7fdf2c0d2320 2023-11-28T12:10:16.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.851+0000 7fdf3199b700 1 --2- 172.21.15.45:0/1436265863 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf2c0d2320 0x7fdf2c1570e0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fdf2800c550 tx=0x7fdf2800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:10:16.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.851+0000 7fdf227fc700 1 -- 172.21.15.45:0/1436265863 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf28004c80 con 0x7fdf2c0d2320 2023-11-28T12:10:16.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.851+0000 7fdf227fc700 1 -- 172.21.15.45:0/1436265863 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf28004e00 con 0x7fdf2c0d2320 2023-11-28T12:10:16.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.851+0000 7fdf33bff700 1 -- 172.21.15.45:0/1436265863 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf2c0d15e0 con 0x7fdf2c0d2320 2023-11-28T12:10:16.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.851+0000 7fdf227fc700 1 -- 172.21.15.45:0/1436265863 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf28007310 con 0x7fdf2c0d2320 2023-11-28T12:10:16.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.851+0000 7fdf33bff700 1 -- 172.21.15.45:0/1436265863 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf2c0d1300 con 0x7fdf2c0d2320 2023-11-28T12:10:16.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.853+0000 7fdf227fc700 1 -- 172.21.15.45:0/1436265863 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fdf2801a020 con 0x7fdf2c0d2320 2023-11-28T12:10:16.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.854+0000 7fdf227fc700 1 --2- 172.21.15.45:0/1436265863 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fdf100682f0 0x7fdf1006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:16.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.854+0000 7fdf227fc700 1 -- 172.21.15.45:0/1436265863 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdf28085a30 con 0x7fdf2c0d2320 2023-11-28T12:10:16.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.854+0000 7fdf3119a700 1 --2- 172.21.15.45:0/1436265863 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fdf100682f0 0x7fdf1006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:10:16.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.855+0000 7fdf3119a700 1 --2- 172.21.15.45:0/1436265863 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fdf100682f0 0x7fdf1006a7a0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c006fd0 tx=0x7fdf1c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:10:16.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.856+0000 7fdf47573b80 1 Processor -- start 2023-11-28T12:10:16.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.857+0000 7fdf47573b80 1 -- start start 2023-11-28T12:10:16.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.857+0000 7fdf47573b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555a6cd42ff0 0x555a6ccfca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:16.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.857+0000 7fdf47573b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a6cd39b60 0x555a6cd433c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:16.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.857+0000 7fdf47573b80 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x555a6cd25700 0x555a6ccfdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:16.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.857+0000 7fdf47573b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a6cc7ae80 con 0x555a6cd39b60 2023-11-28T12:10:16.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.857+0000 7fdf47573b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a6cbe71e0 con 0x555a6cd42ff0 2023-11-28T12:10:16.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.857+0000 7fdf47573b80 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x555a6cc55e50 con 0x555a6cd25700 2023-11-28T12:10:16.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.858+0000 7fdf3119a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a6cd39b60 0x555a6cd433c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:10:16.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.858+0000 7fdf3119a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a6cd39b60 0x555a6cd433c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60968/0 (socket says 172.21.15.45:60968) 2023-11-28T12:10:16.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.858+0000 7fdf3119a700 1 -- 172.21.15.45:0/3541754151 learned_addr learned my addr 172.21.15.45:0/3541754151 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:10:16.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.858+0000 7fdf3199b700 1 --2- 172.21.15.45:0/3541754151 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555a6cd42ff0 0x555a6ccfca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:10:16.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.858+0000 7fdf3219c700 1 --2- 172.21.15.45:0/3541754151 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x555a6cd25700 0x555a6ccfdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:10:16.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.858+0000 7fdf3119a700 1 -- 172.21.15.45:0/3541754151 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x555a6cd25700 msgr2=0x555a6ccfdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:10:16.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.858+0000 7fdf3119a700 1 --2- 172.21.15.45:0/3541754151 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x555a6cd25700 0x555a6ccfdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:16.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.858+0000 7fdf3119a700 1 -- 172.21.15.45:0/3541754151 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555a6cd42ff0 msgr2=0x555a6ccfca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:10:16.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.858+0000 7fdf3119a700 1 --2- 172.21.15.45:0/3541754151 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555a6cd42ff0 0x555a6ccfca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:16.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.858+0000 7fdf3119a700 1 -- 172.21.15.45:0/3541754151 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555a6ca43830 con 0x555a6cd39b60 2023-11-28T12:10:16.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.858+0000 7fdf3119a700 1 --2- 172.21.15.45:0/3541754151 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a6cd39b60 0x555a6cd433c0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c00d7b0 tx=0x7fdf1c010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e01b736ed40aca server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:10:16.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.859+0000 7fdf0f7fe700 1 -- 172.21.15.45:0/3541754151 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf1c00ded0 con 0x555a6cd39b60 2023-11-28T12:10:16.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.859+0000 7fdf0f7fe700 1 -- 172.21.15.45:0/3541754151 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf1c014640 con 0x555a6cd39b60 2023-11-28T12:10:16.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.859+0000 7fdf0f7fe700 1 -- 172.21.15.45:0/3541754151 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf1c0149f0 con 0x555a6cd39b60 2023-11-28T12:10:16.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.859+0000 7fdf47573b80 1 -- 172.21.15.45:0/3541754151 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a6cd39b60 msgr2=0x555a6cd433c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:10:16.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.859+0000 7fdf47573b80 1 --2- 172.21.15.45:0/3541754151 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a6cd39b60 0x555a6cd433c0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c00d7b0 tx=0x7fdf1c010000 comp rx=0 tx=0).stop 2023-11-28T12:10:16.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.859+0000 7fdf47573b80 1 -- 172.21.15.45:0/3541754151 shutdown_connections 2023-11-28T12:10:16.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.859+0000 7fdf47573b80 1 --2- 172.21.15.45:0/3541754151 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555a6cd42ff0 0x555a6ccfca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:16.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.859+0000 7fdf47573b80 1 --2- 172.21.15.45:0/3541754151 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x555a6cd25700 0x555a6ccfdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:16.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.859+0000 7fdf47573b80 1 --2- 172.21.15.45:0/3541754151 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a6cd39b60 0x555a6cd433c0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:16.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.859+0000 7fdf47573b80 1 -- 172.21.15.45:0/3541754151 >> 172.21.15.45:0/3541754151 conn(0x555a6ccf2dc0 msgr2=0x555a6ccfbfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:10:16.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.859+0000 7fdf47573b80 1 -- 172.21.15.45:0/3541754151 shutdown_connections 2023-11-28T12:10:16.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.859+0000 7fdf47573b80 1 -- 172.21.15.45:0/3541754151 wait complete. 2023-11-28T12:10:16.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.860+0000 7fdf47573b80 1 -- start start 2023-11-28T12:10:16.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.860+0000 7fdf47573b80 1 Processor -- start 2023-11-28T12:10:16.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.861+0000 7fdf47573b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a6cd25700 0x555a6cd178c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:16.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.861+0000 7fdf47573b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555a6cd39b60 0x555a6cd3d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:16.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.861+0000 7fdf47573b80 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x555a6cd42ff0 0x555a6cd3b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:16.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.861+0000 7fdf47573b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a6cc4f1c0 con 0x555a6cd25700 2023-11-28T12:10:16.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.861+0000 7fdf47573b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a6ca44430 con 0x555a6cd39b60 2023-11-28T12:10:16.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.861+0000 7fdf47573b80 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x555a6cbe73e0 con 0x555a6cd42ff0 2023-11-28T12:10:16.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.862+0000 7fdf47573b80 10 client.0 _ll_register_callbacks cb 0x555a6cbed4a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T12:10:16.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.862+0000 7fdf3199b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a6cd25700 0x555a6cd178c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:10:16.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.862+0000 7fdf3199b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a6cd25700 0x555a6cd178c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60974/0 (socket says 172.21.15.45:60974) 2023-11-28T12:10:16.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.862+0000 7fdf3199b700 1 -- 172.21.15.45:0/2389535354 learned_addr learned my addr 172.21.15.45:0/2389535354 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:10:16.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.862+0000 7fdf3119a700 1 --2- 172.21.15.45:0/2389535354 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555a6cd39b60 0x555a6cd3d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:10:16.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.862+0000 7fdf3219c700 1 --2- 172.21.15.45:0/2389535354 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x555a6cd42ff0 0x555a6cd3b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:10:16.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.862+0000 7fdf3199b700 1 -- 172.21.15.45:0/2389535354 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x555a6cd42ff0 msgr2=0x555a6cd3b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:10:16.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.862+0000 7fdf3199b700 1 --2- 172.21.15.45:0/2389535354 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x555a6cd42ff0 0x555a6cd3b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:16.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.862+0000 7fdf3199b700 1 -- 172.21.15.45:0/2389535354 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555a6cd39b60 msgr2=0x555a6cd3d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:10:16.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.862+0000 7fdf3199b700 1 --2- 172.21.15.45:0/2389535354 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555a6cd39b60 0x555a6cd3d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:16.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.862+0000 7fdf3199b700 1 -- 172.21.15.45:0/2389535354 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf1c00e040 con 0x555a6cd25700 2023-11-28T12:10:16.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.862+0000 7fdf3119a700 1 --2- 172.21.15.45:0/2389535354 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555a6cd39b60 0x555a6cd3d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:10:16.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.862+0000 7fdf3199b700 1 --2- 172.21.15.45:0/2389535354 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a6cd25700 0x555a6cd178c0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fdf280523b0 tx=0x7fdf2805e020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b7f4798b46f7217 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:10:16.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.862+0000 7fdf0cff9700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-11-28T12:10:16.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.862+0000 7fdf0cff9700 1 -- 172.21.15.45:0/2389535354 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf28007660 con 0x555a6cd25700 2023-11-28T12:10:16.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.863+0000 7fdf0cff9700 1 -- 172.21.15.45:0/2389535354 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(61..61 src has 1..61) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdf28051ca0 con 0x555a6cd25700 2023-11-28T12:10:16.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.863+0000 7fdf47573b80 1 -- 172.21.15.45:0/2389535354 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555a6cc530d0 con 0x555a6cd25700 2023-11-28T12:10:16.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.863+0000 7fdf0cff9700 1 -- 172.21.15.45:0/2389535354 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdf28051e60 con 0x555a6cd25700 2023-11-28T12:10:16.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.863+0000 7fdf47573b80 10 client.6228 fetch_fsmap learned FSMap version 33 2023-11-28T12:10:16.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.863+0000 7fdf47573b80 1 -- 172.21.15.45:0/2389535354 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=2+}) v3 -- 0x555a6cb30140 con 0x555a6cd25700 2023-11-28T12:10:16.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.863+0000 7fdf0cff9700 1 -- 172.21.15.45:0/2389535354 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555a6cc530d0 con 0x555a6cd25700 2023-11-28T12:10:16.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.863+0000 7fdf0cff9700 1 -- 172.21.15.45:0/2389535354 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 33) v1 ==== 3106+0+0 (secure 0 0 0) 0x7fdf28054e10 con 0x555a6cd25700 2023-11-28T12:10:16.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.863+0000 7fdf47573b80 10 client.6228 fetch_fsmap finished waiting for FSMap version 33 2023-11-28T12:10:16.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.863+0000 7fdf47573b80 10 client.6228 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-28T12:10:16.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.863+0000 7fdf47573b80 20 client.6228 populate_metadata read hostname 'smithi045' 2023-11-28T12:10:16.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.863+0000 7fdf47573b80 1 --2- 172.21.15.45:0/2389535354 >> [v2:172.21.15.45:6832/3784258337,v1:172.21.15.45:6833/3784258337] conn(0x555a6cd26c60 0x555a6cd27030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:16.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.863+0000 7fdf47573b80 4 client.6228 mds_command: new command op to 5979 tid=0[{"prefix": "get_command_descriptions"}] 2023-11-28T12:10:16.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.863+0000 7fdf47573b80 1 -- 172.21.15.45:0/2389535354 --> [v2:172.21.15.45:6832/3784258337,v1:172.21.15.45:6833/3784258337] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555a6ca9ef90 con 0x555a6cd26c60 2023-11-28T12:10:16.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.863+0000 7fdf3119a700 1 --2- 172.21.15.45:0/2389535354 >> [v2:172.21.15.45:6832/3784258337,v1:172.21.15.45:6833/3784258337] conn(0x555a6cd26c60 0x555a6cd27030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:10:16.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.864+0000 7fdf0cff9700 10 client.6228 ms_handle_connect on v2:172.21.15.45:6832/3784258337 2023-11-28T12:10:16.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.864+0000 7fdf3119a700 1 --2- 172.21.15.45:0/2389535354 >> [v2:172.21.15.45:6832/3784258337,v1:172.21.15.45:6833/3784258337] conn(0x555a6cd26c60 0x555a6cd27030 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2b513f1b19470 server_cookie=9ce3779c3ff81536 in_seq=0 out_seq=0 2023-11-28T12:10:16.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.864+0000 7fdf0cff9700 1 -- 172.21.15.45:0/2389535354 <== mds.0 v2:172.21.15.45:6832/3784258337 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x555a6ca9ef90 con 0x555a6cd26c60 2023-11-28T12:10:16.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.864+0000 7fdf0cff9700 10 client.6228 handle_command_reply: tid=0 2023-11-28T12:10:16.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.865+0000 7fdf47573b80 1 client.6228 shutdown 2023-11-28T12:10:16.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.865+0000 7fdf47573b80 1 -- 172.21.15.45:0/2389535354 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a6cd25700 msgr2=0x555a6cd178c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:10:16.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.865+0000 7fdf47573b80 1 --2- 172.21.15.45:0/2389535354 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a6cd25700 0x555a6cd178c0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fdf280523b0 tx=0x7fdf2805e020 comp rx=0 tx=0).stop 2023-11-28T12:10:16.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.865+0000 7fdf47573b80 1 -- 172.21.15.45:0/2389535354 shutdown_connections 2023-11-28T12:10:16.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.865+0000 7fdf47573b80 1 --2- 172.21.15.45:0/2389535354 >> [v2:172.21.15.45:6832/3784258337,v1:172.21.15.45:6833/3784258337] conn(0x555a6cd26c60 0x555a6cd27030 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:16.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.865+0000 7fdf47573b80 1 --2- 172.21.15.45:0/2389535354 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x555a6cd42ff0 0x555a6cd3b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:16.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.865+0000 7fdf47573b80 1 --2- 172.21.15.45:0/2389535354 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a6cd25700 0x555a6cd178c0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:16.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.865+0000 7fdf47573b80 1 --2- 172.21.15.45:0/2389535354 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555a6cd39b60 0x555a6cd3d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:16.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.865+0000 7fdf0cff9700 0 client.6228 ms_handle_reset on v2:172.21.15.45:6832/3784258337 2023-11-28T12:10:16.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.865+0000 7fdf47573b80 1 -- 172.21.15.45:0/2389535354 >> 172.21.15.45:0/2389535354 conn(0x555a6ccf2dc0 msgr2=0x555a6cd40b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:10:16.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.865+0000 7fdf47573b80 1 -- 172.21.15.45:0/2389535354 shutdown_connections 2023-11-28T12:10:16.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.865+0000 7fdf47573b80 1 -- 172.21.15.45:0/2389535354 wait complete. 2023-11-28T12:10:16.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.865+0000 7fdf47573b80 20 client.6228 trim_cache size 0 max 16384 2023-11-28T12:10:16.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.879+0000 7fdf47573b80 1 Processor -- start 2023-11-28T12:10:16.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.879+0000 7fdf47573b80 1 -- start start 2023-11-28T12:10:16.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.880+0000 7fdf47573b80 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x555a6cd25700 0x555a6ccfa320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:16.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.880+0000 7fdf47573b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a6cd39b60 0x555a6cd3afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:16.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.880+0000 7fdf47573b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555a6cd42ff0 0x555a6cd22730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:16.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.880+0000 7fdf47573b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a6ccfea30 con 0x555a6cd39b60 2023-11-28T12:10:16.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.880+0000 7fdf47573b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a6cd3e9e0 con 0x555a6cd42ff0 2023-11-28T12:10:16.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.880+0000 7fdf47573b80 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x555a6ccff6a0 con 0x555a6cd25700 2023-11-28T12:10:16.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.880+0000 7fdf3119a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a6cd39b60 0x555a6cd3afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:10:16.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.880+0000 7fdf3119a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a6cd39b60 0x555a6cd3afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60984/0 (socket says 172.21.15.45:60984) 2023-11-28T12:10:16.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.880+0000 7fdf3119a700 1 -- 172.21.15.45:0/3316535384 learned_addr learned my addr 172.21.15.45:0/3316535384 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:10:16.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.880+0000 7fdf3119a700 1 -- 172.21.15.45:0/3316535384 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x555a6cd25700 msgr2=0x555a6ccfa320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:10:16.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.880+0000 7fdf3119a700 1 --2- 172.21.15.45:0/3316535384 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x555a6cd25700 0x555a6ccfa320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:16.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.880+0000 7fdf3119a700 1 -- 172.21.15.45:0/3316535384 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555a6cd42ff0 msgr2=0x555a6cd22730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:10:16.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.880+0000 7fdf3119a700 1 --2- 172.21.15.45:0/3316535384 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555a6cd42ff0 0x555a6cd22730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:16.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.880+0000 7fdf3119a700 1 -- 172.21.15.45:0/3316535384 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555a6cc16380 con 0x555a6cd39b60 2023-11-28T12:10:16.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.880+0000 7fdf3119a700 1 --2- 172.21.15.45:0/3316535384 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a6cd39b60 0x555a6cd3afa0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c00d780 tx=0x7fdf1c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbec1fed269a911b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:10:16.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.881+0000 7fdf0ffff700 1 -- 172.21.15.45:0/3316535384 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf1c00ded0 con 0x555a6cd39b60 2023-11-28T12:10:16.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.881+0000 7fdf0ffff700 1 -- 172.21.15.45:0/3316535384 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf1c018070 con 0x555a6cd39b60 2023-11-28T12:10:16.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.881+0000 7fdf0ffff700 1 -- 172.21.15.45:0/3316535384 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf1c005e10 con 0x555a6cd39b60 2023-11-28T12:10:16.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.881+0000 7fdf47573b80 1 -- 172.21.15.45:0/3316535384 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a6cd39b60 msgr2=0x555a6cd3afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:10:16.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.881+0000 7fdf47573b80 1 --2- 172.21.15.45:0/3316535384 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a6cd39b60 0x555a6cd3afa0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c00d780 tx=0x7fdf1c012000 comp rx=0 tx=0).stop 2023-11-28T12:10:16.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.881+0000 7fdf47573b80 1 -- 172.21.15.45:0/3316535384 shutdown_connections 2023-11-28T12:10:16.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.881+0000 7fdf47573b80 1 --2- 172.21.15.45:0/3316535384 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555a6cd42ff0 0x555a6cd22730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:16.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.881+0000 7fdf47573b80 1 --2- 172.21.15.45:0/3316535384 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x555a6cd25700 0x555a6ccfa320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:16.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.881+0000 7fdf47573b80 1 --2- 172.21.15.45:0/3316535384 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a6cd39b60 0x555a6cd3afa0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:16.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.881+0000 7fdf47573b80 1 -- 172.21.15.45:0/3316535384 >> 172.21.15.45:0/3316535384 conn(0x555a6ccf2dc0 msgr2=0x555a6cd40b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:10:16.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.881+0000 7fdf47573b80 1 -- 172.21.15.45:0/3316535384 shutdown_connections 2023-11-28T12:10:16.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.881+0000 7fdf47573b80 1 -- 172.21.15.45:0/3316535384 wait complete. 2023-11-28T12:10:16.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.882+0000 7fdf47573b80 1 -- start start 2023-11-28T12:10:16.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.882+0000 7fdf47573b80 1 Processor -- start 2023-11-28T12:10:16.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.883+0000 7fdf47573b80 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x555a6cd25700 0x555a6cd15df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:16.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.883+0000 7fdf47573b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a6cd39b60 0x555a6cd23670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:16.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.883+0000 7fdf47573b80 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555a6cd42ff0 0x555a6cd2b360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:16.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.883+0000 7fdf47573b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a6cd16800 con 0x555a6cd39b60 2023-11-28T12:10:16.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.883+0000 7fdf47573b80 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a6cd22a10 con 0x555a6cd42ff0 2023-11-28T12:10:16.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.883+0000 7fdf47573b80 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x555a6cd46280 con 0x555a6cd25700 2023-11-28T12:10:16.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.883+0000 7fdf47573b80 10 client.0 _ll_register_callbacks cb 0x555a6cbed4a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T12:10:16.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.883+0000 7fdf3119a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a6cd39b60 0x555a6cd23670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:10:16.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.883+0000 7fdf3119a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a6cd39b60 0x555a6cd23670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60988/0 (socket says 172.21.15.45:60988) 2023-11-28T12:10:16.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.884+0000 7fdf3119a700 1 -- 172.21.15.45:0/2955210147 learned_addr learned my addr 172.21.15.45:0/2955210147 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:10:16.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.884+0000 7fdf3199b700 1 --2- 172.21.15.45:0/2955210147 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x555a6cd25700 0x555a6cd15df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:10:16.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.884+0000 7fdf3219c700 1 --2- 172.21.15.45:0/2955210147 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555a6cd42ff0 0x555a6cd2b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:10:16.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.884+0000 7fdf3119a700 1 -- 172.21.15.45:0/2955210147 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x555a6cd25700 msgr2=0x555a6cd15df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:10:16.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.884+0000 7fdf3119a700 1 --2- 172.21.15.45:0/2955210147 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x555a6cd25700 0x555a6cd15df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:16.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.884+0000 7fdf3119a700 1 -- 172.21.15.45:0/2955210147 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555a6cd42ff0 msgr2=0x555a6cd2b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:10:16.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.884+0000 7fdf3119a700 1 --2- 172.21.15.45:0/2955210147 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555a6cd42ff0 0x555a6cd2b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:16.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.884+0000 7fdf3119a700 1 -- 172.21.15.45:0/2955210147 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555a6ca43830 con 0x555a6cd39b60 2023-11-28T12:10:16.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.884+0000 7fdf3219c700 1 --2- 172.21.15.45:0/2955210147 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555a6cd42ff0 0x555a6cd2b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:10:16.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.884+0000 7fdf3119a700 1 --2- 172.21.15.45:0/2955210147 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a6cd39b60 0x555a6cd23670 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c030040 tx=0x7fdf1c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b67b52e8db15fab9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:10:16.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.884+0000 7fdf0cff9700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-11-28T12:10:16.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.884+0000 7fdf0cff9700 1 -- 172.21.15.45:0/2955210147 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf1c02d150 con 0x555a6cd39b60 2023-11-28T12:10:16.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.884+0000 7fdf47573b80 1 -- 172.21.15.45:0/2955210147 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdf1c014640 con 0x555a6cd39b60 2023-11-28T12:10:16.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.884+0000 7fdf0cff9700 1 -- 172.21.15.45:0/2955210147 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(61..61 src has 1..61) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdf1c02d2b0 con 0x555a6cd39b60 2023-11-28T12:10:16.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.885+0000 7fdf0cff9700 1 -- 172.21.15.45:0/2955210147 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdf1c02d990 con 0x555a6cd39b60 2023-11-28T12:10:16.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.885+0000 7fdf47573b80 10 client.6234 fetch_fsmap learned FSMap version 33 2023-11-28T12:10:16.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.885+0000 7fdf47573b80 1 -- 172.21.15.45:0/2955210147 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=2+}) v3 -- 0x555a6caa4270 con 0x555a6cd39b60 2023-11-28T12:10:16.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.885+0000 7fdf0cff9700 1 -- 172.21.15.45:0/2955210147 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf1c014640 con 0x555a6cd39b60 2023-11-28T12:10:16.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.885+0000 7fdf0cff9700 1 -- 172.21.15.45:0/2955210147 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 33) v1 ==== 3106+0+0 (secure 0 0 0) 0x7fdf1c02daf0 con 0x555a6cd39b60 2023-11-28T12:10:16.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.885+0000 7fdf47573b80 10 client.6234 fetch_fsmap finished waiting for FSMap version 33 2023-11-28T12:10:16.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.885+0000 7fdf47573b80 10 client.6234 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-28T12:10:16.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.885+0000 7fdf47573b80 20 client.6234 populate_metadata read hostname 'smithi045' 2023-11-28T12:10:16.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.885+0000 7fdf47573b80 1 --2- 172.21.15.45:0/2955210147 >> [v2:172.21.15.45:6832/3784258337,v1:172.21.15.45:6833/3784258337] conn(0x555a6cd24990 0x555a6cd2b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:16.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.885+0000 7fdf47573b80 4 client.6234 mds_command: new command op to 5979 tid=0[{"prefix": "damage ls", "format": "json-pretty"}] 2023-11-28T12:10:16.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.885+0000 7fdf47573b80 1 -- 172.21.15.45:0/2955210147 --> [v2:172.21.15.45:6832/3784258337,v1:172.21.15.45:6833/3784258337] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) v1 -- 0x555a6cad40e0 con 0x555a6cd24990 2023-11-28T12:10:16.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.885+0000 7fdf3199b700 1 --2- 172.21.15.45:0/2955210147 >> [v2:172.21.15.45:6832/3784258337,v1:172.21.15.45:6833/3784258337] conn(0x555a6cd24990 0x555a6cd2b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:10:16.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.886+0000 7fdf3199b700 1 --2- 172.21.15.45:0/2955210147 >> [v2:172.21.15.45:6832/3784258337,v1:172.21.15.45:6833/3784258337] conn(0x555a6cd24990 0x555a6cd2b8a0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84068d350429434a server_cookie=4b1ba166d995b06a in_seq=0 out_seq=0 2023-11-28T12:10:16.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.886+0000 7fdf0cff9700 10 client.6234 ms_handle_connect on v2:172.21.15.45:6832/3784258337 2023-11-28T12:10:16.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.886+0000 7fdf0cff9700 1 -- 172.21.15.45:0/2955210147 <== mds.0 v2:172.21.15.45:6832/3784258337 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+140 (crc 0 0 0) 0x555a6cad40e0 con 0x555a6cd24990 2023-11-28T12:10:16.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.886+0000 7fdf0cff9700 10 client.6234 handle_command_reply: tid=0 2023-11-28T12:10:16.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.886+0000 7fdf47573b80 1 client.6234 shutdown 2023-11-28T12:10:16.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.886+0000 7fdf47573b80 1 -- 172.21.15.45:0/2955210147 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a6cd39b60 msgr2=0x555a6cd23670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:10:16.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.886+0000 7fdf47573b80 1 --2- 172.21.15.45:0/2955210147 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a6cd39b60 0x555a6cd23670 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c030040 tx=0x7fdf1c004750 comp rx=0 tx=0).stop 2023-11-28T12:10:16.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.886+0000 7fdf47573b80 1 -- 172.21.15.45:0/2955210147 shutdown_connections 2023-11-28T12:10:16.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.886+0000 7fdf47573b80 1 --2- 172.21.15.45:0/2955210147 >> [v2:172.21.15.45:6832/3784258337,v1:172.21.15.45:6833/3784258337] conn(0x555a6cd24990 0x555a6cd2b8a0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:16.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.886+0000 7fdf47573b80 1 --2- 172.21.15.45:0/2955210147 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x555a6cd42ff0 0x555a6cd2b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:16.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.886+0000 7fdf47573b80 1 --2- 172.21.15.45:0/2955210147 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x555a6cd25700 0x555a6cd15df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:16.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.886+0000 7fdf0cff9700 0 client.6234 ms_handle_reset on v2:172.21.15.45:6832/3784258337 2023-11-28T12:10:16.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.886+0000 7fdf47573b80 1 --2- 172.21.15.45:0/2955210147 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a6cd39b60 0x555a6cd23670 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:16.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.886+0000 7fdf47573b80 1 -- 172.21.15.45:0/2955210147 >> 172.21.15.45:0/2955210147 conn(0x555a6ccf2dc0 msgr2=0x555a6cd3b060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:10:16.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.886+0000 7fdf47573b80 1 -- 172.21.15.45:0/2955210147 shutdown_connections 2023-11-28T12:10:16.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.886+0000 7fdf47573b80 1 -- 172.21.15.45:0/2955210147 wait complete. 2023-11-28T12:10:16.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.887+0000 7fdf47573b80 20 client.6234 trim_cache size 0 max 16384 2023-11-28T12:10:16.895 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:10:16.895 INFO:teuthology.orchestra.run.smithi045.stdout:[ 2023-11-28T12:10:16.895 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-11-28T12:10:16.895 INFO:teuthology.orchestra.run.smithi045.stdout: "damage_type": "backtrace", 2023-11-28T12:10:16.896 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 803455739, 2023-11-28T12:10:16.896 INFO:teuthology.orchestra.run.smithi045.stdout: "ino": 1099511627777, 2023-11-28T12:10:16.896 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/dir_test/file" 2023-11-28T12:10:16.896 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-11-28T12:10:16.896 INFO:teuthology.orchestra.run.smithi045.stdout:] 2023-11-28T12:10:16.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.887+0000 7fdf33bff700 1 -- 172.21.15.45:0/1436265863 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fdf100682f0 msgr2=0x7fdf1006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:10:16.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.887+0000 7fdf33bff700 1 --2- 172.21.15.45:0/1436265863 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fdf100682f0 0x7fdf1006a7a0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c006fd0 tx=0x7fdf1c008040 comp rx=0 tx=0).stop 2023-11-28T12:10:16.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.887+0000 7fdf33bff700 1 -- 172.21.15.45:0/1436265863 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf2c0d2320 msgr2=0x7fdf2c1570e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:10:16.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.887+0000 7fdf33bff700 1 --2- 172.21.15.45:0/1436265863 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf2c0d2320 0x7fdf2c1570e0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fdf2800c550 tx=0x7fdf2800c910 comp rx=0 tx=0).stop 2023-11-28T12:10:16.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.887+0000 7fdf33bff700 1 -- 172.21.15.45:0/1436265863 shutdown_connections 2023-11-28T12:10:16.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.887+0000 7fdf33bff700 1 --2- 172.21.15.45:0/1436265863 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fdf100682f0 0x7fdf1006a7a0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:16.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.887+0000 7fdf33bff700 1 --2- 172.21.15.45:0/1436265863 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdf2c161340 0x7fdf2c15f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:16.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.887+0000 7fdf33bff700 1 --2- 172.21.15.45:0/1436265863 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf2c0d2320 0x7fdf2c1570e0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:16.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.887+0000 7fdf33bff700 1 --2- 172.21.15.45:0/1436265863 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf2c15c9b0 0x7fdf2c1e7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:16.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.887+0000 7fdf33bff700 1 -- 172.21.15.45:0/1436265863 >> 172.21.15.45:0/1436265863 conn(0x7fdf2c072600 msgr2=0x7fdf2c0ce7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:10:16.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.887+0000 7fdf33bff700 1 -- 172.21.15.45:0/1436265863 shutdown_connections 2023-11-28T12:10:16.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:16.887+0000 7fdf33bff700 1 -- 172.21.15.45:0/1436265863 wait complete. 2023-11-28T12:10:16.906 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T12:10:17.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:17.108+0000 7f29277ff700 1 Processor -- start 2023-11-28T12:10:17.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:17.108+0000 7f29277ff700 1 -- start start 2023-11-28T12:10:17.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:17.109+0000 7f29277ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f292015c9b0 0x7f29200b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:17.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:17.109+0000 7f29277ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2920161340 0x7f29200d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:17.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:17.110+0000 7f29277ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29200d1950 con 0x7f29200d2320 2023-11-28T12:10:17.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:17.110+0000 7f29277ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29200b5800 con 0x7f2920161340 2023-11-28T12:10:17.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:17.110+0000 7f29277ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29200b5520 con 0x7f292015c9b0 2023-11-28T12:10:17.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:17.110+0000 7f2924d9a700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2920161340 0x7f29200d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:10:17.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:17.110+0000 7f2924d9a700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2920161340 0x7f29200d1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60998/0 (socket says 172.21.15.45:60998) 2023-11-28T12:10:17.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:17.110+0000 7f2924d9a700 1 -- 172.21.15.45:0/306048214 learned_addr learned my addr 172.21.15.45:0/306048214 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:10:17.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:17.110+0000 7f292559b700 1 --2- 172.21.15.45:0/306048214 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f292015c9b0 0x7f29200b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:10:17.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:17.110+0000 7f2924d9a700 1 -- 172.21.15.45:0/306048214 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f292015c9b0 msgr2=0x7f29200b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:10:17.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:17.110+0000 7f2924d9a700 1 --2- 172.21.15.45:0/306048214 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f292015c9b0 0x7f29200b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:17.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:17.110+0000 7f2924d9a700 1 -- 172.21.15.45:0/306048214 >> v1:172.21.15.45:6789/0 conn(0x7f29200d2320 legacy=0x7f29200cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:10:17.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:17.110+0000 7f2924d9a700 1 -- 172.21.15.45:0/306048214 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29200d1300 con 0x7f2920161340 2023-11-28T12:10:17.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:17.110+0000 7f2917fff700 1 -- 172.21.15.45:0/306048214 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 360600516 0 0) 0x7f29200d1950 con 0x7f29200d2320 2023-11-28T12:10:17.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:17.111+0000 7f2924d9a700 1 --2- 172.21.15.45:0/306048214 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2920161340 0x7f29200d1de0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f29100098f0 tx=0x7f2910009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc3004f1f86d18c5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:10:17.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:17.111+0000 7f2917fff700 1 -- 172.21.15.45:0/306048214 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2910011830 con 0x7f2920161340 2023-11-28T12:10:17.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:17.111+0000 7f2917fff700 1 -- 172.21.15.45:0/306048214 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2910011990 con 0x7f2920161340 2023-11-28T12:10:17.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:17.111+0000 7f2917fff700 1 -- 172.21.15.45:0/306048214 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2910011d20 con 0x7f2920161340 2023-11-28T12:10:17.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:17.111+0000 7f29277ff700 1 -- 172.21.15.45:0/306048214 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2920161340 msgr2=0x7f29200d1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:10:17.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:17.111+0000 7f29277ff700 1 --2- 172.21.15.45:0/306048214 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2920161340 0x7f29200d1de0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f29100098f0 tx=0x7f2910009c00 comp rx=0 tx=0).stop 2023-11-28T12:10:17.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:17.111+0000 7f29277ff700 1 -- 172.21.15.45:0/306048214 shutdown_connections 2023-11-28T12:10:17.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:17.111+0000 7f29277ff700 1 --2- 172.21.15.45:0/306048214 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f292015c9b0 0x7f29200b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:17.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:17.111+0000 7f29277ff700 1 --2- 172.21.15.45:0/306048214 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2920161340 0x7f29200d1de0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:17.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:17.111+0000 7f29277ff700 1 -- 172.21.15.45:0/306048214 >> 172.21.15.45:0/306048214 conn(0x7f2920072600 msgr2=0x7f29200cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:10:17.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:17.112+0000 7f29277ff700 1 -- 172.21.15.45:0/306048214 shutdown_connections 2023-11-28T12:10:17.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:17.112+0000 7f29277ff700 1 -- 172.21.15.45:0/306048214 wait complete. 2023-11-28T12:10:17.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:17.113+0000 7f29277ff700 1 Processor -- start 2023-11-28T12:10:17.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:17.114+0000 7f29277ff700 1 -- start start 2023-11-28T12:10:17.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:17.114+0000 7f29277ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29200d2320 0x7f29201e7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:17.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:17.114+0000 7f29277ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f292015c9b0 0x7f29200b7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:17.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:17.115+0000 7f29277ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2920161340 0x7f29200b77b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:17.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:17.115+0000 7f29277ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2920140e10 con 0x7f29200d2320 2023-11-28T12:10:17.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:17.115+0000 7f29277ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29201e8430 con 0x7f292015c9b0 2023-11-28T12:10:17.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:17.115+0000 7f29277ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29201e6460 con 0x7f2920161340 2023-11-28T12:10:17.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:17.115+0000 7f292559b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29200d2320 0x7f29201e7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:10:17.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:17.115+0000 7f292559b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29200d2320 0x7f29201e7ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:32774/0 (socket says 172.21.15.45:32774) 2023-11-28T12:10:17.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:17.115+0000 7f292559b700 1 -- 172.21.15.45:0/1269332825 learned_addr learned my addr 172.21.15.45:0/1269332825 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:10:17.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:17.115+0000 7f292559b700 1 -- 172.21.15.45:0/1269332825 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2920161340 msgr2=0x7f29200b77b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:10:17.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:17.115+0000 7f292559b700 1 --2- 172.21.15.45:0/1269332825 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2920161340 0x7f29200b77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:17.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:17.115+0000 7f292559b700 1 -- 172.21.15.45:0/1269332825 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f292015c9b0 msgr2=0x7f29200b7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:10:17.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:17.115+0000 7f292559b700 1 --2- 172.21.15.45:0/1269332825 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f292015c9b0 0x7f29200b7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:17.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:17.115+0000 7f292559b700 1 -- 172.21.15.45:0/1269332825 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2910009550 con 0x7f29200d2320 2023-11-28T12:10:17.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:17.115+0000 7f292559b700 1 --2- 172.21.15.45:0/1269332825 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29200d2320 0x7f29201e7ef0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f291c00e9e0 tx=0x7f291c00eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:10:17.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:17.116+0000 7f2915ffb700 1 -- 172.21.15.45:0/1269332825 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f291c009710 con 0x7f29200d2320 2023-11-28T12:10:17.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:17.116+0000 7f2915ffb700 1 -- 172.21.15.45:0/1269332825 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f291c00c850 con 0x7f29200d2320 2023-11-28T12:10:17.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:17.116+0000 7f2915ffb700 1 -- 172.21.15.45:0/1269332825 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f291c00cbc0 con 0x7f29200d2320 2023-11-28T12:10:17.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:17.116+0000 7f29277ff700 1 -- 172.21.15.45:0/1269332825 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29200b5130 con 0x7f29200d2320 2023-11-28T12:10:17.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:17.116+0000 7f29277ff700 1 -- 172.21.15.45:0/1269332825 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29200d15e0 con 0x7f29200d2320 2023-11-28T12:10:17.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:17.117+0000 7f29277ff700 1 -- 172.21.15.45:0/1269332825 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29200b52c0 con 0x7f29200d2320 2023-11-28T12:10:17.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:17.118+0000 7f2915ffb700 1 -- 172.21.15.45:0/1269332825 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f291c019030 con 0x7f29200d2320 2023-11-28T12:10:17.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:17.119+0000 7f2915ffb700 1 --2- 172.21.15.45:0/1269332825 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f29040682f0 0x7f290406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:17.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:17.119+0000 7f2915ffb700 1 -- 172.21.15.45:0/1269332825 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f291c085e80 con 0x7f29200d2320 2023-11-28T12:10:17.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:17.119+0000 7f2924d9a700 1 --2- 172.21.15.45:0/1269332825 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f29040682f0 0x7f290406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:10:17.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:17.120+0000 7f2924d9a700 1 --2- 172.21.15.45:0/1269332825 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f29040682f0 0x7f290406a7a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f2910000c00 tx=0x7f2910010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:10:17.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:17.124+0000 7f2915ffb700 1 -- 172.21.15.45:0/1269332825 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f291c052500 con 0x7f29200d2320 2023-11-28T12:10:17.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:17.373+0000 7f29277ff700 1 -- 172.21.15.45:0/1269332825 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f29200b9150 con 0x7f29200d2320 2023-11-28T12:10:17.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:17.373+0000 7f2915ffb700 1 -- 172.21.15.45:0/1269332825 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7f291c0210c0 con 0x7f29200d2320 2023-11-28T12:10:17.375 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:10:17.375 INFO:teuthology.orchestra.run.smithi045.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-28T12:10:17.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:17.375+0000 7f29277ff700 1 -- 172.21.15.45:0/1269332825 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f29040682f0 msgr2=0x7f290406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:10:17.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:17.375+0000 7f29277ff700 1 --2- 172.21.15.45:0/1269332825 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f29040682f0 0x7f290406a7a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f2910000c00 tx=0x7f2910010000 comp rx=0 tx=0).stop 2023-11-28T12:10:17.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:17.375+0000 7f29277ff700 1 -- 172.21.15.45:0/1269332825 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29200d2320 msgr2=0x7f29201e7ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:10:17.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:17.375+0000 7f29277ff700 1 --2- 172.21.15.45:0/1269332825 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29200d2320 0x7f29201e7ef0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f291c00e9e0 tx=0x7f291c00eda0 comp rx=0 tx=0).stop 2023-11-28T12:10:17.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:17.376+0000 7f29277ff700 1 -- 172.21.15.45:0/1269332825 shutdown_connections 2023-11-28T12:10:17.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:17.376+0000 7f29277ff700 1 --2- 172.21.15.45:0/1269332825 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f29040682f0 0x7f290406a7a0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:17.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:17.376+0000 7f29277ff700 1 --2- 172.21.15.45:0/1269332825 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2920161340 0x7f29200b77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:17.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:17.376+0000 7f29277ff700 1 --2- 172.21.15.45:0/1269332825 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29200d2320 0x7f29201e7ef0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:17.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:17.376+0000 7f29277ff700 1 --2- 172.21.15.45:0/1269332825 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f292015c9b0 0x7f29200b7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:17.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:17.376+0000 7f29277ff700 1 -- 172.21.15.45:0/1269332825 >> 172.21.15.45:0/1269332825 conn(0x7f2920072600 msgr2=0x7f2920160610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:10:17.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:17.376+0000 7f29277ff700 1 -- 172.21.15.45:0/1269332825 shutdown_connections 2023-11-28T12:10:17.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:17.376+0000 7f29277ff700 1 -- 172.21.15.45:0/1269332825 wait complete. 2023-11-28T12:10:17.395 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=100 retry_count=0)... 2023-11-28T12:10:22.397 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T12:10:22.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:22.610+0000 7f7aa77ff700 1 Processor -- start 2023-11-28T12:10:22.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:22.610+0000 7f7aa77ff700 1 -- start start 2023-11-28T12:10:22.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:22.611+0000 7f7aa77ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7aa015c9b0 0x7f7aa00b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:22.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:22.611+0000 7f7aa77ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7aa00cd7c0 0x7f7aa00cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:22.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:22.611+0000 7f7aa77ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7aa00d1950 con 0x7f7aa0161340 2023-11-28T12:10:22.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:22.611+0000 7f7aa77ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7aa00b5800 con 0x7f7aa015c9b0 2023-11-28T12:10:22.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:22.611+0000 7f7aa77ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa00ce140 con 0x7f7aa00cd7c0 2023-11-28T12:10:22.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:22.612+0000 7f7aa559b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7aa015c9b0 0x7f7aa00b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:10:22.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:22.612+0000 7f7aa559b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7aa015c9b0 0x7f7aa00b4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38852/0 (socket says 172.21.15.45:38852) 2023-11-28T12:10:22.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:22.612+0000 7f7aa559b700 1 -- 172.21.15.45:0/1925589300 learned_addr learned my addr 172.21.15.45:0/1925589300 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:10:22.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:22.612+0000 7f7aa5d9c700 1 --2- 172.21.15.45:0/1925589300 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7aa00cd7c0 0x7f7aa00cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:10:22.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:22.612+0000 7f7aa559b700 1 -- 172.21.15.45:0/1925589300 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7aa00cd7c0 msgr2=0x7f7aa00cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:10:22.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:22.612+0000 7f7aa559b700 1 --2- 172.21.15.45:0/1925589300 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7aa00cd7c0 0x7f7aa00cdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:22.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:22.612+0000 7f7aa559b700 1 -- 172.21.15.45:0/1925589300 >> v1:172.21.15.152:6789/0 conn(0x7f7aa0161340 legacy=0x7f7aa00d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:10:22.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:22.612+0000 7f7aa559b700 1 -- 172.21.15.45:0/1925589300 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aa00d24f0 con 0x7f7aa015c9b0 2023-11-28T12:10:22.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:22.612+0000 7f7aa559b700 1 --2- 172.21.15.45:0/1925589300 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7aa015c9b0 0x7f7aa00b4bf0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c0098f0 tx=0x7f7a9c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8013a322922a1e64 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:10:22.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:22.613+0000 7f7a97fff700 1 -- 172.21.15.45:0/1925589300 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a9c011830 con 0x7f7aa015c9b0 2023-11-28T12:10:22.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:22.613+0000 7f7a97fff700 1 -- 172.21.15.45:0/1925589300 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a9c011990 con 0x7f7aa015c9b0 2023-11-28T12:10:22.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:22.613+0000 7f7a97fff700 1 -- 172.21.15.45:0/1925589300 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a9c011d20 con 0x7f7aa015c9b0 2023-11-28T12:10:22.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:22.613+0000 7f7aa77ff700 1 -- 172.21.15.45:0/1925589300 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7aa015c9b0 msgr2=0x7f7aa00b4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:10:22.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:22.613+0000 7f7aa77ff700 1 --2- 172.21.15.45:0/1925589300 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7aa015c9b0 0x7f7aa00b4bf0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c0098f0 tx=0x7f7a9c009c00 comp rx=0 tx=0).stop 2023-11-28T12:10:22.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:22.613+0000 7f7aa77ff700 1 -- 172.21.15.45:0/1925589300 shutdown_connections 2023-11-28T12:10:22.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:22.613+0000 7f7aa77ff700 1 --2- 172.21.15.45:0/1925589300 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7aa00cd7c0 0x7f7aa00cdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:22.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:22.613+0000 7f7aa77ff700 1 --2- 172.21.15.45:0/1925589300 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7aa015c9b0 0x7f7aa00b4bf0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:22.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:22.613+0000 7f7aa77ff700 1 -- 172.21.15.45:0/1925589300 >> 172.21.15.45:0/1925589300 conn(0x7f7aa0072600 msgr2=0x7f7aa00cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:10:22.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:22.613+0000 7f7aa77ff700 1 -- 172.21.15.45:0/1925589300 shutdown_connections 2023-11-28T12:10:22.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:22.613+0000 7f7aa77ff700 1 -- 172.21.15.45:0/1925589300 wait complete. 2023-11-28T12:10:22.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:22.615+0000 7f7aa77ff700 1 Processor -- start 2023-11-28T12:10:22.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:22.615+0000 7f7aa77ff700 1 -- start start 2023-11-28T12:10:22.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:22.616+0000 7f7aa77ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7aa00cd7c0 0x7f7aa0147430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:22.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:22.616+0000 7f7aa77ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7aa015c9b0 0x7f7aa01e6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:22.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:22.616+0000 7f7aa77ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7aa0161340 0x7f7aa0159560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:22.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:22.616+0000 7f7aa77ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa00c6780 con 0x7f7aa015c9b0 2023-11-28T12:10:22.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:22.616+0000 7f7aa77ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa0147970 con 0x7f7aa0161340 2023-11-28T12:10:22.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:22.616+0000 7f7aa77ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa01e6d60 con 0x7f7aa00cd7c0 2023-11-28T12:10:22.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:22.616+0000 7f7aa4d9a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7aa015c9b0 0x7f7aa01e6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:10:22.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:22.616+0000 7f7aa4d9a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7aa015c9b0 0x7f7aa01e6480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38858/0 (socket says 172.21.15.45:38858) 2023-11-28T12:10:22.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:22.617+0000 7f7aa4d9a700 1 -- 172.21.15.45:0/910018471 learned_addr learned my addr 172.21.15.45:0/910018471 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:10:22.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:22.617+0000 7f7aa559b700 1 --2- 172.21.15.45:0/910018471 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7aa00cd7c0 0x7f7aa0147430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:10:22.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:22.617+0000 7f7aa5d9c700 1 --2- 172.21.15.45:0/910018471 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7aa0161340 0x7f7aa0159560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:10:22.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:22.617+0000 7f7aa4d9a700 1 -- 172.21.15.45:0/910018471 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7aa00cd7c0 msgr2=0x7f7aa0147430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:10:22.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:22.617+0000 7f7aa4d9a700 1 --2- 172.21.15.45:0/910018471 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7aa00cd7c0 0x7f7aa0147430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:22.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:22.617+0000 7f7aa4d9a700 1 -- 172.21.15.45:0/910018471 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7aa0161340 msgr2=0x7f7aa0159560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:10:22.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:22.617+0000 7f7aa4d9a700 1 --2- 172.21.15.45:0/910018471 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7aa0161340 0x7f7aa0159560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:22.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:22.617+0000 7f7aa4d9a700 1 -- 172.21.15.45:0/910018471 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a9c009550 con 0x7f7aa015c9b0 2023-11-28T12:10:22.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:22.617+0000 7f7aa559b700 1 --2- 172.21.15.45:0/910018471 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7aa00cd7c0 0x7f7aa0147430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:10:22.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:22.617+0000 7f7aa4d9a700 1 --2- 172.21.15.45:0/910018471 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7aa015c9b0 0x7f7aa01e6480 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f7a9000c4e0 tx=0x7f7a9000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:10:22.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:22.617+0000 7f7a95ffb700 1 -- 172.21.15.45:0/910018471 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a900052d0 con 0x7f7aa015c9b0 2023-11-28T12:10:22.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:22.617+0000 7f7a95ffb700 1 -- 172.21.15.45:0/910018471 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a90005430 con 0x7f7aa015c9b0 2023-11-28T12:10:22.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:22.617+0000 7f7a95ffb700 1 -- 172.21.15.45:0/910018471 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a900038c0 con 0x7f7aa015c9b0 2023-11-28T12:10:22.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:22.617+0000 7f7aa77ff700 1 -- 172.21.15.45:0/910018471 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7aa00d1300 con 0x7f7aa015c9b0 2023-11-28T12:10:22.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:22.618+0000 7f7aa77ff700 1 -- 172.21.15.45:0/910018471 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7aa00b5520 con 0x7f7aa015c9b0 2023-11-28T12:10:22.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:22.619+0000 7f7aa77ff700 1 -- 172.21.15.45:0/910018471 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7aa00d15e0 con 0x7f7aa015c9b0 2023-11-28T12:10:22.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:22.619+0000 7f7a95ffb700 1 -- 172.21.15.45:0/910018471 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f7a90019030 con 0x7f7aa015c9b0 2023-11-28T12:10:22.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:22.620+0000 7f7a95ffb700 1 --2- 172.21.15.45:0/910018471 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f7a840682f0 0x7f7a8406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:22.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:22.620+0000 7f7a95ffb700 1 -- 172.21.15.45:0/910018471 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f7a90085180 con 0x7f7aa015c9b0 2023-11-28T12:10:22.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:22.621+0000 7f7aa559b700 1 --2- 172.21.15.45:0/910018471 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f7a840682f0 0x7f7a8406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:10:22.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:22.621+0000 7f7aa559b700 1 --2- 172.21.15.45:0/910018471 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f7a840682f0 0x7f7a8406a7a0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c014040 tx=0x7f7a9c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:10:22.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:22.625+0000 7f7a95ffb700 1 -- 172.21.15.45:0/910018471 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f7a90051860 con 0x7f7aa015c9b0 2023-11-28T12:10:22.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:22.869+0000 7f7aa77ff700 1 -- 172.21.15.45:0/910018471 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f7aa00745c0 con 0x7f7aa015c9b0 2023-11-28T12:10:22.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:22.870+0000 7f7a95ffb700 1 -- 172.21.15.45:0/910018471 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7f7a90054e80 con 0x7f7aa015c9b0 2023-11-28T12:10:22.870 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:10:22.871 INFO:teuthology.orchestra.run.smithi045.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-28T12:10:22.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:22.872+0000 7f7aa77ff700 1 -- 172.21.15.45:0/910018471 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f7a840682f0 msgr2=0x7f7a8406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:10:22.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:22.872+0000 7f7aa77ff700 1 --2- 172.21.15.45:0/910018471 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f7a840682f0 0x7f7a8406a7a0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c014040 tx=0x7f7a9c008030 comp rx=0 tx=0).stop 2023-11-28T12:10:22.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:22.872+0000 7f7aa77ff700 1 -- 172.21.15.45:0/910018471 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7aa015c9b0 msgr2=0x7f7aa01e6480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:10:22.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:22.872+0000 7f7aa77ff700 1 --2- 172.21.15.45:0/910018471 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7aa015c9b0 0x7f7aa01e6480 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f7a9000c4e0 tx=0x7f7a9000c8a0 comp rx=0 tx=0).stop 2023-11-28T12:10:22.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:22.872+0000 7f7aa77ff700 1 -- 172.21.15.45:0/910018471 shutdown_connections 2023-11-28T12:10:22.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:22.872+0000 7f7aa77ff700 1 --2- 172.21.15.45:0/910018471 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f7a840682f0 0x7f7a8406a7a0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:22.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:22.872+0000 7f7aa77ff700 1 --2- 172.21.15.45:0/910018471 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7aa0161340 0x7f7aa0159560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:22.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:22.872+0000 7f7aa77ff700 1 --2- 172.21.15.45:0/910018471 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7aa00cd7c0 0x7f7aa0147430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:22.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:22.872+0000 7f7aa77ff700 1 --2- 172.21.15.45:0/910018471 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7aa015c9b0 0x7f7aa01e6480 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:22.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:22.872+0000 7f7aa77ff700 1 -- 172.21.15.45:0/910018471 >> 172.21.15.45:0/910018471 conn(0x7f7aa0072600 msgr2=0x7f7aa00b5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:10:22.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:22.872+0000 7f7aa77ff700 1 -- 172.21.15.45:0/910018471 shutdown_connections 2023-11-28T12:10:22.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:22.872+0000 7f7aa77ff700 1 -- 172.21.15.45:0/910018471 wait complete. 2023-11-28T12:10:22.894 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=100 retry_count=0)... 2023-11-28T12:10:27.895 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T12:10:28.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:28.109+0000 7f57b91ff700 1 Processor -- start 2023-11-28T12:10:28.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:28.109+0000 7f57b91ff700 1 -- start start 2023-11-28T12:10:28.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:28.110+0000 7f57b91ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f57b415c9b0 0x7f57b40b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:28.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:28.110+0000 7f57b91ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f57b4161340 0x7f57b40d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:28.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:28.110+0000 7f57b91ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57b40d1950 con 0x7f57b40d2320 2023-11-28T12:10:28.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:28.110+0000 7f57b91ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57b40b5800 con 0x7f57b415c9b0 2023-11-28T12:10:28.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:28.110+0000 7f57b91ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57b40b5520 con 0x7f57b4161340 2023-11-28T12:10:28.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:28.111+0000 7f57b2d9d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f57b415c9b0 0x7f57b40b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:10:28.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:28.111+0000 7f57b359e700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f57b40d2320 0x7f57b40cd7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:45776/0 (socket says 172.21.15.45:45776) 2023-11-28T12:10:28.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:28.111+0000 7f57b359e700 1 -- 172.21.15.45:0/1503218599 learned_addr learned my addr 172.21.15.45:0/1503218599 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:10:28.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:28.111+0000 7f57b259c700 1 --2- 172.21.15.45:0/1503218599 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f57b4161340 0x7f57b40d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:10:28.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:28.111+0000 7f57b2d9d700 1 -- 172.21.15.45:0/1503218599 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f57b4161340 msgr2=0x7f57b40d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:10:28.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:28.111+0000 7f57b2d9d700 1 --2- 172.21.15.45:0/1503218599 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f57b4161340 0x7f57b40d1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:28.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:28.111+0000 7f57b2d9d700 1 -- 172.21.15.45:0/1503218599 >> v1:172.21.15.45:6789/0 conn(0x7f57b40d2320 legacy=0x7f57b40cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:10:28.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:28.111+0000 7f57b2d9d700 1 -- 172.21.15.45:0/1503218599 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57b40d1300 con 0x7f57b415c9b0 2023-11-28T12:10:28.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:28.112+0000 7f57b2d9d700 1 --2- 172.21.15.45:0/1503218599 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57b415c9b0 0x7f57b40b4bf0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f57a4009840 tx=0x7f57a4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c50b943ae2362304 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:10:28.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:28.112+0000 7f57b1d9b700 1 -- 172.21.15.45:0/1503218599 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a4011830 con 0x7f57b415c9b0 2023-11-28T12:10:28.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:28.112+0000 7f57b1d9b700 1 -- 172.21.15.45:0/1503218599 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57a4011990 con 0x7f57b415c9b0 2023-11-28T12:10:28.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:28.112+0000 7f57b1d9b700 1 -- 172.21.15.45:0/1503218599 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a4011d20 con 0x7f57b415c9b0 2023-11-28T12:10:28.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:28.112+0000 7f57b91ff700 1 -- 172.21.15.45:0/1503218599 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57b415c9b0 msgr2=0x7f57b40b4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:10:28.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:28.112+0000 7f57b91ff700 1 --2- 172.21.15.45:0/1503218599 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57b415c9b0 0x7f57b40b4bf0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f57a4009840 tx=0x7f57a4009b50 comp rx=0 tx=0).stop 2023-11-28T12:10:28.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:28.112+0000 7f57b91ff700 1 -- 172.21.15.45:0/1503218599 shutdown_connections 2023-11-28T12:10:28.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:28.112+0000 7f57b91ff700 1 --2- 172.21.15.45:0/1503218599 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57b415c9b0 0x7f57b40b4bf0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:28.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:28.112+0000 7f57b91ff700 1 --2- 172.21.15.45:0/1503218599 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f57b4161340 0x7f57b40d1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:28.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:28.112+0000 7f57b91ff700 1 -- 172.21.15.45:0/1503218599 >> 172.21.15.45:0/1503218599 conn(0x7f57b4072600 msgr2=0x7f57b40cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:10:28.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:28.112+0000 7f57b91ff700 1 -- 172.21.15.45:0/1503218599 shutdown_connections 2023-11-28T12:10:28.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:28.113+0000 7f57b91ff700 1 -- 172.21.15.45:0/1503218599 wait complete. 2023-11-28T12:10:28.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:28.114+0000 7f57b91ff700 1 Processor -- start 2023-11-28T12:10:28.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:28.114+0000 7f57b91ff700 1 -- start start 2023-11-28T12:10:28.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:28.115+0000 7f57b91ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57b40d2320 0x7f57b4151cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:28.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:28.115+0000 7f57b91ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57b415c9b0 0x7f57b4154f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:28.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:28.115+0000 7f57b91ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f57b4161340 0x7f57b414cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:28.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:28.115+0000 7f57b91ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57b41554a0 con 0x7f57b415c9b0 2023-11-28T12:10:28.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:28.115+0000 7f57b91ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57b41529b0 con 0x7f57b40d2320 2023-11-28T12:10:28.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:28.115+0000 7f57b91ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57b41523f0 con 0x7f57b4161340 2023-11-28T12:10:28.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:28.115+0000 7f57b259c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57b415c9b0 0x7f57b4154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:10:28.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:28.116+0000 7f57b259c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57b415c9b0 0x7f57b4154f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38886/0 (socket says 172.21.15.45:38886) 2023-11-28T12:10:28.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:28.116+0000 7f57b259c700 1 -- 172.21.15.45:0/8788080 learned_addr learned my addr 172.21.15.45:0/8788080 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:10:28.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:28.116+0000 7f57b359e700 1 --2- 172.21.15.45:0/8788080 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f57b4161340 0x7f57b414cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:10:28.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:28.116+0000 7f57b2d9d700 1 --2- 172.21.15.45:0/8788080 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57b40d2320 0x7f57b4151cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:10:28.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:28.116+0000 7f57b259c700 1 -- 172.21.15.45:0/8788080 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f57b4161340 msgr2=0x7f57b414cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:10:28.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:28.116+0000 7f57b259c700 1 --2- 172.21.15.45:0/8788080 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f57b4161340 0x7f57b414cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:28.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:28.116+0000 7f57b259c700 1 -- 172.21.15.45:0/8788080 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57b40d2320 msgr2=0x7f57b4151cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:10:28.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:28.116+0000 7f57b259c700 1 --2- 172.21.15.45:0/8788080 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57b40d2320 0x7f57b4151cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:28.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:28.116+0000 7f57b259c700 1 -- 172.21.15.45:0/8788080 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57a40094a0 con 0x7f57b415c9b0 2023-11-28T12:10:28.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:28.116+0000 7f57b259c700 1 --2- 172.21.15.45:0/8788080 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57b415c9b0 0x7f57b4154f60 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f57a800e810 tx=0x7f57a800eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:10:28.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:28.116+0000 7f579b7fe700 1 -- 172.21.15.45:0/8788080 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a800c070 con 0x7f57b415c9b0 2023-11-28T12:10:28.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:28.117+0000 7f57b91ff700 1 -- 172.21.15.45:0/8788080 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57b40b5130 con 0x7f57b415c9b0 2023-11-28T12:10:28.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:28.117+0000 7f579b7fe700 1 -- 172.21.15.45:0/8788080 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57a8013610 con 0x7f57b415c9b0 2023-11-28T12:10:28.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:28.117+0000 7f579b7fe700 1 -- 172.21.15.45:0/8788080 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a80139c0 con 0x7f57b415c9b0 2023-11-28T12:10:28.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:28.117+0000 7f57b91ff700 1 -- 172.21.15.45:0/8788080 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57b40d15e0 con 0x7f57b415c9b0 2023-11-28T12:10:28.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:28.118+0000 7f57b91ff700 1 -- 172.21.15.45:0/8788080 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57b40b52c0 con 0x7f57b415c9b0 2023-11-28T12:10:28.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:28.118+0000 7f579b7fe700 1 -- 172.21.15.45:0/8788080 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f57a8023070 con 0x7f57b415c9b0 2023-11-28T12:10:28.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:28.119+0000 7f579b7fe700 1 --2- 172.21.15.45:0/8788080 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f57a00682f0 0x7f57a006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:28.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:28.119+0000 7f579b7fe700 1 -- 172.21.15.45:0/8788080 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f57a8085c10 con 0x7f57b415c9b0 2023-11-28T12:10:28.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:28.120+0000 7f57b2d9d700 1 --2- 172.21.15.45:0/8788080 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f57a00682f0 0x7f57a006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:10:28.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:28.121+0000 7f57b2d9d700 1 --2- 172.21.15.45:0/8788080 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f57a00682f0 0x7f57a006a7a0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f57a40090b0 tx=0x7f57a4008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:10:28.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:28.124+0000 7f579b7fe700 1 -- 172.21.15.45:0/8788080 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f57a8052270 con 0x7f57b415c9b0 2023-11-28T12:10:28.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:28.369+0000 7f57b91ff700 1 -- 172.21.15.45:0/8788080 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f57b40745c0 con 0x7f57b415c9b0 2023-11-28T12:10:28.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:28.370+0000 7f579b7fe700 1 -- 172.21.15.45:0/8788080 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7f57a800f040 con 0x7f57b415c9b0 2023-11-28T12:10:28.370 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:10:28.371 INFO:teuthology.orchestra.run.smithi045.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-28T12:10:28.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:28.372+0000 7f57b91ff700 1 -- 172.21.15.45:0/8788080 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f57a00682f0 msgr2=0x7f57a006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:10:28.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:28.372+0000 7f57b91ff700 1 --2- 172.21.15.45:0/8788080 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f57a00682f0 0x7f57a006a7a0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f57a40090b0 tx=0x7f57a4008030 comp rx=0 tx=0).stop 2023-11-28T12:10:28.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:28.372+0000 7f57b91ff700 1 -- 172.21.15.45:0/8788080 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57b415c9b0 msgr2=0x7f57b4154f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:10:28.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:28.372+0000 7f57b91ff700 1 --2- 172.21.15.45:0/8788080 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57b415c9b0 0x7f57b4154f60 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f57a800e810 tx=0x7f57a800eb20 comp rx=0 tx=0).stop 2023-11-28T12:10:28.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:28.372+0000 7f57b91ff700 1 -- 172.21.15.45:0/8788080 shutdown_connections 2023-11-28T12:10:28.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:28.372+0000 7f57b91ff700 1 --2- 172.21.15.45:0/8788080 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f57a00682f0 0x7f57a006a7a0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:28.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:28.372+0000 7f57b91ff700 1 --2- 172.21.15.45:0/8788080 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57b40d2320 0x7f57b4151cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:28.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:28.372+0000 7f57b91ff700 1 --2- 172.21.15.45:0/8788080 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f57b4161340 0x7f57b414cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:28.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:28.372+0000 7f57b91ff700 1 --2- 172.21.15.45:0/8788080 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57b415c9b0 0x7f57b4154f60 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:28.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:28.372+0000 7f57b91ff700 1 -- 172.21.15.45:0/8788080 >> 172.21.15.45:0/8788080 conn(0x7f57b4072600 msgr2=0x7f57b415cf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:10:28.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:28.372+0000 7f57b91ff700 1 -- 172.21.15.45:0/8788080 shutdown_connections 2023-11-28T12:10:28.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:28.372+0000 7f57b91ff700 1 -- 172.21.15.45:0/8788080 wait complete. 2023-11-28T12:10:28.391 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=100 retry_count=0)... 2023-11-28T12:10:30.902 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T12:10:30.907 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T12:10:33.391 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T12:10:33.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:33.606+0000 7fb249bff700 1 Processor -- start 2023-11-28T12:10:33.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:33.606+0000 7fb249bff700 1 -- start start 2023-11-28T12:10:33.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:33.607+0000 7fb249bff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb244161340 0x7fb2440d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:33.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:33.607+0000 7fb249bff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb2440d2320 0x7fb2440cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:33.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:33.607+0000 7fb249bff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2440d1950 con 0x7fb24415c9b0 2023-11-28T12:10:33.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:33.607+0000 7fb249bff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2440b5800 con 0x7fb244161340 2023-11-28T12:10:33.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:33.607+0000 7fb249bff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2440b5300 con 0x7fb2440d2320 2023-11-28T12:10:33.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:33.607+0000 7fb242ffd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb244161340 0x7fb2440d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:10:33.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:33.607+0000 7fb242ffd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb244161340 0x7fb2440d1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54858/0 (socket says 172.21.15.45:54858) 2023-11-28T12:10:33.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:33.607+0000 7fb242ffd700 1 -- 172.21.15.45:0/383795917 learned_addr learned my addr 172.21.15.45:0/383795917 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:10:33.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:33.608+0000 7fb243fff700 1 --2- 172.21.15.45:0/383795917 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb2440d2320 0x7fb2440cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:10:33.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:33.608+0000 7fb242ffd700 1 -- 172.21.15.45:0/383795917 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb2440d2320 msgr2=0x7fb2440cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:10:33.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:33.608+0000 7fb242ffd700 1 --2- 172.21.15.45:0/383795917 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb2440d2320 0x7fb2440cd7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:33.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:33.608+0000 7fb242ffd700 1 -- 172.21.15.45:0/383795917 >> v1:172.21.15.152:6789/0 conn(0x7fb24415c9b0 legacy=0x7fb2440b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:10:33.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:33.608+0000 7fb242ffd700 1 -- 172.21.15.45:0/383795917 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2440b5520 con 0x7fb244161340 2023-11-28T12:10:33.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:33.608+0000 7fb242ffd700 1 --2- 172.21.15.45:0/383795917 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb244161340 0x7fb2440d1de0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fb2380098f0 tx=0x7fb238009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ab425ccc76cec6e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:10:33.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:33.608+0000 7fb2427fc700 1 -- 172.21.15.45:0/383795917 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb23800b8a0 con 0x7fb244161340 2023-11-28T12:10:33.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:33.608+0000 7fb2427fc700 1 -- 172.21.15.45:0/383795917 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb23800ba00 con 0x7fb244161340 2023-11-28T12:10:33.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:33.608+0000 7fb2427fc700 1 -- 172.21.15.45:0/383795917 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb23800bd90 con 0x7fb244161340 2023-11-28T12:10:33.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:33.609+0000 7fb249bff700 1 -- 172.21.15.45:0/383795917 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb244161340 msgr2=0x7fb2440d1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:10:33.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:33.609+0000 7fb249bff700 1 --2- 172.21.15.45:0/383795917 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb244161340 0x7fb2440d1de0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fb2380098f0 tx=0x7fb238009c00 comp rx=0 tx=0).stop 2023-11-28T12:10:33.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:33.609+0000 7fb249bff700 1 -- 172.21.15.45:0/383795917 shutdown_connections 2023-11-28T12:10:33.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:33.609+0000 7fb249bff700 1 --2- 172.21.15.45:0/383795917 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb2440d2320 0x7fb2440cd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:33.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:33.609+0000 7fb249bff700 1 --2- 172.21.15.45:0/383795917 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb244161340 0x7fb2440d1de0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:33.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:33.609+0000 7fb249bff700 1 -- 172.21.15.45:0/383795917 >> 172.21.15.45:0/383795917 conn(0x7fb244072600 msgr2=0x7fb2440cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:10:33.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:33.609+0000 7fb249bff700 1 -- 172.21.15.45:0/383795917 shutdown_connections 2023-11-28T12:10:33.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:33.609+0000 7fb249bff700 1 -- 172.21.15.45:0/383795917 wait complete. 2023-11-28T12:10:33.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:33.611+0000 7fb249bff700 1 Processor -- start 2023-11-28T12:10:33.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:33.611+0000 7fb249bff700 1 -- start start 2023-11-28T12:10:33.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:33.612+0000 7fb249bff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb2440d2320 0x7fb244150490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:33.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:33.612+0000 7fb249bff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb24415c9b0 0x7fb2441578a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:33.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:33.612+0000 7fb249bff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb244161340 0x7fb2441550b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:33.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:33.612+0000 7fb249bff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2441509d0 con 0x7fb244161340 2023-11-28T12:10:33.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:33.612+0000 7fb249bff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2441e8920 con 0x7fb24415c9b0 2023-11-28T12:10:33.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:33.612+0000 7fb249bff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2441e79c0 con 0x7fb2440d2320 2023-11-28T12:10:33.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:33.612+0000 7fb243fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb244161340 0x7fb2441550b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:10:33.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:33.612+0000 7fb243fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb244161340 0x7fb2441550b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54860/0 (socket says 172.21.15.45:54860) 2023-11-28T12:10:33.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:33.612+0000 7fb243fff700 1 -- 172.21.15.45:0/2367574569 learned_addr learned my addr 172.21.15.45:0/2367574569 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:10:33.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:33.612+0000 7fb2437fe700 1 --2- 172.21.15.45:0/2367574569 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb2440d2320 0x7fb244150490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:10:33.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:33.612+0000 7fb242ffd700 1 --2- 172.21.15.45:0/2367574569 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb24415c9b0 0x7fb2441578a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:10:33.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:33.613+0000 7fb243fff700 1 -- 172.21.15.45:0/2367574569 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb2440d2320 msgr2=0x7fb244150490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:10:33.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:33.613+0000 7fb243fff700 1 --2- 172.21.15.45:0/2367574569 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb2440d2320 0x7fb244150490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:33.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:33.613+0000 7fb243fff700 1 -- 172.21.15.45:0/2367574569 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb24415c9b0 msgr2=0x7fb2441578a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:10:33.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:33.613+0000 7fb243fff700 1 --2- 172.21.15.45:0/2367574569 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb24415c9b0 0x7fb2441578a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:33.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:33.613+0000 7fb243fff700 1 -- 172.21.15.45:0/2367574569 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb238009550 con 0x7fb244161340 2023-11-28T12:10:33.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:33.613+0000 7fb243fff700 1 --2- 172.21.15.45:0/2367574569 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb244161340 0x7fb2441550b0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fb23c009fd0 tx=0x7fb23c00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:10:33.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:33.613+0000 7fb22bfff700 1 -- 172.21.15.45:0/2367574569 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb23c007ea0 con 0x7fb244161340 2023-11-28T12:10:33.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:33.613+0000 7fb22bfff700 1 -- 172.21.15.45:0/2367574569 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb23c00ed30 con 0x7fb244161340 2023-11-28T12:10:33.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:33.613+0000 7fb22bfff700 1 -- 172.21.15.45:0/2367574569 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb23c00eea0 con 0x7fb244161340 2023-11-28T12:10:33.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:33.613+0000 7fb249bff700 1 -- 172.21.15.45:0/2367574569 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2440d15e0 con 0x7fb244161340 2023-11-28T12:10:33.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:33.613+0000 7fb249bff700 1 -- 172.21.15.45:0/2367574569 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2440d1300 con 0x7fb244161340 2023-11-28T12:10:33.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:33.614+0000 7fb249bff700 1 -- 172.21.15.45:0/2367574569 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb24415cd80 con 0x7fb244161340 2023-11-28T12:10:33.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:33.615+0000 7fb22bfff700 1 -- 172.21.15.45:0/2367574569 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fb23c012050 con 0x7fb244161340 2023-11-28T12:10:33.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:33.616+0000 7fb22bfff700 1 --2- 172.21.15.45:0/2367574569 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb2300682f0 0x7fb23006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:33.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:33.616+0000 7fb22bfff700 1 -- 172.21.15.45:0/2367574569 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6207+0+0 (secure 0 0 0) 0x7fb23c086290 con 0x7fb244161340 2023-11-28T12:10:33.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:33.617+0000 7fb2437fe700 1 --2- 172.21.15.45:0/2367574569 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb2300682f0 0x7fb23006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:10:33.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:33.617+0000 7fb2437fe700 1 --2- 172.21.15.45:0/2367574569 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb2300682f0 0x7fb23006a7a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fb234007fd0 tx=0x7fb234009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:10:33.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:33.620+0000 7fb22bfff700 1 -- 172.21.15.45:0/2367574569 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fb23c052970 con 0x7fb244161340 2023-11-28T12:10:33.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:33.865+0000 7fb249bff700 1 -- 172.21.15.45:0/2367574569 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fb2440745c0 con 0x7fb244161340 2023-11-28T12:10:33.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:33.865+0000 7fb22bfff700 1 -- 172.21.15.45:0/2367574569 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7fb23c055f90 con 0x7fb244161340 2023-11-28T12:10:33.866 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:10:33.866 INFO:teuthology.orchestra.run.smithi045.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-28T12:10:33.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:33.867+0000 7fb249bff700 1 -- 172.21.15.45:0/2367574569 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb2300682f0 msgr2=0x7fb23006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:10:33.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:33.867+0000 7fb249bff700 1 --2- 172.21.15.45:0/2367574569 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb2300682f0 0x7fb23006a7a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fb234007fd0 tx=0x7fb234009040 comp rx=0 tx=0).stop 2023-11-28T12:10:33.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:33.867+0000 7fb249bff700 1 -- 172.21.15.45:0/2367574569 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb244161340 msgr2=0x7fb2441550b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:10:33.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:33.867+0000 7fb249bff700 1 --2- 172.21.15.45:0/2367574569 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb244161340 0x7fb2441550b0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fb23c009fd0 tx=0x7fb23c00e3c0 comp rx=0 tx=0).stop 2023-11-28T12:10:33.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:33.868+0000 7fb249bff700 1 -- 172.21.15.45:0/2367574569 shutdown_connections 2023-11-28T12:10:33.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:33.868+0000 7fb249bff700 1 --2- 172.21.15.45:0/2367574569 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb2300682f0 0x7fb23006a7a0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:33.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:33.868+0000 7fb249bff700 1 --2- 172.21.15.45:0/2367574569 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb244161340 0x7fb2441550b0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:33.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:33.868+0000 7fb249bff700 1 --2- 172.21.15.45:0/2367574569 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb2440d2320 0x7fb244150490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:33.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:33.868+0000 7fb249bff700 1 --2- 172.21.15.45:0/2367574569 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb24415c9b0 0x7fb2441578a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:33.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:33.868+0000 7fb249bff700 1 -- 172.21.15.45:0/2367574569 >> 172.21.15.45:0/2367574569 conn(0x7fb244072600 msgr2=0x7fb2440b5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:10:33.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:33.868+0000 7fb249bff700 1 -- 172.21.15.45:0/2367574569 shutdown_connections 2023-11-28T12:10:33.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:33.868+0000 7fb249bff700 1 -- 172.21.15.45:0/2367574569 wait complete. 2023-11-28T12:10:33.886 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=100 retry_count=0)... 2023-11-28T12:10:38.887 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T12:10:39.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:39.102+0000 7f4ef37ff700 1 Processor -- start 2023-11-28T12:10:39.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:39.102+0000 7f4ef37ff700 1 -- start start 2023-11-28T12:10:39.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:39.103+0000 7f4ef37ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4eec15cbb0 0x7f4eec0d0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:39.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:39.103+0000 7f4ef37ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f4eec0b38d0 0x7f4eec0d12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:39.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:39.103+0000 7f4ef37ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4eec0afd90 con 0x7f4eec0b47b0 2023-11-28T12:10:39.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:39.103+0000 7f4ef37ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4eec0d3060 con 0x7f4eec15cbb0 2023-11-28T12:10:39.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:39.103+0000 7f4ef37ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4eec0affe0 con 0x7f4eec0b38d0 2023-11-28T12:10:39.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:39.103+0000 7f4ef159b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4eec15cbb0 0x7f4eec0d0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:10:39.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:39.103+0000 7f4ef159b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4eec15cbb0 0x7f4eec0d0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54866/0 (socket says 172.21.15.45:54866) 2023-11-28T12:10:39.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:39.103+0000 7f4ef159b700 1 -- 172.21.15.45:0/3538162973 learned_addr learned my addr 172.21.15.45:0/3538162973 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:10:39.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:39.103+0000 7f4ef1d9c700 1 --2- 172.21.15.45:0/3538162973 >> v2:172.21.15.152:3300/0 conn(0x7f4eec0b38d0 0x7f4eec0d12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:10:39.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:39.104+0000 7f4ef159b700 1 -- 172.21.15.45:0/3538162973 >> v2:172.21.15.152:3300/0 conn(0x7f4eec0b38d0 msgr2=0x7f4eec0d12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:10:39.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:39.104+0000 7f4ef159b700 1 --2- 172.21.15.45:0/3538162973 >> v2:172.21.15.152:3300/0 conn(0x7f4eec0b38d0 0x7f4eec0d12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:39.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:39.104+0000 7f4ef159b700 1 -- 172.21.15.45:0/3538162973 >> v1:172.21.15.152:6789/0 conn(0x7f4eec0b47b0 legacy=0x7f4eec0b1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:10:39.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:39.104+0000 7f4ef159b700 1 -- 172.21.15.45:0/3538162973 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eec0b02c0 con 0x7f4eec15cbb0 2023-11-28T12:10:39.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:39.104+0000 7f4ef1d9c700 1 --2- 172.21.15.45:0/3538162973 >> v2:172.21.15.152:3300/0 conn(0x7f4eec0b38d0 0x7f4eec0d12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:10:39.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:39.104+0000 7f4ef159b700 1 --2- 172.21.15.45:0/3538162973 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4eec15cbb0 0x7f4eec0d0d90 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f4eec08c560 tx=0x7f4ee8009bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2a5cf365cfa423a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:10:39.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:39.104+0000 7f4ee3fff700 1 -- 172.21.15.45:0/3538162973 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee800b8a0 con 0x7f4eec15cbb0 2023-11-28T12:10:39.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:39.104+0000 7f4ee3fff700 1 -- 172.21.15.45:0/3538162973 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ee800ba00 con 0x7f4eec15cbb0 2023-11-28T12:10:39.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:39.104+0000 7f4ee3fff700 1 -- 172.21.15.45:0/3538162973 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee800bdb0 con 0x7f4eec15cbb0 2023-11-28T12:10:39.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:39.105+0000 7f4ef37ff700 1 -- 172.21.15.45:0/3538162973 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4eec15cbb0 msgr2=0x7f4eec0d0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:10:39.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:39.105+0000 7f4ef37ff700 1 --2- 172.21.15.45:0/3538162973 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4eec15cbb0 0x7f4eec0d0d90 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f4eec08c560 tx=0x7f4ee8009bc0 comp rx=0 tx=0).stop 2023-11-28T12:10:39.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:39.105+0000 7f4ef37ff700 1 -- 172.21.15.45:0/3538162973 shutdown_connections 2023-11-28T12:10:39.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:39.105+0000 7f4ef37ff700 1 --2- 172.21.15.45:0/3538162973 >> v2:172.21.15.152:3300/0 conn(0x7f4eec0b38d0 0x7f4eec0d12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:39.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:39.105+0000 7f4ef37ff700 1 --2- 172.21.15.45:0/3538162973 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4eec15cbb0 0x7f4eec0d0d90 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:39.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:39.105+0000 7f4ef37ff700 1 -- 172.21.15.45:0/3538162973 >> 172.21.15.45:0/3538162973 conn(0x7f4eec09c430 msgr2=0x7f4eec0d31c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:10:39.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:39.105+0000 7f4ef37ff700 1 -- 172.21.15.45:0/3538162973 shutdown_connections 2023-11-28T12:10:39.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:39.105+0000 7f4ef37ff700 1 -- 172.21.15.45:0/3538162973 wait complete. 2023-11-28T12:10:39.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:39.107+0000 7f4ef37ff700 1 Processor -- start 2023-11-28T12:10:39.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:39.107+0000 7f4ef37ff700 1 -- start start 2023-11-28T12:10:39.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:39.108+0000 7f4ef37ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4eec0b38d0 0x7f4eec0c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:39.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:39.108+0000 7f4ef37ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4eec0b47b0 0x7f4eec1e3410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:39.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:39.108+0000 7f4ef37ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4eec15cbb0 0x7f4eec1e3950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:39.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:39.108+0000 7f4ef37ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eec0b6ec0 con 0x7f4eec0b38d0 2023-11-28T12:10:39.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:39.108+0000 7f4ef37ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eec0b5ff0 con 0x7f4eec15cbb0 2023-11-28T12:10:39.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:39.108+0000 7f4ef37ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4eec0c6bd0 con 0x7f4eec0b47b0 2023-11-28T12:10:39.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:39.108+0000 7f4ef159b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4eec0b38d0 0x7f4eec0c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:10:39.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:39.108+0000 7f4ef159b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4eec0b38d0 0x7f4eec0c94c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54878/0 (socket says 172.21.15.45:54878) 2023-11-28T12:10:39.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:39.108+0000 7f4ef159b700 1 -- 172.21.15.45:0/4038435580 learned_addr learned my addr 172.21.15.45:0/4038435580 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:10:39.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:39.108+0000 7f4ef159b700 1 -- 172.21.15.45:0/4038435580 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4eec0b47b0 msgr2=0x7f4eec1e3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:10:39.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:39.108+0000 7f4ef159b700 1 --2- 172.21.15.45:0/4038435580 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4eec0b47b0 0x7f4eec1e3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:39.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:39.108+0000 7f4ef159b700 1 -- 172.21.15.45:0/4038435580 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4eec15cbb0 msgr2=0x7f4eec1e3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:10:39.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:39.108+0000 7f4ef159b700 1 --2- 172.21.15.45:0/4038435580 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4eec15cbb0 0x7f4eec1e3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:39.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:39.108+0000 7f4ef159b700 1 -- 172.21.15.45:0/4038435580 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ee80094f0 con 0x7f4eec0b38d0 2023-11-28T12:10:39.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:39.109+0000 7f4ef159b700 1 --2- 172.21.15.45:0/4038435580 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4eec0b38d0 0x7f4eec0c94c0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f4ee8014040 tx=0x7f4ee8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:10:39.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:39.109+0000 7f4ee1ffb700 1 -- 172.21.15.45:0/4038435580 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee8004500 con 0x7f4eec0b38d0 2023-11-28T12:10:39.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:39.109+0000 7f4ee1ffb700 1 -- 172.21.15.45:0/4038435580 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ee80036a0 con 0x7f4eec0b38d0 2023-11-28T12:10:39.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:39.109+0000 7f4ee1ffb700 1 -- 172.21.15.45:0/4038435580 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee8003a30 con 0x7f4eec0b38d0 2023-11-28T12:10:39.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:39.109+0000 7f4ef37ff700 1 -- 172.21.15.45:0/4038435580 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4eec0b0880 con 0x7f4eec0b38d0 2023-11-28T12:10:39.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:39.109+0000 7f4ef37ff700 1 -- 172.21.15.45:0/4038435580 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4eec0b05a0 con 0x7f4eec0b38d0 2023-11-28T12:10:39.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:39.110+0000 7f4ef37ff700 1 -- 172.21.15.45:0/4038435580 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4eec0b0b60 con 0x7f4eec0b38d0 2023-11-28T12:10:39.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:39.111+0000 7f4ee1ffb700 1 -- 172.21.15.45:0/4038435580 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f4ee800f050 con 0x7f4eec0b38d0 2023-11-28T12:10:39.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:39.112+0000 7f4ee1ffb700 1 --2- 172.21.15.45:0/4038435580 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f4ed00682f0 0x7f4ed006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:39.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:39.112+0000 7f4ee1ffb700 1 -- 172.21.15.45:0/4038435580 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f4ee8087650 con 0x7f4eec0b38d0 2023-11-28T12:10:39.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:39.112+0000 7f4ef0d9a700 1 --2- 172.21.15.45:0/4038435580 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f4ed00682f0 0x7f4ed006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:10:39.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:39.113+0000 7f4ef0d9a700 1 --2- 172.21.15.45:0/4038435580 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f4ed00682f0 0x7f4ed006a7a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f4edc000f60 tx=0x7f4edc007a40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:10:39.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:39.117+0000 7f4ee1ffb700 1 -- 172.21.15.45:0/4038435580 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f4ee8053cb0 con 0x7f4eec0b38d0 2023-11-28T12:10:39.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:39.365+0000 7f4ef37ff700 1 -- 172.21.15.45:0/4038435580 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f4eec0745c0 con 0x7f4eec0b38d0 2023-11-28T12:10:39.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:39.365+0000 7f4ee1ffb700 1 -- 172.21.15.45:0/4038435580 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7f4ee80572d0 con 0x7f4eec0b38d0 2023-11-28T12:10:39.366 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:10:39.366 INFO:teuthology.orchestra.run.smithi045.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-28T12:10:39.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:39.367+0000 7f4ef37ff700 1 -- 172.21.15.45:0/4038435580 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f4ed00682f0 msgr2=0x7f4ed006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:10:39.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:39.367+0000 7f4ef37ff700 1 --2- 172.21.15.45:0/4038435580 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f4ed00682f0 0x7f4ed006a7a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f4edc000f60 tx=0x7f4edc007a40 comp rx=0 tx=0).stop 2023-11-28T12:10:39.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:39.367+0000 7f4ef37ff700 1 -- 172.21.15.45:0/4038435580 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4eec0b38d0 msgr2=0x7f4eec0c94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:10:39.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:39.367+0000 7f4ef37ff700 1 --2- 172.21.15.45:0/4038435580 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4eec0b38d0 0x7f4eec0c94c0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f4ee8014040 tx=0x7f4ee8004750 comp rx=0 tx=0).stop 2023-11-28T12:10:39.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:39.367+0000 7f4ef37ff700 1 -- 172.21.15.45:0/4038435580 shutdown_connections 2023-11-28T12:10:39.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:39.367+0000 7f4ef37ff700 1 --2- 172.21.15.45:0/4038435580 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f4ed00682f0 0x7f4ed006a7a0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:39.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:39.367+0000 7f4ef37ff700 1 --2- 172.21.15.45:0/4038435580 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4eec15cbb0 0x7f4eec1e3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:39.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:39.367+0000 7f4ef37ff700 1 --2- 172.21.15.45:0/4038435580 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4eec0b38d0 0x7f4eec0c94c0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:39.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:39.367+0000 7f4ef37ff700 1 --2- 172.21.15.45:0/4038435580 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4eec0b47b0 0x7f4eec1e3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:39.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:39.367+0000 7f4ef37ff700 1 -- 172.21.15.45:0/4038435580 >> 172.21.15.45:0/4038435580 conn(0x7f4eec09c430 msgr2=0x7f4eec0d0d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:10:39.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:39.367+0000 7f4ef37ff700 1 -- 172.21.15.45:0/4038435580 shutdown_connections 2023-11-28T12:10:39.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:39.368+0000 7f4ef37ff700 1 -- 172.21.15.45:0/4038435580 wait complete. 2023-11-28T12:10:39.386 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=100 retry_count=0)... 2023-11-28T12:10:44.387 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T12:10:44.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:44.601+0000 7fc3633ff700 1 Processor -- start 2023-11-28T12:10:44.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:44.601+0000 7fc3633ff700 1 -- start start 2023-11-28T12:10:44.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:44.602+0000 7fc3633ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fc35c161340 0x7fc35c0d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:44.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:44.602+0000 7fc3633ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc35c0d1950 con 0x7fc35c15c9b0 2023-11-28T12:10:44.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:44.602+0000 7fc3633ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc35c0b5520 con 0x7fc35c0d2320 2023-11-28T12:10:44.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:44.602+0000 7fc3633ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc35c0b5800 con 0x7fc35c161340 2023-11-28T12:10:44.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:44.602+0000 7fc36119b700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fc35c15c9b0 0x7fc35c0b4bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:39564/0 (socket says 172.21.15.45:39564) 2023-11-28T12:10:44.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:44.602+0000 7fc36119b700 1 -- 172.21.15.45:0/3763595268 learned_addr learned my addr 172.21.15.45:0/3763595268 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:10:44.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:44.603+0000 7fc353fff700 1 -- 172.21.15.45:0/3763595268 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3510131666 0 0) 0x7fc35c0d1950 con 0x7fc35c15c9b0 2023-11-28T12:10:44.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:44.603+0000 7fc36099a700 1 --2- 172.21.15.45:0/3763595268 >> v2:172.21.15.152:3300/0 conn(0x7fc35c161340 0x7fc35c0d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:10:44.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:44.603+0000 7fc353fff700 1 -- 172.21.15.45:0/3763595268 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3480035b0 con 0x7fc35c15c9b0 2023-11-28T12:10:44.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:44.603+0000 7fc353fff700 1 -- 172.21.15.45:0/3763595268 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3394325468 0 0) 0x7fc3480035b0 con 0x7fc35c15c9b0 2023-11-28T12:10:44.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:44.603+0000 7fc353fff700 1 -- 172.21.15.45:0/3763595268 >> v2:172.21.15.152:3300/0 conn(0x7fc35c161340 msgr2=0x7fc35c0d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:10:44.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:44.603+0000 7fc353fff700 1 --2- 172.21.15.45:0/3763595268 >> v2:172.21.15.152:3300/0 conn(0x7fc35c161340 0x7fc35c0d1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:44.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:44.603+0000 7fc353fff700 1 -- 172.21.15.45:0/3763595268 >> v1:172.21.15.152:6789/0 conn(0x7fc35c0d2320 legacy=0x7fc35c0cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:10:44.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:44.603+0000 7fc353fff700 1 -- 172.21.15.45:0/3763595268 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc35c0d1300 con 0x7fc35c15c9b0 2023-11-28T12:10:44.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:44.603+0000 7fc353fff700 1 -- 172.21.15.45:0/3763595268 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3460218165 0 0) 0x7fc358001670 con 0x7fc35c15c9b0 2023-11-28T12:10:44.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:44.603+0000 7fc353fff700 1 -- 172.21.15.45:0/3763595268 >> v1:172.21.15.45:6789/0 conn(0x7fc35c15c9b0 legacy=0x7fc35c0b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:10:44.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:44.603+0000 7fc353fff700 1 --2- 172.21.15.45:0/3763595268 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc348003a50 0x7fc348003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:44.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:44.603+0000 7fc353fff700 1 --2- 172.21.15.45:0/3763595268 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc348004850 0x7fc348004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:44.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:44.603+0000 7fc353fff700 1 --2- 172.21.15.45:0/3763595268 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc348005250 0x7fc34800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:44.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:44.603+0000 7fc353fff700 1 -- 172.21.15.45:0/3763595268 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc35c0b5800 con 0x7fc348004850 2023-11-28T12:10:44.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:44.603+0000 7fc353fff700 1 -- 172.21.15.45:0/3763595268 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc34800c160 con 0x7fc348005250 2023-11-28T12:10:44.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:44.603+0000 7fc353fff700 1 -- 172.21.15.45:0/3763595268 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc34800c320 con 0x7fc348003a50 2023-11-28T12:10:44.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:44.603+0000 7fc36099a700 1 --2- 172.21.15.45:0/3763595268 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc348004850 0x7fc348004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:10:44.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:44.604+0000 7fc36119b700 1 --2- 172.21.15.45:0/3763595268 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc348003a50 0x7fc348003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:10:44.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:44.604+0000 7fc36199c700 1 --2- 172.21.15.45:0/3763595268 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc348005250 0x7fc34800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:10:44.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:44.604+0000 7fc36099a700 1 -- 172.21.15.45:0/3763595268 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc348003a50 msgr2=0x7fc348003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:10:44.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:44.604+0000 7fc36099a700 1 --2- 172.21.15.45:0/3763595268 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc348003a50 0x7fc348003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:44.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:44.604+0000 7fc36099a700 1 -- 172.21.15.45:0/3763595268 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc348005250 msgr2=0x7fc34800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:10:44.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:44.604+0000 7fc36099a700 1 --2- 172.21.15.45:0/3763595268 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc348005250 0x7fc34800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:44.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:44.604+0000 7fc36099a700 1 -- 172.21.15.45:0/3763595268 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3480035b0 con 0x7fc348004850 2023-11-28T12:10:44.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:44.604+0000 7fc36199c700 1 -- 172.21.15.45:0/3763595268 reap_dead start 2023-11-28T12:10:44.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:44.604+0000 7fc36119b700 1 --2- 172.21.15.45:0/3763595268 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc348003a50 0x7fc348003e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:10:44.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:44.604+0000 7fc36099a700 1 --2- 172.21.15.45:0/3763595268 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc348004850 0x7fc348004cc0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fc34c009b60 tx=0x7fc348005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21e3561020c1b6af server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:10:44.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:44.604+0000 7fc353fff700 1 -- 172.21.15.45:0/3763595268 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc34c00e6c0 con 0x7fc348004850 2023-11-28T12:10:44.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:44.604+0000 7fc353fff700 1 -- 172.21.15.45:0/3763595268 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc34c00e820 con 0x7fc348004850 2023-11-28T12:10:44.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:44.604+0000 7fc353fff700 1 -- 172.21.15.45:0/3763595268 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc34c00eb90 con 0x7fc348004850 2023-11-28T12:10:44.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:44.605+0000 7fc3633ff700 1 -- 172.21.15.45:0/3763595268 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc348004850 msgr2=0x7fc348004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:10:44.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:44.605+0000 7fc3633ff700 1 --2- 172.21.15.45:0/3763595268 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc348004850 0x7fc348004cc0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fc34c009b60 tx=0x7fc348005880 comp rx=0 tx=0).stop 2023-11-28T12:10:44.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:44.605+0000 7fc3633ff700 1 -- 172.21.15.45:0/3763595268 shutdown_connections 2023-11-28T12:10:44.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:44.605+0000 7fc3633ff700 1 --2- 172.21.15.45:0/3763595268 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc348004850 0x7fc348004cc0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:44.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:44.605+0000 7fc3633ff700 1 -- 172.21.15.45:0/3763595268 >> 172.21.15.45:0/3763595268 conn(0x7fc35c072600 msgr2=0x7fc35c0cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:10:44.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:44.605+0000 7fc3633ff700 1 -- 172.21.15.45:0/3763595268 shutdown_connections 2023-11-28T12:10:44.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:44.605+0000 7fc3633ff700 1 -- 172.21.15.45:0/3763595268 wait complete. 2023-11-28T12:10:44.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:44.608+0000 7fc3633ff700 1 Processor -- start 2023-11-28T12:10:44.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:44.608+0000 7fc3633ff700 1 -- start start 2023-11-28T12:10:44.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:44.609+0000 7fc3633ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc348004850 0x7fc35c1e64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:44.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:44.609+0000 7fc3633ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc35c150d00 0x7fc35c0c9250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:44.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:44.609+0000 7fc3633ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc35c151170 0x7fc35c156d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:44.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:44.609+0000 7fc3633ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc35c0c9d10 con 0x7fc348004850 2023-11-28T12:10:44.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:44.609+0000 7fc3633ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc35c1e83e0 con 0x7fc35c150d00 2023-11-28T12:10:44.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:44.609+0000 7fc3633ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc35c1e8680 con 0x7fc35c151170 2023-11-28T12:10:44.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:44.609+0000 7fc36119b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc348004850 0x7fc35c1e64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:10:44.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:44.609+0000 7fc36119b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc348004850 0x7fc35c1e64c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46858/0 (socket says 172.21.15.45:46858) 2023-11-28T12:10:44.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:44.609+0000 7fc36119b700 1 -- 172.21.15.45:0/2019712634 learned_addr learned my addr 172.21.15.45:0/2019712634 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:10:44.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:44.610+0000 7fc36119b700 1 -- 172.21.15.45:0/2019712634 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc35c151170 msgr2=0x7fc35c156d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:10:44.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:44.610+0000 7fc36119b700 1 --2- 172.21.15.45:0/2019712634 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc35c151170 0x7fc35c156d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:44.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:44.610+0000 7fc36099a700 1 --2- 172.21.15.45:0/2019712634 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc35c150d00 0x7fc35c0c9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:10:44.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:44.610+0000 7fc36119b700 1 -- 172.21.15.45:0/2019712634 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc35c150d00 msgr2=0x7fc35c0c9250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:10:44.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:44.610+0000 7fc36119b700 1 --2- 172.21.15.45:0/2019712634 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc35c150d00 0x7fc35c0c9250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:44.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:44.610+0000 7fc36119b700 1 -- 172.21.15.45:0/2019712634 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc35c15cd80 con 0x7fc348004850 2023-11-28T12:10:44.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:44.610+0000 7fc36119b700 1 --2- 172.21.15.45:0/2019712634 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc348004850 0x7fc35c1e64c0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fc358001050 tx=0x7fc35800eb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:10:44.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:44.610+0000 7fc351ffb700 1 -- 172.21.15.45:0/2019712634 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc358012590 con 0x7fc348004850 2023-11-28T12:10:44.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:44.610+0000 7fc351ffb700 1 -- 172.21.15.45:0/2019712634 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3580126f0 con 0x7fc348004850 2023-11-28T12:10:44.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:44.610+0000 7fc3633ff700 1 -- 172.21.15.45:0/2019712634 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc35c0d15e0 con 0x7fc348004850 2023-11-28T12:10:44.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:44.610+0000 7fc351ffb700 1 -- 172.21.15.45:0/2019712634 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc358012a80 con 0x7fc348004850 2023-11-28T12:10:44.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:44.610+0000 7fc3633ff700 1 -- 172.21.15.45:0/2019712634 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc35c15cf10 con 0x7fc348004850 2023-11-28T12:10:44.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:44.611+0000 7fc3633ff700 1 -- 172.21.15.45:0/2019712634 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc35c1f5e70 con 0x7fc348004850 2023-11-28T12:10:44.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:44.612+0000 7fc351ffb700 1 -- 172.21.15.45:0/2019712634 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fc358012be0 con 0x7fc348004850 2023-11-28T12:10:44.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:44.613+0000 7fc351ffb700 1 --2- 172.21.15.45:0/2019712634 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fc3400682f0 0x7fc34006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:44.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:44.613+0000 7fc351ffb700 1 -- 172.21.15.45:0/2019712634 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6207+0+0 (secure 0 0 0) 0x7fc358085d20 con 0x7fc348004850 2023-11-28T12:10:44.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:44.613+0000 7fc36099a700 1 --2- 172.21.15.45:0/2019712634 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fc3400682f0 0x7fc34006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:10:44.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:44.614+0000 7fc36099a700 1 --2- 172.21.15.45:0/2019712634 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fc3400682f0 0x7fc34006a7a0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fc35c1578d0 tx=0x7fc34c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:10:44.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:44.618+0000 7fc351ffb700 1 -- 172.21.15.45:0/2019712634 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fc358052400 con 0x7fc348004850 2023-11-28T12:10:44.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:44.862+0000 7fc3633ff700 1 -- 172.21.15.45:0/2019712634 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fc35c1e8e80 con 0x7fc348004850 2023-11-28T12:10:44.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:44.862+0000 7fc351ffb700 1 -- 172.21.15.45:0/2019712634 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7fc358055a20 con 0x7fc348004850 2023-11-28T12:10:44.863 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:10:44.864 INFO:teuthology.orchestra.run.smithi045.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-28T12:10:44.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:44.864+0000 7fc3633ff700 1 -- 172.21.15.45:0/2019712634 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fc3400682f0 msgr2=0x7fc34006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:10:44.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:44.864+0000 7fc3633ff700 1 --2- 172.21.15.45:0/2019712634 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fc3400682f0 0x7fc34006a7a0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fc35c1578d0 tx=0x7fc34c008030 comp rx=0 tx=0).stop 2023-11-28T12:10:44.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:44.864+0000 7fc3633ff700 1 -- 172.21.15.45:0/2019712634 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc348004850 msgr2=0x7fc35c1e64c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:10:44.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:44.864+0000 7fc3633ff700 1 --2- 172.21.15.45:0/2019712634 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc348004850 0x7fc35c1e64c0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fc358001050 tx=0x7fc35800eb10 comp rx=0 tx=0).stop 2023-11-28T12:10:44.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:44.864+0000 7fc3633ff700 1 -- 172.21.15.45:0/2019712634 shutdown_connections 2023-11-28T12:10:44.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:44.864+0000 7fc3633ff700 1 --2- 172.21.15.45:0/2019712634 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fc3400682f0 0x7fc34006a7a0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:44.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:44.864+0000 7fc3633ff700 1 --2- 172.21.15.45:0/2019712634 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc35c151170 0x7fc35c156d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:44.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:44.864+0000 7fc3633ff700 1 --2- 172.21.15.45:0/2019712634 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc348004850 0x7fc35c1e64c0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:44.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:44.864+0000 7fc3633ff700 1 --2- 172.21.15.45:0/2019712634 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc35c150d00 0x7fc35c0c9250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:44.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:44.864+0000 7fc3633ff700 1 -- 172.21.15.45:0/2019712634 >> 172.21.15.45:0/2019712634 conn(0x7fc35c072600 msgr2=0x7fc35c0b5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:10:44.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:44.865+0000 7fc3633ff700 1 -- 172.21.15.45:0/2019712634 shutdown_connections 2023-11-28T12:10:44.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:44.865+0000 7fc3633ff700 1 -- 172.21.15.45:0/2019712634 wait complete. 2023-11-28T12:10:44.884 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=100 retry_count=0)... 2023-11-28T12:10:49.885 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T12:10:50.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:50.099+0000 7fa57a7ff700 1 Processor -- start 2023-11-28T12:10:50.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:50.099+0000 7fa57a7ff700 1 -- start start 2023-11-28T12:10:50.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:50.100+0000 7fa57a7ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fa57415c9b0 0x7fa5740b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:50.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:50.100+0000 7fa57a7ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa5740cd7c0 0x7fa5740cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:50.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:50.100+0000 7fa57a7ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5740d1950 con 0x7fa574161340 2023-11-28T12:10:50.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:50.100+0000 7fa57a7ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5740b5800 con 0x7fa57415c9b0 2023-11-28T12:10:50.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:50.100+0000 7fa57a7ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5740ce140 con 0x7fa5740cd7c0 2023-11-28T12:10:50.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:50.101+0000 7fa578d9c700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa5740cd7c0 0x7fa5740cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:10:50.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:50.101+0000 7fa573fff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fa57415c9b0 0x7fa5740b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:10:50.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:50.101+0000 7fa56bfff700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fa574161340 0x7fa5740d1de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.45:36312/0 (socket says 172.21.15.45:36312) 2023-11-28T12:10:50.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:50.101+0000 7fa56bfff700 1 -- 172.21.15.45:0/2790565239 learned_addr learned my addr 172.21.15.45:0/2790565239 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:10:50.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:50.101+0000 7fa5737fe700 1 -- 172.21.15.45:0/2790565239 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 168103694 0 0) 0x7fa5740d1950 con 0x7fa574161340 2023-11-28T12:10:50.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:50.101+0000 7fa5737fe700 1 -- 172.21.15.45:0/2790565239 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5600035b0 con 0x7fa574161340 2023-11-28T12:10:50.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:50.102+0000 7fa573fff700 1 -- 172.21.15.45:0/2790565239 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa5740cd7c0 msgr2=0x7fa5740cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:10:50.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:50.102+0000 7fa573fff700 1 --2- 172.21.15.45:0/2790565239 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa5740cd7c0 0x7fa5740cdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:50.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:50.102+0000 7fa573fff700 1 -- 172.21.15.45:0/2790565239 >> v1:172.21.15.152:6789/0 conn(0x7fa574161340 legacy=0x7fa5740d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:10:50.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:50.102+0000 7fa573fff700 1 -- 172.21.15.45:0/2790565239 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5740d24f0 con 0x7fa57415c9b0 2023-11-28T12:10:50.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:50.102+0000 7fa578d9c700 1 --2- 172.21.15.45:0/2790565239 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa5740cd7c0 0x7fa5740cdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:10:50.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:50.102+0000 7fa573fff700 1 --2- 172.21.15.45:0/2790565239 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa57415c9b0 0x7fa5740b4bf0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa564009840 tx=0x7fa564009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=452d8b5b4d7b26dc server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:10:50.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:50.102+0000 7fa5737fe700 1 -- 172.21.15.45:0/2790565239 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa564011830 con 0x7fa57415c9b0 2023-11-28T12:10:50.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:50.102+0000 7fa5737fe700 1 -- 172.21.15.45:0/2790565239 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa564011990 con 0x7fa57415c9b0 2023-11-28T12:10:50.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:50.102+0000 7fa5737fe700 1 -- 172.21.15.45:0/2790565239 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa564011d20 con 0x7fa57415c9b0 2023-11-28T12:10:50.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:50.103+0000 7fa57a7ff700 1 -- 172.21.15.45:0/2790565239 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa57415c9b0 msgr2=0x7fa5740b4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:10:50.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:50.103+0000 7fa57a7ff700 1 --2- 172.21.15.45:0/2790565239 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa57415c9b0 0x7fa5740b4bf0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa564009840 tx=0x7fa564009b50 comp rx=0 tx=0).stop 2023-11-28T12:10:50.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:50.103+0000 7fa57a7ff700 1 -- 172.21.15.45:0/2790565239 shutdown_connections 2023-11-28T12:10:50.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:50.103+0000 7fa57a7ff700 1 --2- 172.21.15.45:0/2790565239 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa5740cd7c0 0x7fa5740cdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:50.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:50.103+0000 7fa57a7ff700 1 --2- 172.21.15.45:0/2790565239 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa57415c9b0 0x7fa5740b4bf0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:50.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:50.103+0000 7fa57a7ff700 1 -- 172.21.15.45:0/2790565239 >> 172.21.15.45:0/2790565239 conn(0x7fa574072600 msgr2=0x7fa5740cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:10:50.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:50.103+0000 7fa57a7ff700 1 -- 172.21.15.45:0/2790565239 shutdown_connections 2023-11-28T12:10:50.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:50.103+0000 7fa57a7ff700 1 -- 172.21.15.45:0/2790565239 wait complete. 2023-11-28T12:10:50.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:50.105+0000 7fa57a7ff700 1 Processor -- start 2023-11-28T12:10:50.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:50.105+0000 7fa57a7ff700 1 -- start start 2023-11-28T12:10:50.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:50.106+0000 7fa57a7ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa5740cd7c0 0x7fa574157a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:50.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:50.106+0000 7fa57a7ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa57415c9b0 0x7fa5740c8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:50.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:50.106+0000 7fa57a7ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa574161340 0x7fa57415e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:50.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:50.106+0000 7fa57a7ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5741f7690 con 0x7fa5740cd7c0 2023-11-28T12:10:50.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:50.106+0000 7fa57a7ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5741f6ac0 con 0x7fa574161340 2023-11-28T12:10:50.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:50.106+0000 7fa57a7ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5741f6d60 con 0x7fa57415c9b0 2023-11-28T12:10:50.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:50.106+0000 7fa573fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa5740cd7c0 0x7fa574157a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:10:50.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:50.106+0000 7fa573fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa5740cd7c0 0x7fa574157a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46870/0 (socket says 172.21.15.45:46870) 2023-11-28T12:10:50.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:50.106+0000 7fa573fff700 1 -- 172.21.15.45:0/497395118 learned_addr learned my addr 172.21.15.45:0/497395118 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:10:50.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:50.106+0000 7fa56bfff700 1 --2- 172.21.15.45:0/497395118 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa57415c9b0 0x7fa5740c8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:10:50.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:50.106+0000 7fa578d9c700 1 --2- 172.21.15.45:0/497395118 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa574161340 0x7fa57415e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:10:50.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:50.107+0000 7fa573fff700 1 -- 172.21.15.45:0/497395118 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa57415c9b0 msgr2=0x7fa5740c8150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:10:50.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:50.107+0000 7fa573fff700 1 --2- 172.21.15.45:0/497395118 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa57415c9b0 0x7fa5740c8150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:50.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:50.107+0000 7fa573fff700 1 -- 172.21.15.45:0/497395118 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa574161340 msgr2=0x7fa57415e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:10:50.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:50.107+0000 7fa573fff700 1 --2- 172.21.15.45:0/497395118 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa574161340 0x7fa57415e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:50.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:50.107+0000 7fa573fff700 1 -- 172.21.15.45:0/497395118 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa56c009a70 con 0x7fa5740cd7c0 2023-11-28T12:10:50.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:50.107+0000 7fa573fff700 1 --2- 172.21.15.45:0/497395118 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa5740cd7c0 0x7fa574157a70 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fa564009fd0 tx=0x7fa564004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:10:50.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:50.107+0000 7fa5717fa700 1 -- 172.21.15.45:0/497395118 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa564004550 con 0x7fa5740cd7c0 2023-11-28T12:10:50.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:50.107+0000 7fa5717fa700 1 -- 172.21.15.45:0/497395118 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa56401e070 con 0x7fa5740cd7c0 2023-11-28T12:10:50.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:50.107+0000 7fa57a7ff700 1 -- 172.21.15.45:0/497395118 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5640094a0 con 0x7fa5740cd7c0 2023-11-28T12:10:50.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:50.107+0000 7fa5717fa700 1 -- 172.21.15.45:0/497395118 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5640038e0 con 0x7fa5740cd7c0 2023-11-28T12:10:50.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:50.107+0000 7fa57a7ff700 1 -- 172.21.15.45:0/497395118 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5740d1300 con 0x7fa5740cd7c0 2023-11-28T12:10:50.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:50.108+0000 7fa57a7ff700 1 -- 172.21.15.45:0/497395118 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5740b5520 con 0x7fa5740cd7c0 2023-11-28T12:10:50.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:50.109+0000 7fa5717fa700 1 -- 172.21.15.45:0/497395118 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fa56400f050 con 0x7fa5740cd7c0 2023-11-28T12:10:50.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:50.110+0000 7fa5717fa700 1 --2- 172.21.15.45:0/497395118 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fa5540682f0 0x7fa55406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:50.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:50.110+0000 7fa5717fa700 1 -- 172.21.15.45:0/497395118 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6207+0+0 (secure 0 0 0) 0x7fa564086bd0 con 0x7fa5740cd7c0 2023-11-28T12:10:50.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:50.111+0000 7fa56bfff700 1 --2- 172.21.15.45:0/497395118 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fa5540682f0 0x7fa55406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:10:50.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:50.112+0000 7fa56bfff700 1 --2- 172.21.15.45:0/497395118 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fa5540682f0 0x7fa55406a7a0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fa5740b90b0 tx=0x7fa55c007dc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:10:50.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:50.115+0000 7fa5717fa700 1 -- 172.21.15.45:0/497395118 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fa5640532b0 con 0x7fa5740cd7c0 2023-11-28T12:10:50.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:50.362+0000 7fa57a7ff700 1 -- 172.21.15.45:0/497395118 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fa5740d15e0 con 0x7fa5740cd7c0 2023-11-28T12:10:50.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:50.362+0000 7fa5717fa700 1 -- 172.21.15.45:0/497395118 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7fa5640200c0 con 0x7fa5740cd7c0 2023-11-28T12:10:50.363 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:10:50.363 INFO:teuthology.orchestra.run.smithi045.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-28T12:10:50.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:50.364+0000 7fa57a7ff700 1 -- 172.21.15.45:0/497395118 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fa5540682f0 msgr2=0x7fa55406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:10:50.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:50.364+0000 7fa57a7ff700 1 --2- 172.21.15.45:0/497395118 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fa5540682f0 0x7fa55406a7a0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fa5740b90b0 tx=0x7fa55c007dc0 comp rx=0 tx=0).stop 2023-11-28T12:10:50.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:50.364+0000 7fa57a7ff700 1 -- 172.21.15.45:0/497395118 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa5740cd7c0 msgr2=0x7fa574157a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:10:50.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:50.364+0000 7fa57a7ff700 1 --2- 172.21.15.45:0/497395118 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa5740cd7c0 0x7fa574157a70 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fa564009fd0 tx=0x7fa564004750 comp rx=0 tx=0).stop 2023-11-28T12:10:50.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:50.364+0000 7fa57a7ff700 1 -- 172.21.15.45:0/497395118 shutdown_connections 2023-11-28T12:10:50.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:50.364+0000 7fa57a7ff700 1 --2- 172.21.15.45:0/497395118 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fa5540682f0 0x7fa55406a7a0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:50.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:50.364+0000 7fa57a7ff700 1 --2- 172.21.15.45:0/497395118 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa574161340 0x7fa57415e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:50.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:50.364+0000 7fa57a7ff700 1 --2- 172.21.15.45:0/497395118 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa5740cd7c0 0x7fa574157a70 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:50.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:50.364+0000 7fa57a7ff700 1 --2- 172.21.15.45:0/497395118 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa57415c9b0 0x7fa5740c8150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:50.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:50.364+0000 7fa57a7ff700 1 -- 172.21.15.45:0/497395118 >> 172.21.15.45:0/497395118 conn(0x7fa574072600 msgr2=0x7fa57415aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:10:50.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:50.364+0000 7fa57a7ff700 1 -- 172.21.15.45:0/497395118 shutdown_connections 2023-11-28T12:10:50.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:50.365+0000 7fa57a7ff700 1 -- 172.21.15.45:0/497395118 wait complete. 2023-11-28T12:10:50.383 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=100 retry_count=0)... 2023-11-28T12:10:55.384 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T12:10:55.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:55.598+0000 7ff7d29ff700 1 Processor -- start 2023-11-28T12:10:55.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:55.598+0000 7ff7d29ff700 1 -- start start 2023-11-28T12:10:55.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:55.600+0000 7ff7d29ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff7cc15ca50 0x7ff7cc06b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:55.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:55.600+0000 7ff7d29ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff7cc06b8c0 0x7ff7cc0cc700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:55.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:55.600+0000 7ff7d29ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ff7cc0ccc40 0x7ff7cc0cd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:55.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:55.600+0000 7ff7d29ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7cc0cd470 con 0x7ff7cc15ca50 2023-11-28T12:10:55.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:55.600+0000 7ff7d29ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7cc06bd30 con 0x7ff7cc0ccc40 2023-11-28T12:10:55.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:55.600+0000 7ff7d29ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7cc0cf5e0 con 0x7ff7cc06b8c0 2023-11-28T12:10:55.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:55.600+0000 7ff7cbfff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff7cc15ca50 0x7ff7cc06b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:10:55.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:55.600+0000 7ff7cbfff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff7cc15ca50 0x7ff7cc06b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52738/0 (socket says 172.21.15.45:52738) 2023-11-28T12:10:55.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:55.600+0000 7ff7cbfff700 1 -- 172.21.15.45:0/3842464589 learned_addr learned my addr 172.21.15.45:0/3842464589 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:10:55.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:55.600+0000 7ff7cb7fe700 1 --2- 172.21.15.45:0/3842464589 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff7cc06b8c0 0x7ff7cc0cc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:10:55.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:55.600+0000 7ff7d0f9c700 1 --2- 172.21.15.45:0/3842464589 >> v2:172.21.15.152:3300/0 conn(0x7ff7cc0ccc40 0x7ff7cc0cd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:10:55.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:55.600+0000 7ff7cbfff700 1 -- 172.21.15.45:0/3842464589 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff7cc06b8c0 msgr2=0x7ff7cc0cc700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:10:55.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:55.600+0000 7ff7cbfff700 1 --2- 172.21.15.45:0/3842464589 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff7cc06b8c0 0x7ff7cc0cc700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:55.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:55.600+0000 7ff7cbfff700 1 -- 172.21.15.45:0/3842464589 >> v2:172.21.15.152:3300/0 conn(0x7ff7cc0ccc40 msgr2=0x7ff7cc0cd7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:10:55.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:55.600+0000 7ff7cbfff700 1 --2- 172.21.15.45:0/3842464589 >> v2:172.21.15.152:3300/0 conn(0x7ff7cc0ccc40 0x7ff7cc0cd7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:55.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:55.600+0000 7ff7cbfff700 1 -- 172.21.15.45:0/3842464589 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7cc0cecb0 con 0x7ff7cc15ca50 2023-11-28T12:10:55.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:55.600+0000 7ff7d0f9c700 1 --2- 172.21.15.45:0/3842464589 >> v2:172.21.15.152:3300/0 conn(0x7ff7cc0ccc40 0x7ff7cc0cd7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:10:55.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:55.601+0000 7ff7cbfff700 1 --2- 172.21.15.45:0/3842464589 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7cc15ca50 0x7ff7cc06b380 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc0c7fc0 tx=0x7ff7bc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b31ea15af36efa3a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:10:55.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:55.601+0000 7ff7caffd700 1 -- 172.21.15.45:0/3842464589 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7bc011830 con 0x7ff7cc15ca50 2023-11-28T12:10:55.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:55.601+0000 7ff7caffd700 1 -- 172.21.15.45:0/3842464589 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7bc011990 con 0x7ff7cc15ca50 2023-11-28T12:10:55.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:55.601+0000 7ff7caffd700 1 -- 172.21.15.45:0/3842464589 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7bc011d20 con 0x7ff7cc15ca50 2023-11-28T12:10:55.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:55.602+0000 7ff7d29ff700 1 -- 172.21.15.45:0/3842464589 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7cc15ca50 msgr2=0x7ff7cc06b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:10:55.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:55.602+0000 7ff7d29ff700 1 --2- 172.21.15.45:0/3842464589 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7cc15ca50 0x7ff7cc06b380 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc0c7fc0 tx=0x7ff7bc009c00 comp rx=0 tx=0).stop 2023-11-28T12:10:55.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:55.602+0000 7ff7d29ff700 1 -- 172.21.15.45:0/3842464589 shutdown_connections 2023-11-28T12:10:55.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:55.602+0000 7ff7d29ff700 1 --2- 172.21.15.45:0/3842464589 >> v2:172.21.15.152:3300/0 conn(0x7ff7cc0ccc40 0x7ff7cc0cd7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:55.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:55.602+0000 7ff7d29ff700 1 --2- 172.21.15.45:0/3842464589 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7cc15ca50 0x7ff7cc06b380 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:55.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:55.602+0000 7ff7d29ff700 1 --2- 172.21.15.45:0/3842464589 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff7cc06b8c0 0x7ff7cc0cc700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:55.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:55.602+0000 7ff7d29ff700 1 -- 172.21.15.45:0/3842464589 >> 172.21.15.45:0/3842464589 conn(0x7ff7cc09a230 msgr2=0x7ff7cc08afd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:10:55.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:55.602+0000 7ff7d29ff700 1 -- 172.21.15.45:0/3842464589 shutdown_connections 2023-11-28T12:10:55.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:55.602+0000 7ff7d29ff700 1 -- 172.21.15.45:0/3842464589 wait complete. 2023-11-28T12:10:55.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:55.604+0000 7ff7d29ff700 1 Processor -- start 2023-11-28T12:10:55.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:55.604+0000 7ff7d29ff700 1 -- start start 2023-11-28T12:10:55.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:55.605+0000 7ff7d29ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7cc06b8c0 0x7ff7cc0b5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:55.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:55.605+0000 7ff7d29ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7cc0ccc40 0x7ff7cc145a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:55.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:55.605+0000 7ff7d29ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff7cc15ca50 0x7ff7cc145fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:55.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:55.605+0000 7ff7d29ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7cc1466e0 con 0x7ff7cc06b8c0 2023-11-28T12:10:55.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:55.605+0000 7ff7d29ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7cc15fa60 con 0x7ff7cc0ccc40 2023-11-28T12:10:55.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:55.605+0000 7ff7d29ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7cc15fd40 con 0x7ff7cc15ca50 2023-11-28T12:10:55.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:55.605+0000 7ff7cbfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7cc06b8c0 0x7ff7cc0b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:10:55.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:55.605+0000 7ff7cbfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7cc06b8c0 0x7ff7cc0b5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52754/0 (socket says 172.21.15.45:52754) 2023-11-28T12:10:55.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:55.605+0000 7ff7cbfff700 1 -- 172.21.15.45:0/442908990 learned_addr learned my addr 172.21.15.45:0/442908990 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:10:55.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:55.605+0000 7ff7cb7fe700 1 --2- 172.21.15.45:0/442908990 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7cc0ccc40 0x7ff7cc145a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:10:55.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:55.605+0000 7ff7d0f9c700 1 --2- 172.21.15.45:0/442908990 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff7cc15ca50 0x7ff7cc145fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:10:55.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:55.606+0000 7ff7cbfff700 1 -- 172.21.15.45:0/442908990 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff7cc15ca50 msgr2=0x7ff7cc145fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:10:55.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:55.606+0000 7ff7cbfff700 1 --2- 172.21.15.45:0/442908990 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff7cc15ca50 0x7ff7cc145fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:55.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:55.606+0000 7ff7cbfff700 1 -- 172.21.15.45:0/442908990 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7cc0ccc40 msgr2=0x7ff7cc145a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:10:55.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:55.606+0000 7ff7cbfff700 1 --2- 172.21.15.45:0/442908990 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7cc0ccc40 0x7ff7cc145a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:55.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:55.606+0000 7ff7cbfff700 1 -- 172.21.15.45:0/442908990 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7bc009550 con 0x7ff7cc06b8c0 2023-11-28T12:10:55.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:55.606+0000 7ff7cbfff700 1 --2- 172.21.15.45:0/442908990 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7cc06b8c0 0x7ff7cc0b5050 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc000c00 tx=0x7ff7bc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:10:55.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:55.606+0000 7ff7c8ff9700 1 -- 172.21.15.45:0/442908990 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7bc004510 con 0x7ff7cc06b8c0 2023-11-28T12:10:55.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:55.606+0000 7ff7c8ff9700 1 -- 172.21.15.45:0/442908990 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7bc01e070 con 0x7ff7cc06b8c0 2023-11-28T12:10:55.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:55.606+0000 7ff7c8ff9700 1 -- 172.21.15.45:0/442908990 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7bc0038e0 con 0x7ff7cc06b8c0 2023-11-28T12:10:55.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:55.606+0000 7ff7d29ff700 1 -- 172.21.15.45:0/442908990 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7cc0cf270 con 0x7ff7cc06b8c0 2023-11-28T12:10:55.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:55.607+0000 7ff7d29ff700 1 -- 172.21.15.45:0/442908990 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7cc0cef90 con 0x7ff7cc06b8c0 2023-11-28T12:10:55.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:55.608+0000 7ff7d29ff700 1 -- 172.21.15.45:0/442908990 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7cc0cd0c0 con 0x7ff7cc06b8c0 2023-11-28T12:10:55.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:55.609+0000 7ff7c8ff9700 1 -- 172.21.15.45:0/442908990 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7ff7bc00f050 con 0x7ff7cc06b8c0 2023-11-28T12:10:55.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:55.610+0000 7ff7c8ff9700 1 --2- 172.21.15.45:0/442908990 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7ff7b80682f0 0x7ff7b806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:10:55.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:55.610+0000 7ff7c8ff9700 1 -- 172.21.15.45:0/442908990 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6207+0+0 (secure 0 0 0) 0x7ff7bc086b20 con 0x7ff7cc06b8c0 2023-11-28T12:10:55.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:55.610+0000 7ff7cb7fe700 1 --2- 172.21.15.45:0/442908990 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7ff7b80682f0 0x7ff7b806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:10:55.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:55.611+0000 7ff7cb7fe700 1 --2- 172.21.15.45:0/442908990 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7ff7b80682f0 0x7ff7b806a7a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc0d0e40 tx=0x7ff7c0009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:10:55.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:55.615+0000 7ff7c8ff9700 1 -- 172.21.15.45:0/442908990 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7ff7bc0532f0 con 0x7ff7cc06b8c0 2023-11-28T12:10:55.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:55.858+0000 7ff7d29ff700 1 -- 172.21.15.45:0/442908990 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7ff7cc0745c0 con 0x7ff7cc06b8c0 2023-11-28T12:10:55.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:55.858+0000 7ff7c8ff9700 1 -- 172.21.15.45:0/442908990 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7ff7bc0150c0 con 0x7ff7cc06b8c0 2023-11-28T12:10:55.860 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:10:55.860 INFO:teuthology.orchestra.run.smithi045.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-28T12:10:55.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:55.860+0000 7ff7d29ff700 1 -- 172.21.15.45:0/442908990 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7ff7b80682f0 msgr2=0x7ff7b806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:10:55.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:55.860+0000 7ff7d29ff700 1 --2- 172.21.15.45:0/442908990 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7ff7b80682f0 0x7ff7b806a7a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc0d0e40 tx=0x7ff7c0009210 comp rx=0 tx=0).stop 2023-11-28T12:10:55.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:55.860+0000 7ff7d29ff700 1 -- 172.21.15.45:0/442908990 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7cc06b8c0 msgr2=0x7ff7cc0b5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:10:55.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:55.860+0000 7ff7d29ff700 1 --2- 172.21.15.45:0/442908990 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7cc06b8c0 0x7ff7cc0b5050 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc000c00 tx=0x7ff7bc004750 comp rx=0 tx=0).stop 2023-11-28T12:10:55.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:55.860+0000 7ff7d29ff700 1 -- 172.21.15.45:0/442908990 shutdown_connections 2023-11-28T12:10:55.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:55.860+0000 7ff7d29ff700 1 --2- 172.21.15.45:0/442908990 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7ff7b80682f0 0x7ff7b806a7a0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:55.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:55.860+0000 7ff7d29ff700 1 --2- 172.21.15.45:0/442908990 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff7cc15ca50 0x7ff7cc145fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:55.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:55.860+0000 7ff7d29ff700 1 --2- 172.21.15.45:0/442908990 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7cc06b8c0 0x7ff7cc0b5050 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:55.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:55.860+0000 7ff7d29ff700 1 --2- 172.21.15.45:0/442908990 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff7cc0ccc40 0x7ff7cc145a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:10:55.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:55.860+0000 7ff7d29ff700 1 -- 172.21.15.45:0/442908990 >> 172.21.15.45:0/442908990 conn(0x7ff7cc09a230 msgr2=0x7ff7cc15bd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:10:55.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:55.860+0000 7ff7d29ff700 1 -- 172.21.15.45:0/442908990 shutdown_connections 2023-11-28T12:10:55.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:10:55.860+0000 7ff7d29ff700 1 -- 172.21.15.45:0/442908990 wait complete. 2023-11-28T12:10:55.880 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=100 retry_count=0)... 2023-11-28T12:11:00.881 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T12:11:01.015 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T12:11:01.020 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T12:11:01.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:01.099+0000 7f35c3bff700 1 Processor -- start 2023-11-28T12:11:01.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:01.099+0000 7f35c3bff700 1 -- start start 2023-11-28T12:11:01.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:01.100+0000 7f35c3bff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f35bc0d01b0 0x7f35bc0d0c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:11:01.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:01.100+0000 7f35c3bff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f35bc0b20b0 0x7f35bc0d1160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:11:01.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:01.100+0000 7f35c3bff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35bc0b0230 con 0x7f35bc0b29b0 2023-11-28T12:11:01.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:01.100+0000 7f35c3bff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35bc15cec0 con 0x7f35bc0b20b0 2023-11-28T12:11:01.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:01.100+0000 7f35c3bff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35bc0b4570 con 0x7f35bc0d01b0 2023-11-28T12:11:01.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:01.101+0000 7f35c119a700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f35bc0b20b0 0x7f35bc0d1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:11:01.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:01.101+0000 7f35c199b700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f35bc0d01b0 0x7f35bc0d0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:11:01.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:01.101+0000 7f35c199b700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f35bc0d01b0 0x7f35bc0d0c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.45:42398/0 (socket says 172.21.15.45:42398) 2023-11-28T12:11:01.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:01.101+0000 7f35c199b700 1 -- 172.21.15.45:0/1524319721 learned_addr learned my addr 172.21.15.45:0/1524319721 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:11:01.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:01.101+0000 7f35c119a700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f35bc0b20b0 0x7f35bc0d1160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.45:46666/0 (socket says 172.21.15.45:46666) 2023-11-28T12:11:01.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:01.102+0000 7f35c119a700 1 -- 172.21.15.45:0/1524319721 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f35bc0d01b0 msgr2=0x7f35bc0d0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:11:01.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:01.102+0000 7f35c119a700 1 --2- 172.21.15.45:0/1524319721 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f35bc0d01b0 0x7f35bc0d0c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:01.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:01.102+0000 7f35c119a700 1 -- 172.21.15.45:0/1524319721 >> v1:172.21.15.152:6789/0 conn(0x7f35bc0b29b0 legacy=0x7f35bc0b2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:11:01.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:01.102+0000 7f35c119a700 1 -- 172.21.15.45:0/1524319721 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35bc0b4850 con 0x7f35bc0b20b0 2023-11-28T12:11:01.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:01.102+0000 7f35c199b700 1 --2- 172.21.15.45:0/1524319721 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f35bc0d01b0 0x7f35bc0d0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:11:01.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:01.102+0000 7f35c0999700 1 -- 172.21.15.45:0/1524319721 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4113544429 0 0) 0x7f35bc0b0230 con 0x7f35bc0b29b0 2023-11-28T12:11:01.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:01.102+0000 7f35c119a700 1 --2- 172.21.15.45:0/1524319721 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f35bc0b20b0 0x7f35bc0d1160 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f35ac009840 tx=0x7f35ac009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b17a9477078efcc server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:11:01.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:01.102+0000 7f35c0999700 1 -- 172.21.15.45:0/1524319721 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35ac011830 con 0x7f35bc0b20b0 2023-11-28T12:11:01.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:01.102+0000 7f35c0999700 1 -- 172.21.15.45:0/1524319721 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35ac011990 con 0x7f35bc0b20b0 2023-11-28T12:11:01.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:01.102+0000 7f35c0999700 1 -- 172.21.15.45:0/1524319721 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35ac011d20 con 0x7f35bc0b20b0 2023-11-28T12:11:01.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:01.103+0000 7f35c3bff700 1 -- 172.21.15.45:0/1524319721 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f35bc0b20b0 msgr2=0x7f35bc0d1160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:11:01.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:01.103+0000 7f35c3bff700 1 --2- 172.21.15.45:0/1524319721 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f35bc0b20b0 0x7f35bc0d1160 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f35ac009840 tx=0x7f35ac009b50 comp rx=0 tx=0).stop 2023-11-28T12:11:01.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:01.103+0000 7f35c3bff700 1 -- 172.21.15.45:0/1524319721 shutdown_connections 2023-11-28T12:11:01.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:01.103+0000 7f35c3bff700 1 --2- 172.21.15.45:0/1524319721 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f35bc0d01b0 0x7f35bc0d0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:01.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:01.103+0000 7f35c3bff700 1 --2- 172.21.15.45:0/1524319721 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f35bc0b20b0 0x7f35bc0d1160 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:01.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:01.103+0000 7f35c3bff700 1 -- 172.21.15.45:0/1524319721 >> 172.21.15.45:0/1524319721 conn(0x7f35bc09c3f0 msgr2=0x7f35bc0d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:11:01.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:01.103+0000 7f35c3bff700 1 -- 172.21.15.45:0/1524319721 shutdown_connections 2023-11-28T12:11:01.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:01.103+0000 7f35c3bff700 1 -- 172.21.15.45:0/1524319721 wait complete. 2023-11-28T12:11:01.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:01.105+0000 7f35c3bff700 1 Processor -- start 2023-11-28T12:11:01.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:01.105+0000 7f35c3bff700 1 -- start start 2023-11-28T12:11:01.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:01.106+0000 7f35c3bff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f35bc0b20b0 0x7f35bc153c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:11:01.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:01.106+0000 7f35c3bff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f35bc0b29b0 0x7f35bc0b8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:11:01.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:01.106+0000 7f35c3bff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f35bc0d01b0 0x7f35bc06ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:11:01.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:01.106+0000 7f35c3bff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35bc0b5e80 con 0x7f35bc0b20b0 2023-11-28T12:11:01.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:01.106+0000 7f35c3bff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35bc0b6ce0 con 0x7f35bc0b29b0 2023-11-28T12:11:01.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:01.106+0000 7f35c3bff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35bc0b60d0 con 0x7f35bc0d01b0 2023-11-28T12:11:01.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:01.106+0000 7f35c199b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f35bc0b20b0 0x7f35bc153c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:11:01.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:01.106+0000 7f35c199b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f35bc0b20b0 0x7f35bc153c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52770/0 (socket says 172.21.15.45:52770) 2023-11-28T12:11:01.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:01.106+0000 7f35c199b700 1 -- 172.21.15.45:0/244813701 learned_addr learned my addr 172.21.15.45:0/244813701 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:11:01.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:01.106+0000 7f35c119a700 1 --2- 172.21.15.45:0/244813701 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f35bc0b29b0 0x7f35bc0b8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:11:01.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:01.106+0000 7f35c219c700 1 --2- 172.21.15.45:0/244813701 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f35bc0d01b0 0x7f35bc06ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:11:01.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:01.106+0000 7f35c199b700 1 -- 172.21.15.45:0/244813701 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f35bc0d01b0 msgr2=0x7f35bc06ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:11:01.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:01.106+0000 7f35c199b700 1 --2- 172.21.15.45:0/244813701 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f35bc0d01b0 0x7f35bc06ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:01.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:01.106+0000 7f35c199b700 1 -- 172.21.15.45:0/244813701 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f35bc0b29b0 msgr2=0x7f35bc0b8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:11:01.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:01.106+0000 7f35c199b700 1 --2- 172.21.15.45:0/244813701 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f35bc0b29b0 0x7f35bc0b8610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:01.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:01.106+0000 7f35c199b700 1 -- 172.21.15.45:0/244813701 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35b8009550 con 0x7f35bc0b20b0 2023-11-28T12:11:01.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:01.106+0000 7f35c219c700 1 --2- 172.21.15.45:0/244813701 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f35bc0d01b0 0x7f35bc06ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:11:01.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:01.107+0000 7f35c199b700 1 --2- 172.21.15.45:0/244813701 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f35bc0b20b0 0x7f35bc153c10 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f35b800e9b0 tx=0x7f35b800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:11:01.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:01.107+0000 7f35b27fc700 1 -- 172.21.15.45:0/244813701 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b800c850 con 0x7f35bc0b20b0 2023-11-28T12:11:01.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:01.107+0000 7f35b27fc700 1 -- 172.21.15.45:0/244813701 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35b800c9b0 con 0x7f35bc0b20b0 2023-11-28T12:11:01.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:01.107+0000 7f35c3bff700 1 -- 172.21.15.45:0/244813701 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35ac0094a0 con 0x7f35bc0b20b0 2023-11-28T12:11:01.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:01.107+0000 7f35b27fc700 1 -- 172.21.15.45:0/244813701 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b800cd20 con 0x7f35bc0b20b0 2023-11-28T12:11:01.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:01.107+0000 7f35c3bff700 1 -- 172.21.15.45:0/244813701 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35bc0afec0 con 0x7f35bc0b20b0 2023-11-28T12:11:01.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:01.108+0000 7f35c3bff700 1 -- 172.21.15.45:0/244813701 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35bc0afbe0 con 0x7f35bc0b20b0 2023-11-28T12:11:01.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:01.109+0000 7f35b27fc700 1 -- 172.21.15.45:0/244813701 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f35b8019030 con 0x7f35bc0b20b0 2023-11-28T12:11:01.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:01.110+0000 7f35b27fc700 1 --2- 172.21.15.45:0/244813701 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f35a00682f0 0x7f35a006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:11:01.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:01.110+0000 7f35b27fc700 1 -- 172.21.15.45:0/244813701 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f35b8085e30 con 0x7f35bc0b20b0 2023-11-28T12:11:01.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:01.110+0000 7f35c119a700 1 --2- 172.21.15.45:0/244813701 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f35a00682f0 0x7f35a006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:11:01.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:01.111+0000 7f35c119a700 1 --2- 172.21.15.45:0/244813701 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f35a00682f0 0x7f35a006a7a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f35ac0090b0 tx=0x7f35ac008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:11:01.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:01.114+0000 7f35b27fc700 1 -- 172.21.15.45:0/244813701 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f35b8052510 con 0x7f35bc0b20b0 2023-11-28T12:11:01.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:01.360+0000 7f35c3bff700 1 -- 172.21.15.45:0/244813701 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f35bc0b6fc0 con 0x7f35bc0b20b0 2023-11-28T12:11:01.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:01.361+0000 7f35b27fc700 1 -- 172.21.15.45:0/244813701 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7f35b80170c0 con 0x7f35bc0b20b0 2023-11-28T12:11:01.363 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:11:01.363 INFO:teuthology.orchestra.run.smithi045.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-28T12:11:01.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:01.363+0000 7f35c3bff700 1 -- 172.21.15.45:0/244813701 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f35a00682f0 msgr2=0x7f35a006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:11:01.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:01.363+0000 7f35c3bff700 1 --2- 172.21.15.45:0/244813701 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f35a00682f0 0x7f35a006a7a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f35ac0090b0 tx=0x7f35ac008030 comp rx=0 tx=0).stop 2023-11-28T12:11:01.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:01.363+0000 7f35c3bff700 1 -- 172.21.15.45:0/244813701 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f35bc0b20b0 msgr2=0x7f35bc153c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:11:01.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:01.363+0000 7f35c3bff700 1 --2- 172.21.15.45:0/244813701 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f35bc0b20b0 0x7f35bc153c10 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f35b800e9b0 tx=0x7f35b800ed70 comp rx=0 tx=0).stop 2023-11-28T12:11:01.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:01.364+0000 7f35c3bff700 1 -- 172.21.15.45:0/244813701 shutdown_connections 2023-11-28T12:11:01.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:01.364+0000 7f35c3bff700 1 --2- 172.21.15.45:0/244813701 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f35a00682f0 0x7f35a006a7a0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:01.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:01.364+0000 7f35c3bff700 1 --2- 172.21.15.45:0/244813701 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f35bc0d01b0 0x7f35bc06ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:01.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:01.364+0000 7f35c3bff700 1 --2- 172.21.15.45:0/244813701 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f35bc0b20b0 0x7f35bc153c10 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:01.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:01.364+0000 7f35c3bff700 1 --2- 172.21.15.45:0/244813701 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f35bc0b29b0 0x7f35bc0b8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:01.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:01.364+0000 7f35c3bff700 1 -- 172.21.15.45:0/244813701 >> 172.21.15.45:0/244813701 conn(0x7f35bc09c3f0 msgr2=0x7f35bc0b14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:11:01.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:01.364+0000 7f35c3bff700 1 -- 172.21.15.45:0/244813701 shutdown_connections 2023-11-28T12:11:01.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:01.364+0000 7f35c3bff700 1 -- 172.21.15.45:0/244813701 wait complete. 2023-11-28T12:11:01.383 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=100 retry_count=0)... 2023-11-28T12:11:06.384 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T12:11:06.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:06.597+0000 7f5bf0bff700 1 Processor -- start 2023-11-28T12:11:06.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:06.597+0000 7f5bf0bff700 1 -- start start 2023-11-28T12:11:06.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:06.599+0000 7f5bf0bff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f5bec161340 0x7f5bec0d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:11:06.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:06.599+0000 7f5bf0bff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bec0d1950 con 0x7f5bec15c9b0 2023-11-28T12:11:06.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:06.599+0000 7f5bf0bff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bec0b5520 con 0x7f5bec0d2320 2023-11-28T12:11:06.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:06.599+0000 7f5bf0bff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bec0b5800 con 0x7f5bec161340 2023-11-28T12:11:06.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:06.599+0000 7f5bea59c700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f5bec15c9b0 0x7f5bec0b4bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:46740/0 (socket says 172.21.15.45:46740) 2023-11-28T12:11:06.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:06.599+0000 7f5bea59c700 1 -- 172.21.15.45:0/950461013 learned_addr learned my addr 172.21.15.45:0/950461013 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:11:06.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:06.599+0000 7f5be3fff700 1 --2- 172.21.15.45:0/950461013 >> v2:172.21.15.152:3300/0 conn(0x7f5bec161340 0x7f5bec0d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:11:06.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:06.599+0000 7f5be9d9b700 1 -- 172.21.15.45:0/950461013 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1088393818 0 0) 0x7f5bec0d1950 con 0x7f5bec15c9b0 2023-11-28T12:11:06.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:06.599+0000 7f5be9d9b700 1 -- 172.21.15.45:0/950461013 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5bd80035b0 con 0x7f5bec15c9b0 2023-11-28T12:11:06.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:06.600+0000 7f5be9d9b700 1 -- 172.21.15.45:0/950461013 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2063582201 0 0) 0x7f5bd80035b0 con 0x7f5bec15c9b0 2023-11-28T12:11:06.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:06.600+0000 7f5be9d9b700 1 -- 172.21.15.45:0/950461013 >> v2:172.21.15.152:3300/0 conn(0x7f5bec161340 msgr2=0x7f5bec0d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:11:06.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:06.600+0000 7f5be9d9b700 1 --2- 172.21.15.45:0/950461013 >> v2:172.21.15.152:3300/0 conn(0x7f5bec161340 0x7f5bec0d1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:06.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:06.600+0000 7f5be9d9b700 1 -- 172.21.15.45:0/950461013 >> v1:172.21.15.152:6789/0 conn(0x7f5bec0d2320 legacy=0x7f5bec0cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:11:06.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:06.600+0000 7f5be9d9b700 1 -- 172.21.15.45:0/950461013 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bec0d1300 con 0x7f5bec15c9b0 2023-11-28T12:11:06.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:06.600+0000 7f5be9d9b700 1 -- 172.21.15.45:0/950461013 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3460218165 0 0) 0x7f5bdc001670 con 0x7f5bec15c9b0 2023-11-28T12:11:06.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:06.600+0000 7f5be9d9b700 1 -- 172.21.15.45:0/950461013 >> v1:172.21.15.45:6789/0 conn(0x7f5bec15c9b0 legacy=0x7f5bec0b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:11:06.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:06.600+0000 7f5be9d9b700 1 --2- 172.21.15.45:0/950461013 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5bd8003a00 0x7f5bd8003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:11:06.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:06.600+0000 7f5be9d9b700 1 --2- 172.21.15.45:0/950461013 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5bd8004850 0x7f5bd8004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:11:06.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:06.600+0000 7f5be9d9b700 1 --2- 172.21.15.45:0/950461013 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5bd8005200 0x7f5bd800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:11:06.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:06.600+0000 7f5be9d9b700 1 -- 172.21.15.45:0/950461013 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bec0b5800 con 0x7f5bd8004850 2023-11-28T12:11:06.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:06.600+0000 7f5be9d9b700 1 -- 172.21.15.45:0/950461013 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd800c110 con 0x7f5bd8003a00 2023-11-28T12:11:06.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:06.600+0000 7f5be9d9b700 1 -- 172.21.15.45:0/950461013 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd800c2d0 con 0x7f5bd8005200 2023-11-28T12:11:06.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:06.600+0000 7f5be3fff700 1 --2- 172.21.15.45:0/950461013 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5bd8004850 0x7f5bd8004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:11:06.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:06.600+0000 7f5bea59c700 1 --2- 172.21.15.45:0/950461013 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5bd8003a00 0x7f5bd8003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:11:06.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:06.600+0000 7f5bead9d700 1 --2- 172.21.15.45:0/950461013 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5bd8005200 0x7f5bd800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:11:06.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:06.600+0000 7f5be3fff700 1 -- 172.21.15.45:0/950461013 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5bd8005200 msgr2=0x7f5bd800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:11:06.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:06.601+0000 7f5be3fff700 1 --2- 172.21.15.45:0/950461013 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5bd8005200 0x7f5bd800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:06.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:06.601+0000 7f5be3fff700 1 -- 172.21.15.45:0/950461013 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5bd8003a00 msgr2=0x7f5bd8003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:11:06.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:06.601+0000 7f5be3fff700 1 --2- 172.21.15.45:0/950461013 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5bd8003a00 0x7f5bd8003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:06.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:06.601+0000 7f5be3fff700 1 -- 172.21.15.45:0/950461013 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bd80035b0 con 0x7f5bd8004850 2023-11-28T12:11:06.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:06.601+0000 7f5bead9d700 1 -- 172.21.15.45:0/950461013 reap_dead start 2023-11-28T12:11:06.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:06.601+0000 7f5be3fff700 1 --2- 172.21.15.45:0/950461013 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5bd8004850 0x7f5bd8004cc0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f5bd4009b60 tx=0x7f5bd8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e1ab1593c792570 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:11:06.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:06.601+0000 7f5be9d9b700 1 -- 172.21.15.45:0/950461013 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd400e6c0 con 0x7f5bd8004850 2023-11-28T12:11:06.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:06.601+0000 7f5be9d9b700 1 -- 172.21.15.45:0/950461013 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bd400e820 con 0x7f5bd8004850 2023-11-28T12:11:06.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:06.601+0000 7f5be9d9b700 1 -- 172.21.15.45:0/950461013 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd400ebb0 con 0x7f5bd8004850 2023-11-28T12:11:06.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:06.601+0000 7f5bf0bff700 1 -- 172.21.15.45:0/950461013 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5bd8004850 msgr2=0x7f5bd8004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:11:06.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:06.601+0000 7f5bf0bff700 1 --2- 172.21.15.45:0/950461013 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5bd8004850 0x7f5bd8004cc0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f5bd4009b60 tx=0x7f5bd8005880 comp rx=0 tx=0).stop 2023-11-28T12:11:06.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:06.602+0000 7f5bf0bff700 1 -- 172.21.15.45:0/950461013 shutdown_connections 2023-11-28T12:11:06.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:06.602+0000 7f5bf0bff700 1 --2- 172.21.15.45:0/950461013 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5bd8004850 0x7f5bd8004cc0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:06.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:06.602+0000 7f5bf0bff700 1 -- 172.21.15.45:0/950461013 >> 172.21.15.45:0/950461013 conn(0x7f5bec072600 msgr2=0x7f5bec0cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:11:06.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:06.602+0000 7f5bf0bff700 1 -- 172.21.15.45:0/950461013 shutdown_connections 2023-11-28T12:11:06.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:06.602+0000 7f5bf0bff700 1 -- 172.21.15.45:0/950461013 wait complete. 2023-11-28T12:11:06.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:06.603+0000 7f5bf0bff700 1 Processor -- start 2023-11-28T12:11:06.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:06.604+0000 7f5bf0bff700 1 -- start start 2023-11-28T12:11:06.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:06.604+0000 7f5bf0bff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5bd8004850 0x7f5bec0c5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:11:06.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:06.604+0000 7f5bf0bff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5bec0c82f0 0x7f5bec0c8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:11:06.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:06.605+0000 7f5bf0bff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5bec15e730 0x7f5bec15eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:11:06.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:06.605+0000 7f5bf0bff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bec1e70d0 con 0x7f5bd8004850 2023-11-28T12:11:06.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:06.605+0000 7f5bf0bff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bec1e64c0 con 0x7f5bec15e730 2023-11-28T12:11:06.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:06.605+0000 7f5bf0bff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bec1e67a0 con 0x7f5bec0c82f0 2023-11-28T12:11:06.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:06.605+0000 7f5bea59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5bd8004850 0x7f5bec0c5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:11:06.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:06.605+0000 7f5bea59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5bd8004850 0x7f5bec0c5fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35698/0 (socket says 172.21.15.45:35698) 2023-11-28T12:11:06.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:06.605+0000 7f5bea59c700 1 -- 172.21.15.45:0/298099684 learned_addr learned my addr 172.21.15.45:0/298099684 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:11:06.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:06.605+0000 7f5bea59c700 1 -- 172.21.15.45:0/298099684 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5bec0c82f0 msgr2=0x7f5bec0c8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:11:06.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:06.605+0000 7f5bea59c700 1 --2- 172.21.15.45:0/298099684 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5bec0c82f0 0x7f5bec0c8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:06.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:06.605+0000 7f5bea59c700 1 -- 172.21.15.45:0/298099684 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5bec15e730 msgr2=0x7f5bec15eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:11:06.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:06.605+0000 7f5bea59c700 1 --2- 172.21.15.45:0/298099684 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5bec15e730 0x7f5bec15eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:06.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:06.605+0000 7f5bea59c700 1 -- 172.21.15.45:0/298099684 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bec15cd80 con 0x7f5bd8004850 2023-11-28T12:11:06.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:06.605+0000 7f5bea59c700 1 --2- 172.21.15.45:0/298099684 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5bd8004850 0x7f5bec0c5fd0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc007290 tx=0x7f5bdc0075a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:11:06.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:06.606+0000 7f5be2ffd700 1 -- 172.21.15.45:0/298099684 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bdc011580 con 0x7f5bd8004850 2023-11-28T12:11:06.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:06.606+0000 7f5be2ffd700 1 -- 172.21.15.45:0/298099684 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bdc011700 con 0x7f5bd8004850 2023-11-28T12:11:06.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:06.606+0000 7f5bf0bff700 1 -- 172.21.15.45:0/298099684 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bec0d15e0 con 0x7f5bd8004850 2023-11-28T12:11:06.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:06.606+0000 7f5be2ffd700 1 -- 172.21.15.45:0/298099684 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bdc011ab0 con 0x7f5bd8004850 2023-11-28T12:11:06.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:06.606+0000 7f5bf0bff700 1 -- 172.21.15.45:0/298099684 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bec15cf10 con 0x7f5bd8004850 2023-11-28T12:11:06.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:06.607+0000 7f5bf0bff700 1 -- 172.21.15.45:0/298099684 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bec0d2750 con 0x7f5bd8004850 2023-11-28T12:11:06.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:06.608+0000 7f5be2ffd700 1 -- 172.21.15.45:0/298099684 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f5bdc011c10 con 0x7f5bd8004850 2023-11-28T12:11:06.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:06.608+0000 7f5be2ffd700 1 --2- 172.21.15.45:0/298099684 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5bcc0682f0 0x7f5bcc06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:11:06.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:06.608+0000 7f5be2ffd700 1 -- 172.21.15.45:0/298099684 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f5bdc085fc0 con 0x7f5bd8004850 2023-11-28T12:11:06.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:06.609+0000 7f5be3fff700 1 --2- 172.21.15.45:0/298099684 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5bcc0682f0 0x7f5bcc06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:11:06.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:06.609+0000 7f5be3fff700 1 --2- 172.21.15.45:0/298099684 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5bcc0682f0 0x7f5bcc06a7a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f5bec0c9b50 tx=0x7f5bd4013000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:11:06.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:06.613+0000 7f5be2ffd700 1 -- 172.21.15.45:0/298099684 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f5bdc0526a0 con 0x7f5bd8004850 2023-11-28T12:11:06.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:06.860+0000 7f5bf0bff700 1 -- 172.21.15.45:0/298099684 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f5bec0745c0 con 0x7f5bd8004850 2023-11-28T12:11:06.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:06.860+0000 7f5be2ffd700 1 -- 172.21.15.45:0/298099684 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7f5bdc055cc0 con 0x7f5bd8004850 2023-11-28T12:11:06.862 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:11:06.862 INFO:teuthology.orchestra.run.smithi045.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-28T12:11:06.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:06.862+0000 7f5bf0bff700 1 -- 172.21.15.45:0/298099684 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5bcc0682f0 msgr2=0x7f5bcc06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:11:06.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:06.862+0000 7f5bf0bff700 1 --2- 172.21.15.45:0/298099684 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5bcc0682f0 0x7f5bcc06a7a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f5bec0c9b50 tx=0x7f5bd4013000 comp rx=0 tx=0).stop 2023-11-28T12:11:06.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:06.862+0000 7f5bf0bff700 1 -- 172.21.15.45:0/298099684 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5bd8004850 msgr2=0x7f5bec0c5fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:11:06.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:06.862+0000 7f5bf0bff700 1 --2- 172.21.15.45:0/298099684 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5bd8004850 0x7f5bec0c5fd0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc007290 tx=0x7f5bdc0075a0 comp rx=0 tx=0).stop 2023-11-28T12:11:06.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:06.863+0000 7f5bf0bff700 1 -- 172.21.15.45:0/298099684 shutdown_connections 2023-11-28T12:11:06.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:06.863+0000 7f5bf0bff700 1 --2- 172.21.15.45:0/298099684 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5bcc0682f0 0x7f5bcc06a7a0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:06.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:06.863+0000 7f5bf0bff700 1 --2- 172.21.15.45:0/298099684 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5bec15e730 0x7f5bec15eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:06.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:06.863+0000 7f5bf0bff700 1 --2- 172.21.15.45:0/298099684 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5bd8004850 0x7f5bec0c5fd0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:06.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:06.863+0000 7f5bf0bff700 1 --2- 172.21.15.45:0/298099684 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5bec0c82f0 0x7f5bec0c8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:06.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:06.863+0000 7f5bf0bff700 1 -- 172.21.15.45:0/298099684 >> 172.21.15.45:0/298099684 conn(0x7f5bec072600 msgr2=0x7f5bec0b6030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:11:06.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:06.863+0000 7f5bf0bff700 1 -- 172.21.15.45:0/298099684 shutdown_connections 2023-11-28T12:11:06.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:06.863+0000 7f5bf0bff700 1 -- 172.21.15.45:0/298099684 wait complete. 2023-11-28T12:11:06.882 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=100 retry_count=0)... 2023-11-28T12:11:11.883 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T12:11:12.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:12.096+0000 7fb880bff700 1 Processor -- start 2023-11-28T12:11:12.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:12.096+0000 7fb880bff700 1 -- start start 2023-11-28T12:11:12.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:12.097+0000 7fb880bff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb87c15c9b0 0x7fb87c0b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:11:12.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:12.097+0000 7fb880bff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb87c0d1950 con 0x7fb87c161340 2023-11-28T12:11:12.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:12.097+0000 7fb880bff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb87c0d24f0 con 0x7fb87c0cd7c0 2023-11-28T12:11:12.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:12.097+0000 7fb880bff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb87c0b5800 con 0x7fb87c15c9b0 2023-11-28T12:11:12.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:12.097+0000 7fb879d9b700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fb87c161340 0x7fb87c0d1de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:52532/0 (socket says 172.21.15.45:52532) 2023-11-28T12:11:12.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:12.097+0000 7fb879d9b700 1 -- 172.21.15.45:0/4253119731 learned_addr learned my addr 172.21.15.45:0/4253119731 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:11:12.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:12.098+0000 7fb87a59c700 1 --2- 172.21.15.45:0/4253119731 >> v2:172.21.15.152:3300/0 conn(0x7fb87c15c9b0 0x7fb87c0b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:11:12.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:12.098+0000 7fb87959a700 1 -- 172.21.15.45:0/4253119731 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 262753407 0 0) 0x7fb87c0d1950 con 0x7fb87c161340 2023-11-28T12:11:12.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:12.098+0000 7fb87959a700 1 -- 172.21.15.45:0/4253119731 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8640035b0 con 0x7fb87c161340 2023-11-28T12:11:12.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:12.098+0000 7fb87959a700 1 -- 172.21.15.45:0/4253119731 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2546639168 0 0) 0x7fb87c0d24f0 con 0x7fb87c0cd7c0 2023-11-28T12:11:12.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:12.098+0000 7fb87959a700 1 -- 172.21.15.45:0/4253119731 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb87c0d1950 con 0x7fb87c0cd7c0 2023-11-28T12:11:12.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:12.098+0000 7fb87a59c700 1 -- 172.21.15.45:0/4253119731 >> v1:172.21.15.152:6789/0 conn(0x7fb87c0cd7c0 legacy=0x7fb87c0b5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:11:12.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:12.098+0000 7fb87a59c700 1 -- 172.21.15.45:0/4253119731 >> v1:172.21.15.45:6789/0 conn(0x7fb87c161340 legacy=0x7fb87c0d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:11:12.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:12.098+0000 7fb87a59c700 1 -- 172.21.15.45:0/4253119731 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb87c0b5520 con 0x7fb87c15c9b0 2023-11-28T12:11:12.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:12.098+0000 7fb87a59c700 1 --2- 172.21.15.45:0/4253119731 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb87c15c9b0 0x7fb87c0b4bf0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fb86c009840 tx=0x7fb86c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d2547925866c9d93 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:11:12.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:12.099+0000 7fb87959a700 1 -- 172.21.15.45:0/4253119731 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86c011830 con 0x7fb87c15c9b0 2023-11-28T12:11:12.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:12.099+0000 7fb87959a700 1 -- 172.21.15.45:0/4253119731 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb86c011990 con 0x7fb87c15c9b0 2023-11-28T12:11:12.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:12.099+0000 7fb87959a700 1 -- 172.21.15.45:0/4253119731 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86c011d20 con 0x7fb87c15c9b0 2023-11-28T12:11:12.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:12.099+0000 7fb880bff700 1 -- 172.21.15.45:0/4253119731 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb87c15c9b0 msgr2=0x7fb87c0b4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:11:12.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:12.099+0000 7fb880bff700 1 --2- 172.21.15.45:0/4253119731 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb87c15c9b0 0x7fb87c0b4bf0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fb86c009840 tx=0x7fb86c009b50 comp rx=0 tx=0).stop 2023-11-28T12:11:12.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:12.099+0000 7fb880bff700 1 -- 172.21.15.45:0/4253119731 shutdown_connections 2023-11-28T12:11:12.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:12.099+0000 7fb880bff700 1 --2- 172.21.15.45:0/4253119731 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb87c15c9b0 0x7fb87c0b4bf0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:12.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:12.099+0000 7fb880bff700 1 -- 172.21.15.45:0/4253119731 >> 172.21.15.45:0/4253119731 conn(0x7fb87c072600 msgr2=0x7fb87c0cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:11:12.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:12.099+0000 7fb880bff700 1 -- 172.21.15.45:0/4253119731 shutdown_connections 2023-11-28T12:11:12.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:12.099+0000 7fb880bff700 1 -- 172.21.15.45:0/4253119731 wait complete. 2023-11-28T12:11:12.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:12.102+0000 7fb880bff700 1 Processor -- start 2023-11-28T12:11:12.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:12.102+0000 7fb880bff700 1 -- start start 2023-11-28T12:11:12.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:12.103+0000 7fb880bff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb87c0cd7c0 0x7fb87c157170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:11:12.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:12.103+0000 7fb880bff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb87c15c9b0 0x7fb87c0ccbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:11:12.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:12.103+0000 7fb880bff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb87c161340 0x7fb87c0cd120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:11:12.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:12.103+0000 7fb880bff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb87c1e6fc0 con 0x7fb87c15c9b0 2023-11-28T12:11:12.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:12.103+0000 7fb880bff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb87c0c95c0 con 0x7fb87c0cd7c0 2023-11-28T12:11:12.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:12.103+0000 7fb880bff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb87c1e6620 con 0x7fb87c161340 2023-11-28T12:11:12.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:12.104+0000 7fb879d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb87c15c9b0 0x7fb87c0ccbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:11:12.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:12.104+0000 7fb879d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb87c15c9b0 0x7fb87c0ccbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53510/0 (socket says 172.21.15.45:53510) 2023-11-28T12:11:12.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:12.104+0000 7fb879d9b700 1 -- 172.21.15.45:0/1307912428 learned_addr learned my addr 172.21.15.45:0/1307912428 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:11:12.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:12.104+0000 7fb87a59c700 1 --2- 172.21.15.45:0/1307912428 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb87c0cd7c0 0x7fb87c157170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:11:12.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:12.104+0000 7fb87ad9d700 1 --2- 172.21.15.45:0/1307912428 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb87c161340 0x7fb87c0cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:11:12.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:12.104+0000 7fb879d9b700 1 -- 172.21.15.45:0/1307912428 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb87c161340 msgr2=0x7fb87c0cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:11:12.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:12.104+0000 7fb879d9b700 1 --2- 172.21.15.45:0/1307912428 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb87c161340 0x7fb87c0cd120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:12.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:12.104+0000 7fb879d9b700 1 -- 172.21.15.45:0/1307912428 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb87c0cd7c0 msgr2=0x7fb87c157170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:11:12.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:12.104+0000 7fb879d9b700 1 --2- 172.21.15.45:0/1307912428 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb87c0cd7c0 0x7fb87c157170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:12.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:12.104+0000 7fb879d9b700 1 -- 172.21.15.45:0/1307912428 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb86c0094a0 con 0x7fb87c15c9b0 2023-11-28T12:11:12.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:12.104+0000 7fb87ad9d700 1 --2- 172.21.15.45:0/1307912428 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb87c161340 0x7fb87c0cd120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:11:12.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:12.104+0000 7fb879d9b700 1 --2- 172.21.15.45:0/1307912428 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb87c15c9b0 0x7fb87c0ccbe0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fb87000c700 tx=0x7fb87000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:11:12.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:12.104+0000 7fb86affd700 1 -- 172.21.15.45:0/1307912428 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb870005d70 con 0x7fb87c15c9b0 2023-11-28T12:11:12.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:12.105+0000 7fb86affd700 1 -- 172.21.15.45:0/1307912428 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8700070d0 con 0x7fb87c15c9b0 2023-11-28T12:11:12.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:12.105+0000 7fb86affd700 1 -- 172.21.15.45:0/1307912428 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb870007480 con 0x7fb87c15c9b0 2023-11-28T12:11:12.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:12.105+0000 7fb880bff700 1 -- 172.21.15.45:0/1307912428 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb87c0d15e0 con 0x7fb87c15c9b0 2023-11-28T12:11:12.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:12.105+0000 7fb880bff700 1 -- 172.21.15.45:0/1307912428 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb87c0d1300 con 0x7fb87c15c9b0 2023-11-28T12:11:12.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:12.106+0000 7fb880bff700 1 -- 172.21.15.45:0/1307912428 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb87c0b5130 con 0x7fb87c15c9b0 2023-11-28T12:11:12.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:12.107+0000 7fb86affd700 1 -- 172.21.15.45:0/1307912428 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fb870019030 con 0x7fb87c15c9b0 2023-11-28T12:11:12.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:12.107+0000 7fb86affd700 1 --2- 172.21.15.45:0/1307912428 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb85c0682f0 0x7fb85c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:11:12.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:12.108+0000 7fb86affd700 1 -- 172.21.15.45:0/1307912428 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6207+0+0 (secure 0 0 0) 0x7fb870085170 con 0x7fb87c15c9b0 2023-11-28T12:11:12.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:12.108+0000 7fb87a59c700 1 --2- 172.21.15.45:0/1307912428 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb85c0682f0 0x7fb85c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:11:12.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:12.109+0000 7fb87a59c700 1 --2- 172.21.15.45:0/1307912428 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb85c0682f0 0x7fb85c06a7a0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb86c009fd0 tx=0x7fb86c01c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:11:12.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:12.112+0000 7fb86affd700 1 -- 172.21.15.45:0/1307912428 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fb870051850 con 0x7fb87c15c9b0 2023-11-28T12:11:12.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:12.362+0000 7fb880bff700 1 -- 172.21.15.45:0/1307912428 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fb87c1e7100 con 0x7fb87c15c9b0 2023-11-28T12:11:12.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:12.362+0000 7fb86affd700 1 -- 172.21.15.45:0/1307912428 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7fb87c1e7100 con 0x7fb87c15c9b0 2023-11-28T12:11:12.364 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:11:12.364 INFO:teuthology.orchestra.run.smithi045.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-28T12:11:12.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:12.365+0000 7fb880bff700 1 -- 172.21.15.45:0/1307912428 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb85c0682f0 msgr2=0x7fb85c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:11:12.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:12.365+0000 7fb880bff700 1 --2- 172.21.15.45:0/1307912428 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb85c0682f0 0x7fb85c06a7a0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb86c009fd0 tx=0x7fb86c01c040 comp rx=0 tx=0).stop 2023-11-28T12:11:12.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:12.365+0000 7fb880bff700 1 -- 172.21.15.45:0/1307912428 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb87c15c9b0 msgr2=0x7fb87c0ccbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:11:12.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:12.365+0000 7fb880bff700 1 --2- 172.21.15.45:0/1307912428 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb87c15c9b0 0x7fb87c0ccbe0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fb87000c700 tx=0x7fb87000ca10 comp rx=0 tx=0).stop 2023-11-28T12:11:12.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:12.365+0000 7fb880bff700 1 -- 172.21.15.45:0/1307912428 shutdown_connections 2023-11-28T12:11:12.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:12.365+0000 7fb880bff700 1 --2- 172.21.15.45:0/1307912428 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb85c0682f0 0x7fb85c06a7a0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:12.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:12.365+0000 7fb880bff700 1 --2- 172.21.15.45:0/1307912428 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb87c0cd7c0 0x7fb87c157170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:12.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:12.365+0000 7fb880bff700 1 --2- 172.21.15.45:0/1307912428 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb87c161340 0x7fb87c0cd120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:12.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:12.365+0000 7fb880bff700 1 --2- 172.21.15.45:0/1307912428 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb87c15c9b0 0x7fb87c0ccbe0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:12.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:12.365+0000 7fb880bff700 1 -- 172.21.15.45:0/1307912428 >> 172.21.15.45:0/1307912428 conn(0x7fb87c072600 msgr2=0x7fb87c15ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:11:12.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:12.365+0000 7fb880bff700 1 -- 172.21.15.45:0/1307912428 shutdown_connections 2023-11-28T12:11:12.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:12.365+0000 7fb880bff700 1 -- 172.21.15.45:0/1307912428 wait complete. 2023-11-28T12:11:12.384 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=100 retry_count=0)... 2023-11-28T12:11:17.385 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T12:11:17.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:17.598+0000 7fe303bff700 1 Processor -- start 2023-11-28T12:11:17.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:17.598+0000 7fe303bff700 1 -- start start 2023-11-28T12:11:17.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:17.599+0000 7fe303bff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe2fc161340 0x7fe2fc0d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:11:17.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:17.599+0000 7fe303bff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe2fc0d2320 0x7fe2fc0cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:11:17.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:17.599+0000 7fe303bff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2fc0d1950 con 0x7fe2fc15c9b0 2023-11-28T12:11:17.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:17.599+0000 7fe303bff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2fc0b5800 con 0x7fe2fc0d2320 2023-11-28T12:11:17.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:17.599+0000 7fe303bff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2fc0b5300 con 0x7fe2fc161340 2023-11-28T12:11:17.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:17.600+0000 7fe30219c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe2fc0d2320 0x7fe2fc0cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:11:17.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:17.600+0000 7fe30219c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe2fc0d2320 0x7fe2fc0cd7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53522/0 (socket says 172.21.15.45:53522) 2023-11-28T12:11:17.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:17.600+0000 7fe30219c700 1 -- 172.21.15.45:0/684635615 learned_addr learned my addr 172.21.15.45:0/684635615 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:11:17.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:17.600+0000 7fe30119a700 1 --2- 172.21.15.45:0/684635615 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe2fc161340 0x7fe2fc0d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:11:17.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:17.600+0000 7fe30219c700 1 -- 172.21.15.45:0/684635615 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe2fc161340 msgr2=0x7fe2fc0d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:11:17.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:17.600+0000 7fe30219c700 1 --2- 172.21.15.45:0/684635615 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe2fc161340 0x7fe2fc0d1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:17.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:17.600+0000 7fe30219c700 1 -- 172.21.15.45:0/684635615 >> v1:172.21.15.152:6789/0 conn(0x7fe2fc15c9b0 legacy=0x7fe2fc0b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:11:17.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:17.600+0000 7fe30219c700 1 -- 172.21.15.45:0/684635615 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2fc0b5520 con 0x7fe2fc0d2320 2023-11-28T12:11:17.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:17.600+0000 7fe30119a700 1 --2- 172.21.15.45:0/684635615 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe2fc161340 0x7fe2fc0d1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:11:17.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:17.600+0000 7fe30219c700 1 --2- 172.21.15.45:0/684635615 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2fc0d2320 0x7fe2fc0cd7c0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fe2f4009e80 tx=0x7fe2f400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c44dc8848c2ac24 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:11:17.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:17.601+0000 7fe300999700 1 -- 172.21.15.45:0/684635615 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f400e070 con 0x7fe2fc0d2320 2023-11-28T12:11:17.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:17.601+0000 7fe300999700 1 -- 172.21.15.45:0/684635615 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2f400b980 con 0x7fe2fc0d2320 2023-11-28T12:11:17.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:17.601+0000 7fe300999700 1 -- 172.21.15.45:0/684635615 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f400bd30 con 0x7fe2fc0d2320 2023-11-28T12:11:17.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:17.601+0000 7fe303bff700 1 -- 172.21.15.45:0/684635615 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2fc0d2320 msgr2=0x7fe2fc0cd7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:11:17.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:17.601+0000 7fe303bff700 1 --2- 172.21.15.45:0/684635615 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2fc0d2320 0x7fe2fc0cd7c0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fe2f4009e80 tx=0x7fe2f400b330 comp rx=0 tx=0).stop 2023-11-28T12:11:17.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:17.601+0000 7fe303bff700 1 -- 172.21.15.45:0/684635615 shutdown_connections 2023-11-28T12:11:17.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:17.601+0000 7fe303bff700 1 --2- 172.21.15.45:0/684635615 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2fc0d2320 0x7fe2fc0cd7c0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:17.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:17.601+0000 7fe303bff700 1 --2- 172.21.15.45:0/684635615 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe2fc161340 0x7fe2fc0d1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:17.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:17.601+0000 7fe303bff700 1 -- 172.21.15.45:0/684635615 >> 172.21.15.45:0/684635615 conn(0x7fe2fc072600 msgr2=0x7fe2fc0cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:11:17.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:17.601+0000 7fe303bff700 1 -- 172.21.15.45:0/684635615 shutdown_connections 2023-11-28T12:11:17.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:17.601+0000 7fe303bff700 1 -- 172.21.15.45:0/684635615 wait complete. 2023-11-28T12:11:17.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:17.603+0000 7fe303bff700 1 Processor -- start 2023-11-28T12:11:17.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:17.604+0000 7fe303bff700 1 -- start start 2023-11-28T12:11:17.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:17.605+0000 7fe303bff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2fc0d2320 0x7fe2fc151900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:11:17.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:17.605+0000 7fe303bff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe2fc15c9b0 0x7fe2fc1548b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:11:17.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:17.605+0000 7fe303bff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe2fc161340 0x7fe2fc0b83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:11:17.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:17.605+0000 7fe303bff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2fc151e40 con 0x7fe2fc0d2320 2023-11-28T12:11:17.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:17.605+0000 7fe303bff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2fc0c69b0 con 0x7fe2fc15c9b0 2023-11-28T12:11:17.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:17.605+0000 7fe303bff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2fc142170 con 0x7fe2fc161340 2023-11-28T12:11:17.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:17.605+0000 7fe30199b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2fc0d2320 0x7fe2fc151900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:11:17.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:17.605+0000 7fe30199b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2fc0d2320 0x7fe2fc151900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53538/0 (socket says 172.21.15.45:53538) 2023-11-28T12:11:17.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:17.605+0000 7fe30199b700 1 -- 172.21.15.45:0/2858391225 learned_addr learned my addr 172.21.15.45:0/2858391225 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:11:17.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:17.605+0000 7fe30119a700 1 --2- 172.21.15.45:0/2858391225 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe2fc15c9b0 0x7fe2fc1548b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:11:17.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:17.605+0000 7fe30219c700 1 --2- 172.21.15.45:0/2858391225 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe2fc161340 0x7fe2fc0b83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:11:17.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:17.605+0000 7fe30199b700 1 -- 172.21.15.45:0/2858391225 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe2fc161340 msgr2=0x7fe2fc0b83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:11:17.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:17.605+0000 7fe30199b700 1 --2- 172.21.15.45:0/2858391225 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe2fc161340 0x7fe2fc0b83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:17.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:17.605+0000 7fe30199b700 1 -- 172.21.15.45:0/2858391225 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe2fc15c9b0 msgr2=0x7fe2fc1548b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:11:17.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:17.605+0000 7fe30199b700 1 --2- 172.21.15.45:0/2858391225 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe2fc15c9b0 0x7fe2fc1548b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:17.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:17.605+0000 7fe30199b700 1 -- 172.21.15.45:0/2858391225 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2f4009b30 con 0x7fe2fc0d2320 2023-11-28T12:11:17.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:17.605+0000 7fe30119a700 1 --2- 172.21.15.45:0/2858391225 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe2fc15c9b0 0x7fe2fc1548b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:11:17.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:17.606+0000 7fe30199b700 1 --2- 172.21.15.45:0/2858391225 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2fc0d2320 0x7fe2fc151900 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fe2f800c450 tx=0x7fe2f800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:11:17.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:17.606+0000 7fe2f27fc700 1 -- 172.21.15.45:0/2858391225 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f80052d0 con 0x7fe2fc0d2320 2023-11-28T12:11:17.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:17.606+0000 7fe2f27fc700 1 -- 172.21.15.45:0/2858391225 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2f8005430 con 0x7fe2fc0d2320 2023-11-28T12:11:17.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:17.606+0000 7fe2f27fc700 1 -- 172.21.15.45:0/2858391225 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f80038c0 con 0x7fe2fc0d2320 2023-11-28T12:11:17.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:17.606+0000 7fe303bff700 1 -- 172.21.15.45:0/2858391225 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2fc0d15e0 con 0x7fe2fc0d2320 2023-11-28T12:11:17.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:17.606+0000 7fe303bff700 1 -- 172.21.15.45:0/2858391225 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2fc0d1300 con 0x7fe2fc0d2320 2023-11-28T12:11:17.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:17.607+0000 7fe303bff700 1 -- 172.21.15.45:0/2858391225 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2fc15cd80 con 0x7fe2fc0d2320 2023-11-28T12:11:17.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:17.608+0000 7fe2f27fc700 1 -- 172.21.15.45:0/2858391225 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fe2f8019030 con 0x7fe2fc0d2320 2023-11-28T12:11:17.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:17.609+0000 7fe2f27fc700 1 --2- 172.21.15.45:0/2858391225 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fe2e00682f0 0x7fe2e006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:11:17.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:17.609+0000 7fe2f27fc700 1 -- 172.21.15.45:0/2858391225 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6207+0+0 (secure 0 0 0) 0x7fe2f8084fe0 con 0x7fe2fc0d2320 2023-11-28T12:11:17.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:17.609+0000 7fe30119a700 1 --2- 172.21.15.45:0/2858391225 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fe2e00682f0 0x7fe2e006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:11:17.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:17.610+0000 7fe30119a700 1 --2- 172.21.15.45:0/2858391225 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fe2e00682f0 0x7fe2e006a7a0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec0099b0 tx=0x7fe2ec008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:11:17.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:17.613+0000 7fe2f27fc700 1 -- 172.21.15.45:0/2858391225 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fe2f80516e0 con 0x7fe2fc0d2320 2023-11-28T12:11:17.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:17.856+0000 7fe303bff700 1 -- 172.21.15.45:0/2858391225 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fe2fc0745c0 con 0x7fe2fc0d2320 2023-11-28T12:11:17.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:17.856+0000 7fe2f27fc700 1 -- 172.21.15.45:0/2858391225 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7fe2f8054d00 con 0x7fe2fc0d2320 2023-11-28T12:11:17.861 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:11:17.861 INFO:teuthology.orchestra.run.smithi045.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-28T12:11:17.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:17.859+0000 7fe303bff700 1 -- 172.21.15.45:0/2858391225 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fe2e00682f0 msgr2=0x7fe2e006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:11:17.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:17.859+0000 7fe303bff700 1 --2- 172.21.15.45:0/2858391225 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fe2e00682f0 0x7fe2e006a7a0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec0099b0 tx=0x7fe2ec008040 comp rx=0 tx=0).stop 2023-11-28T12:11:17.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:17.859+0000 7fe303bff700 1 -- 172.21.15.45:0/2858391225 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2fc0d2320 msgr2=0x7fe2fc151900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:11:17.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:17.859+0000 7fe303bff700 1 --2- 172.21.15.45:0/2858391225 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2fc0d2320 0x7fe2fc151900 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fe2f800c450 tx=0x7fe2f800c810 comp rx=0 tx=0).stop 2023-11-28T12:11:17.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:17.859+0000 7fe303bff700 1 -- 172.21.15.45:0/2858391225 shutdown_connections 2023-11-28T12:11:17.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:17.859+0000 7fe303bff700 1 --2- 172.21.15.45:0/2858391225 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fe2e00682f0 0x7fe2e006a7a0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:17.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:17.859+0000 7fe303bff700 1 --2- 172.21.15.45:0/2858391225 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe2fc161340 0x7fe2fc0b83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:17.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:17.859+0000 7fe303bff700 1 --2- 172.21.15.45:0/2858391225 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2fc0d2320 0x7fe2fc151900 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:17.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:17.859+0000 7fe303bff700 1 --2- 172.21.15.45:0/2858391225 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe2fc15c9b0 0x7fe2fc1548b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:17.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:17.859+0000 7fe303bff700 1 -- 172.21.15.45:0/2858391225 >> 172.21.15.45:0/2858391225 conn(0x7fe2fc072600 msgr2=0x7fe2fc0b5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:11:17.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:17.859+0000 7fe303bff700 1 -- 172.21.15.45:0/2858391225 shutdown_connections 2023-11-28T12:11:17.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:17.859+0000 7fe303bff700 1 -- 172.21.15.45:0/2858391225 wait complete. 2023-11-28T12:11:17.878 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=100 retry_count=0)... 2023-11-28T12:11:22.879 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T12:11:23.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:23.092+0000 7ff6bc1ff700 1 Processor -- start 2023-11-28T12:11:23.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:23.093+0000 7ff6bc1ff700 1 -- start start 2023-11-28T12:11:23.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:23.094+0000 7ff6bc1ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff6b40cd7c0 0x7ff6b40cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:11:23.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:23.094+0000 7ff6bc1ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6b40d1950 con 0x7ff6b415c9b0 2023-11-28T12:11:23.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:23.094+0000 7ff6bc1ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6b40ce140 con 0x7ff6b4161340 2023-11-28T12:11:23.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:23.094+0000 7ff6bc1ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b40b5800 con 0x7ff6b40cd7c0 2023-11-28T12:11:23.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:23.094+0000 7ff6b9f9b700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ff6b415c9b0 0x7ff6b40b4bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:57918/0 (socket says 172.21.15.45:57918) 2023-11-28T12:11:23.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:23.094+0000 7ff6b9f9b700 1 -- 172.21.15.45:0/3081789072 learned_addr learned my addr 172.21.15.45:0/3081789072 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:11:23.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:23.094+0000 7ff6ba79c700 1 --2- 172.21.15.45:0/3081789072 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff6b40cd7c0 0x7ff6b40cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:11:23.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:23.094+0000 7ff6b8f99700 1 -- 172.21.15.45:0/3081789072 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 850619800 0 0) 0x7ff6b40d1950 con 0x7ff6b415c9b0 2023-11-28T12:11:23.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:23.094+0000 7ff6b8f99700 1 -- 172.21.15.45:0/3081789072 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6a00035b0 con 0x7ff6b415c9b0 2023-11-28T12:11:23.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:23.095+0000 7ff6b8f99700 1 -- 172.21.15.45:0/3081789072 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1681821547 0 0) 0x7ff6a00035b0 con 0x7ff6b415c9b0 2023-11-28T12:11:23.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:23.095+0000 7ff6b8f99700 1 -- 172.21.15.45:0/3081789072 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff6b40cd7c0 msgr2=0x7ff6b40cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:11:23.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:23.095+0000 7ff6b8f99700 1 --2- 172.21.15.45:0/3081789072 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff6b40cd7c0 0x7ff6b40cdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:23.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:23.095+0000 7ff6b8f99700 1 -- 172.21.15.45:0/3081789072 >> v1:172.21.15.152:6789/0 conn(0x7ff6b4161340 legacy=0x7ff6b40d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:11:23.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:23.095+0000 7ff6b8f99700 1 -- 172.21.15.45:0/3081789072 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6b40d24f0 con 0x7ff6b415c9b0 2023-11-28T12:11:23.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:23.095+0000 7ff6b8f99700 1 -- 172.21.15.45:0/3081789072 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3460218165 0 0) 0x7ff6b0001670 con 0x7ff6b415c9b0 2023-11-28T12:11:23.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:23.095+0000 7ff6b8f99700 1 -- 172.21.15.45:0/3081789072 >> v1:172.21.15.45:6789/0 conn(0x7ff6b415c9b0 legacy=0x7ff6b40b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:11:23.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:23.095+0000 7ff6b8f99700 1 --2- 172.21.15.45:0/3081789072 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff6a0003a30 0x7ff6a0003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:11:23.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:23.095+0000 7ff6b8f99700 1 --2- 172.21.15.45:0/3081789072 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff6b40cd7c0 0x7ff6a0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:11:23.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:23.095+0000 7ff6b8f99700 1 --2- 172.21.15.45:0/3081789072 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6a0004d90 0x7ff6a0005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:11:23.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:23.095+0000 7ff6b8f99700 1 -- 172.21.15.45:0/3081789072 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b40b5800 con 0x7ff6a0004d90 2023-11-28T12:11:23.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:23.095+0000 7ff6b8f99700 1 -- 172.21.15.45:0/3081789072 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a000bba0 con 0x7ff6a0003a30 2023-11-28T12:11:23.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:23.095+0000 7ff6b8f99700 1 -- 172.21.15.45:0/3081789072 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a000bd60 con 0x7ff6b40cd7c0 2023-11-28T12:11:23.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:23.095+0000 7ff6ba79c700 1 --2- 172.21.15.45:0/3081789072 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6a0004d90 0x7ff6a0005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:11:23.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:23.095+0000 7ff6b979a700 1 --2- 172.21.15.45:0/3081789072 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff6b40cd7c0 0x7ff6a0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:11:23.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:23.095+0000 7ff6b9f9b700 1 --2- 172.21.15.45:0/3081789072 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff6a0003a30 0x7ff6a0003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:11:23.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:23.096+0000 7ff6ba79c700 1 -- 172.21.15.45:0/3081789072 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff6b40cd7c0 msgr2=0x7ff6a0004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:11:23.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:23.096+0000 7ff6ba79c700 1 --2- 172.21.15.45:0/3081789072 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff6b40cd7c0 0x7ff6a0004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:23.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:23.096+0000 7ff6ba79c700 1 -- 172.21.15.45:0/3081789072 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff6a0003a30 msgr2=0x7ff6a0003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:11:23.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:23.096+0000 7ff6ba79c700 1 --2- 172.21.15.45:0/3081789072 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff6a0003a30 0x7ff6a0003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:23.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:23.096+0000 7ff6ba79c700 1 -- 172.21.15.45:0/3081789072 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6a00035b0 con 0x7ff6a0004d90 2023-11-28T12:11:23.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:23.096+0000 7ff6ba79c700 1 --2- 172.21.15.45:0/3081789072 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6a0004d90 0x7ff6a0005200 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac009fc0 tx=0x7ff6a0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc5f626ee2f4a336 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:11:23.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:23.096+0000 7ff6b8f99700 1 -- 172.21.15.45:0/3081789072 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ac00ec30 con 0x7ff6a0004d90 2023-11-28T12:11:23.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:23.096+0000 7ff6b8f99700 1 -- 172.21.15.45:0/3081789072 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6ac00f040 con 0x7ff6a0004d90 2023-11-28T12:11:23.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:23.096+0000 7ff6b8f99700 1 -- 172.21.15.45:0/3081789072 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ac014480 con 0x7ff6a0004d90 2023-11-28T12:11:23.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:23.097+0000 7ff6bc1ff700 1 -- 172.21.15.45:0/3081789072 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6a0004d90 msgr2=0x7ff6a0005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:11:23.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:23.097+0000 7ff6bc1ff700 1 --2- 172.21.15.45:0/3081789072 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6a0004d90 0x7ff6a0005200 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac009fc0 tx=0x7ff6a0005880 comp rx=0 tx=0).stop 2023-11-28T12:11:23.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:23.097+0000 7ff6ba79c700 1 -- 172.21.15.45:0/3081789072 reap_dead start 2023-11-28T12:11:23.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:23.097+0000 7ff6bc1ff700 1 -- 172.21.15.45:0/3081789072 shutdown_connections 2023-11-28T12:11:23.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:23.097+0000 7ff6bc1ff700 1 -- 172.21.15.45:0/3081789072 >> 172.21.15.45:0/3081789072 conn(0x7ff6b4072600 msgr2=0x7ff6b40cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:11:23.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:23.097+0000 7ff6bc1ff700 1 -- 172.21.15.45:0/3081789072 shutdown_connections 2023-11-28T12:11:23.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:23.097+0000 7ff6bc1ff700 1 -- 172.21.15.45:0/3081789072 wait complete. 2023-11-28T12:11:23.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:23.099+0000 7ff6bc1ff700 1 Processor -- start 2023-11-28T12:11:23.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:23.099+0000 7ff6bc1ff700 1 -- start start 2023-11-28T12:11:23.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:23.100+0000 7ff6bc1ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6a0004d90 0x7ff6b41578e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:11:23.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:23.100+0000 7ff6bc1ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff6b40caeb0 0x7ff6b40cb320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:11:23.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:23.100+0000 7ff6bc1ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff6b40ca240 0x7ff6b40ca6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:11:23.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:23.100+0000 7ff6bc1ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b40cac20 con 0x7ff6a0004d90 2023-11-28T12:11:23.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:23.100+0000 7ff6bc1ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b41f3230 con 0x7ff6b40caeb0 2023-11-28T12:11:23.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:23.100+0000 7ff6bc1ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b40c8620 con 0x7ff6b40ca240 2023-11-28T12:11:23.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:23.100+0000 7ff6b9f9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6a0004d90 0x7ff6b41578e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:11:23.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:23.100+0000 7ff6b9f9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6a0004d90 0x7ff6b41578e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35268/0 (socket says 172.21.15.45:35268) 2023-11-28T12:11:23.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:23.100+0000 7ff6b9f9b700 1 -- 172.21.15.45:0/2998864714 learned_addr learned my addr 172.21.15.45:0/2998864714 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:11:23.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:23.100+0000 7ff6ba79c700 1 --2- 172.21.15.45:0/2998864714 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff6b40ca240 0x7ff6b40ca6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:11:23.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:23.100+0000 7ff6b979a700 1 --2- 172.21.15.45:0/2998864714 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff6b40caeb0 0x7ff6b40cb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:11:23.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:23.101+0000 7ff6b9f9b700 1 -- 172.21.15.45:0/2998864714 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff6b40ca240 msgr2=0x7ff6b40ca6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:11:23.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:23.101+0000 7ff6b9f9b700 1 --2- 172.21.15.45:0/2998864714 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff6b40ca240 0x7ff6b40ca6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:23.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:23.101+0000 7ff6b9f9b700 1 -- 172.21.15.45:0/2998864714 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff6b40caeb0 msgr2=0x7ff6b40cb320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:11:23.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:23.101+0000 7ff6b9f9b700 1 --2- 172.21.15.45:0/2998864714 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff6b40caeb0 0x7ff6b40cb320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:23.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:23.101+0000 7ff6b9f9b700 1 -- 172.21.15.45:0/2998864714 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6b40d1300 con 0x7ff6a0004d90 2023-11-28T12:11:23.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:23.101+0000 7ff6b9f9b700 1 --2- 172.21.15.45:0/2998864714 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6a0004d90 0x7ff6b41578e0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7ff6b0007290 tx=0x7ff6b00075a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:11:23.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:23.101+0000 7ff6aa7fc700 1 -- 172.21.15.45:0/2998864714 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b0012560 con 0x7ff6a0004d90 2023-11-28T12:11:23.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:23.101+0000 7ff6aa7fc700 1 -- 172.21.15.45:0/2998864714 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6b00126c0 con 0x7ff6a0004d90 2023-11-28T12:11:23.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:23.101+0000 7ff6bc1ff700 1 -- 172.21.15.45:0/2998864714 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6b40b5520 con 0x7ff6a0004d90 2023-11-28T12:11:23.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:23.101+0000 7ff6aa7fc700 1 -- 172.21.15.45:0/2998864714 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b0012a70 con 0x7ff6a0004d90 2023-11-28T12:11:23.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:23.101+0000 7ff6bc1ff700 1 -- 172.21.15.45:0/2998864714 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6b40d15e0 con 0x7ff6a0004d90 2023-11-28T12:11:23.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:23.102+0000 7ff6bc1ff700 1 -- 172.21.15.45:0/2998864714 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6b40745c0 con 0x7ff6a0004d90 2023-11-28T12:11:23.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:23.103+0000 7ff6aa7fc700 1 -- 172.21.15.45:0/2998864714 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7ff6b0012bd0 con 0x7ff6a0004d90 2023-11-28T12:11:23.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:23.104+0000 7ff6aa7fc700 1 --2- 172.21.15.45:0/2998864714 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7ff6980682f0 0x7ff69806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:11:23.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:23.104+0000 7ff6aa7fc700 1 -- 172.21.15.45:0/2998864714 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6207+0+0 (secure 0 0 0) 0x7ff6b0085f70 con 0x7ff6a0004d90 2023-11-28T12:11:23.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:23.105+0000 7ff6b979a700 1 --2- 172.21.15.45:0/2998864714 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7ff6980682f0 0x7ff69806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:11:23.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:23.105+0000 7ff6b979a700 1 --2- 172.21.15.45:0/2998864714 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7ff6980682f0 0x7ff69806a7a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7ff6a4000c00 tx=0x7ff6a4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:11:23.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:23.108+0000 7ff6aa7fc700 1 -- 172.21.15.45:0/2998864714 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7ff6b0052620 con 0x7ff6a0004d90 2023-11-28T12:11:23.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:23.358+0000 7ff6bc1ff700 1 -- 172.21.15.45:0/2998864714 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7ff6b415bfe0 con 0x7ff6a0004d90 2023-11-28T12:11:23.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:23.359+0000 7ff6aa7fc700 1 -- 172.21.15.45:0/2998864714 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7ff6b0055c40 con 0x7ff6a0004d90 2023-11-28T12:11:23.360 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:11:23.361 INFO:teuthology.orchestra.run.smithi045.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-28T12:11:23.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:23.361+0000 7ff6bc1ff700 1 -- 172.21.15.45:0/2998864714 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7ff6980682f0 msgr2=0x7ff69806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:11:23.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:23.361+0000 7ff6bc1ff700 1 --2- 172.21.15.45:0/2998864714 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7ff6980682f0 0x7ff69806a7a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7ff6a4000c00 tx=0x7ff6a4009040 comp rx=0 tx=0).stop 2023-11-28T12:11:23.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:23.361+0000 7ff6bc1ff700 1 -- 172.21.15.45:0/2998864714 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6a0004d90 msgr2=0x7ff6b41578e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:11:23.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:23.361+0000 7ff6bc1ff700 1 --2- 172.21.15.45:0/2998864714 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6a0004d90 0x7ff6b41578e0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7ff6b0007290 tx=0x7ff6b00075a0 comp rx=0 tx=0).stop 2023-11-28T12:11:23.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:23.361+0000 7ff6bc1ff700 1 -- 172.21.15.45:0/2998864714 shutdown_connections 2023-11-28T12:11:23.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:23.361+0000 7ff6bc1ff700 1 --2- 172.21.15.45:0/2998864714 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7ff6980682f0 0x7ff69806a7a0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:23.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:23.361+0000 7ff6bc1ff700 1 --2- 172.21.15.45:0/2998864714 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff6b40ca240 0x7ff6b40ca6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:23.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:23.361+0000 7ff6bc1ff700 1 --2- 172.21.15.45:0/2998864714 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6a0004d90 0x7ff6b41578e0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:23.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:23.361+0000 7ff6bc1ff700 1 --2- 172.21.15.45:0/2998864714 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff6b40caeb0 0x7ff6b40cb320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:23.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:23.361+0000 7ff6bc1ff700 1 -- 172.21.15.45:0/2998864714 >> 172.21.15.45:0/2998864714 conn(0x7ff6b4072600 msgr2=0x7ff6b40b5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:11:23.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:23.361+0000 7ff6bc1ff700 1 -- 172.21.15.45:0/2998864714 shutdown_connections 2023-11-28T12:11:23.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:23.361+0000 7ff6bc1ff700 1 -- 172.21.15.45:0/2998864714 wait complete. 2023-11-28T12:11:23.381 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=100 retry_count=0)... 2023-11-28T12:11:28.383 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T12:11:28.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:28.597+0000 7fc542fff700 1 Processor -- start 2023-11-28T12:11:28.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:28.597+0000 7fc542fff700 1 -- start start 2023-11-28T12:11:28.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:28.598+0000 7fc542fff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc53c15c9b0 0x7fc53c0b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:11:28.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:28.598+0000 7fc542fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc53c0cd7c0 0x7fc53c0cdc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:11:28.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:28.598+0000 7fc542fff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc53c0ce160 con 0x7fc53c161340 2023-11-28T12:11:28.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:28.599+0000 7fc542fff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc53c0b5800 con 0x7fc53c0cd7c0 2023-11-28T12:11:28.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:28.599+0000 7fc542fff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc53c0d1950 con 0x7fc53c15c9b0 2023-11-28T12:11:28.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:28.599+0000 7fc54159c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc53c0cd7c0 0x7fc53c0cdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:11:28.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:28.599+0000 7fc53bfff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fc53c161340 0x7fc53c0d1de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:57934/0 (socket says 172.21.15.45:57934) 2023-11-28T12:11:28.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:28.599+0000 7fc53bfff700 1 -- 172.21.15.45:0/2556656824 learned_addr learned my addr 172.21.15.45:0/2556656824 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:11:28.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:28.599+0000 7fc540d9b700 1 --2- 172.21.15.45:0/2556656824 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc53c15c9b0 0x7fc53c0b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:11:28.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:28.599+0000 7fc53b7fe700 1 -- 172.21.15.45:0/2556656824 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1575697689 0 0) 0x7fc53c0ce160 con 0x7fc53c161340 2023-11-28T12:11:28.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:28.599+0000 7fc53b7fe700 1 -- 172.21.15.45:0/2556656824 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc52c0035b0 con 0x7fc53c161340 2023-11-28T12:11:28.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:28.599+0000 7fc54159c700 1 -- 172.21.15.45:0/2556656824 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc53c15c9b0 msgr2=0x7fc53c0b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:11:28.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:28.599+0000 7fc54159c700 1 --2- 172.21.15.45:0/2556656824 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc53c15c9b0 0x7fc53c0b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:28.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:28.599+0000 7fc54159c700 1 -- 172.21.15.45:0/2556656824 >> v1:172.21.15.45:6789/0 conn(0x7fc53c161340 legacy=0x7fc53c0d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:11:28.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:28.599+0000 7fc54159c700 1 -- 172.21.15.45:0/2556656824 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc53c0d24f0 con 0x7fc53c0cd7c0 2023-11-28T12:11:28.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:28.600+0000 7fc54159c700 1 --2- 172.21.15.45:0/2556656824 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc53c0cd7c0 0x7fc53c0cdc20 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fc534009d90 tx=0x7fc53400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80401de961d92f72 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:11:28.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:28.600+0000 7fc53b7fe700 1 -- 172.21.15.45:0/2556656824 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc53400e070 con 0x7fc53c0cd7c0 2023-11-28T12:11:28.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:28.600+0000 7fc53b7fe700 1 -- 172.21.15.45:0/2556656824 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc53400bb20 con 0x7fc53c0cd7c0 2023-11-28T12:11:28.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:28.600+0000 7fc53b7fe700 1 -- 172.21.15.45:0/2556656824 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc534012430 con 0x7fc53c0cd7c0 2023-11-28T12:11:28.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:28.600+0000 7fc542fff700 1 -- 172.21.15.45:0/2556656824 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc53c0cd7c0 msgr2=0x7fc53c0cdc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:11:28.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:28.600+0000 7fc542fff700 1 --2- 172.21.15.45:0/2556656824 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc53c0cd7c0 0x7fc53c0cdc20 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fc534009d90 tx=0x7fc53400b330 comp rx=0 tx=0).stop 2023-11-28T12:11:28.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:28.600+0000 7fc542fff700 1 -- 172.21.15.45:0/2556656824 shutdown_connections 2023-11-28T12:11:28.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:28.600+0000 7fc542fff700 1 --2- 172.21.15.45:0/2556656824 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc53c0cd7c0 0x7fc53c0cdc20 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:28.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:28.600+0000 7fc542fff700 1 --2- 172.21.15.45:0/2556656824 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc53c15c9b0 0x7fc53c0b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:28.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:28.600+0000 7fc542fff700 1 -- 172.21.15.45:0/2556656824 >> 172.21.15.45:0/2556656824 conn(0x7fc53c072600 msgr2=0x7fc53c0cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:11:28.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:28.601+0000 7fc542fff700 1 -- 172.21.15.45:0/2556656824 shutdown_connections 2023-11-28T12:11:28.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:28.601+0000 7fc542fff700 1 -- 172.21.15.45:0/2556656824 wait complete. 2023-11-28T12:11:28.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:28.603+0000 7fc542fff700 1 Processor -- start 2023-11-28T12:11:28.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:28.603+0000 7fc542fff700 1 -- start start 2023-11-28T12:11:28.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:28.604+0000 7fc542fff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc53c0cd7c0 0x7fc53c1f2d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:11:28.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:28.604+0000 7fc542fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc53c15c9b0 0x7fc53c157900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:11:28.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:28.604+0000 7fc542fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc53c161340 0x7fc53c0c95d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:11:28.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:28.604+0000 7fc542fff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc53c157e40 con 0x7fc53c15c9b0 2023-11-28T12:11:28.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:28.604+0000 7fc542fff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc53c0c9b10 con 0x7fc53c161340 2023-11-28T12:11:28.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:28.604+0000 7fc542fff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc53c15d8d0 con 0x7fc53c0cd7c0 2023-11-28T12:11:28.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:28.605+0000 7fc53bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc53c15c9b0 0x7fc53c157900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:11:28.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:28.605+0000 7fc53bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc53c15c9b0 0x7fc53c157900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35288/0 (socket says 172.21.15.45:35288) 2023-11-28T12:11:28.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:28.605+0000 7fc53bfff700 1 -- 172.21.15.45:0/3665794165 learned_addr learned my addr 172.21.15.45:0/3665794165 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:11:28.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:28.605+0000 7fc540d9b700 1 --2- 172.21.15.45:0/3665794165 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc53c0cd7c0 0x7fc53c1f2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:11:28.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:28.605+0000 7fc54159c700 1 --2- 172.21.15.45:0/3665794165 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc53c161340 0x7fc53c0c95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:11:28.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:28.605+0000 7fc53bfff700 1 -- 172.21.15.45:0/3665794165 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc53c0cd7c0 msgr2=0x7fc53c1f2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:11:28.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:28.605+0000 7fc53bfff700 1 --2- 172.21.15.45:0/3665794165 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc53c0cd7c0 0x7fc53c1f2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:28.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:28.605+0000 7fc53bfff700 1 -- 172.21.15.45:0/3665794165 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc53c161340 msgr2=0x7fc53c0c95d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:11:28.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:28.605+0000 7fc53bfff700 1 --2- 172.21.15.45:0/3665794165 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc53c161340 0x7fc53c0c95d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:28.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:28.605+0000 7fc53bfff700 1 -- 172.21.15.45:0/3665794165 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc534009a70 con 0x7fc53c15c9b0 2023-11-28T12:11:28.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:28.605+0000 7fc540d9b700 1 --2- 172.21.15.45:0/3665794165 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc53c0cd7c0 0x7fc53c1f2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:11:28.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:28.605+0000 7fc53bfff700 1 --2- 172.21.15.45:0/3665794165 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc53c15c9b0 0x7fc53c157900 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fc528001eb0 tx=0x7fc52800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:11:28.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:28.606+0000 7fc5397fa700 1 -- 172.21.15.45:0/3665794165 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc528005d70 con 0x7fc53c15c9b0 2023-11-28T12:11:28.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:28.606+0000 7fc5397fa700 1 -- 172.21.15.45:0/3665794165 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5280070d0 con 0x7fc53c15c9b0 2023-11-28T12:11:28.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:28.606+0000 7fc542fff700 1 -- 172.21.15.45:0/3665794165 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc53c0d1300 con 0x7fc53c15c9b0 2023-11-28T12:11:28.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:28.606+0000 7fc5397fa700 1 -- 172.21.15.45:0/3665794165 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc528007460 con 0x7fc53c15c9b0 2023-11-28T12:11:28.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:28.606+0000 7fc542fff700 1 -- 172.21.15.45:0/3665794165 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc53c0b5520 con 0x7fc53c15c9b0 2023-11-28T12:11:28.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:28.607+0000 7fc542fff700 1 -- 172.21.15.45:0/3665794165 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc53c0d15e0 con 0x7fc53c15c9b0 2023-11-28T12:11:28.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:28.608+0000 7fc5397fa700 1 -- 172.21.15.45:0/3665794165 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fc528019030 con 0x7fc53c15c9b0 2023-11-28T12:11:28.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:28.609+0000 7fc5397fa700 1 --2- 172.21.15.45:0/3665794165 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fc5200682f0 0x7fc52006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:11:28.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:28.609+0000 7fc5397fa700 1 -- 172.21.15.45:0/3665794165 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6207+0+0 (secure 0 0 0) 0x7fc528085210 con 0x7fc53c15c9b0 2023-11-28T12:11:28.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:28.609+0000 7fc540d9b700 1 --2- 172.21.15.45:0/3665794165 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fc5200682f0 0x7fc52006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:11:28.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:28.610+0000 7fc540d9b700 1 --2- 172.21.15.45:0/3665794165 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fc5200682f0 0x7fc52006a7a0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fc530009b90 tx=0x7fc530008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:11:28.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:28.613+0000 7fc5397fa700 1 -- 172.21.15.45:0/3665794165 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fc5280518f0 con 0x7fc53c15c9b0 2023-11-28T12:11:28.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:28.858+0000 7fc542fff700 1 -- 172.21.15.45:0/3665794165 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fc53c0745c0 con 0x7fc53c15c9b0 2023-11-28T12:11:28.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:28.859+0000 7fc5397fa700 1 -- 172.21.15.45:0/3665794165 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7fc528054f10 con 0x7fc53c15c9b0 2023-11-28T12:11:28.860 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:11:28.860 INFO:teuthology.orchestra.run.smithi045.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-28T12:11:28.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:28.861+0000 7fc542fff700 1 -- 172.21.15.45:0/3665794165 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fc5200682f0 msgr2=0x7fc52006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:11:28.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:28.861+0000 7fc542fff700 1 --2- 172.21.15.45:0/3665794165 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fc5200682f0 0x7fc52006a7a0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fc530009b90 tx=0x7fc530008040 comp rx=0 tx=0).stop 2023-11-28T12:11:28.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:28.861+0000 7fc542fff700 1 -- 172.21.15.45:0/3665794165 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc53c15c9b0 msgr2=0x7fc53c157900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:11:28.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:28.861+0000 7fc542fff700 1 --2- 172.21.15.45:0/3665794165 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc53c15c9b0 0x7fc53c157900 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fc528001eb0 tx=0x7fc52800c860 comp rx=0 tx=0).stop 2023-11-28T12:11:28.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:28.861+0000 7fc542fff700 1 -- 172.21.15.45:0/3665794165 shutdown_connections 2023-11-28T12:11:28.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:28.861+0000 7fc542fff700 1 --2- 172.21.15.45:0/3665794165 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fc5200682f0 0x7fc52006a7a0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:28.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:28.861+0000 7fc542fff700 1 --2- 172.21.15.45:0/3665794165 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc53c161340 0x7fc53c0c95d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:28.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:28.861+0000 7fc542fff700 1 --2- 172.21.15.45:0/3665794165 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc53c0cd7c0 0x7fc53c1f2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:28.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:28.861+0000 7fc542fff700 1 --2- 172.21.15.45:0/3665794165 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc53c15c9b0 0x7fc53c157900 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:28.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:28.861+0000 7fc542fff700 1 -- 172.21.15.45:0/3665794165 >> 172.21.15.45:0/3665794165 conn(0x7fc53c072600 msgr2=0x7fc53c0b7580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:11:28.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:28.862+0000 7fc542fff700 1 -- 172.21.15.45:0/3665794165 shutdown_connections 2023-11-28T12:11:28.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:28.862+0000 7fc542fff700 1 -- 172.21.15.45:0/3665794165 wait complete. 2023-11-28T12:11:28.880 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=100 retry_count=0)... 2023-11-28T12:11:31.399 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T12:11:31.404 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T12:11:33.881 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T12:11:34.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:34.094+0000 7faffbdff700 1 Processor -- start 2023-11-28T12:11:34.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:34.094+0000 7faffbdff700 1 -- start start 2023-11-28T12:11:34.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:34.096+0000 7faffbdff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7faff4161340 0x7faff40d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:11:34.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:34.096+0000 7faffbdff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7faff40d2320 0x7faff40cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:11:34.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:34.096+0000 7faffbdff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faff40d1950 con 0x7faff415c9b0 2023-11-28T12:11:34.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:34.096+0000 7faffbdff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faff40b5800 con 0x7faff40d2320 2023-11-28T12:11:34.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:34.096+0000 7faffbdff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faff40b5300 con 0x7faff4161340 2023-11-28T12:11:34.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:34.096+0000 7faffa39c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7faff40d2320 0x7faff40cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:11:34.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:34.096+0000 7faffa39c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7faff40d2320 0x7faff40cd7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47326/0 (socket says 172.21.15.45:47326) 2023-11-28T12:11:34.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:34.096+0000 7faffa39c700 1 -- 172.21.15.45:0/795721085 learned_addr learned my addr 172.21.15.45:0/795721085 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:11:34.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:34.096+0000 7faff939a700 1 --2- 172.21.15.45:0/795721085 >> v2:172.21.15.152:3300/0 conn(0x7faff4161340 0x7faff40d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:11:34.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:34.096+0000 7faffa39c700 1 -- 172.21.15.45:0/795721085 >> v2:172.21.15.152:3300/0 conn(0x7faff4161340 msgr2=0x7faff40d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:11:34.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:34.096+0000 7faffa39c700 1 --2- 172.21.15.45:0/795721085 >> v2:172.21.15.152:3300/0 conn(0x7faff4161340 0x7faff40d1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:34.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:34.096+0000 7faffa39c700 1 -- 172.21.15.45:0/795721085 >> v1:172.21.15.152:6789/0 conn(0x7faff415c9b0 legacy=0x7faff40b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:11:34.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:34.097+0000 7faffa39c700 1 -- 172.21.15.45:0/795721085 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faff40b5520 con 0x7faff40d2320 2023-11-28T12:11:34.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:34.097+0000 7faffa39c700 1 --2- 172.21.15.45:0/795721085 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faff40d2320 0x7faff40cd7c0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7faff40685c0 tx=0x7fafec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daef69eacc6b4ffe server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:11:34.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:34.097+0000 7faff8b99700 1 -- 172.21.15.45:0/795721085 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafec00e070 con 0x7faff40d2320 2023-11-28T12:11:34.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:34.097+0000 7faff8b99700 1 -- 172.21.15.45:0/795721085 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafec00b980 con 0x7faff40d2320 2023-11-28T12:11:34.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:34.097+0000 7faff8b99700 1 -- 172.21.15.45:0/795721085 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafec00bd30 con 0x7faff40d2320 2023-11-28T12:11:34.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:34.097+0000 7faffbdff700 1 -- 172.21.15.45:0/795721085 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faff40d2320 msgr2=0x7faff40cd7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:11:34.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:34.097+0000 7faffbdff700 1 --2- 172.21.15.45:0/795721085 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faff40d2320 0x7faff40cd7c0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7faff40685c0 tx=0x7fafec00b330 comp rx=0 tx=0).stop 2023-11-28T12:11:34.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:34.098+0000 7faffbdff700 1 -- 172.21.15.45:0/795721085 shutdown_connections 2023-11-28T12:11:34.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:34.098+0000 7faffbdff700 1 --2- 172.21.15.45:0/795721085 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faff40d2320 0x7faff40cd7c0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:34.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:34.098+0000 7faffbdff700 1 --2- 172.21.15.45:0/795721085 >> v2:172.21.15.152:3300/0 conn(0x7faff4161340 0x7faff40d1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:34.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:34.098+0000 7faffbdff700 1 -- 172.21.15.45:0/795721085 >> 172.21.15.45:0/795721085 conn(0x7faff4072600 msgr2=0x7faff40cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:11:34.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:34.098+0000 7faffbdff700 1 -- 172.21.15.45:0/795721085 shutdown_connections 2023-11-28T12:11:34.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:34.098+0000 7faffbdff700 1 -- 172.21.15.45:0/795721085 wait complete. 2023-11-28T12:11:34.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:34.099+0000 7faffbdff700 1 Processor -- start 2023-11-28T12:11:34.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:34.100+0000 7faffbdff700 1 -- start start 2023-11-28T12:11:34.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:34.100+0000 7faffbdff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7faff40d2320 0x7faff40c8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:11:34.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:34.101+0000 7faffbdff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faff415c9b0 0x7faff414dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:11:34.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:34.101+0000 7faffbdff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faff4161340 0x7faff4157510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:11:34.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:34.101+0000 7faffbdff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faff41e64c0 con 0x7faff4161340 2023-11-28T12:11:34.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:34.101+0000 7faffbdff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faff41e67a0 con 0x7faff415c9b0 2023-11-28T12:11:34.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:34.101+0000 7faffbdff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faff41e6a80 con 0x7faff40d2320 2023-11-28T12:11:34.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:34.101+0000 7faffa39c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faff4161340 0x7faff4157510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:11:34.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:34.101+0000 7faffa39c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faff4161340 0x7faff4157510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47332/0 (socket says 172.21.15.45:47332) 2023-11-28T12:11:34.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:34.101+0000 7faffa39c700 1 -- 172.21.15.45:0/2261732144 learned_addr learned my addr 172.21.15.45:0/2261732144 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:11:34.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:34.101+0000 7faff9b9b700 1 --2- 172.21.15.45:0/2261732144 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7faff40d2320 0x7faff40c8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:11:34.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:34.101+0000 7faff939a700 1 --2- 172.21.15.45:0/2261732144 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faff415c9b0 0x7faff414dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:11:34.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:34.101+0000 7faffa39c700 1 -- 172.21.15.45:0/2261732144 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7faff40d2320 msgr2=0x7faff40c8e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:11:34.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:34.101+0000 7faffa39c700 1 --2- 172.21.15.45:0/2261732144 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7faff40d2320 0x7faff40c8e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:34.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:34.101+0000 7faffa39c700 1 -- 172.21.15.45:0/2261732144 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faff415c9b0 msgr2=0x7faff414dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:11:34.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:34.101+0000 7faffa39c700 1 --2- 172.21.15.45:0/2261732144 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faff415c9b0 0x7faff414dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:34.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:34.101+0000 7faffa39c700 1 -- 172.21.15.45:0/2261732144 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafec009b30 con 0x7faff4161340 2023-11-28T12:11:34.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:34.102+0000 7faffa39c700 1 --2- 172.21.15.45:0/2261732144 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faff4161340 0x7faff4157510 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fafec012000 tx=0x7fafec004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:11:34.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:34.102+0000 7fafea7fc700 1 -- 172.21.15.45:0/2261732144 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafec0092e0 con 0x7faff4161340 2023-11-28T12:11:34.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:34.102+0000 7fafea7fc700 1 -- 172.21.15.45:0/2261732144 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafec004960 con 0x7faff4161340 2023-11-28T12:11:34.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:34.102+0000 7fafea7fc700 1 -- 172.21.15.45:0/2261732144 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafec01b670 con 0x7faff4161340 2023-11-28T12:11:34.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:34.102+0000 7faffbdff700 1 -- 172.21.15.45:0/2261732144 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faff40d15e0 con 0x7faff4161340 2023-11-28T12:11:34.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:34.102+0000 7faffbdff700 1 -- 172.21.15.45:0/2261732144 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faff40d1300 con 0x7faff4161340 2023-11-28T12:11:34.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:34.103+0000 7faffbdff700 1 -- 172.21.15.45:0/2261732144 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faff415cd80 con 0x7faff4161340 2023-11-28T12:11:34.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:34.104+0000 7fafea7fc700 1 -- 172.21.15.45:0/2261732144 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fafec021030 con 0x7faff4161340 2023-11-28T12:11:34.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:34.105+0000 7fafea7fc700 1 --2- 172.21.15.45:0/2261732144 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fafd80682f0 0x7fafd806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:11:34.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:34.105+0000 7fafea7fc700 1 -- 172.21.15.45:0/2261732144 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6207+0+0 (secure 0 0 0) 0x7fafec087330 con 0x7faff4161340 2023-11-28T12:11:34.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:34.105+0000 7faff9b9b700 1 --2- 172.21.15.45:0/2261732144 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fafd80682f0 0x7fafd806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:11:34.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:34.106+0000 7faff9b9b700 1 --2- 172.21.15.45:0/2261732144 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fafd80682f0 0x7fafd806a7a0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7faff0001620 tx=0x7faff0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:11:34.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:34.109+0000 7fafea7fc700 1 -- 172.21.15.45:0/2261732144 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fafec053a10 con 0x7faff4161340 2023-11-28T12:11:34.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:34.357+0000 7faffbdff700 1 -- 172.21.15.45:0/2261732144 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7faff40745c0 con 0x7faff4161340 2023-11-28T12:11:34.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:34.357+0000 7fafea7fc700 1 -- 172.21.15.45:0/2261732144 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7fafec01f0c0 con 0x7faff4161340 2023-11-28T12:11:34.358 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:11:34.358 INFO:teuthology.orchestra.run.smithi045.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-28T12:11:34.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:34.360+0000 7faffbdff700 1 -- 172.21.15.45:0/2261732144 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fafd80682f0 msgr2=0x7fafd806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:11:34.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:34.360+0000 7faffbdff700 1 --2- 172.21.15.45:0/2261732144 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fafd80682f0 0x7fafd806a7a0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7faff0001620 tx=0x7faff0009040 comp rx=0 tx=0).stop 2023-11-28T12:11:34.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:34.360+0000 7faffbdff700 1 -- 172.21.15.45:0/2261732144 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faff4161340 msgr2=0x7faff4157510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:11:34.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:34.360+0000 7faffbdff700 1 --2- 172.21.15.45:0/2261732144 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faff4161340 0x7faff4157510 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fafec012000 tx=0x7fafec004ad0 comp rx=0 tx=0).stop 2023-11-28T12:11:34.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:34.360+0000 7faffbdff700 1 -- 172.21.15.45:0/2261732144 shutdown_connections 2023-11-28T12:11:34.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:34.360+0000 7faffbdff700 1 --2- 172.21.15.45:0/2261732144 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fafd80682f0 0x7fafd806a7a0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:34.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:34.360+0000 7faffbdff700 1 --2- 172.21.15.45:0/2261732144 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faff4161340 0x7faff4157510 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:34.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:34.360+0000 7faffbdff700 1 --2- 172.21.15.45:0/2261732144 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7faff40d2320 0x7faff40c8e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:34.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:34.360+0000 7faffbdff700 1 --2- 172.21.15.45:0/2261732144 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7faff415c9b0 0x7faff414dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:34.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:34.360+0000 7faffbdff700 1 -- 172.21.15.45:0/2261732144 >> 172.21.15.45:0/2261732144 conn(0x7faff4072600 msgr2=0x7faff40b6e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:11:34.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:34.360+0000 7faffbdff700 1 -- 172.21.15.45:0/2261732144 shutdown_connections 2023-11-28T12:11:34.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:34.360+0000 7faffbdff700 1 -- 172.21.15.45:0/2261732144 wait complete. 2023-11-28T12:11:34.379 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=100 retry_count=0)... 2023-11-28T12:11:39.380 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T12:11:39.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:39.593+0000 7ff1c1bff700 1 Processor -- start 2023-11-28T12:11:39.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:39.593+0000 7ff1c1bff700 1 -- start start 2023-11-28T12:11:39.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:39.594+0000 7ff1c1bff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff1bc161340 0x7ff1bc0d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:11:39.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:39.594+0000 7ff1c1bff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1bc0d1950 con 0x7ff1bc0d2320 2023-11-28T12:11:39.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:39.594+0000 7ff1c1bff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1bc0b5520 con 0x7ff1bc15c9b0 2023-11-28T12:11:39.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:39.594+0000 7ff1c1bff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1bc0b5800 con 0x7ff1bc161340 2023-11-28T12:11:39.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:39.595+0000 7ff1bbfff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ff1bc0d2320 0x7ff1bc0cd7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:40840/0 (socket says 172.21.15.45:40840) 2023-11-28T12:11:39.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:39.595+0000 7ff1bbfff700 1 -- 172.21.15.45:0/1794560909 learned_addr learned my addr 172.21.15.45:0/1794560909 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:11:39.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:39.595+0000 7ff1baffd700 1 --2- 172.21.15.45:0/1794560909 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff1bc161340 0x7ff1bc0d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:11:39.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:39.595+0000 7ff1ba7fc700 1 -- 172.21.15.45:0/1794560909 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3559766884 0 0) 0x7ff1bc0d1950 con 0x7ff1bc0d2320 2023-11-28T12:11:39.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:39.595+0000 7ff1ba7fc700 1 -- 172.21.15.45:0/1794560909 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1a40035b0 con 0x7ff1bc0d2320 2023-11-28T12:11:39.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:39.595+0000 7ff1ba7fc700 1 -- 172.21.15.45:0/1794560909 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 65285815 0 0) 0x7ff1bc0b5520 con 0x7ff1bc15c9b0 2023-11-28T12:11:39.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:39.595+0000 7ff1ba7fc700 1 -- 172.21.15.45:0/1794560909 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1bc0d1950 con 0x7ff1bc15c9b0 2023-11-28T12:11:39.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:39.595+0000 7ff1ba7fc700 1 -- 172.21.15.45:0/1794560909 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3999892463 0 0) 0x7ff1a40035b0 con 0x7ff1bc0d2320 2023-11-28T12:11:39.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:39.595+0000 7ff1ba7fc700 1 -- 172.21.15.45:0/1794560909 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff1bc161340 msgr2=0x7ff1bc0d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:11:39.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:39.595+0000 7ff1ba7fc700 1 --2- 172.21.15.45:0/1794560909 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff1bc161340 0x7ff1bc0d1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:39.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:39.595+0000 7ff1ba7fc700 1 -- 172.21.15.45:0/1794560909 >> v1:172.21.15.152:6789/0 conn(0x7ff1bc15c9b0 legacy=0x7ff1bc0b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:11:39.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:39.595+0000 7ff1ba7fc700 1 -- 172.21.15.45:0/1794560909 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1bc0d1300 con 0x7ff1bc0d2320 2023-11-28T12:11:39.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:39.595+0000 7ff1ba7fc700 1 -- 172.21.15.45:0/1794560909 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3460218165 0 0) 0x7ff1b40019f0 con 0x7ff1bc0d2320 2023-11-28T12:11:39.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:39.595+0000 7ff1baffd700 1 --2- 172.21.15.45:0/1794560909 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff1bc161340 0x7ff1bc0d1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:11:39.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:39.596+0000 7ff1ba7fc700 1 -- 172.21.15.45:0/1794560909 >> v1:172.21.15.45:6789/0 conn(0x7ff1bc0d2320 legacy=0x7ff1bc0cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:11:39.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:39.596+0000 7ff1ba7fc700 1 --2- 172.21.15.45:0/1794560909 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff1a4003bc0 0x7ff1a4003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:11:39.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:39.596+0000 7ff1ba7fc700 1 --2- 172.21.15.45:0/1794560909 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1a4004850 0x7ff1a4004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:11:39.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:39.596+0000 7ff1ba7fc700 1 --2- 172.21.15.45:0/1794560909 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff1bc161340 0x7ff1a4005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:11:39.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:39.596+0000 7ff1ba7fc700 1 -- 172.21.15.45:0/1794560909 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1bc0b5800 con 0x7ff1a4004850 2023-11-28T12:11:39.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:39.596+0000 7ff1ba7fc700 1 -- 172.21.15.45:0/1794560909 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a400bb60 con 0x7ff1a4003bc0 2023-11-28T12:11:39.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:39.596+0000 7ff1ba7fc700 1 -- 172.21.15.45:0/1794560909 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a400bd20 con 0x7ff1bc161340 2023-11-28T12:11:39.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:39.596+0000 7ff1baffd700 1 --2- 172.21.15.45:0/1794560909 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1a4004850 0x7ff1a4004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:11:39.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:39.596+0000 7ff1bb7fe700 1 --2- 172.21.15.45:0/1794560909 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff1a4003bc0 0x7ff1a4003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:11:39.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:39.596+0000 7ff1bbfff700 1 --2- 172.21.15.45:0/1794560909 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff1bc161340 0x7ff1a4005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:11:39.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:39.596+0000 7ff1baffd700 1 -- 172.21.15.45:0/1794560909 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff1bc161340 msgr2=0x7ff1a4005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:11:39.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:39.596+0000 7ff1baffd700 1 --2- 172.21.15.45:0/1794560909 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff1bc161340 0x7ff1a4005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:39.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:39.596+0000 7ff1baffd700 1 -- 172.21.15.45:0/1794560909 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff1a4003bc0 msgr2=0x7ff1a4003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:11:39.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:39.596+0000 7ff1baffd700 1 --2- 172.21.15.45:0/1794560909 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff1a4003bc0 0x7ff1a4003fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:39.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:39.596+0000 7ff1baffd700 1 -- 172.21.15.45:0/1794560909 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1b00094a0 con 0x7ff1a4004850 2023-11-28T12:11:39.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:39.597+0000 7ff1baffd700 1 --2- 172.21.15.45:0/1794560909 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1a4004850 0x7ff1a4004cc0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7ff1b0009d30 tx=0x7ff1a4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6419a89810b232dc server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:11:39.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:39.597+0000 7ff1ba7fc700 1 -- 172.21.15.45:0/1794560909 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b0009e80 con 0x7ff1a4004850 2023-11-28T12:11:39.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:39.597+0000 7ff1ba7fc700 1 -- 172.21.15.45:0/1794560909 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1b000e9a0 con 0x7ff1a4004850 2023-11-28T12:11:39.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:39.597+0000 7ff1ba7fc700 1 -- 172.21.15.45:0/1794560909 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b000ed10 con 0x7ff1a4004850 2023-11-28T12:11:39.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:39.597+0000 7ff1c1bff700 1 -- 172.21.15.45:0/1794560909 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1a4004850 msgr2=0x7ff1a4004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:11:39.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:39.597+0000 7ff1c1bff700 1 --2- 172.21.15.45:0/1794560909 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1a4004850 0x7ff1a4004cc0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7ff1b0009d30 tx=0x7ff1a4005880 comp rx=0 tx=0).stop 2023-11-28T12:11:39.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:39.597+0000 7ff1bbfff700 1 -- 172.21.15.45:0/1794560909 reap_dead start 2023-11-28T12:11:39.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:39.597+0000 7ff1c1bff700 1 -- 172.21.15.45:0/1794560909 shutdown_connections 2023-11-28T12:11:39.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:39.597+0000 7ff1c1bff700 1 -- 172.21.15.45:0/1794560909 >> 172.21.15.45:0/1794560909 conn(0x7ff1bc072600 msgr2=0x7ff1bc0cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:11:39.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:39.598+0000 7ff1c1bff700 1 -- 172.21.15.45:0/1794560909 shutdown_connections 2023-11-28T12:11:39.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:39.598+0000 7ff1c1bff700 1 -- 172.21.15.45:0/1794560909 wait complete. 2023-11-28T12:11:39.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:39.599+0000 7ff1c1bff700 1 Processor -- start 2023-11-28T12:11:39.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:39.600+0000 7ff1c1bff700 1 -- start start 2023-11-28T12:11:39.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:39.600+0000 7ff1c1bff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff1a4004850 0x7ff1bc15d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:11:39.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:39.600+0000 7ff1c1bff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff1bc154400 0x7ff1bc1473b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:11:39.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:39.601+0000 7ff1c1bff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1bc15ea70 0x7ff1bc156980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:11:39.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:39.601+0000 7ff1c1bff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1bc15e650 con 0x7ff1bc15ea70 2023-11-28T12:11:39.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:39.601+0000 7ff1c1bff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1bc15d9d0 con 0x7ff1bc154400 2023-11-28T12:11:39.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:39.601+0000 7ff1c1bff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1bc15dcb0 con 0x7ff1a4004850 2023-11-28T12:11:39.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:39.601+0000 7ff1bbfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1bc15ea70 0x7ff1bc156980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:11:39.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:39.601+0000 7ff1baffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff1bc154400 0x7ff1bc1473b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:11:39.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:39.601+0000 7ff1bbfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1bc15ea70 0x7ff1bc156980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47356/0 (socket says 172.21.15.45:47356) 2023-11-28T12:11:39.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:39.601+0000 7ff1bbfff700 1 -- 172.21.15.45:0/2813042033 learned_addr learned my addr 172.21.15.45:0/2813042033 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:11:39.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:39.601+0000 7ff1bb7fe700 1 --2- 172.21.15.45:0/2813042033 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff1a4004850 0x7ff1bc15d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:11:39.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:39.601+0000 7ff1bbfff700 1 -- 172.21.15.45:0/2813042033 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff1a4004850 msgr2=0x7ff1bc15d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:11:39.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:39.601+0000 7ff1bbfff700 1 --2- 172.21.15.45:0/2813042033 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff1a4004850 0x7ff1bc15d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:39.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:39.601+0000 7ff1bbfff700 1 -- 172.21.15.45:0/2813042033 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff1bc154400 msgr2=0x7ff1bc1473b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:11:39.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:39.601+0000 7ff1bbfff700 1 --2- 172.21.15.45:0/2813042033 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff1bc154400 0x7ff1bc1473b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:39.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:39.601+0000 7ff1bbfff700 1 -- 172.21.15.45:0/2813042033 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1bc15cd80 con 0x7ff1bc15ea70 2023-11-28T12:11:39.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:39.602+0000 7ff1bbfff700 1 --2- 172.21.15.45:0/2813042033 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1bc15ea70 0x7ff1bc156980 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc08bfd0 tx=0x7ff1b4007c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:11:39.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:39.602+0000 7ff1a3fff700 1 -- 172.21.15.45:0/2813042033 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b400ebc0 con 0x7ff1bc15ea70 2023-11-28T12:11:39.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:39.602+0000 7ff1a3fff700 1 -- 172.21.15.45:0/2813042033 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1b400ed20 con 0x7ff1bc15ea70 2023-11-28T12:11:39.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:39.602+0000 7ff1a3fff700 1 -- 172.21.15.45:0/2813042033 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b4013640 con 0x7ff1bc15ea70 2023-11-28T12:11:39.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:39.602+0000 7ff1c1bff700 1 -- 172.21.15.45:0/2813042033 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1bc0d15e0 con 0x7ff1bc15ea70 2023-11-28T12:11:39.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:39.602+0000 7ff1c1bff700 1 -- 172.21.15.45:0/2813042033 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1bc15cf10 con 0x7ff1bc15ea70 2023-11-28T12:11:39.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:39.603+0000 7ff1c1bff700 1 -- 172.21.15.45:0/2813042033 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1bc0745c0 con 0x7ff1bc15ea70 2023-11-28T12:11:39.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:39.604+0000 7ff1a3fff700 1 -- 172.21.15.45:0/2813042033 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7ff1b40137a0 con 0x7ff1bc15ea70 2023-11-28T12:11:39.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:39.605+0000 7ff1a3fff700 1 --2- 172.21.15.45:0/2813042033 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7ff1a80682f0 0x7ff1a806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:11:39.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:39.605+0000 7ff1a3fff700 1 -- 172.21.15.45:0/2813042033 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6207+0+0 (secure 0 0 0) 0x7ff1b40863d0 con 0x7ff1bc15ea70 2023-11-28T12:11:39.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:39.606+0000 7ff1bb7fe700 1 --2- 172.21.15.45:0/2813042033 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7ff1a80682f0 0x7ff1a806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:11:39.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:39.606+0000 7ff1bb7fe700 1 --2- 172.21.15.45:0/2813042033 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7ff1a80682f0 0x7ff1a806a7a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac000c00 tx=0x7ff1ac009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:11:39.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:39.609+0000 7ff1a3fff700 1 -- 172.21.15.45:0/2813042033 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7ff1b4052a50 con 0x7ff1bc15ea70 2023-11-28T12:11:39.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:39.856+0000 7ff1c1bff700 1 -- 172.21.15.45:0/2813042033 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7ff1bc0d08a0 con 0x7ff1bc15ea70 2023-11-28T12:11:39.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:39.856+0000 7ff1a3fff700 1 -- 172.21.15.45:0/2813042033 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7ff1b4056070 con 0x7ff1bc15ea70 2023-11-28T12:11:39.857 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:11:39.857 INFO:teuthology.orchestra.run.smithi045.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-28T12:11:39.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:39.858+0000 7ff1c1bff700 1 -- 172.21.15.45:0/2813042033 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7ff1a80682f0 msgr2=0x7ff1a806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:11:39.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:39.858+0000 7ff1c1bff700 1 --2- 172.21.15.45:0/2813042033 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7ff1a80682f0 0x7ff1a806a7a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac000c00 tx=0x7ff1ac009040 comp rx=0 tx=0).stop 2023-11-28T12:11:39.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:39.858+0000 7ff1c1bff700 1 -- 172.21.15.45:0/2813042033 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1bc15ea70 msgr2=0x7ff1bc156980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:11:39.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:39.858+0000 7ff1c1bff700 1 --2- 172.21.15.45:0/2813042033 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1bc15ea70 0x7ff1bc156980 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc08bfd0 tx=0x7ff1b4007c90 comp rx=0 tx=0).stop 2023-11-28T12:11:39.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:39.858+0000 7ff1c1bff700 1 -- 172.21.15.45:0/2813042033 shutdown_connections 2023-11-28T12:11:39.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:39.858+0000 7ff1c1bff700 1 --2- 172.21.15.45:0/2813042033 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7ff1a80682f0 0x7ff1a806a7a0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:39.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:39.858+0000 7ff1c1bff700 1 --2- 172.21.15.45:0/2813042033 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1bc15ea70 0x7ff1bc156980 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:39.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:39.858+0000 7ff1c1bff700 1 --2- 172.21.15.45:0/2813042033 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff1a4004850 0x7ff1bc15d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:39.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:39.858+0000 7ff1c1bff700 1 --2- 172.21.15.45:0/2813042033 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff1bc154400 0x7ff1bc1473b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:39.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:39.858+0000 7ff1c1bff700 1 -- 172.21.15.45:0/2813042033 >> 172.21.15.45:0/2813042033 conn(0x7ff1bc072600 msgr2=0x7ff1bc0b60a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:11:39.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:39.859+0000 7ff1c1bff700 1 -- 172.21.15.45:0/2813042033 shutdown_connections 2023-11-28T12:11:39.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:39.859+0000 7ff1c1bff700 1 -- 172.21.15.45:0/2813042033 wait complete. 2023-11-28T12:11:39.877 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=100 retry_count=0)... 2023-11-28T12:11:44.879 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T12:11:45.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:45.092+0000 7f5743fff700 1 Processor -- start 2023-11-28T12:11:45.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:45.092+0000 7f5743fff700 1 -- start start 2023-11-28T12:11:45.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:45.093+0000 7f5743fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f573c161340 0x7f573c0d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:11:45.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:45.093+0000 7f5743fff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f573c0d1950 con 0x7f573c0d2320 2023-11-28T12:11:45.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:45.093+0000 7f5743fff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f573c0b5520 con 0x7f573c15c9b0 2023-11-28T12:11:45.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:45.093+0000 7f5743fff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f573c0b5800 con 0x7f573c161340 2023-11-28T12:11:45.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:45.093+0000 7f574159a700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f573c161340 0x7f573c0d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:11:45.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:45.093+0000 7f574259c700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f573c0d2320 0x7f573c0cd7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:60030/0 (socket says 172.21.15.45:60030) 2023-11-28T12:11:45.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:45.093+0000 7f574259c700 1 -- 172.21.15.45:0/2447711983 learned_addr learned my addr 172.21.15.45:0/2447711983 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:11:45.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:45.094+0000 7f574159a700 1 -- 172.21.15.45:0/2447711983 >> v1:172.21.15.152:6789/0 conn(0x7f573c15c9b0 legacy=0x7f573c0b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:11:45.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:45.094+0000 7f5740d99700 1 -- 172.21.15.45:0/2447711983 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1318003338 0 0) 0x7f573c0d1950 con 0x7f573c0d2320 2023-11-28T12:11:45.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:45.094+0000 7f574159a700 1 -- 172.21.15.45:0/2447711983 >> v1:172.21.15.45:6789/0 conn(0x7f573c0d2320 legacy=0x7f573c0cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:11:45.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:45.094+0000 7f574159a700 1 -- 172.21.15.45:0/2447711983 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f573c0d1300 con 0x7f573c161340 2023-11-28T12:11:45.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:45.094+0000 7f574159a700 1 --2- 172.21.15.45:0/2447711983 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f573c161340 0x7f573c0d1de0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f572c009840 tx=0x7f572c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1db7f7533abd98c6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:11:45.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:45.094+0000 7f5740d99700 1 -- 172.21.15.45:0/2447711983 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f572c011830 con 0x7f573c161340 2023-11-28T12:11:45.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:45.094+0000 7f5740d99700 1 -- 172.21.15.45:0/2447711983 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f572c011990 con 0x7f573c161340 2023-11-28T12:11:45.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:45.094+0000 7f5740d99700 1 -- 172.21.15.45:0/2447711983 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f572c011d20 con 0x7f573c161340 2023-11-28T12:11:45.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:45.095+0000 7f5743fff700 1 -- 172.21.15.45:0/2447711983 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f573c161340 msgr2=0x7f573c0d1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:11:45.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:45.095+0000 7f5743fff700 1 --2- 172.21.15.45:0/2447711983 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f573c161340 0x7f573c0d1de0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f572c009840 tx=0x7f572c009b50 comp rx=0 tx=0).stop 2023-11-28T12:11:45.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:45.095+0000 7f5743fff700 1 -- 172.21.15.45:0/2447711983 shutdown_connections 2023-11-28T12:11:45.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:45.095+0000 7f5743fff700 1 --2- 172.21.15.45:0/2447711983 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f573c161340 0x7f573c0d1de0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:45.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:45.095+0000 7f5743fff700 1 -- 172.21.15.45:0/2447711983 >> 172.21.15.45:0/2447711983 conn(0x7f573c072600 msgr2=0x7f573c0cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:11:45.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:45.095+0000 7f5743fff700 1 -- 172.21.15.45:0/2447711983 shutdown_connections 2023-11-28T12:11:45.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:45.095+0000 7f5743fff700 1 -- 172.21.15.45:0/2447711983 wait complete. 2023-11-28T12:11:45.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:45.097+0000 7f5743fff700 1 Processor -- start 2023-11-28T12:11:45.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:45.097+0000 7f5743fff700 1 -- start start 2023-11-28T12:11:45.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:45.098+0000 7f5743fff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f573c0d2320 0x7f573c0cc080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:11:45.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:45.098+0000 7f5743fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f573c15c9b0 0x7f573c14d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:11:45.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:45.098+0000 7f5743fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f573c161340 0x7f573c15a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:11:45.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:45.098+0000 7f5743fff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f573c0cafe0 con 0x7f573c161340 2023-11-28T12:11:45.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:45.098+0000 7f5743fff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f573c0cb2c0 con 0x7f573c15c9b0 2023-11-28T12:11:45.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:45.098+0000 7f5743fff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f573c0cb5a0 con 0x7f573c0d2320 2023-11-28T12:11:45.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:45.098+0000 7f574259c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f573c161340 0x7f573c15a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:11:45.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:45.098+0000 7f574259c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f573c161340 0x7f573c15a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52890/0 (socket says 172.21.15.45:52890) 2023-11-28T12:11:45.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:45.098+0000 7f574259c700 1 -- 172.21.15.45:0/2145992164 learned_addr learned my addr 172.21.15.45:0/2145992164 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:11:45.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:45.098+0000 7f574159a700 1 --2- 172.21.15.45:0/2145992164 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f573c15c9b0 0x7f573c14d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:11:45.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:45.098+0000 7f5741d9b700 1 --2- 172.21.15.45:0/2145992164 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f573c0d2320 0x7f573c0cc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:11:45.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:45.098+0000 7f574259c700 1 -- 172.21.15.45:0/2145992164 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f573c0d2320 msgr2=0x7f573c0cc080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:11:45.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:45.098+0000 7f574259c700 1 --2- 172.21.15.45:0/2145992164 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f573c0d2320 0x7f573c0cc080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:45.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:45.098+0000 7f574259c700 1 -- 172.21.15.45:0/2145992164 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f573c15c9b0 msgr2=0x7f573c14d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:11:45.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:45.098+0000 7f574259c700 1 --2- 172.21.15.45:0/2145992164 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f573c15c9b0 0x7f573c14d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:45.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:45.098+0000 7f574259c700 1 -- 172.21.15.45:0/2145992164 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f572c0094a0 con 0x7f573c161340 2023-11-28T12:11:45.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:45.099+0000 7f574259c700 1 --2- 172.21.15.45:0/2145992164 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f573c161340 0x7f573c15a4e0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f573400cc70 tx=0x7f573400cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:11:45.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:45.099+0000 7f57327fc700 1 -- 172.21.15.45:0/2145992164 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f573400aaa0 con 0x7f573c161340 2023-11-28T12:11:45.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:45.099+0000 7f57327fc700 1 -- 172.21.15.45:0/2145992164 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f573400ac20 con 0x7f573c161340 2023-11-28T12:11:45.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:45.099+0000 7f5743fff700 1 -- 172.21.15.45:0/2145992164 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f573c15cd80 con 0x7f573c161340 2023-11-28T12:11:45.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:45.099+0000 7f57327fc700 1 -- 172.21.15.45:0/2145992164 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57340070d0 con 0x7f573c161340 2023-11-28T12:11:45.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:45.099+0000 7f5743fff700 1 -- 172.21.15.45:0/2145992164 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f573c0d15e0 con 0x7f573c161340 2023-11-28T12:11:45.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:45.100+0000 7f5743fff700 1 -- 172.21.15.45:0/2145992164 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f573c15cf10 con 0x7f573c161340 2023-11-28T12:11:45.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:45.101+0000 7f57327fc700 1 -- 172.21.15.45:0/2145992164 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f573401a030 con 0x7f573c161340 2023-11-28T12:11:45.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:45.102+0000 7f57327fc700 1 --2- 172.21.15.45:0/2145992164 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f57200682f0 0x7f572006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:11:45.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:45.102+0000 7f57327fc700 1 -- 172.21.15.45:0/2145992164 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f5734085a80 con 0x7f573c161340 2023-11-28T12:11:45.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:45.102+0000 7f5741d9b700 1 --2- 172.21.15.45:0/2145992164 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f57200682f0 0x7f572006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:11:45.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:45.103+0000 7f5741d9b700 1 --2- 172.21.15.45:0/2145992164 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f57200682f0 0x7f572006a7a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f5738007fd0 tx=0x7f5738009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:11:45.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:45.106+0000 7f57327fc700 1 -- 172.21.15.45:0/2145992164 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f5734052100 con 0x7f573c161340 2023-11-28T12:11:45.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:45.353+0000 7f5743fff700 1 -- 172.21.15.45:0/2145992164 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f573c0745c0 con 0x7f573c161340 2023-11-28T12:11:45.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:45.353+0000 7f57327fc700 1 -- 172.21.15.45:0/2145992164 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7f57340180c0 con 0x7f573c161340 2023-11-28T12:11:45.354 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:11:45.354 INFO:teuthology.orchestra.run.smithi045.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-28T12:11:45.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:45.355+0000 7f5743fff700 1 -- 172.21.15.45:0/2145992164 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f57200682f0 msgr2=0x7f572006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:11:45.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:45.355+0000 7f5743fff700 1 --2- 172.21.15.45:0/2145992164 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f57200682f0 0x7f572006a7a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f5738007fd0 tx=0x7f5738009040 comp rx=0 tx=0).stop 2023-11-28T12:11:45.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:45.355+0000 7f5743fff700 1 -- 172.21.15.45:0/2145992164 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f573c161340 msgr2=0x7f573c15a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:11:45.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:45.355+0000 7f5743fff700 1 --2- 172.21.15.45:0/2145992164 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f573c161340 0x7f573c15a4e0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f573400cc70 tx=0x7f573400cf80 comp rx=0 tx=0).stop 2023-11-28T12:11:45.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:45.355+0000 7f5743fff700 1 -- 172.21.15.45:0/2145992164 shutdown_connections 2023-11-28T12:11:45.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:45.355+0000 7f5743fff700 1 --2- 172.21.15.45:0/2145992164 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f57200682f0 0x7f572006a7a0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:45.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:45.355+0000 7f5743fff700 1 --2- 172.21.15.45:0/2145992164 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f573c161340 0x7f573c15a4e0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:45.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:45.355+0000 7f5743fff700 1 --2- 172.21.15.45:0/2145992164 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f573c0d2320 0x7f573c0cc080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:45.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:45.355+0000 7f5743fff700 1 --2- 172.21.15.45:0/2145992164 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f573c15c9b0 0x7f573c14d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:45.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:45.355+0000 7f5743fff700 1 -- 172.21.15.45:0/2145992164 >> 172.21.15.45:0/2145992164 conn(0x7f573c072600 msgr2=0x7f573c15f110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:11:45.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:45.355+0000 7f5743fff700 1 -- 172.21.15.45:0/2145992164 shutdown_connections 2023-11-28T12:11:45.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:45.355+0000 7f5743fff700 1 -- 172.21.15.45:0/2145992164 wait complete. 2023-11-28T12:11:45.374 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=100 retry_count=0)... 2023-11-28T12:11:50.374 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T12:11:50.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:50.587+0000 7fa3241ff700 1 Processor -- start 2023-11-28T12:11:50.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:50.588+0000 7fa3241ff700 1 -- start start 2023-11-28T12:11:50.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:50.589+0000 7fa3241ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa31c0cd7c0 0x7fa31c0cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:11:50.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:50.589+0000 7fa3241ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa31c0d1950 con 0x7fa31c15c9b0 2023-11-28T12:11:50.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:50.589+0000 7fa3241ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa31c0ce140 con 0x7fa31c161340 2023-11-28T12:11:50.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:50.589+0000 7fa3241ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa31c0b5800 con 0x7fa31c0cd7c0 2023-11-28T12:11:50.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:50.589+0000 7fa321f9b700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fa31c15c9b0 0x7fa31c0b4bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:60042/0 (socket says 172.21.15.45:60042) 2023-11-28T12:11:50.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:50.589+0000 7fa321f9b700 1 -- 172.21.15.45:0/2365157302 learned_addr learned my addr 172.21.15.45:0/2365157302 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:11:50.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:50.589+0000 7fa32279c700 1 --2- 172.21.15.45:0/2365157302 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa31c0cd7c0 0x7fa31c0cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:11:50.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:50.589+0000 7fa320f99700 1 -- 172.21.15.45:0/2365157302 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3247227820 0 0) 0x7fa31c0d1950 con 0x7fa31c15c9b0 2023-11-28T12:11:50.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:50.590+0000 7fa320f99700 1 -- 172.21.15.45:0/2365157302 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3080035b0 con 0x7fa31c15c9b0 2023-11-28T12:11:50.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:50.590+0000 7fa320f99700 1 -- 172.21.15.45:0/2365157302 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 491815680 0 0) 0x7fa31c0ce140 con 0x7fa31c161340 2023-11-28T12:11:50.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:50.590+0000 7fa320f99700 1 -- 172.21.15.45:0/2365157302 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa31c0d1950 con 0x7fa31c161340 2023-11-28T12:11:50.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:50.590+0000 7fa320f99700 1 -- 172.21.15.45:0/2365157302 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2352721743 0 0) 0x7fa3080035b0 con 0x7fa31c15c9b0 2023-11-28T12:11:50.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:50.590+0000 7fa320f99700 1 -- 172.21.15.45:0/2365157302 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa31c0cd7c0 msgr2=0x7fa31c0cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:11:50.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:50.590+0000 7fa320f99700 1 --2- 172.21.15.45:0/2365157302 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa31c0cd7c0 0x7fa31c0cdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:50.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:50.590+0000 7fa320f99700 1 -- 172.21.15.45:0/2365157302 >> v1:172.21.15.152:6789/0 conn(0x7fa31c161340 legacy=0x7fa31c0d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:11:50.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:50.590+0000 7fa320f99700 1 -- 172.21.15.45:0/2365157302 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa31c0d24f0 con 0x7fa31c15c9b0 2023-11-28T12:11:50.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:50.590+0000 7fa320f99700 1 -- 172.21.15.45:0/2365157302 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3460218165 0 0) 0x7fa318001670 con 0x7fa31c15c9b0 2023-11-28T12:11:50.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:50.590+0000 7fa320f99700 1 -- 172.21.15.45:0/2365157302 >> v1:172.21.15.45:6789/0 conn(0x7fa31c15c9b0 legacy=0x7fa31c0b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:11:50.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:50.590+0000 7fa320f99700 1 --2- 172.21.15.45:0/2365157302 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa308003bc0 0x7fa308003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:11:50.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:50.590+0000 7fa320f99700 1 --2- 172.21.15.45:0/2365157302 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa308004850 0x7fa308004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:11:50.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:50.590+0000 7fa320f99700 1 --2- 172.21.15.45:0/2365157302 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa31c0cd7c0 0x7fa308005260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:11:50.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:50.590+0000 7fa320f99700 1 -- 172.21.15.45:0/2365157302 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa31c0b5800 con 0x7fa308003bc0 2023-11-28T12:11:50.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:50.590+0000 7fa320f99700 1 -- 172.21.15.45:0/2365157302 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa30800bbd0 con 0x7fa308004850 2023-11-28T12:11:50.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:50.590+0000 7fa320f99700 1 -- 172.21.15.45:0/2365157302 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa30800bd90 con 0x7fa31c0cd7c0 2023-11-28T12:11:50.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:50.590+0000 7fa321f9b700 1 --2- 172.21.15.45:0/2365157302 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa308003bc0 0x7fa308003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:11:50.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:50.591+0000 7fa32179a700 1 --2- 172.21.15.45:0/2365157302 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa308004850 0x7fa308004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:11:50.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:50.591+0000 7fa32279c700 1 --2- 172.21.15.45:0/2365157302 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa31c0cd7c0 0x7fa308005260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:11:50.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:50.591+0000 7fa321f9b700 1 -- 172.21.15.45:0/2365157302 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa31c0cd7c0 msgr2=0x7fa308005260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:11:50.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:50.591+0000 7fa321f9b700 1 --2- 172.21.15.45:0/2365157302 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa31c0cd7c0 0x7fa308005260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:50.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:50.591+0000 7fa321f9b700 1 -- 172.21.15.45:0/2365157302 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa308004850 msgr2=0x7fa308004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:11:50.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:50.591+0000 7fa321f9b700 1 --2- 172.21.15.45:0/2365157302 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa308004850 0x7fa308004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:50.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:50.591+0000 7fa321f9b700 1 -- 172.21.15.45:0/2365157302 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3080035b0 con 0x7fa308003bc0 2023-11-28T12:11:50.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:50.591+0000 7fa321f9b700 1 --2- 172.21.15.45:0/2365157302 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa308003bc0 0x7fa308003fb0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fa31800c160 tx=0x7fa308005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7c3438eca072225 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:11:50.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:50.591+0000 7fa320f99700 1 -- 172.21.15.45:0/2365157302 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa31800cca0 con 0x7fa308003bc0 2023-11-28T12:11:50.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:50.591+0000 7fa320f99700 1 -- 172.21.15.45:0/2365157302 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa31800ce00 con 0x7fa308003bc0 2023-11-28T12:11:50.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:50.591+0000 7fa320f99700 1 -- 172.21.15.45:0/2365157302 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa318005ba0 con 0x7fa308003bc0 2023-11-28T12:11:50.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:50.592+0000 7fa3241ff700 1 -- 172.21.15.45:0/2365157302 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa308003bc0 msgr2=0x7fa308003fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:11:50.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:50.592+0000 7fa3241ff700 1 --2- 172.21.15.45:0/2365157302 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa308003bc0 0x7fa308003fb0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fa31800c160 tx=0x7fa308005880 comp rx=0 tx=0).stop 2023-11-28T12:11:50.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:50.592+0000 7fa32279c700 1 -- 172.21.15.45:0/2365157302 reap_dead start 2023-11-28T12:11:50.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:50.592+0000 7fa3241ff700 1 -- 172.21.15.45:0/2365157302 shutdown_connections 2023-11-28T12:11:50.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:50.592+0000 7fa3241ff700 1 -- 172.21.15.45:0/2365157302 >> 172.21.15.45:0/2365157302 conn(0x7fa31c072600 msgr2=0x7fa31c0cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:11:50.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:50.592+0000 7fa3241ff700 1 -- 172.21.15.45:0/2365157302 shutdown_connections 2023-11-28T12:11:50.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:50.592+0000 7fa3241ff700 1 -- 172.21.15.45:0/2365157302 wait complete. 2023-11-28T12:11:50.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:50.594+0000 7fa3241ff700 1 Processor -- start 2023-11-28T12:11:50.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:50.594+0000 7fa3241ff700 1 -- start start 2023-11-28T12:11:50.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:50.595+0000 7fa3241ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa308003bc0 0x7fa31c0ca240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:11:50.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:50.595+0000 7fa3241ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa31c0cc9e0 0x7fa31c0cacc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:11:50.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:50.595+0000 7fa3241ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa31c156a90 0x7fa31c156ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:11:50.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:50.595+0000 7fa3241ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa31c0cd130 con 0x7fa31c0cc9e0 2023-11-28T12:11:50.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:50.595+0000 7fa3241ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa31c0a9a20 con 0x7fa308003bc0 2023-11-28T12:11:50.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:50.595+0000 7fa3241ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa31c0c84a0 con 0x7fa31c156a90 2023-11-28T12:11:50.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:50.595+0000 7fa32179a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa31c0cc9e0 0x7fa31c0cacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:11:50.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:50.595+0000 7fa32179a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa31c0cc9e0 0x7fa31c0cacc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52912/0 (socket says 172.21.15.45:52912) 2023-11-28T12:11:50.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:50.595+0000 7fa32179a700 1 -- 172.21.15.45:0/1425053578 learned_addr learned my addr 172.21.15.45:0/1425053578 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:11:50.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:50.595+0000 7fa32179a700 1 -- 172.21.15.45:0/1425053578 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa31c156a90 msgr2=0x7fa31c156ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:11:50.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:50.595+0000 7fa32179a700 1 --2- 172.21.15.45:0/1425053578 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa31c156a90 0x7fa31c156ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:50.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:50.595+0000 7fa32179a700 1 -- 172.21.15.45:0/1425053578 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa308003bc0 msgr2=0x7fa31c0ca240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:11:50.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:50.595+0000 7fa32179a700 1 --2- 172.21.15.45:0/1425053578 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa308003bc0 0x7fa31c0ca240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:50.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:50.595+0000 7fa32179a700 1 -- 172.21.15.45:0/1425053578 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa31c0d1300 con 0x7fa31c0cc9e0 2023-11-28T12:11:50.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:50.595+0000 7fa32179a700 1 --2- 172.21.15.45:0/1425053578 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa31c0cc9e0 0x7fa31c0cacc0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fa30c00e7b0 tx=0x7fa30c00eb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:11:50.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:50.596+0000 7fa3127fc700 1 -- 172.21.15.45:0/1425053578 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa30c0052e0 con 0x7fa31c0cc9e0 2023-11-28T12:11:50.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:50.596+0000 7fa3127fc700 1 -- 172.21.15.45:0/1425053578 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa30c005460 con 0x7fa31c0cc9e0 2023-11-28T12:11:50.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:50.596+0000 7fa3241ff700 1 -- 172.21.15.45:0/1425053578 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa31c0b5520 con 0x7fa31c0cc9e0 2023-11-28T12:11:50.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:50.596+0000 7fa3127fc700 1 -- 172.21.15.45:0/1425053578 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa30c0038c0 con 0x7fa31c0cc9e0 2023-11-28T12:11:50.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:50.596+0000 7fa3241ff700 1 -- 172.21.15.45:0/1425053578 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa31c0d15e0 con 0x7fa31c0cc9e0 2023-11-28T12:11:50.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:50.597+0000 7fa3241ff700 1 -- 172.21.15.45:0/1425053578 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa31c0745c0 con 0x7fa31c0cc9e0 2023-11-28T12:11:50.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:50.598+0000 7fa3127fc700 1 -- 172.21.15.45:0/1425053578 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fa30c01b030 con 0x7fa31c0cc9e0 2023-11-28T12:11:50.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:50.599+0000 7fa3127fc700 1 --2- 172.21.15.45:0/1425053578 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fa3000682f0 0x7fa30006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:11:50.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:50.599+0000 7fa3127fc700 1 -- 172.21.15.45:0/1425053578 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6207+0+0 (secure 0 0 0) 0x7fa30c0855b0 con 0x7fa31c0cc9e0 2023-11-28T12:11:50.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:50.599+0000 7fa321f9b700 1 --2- 172.21.15.45:0/1425053578 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fa3000682f0 0x7fa30006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:11:50.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:50.600+0000 7fa321f9b700 1 --2- 172.21.15.45:0/1425053578 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fa3000682f0 0x7fa30006a7a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa31800c160 tx=0x7fa31800a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:11:50.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:50.603+0000 7fa3127fc700 1 -- 172.21.15.45:0/1425053578 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fa30c051c90 con 0x7fa31c0cc9e0 2023-11-28T12:11:50.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:50.847+0000 7fa3241ff700 1 -- 172.21.15.45:0/1425053578 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fa31c0c85e0 con 0x7fa31c0cc9e0 2023-11-28T12:11:50.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:50.847+0000 7fa3127fc700 1 -- 172.21.15.45:0/1425053578 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7fa30c0552b0 con 0x7fa31c0cc9e0 2023-11-28T12:11:50.850 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:11:50.850 INFO:teuthology.orchestra.run.smithi045.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-28T12:11:50.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:50.850+0000 7fa3241ff700 1 -- 172.21.15.45:0/1425053578 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fa3000682f0 msgr2=0x7fa30006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:11:50.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:50.850+0000 7fa3241ff700 1 --2- 172.21.15.45:0/1425053578 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fa3000682f0 0x7fa30006a7a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa31800c160 tx=0x7fa31800a000 comp rx=0 tx=0).stop 2023-11-28T12:11:50.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:50.850+0000 7fa3241ff700 1 -- 172.21.15.45:0/1425053578 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa31c0cc9e0 msgr2=0x7fa31c0cacc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:11:50.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:50.850+0000 7fa3241ff700 1 --2- 172.21.15.45:0/1425053578 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa31c0cc9e0 0x7fa31c0cacc0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fa30c00e7b0 tx=0x7fa30c00eb70 comp rx=0 tx=0).stop 2023-11-28T12:11:50.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:50.850+0000 7fa3241ff700 1 -- 172.21.15.45:0/1425053578 shutdown_connections 2023-11-28T12:11:50.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:50.850+0000 7fa3241ff700 1 --2- 172.21.15.45:0/1425053578 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fa3000682f0 0x7fa30006a7a0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:50.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:50.850+0000 7fa3241ff700 1 --2- 172.21.15.45:0/1425053578 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa308003bc0 0x7fa31c0ca240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:50.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:50.850+0000 7fa3241ff700 1 --2- 172.21.15.45:0/1425053578 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa31c156a90 0x7fa31c156ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:50.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:50.850+0000 7fa3241ff700 1 --2- 172.21.15.45:0/1425053578 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa31c0cc9e0 0x7fa31c0cacc0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:50.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:50.850+0000 7fa3241ff700 1 -- 172.21.15.45:0/1425053578 >> 172.21.15.45:0/1425053578 conn(0x7fa31c072600 msgr2=0x7fa31c160460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:11:50.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:50.850+0000 7fa3241ff700 1 -- 172.21.15.45:0/1425053578 shutdown_connections 2023-11-28T12:11:50.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:50.850+0000 7fa3241ff700 1 -- 172.21.15.45:0/1425053578 wait complete. 2023-11-28T12:11:50.868 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=100 retry_count=0)... 2023-11-28T12:11:55.870 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T12:11:56.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:56.084+0000 7f676efff700 1 Processor -- start 2023-11-28T12:11:56.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:56.084+0000 7f676efff700 1 -- start start 2023-11-28T12:11:56.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:56.085+0000 7f676efff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6768161340 0x7f67680d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:11:56.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:56.085+0000 7f676efff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67680d1950 con 0x7f67680d2320 2023-11-28T12:11:56.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:56.085+0000 7f676efff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67680b5520 con 0x7f676815c9b0 2023-11-28T12:11:56.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:56.085+0000 7f676efff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67680b5800 con 0x7f6768161340 2023-11-28T12:11:56.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:56.085+0000 7f6767fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6768161340 0x7f67680d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:11:56.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:56.085+0000 7f676d59c700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f67680d2320 0x7f67680cd7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:54070/0 (socket says 172.21.15.45:54070) 2023-11-28T12:11:56.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:56.085+0000 7f676d59c700 1 -- 172.21.15.45:0/2861991057 learned_addr learned my addr 172.21.15.45:0/2861991057 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:11:56.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:56.086+0000 7f6767fff700 1 -- 172.21.15.45:0/2861991057 >> v1:172.21.15.152:6789/0 conn(0x7f676815c9b0 legacy=0x7f67680b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:11:56.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:56.086+0000 7f6767fff700 1 -- 172.21.15.45:0/2861991057 >> v1:172.21.15.45:6789/0 conn(0x7f67680d2320 legacy=0x7f67680cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:11:56.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:56.086+0000 7f6767fff700 1 -- 172.21.15.45:0/2861991057 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67680d1300 con 0x7f6768161340 2023-11-28T12:11:56.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:56.086+0000 7f67677fe700 1 -- 172.21.15.45:0/2861991057 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 539738099 0 0) 0x7f67680d1950 con 0x7f67680d2320 2023-11-28T12:11:56.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:56.086+0000 7f6767fff700 1 --2- 172.21.15.45:0/2861991057 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6768161340 0x7f67680d1de0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f6754009840 tx=0x7f6754009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ee3df58c929de89 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:11:56.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:56.086+0000 7f67677fe700 1 -- 172.21.15.45:0/2861991057 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6754004230 con 0x7f6768161340 2023-11-28T12:11:56.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:56.086+0000 7f67677fe700 1 -- 172.21.15.45:0/2861991057 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6754004390 con 0x7f6768161340 2023-11-28T12:11:56.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:56.086+0000 7f67677fe700 1 -- 172.21.15.45:0/2861991057 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67540036a0 con 0x7f6768161340 2023-11-28T12:11:56.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:56.087+0000 7f676efff700 1 -- 172.21.15.45:0/2861991057 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6768161340 msgr2=0x7f67680d1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:11:56.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:56.087+0000 7f676efff700 1 --2- 172.21.15.45:0/2861991057 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6768161340 0x7f67680d1de0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f6754009840 tx=0x7f6754009b50 comp rx=0 tx=0).stop 2023-11-28T12:11:56.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:56.087+0000 7f676efff700 1 -- 172.21.15.45:0/2861991057 shutdown_connections 2023-11-28T12:11:56.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:56.087+0000 7f676efff700 1 --2- 172.21.15.45:0/2861991057 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6768161340 0x7f67680d1de0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:56.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:56.087+0000 7f676efff700 1 -- 172.21.15.45:0/2861991057 >> 172.21.15.45:0/2861991057 conn(0x7f6768072600 msgr2=0x7f67680cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:11:56.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:56.087+0000 7f676efff700 1 -- 172.21.15.45:0/2861991057 shutdown_connections 2023-11-28T12:11:56.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:56.087+0000 7f676efff700 1 -- 172.21.15.45:0/2861991057 wait complete. 2023-11-28T12:11:56.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:56.089+0000 7f676efff700 1 Processor -- start 2023-11-28T12:11:56.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:56.089+0000 7f676efff700 1 -- start start 2023-11-28T12:11:56.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:56.090+0000 7f676efff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f67680d2320 0x7f67681e6f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:11:56.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:56.090+0000 7f676efff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f676815c9b0 0x7f67681511a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:11:56.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:56.090+0000 7f676efff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6768161340 0x7f676815f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:11:56.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:56.090+0000 7f676efff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f676815fa60 con 0x7f6768161340 2023-11-28T12:11:56.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:56.090+0000 7f676efff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67681e78b0 con 0x7f676815c9b0 2023-11-28T12:11:56.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:56.090+0000 7f676efff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67681e7b90 con 0x7f67680d2320 2023-11-28T12:11:56.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:56.090+0000 7f676d59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6768161340 0x7f676815f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:11:56.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:56.090+0000 7f676cd9b700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f67680d2320 0x7f67681e6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:11:56.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:56.090+0000 7f676d59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6768161340 0x7f676815f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44950/0 (socket says 172.21.15.45:44950) 2023-11-28T12:11:56.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:56.090+0000 7f676d59c700 1 -- 172.21.15.45:0/3552160334 learned_addr learned my addr 172.21.15.45:0/3552160334 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:11:56.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:56.090+0000 7f6767fff700 1 --2- 172.21.15.45:0/3552160334 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f676815c9b0 0x7f67681511a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:11:56.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:56.091+0000 7f676d59c700 1 -- 172.21.15.45:0/3552160334 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f67680d2320 msgr2=0x7f67681e6f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:11:56.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:56.091+0000 7f676d59c700 1 --2- 172.21.15.45:0/3552160334 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f67680d2320 0x7f67681e6f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:56.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:56.091+0000 7f676d59c700 1 -- 172.21.15.45:0/3552160334 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f676815c9b0 msgr2=0x7f67681511a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:11:56.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:56.091+0000 7f676d59c700 1 --2- 172.21.15.45:0/3552160334 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f676815c9b0 0x7f67681511a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:56.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:56.091+0000 7f676d59c700 1 -- 172.21.15.45:0/3552160334 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67540094a0 con 0x7f6768161340 2023-11-28T12:11:56.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:56.091+0000 7f676d59c700 1 --2- 172.21.15.45:0/3552160334 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6768161340 0x7f676815f230 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f676000cb30 tx=0x7f676000ce40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:11:56.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:56.091+0000 7f67657fa700 1 -- 172.21.15.45:0/3552160334 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f676000a9e0 con 0x7f6768161340 2023-11-28T12:11:56.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:56.091+0000 7f67657fa700 1 -- 172.21.15.45:0/3552160334 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f676000ab80 con 0x7f6768161340 2023-11-28T12:11:56.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:56.091+0000 7f67657fa700 1 -- 172.21.15.45:0/3552160334 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67600070d0 con 0x7f6768161340 2023-11-28T12:11:56.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:56.091+0000 7f676efff700 1 -- 172.21.15.45:0/3552160334 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f676815cd80 con 0x7f6768161340 2023-11-28T12:11:56.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:56.091+0000 7f676efff700 1 -- 172.21.15.45:0/3552160334 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67680d15e0 con 0x7f6768161340 2023-11-28T12:11:56.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:56.092+0000 7f676efff700 1 -- 172.21.15.45:0/3552160334 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f676815cf10 con 0x7f6768161340 2023-11-28T12:11:56.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:56.093+0000 7f67657fa700 1 -- 172.21.15.45:0/3552160334 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f6760010070 con 0x7f6768161340 2023-11-28T12:11:56.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:56.095+0000 7f67657fa700 1 --2- 172.21.15.45:0/3552160334 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f674c0682f0 0x7f674c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:11:56.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:56.096+0000 7f67657fa700 1 -- 172.21.15.45:0/3552160334 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f67600856a0 con 0x7f6768161340 2023-11-28T12:11:56.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:56.096+0000 7f676cd9b700 1 --2- 172.21.15.45:0/3552160334 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f674c0682f0 0x7f674c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:11:56.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:56.097+0000 7f676cd9b700 1 --2- 172.21.15.45:0/3552160334 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f674c0682f0 0x7f674c06a7a0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f675c007fd0 tx=0x7f675c007ec0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:11:56.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:56.100+0000 7f67657fa700 1 -- 172.21.15.45:0/3552160334 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f6760051d80 con 0x7f6768161340 2023-11-28T12:11:56.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:56.345+0000 7f676efff700 1 -- 172.21.15.45:0/3552160334 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f67680745c0 con 0x7f6768161340 2023-11-28T12:11:56.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:56.346+0000 7f67657fa700 1 -- 172.21.15.45:0/3552160334 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7f6760001ba0 con 0x7f6768161340 2023-11-28T12:11:56.346 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:11:56.347 INFO:teuthology.orchestra.run.smithi045.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-28T12:11:56.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:56.348+0000 7f676efff700 1 -- 172.21.15.45:0/3552160334 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f674c0682f0 msgr2=0x7f674c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:11:56.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:56.348+0000 7f676efff700 1 --2- 172.21.15.45:0/3552160334 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f674c0682f0 0x7f674c06a7a0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f675c007fd0 tx=0x7f675c007ec0 comp rx=0 tx=0).stop 2023-11-28T12:11:56.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:56.348+0000 7f676efff700 1 -- 172.21.15.45:0/3552160334 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6768161340 msgr2=0x7f676815f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:11:56.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:56.348+0000 7f676efff700 1 --2- 172.21.15.45:0/3552160334 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6768161340 0x7f676815f230 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f676000cb30 tx=0x7f676000ce40 comp rx=0 tx=0).stop 2023-11-28T12:11:56.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:56.348+0000 7f676efff700 1 -- 172.21.15.45:0/3552160334 shutdown_connections 2023-11-28T12:11:56.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:56.348+0000 7f676efff700 1 --2- 172.21.15.45:0/3552160334 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f674c0682f0 0x7f674c06a7a0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:56.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:56.348+0000 7f676efff700 1 --2- 172.21.15.45:0/3552160334 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6768161340 0x7f676815f230 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:56.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:56.348+0000 7f676efff700 1 --2- 172.21.15.45:0/3552160334 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f67680d2320 0x7f67681e6f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:56.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:56.348+0000 7f676efff700 1 --2- 172.21.15.45:0/3552160334 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f676815c9b0 0x7f67681511a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:11:56.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:56.348+0000 7f676efff700 1 -- 172.21.15.45:0/3552160334 >> 172.21.15.45:0/3552160334 conn(0x7f6768072600 msgr2=0x7f676815a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:11:56.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:56.348+0000 7f676efff700 1 -- 172.21.15.45:0/3552160334 shutdown_connections 2023-11-28T12:11:56.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:11:56.348+0000 7f676efff700 1 -- 172.21.15.45:0/3552160334 wait complete. 2023-11-28T12:11:56.366 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=100 retry_count=0)... 2023-11-28T12:12:01.367 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T12:12:01.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:01.579+0000 7ffa443ff700 1 Processor -- start 2023-11-28T12:12:01.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:01.580+0000 7ffa443ff700 1 -- start start 2023-11-28T12:12:01.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:01.581+0000 7ffa443ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ffa3c15c9b0 0x7ffa3c0b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:01.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:01.581+0000 7ffa443ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ffa3c0cd7c0 0x7ffa3c0cdc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:01.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:01.581+0000 7ffa443ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa3c0ce160 con 0x7ffa3c161340 2023-11-28T12:12:01.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:01.581+0000 7ffa443ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa3c0b5800 con 0x7ffa3c0cd7c0 2023-11-28T12:12:01.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:01.581+0000 7ffa443ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa3c0d1950 con 0x7ffa3c15c9b0 2023-11-28T12:12:01.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:01.581+0000 7ffa4299c700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ffa3c0cd7c0 0x7ffa3c0cdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:01.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:01.581+0000 7ffa4219b700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ffa3c15c9b0 0x7ffa3c0b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:01.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:01.581+0000 7ffa4299c700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ffa3c0cd7c0 0x7ffa3c0cdc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.45:40204/0 (socket says 172.21.15.45:40204) 2023-11-28T12:12:01.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:01.581+0000 7ffa4219b700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ffa3c15c9b0 0x7ffa3c0b4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.45:49470/0 (socket says 172.21.15.45:49470) 2023-11-28T12:12:01.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:01.581+0000 7ffa4299c700 1 -- 172.21.15.45:0/3004883838 learned_addr learned my addr 172.21.15.45:0/3004883838 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:12:01.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:01.581+0000 7ffa4199a700 1 --1- 172.21.15.45:0/3004883838 >> v1:172.21.15.152:6789/0 conn(0x7ffa3c161340 0x7ffa3c0d1de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.45:58520/0 (socket says 172.21.15.45:58520) 2023-11-28T12:12:01.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:01.582+0000 7ffa4299c700 1 -- 172.21.15.45:0/3004883838 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ffa3c15c9b0 msgr2=0x7ffa3c0b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:12:01.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:01.582+0000 7ffa4299c700 1 --2- 172.21.15.45:0/3004883838 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ffa3c15c9b0 0x7ffa3c0b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:01.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:01.582+0000 7ffa4299c700 1 -- 172.21.15.45:0/3004883838 >> v1:172.21.15.152:6789/0 conn(0x7ffa3c161340 legacy=0x7ffa3c0d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:01.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:01.582+0000 7ffa4299c700 1 -- 172.21.15.45:0/3004883838 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa3c0d24f0 con 0x7ffa3c0cd7c0 2023-11-28T12:12:01.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:01.582+0000 7ffa41199700 1 -- 172.21.15.45:0/3004883838 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3997648859 0 0) 0x7ffa3c0ce160 con 0x7ffa3c161340 2023-11-28T12:12:01.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:01.582+0000 7ffa4299c700 1 --2- 172.21.15.45:0/3004883838 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa3c0cd7c0 0x7ffa3c0cdc20 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ffa34009e50 tx=0x7ffa3400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5fbf2df281c9940 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:01.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:01.582+0000 7ffa41199700 1 -- 172.21.15.45:0/3004883838 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa3400e070 con 0x7ffa3c0cd7c0 2023-11-28T12:12:01.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:01.582+0000 7ffa41199700 1 -- 172.21.15.45:0/3004883838 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa3400b910 con 0x7ffa3c0cd7c0 2023-11-28T12:12:01.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:01.582+0000 7ffa41199700 1 -- 172.21.15.45:0/3004883838 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa3400bcc0 con 0x7ffa3c0cd7c0 2023-11-28T12:12:01.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:01.583+0000 7ffa443ff700 1 -- 172.21.15.45:0/3004883838 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa3c0cd7c0 msgr2=0x7ffa3c0cdc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:01.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:01.583+0000 7ffa443ff700 1 --2- 172.21.15.45:0/3004883838 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa3c0cd7c0 0x7ffa3c0cdc20 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ffa34009e50 tx=0x7ffa3400b330 comp rx=0 tx=0).stop 2023-11-28T12:12:01.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:01.583+0000 7ffa443ff700 1 -- 172.21.15.45:0/3004883838 shutdown_connections 2023-11-28T12:12:01.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:01.583+0000 7ffa443ff700 1 --2- 172.21.15.45:0/3004883838 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ffa3c15c9b0 0x7ffa3c0b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:01.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:01.583+0000 7ffa443ff700 1 --2- 172.21.15.45:0/3004883838 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa3c0cd7c0 0x7ffa3c0cdc20 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:01.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:01.583+0000 7ffa443ff700 1 -- 172.21.15.45:0/3004883838 >> 172.21.15.45:0/3004883838 conn(0x7ffa3c072600 msgr2=0x7ffa3c0cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:01.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:01.583+0000 7ffa443ff700 1 -- 172.21.15.45:0/3004883838 shutdown_connections 2023-11-28T12:12:01.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:01.583+0000 7ffa443ff700 1 -- 172.21.15.45:0/3004883838 wait complete. 2023-11-28T12:12:01.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:01.585+0000 7ffa443ff700 1 Processor -- start 2023-11-28T12:12:01.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:01.585+0000 7ffa443ff700 1 -- start start 2023-11-28T12:12:01.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:01.586+0000 7ffa443ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ffa3c0cd7c0 0x7ffa3c157200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:01.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:01.586+0000 7ffa443ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa3c15c9b0 0x7ffa3c157740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:01.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:01.586+0000 7ffa443ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa3c161340 0x7ffa3c0c6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:01.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:01.586+0000 7ffa443ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa3c15d3d0 con 0x7ffa3c161340 2023-11-28T12:12:01.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:01.586+0000 7ffa443ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa3c15d6b0 con 0x7ffa3c15c9b0 2023-11-28T12:12:01.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:01.586+0000 7ffa443ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa3c0c9ab0 con 0x7ffa3c0cd7c0 2023-11-28T12:12:01.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:01.586+0000 7ffa4299c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa3c161340 0x7ffa3c0c6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:01.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:01.586+0000 7ffa4299c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa3c161340 0x7ffa3c0c6ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44960/0 (socket says 172.21.15.45:44960) 2023-11-28T12:12:01.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:01.586+0000 7ffa4299c700 1 -- 172.21.15.45:0/604303564 learned_addr learned my addr 172.21.15.45:0/604303564 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:12:01.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:01.586+0000 7ffa4199a700 1 --2- 172.21.15.45:0/604303564 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa3c15c9b0 0x7ffa3c157740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:01.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:01.586+0000 7ffa4219b700 1 --2- 172.21.15.45:0/604303564 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ffa3c0cd7c0 0x7ffa3c157200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:01.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:01.587+0000 7ffa4299c700 1 -- 172.21.15.45:0/604303564 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ffa3c0cd7c0 msgr2=0x7ffa3c157200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:01.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:01.587+0000 7ffa4299c700 1 --2- 172.21.15.45:0/604303564 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ffa3c0cd7c0 0x7ffa3c157200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:01.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:01.587+0000 7ffa4299c700 1 -- 172.21.15.45:0/604303564 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa3c15c9b0 msgr2=0x7ffa3c157740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:01.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:01.587+0000 7ffa4299c700 1 --2- 172.21.15.45:0/604303564 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa3c15c9b0 0x7ffa3c157740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:01.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:01.587+0000 7ffa4299c700 1 -- 172.21.15.45:0/604303564 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa34009b30 con 0x7ffa3c161340 2023-11-28T12:12:01.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:01.587+0000 7ffa4299c700 1 --2- 172.21.15.45:0/604303564 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa3c161340 0x7ffa3c0c6ca0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7ffa3400b680 tx=0x7ffa34004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:01.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:01.587+0000 7ffa32ffd700 1 -- 172.21.15.45:0/604303564 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa340048b0 con 0x7ffa3c161340 2023-11-28T12:12:01.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:01.587+0000 7ffa32ffd700 1 -- 172.21.15.45:0/604303564 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa340099b0 con 0x7ffa3c161340 2023-11-28T12:12:01.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:01.587+0000 7ffa443ff700 1 -- 172.21.15.45:0/604303564 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa3c0d1300 con 0x7ffa3c161340 2023-11-28T12:12:01.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:01.587+0000 7ffa32ffd700 1 -- 172.21.15.45:0/604303564 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa3401b670 con 0x7ffa3c161340 2023-11-28T12:12:01.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:01.587+0000 7ffa443ff700 1 -- 172.21.15.45:0/604303564 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa3c0b5520 con 0x7ffa3c161340 2023-11-28T12:12:01.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:01.589+0000 7ffa443ff700 1 -- 172.21.15.45:0/604303564 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa3c0d15e0 con 0x7ffa3c161340 2023-11-28T12:12:01.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:01.589+0000 7ffa32ffd700 1 -- 172.21.15.45:0/604303564 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7ffa3402b070 con 0x7ffa3c161340 2023-11-28T12:12:01.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:01.590+0000 7ffa32ffd700 1 --2- 172.21.15.45:0/604303564 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7ffa200682f0 0x7ffa2006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:01.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:01.590+0000 7ffa32ffd700 1 -- 172.21.15.45:0/604303564 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6207+0+0 (secure 0 0 0) 0x7ffa34087480 con 0x7ffa3c161340 2023-11-28T12:12:01.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:01.591+0000 7ffa4219b700 1 --2- 172.21.15.45:0/604303564 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7ffa200682f0 0x7ffa2006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:01.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:01.592+0000 7ffa4219b700 1 --2- 172.21.15.45:0/604303564 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7ffa200682f0 0x7ffa2006a7a0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7ffa38009b40 tx=0x7ffa38009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:01.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:01.595+0000 7ffa32ffd700 1 -- 172.21.15.45:0/604303564 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7ffa34053bd0 con 0x7ffa3c161340 2023-11-28T12:12:01.786 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T12:12:01.793 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T12:12:01.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:01.852+0000 7ffa443ff700 1 -- 172.21.15.45:0/604303564 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7ffa3c15d820 con 0x7ffa3c161340 2023-11-28T12:12:01.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:01.852+0000 7ffa32ffd700 1 -- 172.21.15.45:0/604303564 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7ffa340571f0 con 0x7ffa3c161340 2023-11-28T12:12:01.854 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:12:01.854 INFO:teuthology.orchestra.run.smithi045.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-28T12:12:01.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:01.855+0000 7ffa443ff700 1 -- 172.21.15.45:0/604303564 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7ffa200682f0 msgr2=0x7ffa2006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:01.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:01.855+0000 7ffa443ff700 1 --2- 172.21.15.45:0/604303564 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7ffa200682f0 0x7ffa2006a7a0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7ffa38009b40 tx=0x7ffa38009210 comp rx=0 tx=0).stop 2023-11-28T12:12:01.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:01.855+0000 7ffa443ff700 1 -- 172.21.15.45:0/604303564 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa3c161340 msgr2=0x7ffa3c0c6ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:01.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:01.855+0000 7ffa443ff700 1 --2- 172.21.15.45:0/604303564 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa3c161340 0x7ffa3c0c6ca0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7ffa3400b680 tx=0x7ffa34004ad0 comp rx=0 tx=0).stop 2023-11-28T12:12:01.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:01.855+0000 7ffa443ff700 1 -- 172.21.15.45:0/604303564 shutdown_connections 2023-11-28T12:12:01.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:01.855+0000 7ffa443ff700 1 --2- 172.21.15.45:0/604303564 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7ffa200682f0 0x7ffa2006a7a0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:01.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:01.855+0000 7ffa443ff700 1 --2- 172.21.15.45:0/604303564 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa3c161340 0x7ffa3c0c6ca0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:01.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:01.855+0000 7ffa443ff700 1 --2- 172.21.15.45:0/604303564 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ffa3c0cd7c0 0x7ffa3c157200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:01.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:01.855+0000 7ffa443ff700 1 --2- 172.21.15.45:0/604303564 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa3c15c9b0 0x7ffa3c157740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:01.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:01.855+0000 7ffa443ff700 1 -- 172.21.15.45:0/604303564 >> 172.21.15.45:0/604303564 conn(0x7ffa3c072600 msgr2=0x7ffa3c160610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:01.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:01.855+0000 7ffa443ff700 1 -- 172.21.15.45:0/604303564 shutdown_connections 2023-11-28T12:12:01.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:01.855+0000 7ffa443ff700 1 -- 172.21.15.45:0/604303564 wait complete. 2023-11-28T12:12:01.875 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=100 retry_count=0)... 2023-11-28T12:12:06.876 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T12:12:07.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.092+0000 7f5f155ff700 1 Processor -- start 2023-11-28T12:12:07.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.092+0000 7f5f155ff700 1 -- start start 2023-11-28T12:12:07.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.093+0000 7f5f155ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5f10070c50 0x7f5f100b0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:07.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.093+0000 7f5f155ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f100b1010 con 0x7f5f100b0bb0 2023-11-28T12:12:07.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.093+0000 7f5f155ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f1015e1a0 con 0x7f5f10158200 2023-11-28T12:12:07.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.093+0000 7f5f155ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f1015f070 con 0x7f5f10070c50 2023-11-28T12:12:07.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.094+0000 7f5f0f7fe700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f5f100b0bb0 0x7f5f1015add0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:34742/0 (socket says 172.21.15.45:34742) 2023-11-28T12:12:07.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.094+0000 7f5f0f7fe700 1 -- 172.21.15.45:0/219676815 learned_addr learned my addr 172.21.15.45:0/219676815 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:12:07.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.094+0000 7f5f07fff700 1 --2- 172.21.15.45:0/219676815 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5f10070c50 0x7f5f100b0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:07.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.094+0000 7f5f0e7fc700 1 -- 172.21.15.45:0/219676815 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2918477166 0 0) 0x7f5f100b1010 con 0x7f5f100b0bb0 2023-11-28T12:12:07.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.094+0000 7f5f0e7fc700 1 -- 172.21.15.45:0/219676815 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5efc0035b0 con 0x7f5f100b0bb0 2023-11-28T12:12:07.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.094+0000 7f5f0e7fc700 1 -- 172.21.15.45:0/219676815 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 947895542 0 0) 0x7f5f1015e1a0 con 0x7f5f10158200 2023-11-28T12:12:07.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.094+0000 7f5f0e7fc700 1 -- 172.21.15.45:0/219676815 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f100b1010 con 0x7f5f10158200 2023-11-28T12:12:07.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.094+0000 7f5f07fff700 1 -- 172.21.15.45:0/219676815 >> v1:172.21.15.152:6789/0 conn(0x7f5f10158200 legacy=0x7f5f100caa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:07.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.094+0000 7f5f07fff700 1 -- 172.21.15.45:0/219676815 >> v1:172.21.15.45:6789/0 conn(0x7f5f100b0bb0 legacy=0x7f5f1015add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:07.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.094+0000 7f5f07fff700 1 -- 172.21.15.45:0/219676815 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f100cb180 con 0x7f5f10070c50 2023-11-28T12:12:07.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.095+0000 7f5f07fff700 1 --2- 172.21.15.45:0/219676815 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5f10070c50 0x7f5f100b0670 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5ef8009870 tx=0x7f5ef8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da1ea94fbd84515a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:07.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.095+0000 7f5f0e7fc700 1 -- 172.21.15.45:0/219676815 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef8011830 con 0x7f5f10070c50 2023-11-28T12:12:07.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.095+0000 7f5f0e7fc700 1 -- 172.21.15.45:0/219676815 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ef8011990 con 0x7f5f10070c50 2023-11-28T12:12:07.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.095+0000 7f5f0e7fc700 1 -- 172.21.15.45:0/219676815 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef8011d20 con 0x7f5f10070c50 2023-11-28T12:12:07.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.096+0000 7f5f155ff700 1 -- 172.21.15.45:0/219676815 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5f10070c50 msgr2=0x7f5f100b0670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:07.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.096+0000 7f5f155ff700 1 --2- 172.21.15.45:0/219676815 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5f10070c50 0x7f5f100b0670 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5ef8009870 tx=0x7f5ef8009b80 comp rx=0 tx=0).stop 2023-11-28T12:12:07.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.096+0000 7f5f155ff700 1 -- 172.21.15.45:0/219676815 shutdown_connections 2023-11-28T12:12:07.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.096+0000 7f5f155ff700 1 --2- 172.21.15.45:0/219676815 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5f10070c50 0x7f5f100b0670 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:07.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.096+0000 7f5f155ff700 1 -- 172.21.15.45:0/219676815 >> 172.21.15.45:0/219676815 conn(0x7f5f100cb670 msgr2=0x7f5f100cba70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:07.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.096+0000 7f5f155ff700 1 -- 172.21.15.45:0/219676815 shutdown_connections 2023-11-28T12:12:07.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.096+0000 7f5f155ff700 1 -- 172.21.15.45:0/219676815 wait complete. 2023-11-28T12:12:07.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.097+0000 7f5f155ff700 1 Processor -- start 2023-11-28T12:12:07.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.098+0000 7f5f155ff700 1 -- start start 2023-11-28T12:12:07.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.099+0000 7f5f155ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5f10070c50 0x7f5f100b4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:07.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.099+0000 7f5f155ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f100b0bb0 0x7f5f101f3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:07.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.099+0000 7f5f155ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5f10158200 0x7f5f100cd410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:07.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.099+0000 7f5f155ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f100b4a30 con 0x7f5f100b0bb0 2023-11-28T12:12:07.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.099+0000 7f5f155ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f100b4850 con 0x7f5f10158200 2023-11-28T12:12:07.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.099+0000 7f5f155ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f1015c820 con 0x7f5f10070c50 2023-11-28T12:12:07.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.099+0000 7f5f07fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f100b0bb0 0x7f5f101f3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:07.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.099+0000 7f5f07fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f100b0bb0 0x7f5f101f3710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47390/0 (socket says 172.21.15.45:47390) 2023-11-28T12:12:07.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.099+0000 7f5f07fff700 1 -- 172.21.15.45:0/2144003010 learned_addr learned my addr 172.21.15.45:0/2144003010 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:12:07.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.099+0000 7f5f0effd700 1 --2- 172.21.15.45:0/2144003010 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5f10070c50 0x7f5f100b4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:07.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.099+0000 7f5f0f7fe700 1 --2- 172.21.15.45:0/2144003010 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5f10158200 0x7f5f100cd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:07.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.099+0000 7f5f07fff700 1 -- 172.21.15.45:0/2144003010 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5f10070c50 msgr2=0x7f5f100b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:07.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.099+0000 7f5f07fff700 1 --2- 172.21.15.45:0/2144003010 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5f10070c50 0x7f5f100b4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:07.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.099+0000 7f5f07fff700 1 -- 172.21.15.45:0/2144003010 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5f10158200 msgr2=0x7f5f100cd410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:07.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.099+0000 7f5f07fff700 1 --2- 172.21.15.45:0/2144003010 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5f10158200 0x7f5f100cd410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:07.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.099+0000 7f5f07fff700 1 -- 172.21.15.45:0/2144003010 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ef80094a0 con 0x7f5f100b0bb0 2023-11-28T12:12:07.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.100+0000 7f5f07fff700 1 --2- 172.21.15.45:0/2144003010 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f100b0bb0 0x7f5f101f3710 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f5ef80090b0 tx=0x7f5ef8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:07.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.100+0000 7f5f077fe700 1 -- 172.21.15.45:0/2144003010 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef801a760 con 0x7f5f100b0bb0 2023-11-28T12:12:07.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.100+0000 7f5f077fe700 1 -- 172.21.15.45:0/2144003010 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ef801a8c0 con 0x7f5f100b0bb0 2023-11-28T12:12:07.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.100+0000 7f5f155ff700 1 -- 172.21.15.45:0/2144003010 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f101585d0 con 0x7f5f100b0bb0 2023-11-28T12:12:07.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.100+0000 7f5f077fe700 1 -- 172.21.15.45:0/2144003010 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef801ac30 con 0x7f5f100b0bb0 2023-11-28T12:12:07.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.100+0000 7f5f155ff700 1 -- 172.21.15.45:0/2144003010 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f100710f0 con 0x7f5f100b0bb0 2023-11-28T12:12:07.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.101+0000 7f5f155ff700 1 -- 172.21.15.45:0/2144003010 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f1015e3f0 con 0x7f5f100b0bb0 2023-11-28T12:12:07.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.102+0000 7f5f077fe700 1 -- 172.21.15.45:0/2144003010 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f5ef802b030 con 0x7f5f100b0bb0 2023-11-28T12:12:07.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.103+0000 7f5f077fe700 1 --2- 172.21.15.45:0/2144003010 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5ef00682f0 0x7f5ef006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:07.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.103+0000 7f5f077fe700 1 -- 172.21.15.45:0/2144003010 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f5ef8086ed0 con 0x7f5f100b0bb0 2023-11-28T12:12:07.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.104+0000 7f5f0effd700 1 --2- 172.21.15.45:0/2144003010 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5ef00682f0 0x7f5ef006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:07.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.104+0000 7f5f0effd700 1 --2- 172.21.15.45:0/2144003010 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5ef00682f0 0x7f5ef006a7a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f5f000011e0 tx=0x7f5f00009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:07.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.107+0000 7f5f077fe700 1 -- 172.21.15.45:0/2144003010 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f5ef8053660 con 0x7f5f100b0bb0 2023-11-28T12:12:07.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.360+0000 7f5f155ff700 1 -- 172.21.15.45:0/2144003010 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f5f1006fd60 con 0x7f5f100b0bb0 2023-11-28T12:12:07.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.360+0000 7f5f077fe700 1 -- 172.21.15.45:0/2144003010 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7f5ef8029080 con 0x7f5f100b0bb0 2023-11-28T12:12:07.362 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:12:07.362 INFO:teuthology.orchestra.run.smithi045.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2023-11-28T12:12:07.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.363+0000 7f5f155ff700 1 -- 172.21.15.45:0/2144003010 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5ef00682f0 msgr2=0x7f5ef006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:07.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.363+0000 7f5f155ff700 1 --2- 172.21.15.45:0/2144003010 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5ef00682f0 0x7f5ef006a7a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f5f000011e0 tx=0x7f5f00009040 comp rx=0 tx=0).stop 2023-11-28T12:12:07.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.363+0000 7f5f155ff700 1 -- 172.21.15.45:0/2144003010 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f100b0bb0 msgr2=0x7f5f101f3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:07.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.363+0000 7f5f155ff700 1 --2- 172.21.15.45:0/2144003010 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f100b0bb0 0x7f5f101f3710 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f5ef80090b0 tx=0x7f5ef8004750 comp rx=0 tx=0).stop 2023-11-28T12:12:07.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.363+0000 7f5f155ff700 1 -- 172.21.15.45:0/2144003010 shutdown_connections 2023-11-28T12:12:07.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.363+0000 7f5f155ff700 1 --2- 172.21.15.45:0/2144003010 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5ef00682f0 0x7f5ef006a7a0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:07.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.363+0000 7f5f155ff700 1 --2- 172.21.15.45:0/2144003010 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5f10158200 0x7f5f100cd410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:07.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.363+0000 7f5f155ff700 1 --2- 172.21.15.45:0/2144003010 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5f10070c50 0x7f5f100b4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:07.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.363+0000 7f5f155ff700 1 --2- 172.21.15.45:0/2144003010 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f100b0bb0 0x7f5f101f3710 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:07.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.363+0000 7f5f155ff700 1 -- 172.21.15.45:0/2144003010 >> 172.21.15.45:0/2144003010 conn(0x7f5f100cb670 msgr2=0x7f5f100ce390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:07.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.363+0000 7f5f155ff700 1 -- 172.21.15.45:0/2144003010 shutdown_connections 2023-11-28T12:12:07.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.363+0000 7f5f155ff700 1 -- 172.21.15.45:0/2144003010 wait complete. 2023-11-28T12:12:07.383 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-28T12:12:07.383 DEBUG:teuthology.orchestra.run.smithi045:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T12:12:07.482 DEBUG:teuthology.orchestra.run.smithi152:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T12:12:07.582 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-28T12:12:07.582 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T12:12:07.582 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T12:12:07.631 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T12:12:07.631 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T12:12:07.682 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T12:12:07.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.921+0000 7f4f1ebff700 1 Processor -- start 2023-11-28T12:12:07.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.921+0000 7f4f1ebff700 1 -- start start 2023-11-28T12:12:07.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.922+0000 7f4f1ebff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4f1815cd30 0x7f4f18161150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:07.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.922+0000 7f4f1ebff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4f1806a980 0x7f4f180d0210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:07.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.922+0000 7f4f1ebff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f180d0840 con 0x7f4f180cfda0 2023-11-28T12:12:07.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.922+0000 7f4f1ebff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f180d0b20 con 0x7f4f1806a980 2023-11-28T12:12:07.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.922+0000 7f4f1ebff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f18160670 con 0x7f4f1815cd30 2023-11-28T12:12:07.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.923+0000 7f4f1d19c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4f1806a980 0x7f4f180d0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:07.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.923+0000 7f4f1d19c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4f1806a980 0x7f4f180d0210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47398/0 (socket says 172.21.15.45:47398) 2023-11-28T12:12:07.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.923+0000 7f4f1d19c700 1 -- 172.21.15.45:0/3674965804 learned_addr learned my addr 172.21.15.45:0/3674965804 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:12:07.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.923+0000 7f4f1c99b700 1 --2- 172.21.15.45:0/3674965804 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4f1815cd30 0x7f4f18161150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:07.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.923+0000 7f4f1d19c700 1 -- 172.21.15.45:0/3674965804 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4f1815cd30 msgr2=0x7f4f18161150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:12:07.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.923+0000 7f4f1d19c700 1 --2- 172.21.15.45:0/3674965804 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4f1815cd30 0x7f4f18161150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:07.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.923+0000 7f4f1d19c700 1 -- 172.21.15.45:0/3674965804 >> v1:172.21.15.152:6789/0 conn(0x7f4f180cfda0 legacy=0x7f4f1806a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:07.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.923+0000 7f4f1d19c700 1 -- 172.21.15.45:0/3674965804 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f18160950 con 0x7f4f1806a980 2023-11-28T12:12:07.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.923+0000 7f4f1d19c700 1 --2- 172.21.15.45:0/3674965804 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f1806a980 0x7f4f180d0210 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f4f10009e50 tx=0x7f4f1000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da5f9c970cc7f922 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:07.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.924+0000 7f4f177fe700 1 -- 172.21.15.45:0/3674965804 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f1000e070 con 0x7f4f1806a980 2023-11-28T12:12:07.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.924+0000 7f4f177fe700 1 -- 172.21.15.45:0/3674965804 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f1000b9c0 con 0x7f4f1806a980 2023-11-28T12:12:07.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.924+0000 7f4f177fe700 1 -- 172.21.15.45:0/3674965804 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f1000bd70 con 0x7f4f1806a980 2023-11-28T12:12:07.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.924+0000 7f4f1ebff700 1 -- 172.21.15.45:0/3674965804 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f1806a980 msgr2=0x7f4f180d0210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:07.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.924+0000 7f4f1ebff700 1 --2- 172.21.15.45:0/3674965804 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f1806a980 0x7f4f180d0210 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f4f10009e50 tx=0x7f4f1000b330 comp rx=0 tx=0).stop 2023-11-28T12:12:07.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.924+0000 7f4f1ebff700 1 -- 172.21.15.45:0/3674965804 shutdown_connections 2023-11-28T12:12:07.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.924+0000 7f4f1ebff700 1 --2- 172.21.15.45:0/3674965804 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4f1815cd30 0x7f4f18161150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:07.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.924+0000 7f4f1ebff700 1 --2- 172.21.15.45:0/3674965804 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f1806a980 0x7f4f180d0210 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:07.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.924+0000 7f4f1ebff700 1 -- 172.21.15.45:0/3674965804 >> 172.21.15.45:0/3674965804 conn(0x7f4f1806b380 msgr2=0x7f4f1806b780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:07.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.924+0000 7f4f1ebff700 1 -- 172.21.15.45:0/3674965804 shutdown_connections 2023-11-28T12:12:07.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.924+0000 7f4f1ebff700 1 -- 172.21.15.45:0/3674965804 wait complete. 2023-11-28T12:12:07.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.926+0000 7f4f1ebff700 1 Processor -- start 2023-11-28T12:12:07.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.926+0000 7f4f1ebff700 1 -- start start 2023-11-28T12:12:07.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.927+0000 7f4f1ebff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4f1806a980 0x7f4f1815a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:07.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.927+0000 7f4f1ebff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f180cfda0 0x7f4f180c7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:07.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.927+0000 7f4f1ebff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f1815cd30 0x7f4f180b3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:07.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.927+0000 7f4f1ebff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f180c3970 con 0x7f4f1815cd30 2023-11-28T12:12:07.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.927+0000 7f4f1ebff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f180c3bc0 con 0x7f4f180cfda0 2023-11-28T12:12:07.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.927+0000 7f4f1ebff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f180c3ea0 con 0x7f4f1806a980 2023-11-28T12:12:07.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.927+0000 7f4f1d19c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f1815cd30 0x7f4f180b3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:07.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.927+0000 7f4f1d19c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f1815cd30 0x7f4f180b3700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47400/0 (socket says 172.21.15.45:47400) 2023-11-28T12:12:07.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.927+0000 7f4f1d19c700 1 -- 172.21.15.45:0/822421024 learned_addr learned my addr 172.21.15.45:0/822421024 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:12:07.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.927+0000 7f4f1c99b700 1 --2- 172.21.15.45:0/822421024 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4f1806a980 0x7f4f1815a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:07.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.927+0000 7f4f17fff700 1 --2- 172.21.15.45:0/822421024 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f180cfda0 0x7f4f180c7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:07.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.928+0000 7f4f1d19c700 1 -- 172.21.15.45:0/822421024 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4f1806a980 msgr2=0x7f4f1815a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:07.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.928+0000 7f4f1d19c700 1 --2- 172.21.15.45:0/822421024 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4f1806a980 0x7f4f1815a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:07.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.928+0000 7f4f1d19c700 1 -- 172.21.15.45:0/822421024 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f180cfda0 msgr2=0x7f4f180c7ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:07.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.928+0000 7f4f1d19c700 1 --2- 172.21.15.45:0/822421024 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f180cfda0 0x7f4f180c7ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:07.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.928+0000 7f4f1d19c700 1 -- 172.21.15.45:0/822421024 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f10009b30 con 0x7f4f1815cd30 2023-11-28T12:12:07.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.928+0000 7f4f1c99b700 1 --2- 172.21.15.45:0/822421024 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4f1806a980 0x7f4f1815a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:12:07.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.928+0000 7f4f1d19c700 1 --2- 172.21.15.45:0/822421024 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f1815cd30 0x7f4f180b3700 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f4f10012000 tx=0x7f4f10004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:07.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.928+0000 7f4f157fa700 1 -- 172.21.15.45:0/822421024 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f100048f0 con 0x7f4f1815cd30 2023-11-28T12:12:07.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.928+0000 7f4f157fa700 1 -- 172.21.15.45:0/822421024 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f100099b0 con 0x7f4f1815cd30 2023-11-28T12:12:07.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.928+0000 7f4f157fa700 1 -- 172.21.15.45:0/822421024 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f1001c680 con 0x7f4f1815cd30 2023-11-28T12:12:07.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.928+0000 7f4f1ebff700 1 -- 172.21.15.45:0/822421024 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f180cc280 con 0x7f4f1815cd30 2023-11-28T12:12:07.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.928+0000 7f4f1ebff700 1 -- 172.21.15.45:0/822421024 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f18160c30 con 0x7f4f1815cd30 2023-11-28T12:12:07.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.929+0000 7f4f1ebff700 1 -- 172.21.15.45:0/822421024 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f18070de0 con 0x7f4f1815cd30 2023-11-28T12:12:07.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.930+0000 7f4f157fa700 1 -- 172.21.15.45:0/822421024 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f4f1002c070 con 0x7f4f1815cd30 2023-11-28T12:12:07.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.932+0000 7f4f157fa700 1 --2- 172.21.15.45:0/822421024 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f4efc0682f0 0x7f4efc06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:07.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.932+0000 7f4f157fa700 1 -- 172.21.15.45:0/822421024 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f4f100879a0 con 0x7f4f1815cd30 2023-11-28T12:12:07.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.932+0000 7f4f1c99b700 1 --2- 172.21.15.45:0/822421024 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f4efc0682f0 0x7f4efc06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:07.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.933+0000 7f4f1c99b700 1 --2- 172.21.15.45:0/822421024 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f4efc0682f0 0x7f4efc06a7a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f4f180c7110 tx=0x7f4f0c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:07.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:07.935+0000 7f4f157fa700 1 -- 172.21.15.45:0/822421024 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f4f10054080 con 0x7f4f1815cd30 2023-11-28T12:12:08.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.137+0000 7f4f1ebff700 1 -- 172.21.15.45:0/822421024 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4f180745c0 con 0x7f4f1815cd30 2023-11-28T12:12:08.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.138+0000 7f4f157fa700 1 -- 172.21.15.45:0/822421024 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) v1 ==== 74+0+18103 (secure 0 0 0) 0x7f4f100576a0 con 0x7f4f1815cd30 2023-11-28T12:12:08.140 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:12:08.141 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":63,"fsid":"bd7c37f1-f7c6-4778-b845-52cf2aa6e366","created":"2023-11-28T12:06:09.045075+0000","modified":"2023-11-28T12:10:19.965300+0000","last_up_change":"2023-11-28T12:06:21.282227+0000","last_in_change":"2023-11-28T12:06:12.560924+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T12:06:21.807108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T12:06:22.491009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-11-28T12:09:33.476735+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-11-28T12:09:34.551527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d0cdd8a-87fd-4f2c-91bd-47bdfa661905","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":115843},{"type":"v1","addr":"172.21.15.45:6808","nonce":115843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":115843},{"type":"v1","addr":"172.21.15.45:6811","nonce":115843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":115843},{"type":"v1","addr":"172.21.15.45:6815","nonce":115843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":115843},{"type":"v1","addr":"172.21.15.45:6813","nonce":115843}]},"public_addr":"172.21.15.45:6808/115843","cluster_addr":"172.21.15.45:6811/115843","heartbeat_back_addr":"172.21.15.45:6815/115843","heartbeat_front_addr":"172.21.15.45:6813/115843","state":["exists","up"]},{"osd":1,"uuid":"c5de4ebd-9ec5-40b3-9caa-9b706fab4c76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":115842},{"type":"v1","addr":"172.21.15.45:6801","nonce":115842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":115842},{"type":"v1","addr":"172.21.15.45:6803","nonce":115842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6807","nonce":115842},{"type":"v1","addr":"172.21.15.45:6809","nonce":115842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":115842},{"type":"v1","addr":"172.21.15.45:6805","nonce":115842}]},"public_addr":"172.21.15.45:6801/115842","cluster_addr":"172.21.15.45:6803/115842","heartbeat_back_addr":"172.21.15.45:6809/115842","heartbeat_front_addr":"172.21.15.45:6805/115842","state":["exists","up"]},{"osd":2,"uuid":"9f4b36b2-65d2-40e7-9fe6-a2991afa71c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":115850},{"type":"v1","addr":"172.21.15.45:6819","nonce":115850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":115850},{"type":"v1","addr":"172.21.15.45:6823","nonce":115850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":115850},{"type":"v1","addr":"172.21.15.45:6831","nonce":115850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":115850},{"type":"v1","addr":"172.21.15.45:6828","nonce":115850}]},"public_addr":"172.21.15.45:6819/115850","cluster_addr":"172.21.15.45:6823/115850","heartbeat_back_addr":"172.21.15.45:6831/115850","heartbeat_front_addr":"172.21.15.45:6828/115850","state":["exists","up"]},{"osd":3,"uuid":"6fe7ef05-4e0d-426c-bf94-44b51d4d550b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":115848},{"type":"v1","addr":"172.21.15.45:6818","nonce":115848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":115848},{"type":"v1","addr":"172.21.15.45:6822","nonce":115848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6827","nonce":115848},{"type":"v1","addr":"172.21.15.45:6829","nonce":115848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":115848},{"type":"v1","addr":"172.21.15.45:6825","nonce":115848}]},"public_addr":"172.21.15.45:6818/115848","cluster_addr":"172.21.15.45:6822/115848","heartbeat_back_addr":"172.21.15.45:6829/115848","heartbeat_front_addr":"172.21.15.45:6825/115848","state":["exists","up"]},{"osd":4,"uuid":"fa403c08-d8a1-4a3a-8384-cb465c1a654c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":116092},{"type":"v1","addr":"172.21.15.152:6801","nonce":116092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":116092},{"type":"v1","addr":"172.21.15.152:6803","nonce":116092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":116092},{"type":"v1","addr":"172.21.15.152:6807","nonce":116092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":116092},{"type":"v1","addr":"172.21.15.152:6805","nonce":116092}]},"public_addr":"172.21.15.152:6801/116092","cluster_addr":"172.21.15.152:6803/116092","heartbeat_back_addr":"172.21.15.152:6807/116092","heartbeat_front_addr":"172.21.15.152:6805/116092","state":["exists","up"]},{"osd":5,"uuid":"399fc450-39fa-43a6-bf80-0b8bcb41bd95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6815","nonce":116093},{"type":"v1","addr":"172.21.15.152:6817","nonce":116093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":116093},{"type":"v1","addr":"172.21.15.152:6819","nonce":116093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":116093},{"type":"v1","addr":"172.21.15.152:6823","nonce":116093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":116093},{"type":"v1","addr":"172.21.15.152:6821","nonce":116093}]},"public_addr":"172.21.15.152:6817/116093","cluster_addr":"172.21.15.152:6819/116093","heartbeat_back_addr":"172.21.15.152:6823/116093","heartbeat_front_addr":"172.21.15.152:6821/116093","state":["exists","up"]},{"osd":6,"uuid":"e59a4017-2d23-4627-836b-e25b2d3ddaaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":116094},{"type":"v1","addr":"172.21.15.152:6809","nonce":116094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":116094},{"type":"v1","addr":"172.21.15.152:6811","nonce":116094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":116094},{"type":"v1","addr":"172.21.15.152:6816","nonce":116094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":116094},{"type":"v1","addr":"172.21.15.152:6813","nonce":116094}]},"public_addr":"172.21.15.152:6809/116094","cluster_addr":"172.21.15.152:6811/116094","heartbeat_back_addr":"172.21.15.152:6816/116094","heartbeat_front_addr":"172.21.15.152:6813/116094","state":["exists","up"]},{"osd":7,"uuid":"8d7f9d4b-bf08-4670-8591-388c0f012a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":116097},{"type":"v1","addr":"172.21.15.152:6825","nonce":116097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":116097},{"type":"v1","addr":"172.21.15.152:6827","nonce":116097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":116097},{"type":"v1","addr":"172.21.15.152:6831","nonce":116097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":116097},{"type":"v1","addr":"172.21.15.152:6829","nonce":116097}]},"public_addr":"172.21.15.152:6825/116097","cluster_addr":"172.21.15.152:6827/116097","heartbeat_back_addr":"172.21.15.152:6831/116097","heartbeat_front_addr":"172.21.15.152:6829/116097","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.937710+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.865423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.159434+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.913090+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.131647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.966255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.972583+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.177209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.15","mappings":[{"from":7,"to":2}]},{"pgid":"10.2","mappings":[{"from":4,"to":5}]},{"pgid":"10.21","mappings":[{"from":4,"to":3}]},{"pgid":"10.37","mappings":[{"from":7,"to":3}]},{"pgid":"10.3b","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T12:12:08.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.141+0000 7f4f1ebff700 1 -- 172.21.15.45:0/822421024 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f4efc0682f0 msgr2=0x7f4efc06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:08.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.141+0000 7f4f1ebff700 1 --2- 172.21.15.45:0/822421024 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f4efc0682f0 0x7f4efc06a7a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f4f180c7110 tx=0x7f4f0c008040 comp rx=0 tx=0).stop 2023-11-28T12:12:08.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.141+0000 7f4f1ebff700 1 -- 172.21.15.45:0/822421024 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f1815cd30 msgr2=0x7f4f180b3700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:08.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.141+0000 7f4f1ebff700 1 --2- 172.21.15.45:0/822421024 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f1815cd30 0x7f4f180b3700 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f4f10012000 tx=0x7f4f10004ad0 comp rx=0 tx=0).stop 2023-11-28T12:12:08.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.141+0000 7f4f1ebff700 1 -- 172.21.15.45:0/822421024 shutdown_connections 2023-11-28T12:12:08.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.141+0000 7f4f1ebff700 1 --2- 172.21.15.45:0/822421024 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f4efc0682f0 0x7f4efc06a7a0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:08.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.141+0000 7f4f1ebff700 1 --2- 172.21.15.45:0/822421024 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4f1815cd30 0x7f4f180b3700 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:08.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.141+0000 7f4f1ebff700 1 --2- 172.21.15.45:0/822421024 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4f1806a980 0x7f4f1815a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:08.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.141+0000 7f4f1ebff700 1 --2- 172.21.15.45:0/822421024 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f180cfda0 0x7f4f180c7ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:08.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.141+0000 7f4f1ebff700 1 -- 172.21.15.45:0/822421024 >> 172.21.15.45:0/822421024 conn(0x7f4f1806b380 msgr2=0x7f4f180ca470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:08.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.141+0000 7f4f1ebff700 1 -- 172.21.15.45:0/822421024 shutdown_connections 2023-11-28T12:12:08.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.141+0000 7f4f1ebff700 1 -- 172.21.15.45:0/822421024 wait complete. 2023-11-28T12:12:08.160 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-28T12:06:21.807108+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-28T12:06:22.491009+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T12:09:33.476735+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '60', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T12:09:34.551527+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '61', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T12:12:08.161 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T12:12:08.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.366+0000 7f7872fff700 1 Processor -- start 2023-11-28T12:12:08.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.366+0000 7f7872fff700 1 -- start start 2023-11-28T12:12:08.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.367+0000 7f7872fff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f786c15c9b0 0x7f786c0b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:08.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.367+0000 7f7872fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f786c161340 0x7f786c0d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:08.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.368+0000 7f7872fff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f786c0d2320 0x7f786c0cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:08.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.368+0000 7f7872fff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f786c0b5800 con 0x7f786c161340 2023-11-28T12:12:08.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.368+0000 7f7872fff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f786c0d1950 con 0x7f786c15c9b0 2023-11-28T12:12:08.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.368+0000 7f7872fff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f786c0b5520 con 0x7f786c0d2320 2023-11-28T12:12:08.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.368+0000 7f786bfff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f786c161340 0x7f786c0d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:08.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.368+0000 7f786bfff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f786c161340 0x7f786c0d1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47412/0 (socket says 172.21.15.45:47412) 2023-11-28T12:12:08.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.368+0000 7f786bfff700 1 -- 172.21.15.45:0/853218258 learned_addr learned my addr 172.21.15.45:0/853218258 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:12:08.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.368+0000 7f7870d9b700 1 --2- 172.21.15.45:0/853218258 >> v2:172.21.15.152:3300/0 conn(0x7f786c15c9b0 0x7f786c0b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:08.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.368+0000 7f787159c700 1 --2- 172.21.15.45:0/853218258 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f786c0d2320 0x7f786c0cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:08.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.368+0000 7f786bfff700 1 -- 172.21.15.45:0/853218258 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f786c0d2320 msgr2=0x7f786c0cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:12:08.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.368+0000 7f786bfff700 1 --2- 172.21.15.45:0/853218258 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f786c0d2320 0x7f786c0cd7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:08.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.368+0000 7f786bfff700 1 -- 172.21.15.45:0/853218258 >> v2:172.21.15.152:3300/0 conn(0x7f786c15c9b0 msgr2=0x7f786c0b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:12:08.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.368+0000 7f786bfff700 1 --2- 172.21.15.45:0/853218258 >> v2:172.21.15.152:3300/0 conn(0x7f786c15c9b0 0x7f786c0b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:08.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.368+0000 7f786bfff700 1 -- 172.21.15.45:0/853218258 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f786c0d1300 con 0x7f786c161340 2023-11-28T12:12:08.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.369+0000 7f786bfff700 1 --2- 172.21.15.45:0/853218258 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f786c161340 0x7f786c0d1de0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f786c067460 tx=0x7f7858009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dafa40d9db89be1f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:08.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.369+0000 7f786b7fe700 1 -- 172.21.15.45:0/853218258 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7858011830 con 0x7f786c161340 2023-11-28T12:12:08.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.369+0000 7f786b7fe700 1 -- 172.21.15.45:0/853218258 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7858011990 con 0x7f786c161340 2023-11-28T12:12:08.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.369+0000 7f786b7fe700 1 -- 172.21.15.45:0/853218258 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7858011d20 con 0x7f786c161340 2023-11-28T12:12:08.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.369+0000 7f7872fff700 1 -- 172.21.15.45:0/853218258 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f786c161340 msgr2=0x7f786c0d1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:08.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.369+0000 7f7872fff700 1 --2- 172.21.15.45:0/853218258 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f786c161340 0x7f786c0d1de0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f786c067460 tx=0x7f7858009bd0 comp rx=0 tx=0).stop 2023-11-28T12:12:08.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.369+0000 7f7872fff700 1 -- 172.21.15.45:0/853218258 shutdown_connections 2023-11-28T12:12:08.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.370+0000 7f7872fff700 1 --2- 172.21.15.45:0/853218258 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f786c0d2320 0x7f786c0cd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:08.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.370+0000 7f7872fff700 1 --2- 172.21.15.45:0/853218258 >> v2:172.21.15.152:3300/0 conn(0x7f786c15c9b0 0x7f786c0b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:08.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.370+0000 7f7872fff700 1 --2- 172.21.15.45:0/853218258 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f786c161340 0x7f786c0d1de0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:08.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.370+0000 7f7872fff700 1 -- 172.21.15.45:0/853218258 >> 172.21.15.45:0/853218258 conn(0x7f786c072600 msgr2=0x7f786c0cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:08.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.370+0000 7f7872fff700 1 -- 172.21.15.45:0/853218258 shutdown_connections 2023-11-28T12:12:08.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.370+0000 7f7872fff700 1 -- 172.21.15.45:0/853218258 wait complete. 2023-11-28T12:12:08.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.371+0000 7f7872fff700 1 Processor -- start 2023-11-28T12:12:08.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.372+0000 7f7872fff700 1 -- start start 2023-11-28T12:12:08.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.372+0000 7f7872fff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f786c0d2320 0x7f786c150580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:08.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.372+0000 7f7872fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f786c15c9b0 0x7f786c1e81f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:08.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.372+0000 7f7872fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f786c161340 0x7f786c1e8730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:08.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.372+0000 7f7872fff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f786c154c20 con 0x7f786c161340 2023-11-28T12:12:08.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.372+0000 7f7872fff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f786c154e30 con 0x7f786c15c9b0 2023-11-28T12:12:08.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.372+0000 7f7872fff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f786c155110 con 0x7f786c0d2320 2023-11-28T12:12:08.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.373+0000 7f787159c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f786c161340 0x7f786c1e8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:08.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.373+0000 7f787159c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f786c161340 0x7f786c1e8730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47426/0 (socket says 172.21.15.45:47426) 2023-11-28T12:12:08.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.373+0000 7f787159c700 1 -- 172.21.15.45:0/2063191439 learned_addr learned my addr 172.21.15.45:0/2063191439 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:12:08.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.373+0000 7f7870d9b700 1 --2- 172.21.15.45:0/2063191439 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f786c0d2320 0x7f786c150580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:08.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.373+0000 7f786bfff700 1 --2- 172.21.15.45:0/2063191439 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f786c15c9b0 0x7f786c1e81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:08.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.373+0000 7f787159c700 1 -- 172.21.15.45:0/2063191439 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f786c0d2320 msgr2=0x7f786c150580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:08.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.373+0000 7f787159c700 1 --2- 172.21.15.45:0/2063191439 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f786c0d2320 0x7f786c150580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:08.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.373+0000 7f787159c700 1 -- 172.21.15.45:0/2063191439 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f786c15c9b0 msgr2=0x7f786c1e81f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:08.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.373+0000 7f787159c700 1 --2- 172.21.15.45:0/2063191439 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f786c15c9b0 0x7f786c1e81f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:08.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.373+0000 7f787159c700 1 -- 172.21.15.45:0/2063191439 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7858009550 con 0x7f786c161340 2023-11-28T12:12:08.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.373+0000 7f787159c700 1 --2- 172.21.15.45:0/2063191439 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f786c161340 0x7f786c1e8730 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f786400efc0 tx=0x7f7864009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:08.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.374+0000 7f78697fa700 1 -- 172.21.15.45:0/2063191439 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7864009b20 con 0x7f786c161340 2023-11-28T12:12:08.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.374+0000 7f78697fa700 1 -- 172.21.15.45:0/2063191439 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f786400f040 con 0x7f786c161340 2023-11-28T12:12:08.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.374+0000 7f7872fff700 1 -- 172.21.15.45:0/2063191439 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f786c0b5130 con 0x7f786c161340 2023-11-28T12:12:08.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.374+0000 7f78697fa700 1 -- 172.21.15.45:0/2063191439 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f786400cc90 con 0x7f786c161340 2023-11-28T12:12:08.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.374+0000 7f7872fff700 1 -- 172.21.15.45:0/2063191439 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f786c0d15e0 con 0x7f786c161340 2023-11-28T12:12:08.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.375+0000 7f7872fff700 1 -- 172.21.15.45:0/2063191439 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f786c0b52c0 con 0x7f786c161340 2023-11-28T12:12:08.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.376+0000 7f78697fa700 1 -- 172.21.15.45:0/2063191439 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f7864014480 con 0x7f786c161340 2023-11-28T12:12:08.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.377+0000 7f78697fa700 1 --2- 172.21.15.45:0/2063191439 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f78500682f0 0x7f785006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:08.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.377+0000 7f78697fa700 1 -- 172.21.15.45:0/2063191439 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f7864086960 con 0x7f786c161340 2023-11-28T12:12:08.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.378+0000 7f7870d9b700 1 --2- 172.21.15.45:0/2063191439 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f78500682f0 0x7f785006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:08.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.378+0000 7f7870d9b700 1 --2- 172.21.15.45:0/2063191439 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f78500682f0 0x7f785006a7a0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f786c1f60a0 tx=0x7f7860009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:08.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.381+0000 7f78697fa700 1 -- 172.21.15.45:0/2063191439 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f7864052fe0 con 0x7f786c161340 2023-11-28T12:12:08.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.581+0000 7f7872fff700 1 -- 172.21.15.45:0/2063191439 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f786c0cf3b0 con 0x7f786c161340 2023-11-28T12:12:08.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.581+0000 7f78697fa700 1 -- 172.21.15.45:0/2063191439 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v63) v1 ==== 92+0+10 (secure 0 0 0) 0x7f78640180a0 con 0x7f786c161340 2023-11-28T12:12:08.583 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-11-28T12:12:08.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.583+0000 7f7872fff700 1 -- 172.21.15.45:0/2063191439 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f78500682f0 msgr2=0x7f785006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:08.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.583+0000 7f7872fff700 1 --2- 172.21.15.45:0/2063191439 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f78500682f0 0x7f785006a7a0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f786c1f60a0 tx=0x7f7860009210 comp rx=0 tx=0).stop 2023-11-28T12:12:08.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.583+0000 7f7872fff700 1 -- 172.21.15.45:0/2063191439 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f786c161340 msgr2=0x7f786c1e8730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:08.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.583+0000 7f7872fff700 1 --2- 172.21.15.45:0/2063191439 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f786c161340 0x7f786c1e8730 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f786400efc0 tx=0x7f7864009f60 comp rx=0 tx=0).stop 2023-11-28T12:12:08.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.583+0000 7f7872fff700 1 -- 172.21.15.45:0/2063191439 shutdown_connections 2023-11-28T12:12:08.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.583+0000 7f7872fff700 1 --2- 172.21.15.45:0/2063191439 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f78500682f0 0x7f785006a7a0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:08.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.583+0000 7f7872fff700 1 --2- 172.21.15.45:0/2063191439 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f786c161340 0x7f786c1e8730 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:08.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.583+0000 7f7872fff700 1 --2- 172.21.15.45:0/2063191439 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f786c0d2320 0x7f786c150580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:08.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.583+0000 7f7872fff700 1 --2- 172.21.15.45:0/2063191439 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f786c15c9b0 0x7f786c1e81f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:08.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.583+0000 7f7872fff700 1 -- 172.21.15.45:0/2063191439 >> 172.21.15.45:0/2063191439 conn(0x7f786c072600 msgr2=0x7f786c15cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:08.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.583+0000 7f7872fff700 1 -- 172.21.15.45:0/2063191439 shutdown_connections 2023-11-28T12:12:08.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.583+0000 7f7872fff700 1 -- 172.21.15.45:0/2063191439 wait complete. 2023-11-28T12:12:08.603 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T12:12:08.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.808+0000 7ff9a55ff700 1 Processor -- start 2023-11-28T12:12:08.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.808+0000 7ff9a55ff700 1 -- start start 2023-11-28T12:12:08.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.809+0000 7ff9a55ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ff9a0161340 0x7ff9a00d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:08.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.809+0000 7ff9a55ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9a00d1950 con 0x7ff9a00d2320 2023-11-28T12:12:08.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.809+0000 7ff9a55ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9a00b5520 con 0x7ff9a015c9b0 2023-11-28T12:12:08.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.809+0000 7ff9a55ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9a00b5800 con 0x7ff9a0161340 2023-11-28T12:12:08.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.809+0000 7ff99f7fe700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ff9a00d2320 0x7ff9a00cd7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:34748/0 (socket says 172.21.15.45:34748) 2023-11-28T12:12:08.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.809+0000 7ff99f7fe700 1 -- 172.21.15.45:0/3892413919 learned_addr learned my addr 172.21.15.45:0/3892413919 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:12:08.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.809+0000 7ff997fff700 1 --2- 172.21.15.45:0/3892413919 >> v2:172.21.15.152:3300/0 conn(0x7ff9a0161340 0x7ff9a00d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:08.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.810+0000 7ff99e7fc700 1 -- 172.21.15.45:0/3892413919 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4212555002 0 0) 0x7ff9a00d1950 con 0x7ff9a00d2320 2023-11-28T12:12:08.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.810+0000 7ff997fff700 1 -- 172.21.15.45:0/3892413919 >> v1:172.21.15.152:6789/0 conn(0x7ff9a015c9b0 legacy=0x7ff9a00b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:08.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.810+0000 7ff997fff700 1 -- 172.21.15.45:0/3892413919 >> v1:172.21.15.45:6789/0 conn(0x7ff9a00d2320 legacy=0x7ff9a00cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:08.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.810+0000 7ff997fff700 1 -- 172.21.15.45:0/3892413919 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9a00d1300 con 0x7ff9a0161340 2023-11-28T12:12:08.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.810+0000 7ff997fff700 1 --2- 172.21.15.45:0/3892413919 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9a0161340 0x7ff9a00d1de0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ff988009840 tx=0x7ff988009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=faedb9232e78824a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:08.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.810+0000 7ff99e7fc700 1 -- 172.21.15.45:0/3892413919 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff988011830 con 0x7ff9a0161340 2023-11-28T12:12:08.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.811+0000 7ff99e7fc700 1 -- 172.21.15.45:0/3892413919 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff988011990 con 0x7ff9a0161340 2023-11-28T12:12:08.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.811+0000 7ff99e7fc700 1 -- 172.21.15.45:0/3892413919 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff988011d20 con 0x7ff9a0161340 2023-11-28T12:12:08.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.811+0000 7ff9a55ff700 1 -- 172.21.15.45:0/3892413919 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9a0161340 msgr2=0x7ff9a00d1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:08.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.811+0000 7ff9a55ff700 1 --2- 172.21.15.45:0/3892413919 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9a0161340 0x7ff9a00d1de0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ff988009840 tx=0x7ff988009b50 comp rx=0 tx=0).stop 2023-11-28T12:12:08.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.811+0000 7ff9a55ff700 1 -- 172.21.15.45:0/3892413919 shutdown_connections 2023-11-28T12:12:08.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.811+0000 7ff9a55ff700 1 --2- 172.21.15.45:0/3892413919 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9a0161340 0x7ff9a00d1de0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:08.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.811+0000 7ff9a55ff700 1 -- 172.21.15.45:0/3892413919 >> 172.21.15.45:0/3892413919 conn(0x7ff9a0072600 msgr2=0x7ff9a00cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:08.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.811+0000 7ff9a55ff700 1 -- 172.21.15.45:0/3892413919 shutdown_connections 2023-11-28T12:12:08.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.811+0000 7ff9a55ff700 1 -- 172.21.15.45:0/3892413919 wait complete. 2023-11-28T12:12:08.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.813+0000 7ff9a55ff700 1 Processor -- start 2023-11-28T12:12:08.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.813+0000 7ff9a55ff700 1 -- start start 2023-11-28T12:12:08.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.814+0000 7ff9a55ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9a00d2320 0x7ff9a0149440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:08.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.814+0000 7ff9a55ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff9a015c9b0 0x7ff9a01e70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:08.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.814+0000 7ff9a55ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9a0161340 0x7ff9a01e7a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:08.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.814+0000 7ff9a55ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a01e86a0 con 0x7ff9a00d2320 2023-11-28T12:12:08.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.814+0000 7ff9a55ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a01e83c0 con 0x7ff9a0161340 2023-11-28T12:12:08.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.814+0000 7ff9a55ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a01e65e0 con 0x7ff9a015c9b0 2023-11-28T12:12:08.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.814+0000 7ff99effd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9a00d2320 0x7ff9a0149440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:08.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.814+0000 7ff99effd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9a00d2320 0x7ff9a0149440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47436/0 (socket says 172.21.15.45:47436) 2023-11-28T12:12:08.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.814+0000 7ff99effd700 1 -- 172.21.15.45:0/2347607038 learned_addr learned my addr 172.21.15.45:0/2347607038 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:12:08.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.815+0000 7ff99f7fe700 1 --2- 172.21.15.45:0/2347607038 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9a0161340 0x7ff9a01e7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:08.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.815+0000 7ff997fff700 1 --2- 172.21.15.45:0/2347607038 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff9a015c9b0 0x7ff9a01e70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:08.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.815+0000 7ff99effd700 1 -- 172.21.15.45:0/2347607038 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff9a015c9b0 msgr2=0x7ff9a01e70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:08.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.815+0000 7ff99effd700 1 --2- 172.21.15.45:0/2347607038 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff9a015c9b0 0x7ff9a01e70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:08.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.815+0000 7ff99effd700 1 -- 172.21.15.45:0/2347607038 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9a0161340 msgr2=0x7ff9a01e7a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:08.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.815+0000 7ff99effd700 1 --2- 172.21.15.45:0/2347607038 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9a0161340 0x7ff9a01e7a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:08.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.815+0000 7ff99effd700 1 -- 172.21.15.45:0/2347607038 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9880094a0 con 0x7ff9a00d2320 2023-11-28T12:12:08.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.815+0000 7ff99f7fe700 1 --2- 172.21.15.45:0/2347607038 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9a0161340 0x7ff9a01e7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:12:08.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.815+0000 7ff997fff700 1 --2- 172.21.15.45:0/2347607038 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff9a015c9b0 0x7ff9a01e70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:12:08.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.815+0000 7ff99effd700 1 --2- 172.21.15.45:0/2347607038 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9a00d2320 0x7ff9a0149440 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7ff99000c4e0 tx=0x7ff99000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:08.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.815+0000 7ff9977fe700 1 -- 172.21.15.45:0/2347607038 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9900052d0 con 0x7ff9a00d2320 2023-11-28T12:12:08.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.815+0000 7ff9977fe700 1 -- 172.21.15.45:0/2347607038 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff990005430 con 0x7ff9a00d2320 2023-11-28T12:12:08.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.815+0000 7ff9977fe700 1 -- 172.21.15.45:0/2347607038 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9900038c0 con 0x7ff9a00d2320 2023-11-28T12:12:08.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.815+0000 7ff9a55ff700 1 -- 172.21.15.45:0/2347607038 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9a015cd80 con 0x7ff9a00d2320 2023-11-28T12:12:08.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.815+0000 7ff9a55ff700 1 -- 172.21.15.45:0/2347607038 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9a00d15e0 con 0x7ff9a00d2320 2023-11-28T12:12:08.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.816+0000 7ff9a55ff700 1 -- 172.21.15.45:0/2347607038 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9a015cf10 con 0x7ff9a00d2320 2023-11-28T12:12:08.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.817+0000 7ff9977fe700 1 -- 172.21.15.45:0/2347607038 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7ff990019030 con 0x7ff9a00d2320 2023-11-28T12:12:08.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.818+0000 7ff9977fe700 1 --2- 172.21.15.45:0/2347607038 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7ff9800682f0 0x7ff98006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:08.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.818+0000 7ff9977fe700 1 -- 172.21.15.45:0/2347607038 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6207+0+0 (secure 0 0 0) 0x7ff9900851c0 con 0x7ff9a00d2320 2023-11-28T12:12:08.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.819+0000 7ff997fff700 1 --2- 172.21.15.45:0/2347607038 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7ff9800682f0 0x7ff98006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:08.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.819+0000 7ff997fff700 1 --2- 172.21.15.45:0/2347607038 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7ff9800682f0 0x7ff98006a7a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ff9a00b6630 tx=0x7ff98801c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:08.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:08.823+0000 7ff9977fe700 1 -- 172.21.15.45:0/2347607038 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7ff9900518a0 con 0x7ff9a00d2320 2023-11-28T12:12:09.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.028+0000 7ff9a55ff700 1 -- 172.21.15.45:0/2347607038 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff9a00745c0 con 0x7ff9a00d2320 2023-11-28T12:12:09.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.028+0000 7ff9977fe700 1 -- 172.21.15.45:0/2347607038 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v63) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff990054ec0 con 0x7ff9a00d2320 2023-11-28T12:12:09.030 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-11-28T12:12:09.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.030+0000 7ff9a55ff700 1 -- 172.21.15.45:0/2347607038 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7ff9800682f0 msgr2=0x7ff98006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:09.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.030+0000 7ff9a55ff700 1 --2- 172.21.15.45:0/2347607038 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7ff9800682f0 0x7ff98006a7a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ff9a00b6630 tx=0x7ff98801c040 comp rx=0 tx=0).stop 2023-11-28T12:12:09.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.030+0000 7ff9a55ff700 1 -- 172.21.15.45:0/2347607038 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9a00d2320 msgr2=0x7ff9a0149440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:09.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.030+0000 7ff9a55ff700 1 --2- 172.21.15.45:0/2347607038 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9a00d2320 0x7ff9a0149440 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7ff99000c4e0 tx=0x7ff99000c8a0 comp rx=0 tx=0).stop 2023-11-28T12:12:09.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.030+0000 7ff9a55ff700 1 -- 172.21.15.45:0/2347607038 shutdown_connections 2023-11-28T12:12:09.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.030+0000 7ff9a55ff700 1 --2- 172.21.15.45:0/2347607038 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7ff9800682f0 0x7ff98006a7a0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:09.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.030+0000 7ff9a55ff700 1 --2- 172.21.15.45:0/2347607038 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9a0161340 0x7ff9a01e7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:09.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.031+0000 7ff9a55ff700 1 --2- 172.21.15.45:0/2347607038 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9a00d2320 0x7ff9a0149440 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:09.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.031+0000 7ff9a55ff700 1 --2- 172.21.15.45:0/2347607038 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7ff9a015c9b0 0x7ff9a01e70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:09.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.031+0000 7ff9a55ff700 1 -- 172.21.15.45:0/2347607038 >> 172.21.15.45:0/2347607038 conn(0x7ff9a0072600 msgr2=0x7ff9a015f110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:09.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.031+0000 7ff9a55ff700 1 -- 172.21.15.45:0/2347607038 shutdown_connections 2023-11-28T12:12:09.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.031+0000 7ff9a55ff700 1 -- 172.21.15.45:0/2347607038 wait complete. 2023-11-28T12:12:09.050 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T12:12:09.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.255+0000 7f5efc7ff700 1 Processor -- start 2023-11-28T12:12:09.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.256+0000 7f5efc7ff700 1 -- start start 2023-11-28T12:12:09.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.257+0000 7f5efc7ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f5ef415c9b0 0x7f5ef40b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:09.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.257+0000 7f5efc7ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5ef40cd7c0 0x7f5ef40cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:09.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.257+0000 7f5efc7ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ef40d1950 con 0x7f5ef4161340 2023-11-28T12:12:09.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.257+0000 7f5efc7ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ef40b5800 con 0x7f5ef415c9b0 2023-11-28T12:12:09.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.257+0000 7f5efc7ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef40ce140 con 0x7f5ef40cd7c0 2023-11-28T12:12:09.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.257+0000 7f5ef9d9a700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f5ef4161340 0x7f5ef40d1de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:34760/0 (socket says 172.21.15.45:34760) 2023-11-28T12:12:09.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.257+0000 7f5ef9d9a700 1 -- 172.21.15.45:0/2132926444 learned_addr learned my addr 172.21.15.45:0/2132926444 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:12:09.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.257+0000 7f5efad9c700 1 --2- 172.21.15.45:0/2132926444 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5ef40cd7c0 0x7f5ef40cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:09.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.257+0000 7f5efa59b700 1 --2- 172.21.15.45:0/2132926444 >> v2:172.21.15.152:3300/0 conn(0x7f5ef415c9b0 0x7f5ef40b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:09.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.258+0000 7f5ef9599700 1 -- 172.21.15.45:0/2132926444 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1922248793 0 0) 0x7f5ef40d1950 con 0x7f5ef4161340 2023-11-28T12:12:09.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.258+0000 7f5ef9599700 1 -- 172.21.15.45:0/2132926444 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ee00035b0 con 0x7f5ef4161340 2023-11-28T12:12:09.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.258+0000 7f5ef9599700 1 -- 172.21.15.45:0/2132926444 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1805505272 0 0) 0x7f5ee00035b0 con 0x7f5ef4161340 2023-11-28T12:12:09.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.258+0000 7f5efad9c700 1 -- 172.21.15.45:0/2132926444 >> v2:172.21.15.152:3300/0 conn(0x7f5ef415c9b0 msgr2=0x7f5ef40b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:12:09.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.258+0000 7f5efad9c700 1 --2- 172.21.15.45:0/2132926444 >> v2:172.21.15.152:3300/0 conn(0x7f5ef415c9b0 0x7f5ef40b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:09.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.258+0000 7f5efad9c700 1 -- 172.21.15.45:0/2132926444 >> v1:172.21.15.45:6789/0 conn(0x7f5ef4161340 legacy=0x7f5ef40d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:09.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.258+0000 7f5efad9c700 1 -- 172.21.15.45:0/2132926444 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ef40d24f0 con 0x7f5ef40cd7c0 2023-11-28T12:12:09.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.258+0000 7f5efa59b700 1 --2- 172.21.15.45:0/2132926444 >> v2:172.21.15.152:3300/0 conn(0x7f5ef415c9b0 0x7f5ef40b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:12:09.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.258+0000 7f5efad9c700 1 --2- 172.21.15.45:0/2132926444 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5ef40cd7c0 0x7f5ef40cdc00 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5eec009d90 tx=0x7f5eec00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=60630797098421c3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:09.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.259+0000 7f5ef9599700 1 -- 172.21.15.45:0/2132926444 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eec00e070 con 0x7f5ef40cd7c0 2023-11-28T12:12:09.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.259+0000 7f5ef9599700 1 -- 172.21.15.45:0/2132926444 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eec003a20 con 0x7f5ef40cd7c0 2023-11-28T12:12:09.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.259+0000 7f5ef9599700 1 -- 172.21.15.45:0/2132926444 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee4001670 con 0x7f5ef40cd7c0 2023-11-28T12:12:09.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.259+0000 7f5efc7ff700 1 -- 172.21.15.45:0/2132926444 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5ef40cd7c0 msgr2=0x7f5ef40cdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:09.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.259+0000 7f5efc7ff700 1 --2- 172.21.15.45:0/2132926444 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5ef40cd7c0 0x7f5ef40cdc00 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5eec009d90 tx=0x7f5eec00b330 comp rx=0 tx=0).stop 2023-11-28T12:12:09.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.259+0000 7f5efc7ff700 1 -- 172.21.15.45:0/2132926444 shutdown_connections 2023-11-28T12:12:09.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.259+0000 7f5efc7ff700 1 --2- 172.21.15.45:0/2132926444 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5ef40cd7c0 0x7f5ef40cdc00 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:09.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.259+0000 7f5efc7ff700 1 --2- 172.21.15.45:0/2132926444 >> v2:172.21.15.152:3300/0 conn(0x7f5ef415c9b0 0x7f5ef40b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:09.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.259+0000 7f5efc7ff700 1 -- 172.21.15.45:0/2132926444 >> 172.21.15.45:0/2132926444 conn(0x7f5ef4072600 msgr2=0x7f5ef40cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:09.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.259+0000 7f5efc7ff700 1 -- 172.21.15.45:0/2132926444 shutdown_connections 2023-11-28T12:12:09.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.259+0000 7f5efc7ff700 1 -- 172.21.15.45:0/2132926444 wait complete. 2023-11-28T12:12:09.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.261+0000 7f5efc7ff700 1 Processor -- start 2023-11-28T12:12:09.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.261+0000 7f5efc7ff700 1 -- start start 2023-11-28T12:12:09.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.262+0000 7f5efc7ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5ef40cd7c0 0x7f5ef40c98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:09.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.262+0000 7f5efc7ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ef415c9b0 0x7f5ef40cc680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:09.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.262+0000 7f5efc7ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ef4161340 0x7f5ef4158d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:09.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.262+0000 7f5efc7ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef40c8d30 con 0x7f5ef415c9b0 2023-11-28T12:12:09.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.262+0000 7f5efc7ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef40c7f70 con 0x7f5ef4161340 2023-11-28T12:12:09.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.262+0000 7f5efc7ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef40c8250 con 0x7f5ef40cd7c0 2023-11-28T12:12:09.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.262+0000 7f5ef9d9a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ef415c9b0 0x7f5ef40cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:09.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.262+0000 7f5ef9d9a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ef415c9b0 0x7f5ef40cc680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47438/0 (socket says 172.21.15.45:47438) 2023-11-28T12:12:09.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.262+0000 7f5ef9d9a700 1 -- 172.21.15.45:0/3586535053 learned_addr learned my addr 172.21.15.45:0/3586535053 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:12:09.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.263+0000 7f5efad9c700 1 --2- 172.21.15.45:0/3586535053 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ef4161340 0x7f5ef4158d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:09.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.263+0000 7f5efa59b700 1 --2- 172.21.15.45:0/3586535053 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5ef40cd7c0 0x7f5ef40c98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:09.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.263+0000 7f5ef9d9a700 1 -- 172.21.15.45:0/3586535053 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5ef40cd7c0 msgr2=0x7f5ef40c98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:09.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.263+0000 7f5ef9d9a700 1 --2- 172.21.15.45:0/3586535053 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5ef40cd7c0 0x7f5ef40c98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:09.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.263+0000 7f5ef9d9a700 1 -- 172.21.15.45:0/3586535053 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ef4161340 msgr2=0x7f5ef4158d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:09.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.263+0000 7f5ef9d9a700 1 --2- 172.21.15.45:0/3586535053 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ef4161340 0x7f5ef4158d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:09.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.263+0000 7f5ef9d9a700 1 -- 172.21.15.45:0/3586535053 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ef00094a0 con 0x7f5ef415c9b0 2023-11-28T12:12:09.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.263+0000 7f5ef9d9a700 1 --2- 172.21.15.45:0/3586535053 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ef415c9b0 0x7f5ef40cc680 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f5ee40011e0 tx=0x7f5ee400ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:09.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.263+0000 7f5eeaffd700 1 -- 172.21.15.45:0/3586535053 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee4004c80 con 0x7f5ef415c9b0 2023-11-28T12:12:09.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.263+0000 7f5eeaffd700 1 -- 172.21.15.45:0/3586535053 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ee4004e00 con 0x7f5ef415c9b0 2023-11-28T12:12:09.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.263+0000 7f5eeaffd700 1 -- 172.21.15.45:0/3586535053 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee4007310 con 0x7f5ef415c9b0 2023-11-28T12:12:09.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.263+0000 7f5efc7ff700 1 -- 172.21.15.45:0/3586535053 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5eec009a70 con 0x7f5ef415c9b0 2023-11-28T12:12:09.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.263+0000 7f5efc7ff700 1 -- 172.21.15.45:0/3586535053 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ef40d1300 con 0x7f5ef415c9b0 2023-11-28T12:12:09.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.264+0000 7f5efc7ff700 1 -- 172.21.15.45:0/3586535053 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ef40b5520 con 0x7f5ef415c9b0 2023-11-28T12:12:09.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.265+0000 7f5eeaffd700 1 -- 172.21.15.45:0/3586535053 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f5ee401a020 con 0x7f5ef415c9b0 2023-11-28T12:12:09.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.266+0000 7f5eeaffd700 1 --2- 172.21.15.45:0/3586535053 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5ed80682f0 0x7f5ed806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:09.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.266+0000 7f5eeaffd700 1 -- 172.21.15.45:0/3586535053 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f5ee4085ad0 con 0x7f5ef415c9b0 2023-11-28T12:12:09.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.267+0000 7f5efa59b700 1 --2- 172.21.15.45:0/3586535053 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5ed80682f0 0x7f5ed806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:09.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.267+0000 7f5efa59b700 1 --2- 172.21.15.45:0/3586535053 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5ed80682f0 0x7f5ed806a7a0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f5ef0009c60 tx=0x7f5ef0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:09.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.271+0000 7f5eeaffd700 1 -- 172.21.15.45:0/3586535053 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f5ee4052260 con 0x7f5ef415c9b0 2023-11-28T12:12:09.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.475+0000 7f5efc7ff700 1 -- 172.21.15.45:0/3586535053 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5ef40d15e0 con 0x7f5ef415c9b0 2023-11-28T12:12:09.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.476+0000 7f5eeaffd700 1 -- 172.21.15.45:0/3586535053 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v63) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5ee4055880 con 0x7f5ef415c9b0 2023-11-28T12:12:09.477 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-11-28T12:12:09.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.478+0000 7f5efc7ff700 1 -- 172.21.15.45:0/3586535053 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5ed80682f0 msgr2=0x7f5ed806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:09.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.478+0000 7f5efc7ff700 1 --2- 172.21.15.45:0/3586535053 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5ed80682f0 0x7f5ed806a7a0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f5ef0009c60 tx=0x7f5ef0008040 comp rx=0 tx=0).stop 2023-11-28T12:12:09.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.478+0000 7f5efc7ff700 1 -- 172.21.15.45:0/3586535053 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ef415c9b0 msgr2=0x7f5ef40cc680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:09.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.478+0000 7f5efc7ff700 1 --2- 172.21.15.45:0/3586535053 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ef415c9b0 0x7f5ef40cc680 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f5ee40011e0 tx=0x7f5ee400ca90 comp rx=0 tx=0).stop 2023-11-28T12:12:09.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.478+0000 7f5efc7ff700 1 -- 172.21.15.45:0/3586535053 shutdown_connections 2023-11-28T12:12:09.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.478+0000 7f5efc7ff700 1 --2- 172.21.15.45:0/3586535053 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5ed80682f0 0x7f5ed806a7a0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:09.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.478+0000 7f5efc7ff700 1 --2- 172.21.15.45:0/3586535053 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ef4161340 0x7f5ef4158d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:09.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.478+0000 7f5efc7ff700 1 --2- 172.21.15.45:0/3586535053 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5ef40cd7c0 0x7f5ef40c98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:09.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.478+0000 7f5efc7ff700 1 --2- 172.21.15.45:0/3586535053 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ef415c9b0 0x7f5ef40cc680 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:09.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.478+0000 7f5efc7ff700 1 -- 172.21.15.45:0/3586535053 >> 172.21.15.45:0/3586535053 conn(0x7f5ef4072600 msgr2=0x7f5ef406a900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:09.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.478+0000 7f5efc7ff700 1 -- 172.21.15.45:0/3586535053 shutdown_connections 2023-11-28T12:12:09.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.479+0000 7f5efc7ff700 1 -- 172.21.15.45:0/3586535053 wait complete. 2023-11-28T12:12:09.498 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T12:12:09.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.703+0000 7f7ac37ff700 1 Processor -- start 2023-11-28T12:12:09.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.703+0000 7f7ac37ff700 1 -- start start 2023-11-28T12:12:09.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.704+0000 7f7ac37ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7abc161340 0x7f7abc0d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:09.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.704+0000 7f7ac37ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f7abc0d2320 0x7f7abc0cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:09.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.704+0000 7f7ac37ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7abc0d1950 con 0x7f7abc15c9b0 2023-11-28T12:12:09.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.704+0000 7f7ac37ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7abc0b5800 con 0x7f7abc0d2320 2023-11-28T12:12:09.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.704+0000 7f7ac37ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7abc0b5300 con 0x7f7abc161340 2023-11-28T12:12:09.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.704+0000 7f7ac1d9c700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f7abc0d2320 0x7f7abc0cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:09.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.704+0000 7f7ac0d9a700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7abc161340 0x7f7abc0d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:09.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.704+0000 7f7ac1d9c700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f7abc0d2320 0x7f7abc0cd7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.45:52620/0 (socket says 172.21.15.45:52620) 2023-11-28T12:12:09.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.704+0000 7f7ac1d9c700 1 -- 172.21.15.45:0/4236412291 learned_addr learned my addr 172.21.15.45:0/4236412291 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:12:09.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.705+0000 7f7ac0d9a700 1 -- 172.21.15.45:0/4236412291 >> v2:172.21.15.152:3300/0 conn(0x7f7abc0d2320 msgr2=0x7f7abc0cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:12:09.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.705+0000 7f7ac0d9a700 1 --2- 172.21.15.45:0/4236412291 >> v2:172.21.15.152:3300/0 conn(0x7f7abc0d2320 0x7f7abc0cd7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:09.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.705+0000 7f7ac0d9a700 1 -- 172.21.15.45:0/4236412291 >> v1:172.21.15.152:6789/0 conn(0x7f7abc15c9b0 legacy=0x7f7abc0b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:09.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.705+0000 7f7ac0d9a700 1 -- 172.21.15.45:0/4236412291 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7abc0b5520 con 0x7f7abc161340 2023-11-28T12:12:09.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.705+0000 7f7ac0d9a700 1 --2- 172.21.15.45:0/4236412291 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7abc161340 0x7f7abc0d1de0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7aac009840 tx=0x7f7aac009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3de96698d4f8b608 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:09.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.705+0000 7f7ab3fff700 1 -- 172.21.15.45:0/4236412291 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aac011830 con 0x7f7abc161340 2023-11-28T12:12:09.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.705+0000 7f7ab3fff700 1 -- 172.21.15.45:0/4236412291 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aac011990 con 0x7f7abc161340 2023-11-28T12:12:09.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.705+0000 7f7ab3fff700 1 -- 172.21.15.45:0/4236412291 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aac011d20 con 0x7f7abc161340 2023-11-28T12:12:09.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.706+0000 7f7ac37ff700 1 -- 172.21.15.45:0/4236412291 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7abc161340 msgr2=0x7f7abc0d1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:09.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.706+0000 7f7ac37ff700 1 --2- 172.21.15.45:0/4236412291 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7abc161340 0x7f7abc0d1de0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7aac009840 tx=0x7f7aac009b50 comp rx=0 tx=0).stop 2023-11-28T12:12:09.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.706+0000 7f7ac37ff700 1 -- 172.21.15.45:0/4236412291 shutdown_connections 2023-11-28T12:12:09.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.706+0000 7f7ac37ff700 1 --2- 172.21.15.45:0/4236412291 >> v2:172.21.15.152:3300/0 conn(0x7f7abc0d2320 0x7f7abc0cd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:09.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.706+0000 7f7ac37ff700 1 --2- 172.21.15.45:0/4236412291 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7abc161340 0x7f7abc0d1de0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:09.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.706+0000 7f7ac37ff700 1 -- 172.21.15.45:0/4236412291 >> 172.21.15.45:0/4236412291 conn(0x7f7abc072600 msgr2=0x7f7abc0cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:09.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.706+0000 7f7ac37ff700 1 -- 172.21.15.45:0/4236412291 shutdown_connections 2023-11-28T12:12:09.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.706+0000 7f7ac37ff700 1 -- 172.21.15.45:0/4236412291 wait complete. 2023-11-28T12:12:09.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.708+0000 7f7ac37ff700 1 Processor -- start 2023-11-28T12:12:09.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.708+0000 7f7ac37ff700 1 -- start start 2023-11-28T12:12:09.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.709+0000 7f7ac37ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7abc0d2320 0x7f7abc0cde40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:09.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.709+0000 7f7ac37ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7abc15c9b0 0x7f7abc156690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:09.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.709+0000 7f7ac37ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7abc161340 0x7f7abc15d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:09.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.709+0000 7f7ac37ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7abc0c9bc0 con 0x7f7abc15c9b0 2023-11-28T12:12:09.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.709+0000 7f7ac37ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7abc0c9ea0 con 0x7f7abc0d2320 2023-11-28T12:12:09.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.709+0000 7f7ac37ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7abc1e6640 con 0x7f7abc161340 2023-11-28T12:12:09.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.709+0000 7f7ac0d9a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7abc15c9b0 0x7f7abc156690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:09.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.709+0000 7f7ac0d9a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7abc15c9b0 0x7f7abc156690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47450/0 (socket says 172.21.15.45:47450) 2023-11-28T12:12:09.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.709+0000 7f7ac0d9a700 1 -- 172.21.15.45:0/1199201977 learned_addr learned my addr 172.21.15.45:0/1199201977 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:12:09.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.709+0000 7f7ac1d9c700 1 --2- 172.21.15.45:0/1199201977 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7abc161340 0x7f7abc15d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:09.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.709+0000 7f7ac159b700 1 --2- 172.21.15.45:0/1199201977 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7abc0d2320 0x7f7abc0cde40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:09.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.710+0000 7f7ac0d9a700 1 -- 172.21.15.45:0/1199201977 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7abc161340 msgr2=0x7f7abc15d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:09.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.710+0000 7f7ac0d9a700 1 --2- 172.21.15.45:0/1199201977 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7abc161340 0x7f7abc15d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:09.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.710+0000 7f7ac0d9a700 1 -- 172.21.15.45:0/1199201977 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7abc0d2320 msgr2=0x7f7abc0cde40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:09.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.710+0000 7f7ac0d9a700 1 --2- 172.21.15.45:0/1199201977 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7abc0d2320 0x7f7abc0cde40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:09.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.710+0000 7f7ac0d9a700 1 -- 172.21.15.45:0/1199201977 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aac0094a0 con 0x7f7abc15c9b0 2023-11-28T12:12:09.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.710+0000 7f7ac0d9a700 1 --2- 172.21.15.45:0/1199201977 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7abc15c9b0 0x7f7abc156690 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f7aac009fd0 tx=0x7f7aac004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:09.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.710+0000 7f7ab1ffb700 1 -- 172.21.15.45:0/1199201977 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aac0036a0 con 0x7f7abc15c9b0 2023-11-28T12:12:09.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.710+0000 7f7ab1ffb700 1 -- 172.21.15.45:0/1199201977 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aac01f070 con 0x7f7abc15c9b0 2023-11-28T12:12:09.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.710+0000 7f7ab1ffb700 1 -- 172.21.15.45:0/1199201977 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aac003a60 con 0x7f7abc15c9b0 2023-11-28T12:12:09.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.710+0000 7f7ac37ff700 1 -- 172.21.15.45:0/1199201977 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7abc0d15e0 con 0x7f7abc15c9b0 2023-11-28T12:12:09.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.710+0000 7f7ac37ff700 1 -- 172.21.15.45:0/1199201977 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7abc0d1300 con 0x7f7abc15c9b0 2023-11-28T12:12:09.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.711+0000 7f7ac37ff700 1 -- 172.21.15.45:0/1199201977 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7abc15cd80 con 0x7f7abc15c9b0 2023-11-28T12:12:09.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.712+0000 7f7ab1ffb700 1 -- 172.21.15.45:0/1199201977 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f7aac00f050 con 0x7f7abc15c9b0 2023-11-28T12:12:09.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.713+0000 7f7ab1ffb700 1 --2- 172.21.15.45:0/1199201977 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f7aa00682f0 0x7f7aa006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:09.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.713+0000 7f7ab1ffb700 1 -- 172.21.15.45:0/1199201977 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f7aac021070 con 0x7f7abc15c9b0 2023-11-28T12:12:09.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.714+0000 7f7ac159b700 1 --2- 172.21.15.45:0/1199201977 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f7aa00682f0 0x7f7aa006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:09.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.714+0000 7f7ac159b700 1 --2- 172.21.15.45:0/1199201977 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f7aa00682f0 0x7f7aa006a7a0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f7ab8007fd0 tx=0x7f7ab8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:09.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.717+0000 7f7ab1ffb700 1 -- 172.21.15.45:0/1199201977 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f7aac053d30 con 0x7f7abc15c9b0 2023-11-28T12:12:09.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.921+0000 7f7ac37ff700 1 -- 172.21.15.45:0/1199201977 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7abc1e6b60 con 0x7f7abc15c9b0 2023-11-28T12:12:09.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.922+0000 7f7ab1ffb700 1 -- 172.21.15.45:0/1199201977 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v63) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7abc1e6b60 con 0x7f7abc15c9b0 2023-11-28T12:12:09.923 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-11-28T12:12:09.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.924+0000 7f7ac37ff700 1 -- 172.21.15.45:0/1199201977 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f7aa00682f0 msgr2=0x7f7aa006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:09.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.924+0000 7f7ac37ff700 1 --2- 172.21.15.45:0/1199201977 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f7aa00682f0 0x7f7aa006a7a0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f7ab8007fd0 tx=0x7f7ab8009040 comp rx=0 tx=0).stop 2023-11-28T12:12:09.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.924+0000 7f7ac37ff700 1 -- 172.21.15.45:0/1199201977 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7abc15c9b0 msgr2=0x7f7abc156690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:09.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.924+0000 7f7ac37ff700 1 --2- 172.21.15.45:0/1199201977 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7abc15c9b0 0x7f7abc156690 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f7aac009fd0 tx=0x7f7aac004750 comp rx=0 tx=0).stop 2023-11-28T12:12:09.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.924+0000 7f7ac37ff700 1 -- 172.21.15.45:0/1199201977 shutdown_connections 2023-11-28T12:12:09.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.924+0000 7f7ac37ff700 1 --2- 172.21.15.45:0/1199201977 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f7aa00682f0 0x7f7aa006a7a0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:09.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.924+0000 7f7ac37ff700 1 --2- 172.21.15.45:0/1199201977 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7abc0d2320 0x7f7abc0cde40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:09.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.924+0000 7f7ac37ff700 1 --2- 172.21.15.45:0/1199201977 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7abc161340 0x7f7abc15d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:09.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.924+0000 7f7ac37ff700 1 --2- 172.21.15.45:0/1199201977 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7abc15c9b0 0x7f7abc156690 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:09.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.924+0000 7f7ac37ff700 1 -- 172.21.15.45:0/1199201977 >> 172.21.15.45:0/1199201977 conn(0x7f7abc072600 msgr2=0x7f7abc0b8440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:09.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.924+0000 7f7ac37ff700 1 -- 172.21.15.45:0/1199201977 shutdown_connections 2023-11-28T12:12:09.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:09.924+0000 7f7ac37ff700 1 -- 172.21.15.45:0/1199201977 wait complete. 2023-11-28T12:12:09.945 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T12:12:10.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.147+0000 7f5d9bdff700 1 Processor -- start 2023-11-28T12:12:10.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.148+0000 7f5d9bdff700 1 -- start start 2023-11-28T12:12:10.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.149+0000 7f5d9bdff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5d9415c9b0 0x7f5d940b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:10.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.149+0000 7f5d9bdff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d940d1950 con 0x7f5d94161340 2023-11-28T12:12:10.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.149+0000 7f5d9bdff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d940d24f0 con 0x7f5d940cd7c0 2023-11-28T12:12:10.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.149+0000 7f5d9bdff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d940b5800 con 0x7f5d9415c9b0 2023-11-28T12:12:10.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.149+0000 7f5d99b9b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5d9415c9b0 0x7f5d940b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:10.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.149+0000 7f5d9939a700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f5d94161340 0x7f5d940d1de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:34764/0 (socket says 172.21.15.45:34764) 2023-11-28T12:12:10.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.149+0000 7f5d9939a700 1 -- 172.21.15.45:0/1265298941 learned_addr learned my addr 172.21.15.45:0/1265298941 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:12:10.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.149+0000 7f5d99b9b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5d9415c9b0 0x7f5d940b4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47466/0 (socket says 172.21.15.45:47466) 2023-11-28T12:12:10.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.149+0000 7f5d99b9b700 1 -- 172.21.15.45:0/1265298941 >> v1:172.21.15.152:6789/0 conn(0x7f5d940cd7c0 legacy=0x7f5d940b5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:12:10.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.149+0000 7f5d99b9b700 1 -- 172.21.15.45:0/1265298941 >> v1:172.21.15.45:6789/0 conn(0x7f5d94161340 legacy=0x7f5d940d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:10.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.149+0000 7f5d99b9b700 1 -- 172.21.15.45:0/1265298941 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d940b5520 con 0x7f5d9415c9b0 2023-11-28T12:12:10.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.150+0000 7f5d99b9b700 1 --2- 172.21.15.45:0/1265298941 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d9415c9b0 0x7f5d940b4bf0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f5d90009840 tx=0x7f5d90009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d55c5b8fef98447 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:10.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.150+0000 7f5d98b99700 1 -- 172.21.15.45:0/1265298941 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d90004230 con 0x7f5d9415c9b0 2023-11-28T12:12:10.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.150+0000 7f5d98b99700 1 -- 172.21.15.45:0/1265298941 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d90004390 con 0x7f5d9415c9b0 2023-11-28T12:12:10.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.150+0000 7f5d98b99700 1 -- 172.21.15.45:0/1265298941 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d900036a0 con 0x7f5d9415c9b0 2023-11-28T12:12:10.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.150+0000 7f5d9bdff700 1 -- 172.21.15.45:0/1265298941 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d9415c9b0 msgr2=0x7f5d940b4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:10.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.150+0000 7f5d9bdff700 1 --2- 172.21.15.45:0/1265298941 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d9415c9b0 0x7f5d940b4bf0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f5d90009840 tx=0x7f5d90009b50 comp rx=0 tx=0).stop 2023-11-28T12:12:10.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.151+0000 7f5d9bdff700 1 -- 172.21.15.45:0/1265298941 shutdown_connections 2023-11-28T12:12:10.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.151+0000 7f5d9bdff700 1 --2- 172.21.15.45:0/1265298941 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d9415c9b0 0x7f5d940b4bf0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:10.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.151+0000 7f5d9bdff700 1 -- 172.21.15.45:0/1265298941 >> 172.21.15.45:0/1265298941 conn(0x7f5d94072600 msgr2=0x7f5d940cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:10.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.151+0000 7f5d9bdff700 1 -- 172.21.15.45:0/1265298941 shutdown_connections 2023-11-28T12:12:10.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.151+0000 7f5d9bdff700 1 -- 172.21.15.45:0/1265298941 wait complete. 2023-11-28T12:12:10.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.152+0000 7f5d9bdff700 1 Processor -- start 2023-11-28T12:12:10.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.153+0000 7f5d9bdff700 1 -- start start 2023-11-28T12:12:10.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.153+0000 7f5d9bdff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5d940cd7c0 0x7f5d9414a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:10.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.153+0000 7f5d9bdff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d9415c9b0 0x7f5d940b7480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:10.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.153+0000 7f5d9bdff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5d94161340 0x7f5d940b79c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:10.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.153+0000 7f5d9bdff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d940cc700 con 0x7f5d9415c9b0 2023-11-28T12:12:10.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.153+0000 7f5d9bdff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d940cc9e0 con 0x7f5d940cd7c0 2023-11-28T12:12:10.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.153+0000 7f5d9bdff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d940cccc0 con 0x7f5d94161340 2023-11-28T12:12:10.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.154+0000 7f5d9939a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d9415c9b0 0x7f5d940b7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:10.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.154+0000 7f5d9939a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d9415c9b0 0x7f5d940b7480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47472/0 (socket says 172.21.15.45:47472) 2023-11-28T12:12:10.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.154+0000 7f5d9939a700 1 -- 172.21.15.45:0/497311744 learned_addr learned my addr 172.21.15.45:0/497311744 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:12:10.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.154+0000 7f5d9939a700 1 -- 172.21.15.45:0/497311744 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5d94161340 msgr2=0x7f5d940b79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:10.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.154+0000 7f5d9939a700 1 --2- 172.21.15.45:0/497311744 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5d94161340 0x7f5d940b79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:10.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.154+0000 7f5d99b9b700 1 --2- 172.21.15.45:0/497311744 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5d940cd7c0 0x7f5d9414a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:10.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.154+0000 7f5d9939a700 1 -- 172.21.15.45:0/497311744 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5d940cd7c0 msgr2=0x7f5d9414a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:10.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.154+0000 7f5d9939a700 1 --2- 172.21.15.45:0/497311744 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5d940cd7c0 0x7f5d9414a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:10.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.154+0000 7f5d9939a700 1 -- 172.21.15.45:0/497311744 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d900094a0 con 0x7f5d9415c9b0 2023-11-28T12:12:10.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.154+0000 7f5d99b9b700 1 --2- 172.21.15.45:0/497311744 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5d940cd7c0 0x7f5d9414a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:12:10.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.154+0000 7f5d9939a700 1 --2- 172.21.15.45:0/497311744 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d9415c9b0 0x7f5d940b7480 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f5d8400c490 tx=0x7f5d8400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:10.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.155+0000 7f5d8a7fc700 1 -- 172.21.15.45:0/497311744 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d84005d70 con 0x7f5d9415c9b0 2023-11-28T12:12:10.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.155+0000 7f5d8a7fc700 1 -- 172.21.15.45:0/497311744 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d840070d0 con 0x7f5d9415c9b0 2023-11-28T12:12:10.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.155+0000 7f5d8a7fc700 1 -- 172.21.15.45:0/497311744 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d84007460 con 0x7f5d9415c9b0 2023-11-28T12:12:10.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.155+0000 7f5d9bdff700 1 -- 172.21.15.45:0/497311744 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d940d15e0 con 0x7f5d9415c9b0 2023-11-28T12:12:10.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.155+0000 7f5d9bdff700 1 -- 172.21.15.45:0/497311744 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d940d1300 con 0x7f5d9415c9b0 2023-11-28T12:12:10.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.156+0000 7f5d9bdff700 1 -- 172.21.15.45:0/497311744 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d940b5130 con 0x7f5d9415c9b0 2023-11-28T12:12:10.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.157+0000 7f5d8a7fc700 1 -- 172.21.15.45:0/497311744 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f5d84019030 con 0x7f5d9415c9b0 2023-11-28T12:12:10.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.158+0000 7f5d8a7fc700 1 --2- 172.21.15.45:0/497311744 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5d780682f0 0x7f5d7806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:10.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.158+0000 7f5d8a7fc700 1 -- 172.21.15.45:0/497311744 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f5d840850f0 con 0x7f5d9415c9b0 2023-11-28T12:12:10.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.158+0000 7f5d99b9b700 1 --2- 172.21.15.45:0/497311744 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5d780682f0 0x7f5d7806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:10.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.159+0000 7f5d99b9b700 1 --2- 172.21.15.45:0/497311744 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5d780682f0 0x7f5d7806a7a0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f5d900090b0 tx=0x7f5d90013040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:10.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.162+0000 7f5d8a7fc700 1 -- 172.21.15.45:0/497311744 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f5d840518c0 con 0x7f5d9415c9b0 2023-11-28T12:12:10.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.381+0000 7f5d9bdff700 1 -- 172.21.15.45:0/497311744 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f5d940745c0 con 0x7f5d9415c9b0 2023-11-28T12:12:10.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.381+0000 7f5d8a7fc700 1 -- 172.21.15.45:0/497311744 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v63) v1 ==== 80+0+0 (secure 0 0 0) 0x7f5d84054ee0 con 0x7f5d9415c9b0 2023-11-28T12:12:10.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.384+0000 7f5d9bdff700 1 -- 172.21.15.45:0/497311744 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5d780682f0 msgr2=0x7f5d7806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:10.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.384+0000 7f5d9bdff700 1 --2- 172.21.15.45:0/497311744 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5d780682f0 0x7f5d7806a7a0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f5d900090b0 tx=0x7f5d90013040 comp rx=0 tx=0).stop 2023-11-28T12:12:10.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.384+0000 7f5d9bdff700 1 -- 172.21.15.45:0/497311744 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d9415c9b0 msgr2=0x7f5d940b7480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:10.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.384+0000 7f5d9bdff700 1 --2- 172.21.15.45:0/497311744 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d9415c9b0 0x7f5d940b7480 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f5d8400c490 tx=0x7f5d8400c850 comp rx=0 tx=0).stop 2023-11-28T12:12:10.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.384+0000 7f5d9bdff700 1 -- 172.21.15.45:0/497311744 shutdown_connections 2023-11-28T12:12:10.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.384+0000 7f5d9bdff700 1 --2- 172.21.15.45:0/497311744 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5d780682f0 0x7f5d7806a7a0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:10.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.384+0000 7f5d9bdff700 1 --2- 172.21.15.45:0/497311744 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5d940cd7c0 0x7f5d9414a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:10.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.384+0000 7f5d9bdff700 1 --2- 172.21.15.45:0/497311744 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5d94161340 0x7f5d940b79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:10.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.384+0000 7f5d9bdff700 1 --2- 172.21.15.45:0/497311744 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d9415c9b0 0x7f5d940b7480 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:10.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.384+0000 7f5d9bdff700 1 -- 172.21.15.45:0/497311744 >> 172.21.15.45:0/497311744 conn(0x7f5d94072600 msgr2=0x7f5d9415a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:10.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.384+0000 7f5d9bdff700 1 -- 172.21.15.45:0/497311744 shutdown_connections 2023-11-28T12:12:10.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.384+0000 7f5d9bdff700 1 -- 172.21.15.45:0/497311744 wait complete. 2023-11-28T12:12:10.387 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-11-28T12:12:10.403 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-28T12:12:10.404 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:12:10.404 DEBUG:teuthology.orchestra.run.smithi045:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-11-28T12:12:10.505 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi045.front.sepia.ceph.com 2023-11-28T12:12:10.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:12:10.506 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-28T12:12:10.564 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-11-28T12:12:10.564 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T12:12:10.613 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16348296k,nr_inodes=4087074,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=41,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275620k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-11-28T12:12:10.613 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T12:12:10.613 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T12:12:10.660 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16351388k,nr_inodes=4087847,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=41,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3276240k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-11-28T12:12:10.660 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-11-28T12:12:10.660 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T12:12:10.707 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16348296k,nr_inodes=4087074,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=41,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275620k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-11-28T12:12:10.707 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T12:12:10.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.908+0000 7fb2d7bff700 1 Processor -- start 2023-11-28T12:12:10.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.909+0000 7fb2d7bff700 1 -- start start 2023-11-28T12:12:10.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.910+0000 7fb2d7bff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb2d00cd7c0 0x7fb2d00cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:10.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.911+0000 7fb2d7bff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2d00d1950 con 0x7fb2d0161340 2023-11-28T12:12:10.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.911+0000 7fb2d7bff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2d00ce140 con 0x7fb2d015c9b0 2023-11-28T12:12:10.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.911+0000 7fb2d7bff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2d00b5800 con 0x7fb2d00cd7c0 2023-11-28T12:12:10.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.911+0000 7fb2d519a700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fb2d0161340 0x7fb2d00d1de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:34772/0 (socket says 172.21.15.45:34772) 2023-11-28T12:12:10.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.911+0000 7fb2d519a700 1 -- 172.21.15.45:0/4230771391 learned_addr learned my addr 172.21.15.45:0/4230771391 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:12:10.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.911+0000 7fb2d619c700 1 --2- 172.21.15.45:0/4230771391 >> v2:172.21.15.45:3300/0 conn(0x7fb2d00cd7c0 0x7fb2d00cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:10.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.911+0000 7fb2d4999700 1 -- 172.21.15.45:0/4230771391 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4149044770 0 0) 0x7fb2d00d1950 con 0x7fb2d0161340 2023-11-28T12:12:10.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.911+0000 7fb2d4999700 1 -- 172.21.15.45:0/4230771391 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2bc0035b0 con 0x7fb2d0161340 2023-11-28T12:12:10.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.911+0000 7fb2d619c700 1 -- 172.21.15.45:0/4230771391 >> v1:172.21.15.152:6789/0 conn(0x7fb2d015c9b0 legacy=0x7fb2d00b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:10.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.911+0000 7fb2d619c700 1 -- 172.21.15.45:0/4230771391 >> v1:172.21.15.45:6789/0 conn(0x7fb2d0161340 legacy=0x7fb2d00d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:10.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.911+0000 7fb2d619c700 1 -- 172.21.15.45:0/4230771391 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d00d24f0 con 0x7fb2d00cd7c0 2023-11-28T12:12:10.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.912+0000 7fb2d619c700 1 --2- 172.21.15.45:0/4230771391 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2d00cd7c0 0x7fb2d00cdc00 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fb2c8009d90 tx=0x7fb2c800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=428daca5bc4de334 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:10.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.912+0000 7fb2d4999700 1 -- 172.21.15.45:0/4230771391 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c800e070 con 0x7fb2d00cd7c0 2023-11-28T12:12:10.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.912+0000 7fb2d4999700 1 -- 172.21.15.45:0/4230771391 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2c800bb20 con 0x7fb2d00cd7c0 2023-11-28T12:12:10.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.912+0000 7fb2d4999700 1 -- 172.21.15.45:0/4230771391 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c8012430 con 0x7fb2d00cd7c0 2023-11-28T12:12:10.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.912+0000 7fb2d7bff700 1 -- 172.21.15.45:0/4230771391 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2d00cd7c0 msgr2=0x7fb2d00cdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:10.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.912+0000 7fb2d7bff700 1 --2- 172.21.15.45:0/4230771391 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2d00cd7c0 0x7fb2d00cdc00 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fb2c8009d90 tx=0x7fb2c800b330 comp rx=0 tx=0).stop 2023-11-28T12:12:10.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.913+0000 7fb2d7bff700 1 -- 172.21.15.45:0/4230771391 shutdown_connections 2023-11-28T12:12:10.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.913+0000 7fb2d7bff700 1 --2- 172.21.15.45:0/4230771391 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2d00cd7c0 0x7fb2d00cdc00 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:10.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.913+0000 7fb2d7bff700 1 -- 172.21.15.45:0/4230771391 >> 172.21.15.45:0/4230771391 conn(0x7fb2d0072600 msgr2=0x7fb2d00cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:10.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.913+0000 7fb2d7bff700 1 -- 172.21.15.45:0/4230771391 shutdown_connections 2023-11-28T12:12:10.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.913+0000 7fb2d7bff700 1 -- 172.21.15.45:0/4230771391 wait complete. 2023-11-28T12:12:10.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.914+0000 7fb2d7bff700 1 Processor -- start 2023-11-28T12:12:10.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.915+0000 7fb2d7bff700 1 -- start start 2023-11-28T12:12:10.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.915+0000 7fb2d7bff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb2d00cd7c0 0x7fb2d014a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:10.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.915+0000 7fb2d7bff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2d015c9b0 0x7fb2d01e85b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:10.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.916+0000 7fb2d7bff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb2d0161340 0x7fb2d015e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:10.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.916+0000 7fb2d7bff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d0157ba0 con 0x7fb2d015c9b0 2023-11-28T12:12:10.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.916+0000 7fb2d7bff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d01e7b60 con 0x7fb2d0161340 2023-11-28T12:12:10.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.916+0000 7fb2d7bff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d01e7090 con 0x7fb2d00cd7c0 2023-11-28T12:12:10.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.916+0000 7fb2d519a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2d015c9b0 0x7fb2d01e85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:10.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.916+0000 7fb2d519a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2d015c9b0 0x7fb2d01e85b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47496/0 (socket says 172.21.15.45:47496) 2023-11-28T12:12:10.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.916+0000 7fb2d519a700 1 -- 172.21.15.45:0/2067640292 learned_addr learned my addr 172.21.15.45:0/2067640292 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:12:10.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.916+0000 7fb2d619c700 1 --2- 172.21.15.45:0/2067640292 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb2d0161340 0x7fb2d015e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:10.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.916+0000 7fb2d599b700 1 --2- 172.21.15.45:0/2067640292 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb2d00cd7c0 0x7fb2d014a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:10.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.916+0000 7fb2d519a700 1 -- 172.21.15.45:0/2067640292 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb2d00cd7c0 msgr2=0x7fb2d014a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:10.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.916+0000 7fb2d519a700 1 --2- 172.21.15.45:0/2067640292 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb2d00cd7c0 0x7fb2d014a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:10.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.916+0000 7fb2d519a700 1 -- 172.21.15.45:0/2067640292 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb2d0161340 msgr2=0x7fb2d015e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:10.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.916+0000 7fb2d519a700 1 --2- 172.21.15.45:0/2067640292 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb2d0161340 0x7fb2d015e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:10.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.916+0000 7fb2d519a700 1 -- 172.21.15.45:0/2067640292 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2c8009a70 con 0x7fb2d015c9b0 2023-11-28T12:12:10.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.917+0000 7fb2d519a700 1 --2- 172.21.15.45:0/2067640292 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2d015c9b0 0x7fb2d01e85b0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fb2c000c700 tx=0x7fb2c000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:10.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.917+0000 7fb2c67fc700 1 -- 172.21.15.45:0/2067640292 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c0005d70 con 0x7fb2d015c9b0 2023-11-28T12:12:10.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.917+0000 7fb2c67fc700 1 -- 172.21.15.45:0/2067640292 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2c00070d0 con 0x7fb2d015c9b0 2023-11-28T12:12:10.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.917+0000 7fb2d7bff700 1 -- 172.21.15.45:0/2067640292 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2d00d1300 con 0x7fb2d015c9b0 2023-11-28T12:12:10.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.917+0000 7fb2c67fc700 1 -- 172.21.15.45:0/2067640292 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c0007460 con 0x7fb2d015c9b0 2023-11-28T12:12:10.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.917+0000 7fb2d7bff700 1 -- 172.21.15.45:0/2067640292 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2d00b5520 con 0x7fb2d015c9b0 2023-11-28T12:12:10.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.918+0000 7fb2d7bff700 1 -- 172.21.15.45:0/2067640292 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2d00d15e0 con 0x7fb2d015c9b0 2023-11-28T12:12:10.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.919+0000 7fb2c67fc700 1 -- 172.21.15.45:0/2067640292 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fb2c0019030 con 0x7fb2d015c9b0 2023-11-28T12:12:10.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.920+0000 7fb2c67fc700 1 --2- 172.21.15.45:0/2067640292 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb2b40682f0 0x7fb2b406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:10.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.920+0000 7fb2c67fc700 1 -- 172.21.15.45:0/2067640292 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6207+0+0 (secure 0 0 0) 0x7fb2c0085090 con 0x7fb2d015c9b0 2023-11-28T12:12:10.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.921+0000 7fb2d599b700 1 --2- 172.21.15.45:0/2067640292 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb2b40682f0 0x7fb2b406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:10.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.921+0000 7fb2d599b700 1 --2- 172.21.15.45:0/2067640292 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb2b40682f0 0x7fb2b406a7a0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc007fd0 tx=0x7fb2cc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:10.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:10.924+0000 7fb2c67fc700 1 -- 172.21.15.45:0/2067640292 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fb2c0051710 con 0x7fb2d015c9b0 2023-11-28T12:12:11.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.171+0000 7fb2d7bff700 1 -- 172.21.15.45:0/2067640292 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb2d00745c0 con 0x7fb2d015c9b0 2023-11-28T12:12:11.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.171+0000 7fb2c67fc700 1 -- 172.21.15.45:0/2067640292 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+4649 (secure 0 0 0) 0x7fb2c0017020 con 0x7fb2d015c9b0 2023-11-28T12:12:11.173 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:12:11.173 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":33,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5423,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6836/735970231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":735970231},{"type":"v1","addr":"172.21.15.152:6836","nonce":735970231}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5797,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/3354918087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6835","nonce":3354918087},{"type":"v1","addr":"172.21.15.152:6837","nonce":3354918087}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5806,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/275804060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":275804060},{"type":"v1","addr":"172.21.15.45:6835","nonce":275804060}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T12:09:35.571815+0000","modified":"2023-11-28T12:09:51.897203+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5979},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5979":{"gid":5979,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":7,"addr":"172.21.15.45:6833/3784258337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":3784258337},{"type":"v1","addr":"172.21.15.45:6833","nonce":3784258337}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-28T12:12:11.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.174+0000 7fb2d7bff700 1 -- 172.21.15.45:0/2067640292 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb2b40682f0 msgr2=0x7fb2b406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:11.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.174+0000 7fb2d7bff700 1 --2- 172.21.15.45:0/2067640292 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb2b40682f0 0x7fb2b406a7a0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc007fd0 tx=0x7fb2cc009040 comp rx=0 tx=0).stop 2023-11-28T12:12:11.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.174+0000 7fb2d7bff700 1 -- 172.21.15.45:0/2067640292 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2d015c9b0 msgr2=0x7fb2d01e85b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:11.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.174+0000 7fb2d7bff700 1 --2- 172.21.15.45:0/2067640292 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2d015c9b0 0x7fb2d01e85b0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fb2c000c700 tx=0x7fb2c000ca10 comp rx=0 tx=0).stop 2023-11-28T12:12:11.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.174+0000 7fb2d7bff700 1 -- 172.21.15.45:0/2067640292 shutdown_connections 2023-11-28T12:12:11.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.174+0000 7fb2d7bff700 1 --2- 172.21.15.45:0/2067640292 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb2b40682f0 0x7fb2b406a7a0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:11.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.174+0000 7fb2d7bff700 1 --2- 172.21.15.45:0/2067640292 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb2d0161340 0x7fb2d015e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:11.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.174+0000 7fb2d7bff700 1 --2- 172.21.15.45:0/2067640292 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb2d00cd7c0 0x7fb2d014a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:11.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.174+0000 7fb2d7bff700 1 --2- 172.21.15.45:0/2067640292 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2d015c9b0 0x7fb2d01e85b0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:11.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.174+0000 7fb2d7bff700 1 -- 172.21.15.45:0/2067640292 >> 172.21.15.45:0/2067640292 conn(0x7fb2d0072600 msgr2=0x7fb2d006a900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:11.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.174+0000 7fb2d7bff700 1 -- 172.21.15.45:0/2067640292 shutdown_connections 2023-11-28T12:12:11.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.174+0000 7fb2d7bff700 1 -- 172.21.15.45:0/2067640292 wait complete. 2023-11-28T12:12:11.177 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 33 2023-11-28T12:12:11.194 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T12:12:11.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.395+0000 7feaed9ff700 1 Processor -- start 2023-11-28T12:12:11.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.395+0000 7feaed9ff700 1 -- start start 2023-11-28T12:12:11.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.396+0000 7feaed9ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7feae815c9b0 0x7feae80b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:11.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.396+0000 7feaed9ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7feae80cd7c0 0x7feae80cdc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:11.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.396+0000 7feaed9ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feae80ce160 con 0x7feae8161340 2023-11-28T12:12:11.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.396+0000 7feaed9ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feae80b5800 con 0x7feae80cd7c0 2023-11-28T12:12:11.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.396+0000 7feaed9ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feae80d1950 con 0x7feae815c9b0 2023-11-28T12:12:11.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.397+0000 7feae67fc700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7feae8161340 0x7feae80d1de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:34780/0 (socket says 172.21.15.45:34780) 2023-11-28T12:12:11.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.397+0000 7feae67fc700 1 -- 172.21.15.45:0/808961175 learned_addr learned my addr 172.21.15.45:0/808961175 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:12:11.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.397+0000 7feae77fe700 1 --2- 172.21.15.45:0/808961175 >> v2:172.21.15.152:3300/0 conn(0x7feae80cd7c0 0x7feae80cdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:11.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.397+0000 7feae6ffd700 1 --2- 172.21.15.45:0/808961175 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7feae815c9b0 0x7feae80b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:11.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.397+0000 7feae5ffb700 1 -- 172.21.15.45:0/808961175 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4127248707 0 0) 0x7feae80ce160 con 0x7feae8161340 2023-11-28T12:12:11.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.397+0000 7feae5ffb700 1 -- 172.21.15.45:0/808961175 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fead00035b0 con 0x7feae8161340 2023-11-28T12:12:11.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.397+0000 7feae77fe700 1 -- 172.21.15.45:0/808961175 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7feae815c9b0 msgr2=0x7feae80b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:12:11.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.397+0000 7feae77fe700 1 --2- 172.21.15.45:0/808961175 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7feae815c9b0 0x7feae80b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:11.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.397+0000 7feae77fe700 1 -- 172.21.15.45:0/808961175 >> v1:172.21.15.45:6789/0 conn(0x7feae8161340 legacy=0x7feae80d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:11.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.397+0000 7feae77fe700 1 -- 172.21.15.45:0/808961175 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae80d24f0 con 0x7feae80cd7c0 2023-11-28T12:12:11.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.397+0000 7feae6ffd700 1 --2- 172.21.15.45:0/808961175 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7feae815c9b0 0x7feae80b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:12:11.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.398+0000 7feae77fe700 1 --2- 172.21.15.45:0/808961175 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feae80cd7c0 0x7feae80cdc20 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7feae0009d90 tx=0x7feae000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=559a2e8a2463704b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:11.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.398+0000 7feae5ffb700 1 -- 172.21.15.45:0/808961175 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae000e070 con 0x7feae80cd7c0 2023-11-28T12:12:11.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.398+0000 7feae5ffb700 1 -- 172.21.15.45:0/808961175 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feae000bb20 con 0x7feae80cd7c0 2023-11-28T12:12:11.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.398+0000 7feae5ffb700 1 -- 172.21.15.45:0/808961175 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae0012430 con 0x7feae80cd7c0 2023-11-28T12:12:11.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.398+0000 7feaed9ff700 1 -- 172.21.15.45:0/808961175 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feae80cd7c0 msgr2=0x7feae80cdc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:11.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.398+0000 7feaed9ff700 1 --2- 172.21.15.45:0/808961175 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feae80cd7c0 0x7feae80cdc20 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7feae0009d90 tx=0x7feae000b330 comp rx=0 tx=0).stop 2023-11-28T12:12:11.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.399+0000 7feaed9ff700 1 -- 172.21.15.45:0/808961175 shutdown_connections 2023-11-28T12:12:11.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.399+0000 7feaed9ff700 1 --2- 172.21.15.45:0/808961175 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feae80cd7c0 0x7feae80cdc20 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:11.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.399+0000 7feaed9ff700 1 --2- 172.21.15.45:0/808961175 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7feae815c9b0 0x7feae80b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:11.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.399+0000 7feaed9ff700 1 -- 172.21.15.45:0/808961175 >> 172.21.15.45:0/808961175 conn(0x7feae8072600 msgr2=0x7feae80cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:11.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.399+0000 7feaed9ff700 1 -- 172.21.15.45:0/808961175 shutdown_connections 2023-11-28T12:12:11.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.399+0000 7feaed9ff700 1 -- 172.21.15.45:0/808961175 wait complete. 2023-11-28T12:12:11.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.400+0000 7feaed9ff700 1 Processor -- start 2023-11-28T12:12:11.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.401+0000 7feaed9ff700 1 -- start start 2023-11-28T12:12:11.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.401+0000 7feaed9ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feae80cd7c0 0x7feae81f6640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:11.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.401+0000 7feaed9ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feae815c9b0 0x7feae80c9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:11.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.401+0000 7feaed9ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7feae8161340 0x7feae81f5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:11.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.401+0000 7feaed9ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae80ca090 con 0x7feae80cd7c0 2023-11-28T12:12:11.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.401+0000 7feaed9ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae80c72c0 con 0x7feae815c9b0 2023-11-28T12:12:11.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.401+0000 7feaed9ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feae80c75a0 con 0x7feae8161340 2023-11-28T12:12:11.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.402+0000 7feae6ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feae80cd7c0 0x7feae81f6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:11.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.402+0000 7feae6ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feae80cd7c0 0x7feae81f6640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47504/0 (socket says 172.21.15.45:47504) 2023-11-28T12:12:11.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.402+0000 7feae6ffd700 1 -- 172.21.15.45:0/671986072 learned_addr learned my addr 172.21.15.45:0/671986072 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:12:11.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.402+0000 7feae6ffd700 1 -- 172.21.15.45:0/671986072 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7feae8161340 msgr2=0x7feae81f5a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:11.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.402+0000 7feae6ffd700 1 --2- 172.21.15.45:0/671986072 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7feae8161340 0x7feae81f5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:11.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.402+0000 7feae67fc700 1 --2- 172.21.15.45:0/671986072 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feae815c9b0 0x7feae80c9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:11.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.402+0000 7feae6ffd700 1 -- 172.21.15.45:0/671986072 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feae815c9b0 msgr2=0x7feae80c9840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:11.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.402+0000 7feae6ffd700 1 --2- 172.21.15.45:0/671986072 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feae815c9b0 0x7feae80c9840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:11.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.402+0000 7feae6ffd700 1 -- 172.21.15.45:0/671986072 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fead80094a0 con 0x7feae80cd7c0 2023-11-28T12:12:11.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.402+0000 7feae67fc700 1 --2- 172.21.15.45:0/671986072 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feae815c9b0 0x7feae80c9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:12:11.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.402+0000 7feae6ffd700 1 --2- 172.21.15.45:0/671986072 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feae80cd7c0 0x7feae81f6640 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fead800ebe0 tx=0x7fead8009e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:11.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.403+0000 7feacffff700 1 -- 172.21.15.45:0/671986072 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead800c8b0 con 0x7feae80cd7c0 2023-11-28T12:12:11.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.403+0000 7feacffff700 1 -- 172.21.15.45:0/671986072 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fead800ca10 con 0x7feae80cd7c0 2023-11-28T12:12:11.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.403+0000 7feacffff700 1 -- 172.21.15.45:0/671986072 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead800cda0 con 0x7feae80cd7c0 2023-11-28T12:12:11.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.403+0000 7feaed9ff700 1 -- 172.21.15.45:0/671986072 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feae0009a70 con 0x7feae80cd7c0 2023-11-28T12:12:11.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.403+0000 7feaed9ff700 1 -- 172.21.15.45:0/671986072 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feae80d1300 con 0x7feae80cd7c0 2023-11-28T12:12:11.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.404+0000 7feaed9ff700 1 -- 172.21.15.45:0/671986072 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feae80b5520 con 0x7feae80cd7c0 2023-11-28T12:12:11.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.405+0000 7feacffff700 1 -- 172.21.15.45:0/671986072 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fead8019030 con 0x7feae80cd7c0 2023-11-28T12:12:11.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.406+0000 7feacffff700 1 --2- 172.21.15.45:0/671986072 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fead40682f0 0x7fead406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:11.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.406+0000 7feacffff700 1 -- 172.21.15.45:0/671986072 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6207+0+0 (secure 0 0 0) 0x7fead8085d00 con 0x7feae80cd7c0 2023-11-28T12:12:11.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.406+0000 7feae67fc700 1 --2- 172.21.15.45:0/671986072 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fead40682f0 0x7fead406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:11.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.407+0000 7feae67fc700 1 --2- 172.21.15.45:0/671986072 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fead40682f0 0x7fead406a7a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7feae81f6b80 tx=0x7feadc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:11.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.410+0000 7feacffff700 1 -- 172.21.15.45:0/671986072 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fead8089030 con 0x7feae80cd7c0 2023-11-28T12:12:11.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.615+0000 7feaed9ff700 1 -- 172.21.15.45:0/671986072 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feae80c7ed0 con 0x7feae80cd7c0 2023-11-28T12:12:11.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.616+0000 7feacffff700 1 -- 172.21.15.45:0/671986072 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) v1 ==== 74+0+18103 (secure 0 0 0) 0x7fead8021090 con 0x7feae80cd7c0 2023-11-28T12:12:11.618 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:12:11.618 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":63,"fsid":"bd7c37f1-f7c6-4778-b845-52cf2aa6e366","created":"2023-11-28T12:06:09.045075+0000","modified":"2023-11-28T12:10:19.965300+0000","last_up_change":"2023-11-28T12:06:21.282227+0000","last_in_change":"2023-11-28T12:06:12.560924+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T12:06:21.807108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T12:06:22.491009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-11-28T12:09:33.476735+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-11-28T12:09:34.551527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d0cdd8a-87fd-4f2c-91bd-47bdfa661905","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":115843},{"type":"v1","addr":"172.21.15.45:6808","nonce":115843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":115843},{"type":"v1","addr":"172.21.15.45:6811","nonce":115843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":115843},{"type":"v1","addr":"172.21.15.45:6815","nonce":115843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":115843},{"type":"v1","addr":"172.21.15.45:6813","nonce":115843}]},"public_addr":"172.21.15.45:6808/115843","cluster_addr":"172.21.15.45:6811/115843","heartbeat_back_addr":"172.21.15.45:6815/115843","heartbeat_front_addr":"172.21.15.45:6813/115843","state":["exists","up"]},{"osd":1,"uuid":"c5de4ebd-9ec5-40b3-9caa-9b706fab4c76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":115842},{"type":"v1","addr":"172.21.15.45:6801","nonce":115842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":115842},{"type":"v1","addr":"172.21.15.45:6803","nonce":115842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6807","nonce":115842},{"type":"v1","addr":"172.21.15.45:6809","nonce":115842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":115842},{"type":"v1","addr":"172.21.15.45:6805","nonce":115842}]},"public_addr":"172.21.15.45:6801/115842","cluster_addr":"172.21.15.45:6803/115842","heartbeat_back_addr":"172.21.15.45:6809/115842","heartbeat_front_addr":"172.21.15.45:6805/115842","state":["exists","up"]},{"osd":2,"uuid":"9f4b36b2-65d2-40e7-9fe6-a2991afa71c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":115850},{"type":"v1","addr":"172.21.15.45:6819","nonce":115850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":115850},{"type":"v1","addr":"172.21.15.45:6823","nonce":115850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":115850},{"type":"v1","addr":"172.21.15.45:6831","nonce":115850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":115850},{"type":"v1","addr":"172.21.15.45:6828","nonce":115850}]},"public_addr":"172.21.15.45:6819/115850","cluster_addr":"172.21.15.45:6823/115850","heartbeat_back_addr":"172.21.15.45:6831/115850","heartbeat_front_addr":"172.21.15.45:6828/115850","state":["exists","up"]},{"osd":3,"uuid":"6fe7ef05-4e0d-426c-bf94-44b51d4d550b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":115848},{"type":"v1","addr":"172.21.15.45:6818","nonce":115848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":115848},{"type":"v1","addr":"172.21.15.45:6822","nonce":115848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6827","nonce":115848},{"type":"v1","addr":"172.21.15.45:6829","nonce":115848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":115848},{"type":"v1","addr":"172.21.15.45:6825","nonce":115848}]},"public_addr":"172.21.15.45:6818/115848","cluster_addr":"172.21.15.45:6822/115848","heartbeat_back_addr":"172.21.15.45:6829/115848","heartbeat_front_addr":"172.21.15.45:6825/115848","state":["exists","up"]},{"osd":4,"uuid":"fa403c08-d8a1-4a3a-8384-cb465c1a654c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":116092},{"type":"v1","addr":"172.21.15.152:6801","nonce":116092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":116092},{"type":"v1","addr":"172.21.15.152:6803","nonce":116092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":116092},{"type":"v1","addr":"172.21.15.152:6807","nonce":116092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":116092},{"type":"v1","addr":"172.21.15.152:6805","nonce":116092}]},"public_addr":"172.21.15.152:6801/116092","cluster_addr":"172.21.15.152:6803/116092","heartbeat_back_addr":"172.21.15.152:6807/116092","heartbeat_front_addr":"172.21.15.152:6805/116092","state":["exists","up"]},{"osd":5,"uuid":"399fc450-39fa-43a6-bf80-0b8bcb41bd95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6815","nonce":116093},{"type":"v1","addr":"172.21.15.152:6817","nonce":116093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":116093},{"type":"v1","addr":"172.21.15.152:6819","nonce":116093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":116093},{"type":"v1","addr":"172.21.15.152:6823","nonce":116093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":116093},{"type":"v1","addr":"172.21.15.152:6821","nonce":116093}]},"public_addr":"172.21.15.152:6817/116093","cluster_addr":"172.21.15.152:6819/116093","heartbeat_back_addr":"172.21.15.152:6823/116093","heartbeat_front_addr":"172.21.15.152:6821/116093","state":["exists","up"]},{"osd":6,"uuid":"e59a4017-2d23-4627-836b-e25b2d3ddaaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":116094},{"type":"v1","addr":"172.21.15.152:6809","nonce":116094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":116094},{"type":"v1","addr":"172.21.15.152:6811","nonce":116094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":116094},{"type":"v1","addr":"172.21.15.152:6816","nonce":116094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":116094},{"type":"v1","addr":"172.21.15.152:6813","nonce":116094}]},"public_addr":"172.21.15.152:6809/116094","cluster_addr":"172.21.15.152:6811/116094","heartbeat_back_addr":"172.21.15.152:6816/116094","heartbeat_front_addr":"172.21.15.152:6813/116094","state":["exists","up"]},{"osd":7,"uuid":"8d7f9d4b-bf08-4670-8591-388c0f012a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":116097},{"type":"v1","addr":"172.21.15.152:6825","nonce":116097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":116097},{"type":"v1","addr":"172.21.15.152:6827","nonce":116097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":116097},{"type":"v1","addr":"172.21.15.152:6831","nonce":116097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":116097},{"type":"v1","addr":"172.21.15.152:6829","nonce":116097}]},"public_addr":"172.21.15.152:6825/116097","cluster_addr":"172.21.15.152:6827/116097","heartbeat_back_addr":"172.21.15.152:6831/116097","heartbeat_front_addr":"172.21.15.152:6829/116097","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.937710+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.865423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.159434+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.913090+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.131647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.966255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.972583+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.177209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.15","mappings":[{"from":7,"to":2}]},{"pgid":"10.2","mappings":[{"from":4,"to":5}]},{"pgid":"10.21","mappings":[{"from":4,"to":3}]},{"pgid":"10.37","mappings":[{"from":7,"to":3}]},{"pgid":"10.3b","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T12:12:11.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.619+0000 7feaed9ff700 1 -- 172.21.15.45:0/671986072 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fead40682f0 msgr2=0x7fead406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:11.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.619+0000 7feaed9ff700 1 --2- 172.21.15.45:0/671986072 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fead40682f0 0x7fead406a7a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7feae81f6b80 tx=0x7feadc009040 comp rx=0 tx=0).stop 2023-11-28T12:12:11.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.619+0000 7feaed9ff700 1 -- 172.21.15.45:0/671986072 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feae80cd7c0 msgr2=0x7feae81f6640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:11.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.619+0000 7feaed9ff700 1 --2- 172.21.15.45:0/671986072 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feae80cd7c0 0x7feae81f6640 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fead800ebe0 tx=0x7fead8009e20 comp rx=0 tx=0).stop 2023-11-28T12:12:11.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.619+0000 7feaed9ff700 1 -- 172.21.15.45:0/671986072 shutdown_connections 2023-11-28T12:12:11.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.619+0000 7feaed9ff700 1 --2- 172.21.15.45:0/671986072 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fead40682f0 0x7fead406a7a0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:11.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.619+0000 7feaed9ff700 1 --2- 172.21.15.45:0/671986072 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7feae8161340 0x7feae81f5a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:11.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.619+0000 7feaed9ff700 1 --2- 172.21.15.45:0/671986072 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feae80cd7c0 0x7feae81f6640 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:11.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.619+0000 7feaed9ff700 1 --2- 172.21.15.45:0/671986072 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feae815c9b0 0x7feae80c9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:11.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.619+0000 7feaed9ff700 1 -- 172.21.15.45:0/671986072 >> 172.21.15.45:0/671986072 conn(0x7feae8072600 msgr2=0x7feae815f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:11.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.619+0000 7feaed9ff700 1 -- 172.21.15.45:0/671986072 shutdown_connections 2023-11-28T12:12:11.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.619+0000 7feaed9ff700 1 -- 172.21.15.45:0/671986072 wait complete. 2023-11-28T12:12:11.639 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-11-28T12:06:21.807108+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-11-28T12:06:22.491009+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T12:09:33.476735+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '60', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T12:09:34.551527+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '61', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T12:12:11.639 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-11-28T12:12:11.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.845+0000 7f13ab7ff700 1 Processor -- start 2023-11-28T12:12:11.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.845+0000 7f13ab7ff700 1 -- start start 2023-11-28T12:12:11.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.846+0000 7f13ab7ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f13a4161340 0x7f13a40d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:11.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.846+0000 7f13ab7ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f13a40d2320 0x7f13a40cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:11.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.846+0000 7f13ab7ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13a40d1950 con 0x7f13a415c9b0 2023-11-28T12:12:11.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.846+0000 7f13ab7ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13a40b5800 con 0x7f13a4161340 2023-11-28T12:12:11.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.846+0000 7f13ab7ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13a40b5300 con 0x7f13a40d2320 2023-11-28T12:12:11.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.847+0000 7f13a8d9a700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f13a4161340 0x7f13a40d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:11.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.847+0000 7f13a8d9a700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f13a4161340 0x7f13a40d1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47514/0 (socket says 172.21.15.45:47514) 2023-11-28T12:12:11.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.847+0000 7f13a8d9a700 1 -- 172.21.15.45:0/2055023267 learned_addr learned my addr 172.21.15.45:0/2055023267 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:12:11.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.847+0000 7f13a9d9c700 1 --2- 172.21.15.45:0/2055023267 >> v2:172.21.15.152:3300/0 conn(0x7f13a40d2320 0x7f13a40cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:11.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.847+0000 7f13a8d9a700 1 -- 172.21.15.45:0/2055023267 >> v2:172.21.15.152:3300/0 conn(0x7f13a40d2320 msgr2=0x7f13a40cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:12:11.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.847+0000 7f13a8d9a700 1 --2- 172.21.15.45:0/2055023267 >> v2:172.21.15.152:3300/0 conn(0x7f13a40d2320 0x7f13a40cd7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:11.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.847+0000 7f13a8d9a700 1 -- 172.21.15.45:0/2055023267 >> v1:172.21.15.152:6789/0 conn(0x7f13a415c9b0 legacy=0x7f13a40b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:12:11.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.847+0000 7f13a8d9a700 1 -- 172.21.15.45:0/2055023267 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13a40b5520 con 0x7f13a4161340 2023-11-28T12:12:11.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.847+0000 7f13a9d9c700 1 --2- 172.21.15.45:0/2055023267 >> v2:172.21.15.152:3300/0 conn(0x7f13a40d2320 0x7f13a40cd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:12:11.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.847+0000 7f13a8d9a700 1 --2- 172.21.15.45:0/2055023267 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13a4161340 0x7f13a40d1de0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f13a406c170 tx=0x7f1394009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ba393fe320567aa server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:11.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.848+0000 7f139bfff700 1 -- 172.21.15.45:0/2055023267 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1394004230 con 0x7f13a4161340 2023-11-28T12:12:11.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.848+0000 7f139bfff700 1 -- 172.21.15.45:0/2055023267 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1394004390 con 0x7f13a4161340 2023-11-28T12:12:11.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.848+0000 7f139bfff700 1 -- 172.21.15.45:0/2055023267 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13940036a0 con 0x7f13a4161340 2023-11-28T12:12:11.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.848+0000 7f13ab7ff700 1 -- 172.21.15.45:0/2055023267 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13a4161340 msgr2=0x7f13a40d1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:11.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.848+0000 7f13ab7ff700 1 --2- 172.21.15.45:0/2055023267 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13a4161340 0x7f13a40d1de0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f13a406c170 tx=0x7f1394009c00 comp rx=0 tx=0).stop 2023-11-28T12:12:11.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.848+0000 7f13ab7ff700 1 -- 172.21.15.45:0/2055023267 shutdown_connections 2023-11-28T12:12:11.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.848+0000 7f13ab7ff700 1 --2- 172.21.15.45:0/2055023267 >> v2:172.21.15.152:3300/0 conn(0x7f13a40d2320 0x7f13a40cd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:11.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.848+0000 7f13ab7ff700 1 --2- 172.21.15.45:0/2055023267 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13a4161340 0x7f13a40d1de0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:11.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.848+0000 7f13ab7ff700 1 -- 172.21.15.45:0/2055023267 >> 172.21.15.45:0/2055023267 conn(0x7f13a4072600 msgr2=0x7f13a40cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:11.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.849+0000 7f13ab7ff700 1 -- 172.21.15.45:0/2055023267 shutdown_connections 2023-11-28T12:12:11.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.849+0000 7f13ab7ff700 1 -- 172.21.15.45:0/2055023267 wait complete. 2023-11-28T12:12:11.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.850+0000 7f13ab7ff700 1 Processor -- start 2023-11-28T12:12:11.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.850+0000 7f13ab7ff700 1 -- start start 2023-11-28T12:12:11.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.851+0000 7f13ab7ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f13a40d2320 0x7f13a41559d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:11.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.851+0000 7f13ab7ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13a415c9b0 0x7f13a41f6750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:11.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.851+0000 7f13ab7ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f13a4161340 0x7f13a4150530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:11.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.851+0000 7f13ab7ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13a4155f10 con 0x7f13a415c9b0 2023-11-28T12:12:11.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.851+0000 7f13ab7ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13a41f6c90 con 0x7f13a40d2320 2023-11-28T12:12:11.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.851+0000 7f13ab7ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13a4156100 con 0x7f13a4161340 2023-11-28T12:12:11.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.852+0000 7f13a8d9a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13a415c9b0 0x7f13a41f6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:11.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.852+0000 7f13a8d9a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13a415c9b0 0x7f13a41f6750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47522/0 (socket says 172.21.15.45:47522) 2023-11-28T12:12:11.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.852+0000 7f13a8d9a700 1 -- 172.21.15.45:0/3201012374 learned_addr learned my addr 172.21.15.45:0/3201012374 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:12:11.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.852+0000 7f13a959b700 1 --2- 172.21.15.45:0/3201012374 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f13a40d2320 0x7f13a41559d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:11.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.852+0000 7f13a9d9c700 1 --2- 172.21.15.45:0/3201012374 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f13a4161340 0x7f13a4150530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:11.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.852+0000 7f13a8d9a700 1 -- 172.21.15.45:0/3201012374 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f13a4161340 msgr2=0x7f13a4150530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:11.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.852+0000 7f13a8d9a700 1 --2- 172.21.15.45:0/3201012374 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f13a4161340 0x7f13a4150530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:11.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.852+0000 7f13a8d9a700 1 -- 172.21.15.45:0/3201012374 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f13a40d2320 msgr2=0x7f13a41559d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:11.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.852+0000 7f13a8d9a700 1 --2- 172.21.15.45:0/3201012374 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f13a40d2320 0x7f13a41559d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:11.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.852+0000 7f13a8d9a700 1 -- 172.21.15.45:0/3201012374 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1394009550 con 0x7f13a415c9b0 2023-11-28T12:12:11.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.852+0000 7f13a8d9a700 1 --2- 172.21.15.45:0/3201012374 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13a415c9b0 0x7f13a41f6750 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f1394009130 tx=0x7f1394004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:11.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.853+0000 7f1399ffb700 1 -- 172.21.15.45:0/3201012374 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1394003cd0 con 0x7f13a415c9b0 2023-11-28T12:12:11.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.853+0000 7f1399ffb700 1 -- 172.21.15.45:0/3201012374 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f139401f070 con 0x7f13a415c9b0 2023-11-28T12:12:11.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.853+0000 7f1399ffb700 1 -- 172.21.15.45:0/3201012374 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1394011830 con 0x7f13a415c9b0 2023-11-28T12:12:11.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.853+0000 7f13ab7ff700 1 -- 172.21.15.45:0/3201012374 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13a40d15e0 con 0x7f13a415c9b0 2023-11-28T12:12:11.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.853+0000 7f13ab7ff700 1 -- 172.21.15.45:0/3201012374 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13a40d1300 con 0x7f13a415c9b0 2023-11-28T12:12:11.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.854+0000 7f13ab7ff700 1 -- 172.21.15.45:0/3201012374 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13a415cd80 con 0x7f13a415c9b0 2023-11-28T12:12:11.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.855+0000 7f1399ffb700 1 -- 172.21.15.45:0/3201012374 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f139402a020 con 0x7f13a415c9b0 2023-11-28T12:12:11.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.855+0000 7f1399ffb700 1 --2- 172.21.15.45:0/3201012374 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f13880682f0 0x7f138806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:11.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.855+0000 7f1399ffb700 1 -- 172.21.15.45:0/3201012374 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f1394087580 con 0x7f13a415c9b0 2023-11-28T12:12:11.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.856+0000 7f13a959b700 1 --2- 172.21.15.45:0/3201012374 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f13880682f0 0x7f138806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:11.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.857+0000 7f13a959b700 1 --2- 172.21.15.45:0/3201012374 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f13880682f0 0x7f138806a7a0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f13a0009960 tx=0x7f13a00090e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:11.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:11.859+0000 7f1399ffb700 1 -- 172.21.15.45:0/3201012374 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f1394053c00 con 0x7f13a415c9b0 2023-11-28T12:12:12.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.060+0000 7f13ab7ff700 1 -- 172.21.15.45:0/3201012374 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f13a415cd80 con 0x7f13a415c9b0 2023-11-28T12:12:12.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.061+0000 7f1399ffb700 1 -- 172.21.15.45:0/3201012374 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v63) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1394057220 con 0x7f13a415c9b0 2023-11-28T12:12:12.062 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-11-28T12:12:12.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.063+0000 7f13ab7ff700 1 -- 172.21.15.45:0/3201012374 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f13880682f0 msgr2=0x7f138806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:12.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.063+0000 7f13ab7ff700 1 --2- 172.21.15.45:0/3201012374 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f13880682f0 0x7f138806a7a0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f13a0009960 tx=0x7f13a00090e0 comp rx=0 tx=0).stop 2023-11-28T12:12:12.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.063+0000 7f13ab7ff700 1 -- 172.21.15.45:0/3201012374 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13a415c9b0 msgr2=0x7f13a41f6750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:12.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.063+0000 7f13ab7ff700 1 --2- 172.21.15.45:0/3201012374 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13a415c9b0 0x7f13a41f6750 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f1394009130 tx=0x7f1394004750 comp rx=0 tx=0).stop 2023-11-28T12:12:12.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.063+0000 7f13ab7ff700 1 -- 172.21.15.45:0/3201012374 shutdown_connections 2023-11-28T12:12:12.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.063+0000 7f13ab7ff700 1 --2- 172.21.15.45:0/3201012374 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f13880682f0 0x7f138806a7a0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:12.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.063+0000 7f13ab7ff700 1 --2- 172.21.15.45:0/3201012374 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f13a40d2320 0x7f13a41559d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:12.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.063+0000 7f13ab7ff700 1 --2- 172.21.15.45:0/3201012374 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f13a4161340 0x7f13a4150530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:12.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.063+0000 7f13ab7ff700 1 --2- 172.21.15.45:0/3201012374 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13a415c9b0 0x7f13a41f6750 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:12.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.063+0000 7f13ab7ff700 1 -- 172.21.15.45:0/3201012374 >> 172.21.15.45:0/3201012374 conn(0x7f13a4072600 msgr2=0x7f13a40b6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:12.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.063+0000 7f13ab7ff700 1 -- 172.21.15.45:0/3201012374 shutdown_connections 2023-11-28T12:12:12.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.063+0000 7f13ab7ff700 1 -- 172.21.15.45:0/3201012374 wait complete. 2023-11-28T12:12:12.082 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T12:12:12.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.288+0000 7fbd1b7ff700 1 Processor -- start 2023-11-28T12:12:12.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.288+0000 7fbd1b7ff700 1 -- start start 2023-11-28T12:12:12.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.289+0000 7fbd1b7ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fbd14159490 0x7fbd140b0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:12.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.289+0000 7fbd1b7ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbd14159860 0x7fbd140b0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:12.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.289+0000 7fbd1b7ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd140ccc00 con 0x7fbd140cdc80 2023-11-28T12:12:12.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.289+0000 7fbd1b7ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd140ccec0 con 0x7fbd14159860 2023-11-28T12:12:12.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.289+0000 7fbd1b7ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd140cd1a0 con 0x7fbd14159490 2023-11-28T12:12:12.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.290+0000 7fbd18d9a700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbd14159860 0x7fbd140b0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:12.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.290+0000 7fbd19d9c700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fbd140cdc80 0x7fbd140c94c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:57718/0 (socket says 172.21.15.45:57718) 2023-11-28T12:12:12.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.290+0000 7fbd18d9a700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbd14159860 0x7fbd140b0bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36522/0 (socket says 172.21.15.45:36522) 2023-11-28T12:12:12.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.290+0000 7fbd19d9c700 1 -- 172.21.15.45:0/1967686166 learned_addr learned my addr 172.21.15.45:0/1967686166 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:12:12.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.290+0000 7fbd1959b700 1 --2- 172.21.15.45:0/1967686166 >> v2:172.21.15.152:3300/0 conn(0x7fbd14159490 0x7fbd140b0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:12.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.290+0000 7fbd18d9a700 1 -- 172.21.15.45:0/1967686166 >> v2:172.21.15.152:3300/0 conn(0x7fbd14159490 msgr2=0x7fbd140b0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:12:12.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.290+0000 7fbd18d9a700 1 --2- 172.21.15.45:0/1967686166 >> v2:172.21.15.152:3300/0 conn(0x7fbd14159490 0x7fbd140b0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:12.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.290+0000 7fbd18d9a700 1 -- 172.21.15.45:0/1967686166 >> v1:172.21.15.45:6789/0 conn(0x7fbd140cdc80 legacy=0x7fbd140c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:12.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.290+0000 7fbd18d9a700 1 -- 172.21.15.45:0/1967686166 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd140cd480 con 0x7fbd14159860 2023-11-28T12:12:12.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.290+0000 7fbd0bfff700 1 -- 172.21.15.45:0/1967686166 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4226826065 0 0) 0x7fbd140ccc00 con 0x7fbd140cdc80 2023-11-28T12:12:12.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.290+0000 7fbd18d9a700 1 --2- 172.21.15.45:0/1967686166 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd14159860 0x7fbd140b0bb0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fbd1406d9b0 tx=0x7fbd04009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a74837244f1f363 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:12.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.291+0000 7fbd0bfff700 1 -- 172.21.15.45:0/1967686166 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd04011830 con 0x7fbd14159860 2023-11-28T12:12:12.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.291+0000 7fbd0bfff700 1 -- 172.21.15.45:0/1967686166 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd04011990 con 0x7fbd14159860 2023-11-28T12:12:12.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.291+0000 7fbd0bfff700 1 -- 172.21.15.45:0/1967686166 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd04011d20 con 0x7fbd14159860 2023-11-28T12:12:12.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.291+0000 7fbd1b7ff700 1 -- 172.21.15.45:0/1967686166 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd14159860 msgr2=0x7fbd140b0bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:12.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.291+0000 7fbd1b7ff700 1 --2- 172.21.15.45:0/1967686166 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd14159860 0x7fbd140b0bb0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fbd1406d9b0 tx=0x7fbd04009b20 comp rx=0 tx=0).stop 2023-11-28T12:12:12.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.291+0000 7fbd1b7ff700 1 -- 172.21.15.45:0/1967686166 shutdown_connections 2023-11-28T12:12:12.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.291+0000 7fbd1b7ff700 1 --2- 172.21.15.45:0/1967686166 >> v2:172.21.15.152:3300/0 conn(0x7fbd14159490 0x7fbd140b0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:12.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.291+0000 7fbd1b7ff700 1 --2- 172.21.15.45:0/1967686166 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd14159860 0x7fbd140b0bb0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:12.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.291+0000 7fbd1b7ff700 1 -- 172.21.15.45:0/1967686166 >> 172.21.15.45:0/1967686166 conn(0x7fbd140cb670 msgr2=0x7fbd140cba70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:12.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.291+0000 7fbd1b7ff700 1 -- 172.21.15.45:0/1967686166 shutdown_connections 2023-11-28T12:12:12.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.291+0000 7fbd1b7ff700 1 -- 172.21.15.45:0/1967686166 wait complete. 2023-11-28T12:12:12.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.293+0000 7fbd1b7ff700 1 Processor -- start 2023-11-28T12:12:12.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.293+0000 7fbd1b7ff700 1 -- start start 2023-11-28T12:12:12.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.294+0000 7fbd1b7ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd140cdc80 0x7fbd140c45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:12.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.294+0000 7fbd1b7ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbd14159490 0x7fbd1415c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:12.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.294+0000 7fbd1b7ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd140c4b60 0x7fbd14157b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:12.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.294+0000 7fbd1b7ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd140b4350 con 0x7fbd140cdc80 2023-11-28T12:12:12.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.294+0000 7fbd1b7ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1415b4b0 con 0x7fbd140c4b60 2023-11-28T12:12:12.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.294+0000 7fbd1b7ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1415b790 con 0x7fbd14159490 2023-11-28T12:12:12.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.294+0000 7fbd1959b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd140cdc80 0x7fbd140c45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:12.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.294+0000 7fbd1959b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd140cdc80 0x7fbd140c45a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36538/0 (socket says 172.21.15.45:36538) 2023-11-28T12:12:12.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.294+0000 7fbd1959b700 1 -- 172.21.15.45:0/3995747938 learned_addr learned my addr 172.21.15.45:0/3995747938 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:12:12.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.294+0000 7fbd19d9c700 1 --2- 172.21.15.45:0/3995747938 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd140c4b60 0x7fbd14157b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:12.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.294+0000 7fbd18d9a700 1 --2- 172.21.15.45:0/3995747938 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbd14159490 0x7fbd1415c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:12.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.295+0000 7fbd1959b700 1 -- 172.21.15.45:0/3995747938 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbd14159490 msgr2=0x7fbd1415c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:12.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.295+0000 7fbd1959b700 1 --2- 172.21.15.45:0/3995747938 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbd14159490 0x7fbd1415c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:12.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.295+0000 7fbd1959b700 1 -- 172.21.15.45:0/3995747938 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd140c4b60 msgr2=0x7fbd14157b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:12.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.295+0000 7fbd1959b700 1 --2- 172.21.15.45:0/3995747938 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd140c4b60 0x7fbd14157b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:12.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.295+0000 7fbd1959b700 1 -- 172.21.15.45:0/3995747938 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd040094a0 con 0x7fbd140cdc80 2023-11-28T12:12:12.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.295+0000 7fbd1959b700 1 --2- 172.21.15.45:0/3995747938 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd140cdc80 0x7fbd140c45a0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fbd1000e9b0 tx=0x7fbd1000ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:12.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.295+0000 7fbd09ffb700 1 -- 172.21.15.45:0/3995747938 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd10009710 con 0x7fbd140cdc80 2023-11-28T12:12:12.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.295+0000 7fbd09ffb700 1 -- 172.21.15.45:0/3995747938 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd1000ee50 con 0x7fbd140cdc80 2023-11-28T12:12:12.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.295+0000 7fbd09ffb700 1 -- 172.21.15.45:0/3995747938 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd1000ca50 con 0x7fbd140cdc80 2023-11-28T12:12:12.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.295+0000 7fbd1b7ff700 1 -- 172.21.15.45:0/3995747938 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd140c9bd0 con 0x7fbd140cdc80 2023-11-28T12:12:12.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.296+0000 7fbd1b7ff700 1 -- 172.21.15.45:0/3995747938 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd140cd760 con 0x7fbd140cdc80 2023-11-28T12:12:12.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.297+0000 7fbd1b7ff700 1 -- 172.21.15.45:0/3995747938 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd140c9d60 con 0x7fbd140cdc80 2023-11-28T12:12:12.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.297+0000 7fbd09ffb700 1 -- 172.21.15.45:0/3995747938 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fbd10019030 con 0x7fbd140cdc80 2023-11-28T12:12:12.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.298+0000 7fbd09ffb700 1 --2- 172.21.15.45:0/3995747938 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fbcf80682f0 0x7fbcf806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:12.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.298+0000 7fbd09ffb700 1 -- 172.21.15.45:0/3995747938 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6207+0+0 (secure 0 0 0) 0x7fbd10085c90 con 0x7fbd140cdc80 2023-11-28T12:12:12.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.299+0000 7fbd18d9a700 1 --2- 172.21.15.45:0/3995747938 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fbcf80682f0 0x7fbcf806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:12.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.299+0000 7fbd18d9a700 1 --2- 172.21.15.45:0/3995747938 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fbcf80682f0 0x7fbcf806a7a0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fbd040090b0 tx=0x7fbd0401c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:12.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.302+0000 7fbd09ffb700 1 -- 172.21.15.45:0/3995747938 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fbd10052370 con 0x7fbd140cdc80 2023-11-28T12:12:12.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.502+0000 7fbd1b7ff700 1 -- 172.21.15.45:0/3995747938 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbd140745c0 con 0x7fbd140cdc80 2023-11-28T12:12:12.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.503+0000 7fbd09ffb700 1 -- 172.21.15.45:0/3995747938 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v63) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbd10055990 con 0x7fbd140cdc80 2023-11-28T12:12:12.505 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-11-28T12:12:12.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.505+0000 7fbd1b7ff700 1 -- 172.21.15.45:0/3995747938 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fbcf80682f0 msgr2=0x7fbcf806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:12.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.505+0000 7fbd1b7ff700 1 --2- 172.21.15.45:0/3995747938 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fbcf80682f0 0x7fbcf806a7a0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fbd040090b0 tx=0x7fbd0401c040 comp rx=0 tx=0).stop 2023-11-28T12:12:12.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.505+0000 7fbd1b7ff700 1 -- 172.21.15.45:0/3995747938 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd140cdc80 msgr2=0x7fbd140c45a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:12.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.505+0000 7fbd1b7ff700 1 --2- 172.21.15.45:0/3995747938 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd140cdc80 0x7fbd140c45a0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fbd1000e9b0 tx=0x7fbd1000ecc0 comp rx=0 tx=0).stop 2023-11-28T12:12:12.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.505+0000 7fbd1b7ff700 1 -- 172.21.15.45:0/3995747938 shutdown_connections 2023-11-28T12:12:12.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.505+0000 7fbd1b7ff700 1 --2- 172.21.15.45:0/3995747938 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fbcf80682f0 0x7fbcf806a7a0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:12.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.505+0000 7fbd1b7ff700 1 --2- 172.21.15.45:0/3995747938 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbd140c4b60 0x7fbd14157b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:12.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.505+0000 7fbd1b7ff700 1 --2- 172.21.15.45:0/3995747938 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd140cdc80 0x7fbd140c45a0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:12.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.505+0000 7fbd1b7ff700 1 --2- 172.21.15.45:0/3995747938 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fbd14159490 0x7fbd1415c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:12.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.505+0000 7fbd1b7ff700 1 -- 172.21.15.45:0/3995747938 >> 172.21.15.45:0/3995747938 conn(0x7fbd140cb670 msgr2=0x7fbd14155780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:12.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.505+0000 7fbd1b7ff700 1 -- 172.21.15.45:0/3995747938 shutdown_connections 2023-11-28T12:12:12.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.506+0000 7fbd1b7ff700 1 -- 172.21.15.45:0/3995747938 wait complete. 2023-11-28T12:12:12.525 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T12:12:12.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.730+0000 7f2a153ff700 1 Processor -- start 2023-11-28T12:12:12.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.730+0000 7f2a153ff700 1 -- start start 2023-11-28T12:12:12.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.731+0000 7f2a153ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2a100b37b0 0x7f2a100b6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:12.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.731+0000 7f2a153ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a100cf220 con 0x7f2a100b4750 2023-11-28T12:12:12.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.732+0000 7f2a153ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a100b3e50 con 0x7f2a100d0ff0 2023-11-28T12:12:12.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.732+0000 7f2a153ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a100cf470 con 0x7f2a100b37b0 2023-11-28T12:12:12.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.732+0000 7f2a07fff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f2a100b4750 0x7f2a100b30a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:57734/0 (socket says 172.21.15.45:57734) 2023-11-28T12:12:12.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.732+0000 7f2a07fff700 1 -- 172.21.15.45:0/3804160007 learned_addr learned my addr 172.21.15.45:0/3804160007 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:12:12.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.732+0000 7f2a0f7fe700 1 --2- 172.21.15.45:0/3804160007 >> v2:172.21.15.45:3300/0 conn(0x7f2a100b37b0 0x7f2a100b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:12.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.732+0000 7f2a0e7fc700 1 -- 172.21.15.45:0/3804160007 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3694464026 0 0) 0x7f2a100cf220 con 0x7f2a100b4750 2023-11-28T12:12:12.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.732+0000 7f2a0e7fc700 1 -- 172.21.15.45:0/3804160007 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29fc0035b0 con 0x7f2a100b4750 2023-11-28T12:12:12.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.732+0000 7f2a0f7fe700 1 -- 172.21.15.45:0/3804160007 >> v1:172.21.15.152:6789/0 conn(0x7f2a100d0ff0 legacy=0x7f2a100cff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:12.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.732+0000 7f2a0f7fe700 1 -- 172.21.15.45:0/3804160007 >> v1:172.21.15.45:6789/0 conn(0x7f2a100b4750 legacy=0x7f2a100b30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:12.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.732+0000 7f2a0f7fe700 1 -- 172.21.15.45:0/3804160007 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a100cf750 con 0x7f2a100b37b0 2023-11-28T12:12:12.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.733+0000 7f2a0f7fe700 1 --2- 172.21.15.45:0/3804160007 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2a100b37b0 0x7f2a100b6000 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f2a08009d90 tx=0x7f2a0800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc87b307efd9a6e3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:12.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.733+0000 7f2a0e7fc700 1 -- 172.21.15.45:0/3804160007 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a0800e070 con 0x7f2a100b37b0 2023-11-28T12:12:12.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.733+0000 7f2a0e7fc700 1 -- 172.21.15.45:0/3804160007 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a0800bb20 con 0x7f2a100b37b0 2023-11-28T12:12:12.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.733+0000 7f2a0e7fc700 1 -- 172.21.15.45:0/3804160007 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a08012430 con 0x7f2a100b37b0 2023-11-28T12:12:12.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.733+0000 7f2a153ff700 1 -- 172.21.15.45:0/3804160007 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2a100b37b0 msgr2=0x7f2a100b6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:12.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.733+0000 7f2a153ff700 1 --2- 172.21.15.45:0/3804160007 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2a100b37b0 0x7f2a100b6000 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f2a08009d90 tx=0x7f2a0800b330 comp rx=0 tx=0).stop 2023-11-28T12:12:12.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.733+0000 7f2a153ff700 1 -- 172.21.15.45:0/3804160007 shutdown_connections 2023-11-28T12:12:12.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.733+0000 7f2a153ff700 1 --2- 172.21.15.45:0/3804160007 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2a100b37b0 0x7f2a100b6000 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:12.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.733+0000 7f2a153ff700 1 -- 172.21.15.45:0/3804160007 >> 172.21.15.45:0/3804160007 conn(0x7f2a1009c3c0 msgr2=0x7f2a100d31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:12.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.734+0000 7f2a153ff700 1 -- 172.21.15.45:0/3804160007 shutdown_connections 2023-11-28T12:12:12.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.734+0000 7f2a153ff700 1 -- 172.21.15.45:0/3804160007 wait complete. 2023-11-28T12:12:12.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.736+0000 7f2a153ff700 1 Processor -- start 2023-11-28T12:12:12.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.736+0000 7f2a153ff700 1 -- start start 2023-11-28T12:12:12.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.737+0000 7f2a153ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2a100b37b0 0x7f2a1015aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:12.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.737+0000 7f2a153ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a100b4750 0x7f2a100b7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:12.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.737+0000 7f2a153ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2a100d0ff0 0x7f2a100b81f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:12.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.738+0000 7f2a153ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a101e59a0 con 0x7f2a100d0ff0 2023-11-28T12:12:12.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.738+0000 7f2a153ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a1015b020 con 0x7f2a100b4750 2023-11-28T12:12:12.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.738+0000 7f2a153ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a100c89e0 con 0x7f2a100b37b0 2023-11-28T12:12:12.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.738+0000 7f2a0f7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2a100d0ff0 0x7f2a100b81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:12.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.738+0000 7f2a0f7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2a100d0ff0 0x7f2a100b81f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36564/0 (socket says 172.21.15.45:36564) 2023-11-28T12:12:12.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.738+0000 7f2a0f7fe700 1 -- 172.21.15.45:0/2608423059 learned_addr learned my addr 172.21.15.45:0/2608423059 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:12:12.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.738+0000 7f2a07fff700 1 --2- 172.21.15.45:0/2608423059 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a100b4750 0x7f2a100b7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:12.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.738+0000 7f2a0effd700 1 --2- 172.21.15.45:0/2608423059 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2a100b37b0 0x7f2a1015aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:12.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.738+0000 7f2a0f7fe700 1 -- 172.21.15.45:0/2608423059 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2a100b37b0 msgr2=0x7f2a1015aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:12.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.738+0000 7f2a0f7fe700 1 --2- 172.21.15.45:0/2608423059 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2a100b37b0 0x7f2a1015aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:12.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.738+0000 7f2a0f7fe700 1 -- 172.21.15.45:0/2608423059 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a100b4750 msgr2=0x7f2a100b7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:12.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.738+0000 7f2a0f7fe700 1 --2- 172.21.15.45:0/2608423059 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a100b4750 0x7f2a100b7080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:12.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.738+0000 7f2a0f7fe700 1 -- 172.21.15.45:0/2608423059 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a08009a70 con 0x7f2a100d0ff0 2023-11-28T12:12:12.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.738+0000 7f2a0f7fe700 1 --2- 172.21.15.45:0/2608423059 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2a100d0ff0 0x7f2a100b81f0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f2a100686f0 tx=0x7f2a08004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:12.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.739+0000 7f2a077fe700 1 -- 172.21.15.45:0/2608423059 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a08012430 con 0x7f2a100d0ff0 2023-11-28T12:12:12.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.739+0000 7f2a077fe700 1 -- 172.21.15.45:0/2608423059 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a08020070 con 0x7f2a100d0ff0 2023-11-28T12:12:12.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.739+0000 7f2a153ff700 1 -- 172.21.15.45:0/2608423059 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a100d0a50 con 0x7f2a100d0ff0 2023-11-28T12:12:12.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.739+0000 7f2a077fe700 1 -- 172.21.15.45:0/2608423059 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a08004280 con 0x7f2a100d0ff0 2023-11-28T12:12:12.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.739+0000 7f2a153ff700 1 -- 172.21.15.45:0/2608423059 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a100cfa30 con 0x7f2a100d0ff0 2023-11-28T12:12:12.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.740+0000 7f2a153ff700 1 -- 172.21.15.45:0/2608423059 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a100d13c0 con 0x7f2a100d0ff0 2023-11-28T12:12:12.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.741+0000 7f2a077fe700 1 -- 172.21.15.45:0/2608423059 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f2a080043e0 con 0x7f2a100d0ff0 2023-11-28T12:12:12.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.742+0000 7f2a077fe700 1 --2- 172.21.15.45:0/2608423059 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f29f00682f0 0x7f29f006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:12.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.742+0000 7f2a077fe700 1 -- 172.21.15.45:0/2608423059 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f2a08022070 con 0x7f2a100d0ff0 2023-11-28T12:12:12.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.742+0000 7f2a0effd700 1 --2- 172.21.15.45:0/2608423059 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f29f00682f0 0x7f29f006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:12.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.743+0000 7f2a0effd700 1 --2- 172.21.15.45:0/2608423059 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f29f00682f0 0x7f29f006a7a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f2a100c9b30 tx=0x7f2a00009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:12.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.746+0000 7f2a077fe700 1 -- 172.21.15.45:0/2608423059 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f2a080548f0 con 0x7f2a100d0ff0 2023-11-28T12:12:12.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.950+0000 7f2a153ff700 1 -- 172.21.15.45:0/2608423059 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2a101e5ae0 con 0x7f2a100d0ff0 2023-11-28T12:12:12.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.950+0000 7f2a077fe700 1 -- 172.21.15.45:0/2608423059 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v63) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2a08057f10 con 0x7f2a100d0ff0 2023-11-28T12:12:12.952 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-11-28T12:12:12.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.953+0000 7f2a153ff700 1 -- 172.21.15.45:0/2608423059 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f29f00682f0 msgr2=0x7f29f006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:12.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.953+0000 7f2a153ff700 1 --2- 172.21.15.45:0/2608423059 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f29f00682f0 0x7f29f006a7a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f2a100c9b30 tx=0x7f2a00009040 comp rx=0 tx=0).stop 2023-11-28T12:12:12.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.953+0000 7f2a153ff700 1 -- 172.21.15.45:0/2608423059 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2a100d0ff0 msgr2=0x7f2a100b81f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:12.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.953+0000 7f2a153ff700 1 --2- 172.21.15.45:0/2608423059 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2a100d0ff0 0x7f2a100b81f0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f2a100686f0 tx=0x7f2a08004ad0 comp rx=0 tx=0).stop 2023-11-28T12:12:12.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.953+0000 7f2a153ff700 1 -- 172.21.15.45:0/2608423059 shutdown_connections 2023-11-28T12:12:12.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.953+0000 7f2a153ff700 1 --2- 172.21.15.45:0/2608423059 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f29f00682f0 0x7f29f006a7a0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:12.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.953+0000 7f2a153ff700 1 --2- 172.21.15.45:0/2608423059 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2a100d0ff0 0x7f2a100b81f0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:12.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.953+0000 7f2a153ff700 1 --2- 172.21.15.45:0/2608423059 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2a100b37b0 0x7f2a1015aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:12.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.953+0000 7f2a153ff700 1 --2- 172.21.15.45:0/2608423059 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2a100b4750 0x7f2a100b7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:12.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.953+0000 7f2a153ff700 1 -- 172.21.15.45:0/2608423059 >> 172.21.15.45:0/2608423059 conn(0x7f2a1009c3c0 msgr2=0x7f2a100b0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:12.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.953+0000 7f2a153ff700 1 -- 172.21.15.45:0/2608423059 shutdown_connections 2023-11-28T12:12:12.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:12.953+0000 7f2a153ff700 1 -- 172.21.15.45:0/2608423059 wait complete. 2023-11-28T12:12:12.973 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T12:12:13.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.178+0000 7f0d501ff700 1 Processor -- start 2023-11-28T12:12:13.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.178+0000 7f0d501ff700 1 -- start start 2023-11-28T12:12:13.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.179+0000 7f0d501ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0d4815c9b0 0x7f0d480b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:13.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.179+0000 7f0d501ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0d480cd7c0 0x7f0d480cdc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:13.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.179+0000 7f0d501ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d480ce160 con 0x7f0d48161340 2023-11-28T12:12:13.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.179+0000 7f0d501ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d480b5800 con 0x7f0d480cd7c0 2023-11-28T12:12:13.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.179+0000 7f0d501ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d480d1950 con 0x7f0d4815c9b0 2023-11-28T12:12:13.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.179+0000 7f0d4d79a700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f0d48161340 0x7f0d480d1de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:57744/0 (socket says 172.21.15.45:57744) 2023-11-28T12:12:13.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.179+0000 7f0d4d79a700 1 -- 172.21.15.45:0/2015798366 learned_addr learned my addr 172.21.15.45:0/2015798366 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:12:13.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.179+0000 7f0d4e79c700 1 --2- 172.21.15.45:0/2015798366 >> v2:172.21.15.45:3300/0 conn(0x7f0d480cd7c0 0x7f0d480cdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:13.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.179+0000 7f0d4df9b700 1 --2- 172.21.15.45:0/2015798366 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0d4815c9b0 0x7f0d480b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:13.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.180+0000 7f0d4cf99700 1 -- 172.21.15.45:0/2015798366 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3271731951 0 0) 0x7f0d480ce160 con 0x7f0d48161340 2023-11-28T12:12:13.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.180+0000 7f0d4cf99700 1 -- 172.21.15.45:0/2015798366 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d340035b0 con 0x7f0d48161340 2023-11-28T12:12:13.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.180+0000 7f0d4e79c700 1 -- 172.21.15.45:0/2015798366 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0d4815c9b0 msgr2=0x7f0d480b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:12:13.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.180+0000 7f0d4e79c700 1 --2- 172.21.15.45:0/2015798366 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0d4815c9b0 0x7f0d480b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:13.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.180+0000 7f0d4e79c700 1 -- 172.21.15.45:0/2015798366 >> v1:172.21.15.45:6789/0 conn(0x7f0d48161340 legacy=0x7f0d480d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:13.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.180+0000 7f0d4e79c700 1 -- 172.21.15.45:0/2015798366 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d480d24f0 con 0x7f0d480cd7c0 2023-11-28T12:12:13.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.180+0000 7f0d4e79c700 1 --2- 172.21.15.45:0/2015798366 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d480cd7c0 0x7f0d480cdc20 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f0d40009d90 tx=0x7f0d4000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e121957b4352500 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:13.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.180+0000 7f0d4cf99700 1 -- 172.21.15.45:0/2015798366 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d4000e070 con 0x7f0d480cd7c0 2023-11-28T12:12:13.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.180+0000 7f0d4cf99700 1 -- 172.21.15.45:0/2015798366 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d4000bb20 con 0x7f0d480cd7c0 2023-11-28T12:12:13.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.180+0000 7f0d4cf99700 1 -- 172.21.15.45:0/2015798366 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d40012430 con 0x7f0d480cd7c0 2023-11-28T12:12:13.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.181+0000 7f0d501ff700 1 -- 172.21.15.45:0/2015798366 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d480cd7c0 msgr2=0x7f0d480cdc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:13.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.181+0000 7f0d501ff700 1 --2- 172.21.15.45:0/2015798366 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d480cd7c0 0x7f0d480cdc20 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f0d40009d90 tx=0x7f0d4000b330 comp rx=0 tx=0).stop 2023-11-28T12:12:13.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.181+0000 7f0d501ff700 1 -- 172.21.15.45:0/2015798366 shutdown_connections 2023-11-28T12:12:13.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.181+0000 7f0d501ff700 1 --2- 172.21.15.45:0/2015798366 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d480cd7c0 0x7f0d480cdc20 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:13.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.181+0000 7f0d501ff700 1 --2- 172.21.15.45:0/2015798366 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0d4815c9b0 0x7f0d480b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:13.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.181+0000 7f0d501ff700 1 -- 172.21.15.45:0/2015798366 >> 172.21.15.45:0/2015798366 conn(0x7f0d48072600 msgr2=0x7f0d480cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:13.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.181+0000 7f0d501ff700 1 -- 172.21.15.45:0/2015798366 shutdown_connections 2023-11-28T12:12:13.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.181+0000 7f0d501ff700 1 -- 172.21.15.45:0/2015798366 wait complete. 2023-11-28T12:12:13.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.183+0000 7f0d501ff700 1 Processor -- start 2023-11-28T12:12:13.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.183+0000 7f0d501ff700 1 -- start start 2023-11-28T12:12:13.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.184+0000 7f0d501ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d480cd7c0 0x7f0d481f33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:13.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.184+0000 7f0d501ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d4815c9b0 0x7f0d48154260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:13.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.184+0000 7f0d501ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0d48161340 0x7f0d480cae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:13.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.184+0000 7f0d501ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d480c8410 con 0x7f0d4815c9b0 2023-11-28T12:12:13.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.184+0000 7f0d501ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d480ca370 con 0x7f0d480cd7c0 2023-11-28T12:12:13.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.184+0000 7f0d501ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d480ca650 con 0x7f0d48161340 2023-11-28T12:12:13.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.184+0000 7f0d4d79a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d4815c9b0 0x7f0d48154260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:13.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.184+0000 7f0d4d79a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d4815c9b0 0x7f0d48154260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36586/0 (socket says 172.21.15.45:36586) 2023-11-28T12:12:13.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.184+0000 7f0d4d79a700 1 -- 172.21.15.45:0/2669702293 learned_addr learned my addr 172.21.15.45:0/2669702293 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:12:13.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.184+0000 7f0d4df9b700 1 --2- 172.21.15.45:0/2669702293 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d480cd7c0 0x7f0d481f33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:13.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.184+0000 7f0d4e79c700 1 --2- 172.21.15.45:0/2669702293 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0d48161340 0x7f0d480cae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:13.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.185+0000 7f0d4d79a700 1 -- 172.21.15.45:0/2669702293 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0d48161340 msgr2=0x7f0d480cae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:13.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.185+0000 7f0d4d79a700 1 --2- 172.21.15.45:0/2669702293 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0d48161340 0x7f0d480cae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:13.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.185+0000 7f0d4d79a700 1 -- 172.21.15.45:0/2669702293 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d480cd7c0 msgr2=0x7f0d481f33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:13.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.185+0000 7f0d4d79a700 1 --2- 172.21.15.45:0/2669702293 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d480cd7c0 0x7f0d481f33a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:13.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.185+0000 7f0d4d79a700 1 -- 172.21.15.45:0/2669702293 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d40009a70 con 0x7f0d4815c9b0 2023-11-28T12:12:13.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.185+0000 7f0d4e79c700 1 --2- 172.21.15.45:0/2669702293 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0d48161340 0x7f0d480cae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:12:13.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.185+0000 7f0d4df9b700 1 --2- 172.21.15.45:0/2669702293 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d480cd7c0 0x7f0d481f33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:12:13.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.185+0000 7f0d4d79a700 1 --2- 172.21.15.45:0/2669702293 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d4815c9b0 0x7f0d48154260 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f0d38001eb0 tx=0x7f0d3800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:13.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.185+0000 7f0d3e7fc700 1 -- 172.21.15.45:0/2669702293 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d38005d70 con 0x7f0d4815c9b0 2023-11-28T12:12:13.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.185+0000 7f0d3e7fc700 1 -- 172.21.15.45:0/2669702293 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d380070d0 con 0x7f0d4815c9b0 2023-11-28T12:12:13.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.185+0000 7f0d3e7fc700 1 -- 172.21.15.45:0/2669702293 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d38007460 con 0x7f0d4815c9b0 2023-11-28T12:12:13.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.185+0000 7f0d501ff700 1 -- 172.21.15.45:0/2669702293 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d480d1300 con 0x7f0d4815c9b0 2023-11-28T12:12:13.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.185+0000 7f0d501ff700 1 -- 172.21.15.45:0/2669702293 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d480b5520 con 0x7f0d4815c9b0 2023-11-28T12:12:13.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.187+0000 7f0d501ff700 1 -- 172.21.15.45:0/2669702293 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d480d15e0 con 0x7f0d4815c9b0 2023-11-28T12:12:13.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.187+0000 7f0d3e7fc700 1 -- 172.21.15.45:0/2669702293 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f0d38019030 con 0x7f0d4815c9b0 2023-11-28T12:12:13.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.188+0000 7f0d3e7fc700 1 --2- 172.21.15.45:0/2669702293 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f0d2c0682f0 0x7f0d2c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:13.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.188+0000 7f0d3e7fc700 1 -- 172.21.15.45:0/2669702293 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f0d380851e0 con 0x7f0d4815c9b0 2023-11-28T12:12:13.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.189+0000 7f0d4df9b700 1 --2- 172.21.15.45:0/2669702293 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f0d2c0682f0 0x7f0d2c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:13.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.190+0000 7f0d4df9b700 1 --2- 172.21.15.45:0/2669702293 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f0d2c0682f0 0x7f0d2c06a7a0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f0d44009b90 tx=0x7f0d44008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:13.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.192+0000 7f0d3e7fc700 1 -- 172.21.15.45:0/2669702293 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f0d380518c0 con 0x7f0d4815c9b0 2023-11-28T12:12:13.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.390+0000 7f0d501ff700 1 -- 172.21.15.45:0/2669702293 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0d480745c0 con 0x7f0d4815c9b0 2023-11-28T12:12:13.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.391+0000 7f0d3e7fc700 1 -- 172.21.15.45:0/2669702293 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v63) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0d38054ee0 con 0x7f0d4815c9b0 2023-11-28T12:12:13.394 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-11-28T12:12:13.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.393+0000 7f0d501ff700 1 -- 172.21.15.45:0/2669702293 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f0d2c0682f0 msgr2=0x7f0d2c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:13.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.393+0000 7f0d501ff700 1 --2- 172.21.15.45:0/2669702293 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f0d2c0682f0 0x7f0d2c06a7a0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f0d44009b90 tx=0x7f0d44008040 comp rx=0 tx=0).stop 2023-11-28T12:12:13.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.393+0000 7f0d501ff700 1 -- 172.21.15.45:0/2669702293 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d4815c9b0 msgr2=0x7f0d48154260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:13.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.393+0000 7f0d501ff700 1 --2- 172.21.15.45:0/2669702293 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d4815c9b0 0x7f0d48154260 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f0d38001eb0 tx=0x7f0d3800c860 comp rx=0 tx=0).stop 2023-11-28T12:12:13.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.393+0000 7f0d501ff700 1 -- 172.21.15.45:0/2669702293 shutdown_connections 2023-11-28T12:12:13.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.393+0000 7f0d501ff700 1 --2- 172.21.15.45:0/2669702293 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f0d2c0682f0 0x7f0d2c06a7a0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:13.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.393+0000 7f0d501ff700 1 --2- 172.21.15.45:0/2669702293 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0d480cd7c0 0x7f0d481f33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:13.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.393+0000 7f0d501ff700 1 --2- 172.21.15.45:0/2669702293 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0d48161340 0x7f0d480cae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:13.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.393+0000 7f0d501ff700 1 --2- 172.21.15.45:0/2669702293 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d4815c9b0 0x7f0d48154260 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:13.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.393+0000 7f0d501ff700 1 -- 172.21.15.45:0/2669702293 >> 172.21.15.45:0/2669702293 conn(0x7f0d48072600 msgr2=0x7f0d480d1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:13.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.393+0000 7f0d501ff700 1 -- 172.21.15.45:0/2669702293 shutdown_connections 2023-11-28T12:12:13.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.393+0000 7f0d501ff700 1 -- 172.21.15.45:0/2669702293 wait complete. 2023-11-28T12:12:13.413 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T12:12:13.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.615+0000 7fc579bff700 1 Processor -- start 2023-11-28T12:12:13.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.615+0000 7fc579bff700 1 -- start start 2023-11-28T12:12:13.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.617+0000 7fc579bff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc57415c9b0 0x7fc5740b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:13.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.617+0000 7fc579bff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc574161340 0x7fc5740d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:13.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.617+0000 7fc579bff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5740d1950 con 0x7fc5740d2320 2023-11-28T12:12:13.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.617+0000 7fc579bff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5740b5800 con 0x7fc574161340 2023-11-28T12:12:13.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.617+0000 7fc579bff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5740b5520 con 0x7fc57415c9b0 2023-11-28T12:12:13.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.617+0000 7fc56bfff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc574161340 0x7fc5740d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:13.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.617+0000 7fc56bfff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc574161340 0x7fc5740d1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36594/0 (socket says 172.21.15.45:36594) 2023-11-28T12:12:13.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.617+0000 7fc56bfff700 1 -- 172.21.15.45:0/2275838857 learned_addr learned my addr 172.21.15.45:0/2275838857 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:12:13.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.617+0000 7fc5737fe700 1 --2- 172.21.15.45:0/2275838857 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc57415c9b0 0x7fc5740b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:13.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.617+0000 7fc56bfff700 1 -- 172.21.15.45:0/2275838857 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc57415c9b0 msgr2=0x7fc5740b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:12:13.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.617+0000 7fc56bfff700 1 --2- 172.21.15.45:0/2275838857 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc57415c9b0 0x7fc5740b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:13.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.617+0000 7fc56bfff700 1 -- 172.21.15.45:0/2275838857 >> v1:172.21.15.152:6789/0 conn(0x7fc5740d2320 legacy=0x7fc5740cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:12:13.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.617+0000 7fc56bfff700 1 -- 172.21.15.45:0/2275838857 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5740d1300 con 0x7fc574161340 2023-11-28T12:12:13.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.617+0000 7fc5737fe700 1 --2- 172.21.15.45:0/2275838857 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc57415c9b0 0x7fc5740b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:12:13.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.618+0000 7fc56bfff700 1 --2- 172.21.15.45:0/2275838857 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc574161340 0x7fc5740d1de0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fc55c0098f0 tx=0x7fc55c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a4b81305cefd834 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:13.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.618+0000 7fc572ffd700 1 -- 172.21.15.45:0/2275838857 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc55c00b8a0 con 0x7fc574161340 2023-11-28T12:12:13.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.618+0000 7fc572ffd700 1 -- 172.21.15.45:0/2275838857 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc55c00ba00 con 0x7fc574161340 2023-11-28T12:12:13.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.618+0000 7fc572ffd700 1 -- 172.21.15.45:0/2275838857 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc55c00bd90 con 0x7fc574161340 2023-11-28T12:12:13.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.619+0000 7fc579bff700 1 -- 172.21.15.45:0/2275838857 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc574161340 msgr2=0x7fc5740d1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:13.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.619+0000 7fc579bff700 1 --2- 172.21.15.45:0/2275838857 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc574161340 0x7fc5740d1de0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fc55c0098f0 tx=0x7fc55c009c00 comp rx=0 tx=0).stop 2023-11-28T12:12:13.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.619+0000 7fc579bff700 1 -- 172.21.15.45:0/2275838857 shutdown_connections 2023-11-28T12:12:13.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.619+0000 7fc579bff700 1 --2- 172.21.15.45:0/2275838857 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc57415c9b0 0x7fc5740b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:13.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.619+0000 7fc579bff700 1 --2- 172.21.15.45:0/2275838857 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc574161340 0x7fc5740d1de0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:13.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.619+0000 7fc579bff700 1 -- 172.21.15.45:0/2275838857 >> 172.21.15.45:0/2275838857 conn(0x7fc574072600 msgr2=0x7fc5740cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:13.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.619+0000 7fc579bff700 1 -- 172.21.15.45:0/2275838857 shutdown_connections 2023-11-28T12:12:13.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.619+0000 7fc579bff700 1 -- 172.21.15.45:0/2275838857 wait complete. 2023-11-28T12:12:13.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.620+0000 7fc579bff700 1 Processor -- start 2023-11-28T12:12:13.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.621+0000 7fc579bff700 1 -- start start 2023-11-28T12:12:13.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.622+0000 7fc579bff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc5740d2320 0x7fc5741f2550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:13.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.622+0000 7fc579bff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc57415c9b0 0x7fc5740c5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:13.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.622+0000 7fc579bff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc574161340 0x7fc5740c9a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:13.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.622+0000 7fc579bff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5740c6480 con 0x7fc5740d2320 2023-11-28T12:12:13.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.622+0000 7fc579bff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc574154a30 con 0x7fc57415c9b0 2023-11-28T12:12:13.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.622+0000 7fc579bff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5740c9fb0 con 0x7fc574161340 2023-11-28T12:12:13.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.622+0000 7fc5737fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc5740d2320 0x7fc5741f2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:13.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.622+0000 7fc5737fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc5740d2320 0x7fc5741f2550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36598/0 (socket says 172.21.15.45:36598) 2023-11-28T12:12:13.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.622+0000 7fc5737fe700 1 -- 172.21.15.45:0/539894430 learned_addr learned my addr 172.21.15.45:0/539894430 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:12:13.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.622+0000 7fc573fff700 1 --2- 172.21.15.45:0/539894430 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc574161340 0x7fc5740c9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:13.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.622+0000 7fc56bfff700 1 --2- 172.21.15.45:0/539894430 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc57415c9b0 0x7fc5740c5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:13.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.622+0000 7fc5737fe700 1 -- 172.21.15.45:0/539894430 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc574161340 msgr2=0x7fc5740c9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:13.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.622+0000 7fc5737fe700 1 --2- 172.21.15.45:0/539894430 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc574161340 0x7fc5740c9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:13.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.622+0000 7fc5737fe700 1 -- 172.21.15.45:0/539894430 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc57415c9b0 msgr2=0x7fc5740c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:13.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.622+0000 7fc5737fe700 1 --2- 172.21.15.45:0/539894430 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc57415c9b0 0x7fc5740c5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:13.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.622+0000 7fc5737fe700 1 -- 172.21.15.45:0/539894430 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc55c009550 con 0x7fc5740d2320 2023-11-28T12:12:13.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.623+0000 7fc5737fe700 1 --2- 172.21.15.45:0/539894430 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc5740d2320 0x7fc5741f2550 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fc56400c750 tx=0x7fc56400ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:13.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.623+0000 7fc570ff9700 1 -- 172.21.15.45:0/539894430 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc564011800 con 0x7fc5740d2320 2023-11-28T12:12:13.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.623+0000 7fc570ff9700 1 -- 172.21.15.45:0/539894430 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc564011960 con 0x7fc5740d2320 2023-11-28T12:12:13.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.623+0000 7fc579bff700 1 -- 172.21.15.45:0/539894430 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5740b5130 con 0x7fc5740d2320 2023-11-28T12:12:13.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.623+0000 7fc570ff9700 1 -- 172.21.15.45:0/539894430 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc564011cd0 con 0x7fc5740d2320 2023-11-28T12:12:13.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.623+0000 7fc579bff700 1 -- 172.21.15.45:0/539894430 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5740d15e0 con 0x7fc5740d2320 2023-11-28T12:12:13.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.624+0000 7fc579bff700 1 -- 172.21.15.45:0/539894430 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5740b52c0 con 0x7fc5740d2320 2023-11-28T12:12:13.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.625+0000 7fc570ff9700 1 -- 172.21.15.45:0/539894430 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fc564020070 con 0x7fc5740d2320 2023-11-28T12:12:13.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.626+0000 7fc570ff9700 1 --2- 172.21.15.45:0/539894430 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fc5540682f0 0x7fc55406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:13.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.626+0000 7fc570ff9700 1 -- 172.21.15.45:0/539894430 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6207+0+0 (secure 0 0 0) 0x7fc564085a00 con 0x7fc5740d2320 2023-11-28T12:12:13.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.626+0000 7fc56bfff700 1 --2- 172.21.15.45:0/539894430 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fc5540682f0 0x7fc55406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:13.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.627+0000 7fc56bfff700 1 --2- 172.21.15.45:0/539894430 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fc5540682f0 0x7fc55406a7a0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fc55c009c40 tx=0x7fc55c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:13.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.630+0000 7fc570ff9700 1 -- 172.21.15.45:0/539894430 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fc5640521d0 con 0x7fc5740d2320 2023-11-28T12:12:13.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.877+0000 7fc579bff700 1 -- 172.21.15.45:0/539894430 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc5740745c0 con 0x7fc5740d2320 2023-11-28T12:12:13.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.877+0000 7fc570ff9700 1 -- 172.21.15.45:0/539894430 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+4649 (secure 0 0 0) 0x7fc5640557f0 con 0x7fc5740d2320 2023-11-28T12:12:13.879 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:12:13.879 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":33,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5423,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6836/735970231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":735970231},{"type":"v1","addr":"172.21.15.152:6836","nonce":735970231}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5797,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/3354918087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6835","nonce":3354918087},{"type":"v1","addr":"172.21.15.152:6837","nonce":3354918087}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5806,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/275804060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":275804060},{"type":"v1","addr":"172.21.15.45:6835","nonce":275804060}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T12:09:35.571815+0000","modified":"2023-11-28T12:09:51.897203+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5979},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5979":{"gid":5979,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":7,"addr":"172.21.15.45:6833/3784258337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":3784258337},{"type":"v1","addr":"172.21.15.45:6833","nonce":3784258337}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-28T12:12:13.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.880+0000 7fc579bff700 1 -- 172.21.15.45:0/539894430 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fc5540682f0 msgr2=0x7fc55406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:13.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.880+0000 7fc579bff700 1 --2- 172.21.15.45:0/539894430 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fc5540682f0 0x7fc55406a7a0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fc55c009c40 tx=0x7fc55c008030 comp rx=0 tx=0).stop 2023-11-28T12:12:13.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.880+0000 7fc579bff700 1 -- 172.21.15.45:0/539894430 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc5740d2320 msgr2=0x7fc5741f2550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:13.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.880+0000 7fc579bff700 1 --2- 172.21.15.45:0/539894430 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc5740d2320 0x7fc5741f2550 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fc56400c750 tx=0x7fc56400ca60 comp rx=0 tx=0).stop 2023-11-28T12:12:13.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.880+0000 7fc579bff700 1 -- 172.21.15.45:0/539894430 shutdown_connections 2023-11-28T12:12:13.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.880+0000 7fc579bff700 1 --2- 172.21.15.45:0/539894430 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fc5540682f0 0x7fc55406a7a0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:13.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.880+0000 7fc579bff700 1 --2- 172.21.15.45:0/539894430 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc574161340 0x7fc5740c9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:13.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.880+0000 7fc579bff700 1 --2- 172.21.15.45:0/539894430 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc5740d2320 0x7fc5741f2550 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:13.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.880+0000 7fc579bff700 1 --2- 172.21.15.45:0/539894430 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc57415c9b0 0x7fc5740c5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:13.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.880+0000 7fc579bff700 1 -- 172.21.15.45:0/539894430 >> 172.21.15.45:0/539894430 conn(0x7fc574072600 msgr2=0x7fc57415cd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:13.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.880+0000 7fc579bff700 1 -- 172.21.15.45:0/539894430 shutdown_connections 2023-11-28T12:12:13.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:13.880+0000 7fc579bff700 1 -- 172.21.15.45:0/539894430 wait complete. 2023-11-28T12:12:13.883 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 33 2023-11-28T12:12:13.899 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T12:12:14.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.101+0000 7f572abff700 1 Processor -- start 2023-11-28T12:12:14.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.101+0000 7f572abff700 1 -- start start 2023-11-28T12:12:14.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.102+0000 7f572abff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5724161340 0x7f57240d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:14.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.103+0000 7f572abff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57240d1950 con 0x7f572415c9b0 2023-11-28T12:12:14.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.103+0000 7f572abff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57240b5520 con 0x7f57240d2320 2023-11-28T12:12:14.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.103+0000 7f572abff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57240b5800 con 0x7f5724161340 2023-11-28T12:12:14.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.103+0000 7f572899b700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f572415c9b0 0x7f57240b4bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:57756/0 (socket says 172.21.15.45:57756) 2023-11-28T12:12:14.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.103+0000 7f572899b700 1 -- 172.21.15.45:0/2326695050 learned_addr learned my addr 172.21.15.45:0/2326695050 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:12:14.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.103+0000 7f5723fff700 1 --2- 172.21.15.45:0/2326695050 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5724161340 0x7f57240d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:14.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.103+0000 7f57237fe700 1 -- 172.21.15.45:0/2326695050 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1108970021 0 0) 0x7f57240d1950 con 0x7f572415c9b0 2023-11-28T12:12:14.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.103+0000 7f57237fe700 1 -- 172.21.15.45:0/2326695050 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57140035b0 con 0x7f572415c9b0 2023-11-28T12:12:14.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.103+0000 7f57237fe700 1 -- 172.21.15.45:0/2326695050 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2023525417 0 0) 0x7f57240b5520 con 0x7f57240d2320 2023-11-28T12:12:14.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.104+0000 7f57237fe700 1 -- 172.21.15.45:0/2326695050 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57240d1950 con 0x7f57240d2320 2023-11-28T12:12:14.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.104+0000 7f57237fe700 1 -- 172.21.15.45:0/2326695050 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 884834430 0 0) 0x7f57140035b0 con 0x7f572415c9b0 2023-11-28T12:12:14.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.104+0000 7f57237fe700 1 -- 172.21.15.45:0/2326695050 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5724161340 msgr2=0x7f57240d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:12:14.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.104+0000 7f57237fe700 1 --2- 172.21.15.45:0/2326695050 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5724161340 0x7f57240d1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:14.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.104+0000 7f57237fe700 1 -- 172.21.15.45:0/2326695050 >> v1:172.21.15.152:6789/0 conn(0x7f57240d2320 legacy=0x7f57240cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:14.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.104+0000 7f57237fe700 1 -- 172.21.15.45:0/2326695050 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57240d1300 con 0x7f572415c9b0 2023-11-28T12:12:14.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.104+0000 7f57237fe700 1 -- 172.21.15.45:0/2326695050 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3460218165 0 0) 0x7f5718001670 con 0x7f572415c9b0 2023-11-28T12:12:14.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.104+0000 7f57237fe700 1 -- 172.21.15.45:0/2326695050 >> v1:172.21.15.45:6789/0 conn(0x7f572415c9b0 legacy=0x7f57240b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:14.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.104+0000 7f57237fe700 1 --2- 172.21.15.45:0/2326695050 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5724161340 0x7f5714003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:14.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.104+0000 7f57237fe700 1 --2- 172.21.15.45:0/2326695050 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5714004170 0x7f5714004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:14.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.104+0000 7f57237fe700 1 --2- 172.21.15.45:0/2326695050 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5714004d90 0x7f5714005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:14.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.104+0000 7f57237fe700 1 -- 172.21.15.45:0/2326695050 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57240b5800 con 0x7f5714004d90 2023-11-28T12:12:14.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.104+0000 7f57237fe700 1 -- 172.21.15.45:0/2326695050 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f571400bba0 con 0x7f5714004170 2023-11-28T12:12:14.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.104+0000 7f57237fe700 1 -- 172.21.15.45:0/2326695050 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f571400bd60 con 0x7f5724161340 2023-11-28T12:12:14.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.104+0000 7f572899b700 1 --2- 172.21.15.45:0/2326695050 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5724161340 0x7f5714003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:14.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.104+0000 7f572919c700 1 --2- 172.21.15.45:0/2326695050 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5714004d90 0x7f5714005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:14.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.104+0000 7f5723fff700 1 --2- 172.21.15.45:0/2326695050 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5714004170 0x7f5714004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:14.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.105+0000 7f572919c700 1 -- 172.21.15.45:0/2326695050 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5724161340 msgr2=0x7f5714003bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:12:14.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.105+0000 7f572919c700 1 --2- 172.21.15.45:0/2326695050 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5724161340 0x7f5714003bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:14.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.105+0000 7f572919c700 1 -- 172.21.15.45:0/2326695050 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5714004170 msgr2=0x7f5714004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:12:14.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.105+0000 7f572919c700 1 --2- 172.21.15.45:0/2326695050 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5714004170 0x7f5714004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:14.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.105+0000 7f572919c700 1 -- 172.21.15.45:0/2326695050 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57140035b0 con 0x7f5714004d90 2023-11-28T12:12:14.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.105+0000 7f572899b700 1 --2- 172.21.15.45:0/2326695050 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5724161340 0x7f5714003bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:12:14.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.105+0000 7f572919c700 1 --2- 172.21.15.45:0/2326695050 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5714004d90 0x7f5714005200 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f571c00c2f0 tx=0x7f5714005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd9afb1dbd50126a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:14.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.105+0000 7f57237fe700 1 -- 172.21.15.45:0/2326695050 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f571c001f30 con 0x7f5714004d90 2023-11-28T12:12:14.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.105+0000 7f57237fe700 1 -- 172.21.15.45:0/2326695050 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f571c00ce90 con 0x7f5714004d90 2023-11-28T12:12:14.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.105+0000 7f57237fe700 1 -- 172.21.15.45:0/2326695050 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f571c003c40 con 0x7f5714004d90 2023-11-28T12:12:14.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.106+0000 7f572abff700 1 -- 172.21.15.45:0/2326695050 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5714004d90 msgr2=0x7f5714005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:14.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.106+0000 7f572abff700 1 --2- 172.21.15.45:0/2326695050 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5714004d90 0x7f5714005200 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f571c00c2f0 tx=0x7f5714005880 comp rx=0 tx=0).stop 2023-11-28T12:12:14.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.106+0000 7f572919c700 1 -- 172.21.15.45:0/2326695050 reap_dead start 2023-11-28T12:12:14.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.106+0000 7f572abff700 1 -- 172.21.15.45:0/2326695050 shutdown_connections 2023-11-28T12:12:14.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.106+0000 7f572abff700 1 -- 172.21.15.45:0/2326695050 >> 172.21.15.45:0/2326695050 conn(0x7f5724072600 msgr2=0x7f57240cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:14.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.106+0000 7f572abff700 1 -- 172.21.15.45:0/2326695050 shutdown_connections 2023-11-28T12:12:14.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.106+0000 7f572abff700 1 -- 172.21.15.45:0/2326695050 wait complete. 2023-11-28T12:12:14.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.108+0000 7f572abff700 1 Processor -- start 2023-11-28T12:12:14.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.108+0000 7f572abff700 1 -- start start 2023-11-28T12:12:14.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.109+0000 7f572abff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5714004d90 0x7f5724156480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:14.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.109+0000 7f572abff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5724154a40 0x7f57241591f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:14.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.109+0000 7f572abff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5724159730 0x7f5724143380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:14.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.109+0000 7f572abff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5724156060 con 0x7f5724154a40 2023-11-28T12:12:14.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.109+0000 7f572abff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5724159ba0 con 0x7f5724159730 2023-11-28T12:12:14.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.109+0000 7f572abff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57240c69b0 con 0x7f5714004d90 2023-11-28T12:12:14.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.109+0000 7f5723fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5724154a40 0x7f57241591f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:14.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.109+0000 7f5723fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5724154a40 0x7f57241591f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36620/0 (socket says 172.21.15.45:36620) 2023-11-28T12:12:14.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.109+0000 7f5723fff700 1 -- 172.21.15.45:0/2992793992 learned_addr learned my addr 172.21.15.45:0/2992793992 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:12:14.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.109+0000 7f572899b700 1 --2- 172.21.15.45:0/2992793992 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5714004d90 0x7f5724156480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:14.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.109+0000 7f572919c700 1 --2- 172.21.15.45:0/2992793992 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5724159730 0x7f5724143380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:14.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.109+0000 7f5723fff700 1 -- 172.21.15.45:0/2992793992 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5714004d90 msgr2=0x7f5724156480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:14.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.109+0000 7f5723fff700 1 --2- 172.21.15.45:0/2992793992 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5714004d90 0x7f5724156480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:14.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.109+0000 7f5723fff700 1 -- 172.21.15.45:0/2992793992 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5724159730 msgr2=0x7f5724143380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:14.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.109+0000 7f5723fff700 1 --2- 172.21.15.45:0/2992793992 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5724159730 0x7f5724143380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:14.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.109+0000 7f5723fff700 1 -- 172.21.15.45:0/2992793992 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f572415cd80 con 0x7f5724154a40 2023-11-28T12:12:14.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.109+0000 7f572919c700 1 --2- 172.21.15.45:0/2992793992 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5724159730 0x7f5724143380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:12:14.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.110+0000 7f5723fff700 1 --2- 172.21.15.45:0/2992793992 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5724154a40 0x7f57241591f0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f5710011aa0 tx=0x7f5710011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:14.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.110+0000 7f57217fa700 1 -- 172.21.15.45:0/2992793992 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f571000f980 con 0x7f5724154a40 2023-11-28T12:12:14.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.110+0000 7f57217fa700 1 -- 172.21.15.45:0/2992793992 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f571000fae0 con 0x7f5724154a40 2023-11-28T12:12:14.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.110+0000 7f572abff700 1 -- 172.21.15.45:0/2992793992 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57240d15e0 con 0x7f5724154a40 2023-11-28T12:12:14.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.110+0000 7f57217fa700 1 -- 172.21.15.45:0/2992793992 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f571000fe90 con 0x7f5724154a40 2023-11-28T12:12:14.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.110+0000 7f572abff700 1 -- 172.21.15.45:0/2992793992 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f572415cf10 con 0x7f5724154a40 2023-11-28T12:12:14.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.111+0000 7f572abff700 1 -- 172.21.15.45:0/2992793992 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57240745c0 con 0x7f5724154a40 2023-11-28T12:12:14.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.112+0000 7f57217fa700 1 -- 172.21.15.45:0/2992793992 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f571001d400 con 0x7f5724154a40 2023-11-28T12:12:14.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.113+0000 7f57217fa700 1 --2- 172.21.15.45:0/2992793992 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f57080682f0 0x7f570806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:14.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.113+0000 7f57217fa700 1 -- 172.21.15.45:0/2992793992 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f5710086700 con 0x7f5724154a40 2023-11-28T12:12:14.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.114+0000 7f572899b700 1 --2- 172.21.15.45:0/2992793992 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f57080682f0 0x7f570806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:14.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.114+0000 7f572899b700 1 --2- 172.21.15.45:0/2992793992 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f57080682f0 0x7f570806a7a0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f5718001200 tx=0x7f5718009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:14.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.117+0000 7f57217fa700 1 -- 172.21.15.45:0/2992793992 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f5710052e40 con 0x7f5724154a40 2023-11-28T12:12:14.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.318+0000 7f572abff700 1 -- 172.21.15.45:0/2992793992 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f57240d08a0 con 0x7f5724154a40 2023-11-28T12:12:14.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.319+0000 7f57217fa700 1 -- 172.21.15.45:0/2992793992 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) v1 ==== 74+0+18103 (secure 0 0 0) 0x7f5710056460 con 0x7f5724154a40 2023-11-28T12:12:14.321 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:12:14.321 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":63,"fsid":"bd7c37f1-f7c6-4778-b845-52cf2aa6e366","created":"2023-11-28T12:06:09.045075+0000","modified":"2023-11-28T12:10:19.965300+0000","last_up_change":"2023-11-28T12:06:21.282227+0000","last_in_change":"2023-11-28T12:06:12.560924+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T12:06:21.807108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T12:06:22.491009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-11-28T12:09:33.476735+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-11-28T12:09:34.551527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d0cdd8a-87fd-4f2c-91bd-47bdfa661905","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":115843},{"type":"v1","addr":"172.21.15.45:6808","nonce":115843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":115843},{"type":"v1","addr":"172.21.15.45:6811","nonce":115843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":115843},{"type":"v1","addr":"172.21.15.45:6815","nonce":115843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":115843},{"type":"v1","addr":"172.21.15.45:6813","nonce":115843}]},"public_addr":"172.21.15.45:6808/115843","cluster_addr":"172.21.15.45:6811/115843","heartbeat_back_addr":"172.21.15.45:6815/115843","heartbeat_front_addr":"172.21.15.45:6813/115843","state":["exists","up"]},{"osd":1,"uuid":"c5de4ebd-9ec5-40b3-9caa-9b706fab4c76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":115842},{"type":"v1","addr":"172.21.15.45:6801","nonce":115842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":115842},{"type":"v1","addr":"172.21.15.45:6803","nonce":115842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6807","nonce":115842},{"type":"v1","addr":"172.21.15.45:6809","nonce":115842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":115842},{"type":"v1","addr":"172.21.15.45:6805","nonce":115842}]},"public_addr":"172.21.15.45:6801/115842","cluster_addr":"172.21.15.45:6803/115842","heartbeat_back_addr":"172.21.15.45:6809/115842","heartbeat_front_addr":"172.21.15.45:6805/115842","state":["exists","up"]},{"osd":2,"uuid":"9f4b36b2-65d2-40e7-9fe6-a2991afa71c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":115850},{"type":"v1","addr":"172.21.15.45:6819","nonce":115850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":115850},{"type":"v1","addr":"172.21.15.45:6823","nonce":115850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":115850},{"type":"v1","addr":"172.21.15.45:6831","nonce":115850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":115850},{"type":"v1","addr":"172.21.15.45:6828","nonce":115850}]},"public_addr":"172.21.15.45:6819/115850","cluster_addr":"172.21.15.45:6823/115850","heartbeat_back_addr":"172.21.15.45:6831/115850","heartbeat_front_addr":"172.21.15.45:6828/115850","state":["exists","up"]},{"osd":3,"uuid":"6fe7ef05-4e0d-426c-bf94-44b51d4d550b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":115848},{"type":"v1","addr":"172.21.15.45:6818","nonce":115848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":115848},{"type":"v1","addr":"172.21.15.45:6822","nonce":115848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6827","nonce":115848},{"type":"v1","addr":"172.21.15.45:6829","nonce":115848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":115848},{"type":"v1","addr":"172.21.15.45:6825","nonce":115848}]},"public_addr":"172.21.15.45:6818/115848","cluster_addr":"172.21.15.45:6822/115848","heartbeat_back_addr":"172.21.15.45:6829/115848","heartbeat_front_addr":"172.21.15.45:6825/115848","state":["exists","up"]},{"osd":4,"uuid":"fa403c08-d8a1-4a3a-8384-cb465c1a654c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":116092},{"type":"v1","addr":"172.21.15.152:6801","nonce":116092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":116092},{"type":"v1","addr":"172.21.15.152:6803","nonce":116092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":116092},{"type":"v1","addr":"172.21.15.152:6807","nonce":116092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":116092},{"type":"v1","addr":"172.21.15.152:6805","nonce":116092}]},"public_addr":"172.21.15.152:6801/116092","cluster_addr":"172.21.15.152:6803/116092","heartbeat_back_addr":"172.21.15.152:6807/116092","heartbeat_front_addr":"172.21.15.152:6805/116092","state":["exists","up"]},{"osd":5,"uuid":"399fc450-39fa-43a6-bf80-0b8bcb41bd95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6815","nonce":116093},{"type":"v1","addr":"172.21.15.152:6817","nonce":116093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":116093},{"type":"v1","addr":"172.21.15.152:6819","nonce":116093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":116093},{"type":"v1","addr":"172.21.15.152:6823","nonce":116093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":116093},{"type":"v1","addr":"172.21.15.152:6821","nonce":116093}]},"public_addr":"172.21.15.152:6817/116093","cluster_addr":"172.21.15.152:6819/116093","heartbeat_back_addr":"172.21.15.152:6823/116093","heartbeat_front_addr":"172.21.15.152:6821/116093","state":["exists","up"]},{"osd":6,"uuid":"e59a4017-2d23-4627-836b-e25b2d3ddaaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":116094},{"type":"v1","addr":"172.21.15.152:6809","nonce":116094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":116094},{"type":"v1","addr":"172.21.15.152:6811","nonce":116094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":116094},{"type":"v1","addr":"172.21.15.152:6816","nonce":116094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":116094},{"type":"v1","addr":"172.21.15.152:6813","nonce":116094}]},"public_addr":"172.21.15.152:6809/116094","cluster_addr":"172.21.15.152:6811/116094","heartbeat_back_addr":"172.21.15.152:6816/116094","heartbeat_front_addr":"172.21.15.152:6813/116094","state":["exists","up"]},{"osd":7,"uuid":"8d7f9d4b-bf08-4670-8591-388c0f012a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":116097},{"type":"v1","addr":"172.21.15.152:6825","nonce":116097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":116097},{"type":"v1","addr":"172.21.15.152:6827","nonce":116097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":116097},{"type":"v1","addr":"172.21.15.152:6831","nonce":116097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":116097},{"type":"v1","addr":"172.21.15.152:6829","nonce":116097}]},"public_addr":"172.21.15.152:6825/116097","cluster_addr":"172.21.15.152:6827/116097","heartbeat_back_addr":"172.21.15.152:6831/116097","heartbeat_front_addr":"172.21.15.152:6829/116097","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.937710+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.865423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.159434+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.913090+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.131647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.966255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.972583+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.177209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.15","mappings":[{"from":7,"to":2}]},{"pgid":"10.2","mappings":[{"from":4,"to":5}]},{"pgid":"10.21","mappings":[{"from":4,"to":3}]},{"pgid":"10.37","mappings":[{"from":7,"to":3}]},{"pgid":"10.3b","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T12:12:14.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.321+0000 7f572abff700 1 -- 172.21.15.45:0/2992793992 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f57080682f0 msgr2=0x7f570806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:14.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.321+0000 7f572abff700 1 --2- 172.21.15.45:0/2992793992 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f57080682f0 0x7f570806a7a0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f5718001200 tx=0x7f5718009040 comp rx=0 tx=0).stop 2023-11-28T12:12:14.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.322+0000 7f572abff700 1 -- 172.21.15.45:0/2992793992 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5724154a40 msgr2=0x7f57241591f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:14.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.322+0000 7f572abff700 1 --2- 172.21.15.45:0/2992793992 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5724154a40 0x7f57241591f0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f5710011aa0 tx=0x7f5710011e60 comp rx=0 tx=0).stop 2023-11-28T12:12:14.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.322+0000 7f572abff700 1 -- 172.21.15.45:0/2992793992 shutdown_connections 2023-11-28T12:12:14.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.322+0000 7f572abff700 1 --2- 172.21.15.45:0/2992793992 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f57080682f0 0x7f570806a7a0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:14.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.322+0000 7f572abff700 1 --2- 172.21.15.45:0/2992793992 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5724159730 0x7f5724143380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:14.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.322+0000 7f572abff700 1 --2- 172.21.15.45:0/2992793992 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5714004d90 0x7f5724156480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:14.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.322+0000 7f572abff700 1 --2- 172.21.15.45:0/2992793992 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5724154a40 0x7f57241591f0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:14.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.322+0000 7f572abff700 1 -- 172.21.15.45:0/2992793992 >> 172.21.15.45:0/2992793992 conn(0x7f5724072600 msgr2=0x7f572406a900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:14.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.322+0000 7f572abff700 1 -- 172.21.15.45:0/2992793992 shutdown_connections 2023-11-28T12:12:14.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.322+0000 7f572abff700 1 -- 172.21.15.45:0/2992793992 wait complete. 2023-11-28T12:12:14.341 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-28T12:12:14.342 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T12:12:14.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.545+0000 7fc5757ff700 1 Processor -- start 2023-11-28T12:12:14.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.545+0000 7fc5757ff700 1 -- start start 2023-11-28T12:12:14.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.546+0000 7fc5757ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc57015c9b0 0x7fc5700b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:14.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.546+0000 7fc5757ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5700d1950 con 0x7fc570161340 2023-11-28T12:12:14.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.546+0000 7fc5757ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5700d24f0 con 0x7fc5700cd7c0 2023-11-28T12:12:14.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.546+0000 7fc5757ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5700b5800 con 0x7fc57015c9b0 2023-11-28T12:12:14.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.547+0000 7fc56effd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc57015c9b0 0x7fc5700b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:14.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.547+0000 7fc56e7fc700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fc570161340 0x7fc5700d1de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:57770/0 (socket says 172.21.15.45:57770) 2023-11-28T12:12:14.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.547+0000 7fc56e7fc700 1 -- 172.21.15.45:0/3091801525 learned_addr learned my addr 172.21.15.45:0/3091801525 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:12:14.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.547+0000 7fc56effd700 1 -- 172.21.15.45:0/3091801525 >> v1:172.21.15.152:6789/0 conn(0x7fc5700cd7c0 legacy=0x7fc5700b5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:14.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.547+0000 7fc56effd700 1 -- 172.21.15.45:0/3091801525 >> v1:172.21.15.45:6789/0 conn(0x7fc570161340 legacy=0x7fc5700d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:14.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.547+0000 7fc56effd700 1 -- 172.21.15.45:0/3091801525 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5700b5520 con 0x7fc57015c9b0 2023-11-28T12:12:14.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.547+0000 7fc56effd700 1 --2- 172.21.15.45:0/3091801525 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc57015c9b0 0x7fc5700b4bf0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fc560009840 tx=0x7fc560009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97404a169e8154b1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:14.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.547+0000 7fc56dffb700 1 -- 172.21.15.45:0/3091801525 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc560011830 con 0x7fc57015c9b0 2023-11-28T12:12:14.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.548+0000 7fc56dffb700 1 -- 172.21.15.45:0/3091801525 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc560011990 con 0x7fc57015c9b0 2023-11-28T12:12:14.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.548+0000 7fc56dffb700 1 -- 172.21.15.45:0/3091801525 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc560011d20 con 0x7fc57015c9b0 2023-11-28T12:12:14.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.548+0000 7fc5757ff700 1 -- 172.21.15.45:0/3091801525 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc57015c9b0 msgr2=0x7fc5700b4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:14.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.548+0000 7fc5757ff700 1 --2- 172.21.15.45:0/3091801525 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc57015c9b0 0x7fc5700b4bf0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fc560009840 tx=0x7fc560009b50 comp rx=0 tx=0).stop 2023-11-28T12:12:14.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.548+0000 7fc5757ff700 1 -- 172.21.15.45:0/3091801525 shutdown_connections 2023-11-28T12:12:14.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.548+0000 7fc5757ff700 1 --2- 172.21.15.45:0/3091801525 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc57015c9b0 0x7fc5700b4bf0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:14.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.548+0000 7fc5757ff700 1 -- 172.21.15.45:0/3091801525 >> 172.21.15.45:0/3091801525 conn(0x7fc570072600 msgr2=0x7fc5700cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:14.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.548+0000 7fc5757ff700 1 -- 172.21.15.45:0/3091801525 shutdown_connections 2023-11-28T12:12:14.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.548+0000 7fc5757ff700 1 -- 172.21.15.45:0/3091801525 wait complete. 2023-11-28T12:12:14.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.550+0000 7fc5757ff700 1 Processor -- start 2023-11-28T12:12:14.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.550+0000 7fc5757ff700 1 -- start start 2023-11-28T12:12:14.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.551+0000 7fc5757ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc5700cd7c0 0x7fc5700b7b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:14.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.551+0000 7fc5757ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc57015c9b0 0x7fc5700cc840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:14.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.551+0000 7fc5757ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc570161340 0x7fc570143070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:14.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.551+0000 7fc5757ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc570157a20 con 0x7fc570161340 2023-11-28T12:12:14.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.551+0000 7fc5757ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5700c96c0 con 0x7fc57015c9b0 2023-11-28T12:12:14.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.551+0000 7fc5757ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5700c99a0 con 0x7fc5700cd7c0 2023-11-28T12:12:14.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.551+0000 7fc56f7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc570161340 0x7fc570143070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:14.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.552+0000 7fc56effd700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc5700cd7c0 0x7fc5700b7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:14.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.552+0000 7fc56f7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc570161340 0x7fc570143070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36638/0 (socket says 172.21.15.45:36638) 2023-11-28T12:12:14.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.552+0000 7fc56f7fe700 1 -- 172.21.15.45:0/2563889574 learned_addr learned my addr 172.21.15.45:0/2563889574 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:12:14.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.552+0000 7fc56e7fc700 1 --2- 172.21.15.45:0/2563889574 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc57015c9b0 0x7fc5700cc840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:14.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.552+0000 7fc56f7fe700 1 -- 172.21.15.45:0/2563889574 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc5700cd7c0 msgr2=0x7fc5700b7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:14.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.552+0000 7fc56f7fe700 1 --2- 172.21.15.45:0/2563889574 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc5700cd7c0 0x7fc5700b7b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:14.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.552+0000 7fc56f7fe700 1 -- 172.21.15.45:0/2563889574 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc57015c9b0 msgr2=0x7fc5700cc840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:14.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.552+0000 7fc56f7fe700 1 --2- 172.21.15.45:0/2563889574 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc57015c9b0 0x7fc5700cc840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:14.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.552+0000 7fc56f7fe700 1 -- 172.21.15.45:0/2563889574 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5600094a0 con 0x7fc570161340 2023-11-28T12:12:14.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.552+0000 7fc56f7fe700 1 --2- 172.21.15.45:0/2563889574 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc570161340 0x7fc570143070 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fc56800cb50 tx=0x7fc56800ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:14.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.552+0000 7fc5577fe700 1 -- 172.21.15.45:0/2563889574 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc568003c00 con 0x7fc570161340 2023-11-28T12:12:14.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.552+0000 7fc5577fe700 1 -- 172.21.15.45:0/2563889574 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc568003d60 con 0x7fc570161340 2023-11-28T12:12:14.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.552+0000 7fc5577fe700 1 -- 172.21.15.45:0/2563889574 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc56800aa20 con 0x7fc570161340 2023-11-28T12:12:14.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.552+0000 7fc5757ff700 1 -- 172.21.15.45:0/2563889574 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5700d15e0 con 0x7fc570161340 2023-11-28T12:12:14.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.553+0000 7fc5757ff700 1 -- 172.21.15.45:0/2563889574 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5700d1300 con 0x7fc570161340 2023-11-28T12:12:14.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.554+0000 7fc5757ff700 1 -- 172.21.15.45:0/2563889574 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5700b5130 con 0x7fc570161340 2023-11-28T12:12:14.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.555+0000 7fc5577fe700 1 -- 172.21.15.45:0/2563889574 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fc568010050 con 0x7fc570161340 2023-11-28T12:12:14.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.556+0000 7fc5577fe700 1 --2- 172.21.15.45:0/2563889574 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fc55c0682f0 0x7fc55c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:14.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.556+0000 7fc5577fe700 1 -- 172.21.15.45:0/2563889574 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6207+0+0 (secure 0 0 0) 0x7fc568085ca0 con 0x7fc570161340 2023-11-28T12:12:14.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.556+0000 7fc56effd700 1 --2- 172.21.15.45:0/2563889574 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fc55c0682f0 0x7fc55c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:14.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.557+0000 7fc56effd700 1 --2- 172.21.15.45:0/2563889574 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fc55c0682f0 0x7fc55c06a7a0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fc5600090b0 tx=0x7fc56001c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:14.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.560+0000 7fc5577fe700 1 -- 172.21.15.45:0/2563889574 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fc568052380 con 0x7fc570161340 2023-11-28T12:12:14.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.808+0000 7fc5757ff700 1 -- 172.21.15.45:0/2563889574 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc5700745c0 con 0x7fc570161340 2023-11-28T12:12:14.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.809+0000 7fc5577fe700 1 -- 172.21.15.45:0/2563889574 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+4649 (secure 0 0 0) 0x7fc5680559a0 con 0x7fc570161340 2023-11-28T12:12:14.812 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:12:14.812 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":33,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5423,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6836/735970231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":735970231},{"type":"v1","addr":"172.21.15.152:6836","nonce":735970231}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5797,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/3354918087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6835","nonce":3354918087},{"type":"v1","addr":"172.21.15.152:6837","nonce":3354918087}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5806,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/275804060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":275804060},{"type":"v1","addr":"172.21.15.45:6835","nonce":275804060}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T12:09:35.571815+0000","modified":"2023-11-28T12:09:51.897203+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5979},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5979":{"gid":5979,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":7,"addr":"172.21.15.45:6833/3784258337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":3784258337},{"type":"v1","addr":"172.21.15.45:6833","nonce":3784258337}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-28T12:12:14.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.811+0000 7fc5757ff700 1 -- 172.21.15.45:0/2563889574 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fc55c0682f0 msgr2=0x7fc55c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:14.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.811+0000 7fc5757ff700 1 --2- 172.21.15.45:0/2563889574 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fc55c0682f0 0x7fc55c06a7a0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fc5600090b0 tx=0x7fc56001c040 comp rx=0 tx=0).stop 2023-11-28T12:12:14.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.811+0000 7fc5757ff700 1 -- 172.21.15.45:0/2563889574 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc570161340 msgr2=0x7fc570143070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:14.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.811+0000 7fc5757ff700 1 --2- 172.21.15.45:0/2563889574 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc570161340 0x7fc570143070 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fc56800cb50 tx=0x7fc56800ce60 comp rx=0 tx=0).stop 2023-11-28T12:12:14.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.811+0000 7fc5757ff700 1 -- 172.21.15.45:0/2563889574 shutdown_connections 2023-11-28T12:12:14.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.811+0000 7fc5757ff700 1 --2- 172.21.15.45:0/2563889574 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fc55c0682f0 0x7fc55c06a7a0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:14.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.811+0000 7fc5757ff700 1 --2- 172.21.15.45:0/2563889574 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc570161340 0x7fc570143070 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:14.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.811+0000 7fc5757ff700 1 --2- 172.21.15.45:0/2563889574 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fc5700cd7c0 0x7fc5700b7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:14.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.811+0000 7fc5757ff700 1 --2- 172.21.15.45:0/2563889574 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc57015c9b0 0x7fc5700cc840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:14.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.811+0000 7fc5757ff700 1 -- 172.21.15.45:0/2563889574 >> 172.21.15.45:0/2563889574 conn(0x7fc570072600 msgr2=0x7fc5700d1de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:14.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.812+0000 7fc5757ff700 1 -- 172.21.15.45:0/2563889574 shutdown_connections 2023-11-28T12:12:14.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:14.812+0000 7fc5757ff700 1 -- 172.21.15.45:0/2563889574 wait complete. 2023-11-28T12:12:14.815 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 33 2023-11-28T12:12:14.831 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T12:12:15.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.034+0000 7f7644dff700 1 Processor -- start 2023-11-28T12:12:15.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.034+0000 7f7644dff700 1 -- start start 2023-11-28T12:12:15.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.035+0000 7f7644dff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f764015c9b0 0x7f76400b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:15.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.035+0000 7f7644dff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7640161340 0x7f76400d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:15.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.035+0000 7f7644dff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76400d1950 con 0x7f76400d2320 2023-11-28T12:12:15.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.035+0000 7f7644dff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76400b5800 con 0x7f7640161340 2023-11-28T12:12:15.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.035+0000 7f7644dff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76400b5520 con 0x7f764015c9b0 2023-11-28T12:12:15.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.035+0000 7f7637fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7640161340 0x7f76400d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:15.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.035+0000 7f7637fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7640161340 0x7f76400d1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36646/0 (socket says 172.21.15.45:36646) 2023-11-28T12:12:15.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.035+0000 7f7637fff700 1 -- 172.21.15.45:0/493406911 learned_addr learned my addr 172.21.15.45:0/493406911 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:12:15.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.035+0000 7f763e59c700 1 --2- 172.21.15.45:0/493406911 >> v2:172.21.15.152:3300/0 conn(0x7f764015c9b0 0x7f76400b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:15.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.036+0000 7f7637fff700 1 -- 172.21.15.45:0/493406911 >> v2:172.21.15.152:3300/0 conn(0x7f764015c9b0 msgr2=0x7f76400b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:12:15.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.036+0000 7f7637fff700 1 --2- 172.21.15.45:0/493406911 >> v2:172.21.15.152:3300/0 conn(0x7f764015c9b0 0x7f76400b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:15.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.036+0000 7f7637fff700 1 -- 172.21.15.45:0/493406911 >> v1:172.21.15.152:6789/0 conn(0x7f76400d2320 legacy=0x7f76400cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:12:15.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.036+0000 7f7637fff700 1 -- 172.21.15.45:0/493406911 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76400d1300 con 0x7f7640161340 2023-11-28T12:12:15.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.036+0000 7f7637fff700 1 --2- 172.21.15.45:0/493406911 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7640161340 0x7f76400d1de0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f7640067460 tx=0x7f7628009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c361867b6205298 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:15.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.036+0000 7f763dd9b700 1 -- 172.21.15.45:0/493406911 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7628004230 con 0x7f7640161340 2023-11-28T12:12:15.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.036+0000 7f763dd9b700 1 -- 172.21.15.45:0/493406911 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7628004390 con 0x7f7640161340 2023-11-28T12:12:15.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.036+0000 7f763dd9b700 1 -- 172.21.15.45:0/493406911 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76280036a0 con 0x7f7640161340 2023-11-28T12:12:15.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.037+0000 7f7644dff700 1 -- 172.21.15.45:0/493406911 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7640161340 msgr2=0x7f76400d1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:15.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.037+0000 7f7644dff700 1 --2- 172.21.15.45:0/493406911 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7640161340 0x7f76400d1de0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f7640067460 tx=0x7f7628009bd0 comp rx=0 tx=0).stop 2023-11-28T12:12:15.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.037+0000 7f7644dff700 1 -- 172.21.15.45:0/493406911 shutdown_connections 2023-11-28T12:12:15.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.037+0000 7f7644dff700 1 --2- 172.21.15.45:0/493406911 >> v2:172.21.15.152:3300/0 conn(0x7f764015c9b0 0x7f76400b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:15.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.037+0000 7f7644dff700 1 --2- 172.21.15.45:0/493406911 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7640161340 0x7f76400d1de0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:15.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.037+0000 7f7644dff700 1 -- 172.21.15.45:0/493406911 >> 172.21.15.45:0/493406911 conn(0x7f7640072600 msgr2=0x7f76400cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:15.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.037+0000 7f7644dff700 1 -- 172.21.15.45:0/493406911 shutdown_connections 2023-11-28T12:12:15.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.037+0000 7f7644dff700 1 -- 172.21.15.45:0/493406911 wait complete. 2023-11-28T12:12:15.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.039+0000 7f7644dff700 1 Processor -- start 2023-11-28T12:12:15.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.039+0000 7f7644dff700 1 -- start start 2023-11-28T12:12:15.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.041+0000 7f7644dff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76400d2320 0x7f7640150560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:15.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.041+0000 7f7644dff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f764015c9b0 0x7f764014ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:15.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.041+0000 7f7644dff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7640161340 0x7f76401565e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:15.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.041+0000 7f7644dff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76401e6460 con 0x7f76400d2320 2023-11-28T12:12:15.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.041+0000 7f7644dff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76401e6740 con 0x7f764015c9b0 2023-11-28T12:12:15.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.041+0000 7f7644dff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76401e6a20 con 0x7f7640161340 2023-11-28T12:12:15.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.041+0000 7f763e59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76400d2320 0x7f7640150560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:15.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.041+0000 7f763e59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76400d2320 0x7f7640150560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36656/0 (socket says 172.21.15.45:36656) 2023-11-28T12:12:15.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.041+0000 7f763e59c700 1 -- 172.21.15.45:0/389520191 learned_addr learned my addr 172.21.15.45:0/389520191 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:12:15.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.041+0000 7f763e59c700 1 -- 172.21.15.45:0/389520191 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7640161340 msgr2=0x7f76401565e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:15.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.041+0000 7f763e59c700 1 --2- 172.21.15.45:0/389520191 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7640161340 0x7f76401565e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:15.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.041+0000 7f763e59c700 1 -- 172.21.15.45:0/389520191 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f764015c9b0 msgr2=0x7f764014ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:15.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.041+0000 7f7637fff700 1 --2- 172.21.15.45:0/389520191 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f764015c9b0 0x7f764014ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:15.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.041+0000 7f763e59c700 1 --2- 172.21.15.45:0/389520191 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f764015c9b0 0x7f764014ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:15.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.041+0000 7f763e59c700 1 -- 172.21.15.45:0/389520191 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7628009550 con 0x7f76400d2320 2023-11-28T12:12:15.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.041+0000 7f7637fff700 1 --2- 172.21.15.45:0/389520191 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f764015c9b0 0x7f764014ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:12:15.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.042+0000 7f763e59c700 1 --2- 172.21.15.45:0/389520191 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76400d2320 0x7f7640150560 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f763000e810 tx=0x7f763000ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:15.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.042+0000 7f7636ffd700 1 -- 172.21.15.45:0/389520191 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7630013610 con 0x7f76400d2320 2023-11-28T12:12:15.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.042+0000 7f7636ffd700 1 -- 172.21.15.45:0/389520191 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7630013770 con 0x7f76400d2320 2023-11-28T12:12:15.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.042+0000 7f7636ffd700 1 -- 172.21.15.45:0/389520191 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7630013b20 con 0x7f76400d2320 2023-11-28T12:12:15.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.042+0000 7f7644dff700 1 -- 172.21.15.45:0/389520191 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76400b5130 con 0x7f76400d2320 2023-11-28T12:12:15.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.042+0000 7f7644dff700 1 -- 172.21.15.45:0/389520191 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76400d15e0 con 0x7f76400d2320 2023-11-28T12:12:15.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.043+0000 7f7644dff700 1 -- 172.21.15.45:0/389520191 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76400b52c0 con 0x7f76400d2320 2023-11-28T12:12:15.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.044+0000 7f7636ffd700 1 -- 172.21.15.45:0/389520191 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f7630023070 con 0x7f76400d2320 2023-11-28T12:12:15.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.045+0000 7f7636ffd700 1 --2- 172.21.15.45:0/389520191 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f76200682f0 0x7f762006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:15.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.046+0000 7f7636ffd700 1 -- 172.21.15.45:0/389520191 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f7630085af0 con 0x7f76400d2320 2023-11-28T12:12:15.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.046+0000 7f7637fff700 1 --2- 172.21.15.45:0/389520191 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f76200682f0 0x7f762006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:15.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.047+0000 7f7637fff700 1 --2- 172.21.15.45:0/389520191 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f76200682f0 0x7f762006a7a0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f7628009c10 tx=0x7f7628008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:15.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.050+0000 7f7636ffd700 1 -- 172.21.15.45:0/389520191 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f7630052150 con 0x7f76400d2320 2023-11-28T12:12:15.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.299+0000 7f7644dff700 1 -- 172.21.15.45:0/389520191 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f76400ced90 con 0x7f76400d2320 2023-11-28T12:12:15.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.300+0000 7f7636ffd700 1 -- 172.21.15.45:0/389520191 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+4649 (secure 0 0 0) 0x7f7630055770 con 0x7f76400d2320 2023-11-28T12:12:15.302 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:12:15.302 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":33,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5423,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6836/735970231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":735970231},{"type":"v1","addr":"172.21.15.152:6836","nonce":735970231}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5797,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/3354918087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6835","nonce":3354918087},{"type":"v1","addr":"172.21.15.152:6837","nonce":3354918087}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5806,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/275804060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":275804060},{"type":"v1","addr":"172.21.15.45:6835","nonce":275804060}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T12:09:35.571815+0000","modified":"2023-11-28T12:09:51.897203+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5979},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5979":{"gid":5979,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":7,"addr":"172.21.15.45:6833/3784258337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":3784258337},{"type":"v1","addr":"172.21.15.45:6833","nonce":3784258337}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-28T12:12:15.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.302+0000 7f7644dff700 1 -- 172.21.15.45:0/389520191 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f76200682f0 msgr2=0x7f762006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:15.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.302+0000 7f7644dff700 1 --2- 172.21.15.45:0/389520191 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f76200682f0 0x7f762006a7a0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f7628009c10 tx=0x7f7628008030 comp rx=0 tx=0).stop 2023-11-28T12:12:15.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.302+0000 7f7644dff700 1 -- 172.21.15.45:0/389520191 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76400d2320 msgr2=0x7f7640150560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:15.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.302+0000 7f7644dff700 1 --2- 172.21.15.45:0/389520191 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76400d2320 0x7f7640150560 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f763000e810 tx=0x7f763000ebd0 comp rx=0 tx=0).stop 2023-11-28T12:12:15.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.302+0000 7f7644dff700 1 -- 172.21.15.45:0/389520191 shutdown_connections 2023-11-28T12:12:15.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.302+0000 7f7644dff700 1 --2- 172.21.15.45:0/389520191 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f76200682f0 0x7f762006a7a0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:15.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.302+0000 7f7644dff700 1 --2- 172.21.15.45:0/389520191 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7640161340 0x7f76401565e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:15.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.302+0000 7f7644dff700 1 --2- 172.21.15.45:0/389520191 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76400d2320 0x7f7640150560 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:15.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.302+0000 7f7644dff700 1 --2- 172.21.15.45:0/389520191 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f764015c9b0 0x7f764014ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:15.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.302+0000 7f7644dff700 1 -- 172.21.15.45:0/389520191 >> 172.21.15.45:0/389520191 conn(0x7f7640072600 msgr2=0x7f764015a660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:15.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.302+0000 7f7644dff700 1 -- 172.21.15.45:0/389520191 shutdown_connections 2023-11-28T12:12:15.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.302+0000 7f7644dff700 1 -- 172.21.15.45:0/389520191 wait complete. 2023-11-28T12:12:15.305 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 33 2023-11-28T12:12:15.323 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T12:12:15.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.524+0000 7fb537bff700 1 Processor -- start 2023-11-28T12:12:15.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.525+0000 7fb537bff700 1 -- start start 2023-11-28T12:12:15.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.526+0000 7fb537bff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb53015c9b0 0x7fb5300b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:15.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.526+0000 7fb537bff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb5300cd7c0 0x7fb5300cdc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:15.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.526+0000 7fb537bff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5300ce160 con 0x7fb530161340 2023-11-28T12:12:15.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.526+0000 7fb537bff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5300b5800 con 0x7fb5300cd7c0 2023-11-28T12:12:15.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.526+0000 7fb537bff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5300d1950 con 0x7fb53015c9b0 2023-11-28T12:12:15.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.526+0000 7fb53519a700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fb530161340 0x7fb5300d1de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:57776/0 (socket says 172.21.15.45:57776) 2023-11-28T12:12:15.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.526+0000 7fb53519a700 1 -- 172.21.15.45:0/3883901517 learned_addr learned my addr 172.21.15.45:0/3883901517 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:12:15.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.526+0000 7fb53599b700 1 --2- 172.21.15.45:0/3883901517 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb53015c9b0 0x7fb5300b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:15.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.526+0000 7fb53619c700 1 --2- 172.21.15.45:0/3883901517 >> v2:172.21.15.152:3300/0 conn(0x7fb5300cd7c0 0x7fb5300cdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:15.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.527+0000 7fb534999700 1 -- 172.21.15.45:0/3883901517 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1760332755 0 0) 0x7fb5300ce160 con 0x7fb530161340 2023-11-28T12:12:15.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.527+0000 7fb534999700 1 -- 172.21.15.45:0/3883901517 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb51c0035b0 con 0x7fb530161340 2023-11-28T12:12:15.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.527+0000 7fb53599b700 1 -- 172.21.15.45:0/3883901517 >> v2:172.21.15.152:3300/0 conn(0x7fb5300cd7c0 msgr2=0x7fb5300cdc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:12:15.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.527+0000 7fb53599b700 1 --2- 172.21.15.45:0/3883901517 >> v2:172.21.15.152:3300/0 conn(0x7fb5300cd7c0 0x7fb5300cdc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:15.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.527+0000 7fb53599b700 1 -- 172.21.15.45:0/3883901517 >> v1:172.21.15.45:6789/0 conn(0x7fb530161340 legacy=0x7fb5300d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:15.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.527+0000 7fb53599b700 1 -- 172.21.15.45:0/3883901517 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5300d24f0 con 0x7fb53015c9b0 2023-11-28T12:12:15.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.527+0000 7fb53599b700 1 --2- 172.21.15.45:0/3883901517 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb53015c9b0 0x7fb5300b4bf0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb52c009840 tx=0x7fb52c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=130b933eedb22266 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:15.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.528+0000 7fb534999700 1 -- 172.21.15.45:0/3883901517 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb52c011830 con 0x7fb53015c9b0 2023-11-28T12:12:15.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.528+0000 7fb534999700 1 -- 172.21.15.45:0/3883901517 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb52c011990 con 0x7fb53015c9b0 2023-11-28T12:12:15.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.528+0000 7fb534999700 1 -- 172.21.15.45:0/3883901517 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb52c011d20 con 0x7fb53015c9b0 2023-11-28T12:12:15.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.528+0000 7fb537bff700 1 -- 172.21.15.45:0/3883901517 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb53015c9b0 msgr2=0x7fb5300b4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:15.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.528+0000 7fb537bff700 1 --2- 172.21.15.45:0/3883901517 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb53015c9b0 0x7fb5300b4bf0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb52c009840 tx=0x7fb52c009b50 comp rx=0 tx=0).stop 2023-11-28T12:12:15.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.528+0000 7fb537bff700 1 -- 172.21.15.45:0/3883901517 shutdown_connections 2023-11-28T12:12:15.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.528+0000 7fb537bff700 1 --2- 172.21.15.45:0/3883901517 >> v2:172.21.15.152:3300/0 conn(0x7fb5300cd7c0 0x7fb5300cdc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:15.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.528+0000 7fb537bff700 1 --2- 172.21.15.45:0/3883901517 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb53015c9b0 0x7fb5300b4bf0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:15.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.528+0000 7fb537bff700 1 -- 172.21.15.45:0/3883901517 >> 172.21.15.45:0/3883901517 conn(0x7fb530072600 msgr2=0x7fb5300cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:15.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.528+0000 7fb537bff700 1 -- 172.21.15.45:0/3883901517 shutdown_connections 2023-11-28T12:12:15.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.528+0000 7fb537bff700 1 -- 172.21.15.45:0/3883901517 wait complete. 2023-11-28T12:12:15.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.530+0000 7fb537bff700 1 Processor -- start 2023-11-28T12:12:15.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.530+0000 7fb537bff700 1 -- start start 2023-11-28T12:12:15.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.531+0000 7fb537bff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5300cd7c0 0x7fb5300cb320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:15.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.531+0000 7fb537bff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb53015c9b0 0x7fb53015e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:15.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.531+0000 7fb537bff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb530161340 0x7fb53015e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:15.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.531+0000 7fb537bff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb530154f60 con 0x7fb530161340 2023-11-28T12:12:15.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.531+0000 7fb537bff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5300c9760 con 0x7fb5300cd7c0 2023-11-28T12:12:15.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.531+0000 7fb537bff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5300c8b50 con 0x7fb53015c9b0 2023-11-28T12:12:15.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.531+0000 7fb53619c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb530161340 0x7fb53015e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:15.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.531+0000 7fb53619c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb530161340 0x7fb53015e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36672/0 (socket says 172.21.15.45:36672) 2023-11-28T12:12:15.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.531+0000 7fb53619c700 1 -- 172.21.15.45:0/1701845345 learned_addr learned my addr 172.21.15.45:0/1701845345 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:12:15.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.531+0000 7fb53599b700 1 --2- 172.21.15.45:0/1701845345 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5300cd7c0 0x7fb5300cb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:15.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.531+0000 7fb53519a700 1 --2- 172.21.15.45:0/1701845345 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb53015c9b0 0x7fb53015e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:15.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.532+0000 7fb53619c700 1 -- 172.21.15.45:0/1701845345 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb53015c9b0 msgr2=0x7fb53015e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:15.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.532+0000 7fb53619c700 1 --2- 172.21.15.45:0/1701845345 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb53015c9b0 0x7fb53015e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:15.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.532+0000 7fb53619c700 1 -- 172.21.15.45:0/1701845345 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5300cd7c0 msgr2=0x7fb5300cb320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:15.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.532+0000 7fb53619c700 1 --2- 172.21.15.45:0/1701845345 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5300cd7c0 0x7fb5300cb320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:15.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.532+0000 7fb53619c700 1 -- 172.21.15.45:0/1701845345 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb52c0094a0 con 0x7fb530161340 2023-11-28T12:12:15.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.532+0000 7fb53619c700 1 --2- 172.21.15.45:0/1701845345 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb530161340 0x7fb53015e900 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fb52800efc0 tx=0x7fb52800c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:15.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.532+0000 7fb5267fc700 1 -- 172.21.15.45:0/1701845345 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb52800cad0 con 0x7fb530161340 2023-11-28T12:12:15.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.532+0000 7fb5267fc700 1 -- 172.21.15.45:0/1701845345 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb52800f040 con 0x7fb530161340 2023-11-28T12:12:15.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.532+0000 7fb5267fc700 1 -- 172.21.15.45:0/1701845345 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb52800ce70 con 0x7fb530161340 2023-11-28T12:12:15.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.532+0000 7fb537bff700 1 -- 172.21.15.45:0/1701845345 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5300d1300 con 0x7fb530161340 2023-11-28T12:12:15.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.533+0000 7fb537bff700 1 -- 172.21.15.45:0/1701845345 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5300b5520 con 0x7fb530161340 2023-11-28T12:12:15.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.534+0000 7fb537bff700 1 -- 172.21.15.45:0/1701845345 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5300d15e0 con 0x7fb530161340 2023-11-28T12:12:15.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.534+0000 7fb5267fc700 1 -- 172.21.15.45:0/1701845345 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fb528014480 con 0x7fb530161340 2023-11-28T12:12:15.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.536+0000 7fb5267fc700 1 --2- 172.21.15.45:0/1701845345 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb5140682f0 0x7fb51406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:15.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.536+0000 7fb5267fc700 1 -- 172.21.15.45:0/1701845345 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6207+0+0 (secure 0 0 0) 0x7fb528086970 con 0x7fb530161340 2023-11-28T12:12:15.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.536+0000 7fb53599b700 1 --2- 172.21.15.45:0/1701845345 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb5140682f0 0x7fb51406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:15.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.537+0000 7fb53599b700 1 --2- 172.21.15.45:0/1701845345 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb5140682f0 0x7fb51406a7a0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fb52c000c00 tx=0x7fb52c01c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:15.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.540+0000 7fb5267fc700 1 -- 172.21.15.45:0/1701845345 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fb528052ff0 con 0x7fb530161340 2023-11-28T12:12:15.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.746+0000 7fb537bff700 1 -- 172.21.15.45:0/1701845345 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb5300c9af0 con 0x7fb530161340 2023-11-28T12:12:15.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.747+0000 7fb5267fc700 1 -- 172.21.15.45:0/1701845345 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) v1 ==== 74+0+18103 (secure 0 0 0) 0x7fb528056610 con 0x7fb530161340 2023-11-28T12:12:15.749 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:12:15.749 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":63,"fsid":"bd7c37f1-f7c6-4778-b845-52cf2aa6e366","created":"2023-11-28T12:06:09.045075+0000","modified":"2023-11-28T12:10:19.965300+0000","last_up_change":"2023-11-28T12:06:21.282227+0000","last_in_change":"2023-11-28T12:06:12.560924+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T12:06:21.807108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T12:06:22.491009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-11-28T12:09:33.476735+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-11-28T12:09:34.551527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d0cdd8a-87fd-4f2c-91bd-47bdfa661905","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":115843},{"type":"v1","addr":"172.21.15.45:6808","nonce":115843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":115843},{"type":"v1","addr":"172.21.15.45:6811","nonce":115843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":115843},{"type":"v1","addr":"172.21.15.45:6815","nonce":115843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":115843},{"type":"v1","addr":"172.21.15.45:6813","nonce":115843}]},"public_addr":"172.21.15.45:6808/115843","cluster_addr":"172.21.15.45:6811/115843","heartbeat_back_addr":"172.21.15.45:6815/115843","heartbeat_front_addr":"172.21.15.45:6813/115843","state":["exists","up"]},{"osd":1,"uuid":"c5de4ebd-9ec5-40b3-9caa-9b706fab4c76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":115842},{"type":"v1","addr":"172.21.15.45:6801","nonce":115842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":115842},{"type":"v1","addr":"172.21.15.45:6803","nonce":115842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6807","nonce":115842},{"type":"v1","addr":"172.21.15.45:6809","nonce":115842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":115842},{"type":"v1","addr":"172.21.15.45:6805","nonce":115842}]},"public_addr":"172.21.15.45:6801/115842","cluster_addr":"172.21.15.45:6803/115842","heartbeat_back_addr":"172.21.15.45:6809/115842","heartbeat_front_addr":"172.21.15.45:6805/115842","state":["exists","up"]},{"osd":2,"uuid":"9f4b36b2-65d2-40e7-9fe6-a2991afa71c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":115850},{"type":"v1","addr":"172.21.15.45:6819","nonce":115850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":115850},{"type":"v1","addr":"172.21.15.45:6823","nonce":115850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":115850},{"type":"v1","addr":"172.21.15.45:6831","nonce":115850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":115850},{"type":"v1","addr":"172.21.15.45:6828","nonce":115850}]},"public_addr":"172.21.15.45:6819/115850","cluster_addr":"172.21.15.45:6823/115850","heartbeat_back_addr":"172.21.15.45:6831/115850","heartbeat_front_addr":"172.21.15.45:6828/115850","state":["exists","up"]},{"osd":3,"uuid":"6fe7ef05-4e0d-426c-bf94-44b51d4d550b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":115848},{"type":"v1","addr":"172.21.15.45:6818","nonce":115848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":115848},{"type":"v1","addr":"172.21.15.45:6822","nonce":115848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6827","nonce":115848},{"type":"v1","addr":"172.21.15.45:6829","nonce":115848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":115848},{"type":"v1","addr":"172.21.15.45:6825","nonce":115848}]},"public_addr":"172.21.15.45:6818/115848","cluster_addr":"172.21.15.45:6822/115848","heartbeat_back_addr":"172.21.15.45:6829/115848","heartbeat_front_addr":"172.21.15.45:6825/115848","state":["exists","up"]},{"osd":4,"uuid":"fa403c08-d8a1-4a3a-8384-cb465c1a654c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":116092},{"type":"v1","addr":"172.21.15.152:6801","nonce":116092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":116092},{"type":"v1","addr":"172.21.15.152:6803","nonce":116092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":116092},{"type":"v1","addr":"172.21.15.152:6807","nonce":116092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":116092},{"type":"v1","addr":"172.21.15.152:6805","nonce":116092}]},"public_addr":"172.21.15.152:6801/116092","cluster_addr":"172.21.15.152:6803/116092","heartbeat_back_addr":"172.21.15.152:6807/116092","heartbeat_front_addr":"172.21.15.152:6805/116092","state":["exists","up"]},{"osd":5,"uuid":"399fc450-39fa-43a6-bf80-0b8bcb41bd95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6815","nonce":116093},{"type":"v1","addr":"172.21.15.152:6817","nonce":116093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":116093},{"type":"v1","addr":"172.21.15.152:6819","nonce":116093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":116093},{"type":"v1","addr":"172.21.15.152:6823","nonce":116093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":116093},{"type":"v1","addr":"172.21.15.152:6821","nonce":116093}]},"public_addr":"172.21.15.152:6817/116093","cluster_addr":"172.21.15.152:6819/116093","heartbeat_back_addr":"172.21.15.152:6823/116093","heartbeat_front_addr":"172.21.15.152:6821/116093","state":["exists","up"]},{"osd":6,"uuid":"e59a4017-2d23-4627-836b-e25b2d3ddaaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":116094},{"type":"v1","addr":"172.21.15.152:6809","nonce":116094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":116094},{"type":"v1","addr":"172.21.15.152:6811","nonce":116094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":116094},{"type":"v1","addr":"172.21.15.152:6816","nonce":116094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":116094},{"type":"v1","addr":"172.21.15.152:6813","nonce":116094}]},"public_addr":"172.21.15.152:6809/116094","cluster_addr":"172.21.15.152:6811/116094","heartbeat_back_addr":"172.21.15.152:6816/116094","heartbeat_front_addr":"172.21.15.152:6813/116094","state":["exists","up"]},{"osd":7,"uuid":"8d7f9d4b-bf08-4670-8591-388c0f012a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":116097},{"type":"v1","addr":"172.21.15.152:6825","nonce":116097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":116097},{"type":"v1","addr":"172.21.15.152:6827","nonce":116097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":116097},{"type":"v1","addr":"172.21.15.152:6831","nonce":116097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":116097},{"type":"v1","addr":"172.21.15.152:6829","nonce":116097}]},"public_addr":"172.21.15.152:6825/116097","cluster_addr":"172.21.15.152:6827/116097","heartbeat_back_addr":"172.21.15.152:6831/116097","heartbeat_front_addr":"172.21.15.152:6829/116097","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.937710+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.865423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.159434+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.913090+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.131647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.966255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.972583+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.177209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.15","mappings":[{"from":7,"to":2}]},{"pgid":"10.2","mappings":[{"from":4,"to":5}]},{"pgid":"10.21","mappings":[{"from":4,"to":3}]},{"pgid":"10.37","mappings":[{"from":7,"to":3}]},{"pgid":"10.3b","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T12:12:15.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.749+0000 7fb537bff700 1 -- 172.21.15.45:0/1701845345 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb5140682f0 msgr2=0x7fb51406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:15.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.749+0000 7fb537bff700 1 --2- 172.21.15.45:0/1701845345 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb5140682f0 0x7fb51406a7a0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fb52c000c00 tx=0x7fb52c01c040 comp rx=0 tx=0).stop 2023-11-28T12:12:15.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.749+0000 7fb537bff700 1 -- 172.21.15.45:0/1701845345 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb530161340 msgr2=0x7fb53015e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:15.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.749+0000 7fb537bff700 1 --2- 172.21.15.45:0/1701845345 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb530161340 0x7fb53015e900 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fb52800efc0 tx=0x7fb52800c0c0 comp rx=0 tx=0).stop 2023-11-28T12:12:15.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.749+0000 7fb537bff700 1 -- 172.21.15.45:0/1701845345 shutdown_connections 2023-11-28T12:12:15.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.749+0000 7fb537bff700 1 --2- 172.21.15.45:0/1701845345 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb5140682f0 0x7fb51406a7a0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:15.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.749+0000 7fb537bff700 1 --2- 172.21.15.45:0/1701845345 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb5300cd7c0 0x7fb5300cb320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:15.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.749+0000 7fb537bff700 1 --2- 172.21.15.45:0/1701845345 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb530161340 0x7fb53015e900 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:15.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.749+0000 7fb537bff700 1 --2- 172.21.15.45:0/1701845345 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb53015c9b0 0x7fb53015e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:15.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.749+0000 7fb537bff700 1 -- 172.21.15.45:0/1701845345 >> 172.21.15.45:0/1701845345 conn(0x7fb530072600 msgr2=0x7fb5300d1de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:15.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.749+0000 7fb537bff700 1 -- 172.21.15.45:0/1701845345 shutdown_connections 2023-11-28T12:12:15.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.749+0000 7fb537bff700 1 -- 172.21.15.45:0/1701845345 wait complete. 2023-11-28T12:12:15.769 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-28T12:12:15.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.973+0000 7fe6eefff700 1 Processor -- start 2023-11-28T12:12:15.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.973+0000 7fe6eefff700 1 -- start start 2023-11-28T12:12:15.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.974+0000 7fe6eefff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fe6e815c9b0 0x7fe6e80b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:15.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.974+0000 7fe6eefff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe6e80cd7c0 0x7fe6e80cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:15.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.974+0000 7fe6eefff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6e80d1950 con 0x7fe6e8161340 2023-11-28T12:12:15.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.974+0000 7fe6eefff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6e80b5800 con 0x7fe6e815c9b0 2023-11-28T12:12:15.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.974+0000 7fe6eefff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e80ce140 con 0x7fe6e80cd7c0 2023-11-28T12:12:15.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.975+0000 7fe6e7fff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fe6e8161340 0x7fe6e80d1de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:57790/0 (socket says 172.21.15.45:57790) 2023-11-28T12:12:15.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.975+0000 7fe6e7fff700 1 -- 172.21.15.45:0/3144611924 learned_addr learned my addr 172.21.15.45:0/3144611924 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:12:15.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.975+0000 7fe6ed59c700 1 --2- 172.21.15.45:0/3144611924 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe6e80cd7c0 0x7fe6e80cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:15.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.975+0000 7fe6ecd9b700 1 --2- 172.21.15.45:0/3144611924 >> v2:172.21.15.152:3300/0 conn(0x7fe6e815c9b0 0x7fe6e80b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:15.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.975+0000 7fe6e77fe700 1 -- 172.21.15.45:0/3144611924 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2152262762 0 0) 0x7fe6e80d1950 con 0x7fe6e8161340 2023-11-28T12:12:15.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.975+0000 7fe6e77fe700 1 -- 172.21.15.45:0/3144611924 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6d80035b0 con 0x7fe6e8161340 2023-11-28T12:12:15.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.975+0000 7fe6ecd9b700 1 -- 172.21.15.45:0/3144611924 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe6e80cd7c0 msgr2=0x7fe6e80cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:12:15.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.975+0000 7fe6e77fe700 1 -- 172.21.15.45:0/3144611924 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 296772732 0 0) 0x7fe6d80035b0 con 0x7fe6e8161340 2023-11-28T12:12:15.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.975+0000 7fe6ecd9b700 1 --2- 172.21.15.45:0/3144611924 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe6e80cd7c0 0x7fe6e80cdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:15.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.975+0000 7fe6ecd9b700 1 -- 172.21.15.45:0/3144611924 >> v1:172.21.15.45:6789/0 conn(0x7fe6e8161340 legacy=0x7fe6e80d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:15.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.975+0000 7fe6ecd9b700 1 -- 172.21.15.45:0/3144611924 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6e80d24f0 con 0x7fe6e815c9b0 2023-11-28T12:12:15.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.976+0000 7fe6ecd9b700 1 --2- 172.21.15.45:0/3144611924 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe6e815c9b0 0x7fe6e80b4bf0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc009840 tx=0x7fe6dc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84f7e53ec9f99380 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:15.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.976+0000 7fe6e77fe700 1 -- 172.21.15.45:0/3144611924 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d4001670 con 0x7fe6e815c9b0 2023-11-28T12:12:15.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.976+0000 7fe6e77fe700 1 -- 172.21.15.45:0/3144611924 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6dc004030 con 0x7fe6e815c9b0 2023-11-28T12:12:15.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.976+0000 7fe6e77fe700 1 -- 172.21.15.45:0/3144611924 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc0043c0 con 0x7fe6e815c9b0 2023-11-28T12:12:15.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.977+0000 7fe6eefff700 1 -- 172.21.15.45:0/3144611924 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe6e815c9b0 msgr2=0x7fe6e80b4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:15.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.977+0000 7fe6eefff700 1 --2- 172.21.15.45:0/3144611924 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe6e815c9b0 0x7fe6e80b4bf0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc009840 tx=0x7fe6dc009b50 comp rx=0 tx=0).stop 2023-11-28T12:12:15.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.977+0000 7fe6eefff700 1 -- 172.21.15.45:0/3144611924 shutdown_connections 2023-11-28T12:12:15.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.977+0000 7fe6eefff700 1 --2- 172.21.15.45:0/3144611924 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe6e80cd7c0 0x7fe6e80cdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:15.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.977+0000 7fe6eefff700 1 --2- 172.21.15.45:0/3144611924 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe6e815c9b0 0x7fe6e80b4bf0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:15.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.977+0000 7fe6eefff700 1 -- 172.21.15.45:0/3144611924 >> 172.21.15.45:0/3144611924 conn(0x7fe6e8072600 msgr2=0x7fe6e80cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:15.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.977+0000 7fe6eefff700 1 -- 172.21.15.45:0/3144611924 shutdown_connections 2023-11-28T12:12:15.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.977+0000 7fe6eefff700 1 -- 172.21.15.45:0/3144611924 wait complete. 2023-11-28T12:12:15.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.979+0000 7fe6eefff700 1 Processor -- start 2023-11-28T12:12:15.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.979+0000 7fe6eefff700 1 -- start start 2023-11-28T12:12:15.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.980+0000 7fe6eefff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe6e80cd7c0 0x7fe6e81570e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:15.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.980+0000 7fe6eefff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe6e815c9b0 0x7fe6e80c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:15.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.980+0000 7fe6eefff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6e8161340 0x7fe6e815e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:15.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.980+0000 7fe6eefff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e80c89b0 con 0x7fe6e8161340 2023-11-28T12:12:15.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.980+0000 7fe6eefff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e80c8c90 con 0x7fe6e80cd7c0 2023-11-28T12:12:15.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.980+0000 7fe6eefff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e80c8f70 con 0x7fe6e815c9b0 2023-11-28T12:12:15.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.980+0000 7fe6ed59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6e8161340 0x7fe6e815e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:15.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.980+0000 7fe6ed59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6e8161340 0x7fe6e815e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36686/0 (socket says 172.21.15.45:36686) 2023-11-28T12:12:15.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.980+0000 7fe6ed59c700 1 -- 172.21.15.45:0/4177069317 learned_addr learned my addr 172.21.15.45:0/4177069317 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:12:15.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.980+0000 7fe6ecd9b700 1 --2- 172.21.15.45:0/4177069317 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe6e80cd7c0 0x7fe6e81570e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:15.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.980+0000 7fe6e7fff700 1 --2- 172.21.15.45:0/4177069317 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe6e815c9b0 0x7fe6e80c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:15.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.980+0000 7fe6ed59c700 1 -- 172.21.15.45:0/4177069317 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe6e815c9b0 msgr2=0x7fe6e80c7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:15.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.980+0000 7fe6ed59c700 1 --2- 172.21.15.45:0/4177069317 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe6e815c9b0 0x7fe6e80c7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:15.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.980+0000 7fe6ed59c700 1 -- 172.21.15.45:0/4177069317 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe6e80cd7c0 msgr2=0x7fe6e81570e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:15.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.980+0000 7fe6ed59c700 1 --2- 172.21.15.45:0/4177069317 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe6e80cd7c0 0x7fe6e81570e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:15.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.980+0000 7fe6ed59c700 1 -- 172.21.15.45:0/4177069317 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6dc0094a0 con 0x7fe6e8161340 2023-11-28T12:12:15.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.981+0000 7fe6ed59c700 1 --2- 172.21.15.45:0/4177069317 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6e8161340 0x7fe6e815e960 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fe6e000efc0 tx=0x7fe6e000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:15.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.981+0000 7fe6e57fa700 1 -- 172.21.15.45:0/4177069317 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e0009ba0 con 0x7fe6e8161340 2023-11-28T12:12:15.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.981+0000 7fe6e57fa700 1 -- 172.21.15.45:0/4177069317 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6e000f040 con 0x7fe6e8161340 2023-11-28T12:12:15.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.981+0000 7fe6e57fa700 1 -- 172.21.15.45:0/4177069317 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e0014480 con 0x7fe6e8161340 2023-11-28T12:12:15.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.981+0000 7fe6eefff700 1 -- 172.21.15.45:0/4177069317 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6e80d1300 con 0x7fe6e8161340 2023-11-28T12:12:15.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.981+0000 7fe6eefff700 1 -- 172.21.15.45:0/4177069317 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6e80b5520 con 0x7fe6e8161340 2023-11-28T12:12:15.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.982+0000 7fe6eefff700 1 -- 172.21.15.45:0/4177069317 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6e80d15e0 con 0x7fe6e8161340 2023-11-28T12:12:15.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.983+0000 7fe6e57fa700 1 -- 172.21.15.45:0/4177069317 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fe6e00145e0 con 0x7fe6e8161340 2023-11-28T12:12:15.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.984+0000 7fe6e57fa700 1 --2- 172.21.15.45:0/4177069317 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fe6cc0682f0 0x7fe6cc06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:15.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.984+0000 7fe6e57fa700 1 -- 172.21.15.45:0/4177069317 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6207+0+0 (secure 0 0 0) 0x7fe6e0086810 con 0x7fe6e8161340 2023-11-28T12:12:15.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.984+0000 7fe6ecd9b700 1 --2- 172.21.15.45:0/4177069317 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fe6cc0682f0 0x7fe6cc06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:15.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.985+0000 7fe6ecd9b700 1 --2- 172.21.15.45:0/4177069317 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fe6cc0682f0 0x7fe6cc06a7a0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc0090b0 tx=0x7fe6dc013040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:15.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:15.988+0000 7fe6e57fa700 1 -- 172.21.15.45:0/4177069317 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fe6e0052ef0 con 0x7fe6e8161340 2023-11-28T12:12:16.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:16.236+0000 7fe6eefff700 1 -- 172.21.15.45:0/4177069317 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fe6e8066d60 con 0x7fe6e8161340 2023-11-28T12:12:16.991 INFO:tasks.ceph.mon.a.smithi045.stderr:2023-11-28T12:12:16.990+0000 7fe5533f9700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-28T12:12:16.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:16.997+0000 7fe6e57fa700 1 -- 172.21.15.45:0/4177069317 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v34) v1 ==== 161+0+0 (secure 0 0 0) 0x7fe6e0056510 con 0x7fe6e8161340 2023-11-28T12:12:17.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:17.001+0000 7fe6eefff700 1 -- 172.21.15.45:0/4177069317 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fe6cc0682f0 msgr2=0x7fe6cc06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:17.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:17.001+0000 7fe6eefff700 1 --2- 172.21.15.45:0/4177069317 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fe6cc0682f0 0x7fe6cc06a7a0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc0090b0 tx=0x7fe6dc013040 comp rx=0 tx=0).stop 2023-11-28T12:12:17.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:17.001+0000 7fe6eefff700 1 -- 172.21.15.45:0/4177069317 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6e8161340 msgr2=0x7fe6e815e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:17.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:17.001+0000 7fe6eefff700 1 --2- 172.21.15.45:0/4177069317 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6e8161340 0x7fe6e815e960 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fe6e000efc0 tx=0x7fe6e000c3a0 comp rx=0 tx=0).stop 2023-11-28T12:12:17.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:17.001+0000 7fe6eefff700 1 -- 172.21.15.45:0/4177069317 shutdown_connections 2023-11-28T12:12:17.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:17.001+0000 7fe6eefff700 1 --2- 172.21.15.45:0/4177069317 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fe6cc0682f0 0x7fe6cc06a7a0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:17.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:17.001+0000 7fe6eefff700 1 --2- 172.21.15.45:0/4177069317 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe6e80cd7c0 0x7fe6e81570e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:17.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:17.001+0000 7fe6eefff700 1 --2- 172.21.15.45:0/4177069317 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6e8161340 0x7fe6e815e960 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:17.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:17.001+0000 7fe6eefff700 1 --2- 172.21.15.45:0/4177069317 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe6e815c9b0 0x7fe6e80c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:17.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:17.001+0000 7fe6eefff700 1 -- 172.21.15.45:0/4177069317 >> 172.21.15.45:0/4177069317 conn(0x7fe6e8072600 msgr2=0x7fe6e806a900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:17.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:17.002+0000 7fe6eefff700 1 -- 172.21.15.45:0/4177069317 shutdown_connections 2023-11-28T12:12:17.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:17.002+0000 7fe6eefff700 1 -- 172.21.15.45:0/4177069317 wait complete. 2023-11-28T12:12:17.004 INFO:teuthology.orchestra.run.smithi045.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-28T12:12:17.016 INFO:tasks.ceph.mds.c.smithi045.stderr: -7114> 2023-11-28T12:09:45.567+0000 7fc27ddea700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /dir_test/file auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={5950=0-4194304@1} caps={5950=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=5950 | request=0 caps=1 dirtyparent=0 dirty=0 authpin=1 scrubqueue=0 0x55b67b17d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(10)0x10000000001:[<0x10000000000/file v2>,<0x1/dir_test v4>]//[]","error_str":"failed to decode on-disk backtrace (26 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-11-28T12:12:17.025 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-28T12:12:17.072 INFO:tasks.ceph.mds.c.smithi045.stdout:starting mds.c at 2023-11-28T12:12:17.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:17.235+0000 7f0c53bff700 1 Processor -- start 2023-11-28T12:12:17.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:17.235+0000 7f0c53bff700 1 -- start start 2023-11-28T12:12:17.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:17.236+0000 7f0c53bff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f0c4c0d01b0 0x7f0c4c0d0c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:17.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:17.236+0000 7f0c53bff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0c4c0b20b0 0x7f0c4c0d1160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:17.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:17.236+0000 7f0c53bff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c4c0b0230 con 0x7f0c4c0b29b0 2023-11-28T12:12:17.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:17.236+0000 7f0c53bff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c4c15cec0 con 0x7f0c4c0d01b0 2023-11-28T12:12:17.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:17.236+0000 7f0c53bff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4c0b4570 con 0x7f0c4c0b20b0 2023-11-28T12:12:17.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:17.237+0000 7f0c5219c700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f0c4c0b29b0 0x7f0c4c0b2e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:57804/0 (socket says 172.21.15.45:57804) 2023-11-28T12:12:17.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:17.237+0000 7f0c5219c700 1 -- 172.21.15.45:0/1299570417 learned_addr learned my addr 172.21.15.45:0/1299570417 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:12:17.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:17.237+0000 7f0c5119a700 1 --2- 172.21.15.45:0/1299570417 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0c4c0b20b0 0x7f0c4c0d1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:17.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:17.237+0000 7f0c5199b700 1 --2- 172.21.15.45:0/1299570417 >> v2:172.21.15.152:3300/0 conn(0x7f0c4c0d01b0 0x7f0c4c0d0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:17.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:17.237+0000 7f0c50999700 1 -- 172.21.15.45:0/1299570417 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2784455748 0 0) 0x7f0c4c0b0230 con 0x7f0c4c0b29b0 2023-11-28T12:12:17.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:17.237+0000 7f0c50999700 1 -- 172.21.15.45:0/1299570417 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c380035b0 con 0x7f0c4c0b29b0 2023-11-28T12:12:17.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:17.237+0000 7f0c5119a700 1 -- 172.21.15.45:0/1299570417 >> v2:172.21.15.152:3300/0 conn(0x7f0c4c0d01b0 msgr2=0x7f0c4c0d0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:12:17.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:17.237+0000 7f0c5119a700 1 --2- 172.21.15.45:0/1299570417 >> v2:172.21.15.152:3300/0 conn(0x7f0c4c0d01b0 0x7f0c4c0d0c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:17.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:17.237+0000 7f0c5119a700 1 -- 172.21.15.45:0/1299570417 >> v1:172.21.15.45:6789/0 conn(0x7f0c4c0b29b0 legacy=0x7f0c4c0b2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:17.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:17.237+0000 7f0c5119a700 1 -- 172.21.15.45:0/1299570417 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c4c0b4850 con 0x7f0c4c0b20b0 2023-11-28T12:12:17.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:17.237+0000 7f0c5119a700 1 --2- 172.21.15.45:0/1299570417 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0c4c0b20b0 0x7f0c4c0d1160 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c009840 tx=0x7f0c3c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d283a593b7cc0135 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:17.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:17.238+0000 7f0c50999700 1 -- 172.21.15.45:0/1299570417 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c3c011830 con 0x7f0c4c0b20b0 2023-11-28T12:12:17.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:17.238+0000 7f0c50999700 1 -- 172.21.15.45:0/1299570417 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c3c011990 con 0x7f0c4c0b20b0 2023-11-28T12:12:17.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:17.238+0000 7f0c50999700 1 -- 172.21.15.45:0/1299570417 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c3c011d20 con 0x7f0c4c0b20b0 2023-11-28T12:12:17.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:17.238+0000 7f0c53bff700 1 -- 172.21.15.45:0/1299570417 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0c4c0b20b0 msgr2=0x7f0c4c0d1160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:17.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:17.238+0000 7f0c53bff700 1 --2- 172.21.15.45:0/1299570417 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0c4c0b20b0 0x7f0c4c0d1160 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c009840 tx=0x7f0c3c009b50 comp rx=0 tx=0).stop 2023-11-28T12:12:17.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:17.238+0000 7f0c53bff700 1 -- 172.21.15.45:0/1299570417 shutdown_connections 2023-11-28T12:12:17.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:17.238+0000 7f0c53bff700 1 --2- 172.21.15.45:0/1299570417 >> v2:172.21.15.152:3300/0 conn(0x7f0c4c0d01b0 0x7f0c4c0d0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:17.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:17.238+0000 7f0c53bff700 1 --2- 172.21.15.45:0/1299570417 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0c4c0b20b0 0x7f0c4c0d1160 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:17.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:17.238+0000 7f0c53bff700 1 -- 172.21.15.45:0/1299570417 >> 172.21.15.45:0/1299570417 conn(0x7f0c4c09c3f0 msgr2=0x7f0c4c0d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:17.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:17.239+0000 7f0c53bff700 1 -- 172.21.15.45:0/1299570417 shutdown_connections 2023-11-28T12:12:17.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:17.239+0000 7f0c53bff700 1 -- 172.21.15.45:0/1299570417 wait complete. 2023-11-28T12:12:17.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:17.241+0000 7f0c53bff700 1 Processor -- start 2023-11-28T12:12:17.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:17.241+0000 7f0c53bff700 1 -- start start 2023-11-28T12:12:17.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:17.242+0000 7f0c53bff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c4c0b20b0 0x7f0c4c1556a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:17.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:17.242+0000 7f0c53bff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0c4c0b29b0 0x7f0c4c0b7350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:17.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:17.242+0000 7f0c53bff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0c4c0d01b0 0x7f0c4c0b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:17.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:17.242+0000 7f0c53bff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4c159e60 con 0x7f0c4c0b20b0 2023-11-28T12:12:17.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:17.242+0000 7f0c53bff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4c0b7890 con 0x7f0c4c0b29b0 2023-11-28T12:12:17.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:17.242+0000 7f0c53bff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4c159040 con 0x7f0c4c0d01b0 2023-11-28T12:12:17.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:17.243+0000 7f0c5199b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c4c0b20b0 0x7f0c4c1556a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:17.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:17.243+0000 7f0c5199b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c4c0b20b0 0x7f0c4c1556a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36702/0 (socket says 172.21.15.45:36702) 2023-11-28T12:12:17.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:17.243+0000 7f0c5199b700 1 -- 172.21.15.45:0/1877742689 learned_addr learned my addr 172.21.15.45:0/1877742689 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:12:17.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:17.243+0000 7f0c5119a700 1 --2- 172.21.15.45:0/1877742689 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0c4c0b29b0 0x7f0c4c0b7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:17.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:17.243+0000 7f0c5219c700 1 --2- 172.21.15.45:0/1877742689 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0c4c0d01b0 0x7f0c4c0b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:17.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:17.243+0000 7f0c5199b700 1 -- 172.21.15.45:0/1877742689 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0c4c0d01b0 msgr2=0x7f0c4c0b6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:17.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:17.243+0000 7f0c5199b700 1 --2- 172.21.15.45:0/1877742689 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0c4c0d01b0 0x7f0c4c0b6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:17.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:17.243+0000 7f0c5199b700 1 -- 172.21.15.45:0/1877742689 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0c4c0b29b0 msgr2=0x7f0c4c0b7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:17.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:17.243+0000 7f0c5199b700 1 --2- 172.21.15.45:0/1877742689 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0c4c0b29b0 0x7f0c4c0b7350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:17.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:17.243+0000 7f0c5199b700 1 -- 172.21.15.45:0/1877742689 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c3c0094a0 con 0x7f0c4c0b20b0 2023-11-28T12:12:17.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:17.243+0000 7f0c5199b700 1 --2- 172.21.15.45:0/1877742689 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c4c0b20b0 0x7f0c4c1556a0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f0c4800e870 tx=0x7f0c4800eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:17.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:17.244+0000 7f0c427fc700 1 -- 172.21.15.45:0/1877742689 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c48009590 con 0x7f0c4c0b20b0 2023-11-28T12:12:17.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:17.244+0000 7f0c427fc700 1 -- 172.21.15.45:0/1877742689 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c48013680 con 0x7f0c4c0b20b0 2023-11-28T12:12:17.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:17.244+0000 7f0c427fc700 1 -- 172.21.15.45:0/1877742689 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c480139f0 con 0x7f0c4c0b20b0 2023-11-28T12:12:17.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:17.244+0000 7f0c53bff700 1 -- 172.21.15.45:0/1877742689 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c4c0afec0 con 0x7f0c4c0b20b0 2023-11-28T12:12:17.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:17.244+0000 7f0c53bff700 1 -- 172.21.15.45:0/1877742689 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c4c0afbe0 con 0x7f0c4c0b20b0 2023-11-28T12:12:17.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:17.245+0000 7f0c53bff700 1 -- 172.21.15.45:0/1877742689 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c4c0b2600 con 0x7f0c4c0b20b0 2023-11-28T12:12:17.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:17.246+0000 7f0c427fc700 1 -- 172.21.15.45:0/1877742689 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f0c48019030 con 0x7f0c4c0b20b0 2023-11-28T12:12:17.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:17.247+0000 7f0c427fc700 1 --2- 172.21.15.45:0/1877742689 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f0c300682f0 0x7f0c3006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:17.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:17.247+0000 7f0c427fc700 1 -- 172.21.15.45:0/1877742689 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f0c48085b30 con 0x7f0c4c0b20b0 2023-11-28T12:12:17.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:17.248+0000 7f0c5119a700 1 --2- 172.21.15.45:0/1877742689 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f0c300682f0 0x7f0c3006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:17.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:17.248+0000 7f0c5119a700 1 --2- 172.21.15.45:0/1877742689 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f0c300682f0 0x7f0c3006a7a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c000c00 tx=0x7f0c3c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:17.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:17.251+0000 7f0c427fc700 1 -- 172.21.15.45:0/1877742689 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f0c480521b0 con 0x7f0c4c0b20b0 2023-11-28T12:12:17.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:17.500+0000 7f0c53bff700 1 -- 172.21.15.45:0/1877742689 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f0c4c15a0d0 con 0x7f0c4c0b20b0 2023-11-28T12:12:18.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:17.999+0000 7f0c427fc700 1 -- 172.21.15.45:0/1877742689 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v35) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0c480557d0 con 0x7f0c4c0b20b0 2023-11-28T12:12:18.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:18.002+0000 7f0c53bff700 1 -- 172.21.15.45:0/1877742689 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f0c300682f0 msgr2=0x7f0c3006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:18.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:18.002+0000 7f0c53bff700 1 --2- 172.21.15.45:0/1877742689 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f0c300682f0 0x7f0c3006a7a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c000c00 tx=0x7f0c3c008030 comp rx=0 tx=0).stop 2023-11-28T12:12:18.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:18.002+0000 7f0c53bff700 1 -- 172.21.15.45:0/1877742689 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c4c0b20b0 msgr2=0x7f0c4c1556a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:18.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:18.002+0000 7f0c53bff700 1 --2- 172.21.15.45:0/1877742689 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c4c0b20b0 0x7f0c4c1556a0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f0c4800e870 tx=0x7f0c4800eb80 comp rx=0 tx=0).stop 2023-11-28T12:12:18.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:18.002+0000 7f0c53bff700 1 -- 172.21.15.45:0/1877742689 shutdown_connections 2023-11-28T12:12:18.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:18.002+0000 7f0c53bff700 1 --2- 172.21.15.45:0/1877742689 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f0c300682f0 0x7f0c3006a7a0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:18.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:18.002+0000 7f0c53bff700 1 --2- 172.21.15.45:0/1877742689 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f0c4c0d01b0 0x7f0c4c0b6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:18.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:18.002+0000 7f0c53bff700 1 --2- 172.21.15.45:0/1877742689 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c4c0b20b0 0x7f0c4c1556a0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:18.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:18.002+0000 7f0c53bff700 1 --2- 172.21.15.45:0/1877742689 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0c4c0b29b0 0x7f0c4c0b7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:18.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:18.002+0000 7f0c53bff700 1 -- 172.21.15.45:0/1877742689 >> 172.21.15.45:0/1877742689 conn(0x7f0c4c09c3f0 msgr2=0x7f0c4c0b3840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:18.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:18.002+0000 7f0c53bff700 1 -- 172.21.15.45:0/1877742689 shutdown_connections 2023-11-28T12:12:18.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:18.003+0000 7f0c53bff700 1 -- 172.21.15.45:0/1877742689 wait complete. 2023-11-28T12:12:18.024 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-28T12:12:18.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:18.233+0000 7fdb0ddff700 1 Processor -- start 2023-11-28T12:12:18.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:18.234+0000 7fdb0ddff700 1 -- start start 2023-11-28T12:12:18.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:18.235+0000 7fdb0ddff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fdb0815a760 0x7fdb08161200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:18.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:18.235+0000 7fdb0ddff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdb0815dc30 0x7fdb080b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:18.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:18.235+0000 7fdb0ddff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fdb080cd7c0 0x7fdb080cdc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:18.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:18.235+0000 7fdb0ddff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb0815ab30 con 0x7fdb080cd7c0 2023-11-28T12:12:18.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:18.235+0000 7fdb0ddff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb0815e0a0 con 0x7fdb0815a760 2023-11-28T12:12:18.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:18.235+0000 7fdb0ddff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb080ce150 con 0x7fdb0815dc30 2023-11-28T12:12:18.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:18.235+0000 7fdb07fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fdb080cd7c0 0x7fdb080cdc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:18.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:18.235+0000 7fdb07fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fdb080cd7c0 0x7fdb080cdc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36710/0 (socket says 172.21.15.45:36710) 2023-11-28T12:12:18.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:18.235+0000 7fdb07fff700 1 -- 172.21.15.45:0/2176699521 learned_addr learned my addr 172.21.15.45:0/2176699521 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:12:18.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:18.235+0000 7fdb06ffd700 1 --2- 172.21.15.45:0/2176699521 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdb0815dc30 0x7fdb080b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:18.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:18.235+0000 7fdb077fe700 1 --2- 172.21.15.45:0/2176699521 >> v2:172.21.15.152:3300/0 conn(0x7fdb0815a760 0x7fdb08161200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:18.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:18.236+0000 7fdb07fff700 1 -- 172.21.15.45:0/2176699521 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdb0815dc30 msgr2=0x7fdb080b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:12:18.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:18.236+0000 7fdb07fff700 1 --2- 172.21.15.45:0/2176699521 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdb0815dc30 0x7fdb080b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:18.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:18.236+0000 7fdb07fff700 1 -- 172.21.15.45:0/2176699521 >> v2:172.21.15.152:3300/0 conn(0x7fdb0815a760 msgr2=0x7fdb08161200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:12:18.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:18.236+0000 7fdb07fff700 1 --2- 172.21.15.45:0/2176699521 >> v2:172.21.15.152:3300/0 conn(0x7fdb0815a760 0x7fdb08161200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:18.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:18.236+0000 7fdb07fff700 1 -- 172.21.15.45:0/2176699521 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb08160d70 con 0x7fdb080cd7c0 2023-11-28T12:12:18.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:18.236+0000 7fdb07fff700 1 --2- 172.21.15.45:0/2176699521 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb080cd7c0 0x7fdb080cdc10 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fdb0808bff0 tx=0x7fdb0000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32bb42e77d5e84c1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:18.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:18.236+0000 7fdb067fc700 1 -- 172.21.15.45:0/2176699521 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0000e070 con 0x7fdb080cd7c0 2023-11-28T12:12:18.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:18.236+0000 7fdb067fc700 1 -- 172.21.15.45:0/2176699521 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb0000b8d0 con 0x7fdb080cd7c0 2023-11-28T12:12:18.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:18.236+0000 7fdb067fc700 1 -- 172.21.15.45:0/2176699521 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0000bc80 con 0x7fdb080cd7c0 2023-11-28T12:12:18.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:18.237+0000 7fdb0ddff700 1 -- 172.21.15.45:0/2176699521 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb080cd7c0 msgr2=0x7fdb080cdc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:18.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:18.237+0000 7fdb0ddff700 1 --2- 172.21.15.45:0/2176699521 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb080cd7c0 0x7fdb080cdc10 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fdb0808bff0 tx=0x7fdb0000b330 comp rx=0 tx=0).stop 2023-11-28T12:12:18.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:18.237+0000 7fdb0ddff700 1 -- 172.21.15.45:0/2176699521 shutdown_connections 2023-11-28T12:12:18.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:18.237+0000 7fdb0ddff700 1 --2- 172.21.15.45:0/2176699521 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb080cd7c0 0x7fdb080cdc10 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:18.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:18.237+0000 7fdb0ddff700 1 --2- 172.21.15.45:0/2176699521 >> v2:172.21.15.152:3300/0 conn(0x7fdb0815a760 0x7fdb08161200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:18.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:18.237+0000 7fdb0ddff700 1 --2- 172.21.15.45:0/2176699521 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdb0815dc30 0x7fdb080b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:18.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:18.237+0000 7fdb0ddff700 1 -- 172.21.15.45:0/2176699521 >> 172.21.15.45:0/2176699521 conn(0x7fdb08072620 msgr2=0x7fdb080cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:18.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:18.237+0000 7fdb0ddff700 1 -- 172.21.15.45:0/2176699521 shutdown_connections 2023-11-28T12:12:18.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:18.237+0000 7fdb0ddff700 1 -- 172.21.15.45:0/2176699521 wait complete. 2023-11-28T12:12:18.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:18.239+0000 7fdb0ddff700 1 Processor -- start 2023-11-28T12:12:18.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:18.239+0000 7fdb0ddff700 1 -- start start 2023-11-28T12:12:18.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:18.240+0000 7fdb0ddff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdb080cd7c0 0x7fdb08149d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:18.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:18.240+0000 7fdb0ddff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb0815a760 0x7fdb08158300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:18.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:18.240+0000 7fdb0ddff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdb0815dc30 0x7fdb080cac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:18.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:18.240+0000 7fdb0ddff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb080b7a70 con 0x7fdb0815a760 2023-11-28T12:12:18.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:18.240+0000 7fdb0ddff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb080b7440 con 0x7fdb0815dc30 2023-11-28T12:12:18.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:18.240+0000 7fdb0ddff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb08158be0 con 0x7fdb080cd7c0 2023-11-28T12:12:18.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:18.240+0000 7fdb06ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb0815a760 0x7fdb08158300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:18.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:18.240+0000 7fdb06ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb0815a760 0x7fdb08158300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36716/0 (socket says 172.21.15.45:36716) 2023-11-28T12:12:18.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:18.240+0000 7fdb06ffd700 1 -- 172.21.15.45:0/758808114 learned_addr learned my addr 172.21.15.45:0/758808114 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:12:18.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:18.240+0000 7fdb077fe700 1 --2- 172.21.15.45:0/758808114 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdb080cd7c0 0x7fdb08149d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:18.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:18.240+0000 7fdb07fff700 1 --2- 172.21.15.45:0/758808114 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdb0815dc30 0x7fdb080cac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:18.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:18.241+0000 7fdb06ffd700 1 -- 172.21.15.45:0/758808114 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdb080cd7c0 msgr2=0x7fdb08149d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:18.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:18.241+0000 7fdb06ffd700 1 --2- 172.21.15.45:0/758808114 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdb080cd7c0 0x7fdb08149d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:18.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:18.241+0000 7fdb06ffd700 1 -- 172.21.15.45:0/758808114 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdb0815dc30 msgr2=0x7fdb080cac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:18.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:18.241+0000 7fdb06ffd700 1 --2- 172.21.15.45:0/758808114 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdb0815dc30 0x7fdb080cac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:18.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:18.241+0000 7fdb06ffd700 1 -- 172.21.15.45:0/758808114 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb00009b30 con 0x7fdb0815a760 2023-11-28T12:12:18.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:18.241+0000 7fdb06ffd700 1 --2- 172.21.15.45:0/758808114 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb0815a760 0x7fdb08158300 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fdafc00e8a0 tx=0x7fdafc00ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:18.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:18.241+0000 7fdaeffff700 1 -- 172.21.15.45:0/758808114 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdafc009590 con 0x7fdb0815a760 2023-11-28T12:12:18.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:18.241+0000 7fdaeffff700 1 -- 172.21.15.45:0/758808114 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdafc013680 con 0x7fdb0815a760 2023-11-28T12:12:18.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:18.241+0000 7fdaeffff700 1 -- 172.21.15.45:0/758808114 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdafc0139f0 con 0x7fdb0815a760 2023-11-28T12:12:18.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:18.241+0000 7fdb0ddff700 1 -- 172.21.15.45:0/758808114 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb080b5390 con 0x7fdb0815a760 2023-11-28T12:12:18.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:18.241+0000 7fdb0ddff700 1 -- 172.21.15.45:0/758808114 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb080b5130 con 0x7fdb0815a760 2023-11-28T12:12:18.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:18.242+0000 7fdb0ddff700 1 -- 172.21.15.45:0/758808114 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb080b5670 con 0x7fdb0815a760 2023-11-28T12:12:18.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:18.243+0000 7fdaeffff700 1 -- 172.21.15.45:0/758808114 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fdafc023070 con 0x7fdb0815a760 2023-11-28T12:12:18.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:18.244+0000 7fdaeffff700 1 --2- 172.21.15.45:0/758808114 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fdaf40682f0 0x7fdaf406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:18.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:18.244+0000 7fdaeffff700 1 -- 172.21.15.45:0/758808114 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6293+0+0 (secure 0 0 0) 0x7fdafc085e60 con 0x7fdb0815a760 2023-11-28T12:12:18.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:18.245+0000 7fdb077fe700 1 --2- 172.21.15.45:0/758808114 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fdaf40682f0 0x7fdaf406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:18.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:18.246+0000 7fdb077fe700 1 --2- 172.21.15.45:0/758808114 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fdaf40682f0 0x7fdaf406a7a0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fdb08157260 tx=0x7fdaf8009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:18.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:18.248+0000 7fdaeffff700 1 -- 172.21.15.45:0/758808114 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fdafc052480 con 0x7fdb0815a760 2023-11-28T12:12:18.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:18.452+0000 7fdb0ddff700 1 -- 172.21.15.45:0/758808114 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fdb080b7bb0 con 0x7fdb0815a760 2023-11-28T12:12:19.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:19.011+0000 7fdaeffff700 1 -- 172.21.15.45:0/758808114 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v65) v1 ==== 181+0+0 (secure 0 0 0) 0x7fdb080b7bb0 con 0x7fdb0815a760 2023-11-28T12:12:19.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:19.013+0000 7fdb0ddff700 1 -- 172.21.15.45:0/758808114 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fdaf40682f0 msgr2=0x7fdaf406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:19.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:19.013+0000 7fdb0ddff700 1 --2- 172.21.15.45:0/758808114 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fdaf40682f0 0x7fdaf406a7a0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fdb08157260 tx=0x7fdaf8009210 comp rx=0 tx=0).stop 2023-11-28T12:12:19.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:19.013+0000 7fdb0ddff700 1 -- 172.21.15.45:0/758808114 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb0815a760 msgr2=0x7fdb08158300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:19.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:19.013+0000 7fdb0ddff700 1 --2- 172.21.15.45:0/758808114 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb0815a760 0x7fdb08158300 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fdafc00e8a0 tx=0x7fdafc00ebb0 comp rx=0 tx=0).stop 2023-11-28T12:12:19.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:19.014+0000 7fdb0ddff700 1 -- 172.21.15.45:0/758808114 shutdown_connections 2023-11-28T12:12:19.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:19.014+0000 7fdb0ddff700 1 --2- 172.21.15.45:0/758808114 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fdaf40682f0 0x7fdaf406a7a0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:19.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:19.014+0000 7fdb0ddff700 1 --2- 172.21.15.45:0/758808114 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdb0815dc30 0x7fdb080cac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:19.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:19.014+0000 7fdb0ddff700 1 --2- 172.21.15.45:0/758808114 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fdb080cd7c0 0x7fdb08149d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:19.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:19.014+0000 7fdb0ddff700 1 --2- 172.21.15.45:0/758808114 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb0815a760 0x7fdb08158300 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:19.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:19.014+0000 7fdb0ddff700 1 -- 172.21.15.45:0/758808114 >> 172.21.15.45:0/758808114 conn(0x7fdb08072620 msgr2=0x7fdb080b46b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:19.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:19.014+0000 7fdb0ddff700 1 -- 172.21.15.45:0/758808114 shutdown_connections 2023-11-28T12:12:19.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:19.014+0000 7fdb0ddff700 1 -- 172.21.15.45:0/758808114 wait complete. 2023-11-28T12:12:19.017 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' removed 2023-11-28T12:12:19.036 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-28T12:12:19.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:19.247+0000 7fae419ff700 1 Processor -- start 2023-11-28T12:12:19.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:19.247+0000 7fae419ff700 1 -- start start 2023-11-28T12:12:19.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:19.248+0000 7fae419ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fae3c15ca60 0x7fae3c0b38b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:19.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:19.248+0000 7fae419ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fae3c0d1350 0x7fae3c0b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:19.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:19.248+0000 7fae419ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae3c0afbe0 con 0x7fae3c0b29d0 2023-11-28T12:12:19.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:19.248+0000 7fae419ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae3c0b2750 con 0x7fae3c0d1350 2023-11-28T12:12:19.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:19.248+0000 7fae419ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae3c15ce30 con 0x7fae3c15ca60 2023-11-28T12:12:19.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:19.249+0000 7fae3b7fe700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fae3c0d1350 0x7fae3c0b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:19.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:19.249+0000 7fae3affd700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fae3c15ca60 0x7fae3c0b38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:19.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:19.249+0000 7fae33fff700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fae3c0b29d0 0x7fae3c0d0c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.45:50916/0 (socket says 172.21.15.45:50916) 2023-11-28T12:12:19.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:19.249+0000 7fae33fff700 1 -- 172.21.15.45:0/239429611 learned_addr learned my addr 172.21.15.45:0/239429611 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:12:19.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:19.249+0000 7fae3a7fc700 1 -- 172.21.15.45:0/239429611 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 431805718 0 0) 0x7fae3c0afbe0 con 0x7fae3c0b29d0 2023-11-28T12:12:19.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:19.249+0000 7fae3affd700 1 -- 172.21.15.45:0/239429611 >> v2:172.21.15.152:3300/0 conn(0x7fae3c0d1350 msgr2=0x7fae3c0b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:12:19.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:19.249+0000 7fae3affd700 1 --2- 172.21.15.45:0/239429611 >> v2:172.21.15.152:3300/0 conn(0x7fae3c0d1350 0x7fae3c0b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:19.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:19.249+0000 7fae3affd700 1 -- 172.21.15.45:0/239429611 >> v1:172.21.15.152:6789/0 conn(0x7fae3c0b29d0 legacy=0x7fae3c0d0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:19.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:19.249+0000 7fae3affd700 1 -- 172.21.15.45:0/239429611 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae3c0b3f20 con 0x7fae3c15ca60 2023-11-28T12:12:19.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:19.249+0000 7fae3b7fe700 1 --2- 172.21.15.45:0/239429611 >> v2:172.21.15.152:3300/0 conn(0x7fae3c0d1350 0x7fae3c0b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:12:19.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:19.250+0000 7fae3affd700 1 --2- 172.21.15.45:0/239429611 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fae3c15ca60 0x7fae3c0b38b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fae2c009820 tx=0x7fae2c009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=344c9e77533dadfd server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:19.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:19.250+0000 7fae3a7fc700 1 -- 172.21.15.45:0/239429611 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2c005e30 con 0x7fae3c15ca60 2023-11-28T12:12:19.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:19.250+0000 7fae3a7fc700 1 -- 172.21.15.45:0/239429611 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae2c006030 con 0x7fae3c15ca60 2023-11-28T12:12:19.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:19.250+0000 7fae3a7fc700 1 -- 172.21.15.45:0/239429611 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2c0063c0 con 0x7fae3c15ca60 2023-11-28T12:12:19.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:19.250+0000 7fae419ff700 1 -- 172.21.15.45:0/239429611 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fae3c15ca60 msgr2=0x7fae3c0b38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:19.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:19.250+0000 7fae419ff700 1 --2- 172.21.15.45:0/239429611 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fae3c15ca60 0x7fae3c0b38b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fae2c009820 tx=0x7fae2c009b30 comp rx=0 tx=0).stop 2023-11-28T12:12:19.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:19.251+0000 7fae419ff700 1 -- 172.21.15.45:0/239429611 shutdown_connections 2023-11-28T12:12:19.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:19.251+0000 7fae419ff700 1 --2- 172.21.15.45:0/239429611 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fae3c15ca60 0x7fae3c0b38b0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:19.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:19.251+0000 7fae419ff700 1 --2- 172.21.15.45:0/239429611 >> v2:172.21.15.152:3300/0 conn(0x7fae3c0d1350 0x7fae3c0b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:19.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:19.251+0000 7fae419ff700 1 -- 172.21.15.45:0/239429611 >> 172.21.15.45:0/239429611 conn(0x7fae3c09c3f0 msgr2=0x7fae3c0d3070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:19.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:19.251+0000 7fae419ff700 1 -- 172.21.15.45:0/239429611 shutdown_connections 2023-11-28T12:12:19.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:19.251+0000 7fae419ff700 1 -- 172.21.15.45:0/239429611 wait complete. 2023-11-28T12:12:19.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:19.252+0000 7fae419ff700 1 Processor -- start 2023-11-28T12:12:19.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:19.253+0000 7fae419ff700 1 -- start start 2023-11-28T12:12:19.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:19.253+0000 7fae419ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fae3c0b29d0 0x7fae3c15fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:19.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:19.254+0000 7fae419ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae3c0d1350 0x7fae3c15f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:19.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:19.254+0000 7fae419ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fae3c15ca60 0x7fae3c15a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:19.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:19.254+0000 7fae419ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae3c147090 con 0x7fae3c15ca60 2023-11-28T12:12:19.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:19.254+0000 7fae419ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae3c147650 con 0x7fae3c0d1350 2023-11-28T12:12:19.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:19.254+0000 7fae419ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae3c0b7490 con 0x7fae3c0b29d0 2023-11-28T12:12:19.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:19.254+0000 7fae3b7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fae3c15ca60 0x7fae3c15a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:19.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:19.254+0000 7fae3b7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fae3c15ca60 0x7fae3c15a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36722/0 (socket says 172.21.15.45:36722) 2023-11-28T12:12:19.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:19.254+0000 7fae3b7fe700 1 -- 172.21.15.45:0/1985682839 learned_addr learned my addr 172.21.15.45:0/1985682839 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:12:19.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:19.254+0000 7fae3affd700 1 --2- 172.21.15.45:0/1985682839 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fae3c0b29d0 0x7fae3c15fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:19.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:19.254+0000 7fae33fff700 1 --2- 172.21.15.45:0/1985682839 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae3c0d1350 0x7fae3c15f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:19.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:19.254+0000 7fae3b7fe700 1 -- 172.21.15.45:0/1985682839 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fae3c0b29d0 msgr2=0x7fae3c15fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:19.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:19.254+0000 7fae3b7fe700 1 --2- 172.21.15.45:0/1985682839 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fae3c0b29d0 0x7fae3c15fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:19.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:19.254+0000 7fae3b7fe700 1 -- 172.21.15.45:0/1985682839 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae3c0d1350 msgr2=0x7fae3c15f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:19.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:19.254+0000 7fae3b7fe700 1 --2- 172.21.15.45:0/1985682839 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae3c0d1350 0x7fae3c15f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:19.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:19.254+0000 7fae3b7fe700 1 -- 172.21.15.45:0/1985682839 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae34009a70 con 0x7fae3c15ca60 2023-11-28T12:12:19.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:19.254+0000 7fae33fff700 1 --2- 172.21.15.45:0/1985682839 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae3c0d1350 0x7fae3c15f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:12:19.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:19.255+0000 7fae3b7fe700 1 --2- 172.21.15.45:0/1985682839 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fae3c15ca60 0x7fae3c15a8f0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fae3400efb0 tx=0x7fae3400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:19.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:19.255+0000 7fae38ff9700 1 -- 172.21.15.45:0/1985682839 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae3400cd40 con 0x7fae3c15ca60 2023-11-28T12:12:19.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:19.255+0000 7fae38ff9700 1 -- 172.21.15.45:0/1985682839 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae3400f040 con 0x7fae3c15ca60 2023-11-28T12:12:19.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:19.255+0000 7fae38ff9700 1 -- 172.21.15.45:0/1985682839 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae3400cea0 con 0x7fae3c15ca60 2023-11-28T12:12:19.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:19.255+0000 7fae419ff700 1 -- 172.21.15.45:0/1985682839 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae2c009430 con 0x7fae3c15ca60 2023-11-28T12:12:19.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:19.255+0000 7fae419ff700 1 -- 172.21.15.45:0/1985682839 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae3c0b44e0 con 0x7fae3c15ca60 2023-11-28T12:12:19.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:19.256+0000 7fae419ff700 1 -- 172.21.15.45:0/1985682839 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae3c0b4200 con 0x7fae3c15ca60 2023-11-28T12:12:19.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:19.257+0000 7fae38ff9700 1 -- 172.21.15.45:0/1985682839 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fae340146a0 con 0x7fae3c15ca60 2023-11-28T12:12:19.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:19.258+0000 7fae38ff9700 1 --2- 172.21.15.45:0/1985682839 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fae1c068320 0x7fae1c06a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:19.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:19.258+0000 7fae38ff9700 1 -- 172.21.15.45:0/1985682839 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5826+0+0 (secure 0 0 0) 0x7fae34086a40 con 0x7fae3c15ca60 2023-11-28T12:12:19.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:19.258+0000 7fae3affd700 1 --2- 172.21.15.45:0/1985682839 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fae1c068320 0x7fae1c06a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:19.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:19.259+0000 7fae3affd700 1 --2- 172.21.15.45:0/1985682839 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fae1c068320 0x7fae1c06a7d0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fae2c000c00 tx=0x7fae2c008070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:19.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:19.262+0000 7fae38ff9700 1 -- 172.21.15.45:0/1985682839 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fae34053290 con 0x7fae3c15ca60 2023-11-28T12:12:19.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:19.466+0000 7fae419ff700 1 -- 172.21.15.45:0/1985682839 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fae3c0b47c0 con 0x7fae3c15ca60 2023-11-28T12:12:20.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.013+0000 7fae38ff9700 1 -- 172.21.15.45:0/1985682839 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v66) v1 ==== 169+0+0 (secure 0 0 0) 0x7fae340180d0 con 0x7fae3c15ca60 2023-11-28T12:12:20.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.016+0000 7fae419ff700 1 -- 172.21.15.45:0/1985682839 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fae1c068320 msgr2=0x7fae1c06a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:20.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.016+0000 7fae419ff700 1 --2- 172.21.15.45:0/1985682839 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fae1c068320 0x7fae1c06a7d0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fae2c000c00 tx=0x7fae2c008070 comp rx=0 tx=0).stop 2023-11-28T12:12:20.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.016+0000 7fae419ff700 1 -- 172.21.15.45:0/1985682839 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fae3c15ca60 msgr2=0x7fae3c15a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:20.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.016+0000 7fae419ff700 1 --2- 172.21.15.45:0/1985682839 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fae3c15ca60 0x7fae3c15a8f0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fae3400efb0 tx=0x7fae3400c3a0 comp rx=0 tx=0).stop 2023-11-28T12:12:20.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.016+0000 7fae419ff700 1 -- 172.21.15.45:0/1985682839 shutdown_connections 2023-11-28T12:12:20.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.016+0000 7fae419ff700 1 --2- 172.21.15.45:0/1985682839 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fae1c068320 0x7fae1c06a7d0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:20.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.016+0000 7fae419ff700 1 --2- 172.21.15.45:0/1985682839 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fae3c15ca60 0x7fae3c15a8f0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:20.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.016+0000 7fae419ff700 1 --2- 172.21.15.45:0/1985682839 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fae3c0b29d0 0x7fae3c15fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:20.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.016+0000 7fae419ff700 1 --2- 172.21.15.45:0/1985682839 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fae3c0d1350 0x7fae3c15f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:20.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.016+0000 7fae419ff700 1 -- 172.21.15.45:0/1985682839 >> 172.21.15.45:0/1985682839 conn(0x7fae3c09c3f0 msgr2=0x7fae3c1604f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:20.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.016+0000 7fae419ff700 1 -- 172.21.15.45:0/1985682839 shutdown_connections 2023-11-28T12:12:20.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.016+0000 7fae419ff700 1 -- 172.21.15.45:0/1985682839 wait complete. 2023-11-28T12:12:20.023 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' removed 2023-11-28T12:12:20.039 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-28T12:12:20.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.249+0000 7f2e499ff700 1 Processor -- start 2023-11-28T12:12:20.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.250+0000 7f2e499ff700 1 -- start start 2023-11-28T12:12:20.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.251+0000 7f2e499ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2e4415c9b0 0x7f2e440b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:20.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.251+0000 7f2e499ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e440d1950 con 0x7f2e44161340 2023-11-28T12:12:20.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.251+0000 7f2e499ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e440d24f0 con 0x7f2e440cd7c0 2023-11-28T12:12:20.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.251+0000 7f2e499ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e440b5800 con 0x7f2e4415c9b0 2023-11-28T12:12:20.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.252+0000 7f2e42ffd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2e4415c9b0 0x7f2e440b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:20.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.252+0000 7f2e427fc700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f2e44161340 0x7f2e440d1de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:57818/0 (socket says 172.21.15.45:57818) 2023-11-28T12:12:20.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.252+0000 7f2e427fc700 1 -- 172.21.15.45:0/3600892527 learned_addr learned my addr 172.21.15.45:0/3600892527 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:12:20.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.252+0000 7f2e42ffd700 1 -- 172.21.15.45:0/3600892527 >> v1:172.21.15.152:6789/0 conn(0x7f2e440cd7c0 legacy=0x7f2e440b5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:12:20.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.252+0000 7f2e42ffd700 1 -- 172.21.15.45:0/3600892527 >> v1:172.21.15.45:6789/0 conn(0x7f2e44161340 legacy=0x7f2e440d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:20.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.252+0000 7f2e42ffd700 1 -- 172.21.15.45:0/3600892527 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e440b5520 con 0x7f2e4415c9b0 2023-11-28T12:12:20.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.252+0000 7f2e41ffb700 1 -- 172.21.15.45:0/3600892527 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1026014898 0 0) 0x7f2e440d1950 con 0x7f2e44161340 2023-11-28T12:12:20.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.252+0000 7f2e42ffd700 1 --2- 172.21.15.45:0/3600892527 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e4415c9b0 0x7f2e440b4bf0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f2e34009840 tx=0x7f2e34009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7385ae5acd17626 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:20.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.253+0000 7f2e41ffb700 1 -- 172.21.15.45:0/3600892527 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e34011830 con 0x7f2e4415c9b0 2023-11-28T12:12:20.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.253+0000 7f2e41ffb700 1 -- 172.21.15.45:0/3600892527 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e34011990 con 0x7f2e4415c9b0 2023-11-28T12:12:20.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.253+0000 7f2e41ffb700 1 -- 172.21.15.45:0/3600892527 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e34011d20 con 0x7f2e4415c9b0 2023-11-28T12:12:20.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.253+0000 7f2e499ff700 1 -- 172.21.15.45:0/3600892527 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e4415c9b0 msgr2=0x7f2e440b4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:20.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.253+0000 7f2e499ff700 1 --2- 172.21.15.45:0/3600892527 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e4415c9b0 0x7f2e440b4bf0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f2e34009840 tx=0x7f2e34009b50 comp rx=0 tx=0).stop 2023-11-28T12:12:20.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.253+0000 7f2e499ff700 1 -- 172.21.15.45:0/3600892527 shutdown_connections 2023-11-28T12:12:20.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.253+0000 7f2e499ff700 1 --2- 172.21.15.45:0/3600892527 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e4415c9b0 0x7f2e440b4bf0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:20.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.253+0000 7f2e499ff700 1 -- 172.21.15.45:0/3600892527 >> 172.21.15.45:0/3600892527 conn(0x7f2e44072600 msgr2=0x7f2e440cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:20.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.253+0000 7f2e499ff700 1 -- 172.21.15.45:0/3600892527 shutdown_connections 2023-11-28T12:12:20.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.253+0000 7f2e499ff700 1 -- 172.21.15.45:0/3600892527 wait complete. 2023-11-28T12:12:20.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.256+0000 7f2e499ff700 1 Processor -- start 2023-11-28T12:12:20.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.256+0000 7f2e499ff700 1 -- start start 2023-11-28T12:12:20.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.257+0000 7f2e499ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2e440cd7c0 0x7f2e441579c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:20.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.257+0000 7f2e499ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e4415c9b0 0x7f2e440cc980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:20.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.257+0000 7f2e499ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2e44161340 0x7f2e441e8860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:20.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.257+0000 7f2e499ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e440cb8e0 con 0x7f2e4415c9b0 2023-11-28T12:12:20.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.257+0000 7f2e499ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e440cbbc0 con 0x7f2e44161340 2023-11-28T12:12:20.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.257+0000 7f2e499ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e440cbea0 con 0x7f2e440cd7c0 2023-11-28T12:12:20.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.257+0000 7f2e427fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e4415c9b0 0x7f2e440cc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:20.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.257+0000 7f2e427fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e4415c9b0 0x7f2e440cc980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36742/0 (socket says 172.21.15.45:36742) 2023-11-28T12:12:20.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.257+0000 7f2e427fc700 1 -- 172.21.15.45:0/3836922826 learned_addr learned my addr 172.21.15.45:0/3836922826 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:12:20.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.258+0000 7f2e42ffd700 1 --2- 172.21.15.45:0/3836922826 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2e440cd7c0 0x7f2e441579c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:20.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.258+0000 7f2e437fe700 1 --2- 172.21.15.45:0/3836922826 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2e44161340 0x7f2e441e8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:20.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.258+0000 7f2e427fc700 1 -- 172.21.15.45:0/3836922826 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2e440cd7c0 msgr2=0x7f2e441579c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:20.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.258+0000 7f2e427fc700 1 --2- 172.21.15.45:0/3836922826 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2e440cd7c0 0x7f2e441579c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:20.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.258+0000 7f2e427fc700 1 -- 172.21.15.45:0/3836922826 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2e44161340 msgr2=0x7f2e441e8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:20.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.258+0000 7f2e427fc700 1 --2- 172.21.15.45:0/3836922826 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2e44161340 0x7f2e441e8860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:20.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.258+0000 7f2e427fc700 1 -- 172.21.15.45:0/3836922826 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e340094a0 con 0x7f2e4415c9b0 2023-11-28T12:12:20.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.258+0000 7f2e427fc700 1 --2- 172.21.15.45:0/3836922826 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e4415c9b0 0x7f2e440cc980 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f2e3800c520 tx=0x7f2e3800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:20.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.258+0000 7f2e2bfff700 1 -- 172.21.15.45:0/3836922826 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e38004c80 con 0x7f2e4415c9b0 2023-11-28T12:12:20.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.258+0000 7f2e2bfff700 1 -- 172.21.15.45:0/3836922826 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e38004e00 con 0x7f2e4415c9b0 2023-11-28T12:12:20.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.258+0000 7f2e2bfff700 1 -- 172.21.15.45:0/3836922826 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e38007310 con 0x7f2e4415c9b0 2023-11-28T12:12:20.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.258+0000 7f2e499ff700 1 -- 172.21.15.45:0/3836922826 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e440d15e0 con 0x7f2e4415c9b0 2023-11-28T12:12:20.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.258+0000 7f2e499ff700 1 -- 172.21.15.45:0/3836922826 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e440d1300 con 0x7f2e4415c9b0 2023-11-28T12:12:20.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.259+0000 7f2e499ff700 1 -- 172.21.15.45:0/3836922826 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e440b5130 con 0x7f2e4415c9b0 2023-11-28T12:12:20.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.261+0000 7f2e2bfff700 1 -- 172.21.15.45:0/3836922826 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f2e3801a020 con 0x7f2e4415c9b0 2023-11-28T12:12:20.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.261+0000 7f2e2bfff700 1 --2- 172.21.15.45:0/3836922826 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f2e300682f0 0x7f2e3006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:20.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.262+0000 7f2e2bfff700 1 -- 172.21.15.45:0/3836922826 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f2e380856c0 con 0x7f2e4415c9b0 2023-11-28T12:12:20.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.262+0000 7f2e42ffd700 1 --2- 172.21.15.45:0/3836922826 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f2e300682f0 0x7f2e3006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:20.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.263+0000 7f2e42ffd700 1 --2- 172.21.15.45:0/3836922826 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f2e300682f0 0x7f2e3006a7a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f2e34000c00 tx=0x7f2e3401c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:20.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.266+0000 7f2e2bfff700 1 -- 172.21.15.45:0/3836922826 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f2e38052150 con 0x7f2e4415c9b0 2023-11-28T12:12:20.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.471+0000 7f2e499ff700 1 -- 172.21.15.45:0/3836922826 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f2e440745c0 con 0x7f2e4415c9b0 2023-11-28T12:12:20.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.475+0000 7f2e2bfff700 1 -- 172.21.15.45:0/3836922826 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7f2e38055770 con 0x7f2e4415c9b0 2023-11-28T12:12:20.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.477+0000 7f2e499ff700 1 -- 172.21.15.45:0/3836922826 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f2e300682f0 msgr2=0x7f2e3006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:20.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.477+0000 7f2e499ff700 1 --2- 172.21.15.45:0/3836922826 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f2e300682f0 0x7f2e3006a7a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f2e34000c00 tx=0x7f2e3401c040 comp rx=0 tx=0).stop 2023-11-28T12:12:20.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.477+0000 7f2e499ff700 1 -- 172.21.15.45:0/3836922826 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e4415c9b0 msgr2=0x7f2e440cc980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:20.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.477+0000 7f2e499ff700 1 --2- 172.21.15.45:0/3836922826 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e4415c9b0 0x7f2e440cc980 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f2e3800c520 tx=0x7f2e3800c8e0 comp rx=0 tx=0).stop 2023-11-28T12:12:20.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.477+0000 7f2e499ff700 1 -- 172.21.15.45:0/3836922826 shutdown_connections 2023-11-28T12:12:20.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.477+0000 7f2e499ff700 1 --2- 172.21.15.45:0/3836922826 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f2e300682f0 0x7f2e3006a7a0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:20.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.477+0000 7f2e499ff700 1 --2- 172.21.15.45:0/3836922826 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2e44161340 0x7f2e441e8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:20.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.477+0000 7f2e499ff700 1 --2- 172.21.15.45:0/3836922826 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2e440cd7c0 0x7f2e441579c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:20.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.477+0000 7f2e499ff700 1 --2- 172.21.15.45:0/3836922826 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e4415c9b0 0x7f2e440cc980 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:20.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.477+0000 7f2e499ff700 1 -- 172.21.15.45:0/3836922826 >> 172.21.15.45:0/3836922826 conn(0x7f2e44072600 msgr2=0x7f2e440b5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:20.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.478+0000 7f2e499ff700 1 -- 172.21.15.45:0/3836922826 shutdown_connections 2023-11-28T12:12:20.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.478+0000 7f2e499ff700 1 -- 172.21.15.45:0/3836922826 wait complete. 2023-11-28T12:12:20.497 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair' 2023-11-28T12:12:20.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.699+0000 7f96e19ff700 1 Processor -- start 2023-11-28T12:12:20.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.699+0000 7f96e19ff700 1 -- start start 2023-11-28T12:12:20.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.700+0000 7f96e19ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f96dc15c9b0 0x7f96dc0b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:20.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.700+0000 7f96e19ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f96dc0cd7c0 0x7f96dc0cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:20.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.700+0000 7f96e19ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96dc0d1950 con 0x7f96dc161340 2023-11-28T12:12:20.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.700+0000 7f96e19ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96dc0b5800 con 0x7f96dc15c9b0 2023-11-28T12:12:20.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.700+0000 7f96e19ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96dc0ce140 con 0x7f96dc0cd7c0 2023-11-28T12:12:20.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.701+0000 7f96daffd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f96dc15c9b0 0x7f96dc0b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:20.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.701+0000 7f96daffd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f96dc15c9b0 0x7f96dc0b4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36750/0 (socket says 172.21.15.45:36750) 2023-11-28T12:12:20.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.701+0000 7f96daffd700 1 -- 172.21.15.45:0/3311347573 learned_addr learned my addr 172.21.15.45:0/3311347573 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:12:20.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.701+0000 7f96db7fe700 1 --2- 172.21.15.45:0/3311347573 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f96dc0cd7c0 0x7f96dc0cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:20.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.701+0000 7f96daffd700 1 -- 172.21.15.45:0/3311347573 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f96dc0cd7c0 msgr2=0x7f96dc0cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:12:20.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.701+0000 7f96daffd700 1 --2- 172.21.15.45:0/3311347573 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f96dc0cd7c0 0x7f96dc0cdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:20.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.701+0000 7f96daffd700 1 -- 172.21.15.45:0/3311347573 >> v1:172.21.15.152:6789/0 conn(0x7f96dc161340 legacy=0x7f96dc0d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:12:20.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.701+0000 7f96daffd700 1 -- 172.21.15.45:0/3311347573 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96dc0d24f0 con 0x7f96dc15c9b0 2023-11-28T12:12:20.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.701+0000 7f96daffd700 1 --2- 172.21.15.45:0/3311347573 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96dc15c9b0 0x7f96dc0b4bf0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f96cc0098f0 tx=0x7f96cc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a511faf66aa1239e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:20.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.702+0000 7f96d9ffb700 1 -- 172.21.15.45:0/3311347573 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96cc00b8a0 con 0x7f96dc15c9b0 2023-11-28T12:12:20.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.702+0000 7f96d9ffb700 1 -- 172.21.15.45:0/3311347573 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96cc00ba00 con 0x7f96dc15c9b0 2023-11-28T12:12:20.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.702+0000 7f96d9ffb700 1 -- 172.21.15.45:0/3311347573 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96cc00bd90 con 0x7f96dc15c9b0 2023-11-28T12:12:20.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.702+0000 7f96e19ff700 1 -- 172.21.15.45:0/3311347573 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96dc15c9b0 msgr2=0x7f96dc0b4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:20.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.702+0000 7f96e19ff700 1 --2- 172.21.15.45:0/3311347573 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96dc15c9b0 0x7f96dc0b4bf0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f96cc0098f0 tx=0x7f96cc009c00 comp rx=0 tx=0).stop 2023-11-28T12:12:20.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.702+0000 7f96e19ff700 1 -- 172.21.15.45:0/3311347573 shutdown_connections 2023-11-28T12:12:20.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.702+0000 7f96e19ff700 1 --2- 172.21.15.45:0/3311347573 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f96dc0cd7c0 0x7f96dc0cdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:20.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.702+0000 7f96e19ff700 1 --2- 172.21.15.45:0/3311347573 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96dc15c9b0 0x7f96dc0b4bf0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:20.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.702+0000 7f96e19ff700 1 -- 172.21.15.45:0/3311347573 >> 172.21.15.45:0/3311347573 conn(0x7f96dc072600 msgr2=0x7f96dc0cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:20.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.702+0000 7f96e19ff700 1 -- 172.21.15.45:0/3311347573 shutdown_connections 2023-11-28T12:12:20.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.702+0000 7f96e19ff700 1 -- 172.21.15.45:0/3311347573 wait complete. 2023-11-28T12:12:20.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.704+0000 7f96e19ff700 1 Processor -- start 2023-11-28T12:12:20.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.704+0000 7f96e19ff700 1 -- start start 2023-11-28T12:12:20.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.705+0000 7f96e19ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96dc0cd7c0 0x7f96dc0c7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:20.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.705+0000 7f96e19ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f96dc15c9b0 0x7f96dc1596a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:20.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.705+0000 7f96e19ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f96dc161340 0x7f96dc153860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:20.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.705+0000 7f96e19ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96dc0c8670 con 0x7f96dc0cd7c0 2023-11-28T12:12:20.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.705+0000 7f96e19ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96dc0c8950 con 0x7f96dc161340 2023-11-28T12:12:20.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.705+0000 7f96e19ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96dc0c8c30 con 0x7f96dc15c9b0 2023-11-28T12:12:20.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.705+0000 7f96daffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96dc0cd7c0 0x7f96dc0c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:20.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.705+0000 7f96daffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96dc0cd7c0 0x7f96dc0c7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36766/0 (socket says 172.21.15.45:36766) 2023-11-28T12:12:20.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.706+0000 7f96daffd700 1 -- 172.21.15.45:0/2615488632 learned_addr learned my addr 172.21.15.45:0/2615488632 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:12:20.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.706+0000 7f96da7fc700 1 --2- 172.21.15.45:0/2615488632 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f96dc15c9b0 0x7f96dc1596a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:20.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.706+0000 7f96db7fe700 1 --2- 172.21.15.45:0/2615488632 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f96dc161340 0x7f96dc153860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:20.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.706+0000 7f96daffd700 1 -- 172.21.15.45:0/2615488632 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f96dc15c9b0 msgr2=0x7f96dc1596a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:20.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.706+0000 7f96daffd700 1 --2- 172.21.15.45:0/2615488632 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f96dc15c9b0 0x7f96dc1596a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:20.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.706+0000 7f96daffd700 1 -- 172.21.15.45:0/2615488632 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f96dc161340 msgr2=0x7f96dc153860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:20.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.706+0000 7f96daffd700 1 --2- 172.21.15.45:0/2615488632 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f96dc161340 0x7f96dc153860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:20.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.706+0000 7f96daffd700 1 -- 172.21.15.45:0/2615488632 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96cc009550 con 0x7f96dc0cd7c0 2023-11-28T12:12:20.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.706+0000 7f96db7fe700 1 --2- 172.21.15.45:0/2615488632 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f96dc161340 0x7f96dc153860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:12:20.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.706+0000 7f96daffd700 1 --2- 172.21.15.45:0/2615488632 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96dc0cd7c0 0x7f96dc0c7760 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f96cc009c40 tx=0x7f96cc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:20.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.707+0000 7f96c3fff700 1 -- 172.21.15.45:0/2615488632 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96cc004590 con 0x7f96dc0cd7c0 2023-11-28T12:12:20.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.707+0000 7f96c3fff700 1 -- 172.21.15.45:0/2615488632 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96cc01e070 con 0x7f96dc0cd7c0 2023-11-28T12:12:20.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.707+0000 7f96e19ff700 1 -- 172.21.15.45:0/2615488632 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96dc0d1300 con 0x7f96dc0cd7c0 2023-11-28T12:12:20.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.707+0000 7f96c3fff700 1 -- 172.21.15.45:0/2615488632 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96cc0038e0 con 0x7f96dc0cd7c0 2023-11-28T12:12:20.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.707+0000 7f96e19ff700 1 -- 172.21.15.45:0/2615488632 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96dc0b5520 con 0x7f96dc0cd7c0 2023-11-28T12:12:20.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.708+0000 7f96e19ff700 1 -- 172.21.15.45:0/2615488632 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96dc0d15e0 con 0x7f96dc0cd7c0 2023-11-28T12:12:20.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.709+0000 7f96c3fff700 1 -- 172.21.15.45:0/2615488632 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f96cc00f050 con 0x7f96dc0cd7c0 2023-11-28T12:12:20.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.709+0000 7f96c3fff700 1 --2- 172.21.15.45:0/2615488632 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f96c80682f0 0x7f96c806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:20.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.710+0000 7f96c3fff700 1 -- 172.21.15.45:0/2615488632 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f96cc020070 con 0x7f96dc0cd7c0 2023-11-28T12:12:20.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.710+0000 7f96da7fc700 1 --2- 172.21.15.45:0/2615488632 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f96c80682f0 0x7f96c806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:20.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.711+0000 7f96da7fc700 1 --2- 172.21.15.45:0/2615488632 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f96c80682f0 0x7f96c806a7a0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f96dc0b8cd0 tx=0x7f96d0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:20.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:20.714+0000 7f96c3fff700 1 -- 172.21.15.45:0/2615488632 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f96cc0538e0 con 0x7f96dc0cd7c0 2023-11-28T12:12:21.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:21.005+0000 7f96e19ff700 1 -- 172.21.15.45:0/2615488632 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair"]} v 0) v1 -- 0x7f96dc0745c0 con 0x7f96dc0cd7c0 2023-11-28T12:12:21.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:21.025+0000 7f96c3fff700 1 -- 172.21.15.45:0/2615488632 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair"]}]=0 v277) v1 ==== 169+0+0 (secure 0 0 0) 0x7f96cc056f00 con 0x7f96dc0cd7c0 2023-11-28T12:12:21.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:21.027+0000 7f96e19ff700 1 -- 172.21.15.45:0/2615488632 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f96c80682f0 msgr2=0x7f96c806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:21.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:21.027+0000 7f96e19ff700 1 --2- 172.21.15.45:0/2615488632 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f96c80682f0 0x7f96c806a7a0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f96dc0b8cd0 tx=0x7f96d0009040 comp rx=0 tx=0).stop 2023-11-28T12:12:21.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:21.027+0000 7f96e19ff700 1 -- 172.21.15.45:0/2615488632 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96dc0cd7c0 msgr2=0x7f96dc0c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:21.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:21.027+0000 7f96e19ff700 1 --2- 172.21.15.45:0/2615488632 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96dc0cd7c0 0x7f96dc0c7760 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f96cc009c40 tx=0x7f96cc004750 comp rx=0 tx=0).stop 2023-11-28T12:12:21.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:21.027+0000 7f96e19ff700 1 -- 172.21.15.45:0/2615488632 shutdown_connections 2023-11-28T12:12:21.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:21.027+0000 7f96e19ff700 1 --2- 172.21.15.45:0/2615488632 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f96c80682f0 0x7f96c806a7a0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:21.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:21.027+0000 7f96e19ff700 1 --2- 172.21.15.45:0/2615488632 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f96dc161340 0x7f96dc153860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:21.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:21.027+0000 7f96e19ff700 1 --2- 172.21.15.45:0/2615488632 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96dc0cd7c0 0x7f96dc0c7760 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:21.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:21.027+0000 7f96e19ff700 1 --2- 172.21.15.45:0/2615488632 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f96dc15c9b0 0x7f96dc1596a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:21.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:21.027+0000 7f96e19ff700 1 -- 172.21.15.45:0/2615488632 >> 172.21.15.45:0/2615488632 conn(0x7f96dc072600 msgr2=0x7f96dc06a900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:21.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:21.027+0000 7f96e19ff700 1 -- 172.21.15.45:0/2615488632 shutdown_connections 2023-11-28T12:12:21.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:21.027+0000 7f96e19ff700 1 -- 172.21.15.45:0/2615488632 wait complete. 2023-11-28T12:12:21.048 INFO:tasks.cephfs_test_runner:Test that the damage health status is cleared ... ERROR 2023-11-28T12:12:21.048 INFO:tasks.cephfs_test_runner: 2023-11-28T12:12:21.048 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-28T12:12:21.048 INFO:tasks.cephfs_test_runner:ERROR: test_health_status_after_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2023-11-28T12:12:21.048 INFO:tasks.cephfs_test_runner:Test that the damage health status is cleared 2023-11-28T12:12:21.048 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-28T12:12:21.048 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-28T12:12:21.048 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_neesingh-rh_ceph_17c45c858c4cb3105f973d12c6c74f8d5037aa89/qa/tasks/cephfs/test_forward_scrub.py", line 500, in test_health_status_after_backtrace_repair 2023-11-28T12:12:21.049 INFO:tasks.cephfs_test_runner: self.wait_until_true(lambda: self._check_for_presence_of_MDS_damage(), timeout=100) 2023-11-28T12:12:21.049 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_neesingh-rh_ceph_17c45c858c4cb3105f973d12c6c74f8d5037aa89/qa/tasks/ceph_test_case.py", line 212, in wait_until_true 2023-11-28T12:12:21.049 INFO:tasks.cephfs_test_runner: raise TestTimeoutError("Timed out after {0}s and {1} retries".format(elapsed, retry_count)) 2023-11-28T12:12:21.049 INFO:tasks.cephfs_test_runner:tasks.ceph_test_case.TestTimeoutError: Timed out after 100s and 0 retries 2023-11-28T12:12:21.049 INFO:tasks.cephfs_test_runner: 2023-11-28T12:12:21.049 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-28T12:12:21.049 INFO:tasks.cephfs_test_runner:Ran 3 tests in 312.453s 2023-11-28T12:12:21.049 INFO:tasks.cephfs_test_runner: 2023-11-28T12:12:21.049 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2023-11-28T12:12:21.049 INFO:tasks.cephfs_test_runner: 2023-11-28T12:12:21.049 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-28T12:12:21.049 INFO:tasks.cephfs_test_runner:ERROR: test_health_status_after_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2023-11-28T12:12:21.050 INFO:tasks.cephfs_test_runner:Test that the damage health status is cleared 2023-11-28T12:12:21.050 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-28T12:12:21.050 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-28T12:12:21.050 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_neesingh-rh_ceph_17c45c858c4cb3105f973d12c6c74f8d5037aa89/qa/tasks/cephfs/test_forward_scrub.py", line 500, in test_health_status_after_backtrace_repair 2023-11-28T12:12:21.050 INFO:tasks.cephfs_test_runner: self.wait_until_true(lambda: self._check_for_presence_of_MDS_damage(), timeout=100) 2023-11-28T12:12:21.050 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_neesingh-rh_ceph_17c45c858c4cb3105f973d12c6c74f8d5037aa89/qa/tasks/ceph_test_case.py", line 212, in wait_until_true 2023-11-28T12:12:21.050 INFO:tasks.cephfs_test_runner: raise TestTimeoutError("Timed out after {0}s and {1} retries".format(elapsed, retry_count)) 2023-11-28T12:12:21.050 INFO:tasks.cephfs_test_runner:tasks.ceph_test_case.TestTimeoutError: Timed out after 100s and 0 retries 2023-11-28T12:12:21.050 INFO:tasks.cephfs_test_runner: 2023-11-28T12:12:21.050 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_neesingh-rh_ceph_17c45c858c4cb3105f973d12c6c74f8d5037aa89/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_health_status_after_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2023-11-28T12:12:21.121 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=2b1eeb83ffd94519bee1384420e33939 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_neesingh-rh_ceph_17c45c858c4cb3105f973d12c6c74f8d5037aa89/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_health_status_after_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2023-11-28T12:12:21.123 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-11-28T12:12:21.132 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-11-28T12:12:21.173 INFO:tasks.kclient:Unmounting kernel clients... 2023-11-28T12:12:21.173 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T12:12:21.173 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T12:12:21.233 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16351388k,nr_inodes=4087847,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=41,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3276240k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-11-28T12:12:21.234 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-11-28T12:12:21.234 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T12:12:21.320 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16351388k,nr_inodes=4087847,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=41,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3276240k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-11-28T12:12:21.320 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-11-28T12:12:21.320 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T12:12:21.372 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16348296k,nr_inodes=4087074,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=41,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275620k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-11-28T12:12:21.372 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2023-11-28T12:12:21.372 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T12:12:21.421 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16348296k,nr_inodes=4087074,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=41,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3275620k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-11-28T12:12:21.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:12:21.421 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2023-11-28T12:12:21.468 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-28T12:12:21.469 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-28T12:12:21.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:12:21.469 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T12:12:21.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:12:21.542 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T12:12:21.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:12:21.617 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link delete ceph-brx 2023-11-28T12:12:21.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:12:21.741 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2023-11-28T12:12:21.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:12:21.793 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link delete ceph-brx 2023-11-28T12:12:21.870 INFO:teuthology.orchestra.run.smithi045.stderr:Cannot find device "ceph-brx" 2023-11-28T12:12:22.089 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T12:12:22.090 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:12:22.090 DEBUG:teuthology.orchestra.run.smithi152:> ip netns list 2023-11-28T12:12:22.141 INFO:teuthology.orchestra.run.smithi152.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-28T12:12:22.142 INFO:teuthology.orchestra.run.smithi152.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-11-28T12:12:22.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:12:22.143 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-28T12:12:22.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:12:22.219 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-28T12:12:22.292 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:12:22.292 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link delete ceph-brx 2023-11-28T12:12:22.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:12:22.412 DEBUG:teuthology.orchestra.run.smithi152:> ip netns list 2023-11-28T12:12:22.462 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T12:12:22.463 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link delete ceph-brx 2023-11-28T12:12:22.539 INFO:teuthology.orchestra.run.smithi152.stderr:Cannot find device "ceph-brx" 2023-11-28T12:12:22.542 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T12:12:22.542 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-11-28T12:12:22.575 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-28T12:12:22.576 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T12:12:22.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:22.786+0000 7f30383ff700 1 Processor -- start 2023-11-28T12:12:22.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:22.786+0000 7f30383ff700 1 -- start start 2023-11-28T12:12:22.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:22.787+0000 7f30383ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3030070c50 0x7f30300b0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:22.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:22.787+0000 7f30383ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f30300b0bb0 0x7f303015add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:22.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:22.787+0000 7f30383ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f303015e1a0 con 0x7f3030158200 2023-11-28T12:12:22.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:22.787+0000 7f30383ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f303015f070 con 0x7f3030070c50 2023-11-28T12:12:22.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:22.787+0000 7f30383ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30300b0fd0 con 0x7f30300b0bb0 2023-11-28T12:12:22.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:22.787+0000 7f303619b700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f3030158200 0x7f30300caa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:43996/0 (socket says 172.21.15.45:43996) 2023-11-28T12:12:22.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:22.787+0000 7f303619b700 1 -- 172.21.15.45:0/2526793624 learned_addr learned my addr 172.21.15.45:0/2526793624 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:12:22.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:22.787+0000 7f303599a700 1 --2- 172.21.15.45:0/2526793624 >> v2:172.21.15.45:3300/0 conn(0x7f3030070c50 0x7f30300b0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:22.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:22.788+0000 7f303699c700 1 --2- 172.21.15.45:0/2526793624 >> v2:172.21.15.152:3300/0 conn(0x7f30300b0bb0 0x7f303015add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:22.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:22.788+0000 7f3035199700 1 -- 172.21.15.45:0/2526793624 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2638547321 0 0) 0x7f303015e1a0 con 0x7f3030158200 2023-11-28T12:12:22.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:22.788+0000 7f3035199700 1 -- 172.21.15.45:0/2526793624 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f301c0035b0 con 0x7f3030158200 2023-11-28T12:12:22.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:22.788+0000 7f303599a700 1 -- 172.21.15.45:0/2526793624 >> v2:172.21.15.152:3300/0 conn(0x7f30300b0bb0 msgr2=0x7f303015add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:12:22.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:22.788+0000 7f303599a700 1 --2- 172.21.15.45:0/2526793624 >> v2:172.21.15.152:3300/0 conn(0x7f30300b0bb0 0x7f303015add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:22.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:22.788+0000 7f303599a700 1 -- 172.21.15.45:0/2526793624 >> v1:172.21.15.45:6789/0 conn(0x7f3030158200 legacy=0x7f30300caa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:22.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:22.788+0000 7f303599a700 1 -- 172.21.15.45:0/2526793624 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30300cb180 con 0x7f3030070c50 2023-11-28T12:12:22.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:22.788+0000 7f303599a700 1 --2- 172.21.15.45:0/2526793624 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3030070c50 0x7f30300b0670 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f303015ef70 tx=0x7f3020009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b4e6c6bc62861f2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:22.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:22.789+0000 7f3035199700 1 -- 172.21.15.45:0/2526793624 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3020011830 con 0x7f3030070c50 2023-11-28T12:12:22.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:22.789+0000 7f3035199700 1 -- 172.21.15.45:0/2526793624 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3020011990 con 0x7f3030070c50 2023-11-28T12:12:22.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:22.789+0000 7f3035199700 1 -- 172.21.15.45:0/2526793624 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3020011d20 con 0x7f3030070c50 2023-11-28T12:12:22.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:22.789+0000 7f30383ff700 1 -- 172.21.15.45:0/2526793624 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3030070c50 msgr2=0x7f30300b0670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:22.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:22.789+0000 7f30383ff700 1 --2- 172.21.15.45:0/2526793624 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3030070c50 0x7f30300b0670 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f303015ef70 tx=0x7f3020009b20 comp rx=0 tx=0).stop 2023-11-28T12:12:22.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:22.789+0000 7f30383ff700 1 -- 172.21.15.45:0/2526793624 shutdown_connections 2023-11-28T12:12:22.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:22.789+0000 7f30383ff700 1 --2- 172.21.15.45:0/2526793624 >> v2:172.21.15.152:3300/0 conn(0x7f30300b0bb0 0x7f303015add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:22.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:22.789+0000 7f30383ff700 1 --2- 172.21.15.45:0/2526793624 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3030070c50 0x7f30300b0670 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:22.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:22.789+0000 7f30383ff700 1 -- 172.21.15.45:0/2526793624 >> 172.21.15.45:0/2526793624 conn(0x7f30300cb670 msgr2=0x7f30300cba70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:22.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:22.789+0000 7f30383ff700 1 -- 172.21.15.45:0/2526793624 shutdown_connections 2023-11-28T12:12:22.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:22.789+0000 7f30383ff700 1 -- 172.21.15.45:0/2526793624 wait complete. 2023-11-28T12:12:22.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:22.791+0000 7f30383ff700 1 Processor -- start 2023-11-28T12:12:22.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:22.791+0000 7f30383ff700 1 -- start start 2023-11-28T12:12:22.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:22.792+0000 7f30383ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3030070c50 0x7f3030156f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:22.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:22.792+0000 7f30383ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30300b0bb0 0x7f30301f21e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:22.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:22.792+0000 7f30383ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3030158200 0x7f30300af5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:22.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:22.792+0000 7f30383ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3030157440 con 0x7f30300b0bb0 2023-11-28T12:12:22.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:22.792+0000 7f30383ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30300b1f90 con 0x7f3030158200 2023-11-28T12:12:22.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:22.792+0000 7f30383ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30300b2270 con 0x7f3030070c50 2023-11-28T12:12:22.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:22.792+0000 7f303599a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30300b0bb0 0x7f30301f21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:22.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:22.792+0000 7f303599a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30300b0bb0 0x7f30301f21e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56078/0 (socket says 172.21.15.45:56078) 2023-11-28T12:12:22.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:22.792+0000 7f303599a700 1 -- 172.21.15.45:0/4118731117 learned_addr learned my addr 172.21.15.45:0/4118731117 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:12:22.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:22.793+0000 7f303699c700 1 --2- 172.21.15.45:0/4118731117 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3030158200 0x7f30300af5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:22.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:22.793+0000 7f303619b700 1 --2- 172.21.15.45:0/4118731117 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3030070c50 0x7f3030156f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:22.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:22.793+0000 7f303599a700 1 -- 172.21.15.45:0/4118731117 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3030070c50 msgr2=0x7f3030156f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:22.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:22.793+0000 7f303599a700 1 --2- 172.21.15.45:0/4118731117 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3030070c50 0x7f3030156f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:22.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:22.793+0000 7f303599a700 1 -- 172.21.15.45:0/4118731117 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3030158200 msgr2=0x7f30300af5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:22.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:22.793+0000 7f303599a700 1 --2- 172.21.15.45:0/4118731117 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3030158200 0x7f30300af5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:22.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:22.793+0000 7f303599a700 1 -- 172.21.15.45:0/4118731117 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30200094a0 con 0x7f30300b0bb0 2023-11-28T12:12:22.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:22.793+0000 7f303699c700 1 --2- 172.21.15.45:0/4118731117 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3030158200 0x7f30300af5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:12:22.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:22.793+0000 7f303599a700 1 --2- 172.21.15.45:0/4118731117 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30300b0bb0 0x7f30301f21e0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f3020009b60 tx=0x7f3020004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:22.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:22.793+0000 7f3026ffd700 1 -- 172.21.15.45:0/4118731117 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3020004590 con 0x7f30300b0bb0 2023-11-28T12:12:22.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:22.793+0000 7f3026ffd700 1 -- 172.21.15.45:0/4118731117 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f302001f070 con 0x7f30300b0bb0 2023-11-28T12:12:22.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:22.793+0000 7f3026ffd700 1 -- 172.21.15.45:0/4118731117 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30200038e0 con 0x7f30300b0bb0 2023-11-28T12:12:22.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:22.793+0000 7f30383ff700 1 -- 172.21.15.45:0/4118731117 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30301585d0 con 0x7f30300b0bb0 2023-11-28T12:12:22.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:22.794+0000 7f30383ff700 1 -- 172.21.15.45:0/4118731117 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30300710f0 con 0x7f30300b0bb0 2023-11-28T12:12:22.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:22.794+0000 7f30383ff700 1 -- 172.21.15.45:0/4118731117 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f303015e3f0 con 0x7f30300b0bb0 2023-11-28T12:12:22.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:22.795+0000 7f3026ffd700 1 -- 172.21.15.45:0/4118731117 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f302000f050 con 0x7f30300b0bb0 2023-11-28T12:12:22.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:22.796+0000 7f3026ffd700 1 --2- 172.21.15.45:0/4118731117 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f30140682f0 0x7f301406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:22.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:22.796+0000 7f3026ffd700 1 -- 172.21.15.45:0/4118731117 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f3020021070 con 0x7f30300b0bb0 2023-11-28T12:12:22.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:22.797+0000 7f303619b700 1 --2- 172.21.15.45:0/4118731117 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f30140682f0 0x7f301406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:22.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:22.797+0000 7f303619b700 1 --2- 172.21.15.45:0/4118731117 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f30140682f0 0x7f301406a7a0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f302c007fd0 tx=0x7f302c007dc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:22.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:22.801+0000 7f3026ffd700 1 -- 172.21.15.45:0/4118731117 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f3020053bb0 con 0x7f30300b0bb0 2023-11-28T12:12:23.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:22.999+0000 7f30383ff700 1 -- 172.21.15.45:0/4118731117 --> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f303006fd60 con 0x7f30140682f0 2023-11-28T12:12:23.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.003+0000 7f3026ffd700 1 -- 172.21.15.45:0/4118731117 <== mgr.4100 v2:172.21.15.152:6832/115389 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+72763 (secure 0 0 0) 0x7f303006fd60 con 0x7f30140682f0 2023-11-28T12:12:23.005 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:12:23.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.005+0000 7f30383ff700 1 -- 172.21.15.45:0/4118731117 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f30140682f0 msgr2=0x7f301406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:23.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.005+0000 7f30383ff700 1 --2- 172.21.15.45:0/4118731117 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f30140682f0 0x7f301406a7a0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f302c007fd0 tx=0x7f302c007dc0 comp rx=0 tx=0).stop 2023-11-28T12:12:23.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.005+0000 7f30383ff700 1 -- 172.21.15.45:0/4118731117 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30300b0bb0 msgr2=0x7f30301f21e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:23.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.005+0000 7f30383ff700 1 --2- 172.21.15.45:0/4118731117 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30300b0bb0 0x7f30301f21e0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f3020009b60 tx=0x7f3020004750 comp rx=0 tx=0).stop 2023-11-28T12:12:23.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.005+0000 7f30383ff700 1 -- 172.21.15.45:0/4118731117 shutdown_connections 2023-11-28T12:12:23.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.005+0000 7f30383ff700 1 --2- 172.21.15.45:0/4118731117 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f30140682f0 0x7f301406a7a0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:23.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.005+0000 7f30383ff700 1 --2- 172.21.15.45:0/4118731117 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3030158200 0x7f30300af5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:23.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.005+0000 7f30383ff700 1 --2- 172.21.15.45:0/4118731117 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3030070c50 0x7f3030156f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:23.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.005+0000 7f30383ff700 1 --2- 172.21.15.45:0/4118731117 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30300b0bb0 0x7f30301f21e0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:23.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.005+0000 7f30383ff700 1 -- 172.21.15.45:0/4118731117 >> 172.21.15.45:0/4118731117 conn(0x7f30300cb670 msgr2=0x7f3030071280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:23.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.005+0000 7f30383ff700 1 -- 172.21.15.45:0/4118731117 shutdown_connections 2023-11-28T12:12:23.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.005+0000 7f30383ff700 1 -- 172.21.15.45:0/4118731117 wait complete. 2023-11-28T12:12:23.009 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-11-28T12:12:23.025 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":240,"stamp":"2023-11-28T12:12:22.519273+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":190,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":109168,"kb_used_data":7408,"kb_used_omap":0,"kb_used_meta":101696,"kb_avail":754865552,"statfs":{"total":773094113280,"available":772982325248,"internally_reserved":0,"allocated":7585792,"data_stored":4033316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":104136704},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12572,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-6,"num_read_kb":-5,"num_write":-78,"num_write_kb":-40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-2,"num_bytes_recovered":-90,"num_keys_recovered":0,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.278249"},"pg_stats":[{"pgid":"1.5","version":"0'0","reported_seq":52,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T12:12:19.016795+0000","last_change":"2023-11-28T12:06:23.961595+0000","last_active":"2023-11-28T12:12:19.016795+0000","last_peered":"2023-11-28T12:12:19.016795+0000","last_clean":"2023-11-28T12:12:19.016795+0000","last_became_active":"2023-11-28T12:06:23.961257+0000","last_became_peered":"2023-11-28T12:06:23.961257+0000","last_unstale":"2023-11-28T12:12:19.016795+0000","last_undegraded":"2023-11-28T12:12:19.016795+0000","last_fullsized":"2023-11-28T12:12:19.016795+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:30:40.200095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":54,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T12:12:16.242265+0000","last_change":"2023-11-28T12:06:23.517505+0000","last_active":"2023-11-28T12:12:16.242265+0000","last_peered":"2023-11-28T12:12:16.242265+0000","last_clean":"2023-11-28T12:12:16.242265+0000","last_became_active":"2023-11-28T12:06:23.517151+0000","last_became_peered":"2023-11-28T12:06:23.517151+0000","last_unstale":"2023-11-28T12:12:16.242265+0000","last_undegraded":"2023-11-28T12:12:16.242265+0000","last_fullsized":"2023-11-28T12:12:16.242265+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:30:40.200095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":53,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T12:12:16.243179+0000","last_change":"2023-11-28T12:06:23.517967+0000","last_active":"2023-11-28T12:12:16.243179+0000","last_peered":"2023-11-28T12:12:16.243179+0000","last_clean":"2023-11-28T12:12:16.243179+0000","last_became_active":"2023-11-28T12:06:23.517495+0000","last_became_peered":"2023-11-28T12:06:23.517495+0000","last_unstale":"2023-11-28T12:12:16.243179+0000","last_undegraded":"2023-11-28T12:12:16.243179+0000","last_fullsized":"2023-11-28T12:12:16.243179+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:51:06.844441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":206,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T12:12:19.975656+0000","last_change":"2023-11-28T12:06:23.513472+0000","last_active":"2023-11-28T12:12:19.975656+0000","last_peered":"2023-11-28T12:12:19.975656+0000","last_clean":"2023-11-28T12:12:19.975656+0000","last_became_active":"2023-11-28T12:06:23.513150+0000","last_became_peered":"2023-11-28T12:06:23.513150+0000","last_unstale":"2023-11-28T12:12:19.975656+0000","last_undegraded":"2023-11-28T12:12:19.975656+0000","last_fullsized":"2023-11-28T12:12:19.975656+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:34:18.653049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":56,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T12:12:19.975955+0000","last_change":"2023-11-28T12:06:23.903708+0000","last_active":"2023-11-28T12:12:19.975955+0000","last_peered":"2023-11-28T12:12:19.975955+0000","last_clean":"2023-11-28T12:12:19.975955+0000","last_became_active":"2023-11-28T12:06:23.903399+0000","last_became_peered":"2023-11-28T12:06:23.903399+0000","last_unstale":"2023-11-28T12:12:19.975955+0000","last_undegraded":"2023-11-28T12:12:19.975955+0000","last_fullsized":"2023-11-28T12:12:19.975955+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:31:13.187145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":56,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T12:12:19.975692+0000","last_change":"2023-11-28T12:06:23.903662+0000","last_active":"2023-11-28T12:12:19.975692+0000","last_peered":"2023-11-28T12:12:19.975692+0000","last_clean":"2023-11-28T12:12:19.975692+0000","last_became_active":"2023-11-28T12:06:23.903354+0000","last_became_peered":"2023-11-28T12:06:23.903354+0000","last_unstale":"2023-11-28T12:12:19.975692+0000","last_undegraded":"2023-11-28T12:12:19.975692+0000","last_fullsized":"2023-11-28T12:12:19.975692+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:02:07.694087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":57,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T12:12:19.019578+0000","last_change":"2023-11-28T12:06:23.903797+0000","last_active":"2023-11-28T12:12:19.019578+0000","last_peered":"2023-11-28T12:12:19.019578+0000","last_clean":"2023-11-28T12:12:19.019578+0000","last_became_active":"2023-11-28T12:06:23.903475+0000","last_became_peered":"2023-11-28T12:06:23.903475+0000","last_unstale":"2023-11-28T12:12:19.019578+0000","last_undegraded":"2023-11-28T12:12:19.019578+0000","last_fullsized":"2023-11-28T12:12:19.019578+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:51:06.844441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":62,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T12:12:19.023127+0000","last_change":"2023-11-28T12:06:23.903983+0000","last_active":"2023-11-28T12:12:19.023127+0000","last_peered":"2023-11-28T12:12:19.023127+0000","last_clean":"2023-11-28T12:12:19.023127+0000","last_became_active":"2023-11-28T12:06:23.903511+0000","last_became_peered":"2023-11-28T12:06:23.903511+0000","last_unstale":"2023-11-28T12:12:19.023127+0000","last_undegraded":"2023-11-28T12:12:19.023127+0000","last_fullsized":"2023-11-28T12:12:19.023127+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:31:13.187145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":62,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T12:12:19.024167+0000","last_change":"2023-11-28T12:06:23.517246+0000","last_active":"2023-11-28T12:12:19.024167+0000","last_peered":"2023-11-28T12:12:19.024167+0000","last_clean":"2023-11-28T12:12:19.024167+0000","last_became_active":"2023-11-28T12:06:23.516854+0000","last_became_peered":"2023-11-28T12:06:23.516854+0000","last_unstale":"2023-11-28T12:12:19.024167+0000","last_undegraded":"2023-11-28T12:12:19.024167+0000","last_fullsized":"2023-11-28T12:12:19.024167+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:51:06.844441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574924,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15196,"kb_used_data":1364,"kb_used_omap":0,"kb_used_meta":13824,"kb_avail":94356644,"statfs":{"total":96636764160,"available":96621203456,"internally_reserved":0,"allocated":1396736,"data_stored":948029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14155776},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.68200000000000005,"15min":0.64000000000000001},"min":{"1min":0.42299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.92300000000000004,"5min":1.141,"15min":1.141},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.67700000000000005,"15min":0.69899999999999995},"min":{"1min":0.52000000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.98499999999999999,"5min":2.7469999999999999,"15min":2.7469999999999999},"last":0.57299999999999995}]},{"osd":1,"last update":"Tue Nov 28 12:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.67700000000000005,"15min":0.63100000000000001},"min":{"1min":0.57299999999999995,"5min":0.374,"15min":0.374},"max":{"1min":0.95299999999999996,"5min":1,"15min":1},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.65100000000000002,"15min":0.61399999999999999},"min":{"1min":0.54000000000000004,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.84899999999999998,"5min":1.171,"15min":1.171},"last":0.72499999999999998}]},{"osd":2,"last update":"Tue Nov 28 12:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.71799999999999997,"15min":0.70699999999999996},"min":{"1min":0.50700000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.95499999999999996,"5min":1.819,"15min":1.819},"last":1.0409999999999999},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.76200000000000001,"15min":0.75800000000000001},"min":{"1min":0.58599999999999997,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.91400000000000003,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":1.014}]},{"osd":3,"last update":"Tue Nov 28 12:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.71899999999999997,"15min":0.69199999999999995},"min":{"1min":0.56899999999999995,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.95199999999999996,"5min":0.999,"15min":0.999},"last":0.97599999999999998},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.76800000000000002,"15min":0.73599999999999999},"min":{"1min":0.63100000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.008,"5min":1.103,"15min":1.103},"last":1.077}]},{"osd":4,"last update":"Tue Nov 28 12:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61099999999999999,"15min":0.61599999999999999},"min":{"1min":0.46300000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.746,"5min":0.878,"15min":0.878},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.90000000000000002,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":1.181}]},{"osd":5,"last update":"Tue Nov 28 12:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.63300000000000001,"15min":0.65700000000000003},"min":{"1min":0.45400000000000001,"5min":0.437,"15min":0.437},"max":{"1min":0.78300000000000003,"5min":1.044,"15min":1.044},"last":1.2090000000000001},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.67900000000000005,"15min":0.71499999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.88400000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":1.2689999999999999}]},{"osd":6,"last update":"Tue Nov 28 12:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.63500000000000001,"15min":0.66200000000000003},"min":{"1min":0.48899999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.90500000000000003,"5min":1.012,"15min":1.012},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.72599999999999998,"15min":0.75800000000000001},"min":{"1min":0.53400000000000003,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.86299999999999999,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":1.228}]}]},{"osd":6,"up_from":13,"seq":55834574922,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9624,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":8832,"kb_avail":94362216,"statfs":{"total":96636764160,"available":96626909184,"internally_reserved":0,"allocated":802816,"data_stored":357661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9043968},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:11:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.65200000000000002,"15min":0.60299999999999998},"min":{"1min":0.5,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.95399999999999996,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.65400000000000003,"15min":0.61399999999999999},"min":{"1min":0.55300000000000005,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.88600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.64000000000000001}]},{"osd":1,"last update":"Tue Nov 28 12:11:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.68899999999999995,"15min":0.64800000000000002},"min":{"1min":0.54500000000000004,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.93200000000000005,"5min":1.087,"15min":1.087},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.73399999999999999,"15min":0.71599999999999997},"min":{"1min":0.66900000000000004,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.91900000000000004,"5min":1.034,"15min":1.034},"last":0.65700000000000003}]},{"osd":2,"last update":"Tue Nov 28 12:11:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67400000000000004,"15min":0.64400000000000002},"min":{"1min":0.46300000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.97099999999999997,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.67200000000000004,"15min":0.64900000000000002},"min":{"1min":0.52200000000000002,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.84599999999999997,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.61499999999999999}]},{"osd":3,"last update":"Tue Nov 28 12:11:35 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.746,"15min":0.73199999999999998},"min":{"1min":0.67500000000000004,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.024,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.75600000000000001,"15min":0.72999999999999998},"min":{"1min":0.64200000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.99299999999999999,"5min":1.069,"15min":1.069},"last":0.67500000000000004}]},{"osd":4,"last update":"Tue Nov 28 12:11:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.63900000000000001,"15min":0.66400000000000003},"min":{"1min":0.41399999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.86399999999999999,"5min":1.054,"15min":1.054},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.63,"5min":0.66400000000000003,"15min":0.67500000000000004},"min":{"1min":0.441,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.82099999999999995,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.73099999999999998}]},{"osd":5,"last update":"Tue Nov 28 12:11:35 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.67000000000000004,"15min":0.68999999999999995},"min":{"1min":0.51400000000000001,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.92200000000000004,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.751,"15min":0.76600000000000001},"min":{"1min":0.56499999999999995,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.94599999999999995,"5min":1.111,"15min":1.111},"last":0.75}]},{"osd":7,"last update":"Tue Nov 28 12:11:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.70599999999999996,"15min":0.74099999999999999},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.874,"5min":1.008,"15min":1.008},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.68999999999999995,"15min":0.71799999999999997},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.85199999999999998,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.88500000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574924,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14940,"kb_used_data":1364,"kb_used_omap":0,"kb_used_meta":13568,"kb_avail":94356900,"statfs":{"total":96636764160,"available":96621465600,"internally_reserved":0,"allocated":1396736,"data_stored":948029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13893632},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:11:26 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.42799999999999999,"15min":0.436},"min":{"1min":0.32000000000000001,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.60999999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.48599999999999999,"15min":0.497},"min":{"1min":0.318,"5min":0.309,"15min":0.309},"max":{"1min":0.76100000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.70699999999999996}]},{"osd":2,"last update":"Tue Nov 28 12:11:26 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.46700000000000003,"15min":0.47299999999999998},"min":{"1min":0.34799999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.66200000000000003,"5min":1.111,"15min":1.111},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.5,"15min":0.499},"min":{"1min":0.40100000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.754,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.39800000000000002}]},{"osd":3,"last update":"Tue Nov 28 12:11:26 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.60999999999999999,"15min":0.58699999999999997},"min":{"1min":0.51800000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.80200000000000005,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59399999999999997,"15min":0.56799999999999995},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.77800000000000002,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.82199999999999995}]},{"osd":4,"last update":"Tue Nov 28 12:11:26 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.72399999999999998,"15min":0.70999999999999996},"min":{"1min":0.50900000000000001,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.89100000000000001,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.749,"5min":0.75,"15min":0.753},"min":{"1min":0.57399999999999995,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.89400000000000002,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.59199999999999997}]},{"osd":5,"last update":"Tue Nov 28 12:11:26 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.76000000000000001,"15min":0.75700000000000001},"min":{"1min":0.64200000000000002,"5min":0.496,"15min":0.496},"max":{"1min":0.93799999999999994,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.753},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.56999999999999995,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.97599999999999998,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.623}]},{"osd":6,"last update":"Tue Nov 28 12:11:26 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.77400000000000002,"15min":0.77800000000000002},"min":{"1min":0.53400000000000003,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.96099999999999997,"5min":1.21,"15min":1.21},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.79200000000000004,"15min":0.80300000000000005},"min":{"1min":0.57499999999999996,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.997,"5min":1.502,"15min":1.502},"last":0.78900000000000003}]},{"osd":7,"last update":"Tue Nov 28 12:11:26 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.80500000000000005,"15min":0.80700000000000005},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.97299999999999998,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78900000000000003,"15min":0.78300000000000003},"min":{"1min":0.55500000000000005,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.022,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.58299999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574922,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13844,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":13056,"kb_avail":94357996,"statfs":{"total":96636764160,"available":96622587904,"internally_reserved":0,"allocated":798720,"data_stored":356300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13369344},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 12:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.40000000000000002,"15min":0.38700000000000001},"min":{"1min":0.33400000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.46700000000000003,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.47299999999999998,"15min":0.49399999999999999},"min":{"1min":0.315,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.746,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.48499999999999999}]},{"osd":2,"last update":"Tue Nov 28 12:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.33900000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.61799999999999999,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.51300000000000001,"15min":0.53900000000000003},"min":{"1min":0.38,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.70399999999999996,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.438}]},{"osd":3,"last update":"Tue Nov 28 12:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52000000000000002,"15min":0.52500000000000002},"min":{"1min":0.35799999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.67400000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.58899999999999997,"15min":0.60499999999999998},"min":{"1min":0.501,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.71599999999999997,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.50900000000000001}]},{"osd":4,"last update":"Tue Nov 28 12:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.79300000000000004,"15min":0.79700000000000004},"min":{"1min":0.625,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.069,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.753,"5min":0.78800000000000003,"15min":0.78100000000000003},"min":{"1min":0.57899999999999996,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.0780000000000001,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.79200000000000004}]},{"osd":5,"last update":"Tue Nov 28 12:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.80200000000000005,"15min":0.82599999999999996},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.101,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.81799999999999995,"15min":0.81599999999999995},"min":{"1min":0.60199999999999998,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.016,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.80300000000000005}]},{"osd":6,"last update":"Tue Nov 28 12:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.81000000000000005,"15min":0.81100000000000005},"min":{"1min":0.64000000000000001,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.044,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.81999999999999995,"15min":0.84499999999999997},"min":{"1min":0.56100000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.145,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.63100000000000001}]},{"osd":7,"last update":"Tue Nov 28 12:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.84299999999999997,"15min":0.85899999999999999},"min":{"1min":0.58899999999999997,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.022,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.55900000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.0369999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.74299999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574923,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13720,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":12928,"kb_avail":94358120,"statfs":{"total":96636764160,"available":96622714880,"internally_reserved":0,"allocated":802816,"data_stored":357661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13238272},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:11:28 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.45300000000000001,"15min":0.442},"min":{"1min":0.32800000000000001,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.84599999999999997,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.48599999999999999,"15min":0.46400000000000002},"min":{"1min":0.34399999999999997,"5min":0.317,"15min":0.317},"max":{"1min":0.78200000000000003,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.44400000000000001}]},{"osd":1,"last update":"Tue Nov 28 12:11:28 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.50800000000000001,"15min":0.49299999999999999},"min":{"1min":0.371,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.78800000000000003,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.54400000000000004,"15min":0.52200000000000002},"min":{"1min":0.378,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.876,"5min":1.589,"15min":1.589},"last":0.40100000000000002}]},{"osd":3,"last update":"Tue Nov 28 12:11:28 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.51000000000000001,"15min":0.48999999999999999},"min":{"1min":0.372,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.68899999999999995,"5min":1.762,"15min":1.762},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.56499999999999995,"15min":0.56899999999999995},"min":{"1min":0.44500000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.83999999999999997,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.35399999999999998}]},{"osd":4,"last update":"Tue Nov 28 12:11:28 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.82799999999999996,"15min":0.82999999999999996},"min":{"1min":0.58599999999999997,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0620000000000001,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.83699999999999997,"15min":0.82899999999999996},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.123,"5min":1.534,"15min":1.534},"last":0.84399999999999997}]},{"osd":5,"last update":"Tue Nov 28 12:11:28 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.79800000000000004,"15min":0.76100000000000001},"min":{"1min":0.54200000000000004,"5min":0.497,"15min":0.497},"max":{"1min":1.139,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":0.753},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.79900000000000004,"15min":0.79300000000000004},"min":{"1min":0.66700000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.85499999999999998}]},{"osd":6,"last update":"Tue Nov 28 12:11:28 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.81299999999999994,"15min":0.79600000000000004},"min":{"1min":0.53100000000000003,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.98399999999999999,"5min":1.9219999999999999,"15min":1.9219999999999999},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.87,"5min":0.82899999999999996,"15min":0.80100000000000005},"min":{"1min":0.63400000000000001,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.085,"5min":1.698,"15min":1.698},"last":0.73199999999999998}]},{"osd":7,"last update":"Tue Nov 28 12:11:28 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.82899999999999996,"15min":0.81499999999999995},"min":{"1min":0.64800000000000002,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0569999999999999,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":0.746},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.84399999999999997,"15min":0.83299999999999996},"min":{"1min":0.58199999999999996,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0820000000000001,"5min":1.804,"15min":1.804},"last":0.83499999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574922,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14020,"kb_used_data":764,"kb_used_omap":0,"kb_used_meta":13248,"kb_avail":94357820,"statfs":{"total":96636764160,"available":96622407680,"internally_reserved":0,"allocated":782336,"data_stored":350314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13565952},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.44,"15min":0.441},"min":{"1min":0.29699999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.505,"5min":0.47899999999999998,"15min":0.45800000000000002},"min":{"1min":0.318,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.76800000000000002,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.34699999999999998}]},{"osd":1,"last update":"Tue Nov 28 12:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.45900000000000002,"15min":0.435},"min":{"1min":0.35699999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.83399999999999996,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.53000000000000003,"15min":0.53400000000000003},"min":{"1min":0.432,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.441}]},{"osd":2,"last update":"Tue Nov 28 12:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.54500000000000004,"15min":0.52900000000000003},"min":{"1min":0.41499999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.621,"5min":0.58499999999999996,"15min":0.57699999999999996},"min":{"1min":0.45400000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.83699999999999997,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.50600000000000001}]},{"osd":4,"last update":"Tue Nov 28 12:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.76700000000000002,"15min":0.72299999999999998},"min":{"1min":0.55800000000000005,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.75600000000000001,"15min":0.72599999999999998},"min":{"1min":0.60699999999999998,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.84499999999999997}]},{"osd":5,"last update":"Tue Nov 28 12:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.78500000000000003,"15min":0.76300000000000001},"min":{"1min":0.59199999999999997,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.79600000000000004,"15min":0.78600000000000003},"min":{"1min":0.624,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.0960000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.85999999999999999}]},{"osd":6,"last update":"Tue Nov 28 12:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.79100000000000004,"15min":0.77500000000000002},"min":{"1min":0.54600000000000004,"5min":0.498,"15min":0.498},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.872,"5min":0.81699999999999995,"15min":0.79500000000000004},"min":{"1min":0.65300000000000002,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.94499999999999995}]},{"osd":7,"last update":"Tue Nov 28 12:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.81100000000000005,"15min":0.79800000000000004},"min":{"1min":0.63400000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0349999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.82499999999999996,"15min":0.80600000000000005},"min":{"1min":0.621,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.119,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.878}]}]},{"osd":4,"up_from":13,"seq":55834574922,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13976,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":13184,"kb_avail":94357864,"statfs":{"total":96636764160,"available":96622452736,"internally_reserved":0,"allocated":802816,"data_stored":357661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13500416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.68200000000000005,"15min":0.66000000000000003},"min":{"1min":0.497,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.92900000000000005,"5min":1.044,"15min":1.044},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.68000000000000005,"15min":0.66300000000000003},"min":{"1min":0.55600000000000005,"5min":0.37,"15min":0.37},"max":{"1min":0.88600000000000001,"5min":1.042,"15min":1.042},"last":0.56299999999999994}]},{"osd":1,"last update":"Tue Nov 28 12:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.70099999999999996,"15min":0.67700000000000005},"min":{"1min":0.54600000000000004,"5min":0.433,"15min":0.433},"max":{"1min":0.94599999999999995,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.69299999999999995,"15min":0.68899999999999995},"min":{"1min":0.53900000000000003,"5min":0.441,"15min":0.441},"max":{"1min":0.86099999999999999,"5min":1.097,"15min":1.097},"last":0.78300000000000003}]},{"osd":2,"last update":"Tue Nov 28 12:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.71299999999999997,"15min":0.71699999999999997},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.90100000000000002,"5min":1.125,"15min":1.125},"last":0.501},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73699999999999999,"15min":0.74199999999999999},"min":{"1min":0.58999999999999997,"5min":0.435,"15min":0.435},"max":{"1min":0.81799999999999995,"5min":1.143,"15min":1.143},"last":0.83099999999999996}]},{"osd":3,"last update":"Tue Nov 28 12:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69199999999999995,"15min":0.68500000000000005},"min":{"1min":0.55100000000000005,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.879,"5min":1.093,"15min":1.093},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.749,"15min":0.77300000000000002},"min":{"1min":0.56200000000000006,"5min":0.5,"15min":0.5},"max":{"1min":0.92600000000000005,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.60399999999999998}]},{"osd":5,"last update":"Tue Nov 28 12:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.63400000000000001,"15min":0.69999999999999996},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.85699999999999998,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.64400000000000002,"15min":0.69299999999999995},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.81699999999999995,"5min":1.296,"15min":1.296},"last":0.67000000000000004}]},{"osd":6,"last update":"Tue Nov 28 12:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.68300000000000005,"15min":0.73399999999999999},"min":{"1min":0.44500000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.88500000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.755},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.72499999999999998,"15min":0.79200000000000004},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.91400000000000003,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.875}]},{"osd":7,"last update":"Tue Nov 28 12:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.71899999999999997,"15min":0.77600000000000002},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.93000000000000005,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.625},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.76200000000000001,"15min":0.82999999999999996},"min":{"1min":0.55300000000000005,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.94299999999999995,"5min":1.28,"15min":1.28},"last":0.72199999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574923,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13848,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":13056,"kb_avail":94357992,"statfs":{"total":96636764160,"available":96622583808,"internally_reserved":0,"allocated":802816,"data_stored":357661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13369344},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:11:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.68700000000000006,"15min":0.65900000000000003},"min":{"1min":0.45000000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.0009999999999999,"5min":1.204,"15min":1.204},"last":0.628},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.73399999999999999,"15min":0.70499999999999996},"min":{"1min":0.56599999999999995,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.016,"5min":1.048,"15min":1.048},"last":0.60999999999999999}]},{"osd":1,"last update":"Tue Nov 28 12:11:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.66900000000000004,"15min":0.60999999999999999},"min":{"1min":0.44400000000000001,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.94799999999999995,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.66400000000000003,"15min":0.62},"min":{"1min":0.47299999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.88200000000000001,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.69799999999999995}]},{"osd":2,"last update":"Tue Nov 28 12:11:32 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.68999999999999995,"15min":0.68600000000000005},"min":{"1min":0.60599999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.83899999999999997,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.70199999999999996,"15min":0.69599999999999995},"min":{"1min":0.48899999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.93300000000000005,"5min":1.298,"15min":1.298},"last":0.67800000000000005}]},{"osd":3,"last update":"Tue Nov 28 12:11:32 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.72499999999999998,"15min":0.70099999999999996},"min":{"1min":0.55700000000000005,"5min":0.438,"15min":0.438},"max":{"1min":0.91200000000000003,"5min":1.093,"15min":1.093},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.75900000000000001,"15min":0.752},"min":{"1min":0.59199999999999997,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.91100000000000003,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.73399999999999999}]},{"osd":4,"last update":"Tue Nov 28 12:11:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.625,"15min":0.68300000000000005},"min":{"1min":0.40600000000000003,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.879,"5min":1.141,"15min":1.141},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.74299999999999999,"15min":0.76100000000000001},"min":{"1min":0.55900000000000005,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.92900000000000005,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.72099999999999997}]},{"osd":6,"last update":"Tue Nov 28 12:11:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67800000000000005,"15min":0.73599999999999999},"min":{"1min":0.45900000000000002,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.0009999999999999,"5min":1.264,"15min":1.264},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.67200000000000004,"15min":0.70999999999999996},"min":{"1min":0.46400000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.80500000000000005}]},{"osd":7,"last update":"Tue Nov 28 12:11:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.68400000000000005,"15min":0.73599999999999999},"min":{"1min":0.49299999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.90500000000000003,"5min":1.173,"15min":1.173},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.71699999999999997,"15min":0.76700000000000002},"min":{"1min":0.496,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.97499999999999998,"5min":1.008,"15min":1.008},"last":0.874}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T12:12:23.027 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T12:12:23.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.230+0000 7fb4611ff700 1 Processor -- start 2023-11-28T12:12:23.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.230+0000 7fb4611ff700 1 -- start start 2023-11-28T12:12:23.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.231+0000 7fb4611ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb45c158200 0x7fb45c070c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:23.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.231+0000 7fb4611ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb45c0b0d80 0x7fb45c15add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:23.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.231+0000 7fb4611ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb45c15e1a0 con 0x7fb45c0caa70 2023-11-28T12:12:23.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.231+0000 7fb4611ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb45c15f070 con 0x7fb45c158200 2023-11-28T12:12:23.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.231+0000 7fb4611ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb45c071190 con 0x7fb45c0b0d80 2023-11-28T12:12:23.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.231+0000 7fb45ad9d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb45c158200 0x7fb45c070c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:23.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.232+0000 7fb45a59c700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fb45c0caa70 0x7fb45c0b0670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44006/0 (socket says 172.21.15.45:44006) 2023-11-28T12:12:23.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.232+0000 7fb45ad9d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb45c158200 0x7fb45c070c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56084/0 (socket says 172.21.15.45:56084) 2023-11-28T12:12:23.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.232+0000 7fb45a59c700 1 -- 172.21.15.45:0/3837534843 learned_addr learned my addr 172.21.15.45:0/3837534843 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:12:23.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.232+0000 7fb45b59e700 1 --2- 172.21.15.45:0/3837534843 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb45c0b0d80 0x7fb45c15add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:23.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.232+0000 7fb45ad9d700 1 -- 172.21.15.45:0/3837534843 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb45c0b0d80 msgr2=0x7fb45c15add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:12:23.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.232+0000 7fb45ad9d700 1 --2- 172.21.15.45:0/3837534843 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb45c0b0d80 0x7fb45c15add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:23.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.232+0000 7fb45ad9d700 1 -- 172.21.15.45:0/3837534843 >> v1:172.21.15.45:6789/0 conn(0x7fb45c0caa70 legacy=0x7fb45c0b0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:23.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.232+0000 7fb45ad9d700 1 -- 172.21.15.45:0/3837534843 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb45c1585d0 con 0x7fb45c158200 2023-11-28T12:12:23.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.232+0000 7fb459d9b700 1 -- 172.21.15.45:0/3837534843 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3124736897 0 0) 0x7fb45c15e1a0 con 0x7fb45c0caa70 2023-11-28T12:12:23.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.232+0000 7fb45ad9d700 1 --2- 172.21.15.45:0/3837534843 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb45c158200 0x7fb45c070c50 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fb44c009840 tx=0x7fb44c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfa63d3e37682577 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:23.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.233+0000 7fb459d9b700 1 -- 172.21.15.45:0/3837534843 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44c011830 con 0x7fb45c158200 2023-11-28T12:12:23.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.233+0000 7fb459d9b700 1 -- 172.21.15.45:0/3837534843 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb44c011990 con 0x7fb45c158200 2023-11-28T12:12:23.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.233+0000 7fb459d9b700 1 -- 172.21.15.45:0/3837534843 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44c011d20 con 0x7fb45c158200 2023-11-28T12:12:23.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.233+0000 7fb4611ff700 1 -- 172.21.15.45:0/3837534843 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb45c158200 msgr2=0x7fb45c070c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:23.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.233+0000 7fb4611ff700 1 --2- 172.21.15.45:0/3837534843 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb45c158200 0x7fb45c070c50 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fb44c009840 tx=0x7fb44c009b50 comp rx=0 tx=0).stop 2023-11-28T12:12:23.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.233+0000 7fb4611ff700 1 -- 172.21.15.45:0/3837534843 shutdown_connections 2023-11-28T12:12:23.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.233+0000 7fb4611ff700 1 --2- 172.21.15.45:0/3837534843 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb45c0b0d80 0x7fb45c15add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:23.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.233+0000 7fb4611ff700 1 --2- 172.21.15.45:0/3837534843 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb45c158200 0x7fb45c070c50 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:23.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.233+0000 7fb4611ff700 1 -- 172.21.15.45:0/3837534843 >> 172.21.15.45:0/3837534843 conn(0x7fb45c0cb670 msgr2=0x7fb45c0cba70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:23.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.233+0000 7fb4611ff700 1 -- 172.21.15.45:0/3837534843 shutdown_connections 2023-11-28T12:12:23.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.233+0000 7fb4611ff700 1 -- 172.21.15.45:0/3837534843 wait complete. 2023-11-28T12:12:23.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.235+0000 7fb4611ff700 1 Processor -- start 2023-11-28T12:12:23.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.235+0000 7fb4611ff700 1 -- start start 2023-11-28T12:12:23.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.236+0000 7fb4611ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb45c0b0d80 0x7fb45c1f6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:23.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.236+0000 7fb4611ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb45c0caa70 0x7fb45c0b39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:23.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.236+0000 7fb4611ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb45c158200 0x7fb45c156ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:23.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.236+0000 7fb4611ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb45c1f67c0 con 0x7fb45c0b0d80 2023-11-28T12:12:23.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.236+0000 7fb4611ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb45c0b28d0 con 0x7fb45c0caa70 2023-11-28T12:12:23.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.236+0000 7fb4611ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb45c0b1a20 con 0x7fb45c158200 2023-11-28T12:12:23.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.236+0000 7fb45ad9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb45c0b0d80 0x7fb45c1f6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:23.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.236+0000 7fb45ad9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb45c0b0d80 0x7fb45c1f6280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56100/0 (socket says 172.21.15.45:56100) 2023-11-28T12:12:23.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.236+0000 7fb45ad9d700 1 -- 172.21.15.45:0/3536870334 learned_addr learned my addr 172.21.15.45:0/3536870334 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:12:23.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.237+0000 7fb45a59c700 1 --2- 172.21.15.45:0/3536870334 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb45c0caa70 0x7fb45c0b39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:23.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.237+0000 7fb45b59e700 1 --2- 172.21.15.45:0/3536870334 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb45c158200 0x7fb45c156ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:23.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.237+0000 7fb45ad9d700 1 -- 172.21.15.45:0/3536870334 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb45c158200 msgr2=0x7fb45c156ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:23.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.237+0000 7fb45ad9d700 1 --2- 172.21.15.45:0/3536870334 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb45c158200 0x7fb45c156ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:23.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.237+0000 7fb45ad9d700 1 -- 172.21.15.45:0/3536870334 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb45c0caa70 msgr2=0x7fb45c0b39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:23.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.237+0000 7fb45ad9d700 1 --2- 172.21.15.45:0/3536870334 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb45c0caa70 0x7fb45c0b39e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:23.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.237+0000 7fb45ad9d700 1 -- 172.21.15.45:0/3536870334 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb44c0094a0 con 0x7fb45c0b0d80 2023-11-28T12:12:23.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.237+0000 7fb45ad9d700 1 --2- 172.21.15.45:0/3536870334 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb45c0b0d80 0x7fb45c1f6280 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fb44c009b90 tx=0x7fb44c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:23.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.237+0000 7fb4437fe700 1 -- 172.21.15.45:0/3536870334 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44c0038a0 con 0x7fb45c0b0d80 2023-11-28T12:12:23.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.237+0000 7fb4437fe700 1 -- 172.21.15.45:0/3536870334 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb44c01e070 con 0x7fb45c0b0d80 2023-11-28T12:12:23.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.237+0000 7fb4611ff700 1 -- 172.21.15.45:0/3536870334 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb45c15e6d0 con 0x7fb45c0b0d80 2023-11-28T12:12:23.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.238+0000 7fb4437fe700 1 -- 172.21.15.45:0/3536870334 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44c003c40 con 0x7fb45c0b0d80 2023-11-28T12:12:23.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.238+0000 7fb4611ff700 1 -- 172.21.15.45:0/3536870334 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb45c15e3f0 con 0x7fb45c0b0d80 2023-11-28T12:12:23.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.239+0000 7fb4611ff700 1 -- 172.21.15.45:0/3536870334 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb45c15e9b0 con 0x7fb45c0b0d80 2023-11-28T12:12:23.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.240+0000 7fb4437fe700 1 -- 172.21.15.45:0/3536870334 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fb44c00f050 con 0x7fb45c0b0d80 2023-11-28T12:12:23.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.240+0000 7fb4437fe700 1 --2- 172.21.15.45:0/3536870334 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb4480682f0 0x7fb44806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:23.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.240+0000 7fb4437fe700 1 -- 172.21.15.45:0/3536870334 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fb44c086a80 con 0x7fb45c0b0d80 2023-11-28T12:12:23.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.241+0000 7fb45a59c700 1 --2- 172.21.15.45:0/3536870334 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb4480682f0 0x7fb44806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:23.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.242+0000 7fb45a59c700 1 --2- 172.21.15.45:0/3536870334 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb4480682f0 0x7fb44806a7a0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fb45c15cfc0 tx=0x7fb450007be0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:23.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.245+0000 7fb4437fe700 1 -- 172.21.15.45:0/3536870334 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fb44c053510 con 0x7fb45c0b0d80 2023-11-28T12:12:23.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.442+0000 7fb4611ff700 1 -- 172.21.15.45:0/3536870334 --> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb45c06fd60 con 0x7fb4480682f0 2023-11-28T12:12:23.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.446+0000 7fb4437fe700 1 -- 172.21.15.45:0/3536870334 <== mgr.4100 v2:172.21.15.152:6832/115389 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+72763 (secure 0 0 0) 0x7fb45c06fd60 con 0x7fb4480682f0 2023-11-28T12:12:23.448 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:12:23.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.448+0000 7fb4611ff700 1 -- 172.21.15.45:0/3536870334 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb4480682f0 msgr2=0x7fb44806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:23.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.448+0000 7fb4611ff700 1 --2- 172.21.15.45:0/3536870334 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb4480682f0 0x7fb44806a7a0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fb45c15cfc0 tx=0x7fb450007be0 comp rx=0 tx=0).stop 2023-11-28T12:12:23.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.448+0000 7fb4611ff700 1 -- 172.21.15.45:0/3536870334 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb45c0b0d80 msgr2=0x7fb45c1f6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:23.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.448+0000 7fb4611ff700 1 --2- 172.21.15.45:0/3536870334 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb45c0b0d80 0x7fb45c1f6280 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fb44c009b90 tx=0x7fb44c004750 comp rx=0 tx=0).stop 2023-11-28T12:12:23.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.448+0000 7fb4611ff700 1 -- 172.21.15.45:0/3536870334 shutdown_connections 2023-11-28T12:12:23.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.448+0000 7fb4611ff700 1 --2- 172.21.15.45:0/3536870334 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fb4480682f0 0x7fb44806a7a0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:23.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.448+0000 7fb4611ff700 1 --2- 172.21.15.45:0/3536870334 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fb45c158200 0x7fb45c156ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:23.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.448+0000 7fb4611ff700 1 --2- 172.21.15.45:0/3536870334 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb45c0b0d80 0x7fb45c1f6280 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:23.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.448+0000 7fb4611ff700 1 --2- 172.21.15.45:0/3536870334 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb45c0caa70 0x7fb45c0b39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:23.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.448+0000 7fb4611ff700 1 -- 172.21.15.45:0/3536870334 >> 172.21.15.45:0/3536870334 conn(0x7fb45c0cb670 msgr2=0x7fb45c0712d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:23.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.449+0000 7fb4611ff700 1 -- 172.21.15.45:0/3536870334 shutdown_connections 2023-11-28T12:12:23.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.449+0000 7fb4611ff700 1 -- 172.21.15.45:0/3536870334 wait complete. 2023-11-28T12:12:23.452 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-11-28T12:12:23.468 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":240,"stamp":"2023-11-28T12:12:22.519273+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":190,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":109168,"kb_used_data":7408,"kb_used_omap":0,"kb_used_meta":101696,"kb_avail":754865552,"statfs":{"total":773094113280,"available":772982325248,"internally_reserved":0,"allocated":7585792,"data_stored":4033316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":104136704},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12572,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-6,"num_read_kb":-5,"num_write":-78,"num_write_kb":-40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-2,"num_bytes_recovered":-90,"num_keys_recovered":0,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.278249"},"pg_stats":[{"pgid":"1.5","version":"0'0","reported_seq":52,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T12:12:19.016795+0000","last_change":"2023-11-28T12:06:23.961595+0000","last_active":"2023-11-28T12:12:19.016795+0000","last_peered":"2023-11-28T12:12:19.016795+0000","last_clean":"2023-11-28T12:12:19.016795+0000","last_became_active":"2023-11-28T12:06:23.961257+0000","last_became_peered":"2023-11-28T12:06:23.961257+0000","last_unstale":"2023-11-28T12:12:19.016795+0000","last_undegraded":"2023-11-28T12:12:19.016795+0000","last_fullsized":"2023-11-28T12:12:19.016795+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:30:40.200095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":54,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T12:12:16.242265+0000","last_change":"2023-11-28T12:06:23.517505+0000","last_active":"2023-11-28T12:12:16.242265+0000","last_peered":"2023-11-28T12:12:16.242265+0000","last_clean":"2023-11-28T12:12:16.242265+0000","last_became_active":"2023-11-28T12:06:23.517151+0000","last_became_peered":"2023-11-28T12:06:23.517151+0000","last_unstale":"2023-11-28T12:12:16.242265+0000","last_undegraded":"2023-11-28T12:12:16.242265+0000","last_fullsized":"2023-11-28T12:12:16.242265+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:30:40.200095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":53,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T12:12:16.243179+0000","last_change":"2023-11-28T12:06:23.517967+0000","last_active":"2023-11-28T12:12:16.243179+0000","last_peered":"2023-11-28T12:12:16.243179+0000","last_clean":"2023-11-28T12:12:16.243179+0000","last_became_active":"2023-11-28T12:06:23.517495+0000","last_became_peered":"2023-11-28T12:06:23.517495+0000","last_unstale":"2023-11-28T12:12:16.243179+0000","last_undegraded":"2023-11-28T12:12:16.243179+0000","last_fullsized":"2023-11-28T12:12:16.243179+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:51:06.844441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":206,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T12:12:19.975656+0000","last_change":"2023-11-28T12:06:23.513472+0000","last_active":"2023-11-28T12:12:19.975656+0000","last_peered":"2023-11-28T12:12:19.975656+0000","last_clean":"2023-11-28T12:12:19.975656+0000","last_became_active":"2023-11-28T12:06:23.513150+0000","last_became_peered":"2023-11-28T12:06:23.513150+0000","last_unstale":"2023-11-28T12:12:19.975656+0000","last_undegraded":"2023-11-28T12:12:19.975656+0000","last_fullsized":"2023-11-28T12:12:19.975656+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:34:18.653049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":56,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T12:12:19.975955+0000","last_change":"2023-11-28T12:06:23.903708+0000","last_active":"2023-11-28T12:12:19.975955+0000","last_peered":"2023-11-28T12:12:19.975955+0000","last_clean":"2023-11-28T12:12:19.975955+0000","last_became_active":"2023-11-28T12:06:23.903399+0000","last_became_peered":"2023-11-28T12:06:23.903399+0000","last_unstale":"2023-11-28T12:12:19.975955+0000","last_undegraded":"2023-11-28T12:12:19.975955+0000","last_fullsized":"2023-11-28T12:12:19.975955+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:31:13.187145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":56,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T12:12:19.975692+0000","last_change":"2023-11-28T12:06:23.903662+0000","last_active":"2023-11-28T12:12:19.975692+0000","last_peered":"2023-11-28T12:12:19.975692+0000","last_clean":"2023-11-28T12:12:19.975692+0000","last_became_active":"2023-11-28T12:06:23.903354+0000","last_became_peered":"2023-11-28T12:06:23.903354+0000","last_unstale":"2023-11-28T12:12:19.975692+0000","last_undegraded":"2023-11-28T12:12:19.975692+0000","last_fullsized":"2023-11-28T12:12:19.975692+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:02:07.694087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":57,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T12:12:19.019578+0000","last_change":"2023-11-28T12:06:23.903797+0000","last_active":"2023-11-28T12:12:19.019578+0000","last_peered":"2023-11-28T12:12:19.019578+0000","last_clean":"2023-11-28T12:12:19.019578+0000","last_became_active":"2023-11-28T12:06:23.903475+0000","last_became_peered":"2023-11-28T12:06:23.903475+0000","last_unstale":"2023-11-28T12:12:19.019578+0000","last_undegraded":"2023-11-28T12:12:19.019578+0000","last_fullsized":"2023-11-28T12:12:19.019578+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:51:06.844441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":62,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T12:12:19.023127+0000","last_change":"2023-11-28T12:06:23.903983+0000","last_active":"2023-11-28T12:12:19.023127+0000","last_peered":"2023-11-28T12:12:19.023127+0000","last_clean":"2023-11-28T12:12:19.023127+0000","last_became_active":"2023-11-28T12:06:23.903511+0000","last_became_peered":"2023-11-28T12:06:23.903511+0000","last_unstale":"2023-11-28T12:12:19.023127+0000","last_undegraded":"2023-11-28T12:12:19.023127+0000","last_fullsized":"2023-11-28T12:12:19.023127+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:31:13.187145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":62,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T12:12:19.024167+0000","last_change":"2023-11-28T12:06:23.517246+0000","last_active":"2023-11-28T12:12:19.024167+0000","last_peered":"2023-11-28T12:12:19.024167+0000","last_clean":"2023-11-28T12:12:19.024167+0000","last_became_active":"2023-11-28T12:06:23.516854+0000","last_became_peered":"2023-11-28T12:06:23.516854+0000","last_unstale":"2023-11-28T12:12:19.024167+0000","last_undegraded":"2023-11-28T12:12:19.024167+0000","last_fullsized":"2023-11-28T12:12:19.024167+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:51:06.844441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574924,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15196,"kb_used_data":1364,"kb_used_omap":0,"kb_used_meta":13824,"kb_avail":94356644,"statfs":{"total":96636764160,"available":96621203456,"internally_reserved":0,"allocated":1396736,"data_stored":948029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14155776},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.68200000000000005,"15min":0.64000000000000001},"min":{"1min":0.42299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.92300000000000004,"5min":1.141,"15min":1.141},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.67700000000000005,"15min":0.69899999999999995},"min":{"1min":0.52000000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.98499999999999999,"5min":2.7469999999999999,"15min":2.7469999999999999},"last":0.57299999999999995}]},{"osd":1,"last update":"Tue Nov 28 12:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.67700000000000005,"15min":0.63100000000000001},"min":{"1min":0.57299999999999995,"5min":0.374,"15min":0.374},"max":{"1min":0.95299999999999996,"5min":1,"15min":1},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.65100000000000002,"15min":0.61399999999999999},"min":{"1min":0.54000000000000004,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.84899999999999998,"5min":1.171,"15min":1.171},"last":0.72499999999999998}]},{"osd":2,"last update":"Tue Nov 28 12:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.71799999999999997,"15min":0.70699999999999996},"min":{"1min":0.50700000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.95499999999999996,"5min":1.819,"15min":1.819},"last":1.0409999999999999},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.76200000000000001,"15min":0.75800000000000001},"min":{"1min":0.58599999999999997,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.91400000000000003,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":1.014}]},{"osd":3,"last update":"Tue Nov 28 12:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.71899999999999997,"15min":0.69199999999999995},"min":{"1min":0.56899999999999995,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.95199999999999996,"5min":0.999,"15min":0.999},"last":0.97599999999999998},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.76800000000000002,"15min":0.73599999999999999},"min":{"1min":0.63100000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.008,"5min":1.103,"15min":1.103},"last":1.077}]},{"osd":4,"last update":"Tue Nov 28 12:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61099999999999999,"15min":0.61599999999999999},"min":{"1min":0.46300000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.746,"5min":0.878,"15min":0.878},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.90000000000000002,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":1.181}]},{"osd":5,"last update":"Tue Nov 28 12:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.63300000000000001,"15min":0.65700000000000003},"min":{"1min":0.45400000000000001,"5min":0.437,"15min":0.437},"max":{"1min":0.78300000000000003,"5min":1.044,"15min":1.044},"last":1.2090000000000001},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.67900000000000005,"15min":0.71499999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.88400000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":1.2689999999999999}]},{"osd":6,"last update":"Tue Nov 28 12:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.63500000000000001,"15min":0.66200000000000003},"min":{"1min":0.48899999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.90500000000000003,"5min":1.012,"15min":1.012},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.72599999999999998,"15min":0.75800000000000001},"min":{"1min":0.53400000000000003,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.86299999999999999,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":1.228}]}]},{"osd":6,"up_from":13,"seq":55834574922,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9624,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":8832,"kb_avail":94362216,"statfs":{"total":96636764160,"available":96626909184,"internally_reserved":0,"allocated":802816,"data_stored":357661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9043968},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:11:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.65200000000000002,"15min":0.60299999999999998},"min":{"1min":0.5,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.95399999999999996,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.65400000000000003,"15min":0.61399999999999999},"min":{"1min":0.55300000000000005,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.88600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.64000000000000001}]},{"osd":1,"last update":"Tue Nov 28 12:11:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.68899999999999995,"15min":0.64800000000000002},"min":{"1min":0.54500000000000004,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.93200000000000005,"5min":1.087,"15min":1.087},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.73399999999999999,"15min":0.71599999999999997},"min":{"1min":0.66900000000000004,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.91900000000000004,"5min":1.034,"15min":1.034},"last":0.65700000000000003}]},{"osd":2,"last update":"Tue Nov 28 12:11:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67400000000000004,"15min":0.64400000000000002},"min":{"1min":0.46300000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.97099999999999997,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.67200000000000004,"15min":0.64900000000000002},"min":{"1min":0.52200000000000002,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.84599999999999997,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.61499999999999999}]},{"osd":3,"last update":"Tue Nov 28 12:11:35 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.746,"15min":0.73199999999999998},"min":{"1min":0.67500000000000004,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.024,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.75600000000000001,"15min":0.72999999999999998},"min":{"1min":0.64200000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.99299999999999999,"5min":1.069,"15min":1.069},"last":0.67500000000000004}]},{"osd":4,"last update":"Tue Nov 28 12:11:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.63900000000000001,"15min":0.66400000000000003},"min":{"1min":0.41399999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.86399999999999999,"5min":1.054,"15min":1.054},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.63,"5min":0.66400000000000003,"15min":0.67500000000000004},"min":{"1min":0.441,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.82099999999999995,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.73099999999999998}]},{"osd":5,"last update":"Tue Nov 28 12:11:35 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.67000000000000004,"15min":0.68999999999999995},"min":{"1min":0.51400000000000001,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.92200000000000004,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.751,"15min":0.76600000000000001},"min":{"1min":0.56499999999999995,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.94599999999999995,"5min":1.111,"15min":1.111},"last":0.75}]},{"osd":7,"last update":"Tue Nov 28 12:11:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.70599999999999996,"15min":0.74099999999999999},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.874,"5min":1.008,"15min":1.008},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.68999999999999995,"15min":0.71799999999999997},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.85199999999999998,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.88500000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574924,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14940,"kb_used_data":1364,"kb_used_omap":0,"kb_used_meta":13568,"kb_avail":94356900,"statfs":{"total":96636764160,"available":96621465600,"internally_reserved":0,"allocated":1396736,"data_stored":948029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13893632},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:11:26 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.42799999999999999,"15min":0.436},"min":{"1min":0.32000000000000001,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.60999999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.48599999999999999,"15min":0.497},"min":{"1min":0.318,"5min":0.309,"15min":0.309},"max":{"1min":0.76100000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.70699999999999996}]},{"osd":2,"last update":"Tue Nov 28 12:11:26 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.46700000000000003,"15min":0.47299999999999998},"min":{"1min":0.34799999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.66200000000000003,"5min":1.111,"15min":1.111},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.5,"15min":0.499},"min":{"1min":0.40100000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.754,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.39800000000000002}]},{"osd":3,"last update":"Tue Nov 28 12:11:26 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.60999999999999999,"15min":0.58699999999999997},"min":{"1min":0.51800000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.80200000000000005,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59399999999999997,"15min":0.56799999999999995},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.77800000000000002,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.82199999999999995}]},{"osd":4,"last update":"Tue Nov 28 12:11:26 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.72399999999999998,"15min":0.70999999999999996},"min":{"1min":0.50900000000000001,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.89100000000000001,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.749,"5min":0.75,"15min":0.753},"min":{"1min":0.57399999999999995,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.89400000000000002,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.59199999999999997}]},{"osd":5,"last update":"Tue Nov 28 12:11:26 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.76000000000000001,"15min":0.75700000000000001},"min":{"1min":0.64200000000000002,"5min":0.496,"15min":0.496},"max":{"1min":0.93799999999999994,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.753},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.56999999999999995,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.97599999999999998,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.623}]},{"osd":6,"last update":"Tue Nov 28 12:11:26 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.77400000000000002,"15min":0.77800000000000002},"min":{"1min":0.53400000000000003,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.96099999999999997,"5min":1.21,"15min":1.21},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.79200000000000004,"15min":0.80300000000000005},"min":{"1min":0.57499999999999996,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.997,"5min":1.502,"15min":1.502},"last":0.78900000000000003}]},{"osd":7,"last update":"Tue Nov 28 12:11:26 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.80500000000000005,"15min":0.80700000000000005},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.97299999999999998,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78900000000000003,"15min":0.78300000000000003},"min":{"1min":0.55500000000000005,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.022,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.58299999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574922,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13844,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":13056,"kb_avail":94357996,"statfs":{"total":96636764160,"available":96622587904,"internally_reserved":0,"allocated":798720,"data_stored":356300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13369344},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 12:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.40000000000000002,"15min":0.38700000000000001},"min":{"1min":0.33400000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.46700000000000003,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.47299999999999998,"15min":0.49399999999999999},"min":{"1min":0.315,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.746,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.48499999999999999}]},{"osd":2,"last update":"Tue Nov 28 12:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.33900000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.61799999999999999,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.51300000000000001,"15min":0.53900000000000003},"min":{"1min":0.38,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.70399999999999996,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.438}]},{"osd":3,"last update":"Tue Nov 28 12:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52000000000000002,"15min":0.52500000000000002},"min":{"1min":0.35799999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.67400000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.58899999999999997,"15min":0.60499999999999998},"min":{"1min":0.501,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.71599999999999997,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.50900000000000001}]},{"osd":4,"last update":"Tue Nov 28 12:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.79300000000000004,"15min":0.79700000000000004},"min":{"1min":0.625,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.069,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.753,"5min":0.78800000000000003,"15min":0.78100000000000003},"min":{"1min":0.57899999999999996,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.0780000000000001,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.79200000000000004}]},{"osd":5,"last update":"Tue Nov 28 12:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.80200000000000005,"15min":0.82599999999999996},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.101,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.81799999999999995,"15min":0.81599999999999995},"min":{"1min":0.60199999999999998,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.016,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.80300000000000005}]},{"osd":6,"last update":"Tue Nov 28 12:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.81000000000000005,"15min":0.81100000000000005},"min":{"1min":0.64000000000000001,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.044,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.81999999999999995,"15min":0.84499999999999997},"min":{"1min":0.56100000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.145,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.63100000000000001}]},{"osd":7,"last update":"Tue Nov 28 12:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.84299999999999997,"15min":0.85899999999999999},"min":{"1min":0.58899999999999997,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.022,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.55900000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.0369999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.74299999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574923,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13720,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":12928,"kb_avail":94358120,"statfs":{"total":96636764160,"available":96622714880,"internally_reserved":0,"allocated":802816,"data_stored":357661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13238272},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:11:28 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.45300000000000001,"15min":0.442},"min":{"1min":0.32800000000000001,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.84599999999999997,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.48599999999999999,"15min":0.46400000000000002},"min":{"1min":0.34399999999999997,"5min":0.317,"15min":0.317},"max":{"1min":0.78200000000000003,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.44400000000000001}]},{"osd":1,"last update":"Tue Nov 28 12:11:28 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.50800000000000001,"15min":0.49299999999999999},"min":{"1min":0.371,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.78800000000000003,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.54400000000000004,"15min":0.52200000000000002},"min":{"1min":0.378,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.876,"5min":1.589,"15min":1.589},"last":0.40100000000000002}]},{"osd":3,"last update":"Tue Nov 28 12:11:28 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.51000000000000001,"15min":0.48999999999999999},"min":{"1min":0.372,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.68899999999999995,"5min":1.762,"15min":1.762},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.56499999999999995,"15min":0.56899999999999995},"min":{"1min":0.44500000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.83999999999999997,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.35399999999999998}]},{"osd":4,"last update":"Tue Nov 28 12:11:28 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.82799999999999996,"15min":0.82999999999999996},"min":{"1min":0.58599999999999997,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0620000000000001,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.83699999999999997,"15min":0.82899999999999996},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.123,"5min":1.534,"15min":1.534},"last":0.84399999999999997}]},{"osd":5,"last update":"Tue Nov 28 12:11:28 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.79800000000000004,"15min":0.76100000000000001},"min":{"1min":0.54200000000000004,"5min":0.497,"15min":0.497},"max":{"1min":1.139,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":0.753},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.79900000000000004,"15min":0.79300000000000004},"min":{"1min":0.66700000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.85499999999999998}]},{"osd":6,"last update":"Tue Nov 28 12:11:28 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.81299999999999994,"15min":0.79600000000000004},"min":{"1min":0.53100000000000003,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.98399999999999999,"5min":1.9219999999999999,"15min":1.9219999999999999},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.87,"5min":0.82899999999999996,"15min":0.80100000000000005},"min":{"1min":0.63400000000000001,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.085,"5min":1.698,"15min":1.698},"last":0.73199999999999998}]},{"osd":7,"last update":"Tue Nov 28 12:11:28 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.82899999999999996,"15min":0.81499999999999995},"min":{"1min":0.64800000000000002,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0569999999999999,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":0.746},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.84399999999999997,"15min":0.83299999999999996},"min":{"1min":0.58199999999999996,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0820000000000001,"5min":1.804,"15min":1.804},"last":0.83499999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574922,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14020,"kb_used_data":764,"kb_used_omap":0,"kb_used_meta":13248,"kb_avail":94357820,"statfs":{"total":96636764160,"available":96622407680,"internally_reserved":0,"allocated":782336,"data_stored":350314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13565952},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.44,"15min":0.441},"min":{"1min":0.29699999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.505,"5min":0.47899999999999998,"15min":0.45800000000000002},"min":{"1min":0.318,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.76800000000000002,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.34699999999999998}]},{"osd":1,"last update":"Tue Nov 28 12:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.45900000000000002,"15min":0.435},"min":{"1min":0.35699999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.83399999999999996,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.53000000000000003,"15min":0.53400000000000003},"min":{"1min":0.432,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.441}]},{"osd":2,"last update":"Tue Nov 28 12:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.54500000000000004,"15min":0.52900000000000003},"min":{"1min":0.41499999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.621,"5min":0.58499999999999996,"15min":0.57699999999999996},"min":{"1min":0.45400000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.83699999999999997,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.50600000000000001}]},{"osd":4,"last update":"Tue Nov 28 12:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.76700000000000002,"15min":0.72299999999999998},"min":{"1min":0.55800000000000005,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.75600000000000001,"15min":0.72599999999999998},"min":{"1min":0.60699999999999998,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.84499999999999997}]},{"osd":5,"last update":"Tue Nov 28 12:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.78500000000000003,"15min":0.76300000000000001},"min":{"1min":0.59199999999999997,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.79600000000000004,"15min":0.78600000000000003},"min":{"1min":0.624,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.0960000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.85999999999999999}]},{"osd":6,"last update":"Tue Nov 28 12:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.79100000000000004,"15min":0.77500000000000002},"min":{"1min":0.54600000000000004,"5min":0.498,"15min":0.498},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.872,"5min":0.81699999999999995,"15min":0.79500000000000004},"min":{"1min":0.65300000000000002,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.94499999999999995}]},{"osd":7,"last update":"Tue Nov 28 12:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.81100000000000005,"15min":0.79800000000000004},"min":{"1min":0.63400000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0349999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.82499999999999996,"15min":0.80600000000000005},"min":{"1min":0.621,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.119,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.878}]}]},{"osd":4,"up_from":13,"seq":55834574922,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13976,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":13184,"kb_avail":94357864,"statfs":{"total":96636764160,"available":96622452736,"internally_reserved":0,"allocated":802816,"data_stored":357661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13500416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.68200000000000005,"15min":0.66000000000000003},"min":{"1min":0.497,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.92900000000000005,"5min":1.044,"15min":1.044},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.68000000000000005,"15min":0.66300000000000003},"min":{"1min":0.55600000000000005,"5min":0.37,"15min":0.37},"max":{"1min":0.88600000000000001,"5min":1.042,"15min":1.042},"last":0.56299999999999994}]},{"osd":1,"last update":"Tue Nov 28 12:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.70099999999999996,"15min":0.67700000000000005},"min":{"1min":0.54600000000000004,"5min":0.433,"15min":0.433},"max":{"1min":0.94599999999999995,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.69299999999999995,"15min":0.68899999999999995},"min":{"1min":0.53900000000000003,"5min":0.441,"15min":0.441},"max":{"1min":0.86099999999999999,"5min":1.097,"15min":1.097},"last":0.78300000000000003}]},{"osd":2,"last update":"Tue Nov 28 12:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.71299999999999997,"15min":0.71699999999999997},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.90100000000000002,"5min":1.125,"15min":1.125},"last":0.501},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73699999999999999,"15min":0.74199999999999999},"min":{"1min":0.58999999999999997,"5min":0.435,"15min":0.435},"max":{"1min":0.81799999999999995,"5min":1.143,"15min":1.143},"last":0.83099999999999996}]},{"osd":3,"last update":"Tue Nov 28 12:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69199999999999995,"15min":0.68500000000000005},"min":{"1min":0.55100000000000005,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.879,"5min":1.093,"15min":1.093},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.749,"15min":0.77300000000000002},"min":{"1min":0.56200000000000006,"5min":0.5,"15min":0.5},"max":{"1min":0.92600000000000005,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.60399999999999998}]},{"osd":5,"last update":"Tue Nov 28 12:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.63400000000000001,"15min":0.69999999999999996},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.85699999999999998,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.64400000000000002,"15min":0.69299999999999995},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.81699999999999995,"5min":1.296,"15min":1.296},"last":0.67000000000000004}]},{"osd":6,"last update":"Tue Nov 28 12:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.68300000000000005,"15min":0.73399999999999999},"min":{"1min":0.44500000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.88500000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.755},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.72499999999999998,"15min":0.79200000000000004},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.91400000000000003,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.875}]},{"osd":7,"last update":"Tue Nov 28 12:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.71899999999999997,"15min":0.77600000000000002},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.93000000000000005,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.625},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.76200000000000001,"15min":0.82999999999999996},"min":{"1min":0.55300000000000005,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.94299999999999995,"5min":1.28,"15min":1.28},"last":0.72199999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574923,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13848,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":13056,"kb_avail":94357992,"statfs":{"total":96636764160,"available":96622583808,"internally_reserved":0,"allocated":802816,"data_stored":357661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13369344},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:11:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.68700000000000006,"15min":0.65900000000000003},"min":{"1min":0.45000000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.0009999999999999,"5min":1.204,"15min":1.204},"last":0.628},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.73399999999999999,"15min":0.70499999999999996},"min":{"1min":0.56599999999999995,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.016,"5min":1.048,"15min":1.048},"last":0.60999999999999999}]},{"osd":1,"last update":"Tue Nov 28 12:11:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.66900000000000004,"15min":0.60999999999999999},"min":{"1min":0.44400000000000001,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.94799999999999995,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.66400000000000003,"15min":0.62},"min":{"1min":0.47299999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.88200000000000001,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.69799999999999995}]},{"osd":2,"last update":"Tue Nov 28 12:11:32 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.68999999999999995,"15min":0.68600000000000005},"min":{"1min":0.60599999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.83899999999999997,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.70199999999999996,"15min":0.69599999999999995},"min":{"1min":0.48899999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.93300000000000005,"5min":1.298,"15min":1.298},"last":0.67800000000000005}]},{"osd":3,"last update":"Tue Nov 28 12:11:32 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.72499999999999998,"15min":0.70099999999999996},"min":{"1min":0.55700000000000005,"5min":0.438,"15min":0.438},"max":{"1min":0.91200000000000003,"5min":1.093,"15min":1.093},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.75900000000000001,"15min":0.752},"min":{"1min":0.59199999999999997,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.91100000000000003,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.73399999999999999}]},{"osd":4,"last update":"Tue Nov 28 12:11:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.625,"15min":0.68300000000000005},"min":{"1min":0.40600000000000003,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.879,"5min":1.141,"15min":1.141},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.74299999999999999,"15min":0.76100000000000001},"min":{"1min":0.55900000000000005,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.92900000000000005,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.72099999999999997}]},{"osd":6,"last update":"Tue Nov 28 12:11:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67800000000000005,"15min":0.73599999999999999},"min":{"1min":0.45900000000000002,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.0009999999999999,"5min":1.264,"15min":1.264},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.67200000000000004,"15min":0.70999999999999996},"min":{"1min":0.46400000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.80500000000000005}]},{"osd":7,"last update":"Tue Nov 28 12:11:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.68400000000000005,"15min":0.73599999999999999},"min":{"1min":0.49299999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.90500000000000003,"5min":1.173,"15min":1.173},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.71699999999999997,"15min":0.76700000000000002},"min":{"1min":0.496,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.97499999999999998,"5min":1.008,"15min":1.008},"last":0.874}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T12:12:23.471 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-28T12:12:23.471 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T12:12:23.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.673+0000 7f5c395ff700 1 Processor -- start 2023-11-28T12:12:23.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.673+0000 7f5c395ff700 1 -- start start 2023-11-28T12:12:23.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.674+0000 7f5c395ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f5c340af3d0 0x7f5c3415cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:23.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.674+0000 7f5c395ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5c3406a270 0x7f5c3406a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:23.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.674+0000 7f5c395ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c3406ab80 con 0x7f5c34071220 2023-11-28T12:12:23.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.674+0000 7f5c395ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c3415d510 con 0x7f5c3406a270 2023-11-28T12:12:23.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.674+0000 7f5c395ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c3415d7f0 con 0x7f5c340af3d0 2023-11-28T12:12:23.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.675+0000 7f5c327fc700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f5c34071220 0x7f5c341609c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44020/0 (socket says 172.21.15.45:44020) 2023-11-28T12:12:23.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.675+0000 7f5c327fc700 1 -- 172.21.15.45:0/2371124723 learned_addr learned my addr 172.21.15.45:0/2371124723 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:12:23.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.675+0000 7f5c337fe700 1 --2- 172.21.15.45:0/2371124723 >> v2:172.21.15.45:3300/0 conn(0x7f5c3406a270 0x7f5c3406a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:23.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.675+0000 7f5c32ffd700 1 --2- 172.21.15.45:0/2371124723 >> v2:172.21.15.152:3300/0 conn(0x7f5c340af3d0 0x7f5c3415cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:23.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.675+0000 7f5c31ffb700 1 -- 172.21.15.45:0/2371124723 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2578919091 0 0) 0x7f5c3406ab80 con 0x7f5c34071220 2023-11-28T12:12:23.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.675+0000 7f5c337fe700 1 -- 172.21.15.45:0/2371124723 >> v2:172.21.15.152:3300/0 conn(0x7f5c340af3d0 msgr2=0x7f5c3415cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:12:23.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.675+0000 7f5c337fe700 1 --2- 172.21.15.45:0/2371124723 >> v2:172.21.15.152:3300/0 conn(0x7f5c340af3d0 0x7f5c3415cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:23.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.675+0000 7f5c337fe700 1 -- 172.21.15.45:0/2371124723 >> v1:172.21.15.45:6789/0 conn(0x7f5c34071220 legacy=0x7f5c341609c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:23.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.675+0000 7f5c337fe700 1 -- 172.21.15.45:0/2371124723 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c3415dad0 con 0x7f5c3406a270 2023-11-28T12:12:23.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.675+0000 7f5c337fe700 1 --2- 172.21.15.45:0/2371124723 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c3406a270 0x7f5c3406a640 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f5c3406b1a0 tx=0x7f5c2c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88ea8e379a986b1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:23.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.676+0000 7f5c31ffb700 1 -- 172.21.15.45:0/2371124723 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c2c00e070 con 0x7f5c3406a270 2023-11-28T12:12:23.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.676+0000 7f5c31ffb700 1 -- 172.21.15.45:0/2371124723 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c2c00bb20 con 0x7f5c3406a270 2023-11-28T12:12:23.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.676+0000 7f5c31ffb700 1 -- 172.21.15.45:0/2371124723 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c2c012430 con 0x7f5c3406a270 2023-11-28T12:12:23.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.676+0000 7f5c395ff700 1 -- 172.21.15.45:0/2371124723 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c3406a270 msgr2=0x7f5c3406a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:23.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.676+0000 7f5c395ff700 1 --2- 172.21.15.45:0/2371124723 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c3406a270 0x7f5c3406a640 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f5c3406b1a0 tx=0x7f5c2c00b330 comp rx=0 tx=0).stop 2023-11-28T12:12:23.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.676+0000 7f5c395ff700 1 -- 172.21.15.45:0/2371124723 shutdown_connections 2023-11-28T12:12:23.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.676+0000 7f5c395ff700 1 --2- 172.21.15.45:0/2371124723 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c3406a270 0x7f5c3406a640 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:23.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.676+0000 7f5c395ff700 1 --2- 172.21.15.45:0/2371124723 >> v2:172.21.15.152:3300/0 conn(0x7f5c340af3d0 0x7f5c3415cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:23.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.676+0000 7f5c395ff700 1 -- 172.21.15.45:0/2371124723 >> 172.21.15.45:0/2371124723 conn(0x7f5c340b1890 msgr2=0x7f5c340b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:23.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.676+0000 7f5c395ff700 1 -- 172.21.15.45:0/2371124723 shutdown_connections 2023-11-28T12:12:23.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.676+0000 7f5c395ff700 1 -- 172.21.15.45:0/2371124723 wait complete. 2023-11-28T12:12:23.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.678+0000 7f5c395ff700 1 Processor -- start 2023-11-28T12:12:23.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.678+0000 7f5c395ff700 1 -- start start 2023-11-28T12:12:23.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.679+0000 7f5c395ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c3406a270 0x7f5c3414d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:23.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.679+0000 7f5c395ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5c34071220 0x7f5c340b35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:23.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.679+0000 7f5c395ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c340af3d0 0x7f5c34159050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:23.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.679+0000 7f5c395ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c340b4bb0 con 0x7f5c3406a270 2023-11-28T12:12:23.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.679+0000 7f5c395ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c3414d8c0 con 0x7f5c340af3d0 2023-11-28T12:12:23.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.679+0000 7f5c395ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c340b3f30 con 0x7f5c34071220 2023-11-28T12:12:23.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.679+0000 7f5c32ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c3406a270 0x7f5c3414d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:23.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.679+0000 7f5c32ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c3406a270 0x7f5c3414d380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56118/0 (socket says 172.21.15.45:56118) 2023-11-28T12:12:23.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.679+0000 7f5c32ffd700 1 -- 172.21.15.45:0/3669081908 learned_addr learned my addr 172.21.15.45:0/3669081908 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:12:23.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.680+0000 7f5c327fc700 1 --2- 172.21.15.45:0/3669081908 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5c34071220 0x7f5c340b35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:23.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.680+0000 7f5c337fe700 1 --2- 172.21.15.45:0/3669081908 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c340af3d0 0x7f5c34159050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:23.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.680+0000 7f5c32ffd700 1 -- 172.21.15.45:0/3669081908 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5c34071220 msgr2=0x7f5c340b35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:23.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.680+0000 7f5c32ffd700 1 --2- 172.21.15.45:0/3669081908 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5c34071220 0x7f5c340b35c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:23.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.680+0000 7f5c32ffd700 1 -- 172.21.15.45:0/3669081908 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c340af3d0 msgr2=0x7f5c34159050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:23.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.680+0000 7f5c32ffd700 1 --2- 172.21.15.45:0/3669081908 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c340af3d0 0x7f5c34159050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:23.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.680+0000 7f5c32ffd700 1 -- 172.21.15.45:0/3669081908 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c2c009a70 con 0x7f5c3406a270 2023-11-28T12:12:23.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.680+0000 7f5c32ffd700 1 --2- 172.21.15.45:0/3669081908 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c3406a270 0x7f5c3414d380 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f5c2400e870 tx=0x7f5c2400ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:23.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.680+0000 7f5c1b7fe700 1 -- 172.21.15.45:0/3669081908 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c24009590 con 0x7f5c3406a270 2023-11-28T12:12:23.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.680+0000 7f5c1b7fe700 1 -- 172.21.15.45:0/3669081908 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c2400ee70 con 0x7f5c3406a270 2023-11-28T12:12:23.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.680+0000 7f5c1b7fe700 1 -- 172.21.15.45:0/3669081908 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c2400ca50 con 0x7f5c3406a270 2023-11-28T12:12:23.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.680+0000 7f5c395ff700 1 -- 172.21.15.45:0/3669081908 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c341610d0 con 0x7f5c3406a270 2023-11-28T12:12:23.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.681+0000 7f5c395ff700 1 -- 172.21.15.45:0/3669081908 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c341604a0 con 0x7f5c3406a270 2023-11-28T12:12:23.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.682+0000 7f5c395ff700 1 -- 172.21.15.45:0/3669081908 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c34161260 con 0x7f5c3406a270 2023-11-28T12:12:23.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.683+0000 7f5c1b7fe700 1 -- 172.21.15.45:0/3669081908 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f5c24019030 con 0x7f5c3406a270 2023-11-28T12:12:23.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.683+0000 7f5c1b7fe700 1 --2- 172.21.15.45:0/3669081908 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5c200682f0 0x7f5c2006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:23.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.683+0000 7f5c1b7fe700 1 -- 172.21.15.45:0/3669081908 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f5c24085790 con 0x7f5c3406a270 2023-11-28T12:12:23.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.684+0000 7f5c327fc700 1 --2- 172.21.15.45:0/3669081908 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5c200682f0 0x7f5c2006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:23.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.685+0000 7f5c327fc700 1 --2- 172.21.15.45:0/3669081908 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5c200682f0 0x7f5c2006a7a0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f5c34157fb0 tx=0x7f5c28007be0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:23.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.687+0000 7f5c1b7fe700 1 -- 172.21.15.45:0/3669081908 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f5c34161260 con 0x7f5c3406a270 2023-11-28T12:12:23.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.884+0000 7f5c395ff700 1 -- 172.21.15.45:0/3669081908 --> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5c34161260 con 0x7f5c200682f0 2023-11-28T12:12:23.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.887+0000 7f5c1b7fe700 1 -- 172.21.15.45:0/3669081908 <== mgr.4100 v2:172.21.15.152:6832/115389 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+72763 (secure 0 0 0) 0x7f5c34161260 con 0x7f5c200682f0 2023-11-28T12:12:23.889 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:12:23.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.889+0000 7f5c395ff700 1 -- 172.21.15.45:0/3669081908 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5c200682f0 msgr2=0x7f5c2006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:23.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.889+0000 7f5c395ff700 1 --2- 172.21.15.45:0/3669081908 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5c200682f0 0x7f5c2006a7a0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f5c34157fb0 tx=0x7f5c28007be0 comp rx=0 tx=0).stop 2023-11-28T12:12:23.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.889+0000 7f5c395ff700 1 -- 172.21.15.45:0/3669081908 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c3406a270 msgr2=0x7f5c3414d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:23.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.889+0000 7f5c395ff700 1 --2- 172.21.15.45:0/3669081908 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c3406a270 0x7f5c3414d380 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f5c2400e870 tx=0x7f5c2400ec30 comp rx=0 tx=0).stop 2023-11-28T12:12:23.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.889+0000 7f5c395ff700 1 -- 172.21.15.45:0/3669081908 shutdown_connections 2023-11-28T12:12:23.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.889+0000 7f5c395ff700 1 --2- 172.21.15.45:0/3669081908 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5c200682f0 0x7f5c2006a7a0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:23.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.889+0000 7f5c395ff700 1 --2- 172.21.15.45:0/3669081908 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5c340af3d0 0x7f5c34159050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:23.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.889+0000 7f5c395ff700 1 --2- 172.21.15.45:0/3669081908 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c3406a270 0x7f5c3414d380 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:23.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.889+0000 7f5c395ff700 1 --2- 172.21.15.45:0/3669081908 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5c34071220 0x7f5c340b35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:23.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.889+0000 7f5c395ff700 1 -- 172.21.15.45:0/3669081908 >> 172.21.15.45:0/3669081908 conn(0x7f5c340b1890 msgr2=0x7f5c3415c260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:23.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.889+0000 7f5c395ff700 1 -- 172.21.15.45:0/3669081908 shutdown_connections 2023-11-28T12:12:23.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:23.890+0000 7f5c395ff700 1 -- 172.21.15.45:0/3669081908 wait complete. 2023-11-28T12:12:23.893 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-11-28T12:12:23.909 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":240,"stamp":"2023-11-28T12:12:22.519273+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":190,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":109168,"kb_used_data":7408,"kb_used_omap":0,"kb_used_meta":101696,"kb_avail":754865552,"statfs":{"total":773094113280,"available":772982325248,"internally_reserved":0,"allocated":7585792,"data_stored":4033316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":104136704},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12572,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-6,"num_read_kb":-5,"num_write":-78,"num_write_kb":-40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-2,"num_bytes_recovered":-90,"num_keys_recovered":0,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.278249"},"pg_stats":[{"pgid":"1.5","version":"0'0","reported_seq":52,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T12:12:19.016795+0000","last_change":"2023-11-28T12:06:23.961595+0000","last_active":"2023-11-28T12:12:19.016795+0000","last_peered":"2023-11-28T12:12:19.016795+0000","last_clean":"2023-11-28T12:12:19.016795+0000","last_became_active":"2023-11-28T12:06:23.961257+0000","last_became_peered":"2023-11-28T12:06:23.961257+0000","last_unstale":"2023-11-28T12:12:19.016795+0000","last_undegraded":"2023-11-28T12:12:19.016795+0000","last_fullsized":"2023-11-28T12:12:19.016795+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:30:40.200095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":54,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T12:12:16.242265+0000","last_change":"2023-11-28T12:06:23.517505+0000","last_active":"2023-11-28T12:12:16.242265+0000","last_peered":"2023-11-28T12:12:16.242265+0000","last_clean":"2023-11-28T12:12:16.242265+0000","last_became_active":"2023-11-28T12:06:23.517151+0000","last_became_peered":"2023-11-28T12:06:23.517151+0000","last_unstale":"2023-11-28T12:12:16.242265+0000","last_undegraded":"2023-11-28T12:12:16.242265+0000","last_fullsized":"2023-11-28T12:12:16.242265+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:30:40.200095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":53,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T12:12:16.243179+0000","last_change":"2023-11-28T12:06:23.517967+0000","last_active":"2023-11-28T12:12:16.243179+0000","last_peered":"2023-11-28T12:12:16.243179+0000","last_clean":"2023-11-28T12:12:16.243179+0000","last_became_active":"2023-11-28T12:06:23.517495+0000","last_became_peered":"2023-11-28T12:06:23.517495+0000","last_unstale":"2023-11-28T12:12:16.243179+0000","last_undegraded":"2023-11-28T12:12:16.243179+0000","last_fullsized":"2023-11-28T12:12:16.243179+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:51:06.844441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":206,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T12:12:19.975656+0000","last_change":"2023-11-28T12:06:23.513472+0000","last_active":"2023-11-28T12:12:19.975656+0000","last_peered":"2023-11-28T12:12:19.975656+0000","last_clean":"2023-11-28T12:12:19.975656+0000","last_became_active":"2023-11-28T12:06:23.513150+0000","last_became_peered":"2023-11-28T12:06:23.513150+0000","last_unstale":"2023-11-28T12:12:19.975656+0000","last_undegraded":"2023-11-28T12:12:19.975656+0000","last_fullsized":"2023-11-28T12:12:19.975656+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:34:18.653049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":56,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T12:12:19.975955+0000","last_change":"2023-11-28T12:06:23.903708+0000","last_active":"2023-11-28T12:12:19.975955+0000","last_peered":"2023-11-28T12:12:19.975955+0000","last_clean":"2023-11-28T12:12:19.975955+0000","last_became_active":"2023-11-28T12:06:23.903399+0000","last_became_peered":"2023-11-28T12:06:23.903399+0000","last_unstale":"2023-11-28T12:12:19.975955+0000","last_undegraded":"2023-11-28T12:12:19.975955+0000","last_fullsized":"2023-11-28T12:12:19.975955+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:31:13.187145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":56,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T12:12:19.975692+0000","last_change":"2023-11-28T12:06:23.903662+0000","last_active":"2023-11-28T12:12:19.975692+0000","last_peered":"2023-11-28T12:12:19.975692+0000","last_clean":"2023-11-28T12:12:19.975692+0000","last_became_active":"2023-11-28T12:06:23.903354+0000","last_became_peered":"2023-11-28T12:06:23.903354+0000","last_unstale":"2023-11-28T12:12:19.975692+0000","last_undegraded":"2023-11-28T12:12:19.975692+0000","last_fullsized":"2023-11-28T12:12:19.975692+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:02:07.694087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":57,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T12:12:19.019578+0000","last_change":"2023-11-28T12:06:23.903797+0000","last_active":"2023-11-28T12:12:19.019578+0000","last_peered":"2023-11-28T12:12:19.019578+0000","last_clean":"2023-11-28T12:12:19.019578+0000","last_became_active":"2023-11-28T12:06:23.903475+0000","last_became_peered":"2023-11-28T12:06:23.903475+0000","last_unstale":"2023-11-28T12:12:19.019578+0000","last_undegraded":"2023-11-28T12:12:19.019578+0000","last_fullsized":"2023-11-28T12:12:19.019578+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:51:06.844441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":62,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T12:12:19.023127+0000","last_change":"2023-11-28T12:06:23.903983+0000","last_active":"2023-11-28T12:12:19.023127+0000","last_peered":"2023-11-28T12:12:19.023127+0000","last_clean":"2023-11-28T12:12:19.023127+0000","last_became_active":"2023-11-28T12:06:23.903511+0000","last_became_peered":"2023-11-28T12:06:23.903511+0000","last_unstale":"2023-11-28T12:12:19.023127+0000","last_undegraded":"2023-11-28T12:12:19.023127+0000","last_fullsized":"2023-11-28T12:12:19.023127+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:31:13.187145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":62,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T12:12:19.024167+0000","last_change":"2023-11-28T12:06:23.517246+0000","last_active":"2023-11-28T12:12:19.024167+0000","last_peered":"2023-11-28T12:12:19.024167+0000","last_clean":"2023-11-28T12:12:19.024167+0000","last_became_active":"2023-11-28T12:06:23.516854+0000","last_became_peered":"2023-11-28T12:06:23.516854+0000","last_unstale":"2023-11-28T12:12:19.024167+0000","last_undegraded":"2023-11-28T12:12:19.024167+0000","last_fullsized":"2023-11-28T12:12:19.024167+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:51:06.844441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574924,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15196,"kb_used_data":1364,"kb_used_omap":0,"kb_used_meta":13824,"kb_avail":94356644,"statfs":{"total":96636764160,"available":96621203456,"internally_reserved":0,"allocated":1396736,"data_stored":948029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14155776},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.68200000000000005,"15min":0.64000000000000001},"min":{"1min":0.42299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.92300000000000004,"5min":1.141,"15min":1.141},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.67700000000000005,"15min":0.69899999999999995},"min":{"1min":0.52000000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.98499999999999999,"5min":2.7469999999999999,"15min":2.7469999999999999},"last":0.57299999999999995}]},{"osd":1,"last update":"Tue Nov 28 12:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.67700000000000005,"15min":0.63100000000000001},"min":{"1min":0.57299999999999995,"5min":0.374,"15min":0.374},"max":{"1min":0.95299999999999996,"5min":1,"15min":1},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.65100000000000002,"15min":0.61399999999999999},"min":{"1min":0.54000000000000004,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.84899999999999998,"5min":1.171,"15min":1.171},"last":0.72499999999999998}]},{"osd":2,"last update":"Tue Nov 28 12:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.71799999999999997,"15min":0.70699999999999996},"min":{"1min":0.50700000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.95499999999999996,"5min":1.819,"15min":1.819},"last":1.0409999999999999},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.76200000000000001,"15min":0.75800000000000001},"min":{"1min":0.58599999999999997,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.91400000000000003,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":1.014}]},{"osd":3,"last update":"Tue Nov 28 12:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.71899999999999997,"15min":0.69199999999999995},"min":{"1min":0.56899999999999995,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.95199999999999996,"5min":0.999,"15min":0.999},"last":0.97599999999999998},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.76800000000000002,"15min":0.73599999999999999},"min":{"1min":0.63100000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.008,"5min":1.103,"15min":1.103},"last":1.077}]},{"osd":4,"last update":"Tue Nov 28 12:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61099999999999999,"15min":0.61599999999999999},"min":{"1min":0.46300000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.746,"5min":0.878,"15min":0.878},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.90000000000000002,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":1.181}]},{"osd":5,"last update":"Tue Nov 28 12:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.63300000000000001,"15min":0.65700000000000003},"min":{"1min":0.45400000000000001,"5min":0.437,"15min":0.437},"max":{"1min":0.78300000000000003,"5min":1.044,"15min":1.044},"last":1.2090000000000001},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.67900000000000005,"15min":0.71499999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.88400000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":1.2689999999999999}]},{"osd":6,"last update":"Tue Nov 28 12:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.63500000000000001,"15min":0.66200000000000003},"min":{"1min":0.48899999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.90500000000000003,"5min":1.012,"15min":1.012},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.72599999999999998,"15min":0.75800000000000001},"min":{"1min":0.53400000000000003,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.86299999999999999,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":1.228}]}]},{"osd":6,"up_from":13,"seq":55834574922,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9624,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":8832,"kb_avail":94362216,"statfs":{"total":96636764160,"available":96626909184,"internally_reserved":0,"allocated":802816,"data_stored":357661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9043968},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:11:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.65200000000000002,"15min":0.60299999999999998},"min":{"1min":0.5,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.95399999999999996,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.65400000000000003,"15min":0.61399999999999999},"min":{"1min":0.55300000000000005,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.88600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.64000000000000001}]},{"osd":1,"last update":"Tue Nov 28 12:11:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.68899999999999995,"15min":0.64800000000000002},"min":{"1min":0.54500000000000004,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.93200000000000005,"5min":1.087,"15min":1.087},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.73399999999999999,"15min":0.71599999999999997},"min":{"1min":0.66900000000000004,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.91900000000000004,"5min":1.034,"15min":1.034},"last":0.65700000000000003}]},{"osd":2,"last update":"Tue Nov 28 12:11:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67400000000000004,"15min":0.64400000000000002},"min":{"1min":0.46300000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.97099999999999997,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.67200000000000004,"15min":0.64900000000000002},"min":{"1min":0.52200000000000002,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.84599999999999997,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.61499999999999999}]},{"osd":3,"last update":"Tue Nov 28 12:11:35 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.746,"15min":0.73199999999999998},"min":{"1min":0.67500000000000004,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.024,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.75600000000000001,"15min":0.72999999999999998},"min":{"1min":0.64200000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.99299999999999999,"5min":1.069,"15min":1.069},"last":0.67500000000000004}]},{"osd":4,"last update":"Tue Nov 28 12:11:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.63900000000000001,"15min":0.66400000000000003},"min":{"1min":0.41399999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.86399999999999999,"5min":1.054,"15min":1.054},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.63,"5min":0.66400000000000003,"15min":0.67500000000000004},"min":{"1min":0.441,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.82099999999999995,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.73099999999999998}]},{"osd":5,"last update":"Tue Nov 28 12:11:35 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.67000000000000004,"15min":0.68999999999999995},"min":{"1min":0.51400000000000001,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.92200000000000004,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.751,"15min":0.76600000000000001},"min":{"1min":0.56499999999999995,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.94599999999999995,"5min":1.111,"15min":1.111},"last":0.75}]},{"osd":7,"last update":"Tue Nov 28 12:11:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.70599999999999996,"15min":0.74099999999999999},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.874,"5min":1.008,"15min":1.008},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.68999999999999995,"15min":0.71799999999999997},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.85199999999999998,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.88500000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574924,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14940,"kb_used_data":1364,"kb_used_omap":0,"kb_used_meta":13568,"kb_avail":94356900,"statfs":{"total":96636764160,"available":96621465600,"internally_reserved":0,"allocated":1396736,"data_stored":948029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13893632},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:11:26 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.42799999999999999,"15min":0.436},"min":{"1min":0.32000000000000001,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.60999999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.48599999999999999,"15min":0.497},"min":{"1min":0.318,"5min":0.309,"15min":0.309},"max":{"1min":0.76100000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.70699999999999996}]},{"osd":2,"last update":"Tue Nov 28 12:11:26 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.46700000000000003,"15min":0.47299999999999998},"min":{"1min":0.34799999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.66200000000000003,"5min":1.111,"15min":1.111},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.5,"15min":0.499},"min":{"1min":0.40100000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.754,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.39800000000000002}]},{"osd":3,"last update":"Tue Nov 28 12:11:26 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.60999999999999999,"15min":0.58699999999999997},"min":{"1min":0.51800000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.80200000000000005,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59399999999999997,"15min":0.56799999999999995},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.77800000000000002,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.82199999999999995}]},{"osd":4,"last update":"Tue Nov 28 12:11:26 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.72399999999999998,"15min":0.70999999999999996},"min":{"1min":0.50900000000000001,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.89100000000000001,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.749,"5min":0.75,"15min":0.753},"min":{"1min":0.57399999999999995,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.89400000000000002,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.59199999999999997}]},{"osd":5,"last update":"Tue Nov 28 12:11:26 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.76000000000000001,"15min":0.75700000000000001},"min":{"1min":0.64200000000000002,"5min":0.496,"15min":0.496},"max":{"1min":0.93799999999999994,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.753},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.56999999999999995,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.97599999999999998,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.623}]},{"osd":6,"last update":"Tue Nov 28 12:11:26 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.77400000000000002,"15min":0.77800000000000002},"min":{"1min":0.53400000000000003,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.96099999999999997,"5min":1.21,"15min":1.21},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.79200000000000004,"15min":0.80300000000000005},"min":{"1min":0.57499999999999996,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.997,"5min":1.502,"15min":1.502},"last":0.78900000000000003}]},{"osd":7,"last update":"Tue Nov 28 12:11:26 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.80500000000000005,"15min":0.80700000000000005},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.97299999999999998,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78900000000000003,"15min":0.78300000000000003},"min":{"1min":0.55500000000000005,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.022,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.58299999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574922,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13844,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":13056,"kb_avail":94357996,"statfs":{"total":96636764160,"available":96622587904,"internally_reserved":0,"allocated":798720,"data_stored":356300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13369344},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 12:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.40000000000000002,"15min":0.38700000000000001},"min":{"1min":0.33400000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.46700000000000003,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.47299999999999998,"15min":0.49399999999999999},"min":{"1min":0.315,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.746,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.48499999999999999}]},{"osd":2,"last update":"Tue Nov 28 12:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.33900000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.61799999999999999,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.51300000000000001,"15min":0.53900000000000003},"min":{"1min":0.38,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.70399999999999996,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.438}]},{"osd":3,"last update":"Tue Nov 28 12:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52000000000000002,"15min":0.52500000000000002},"min":{"1min":0.35799999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.67400000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.58899999999999997,"15min":0.60499999999999998},"min":{"1min":0.501,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.71599999999999997,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.50900000000000001}]},{"osd":4,"last update":"Tue Nov 28 12:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.79300000000000004,"15min":0.79700000000000004},"min":{"1min":0.625,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.069,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.753,"5min":0.78800000000000003,"15min":0.78100000000000003},"min":{"1min":0.57899999999999996,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.0780000000000001,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.79200000000000004}]},{"osd":5,"last update":"Tue Nov 28 12:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.80200000000000005,"15min":0.82599999999999996},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.101,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.81799999999999995,"15min":0.81599999999999995},"min":{"1min":0.60199999999999998,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.016,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.80300000000000005}]},{"osd":6,"last update":"Tue Nov 28 12:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.81000000000000005,"15min":0.81100000000000005},"min":{"1min":0.64000000000000001,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.044,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.81999999999999995,"15min":0.84499999999999997},"min":{"1min":0.56100000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.145,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.63100000000000001}]},{"osd":7,"last update":"Tue Nov 28 12:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.84299999999999997,"15min":0.85899999999999999},"min":{"1min":0.58899999999999997,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.022,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.55900000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.0369999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.74299999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574923,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13720,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":12928,"kb_avail":94358120,"statfs":{"total":96636764160,"available":96622714880,"internally_reserved":0,"allocated":802816,"data_stored":357661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13238272},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:11:28 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.45300000000000001,"15min":0.442},"min":{"1min":0.32800000000000001,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.84599999999999997,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.48599999999999999,"15min":0.46400000000000002},"min":{"1min":0.34399999999999997,"5min":0.317,"15min":0.317},"max":{"1min":0.78200000000000003,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.44400000000000001}]},{"osd":1,"last update":"Tue Nov 28 12:11:28 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.50800000000000001,"15min":0.49299999999999999},"min":{"1min":0.371,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.78800000000000003,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.54400000000000004,"15min":0.52200000000000002},"min":{"1min":0.378,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.876,"5min":1.589,"15min":1.589},"last":0.40100000000000002}]},{"osd":3,"last update":"Tue Nov 28 12:11:28 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.51000000000000001,"15min":0.48999999999999999},"min":{"1min":0.372,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.68899999999999995,"5min":1.762,"15min":1.762},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.56499999999999995,"15min":0.56899999999999995},"min":{"1min":0.44500000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.83999999999999997,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.35399999999999998}]},{"osd":4,"last update":"Tue Nov 28 12:11:28 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.82799999999999996,"15min":0.82999999999999996},"min":{"1min":0.58599999999999997,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0620000000000001,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.83699999999999997,"15min":0.82899999999999996},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.123,"5min":1.534,"15min":1.534},"last":0.84399999999999997}]},{"osd":5,"last update":"Tue Nov 28 12:11:28 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.79800000000000004,"15min":0.76100000000000001},"min":{"1min":0.54200000000000004,"5min":0.497,"15min":0.497},"max":{"1min":1.139,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":0.753},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.79900000000000004,"15min":0.79300000000000004},"min":{"1min":0.66700000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.85499999999999998}]},{"osd":6,"last update":"Tue Nov 28 12:11:28 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.81299999999999994,"15min":0.79600000000000004},"min":{"1min":0.53100000000000003,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.98399999999999999,"5min":1.9219999999999999,"15min":1.9219999999999999},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.87,"5min":0.82899999999999996,"15min":0.80100000000000005},"min":{"1min":0.63400000000000001,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.085,"5min":1.698,"15min":1.698},"last":0.73199999999999998}]},{"osd":7,"last update":"Tue Nov 28 12:11:28 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.82899999999999996,"15min":0.81499999999999995},"min":{"1min":0.64800000000000002,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0569999999999999,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":0.746},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.84399999999999997,"15min":0.83299999999999996},"min":{"1min":0.58199999999999996,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0820000000000001,"5min":1.804,"15min":1.804},"last":0.83499999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574922,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14020,"kb_used_data":764,"kb_used_omap":0,"kb_used_meta":13248,"kb_avail":94357820,"statfs":{"total":96636764160,"available":96622407680,"internally_reserved":0,"allocated":782336,"data_stored":350314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13565952},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.44,"15min":0.441},"min":{"1min":0.29699999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.505,"5min":0.47899999999999998,"15min":0.45800000000000002},"min":{"1min":0.318,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.76800000000000002,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.34699999999999998}]},{"osd":1,"last update":"Tue Nov 28 12:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.45900000000000002,"15min":0.435},"min":{"1min":0.35699999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.83399999999999996,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.53000000000000003,"15min":0.53400000000000003},"min":{"1min":0.432,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.441}]},{"osd":2,"last update":"Tue Nov 28 12:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.54500000000000004,"15min":0.52900000000000003},"min":{"1min":0.41499999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.621,"5min":0.58499999999999996,"15min":0.57699999999999996},"min":{"1min":0.45400000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.83699999999999997,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.50600000000000001}]},{"osd":4,"last update":"Tue Nov 28 12:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.76700000000000002,"15min":0.72299999999999998},"min":{"1min":0.55800000000000005,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.75600000000000001,"15min":0.72599999999999998},"min":{"1min":0.60699999999999998,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.84499999999999997}]},{"osd":5,"last update":"Tue Nov 28 12:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.78500000000000003,"15min":0.76300000000000001},"min":{"1min":0.59199999999999997,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.79600000000000004,"15min":0.78600000000000003},"min":{"1min":0.624,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.0960000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.85999999999999999}]},{"osd":6,"last update":"Tue Nov 28 12:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.79100000000000004,"15min":0.77500000000000002},"min":{"1min":0.54600000000000004,"5min":0.498,"15min":0.498},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.872,"5min":0.81699999999999995,"15min":0.79500000000000004},"min":{"1min":0.65300000000000002,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.94499999999999995}]},{"osd":7,"last update":"Tue Nov 28 12:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.81100000000000005,"15min":0.79800000000000004},"min":{"1min":0.63400000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0349999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.82499999999999996,"15min":0.80600000000000005},"min":{"1min":0.621,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.119,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.878}]}]},{"osd":4,"up_from":13,"seq":55834574922,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13976,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":13184,"kb_avail":94357864,"statfs":{"total":96636764160,"available":96622452736,"internally_reserved":0,"allocated":802816,"data_stored":357661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13500416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.68200000000000005,"15min":0.66000000000000003},"min":{"1min":0.497,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.92900000000000005,"5min":1.044,"15min":1.044},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.68000000000000005,"15min":0.66300000000000003},"min":{"1min":0.55600000000000005,"5min":0.37,"15min":0.37},"max":{"1min":0.88600000000000001,"5min":1.042,"15min":1.042},"last":0.56299999999999994}]},{"osd":1,"last update":"Tue Nov 28 12:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.70099999999999996,"15min":0.67700000000000005},"min":{"1min":0.54600000000000004,"5min":0.433,"15min":0.433},"max":{"1min":0.94599999999999995,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.69299999999999995,"15min":0.68899999999999995},"min":{"1min":0.53900000000000003,"5min":0.441,"15min":0.441},"max":{"1min":0.86099999999999999,"5min":1.097,"15min":1.097},"last":0.78300000000000003}]},{"osd":2,"last update":"Tue Nov 28 12:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.71299999999999997,"15min":0.71699999999999997},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.90100000000000002,"5min":1.125,"15min":1.125},"last":0.501},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73699999999999999,"15min":0.74199999999999999},"min":{"1min":0.58999999999999997,"5min":0.435,"15min":0.435},"max":{"1min":0.81799999999999995,"5min":1.143,"15min":1.143},"last":0.83099999999999996}]},{"osd":3,"last update":"Tue Nov 28 12:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69199999999999995,"15min":0.68500000000000005},"min":{"1min":0.55100000000000005,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.879,"5min":1.093,"15min":1.093},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.749,"15min":0.77300000000000002},"min":{"1min":0.56200000000000006,"5min":0.5,"15min":0.5},"max":{"1min":0.92600000000000005,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.60399999999999998}]},{"osd":5,"last update":"Tue Nov 28 12:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.63400000000000001,"15min":0.69999999999999996},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.85699999999999998,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.64400000000000002,"15min":0.69299999999999995},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.81699999999999995,"5min":1.296,"15min":1.296},"last":0.67000000000000004}]},{"osd":6,"last update":"Tue Nov 28 12:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.68300000000000005,"15min":0.73399999999999999},"min":{"1min":0.44500000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.88500000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.755},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.72499999999999998,"15min":0.79200000000000004},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.91400000000000003,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.875}]},{"osd":7,"last update":"Tue Nov 28 12:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.71899999999999997,"15min":0.77600000000000002},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.93000000000000005,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.625},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.76200000000000001,"15min":0.82999999999999996},"min":{"1min":0.55300000000000005,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.94299999999999995,"5min":1.28,"15min":1.28},"last":0.72199999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574923,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13848,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":13056,"kb_avail":94357992,"statfs":{"total":96636764160,"available":96622583808,"internally_reserved":0,"allocated":802816,"data_stored":357661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13369344},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:11:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.68700000000000006,"15min":0.65900000000000003},"min":{"1min":0.45000000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.0009999999999999,"5min":1.204,"15min":1.204},"last":0.628},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.73399999999999999,"15min":0.70499999999999996},"min":{"1min":0.56599999999999995,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.016,"5min":1.048,"15min":1.048},"last":0.60999999999999999}]},{"osd":1,"last update":"Tue Nov 28 12:11:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.66900000000000004,"15min":0.60999999999999999},"min":{"1min":0.44400000000000001,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.94799999999999995,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.66400000000000003,"15min":0.62},"min":{"1min":0.47299999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.88200000000000001,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.69799999999999995}]},{"osd":2,"last update":"Tue Nov 28 12:11:32 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.68999999999999995,"15min":0.68600000000000005},"min":{"1min":0.60599999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.83899999999999997,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.70199999999999996,"15min":0.69599999999999995},"min":{"1min":0.48899999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.93300000000000005,"5min":1.298,"15min":1.298},"last":0.67800000000000005}]},{"osd":3,"last update":"Tue Nov 28 12:11:32 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.72499999999999998,"15min":0.70099999999999996},"min":{"1min":0.55700000000000005,"5min":0.438,"15min":0.438},"max":{"1min":0.91200000000000003,"5min":1.093,"15min":1.093},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.75900000000000001,"15min":0.752},"min":{"1min":0.59199999999999997,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.91100000000000003,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.73399999999999999}]},{"osd":4,"last update":"Tue Nov 28 12:11:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.625,"15min":0.68300000000000005},"min":{"1min":0.40600000000000003,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.879,"5min":1.141,"15min":1.141},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.74299999999999999,"15min":0.76100000000000001},"min":{"1min":0.55900000000000005,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.92900000000000005,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.72099999999999997}]},{"osd":6,"last update":"Tue Nov 28 12:11:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67800000000000005,"15min":0.73599999999999999},"min":{"1min":0.45900000000000002,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.0009999999999999,"5min":1.264,"15min":1.264},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.67200000000000004,"15min":0.70999999999999996},"min":{"1min":0.46400000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.80500000000000005}]},{"osd":7,"last update":"Tue Nov 28 12:11:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.68400000000000005,"15min":0.73599999999999999},"min":{"1min":0.49299999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.90500000000000003,"5min":1.173,"15min":1.173},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.71699999999999997,"15min":0.76700000000000002},"min":{"1min":0.496,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.97499999999999998,"5min":1.008,"15min":1.008},"last":0.874}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T12:12:23.948 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T12:12:24.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:24.149+0000 7f08d13ff700 1 Processor -- start 2023-11-28T12:12:24.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:24.150+0000 7f08d13ff700 1 -- start start 2023-11-28T12:12:24.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:24.151+0000 7f08d13ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f08cc0cd7c0 0x7f08cc0cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:24.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:24.151+0000 7f08d13ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08cc0d1950 con 0x7f08cc15c9b0 2023-11-28T12:12:24.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:24.151+0000 7f08d13ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08cc0ce140 con 0x7f08cc161340 2023-11-28T12:12:24.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:24.151+0000 7f08d13ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08cc0b5800 con 0x7f08cc0cd7c0 2023-11-28T12:12:24.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:24.151+0000 7f08caffd700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f08cc15c9b0 0x7f08cc0b4bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44028/0 (socket says 172.21.15.45:44028) 2023-11-28T12:12:24.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:24.151+0000 7f08caffd700 1 -- 172.21.15.45:0/2169824689 learned_addr learned my addr 172.21.15.45:0/2169824689 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:12:24.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:24.151+0000 7f08cb7fe700 1 --2- 172.21.15.45:0/2169824689 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f08cc0cd7c0 0x7f08cc0cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:24.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:24.151+0000 7f08ca7fc700 1 -- 172.21.15.45:0/2169824689 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1930292312 0 0) 0x7f08cc0d1950 con 0x7f08cc15c9b0 2023-11-28T12:12:24.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:24.152+0000 7f08ca7fc700 1 -- 172.21.15.45:0/2169824689 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08b80035b0 con 0x7f08cc15c9b0 2023-11-28T12:12:24.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:24.152+0000 7f08ca7fc700 1 -- 172.21.15.45:0/2169824689 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2876915701 0 0) 0x7f08cc0ce140 con 0x7f08cc161340 2023-11-28T12:12:24.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:24.152+0000 7f08ca7fc700 1 -- 172.21.15.45:0/2169824689 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08cc0d1950 con 0x7f08cc161340 2023-11-28T12:12:24.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:24.152+0000 7f08ca7fc700 1 -- 172.21.15.45:0/2169824689 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1358871736 0 0) 0x7f08b80035b0 con 0x7f08cc15c9b0 2023-11-28T12:12:24.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:24.152+0000 7f08ca7fc700 1 -- 172.21.15.45:0/2169824689 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f08cc0cd7c0 msgr2=0x7f08cc0cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:12:24.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:24.152+0000 7f08ca7fc700 1 --2- 172.21.15.45:0/2169824689 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f08cc0cd7c0 0x7f08cc0cdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:24.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:24.152+0000 7f08ca7fc700 1 -- 172.21.15.45:0/2169824689 >> v1:172.21.15.152:6789/0 conn(0x7f08cc161340 legacy=0x7f08cc0d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:24.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:24.152+0000 7f08ca7fc700 1 -- 172.21.15.45:0/2169824689 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08cc0d24f0 con 0x7f08cc15c9b0 2023-11-28T12:12:24.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:24.152+0000 7f08ca7fc700 1 -- 172.21.15.45:0/2169824689 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3460218165 0 0) 0x7f08bc001670 con 0x7f08cc15c9b0 2023-11-28T12:12:24.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:24.152+0000 7f08cb7fe700 1 --2- 172.21.15.45:0/2169824689 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f08cc0cd7c0 0x7f08cc0cdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:12:24.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:24.152+0000 7f08ca7fc700 1 -- 172.21.15.45:0/2169824689 >> v1:172.21.15.45:6789/0 conn(0x7f08cc15c9b0 legacy=0x7f08cc0b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:24.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:24.152+0000 7f08ca7fc700 1 --2- 172.21.15.45:0/2169824689 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08b8003bc0 0x7f08b8003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:24.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:24.152+0000 7f08ca7fc700 1 --2- 172.21.15.45:0/2169824689 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f08b8004850 0x7f08b8004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:24.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:24.152+0000 7f08ca7fc700 1 --2- 172.21.15.45:0/2169824689 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f08cc0cd7c0 0x7f08b8005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:24.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:24.152+0000 7f08ca7fc700 1 -- 172.21.15.45:0/2169824689 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08cc0b5800 con 0x7f08b8003bc0 2023-11-28T12:12:24.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:24.152+0000 7f08ca7fc700 1 -- 172.21.15.45:0/2169824689 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08b800baf0 con 0x7f08b8004850 2023-11-28T12:12:24.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:24.152+0000 7f08ca7fc700 1 -- 172.21.15.45:0/2169824689 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08b800bcb0 con 0x7f08cc0cd7c0 2023-11-28T12:12:24.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:24.152+0000 7f08caffd700 1 --2- 172.21.15.45:0/2169824689 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08b8003bc0 0x7f08b8003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:24.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:24.152+0000 7f08cb7fe700 1 --2- 172.21.15.45:0/2169824689 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f08cc0cd7c0 0x7f08b8005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:24.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:24.152+0000 7f08c3fff700 1 --2- 172.21.15.45:0/2169824689 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f08b8004850 0x7f08b8004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:24.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:24.153+0000 7f08caffd700 1 -- 172.21.15.45:0/2169824689 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f08cc0cd7c0 msgr2=0x7f08b8005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:12:24.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:24.153+0000 7f08caffd700 1 --2- 172.21.15.45:0/2169824689 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f08cc0cd7c0 0x7f08b8005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:24.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:24.153+0000 7f08caffd700 1 -- 172.21.15.45:0/2169824689 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f08b8004850 msgr2=0x7f08b8004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:12:24.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:24.153+0000 7f08caffd700 1 --2- 172.21.15.45:0/2169824689 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f08b8004850 0x7f08b8004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:24.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:24.153+0000 7f08caffd700 1 -- 172.21.15.45:0/2169824689 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08c4009a70 con 0x7f08b8003bc0 2023-11-28T12:12:24.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:24.153+0000 7f08caffd700 1 --2- 172.21.15.45:0/2169824689 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08b8003bc0 0x7f08b8003fb0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f08bc00c210 tx=0x7f08b8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0507e3f87e3fd6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:24.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:24.153+0000 7f08ca7fc700 1 -- 172.21.15.45:0/2169824689 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08bc00cd50 con 0x7f08b8003bc0 2023-11-28T12:12:24.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:24.153+0000 7f08ca7fc700 1 -- 172.21.15.45:0/2169824689 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08bc005960 con 0x7f08b8003bc0 2023-11-28T12:12:24.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:24.153+0000 7f08ca7fc700 1 -- 172.21.15.45:0/2169824689 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08bc005d10 con 0x7f08b8003bc0 2023-11-28T12:12:24.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:24.154+0000 7f08d13ff700 1 -- 172.21.15.45:0/2169824689 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08b8003bc0 msgr2=0x7f08b8003fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:24.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:24.154+0000 7f08d13ff700 1 --2- 172.21.15.45:0/2169824689 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08b8003bc0 0x7f08b8003fb0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f08bc00c210 tx=0x7f08b8005880 comp rx=0 tx=0).stop 2023-11-28T12:12:24.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:24.154+0000 7f08cb7fe700 1 -- 172.21.15.45:0/2169824689 reap_dead start 2023-11-28T12:12:24.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:24.154+0000 7f08d13ff700 1 -- 172.21.15.45:0/2169824689 shutdown_connections 2023-11-28T12:12:24.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:24.154+0000 7f08d13ff700 1 -- 172.21.15.45:0/2169824689 >> 172.21.15.45:0/2169824689 conn(0x7f08cc072600 msgr2=0x7f08cc0cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:24.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:24.154+0000 7f08d13ff700 1 -- 172.21.15.45:0/2169824689 shutdown_connections 2023-11-28T12:12:24.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:24.154+0000 7f08d13ff700 1 -- 172.21.15.45:0/2169824689 wait complete. 2023-11-28T12:12:24.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:24.156+0000 7f08d13ff700 1 Processor -- start 2023-11-28T12:12:24.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:24.156+0000 7f08d13ff700 1 -- start start 2023-11-28T12:12:24.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:24.157+0000 7f08d13ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f08b8003bc0 0x7f08cc15d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:24.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:24.157+0000 7f08d13ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08cc1e7490 0x7f08cc148ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:24.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:24.157+0000 7f08d13ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f08cc1e7900 0x7f08cc149410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:24.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:24.157+0000 7f08d13ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08cc1e8a60 con 0x7f08cc1e7490 2023-11-28T12:12:24.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:24.157+0000 7f08d13ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08cc1e7e50 con 0x7f08b8003bc0 2023-11-28T12:12:24.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:24.157+0000 7f08d13ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08cc1e8130 con 0x7f08cc1e7900 2023-11-28T12:12:24.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:24.157+0000 7f08c3fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08cc1e7490 0x7f08cc148ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:24.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:24.157+0000 7f08c3fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08cc1e7490 0x7f08cc148ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56122/0 (socket says 172.21.15.45:56122) 2023-11-28T12:12:24.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:24.157+0000 7f08c3fff700 1 -- 172.21.15.45:0/4089888920 learned_addr learned my addr 172.21.15.45:0/4089888920 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:12:24.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:24.157+0000 7f08caffd700 1 --2- 172.21.15.45:0/4089888920 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f08b8003bc0 0x7f08cc15d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:24.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:24.157+0000 7f08cb7fe700 1 --2- 172.21.15.45:0/4089888920 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f08cc1e7900 0x7f08cc149410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:24.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:24.157+0000 7f08c3fff700 1 -- 172.21.15.45:0/4089888920 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f08cc1e7900 msgr2=0x7f08cc149410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:24.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:24.157+0000 7f08c3fff700 1 --2- 172.21.15.45:0/4089888920 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f08cc1e7900 0x7f08cc149410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:24.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:24.157+0000 7f08c3fff700 1 -- 172.21.15.45:0/4089888920 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f08b8003bc0 msgr2=0x7f08cc15d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:24.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:24.157+0000 7f08c3fff700 1 --2- 172.21.15.45:0/4089888920 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f08b8003bc0 0x7f08cc15d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:24.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:24.157+0000 7f08c3fff700 1 -- 172.21.15.45:0/4089888920 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08cc0d1300 con 0x7f08cc1e7490 2023-11-28T12:12:24.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:24.158+0000 7f08c3fff700 1 --2- 172.21.15.45:0/4089888920 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08cc1e7490 0x7f08cc148ed0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f08b400f770 tx=0x7f08b400fb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:24.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:24.158+0000 7f08c37fe700 1 -- 172.21.15.45:0/4089888920 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b4005320 con 0x7f08cc1e7490 2023-11-28T12:12:24.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:24.158+0000 7f08c37fe700 1 -- 172.21.15.45:0/4089888920 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08b40054a0 con 0x7f08cc1e7490 2023-11-28T12:12:24.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:24.158+0000 7f08d13ff700 1 -- 172.21.15.45:0/4089888920 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08cc0b5520 con 0x7f08cc1e7490 2023-11-28T12:12:24.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:24.158+0000 7f08c37fe700 1 -- 172.21.15.45:0/4089888920 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b4006aa0 con 0x7f08cc1e7490 2023-11-28T12:12:24.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:24.158+0000 7f08d13ff700 1 -- 172.21.15.45:0/4089888920 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08cc0d15e0 con 0x7f08cc1e7490 2023-11-28T12:12:24.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:24.159+0000 7f08d13ff700 1 -- 172.21.15.45:0/4089888920 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08cc0745c0 con 0x7f08cc1e7490 2023-11-28T12:12:24.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:24.160+0000 7f08c37fe700 1 -- 172.21.15.45:0/4089888920 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f08b401c030 con 0x7f08cc1e7490 2023-11-28T12:12:24.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:24.161+0000 7f08c37fe700 1 --2- 172.21.15.45:0/4089888920 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f08ac0682f0 0x7f08ac06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:24.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:24.161+0000 7f08c37fe700 1 -- 172.21.15.45:0/4089888920 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f08b4085150 con 0x7f08cc1e7490 2023-11-28T12:12:24.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:24.161+0000 7f08caffd700 1 --2- 172.21.15.45:0/4089888920 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f08ac0682f0 0x7f08ac06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:24.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:24.162+0000 7f08caffd700 1 --2- 172.21.15.45:0/4089888920 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f08ac0682f0 0x7f08ac06a7a0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f08bc015040 tx=0x7f08bc007f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:24.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:24.165+0000 7f08c37fe700 1 -- 172.21.15.45:0/4089888920 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f08b4051be0 con 0x7f08cc1e7490 2023-11-28T12:12:24.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:24.367+0000 7f08d13ff700 1 -- 172.21.15.45:0/4089888920 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f08cc0d08a0 con 0x7f08cc1e7490 2023-11-28T12:12:24.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:24.368+0000 7f08c37fe700 1 -- 172.21.15.45:0/4089888920 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) v1 ==== 74+0+14339 (secure 0 0 0) 0x7f08b4055200 con 0x7f08cc1e7490 2023-11-28T12:12:24.370 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:12:24.370 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":66,"fsid":"bd7c37f1-f7c6-4778-b845-52cf2aa6e366","created":"2023-11-28T12:06:09.045075+0000","modified":"2023-11-28T12:12:20.010948+0000","last_up_change":"2023-11-28T12:06:21.282227+0000","last_in_change":"2023-11-28T12:06:12.560924+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-11-28T12:06:21.807108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-11-28T12:06:22.491009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d0cdd8a-87fd-4f2c-91bd-47bdfa661905","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":115843},{"type":"v1","addr":"172.21.15.45:6808","nonce":115843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":115843},{"type":"v1","addr":"172.21.15.45:6811","nonce":115843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":115843},{"type":"v1","addr":"172.21.15.45:6815","nonce":115843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":115843},{"type":"v1","addr":"172.21.15.45:6813","nonce":115843}]},"public_addr":"172.21.15.45:6808/115843","cluster_addr":"172.21.15.45:6811/115843","heartbeat_back_addr":"172.21.15.45:6815/115843","heartbeat_front_addr":"172.21.15.45:6813/115843","state":["exists","up"]},{"osd":1,"uuid":"c5de4ebd-9ec5-40b3-9caa-9b706fab4c76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":115842},{"type":"v1","addr":"172.21.15.45:6801","nonce":115842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":115842},{"type":"v1","addr":"172.21.15.45:6803","nonce":115842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6807","nonce":115842},{"type":"v1","addr":"172.21.15.45:6809","nonce":115842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":115842},{"type":"v1","addr":"172.21.15.45:6805","nonce":115842}]},"public_addr":"172.21.15.45:6801/115842","cluster_addr":"172.21.15.45:6803/115842","heartbeat_back_addr":"172.21.15.45:6809/115842","heartbeat_front_addr":"172.21.15.45:6805/115842","state":["exists","up"]},{"osd":2,"uuid":"9f4b36b2-65d2-40e7-9fe6-a2991afa71c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6817","nonce":115850},{"type":"v1","addr":"172.21.15.45:6819","nonce":115850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6821","nonce":115850},{"type":"v1","addr":"172.21.15.45:6823","nonce":115850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":115850},{"type":"v1","addr":"172.21.15.45:6831","nonce":115850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":115850},{"type":"v1","addr":"172.21.15.45:6828","nonce":115850}]},"public_addr":"172.21.15.45:6819/115850","cluster_addr":"172.21.15.45:6823/115850","heartbeat_back_addr":"172.21.15.45:6831/115850","heartbeat_front_addr":"172.21.15.45:6828/115850","state":["exists","up"]},{"osd":3,"uuid":"6fe7ef05-4e0d-426c-bf94-44b51d4d550b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":115848},{"type":"v1","addr":"172.21.15.45:6818","nonce":115848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":115848},{"type":"v1","addr":"172.21.15.45:6822","nonce":115848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6827","nonce":115848},{"type":"v1","addr":"172.21.15.45:6829","nonce":115848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":115848},{"type":"v1","addr":"172.21.15.45:6825","nonce":115848}]},"public_addr":"172.21.15.45:6818/115848","cluster_addr":"172.21.15.45:6822/115848","heartbeat_back_addr":"172.21.15.45:6829/115848","heartbeat_front_addr":"172.21.15.45:6825/115848","state":["exists","up"]},{"osd":4,"uuid":"fa403c08-d8a1-4a3a-8384-cb465c1a654c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":116092},{"type":"v1","addr":"172.21.15.152:6801","nonce":116092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":116092},{"type":"v1","addr":"172.21.15.152:6803","nonce":116092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":116092},{"type":"v1","addr":"172.21.15.152:6807","nonce":116092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":116092},{"type":"v1","addr":"172.21.15.152:6805","nonce":116092}]},"public_addr":"172.21.15.152:6801/116092","cluster_addr":"172.21.15.152:6803/116092","heartbeat_back_addr":"172.21.15.152:6807/116092","heartbeat_front_addr":"172.21.15.152:6805/116092","state":["exists","up"]},{"osd":5,"uuid":"399fc450-39fa-43a6-bf80-0b8bcb41bd95","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6815","nonce":116093},{"type":"v1","addr":"172.21.15.152:6817","nonce":116093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":116093},{"type":"v1","addr":"172.21.15.152:6819","nonce":116093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":116093},{"type":"v1","addr":"172.21.15.152:6823","nonce":116093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":116093},{"type":"v1","addr":"172.21.15.152:6821","nonce":116093}]},"public_addr":"172.21.15.152:6817/116093","cluster_addr":"172.21.15.152:6819/116093","heartbeat_back_addr":"172.21.15.152:6823/116093","heartbeat_front_addr":"172.21.15.152:6821/116093","state":["exists","up"]},{"osd":6,"uuid":"e59a4017-2d23-4627-836b-e25b2d3ddaaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":116094},{"type":"v1","addr":"172.21.15.152:6809","nonce":116094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":116094},{"type":"v1","addr":"172.21.15.152:6811","nonce":116094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":116094},{"type":"v1","addr":"172.21.15.152:6816","nonce":116094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":116094},{"type":"v1","addr":"172.21.15.152:6813","nonce":116094}]},"public_addr":"172.21.15.152:6809/116094","cluster_addr":"172.21.15.152:6811/116094","heartbeat_back_addr":"172.21.15.152:6816/116094","heartbeat_front_addr":"172.21.15.152:6813/116094","state":["exists","up"]},{"osd":7,"uuid":"8d7f9d4b-bf08-4670-8591-388c0f012a45","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":116097},{"type":"v1","addr":"172.21.15.152:6825","nonce":116097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":116097},{"type":"v1","addr":"172.21.15.152:6827","nonce":116097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":116097},{"type":"v1","addr":"172.21.15.152:6831","nonce":116097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":116097},{"type":"v1","addr":"172.21.15.152:6829","nonce":116097}]},"public_addr":"172.21.15.152:6825/116097","cluster_addr":"172.21.15.152:6827/116097","heartbeat_back_addr":"172.21.15.152:6831/116097","heartbeat_front_addr":"172.21.15.152:6829/116097","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.937710+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.865423+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.159434+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.913090+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.131647+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.966255+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:17.972583+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T12:06:18.177209+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6833/3784258337":"2023-11-29T12:12:16.238092+0000","172.21.15.45:6832/3784258337":"2023-11-29T12:12:16.238092+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T12:12:24.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:24.370+0000 7f08d13ff700 1 -- 172.21.15.45:0/4089888920 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f08ac0682f0 msgr2=0x7f08ac06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:24.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:24.370+0000 7f08d13ff700 1 --2- 172.21.15.45:0/4089888920 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f08ac0682f0 0x7f08ac06a7a0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f08bc015040 tx=0x7f08bc007f90 comp rx=0 tx=0).stop 2023-11-28T12:12:24.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:24.370+0000 7f08d13ff700 1 -- 172.21.15.45:0/4089888920 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08cc1e7490 msgr2=0x7f08cc148ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:24.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:24.370+0000 7f08d13ff700 1 --2- 172.21.15.45:0/4089888920 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08cc1e7490 0x7f08cc148ed0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f08b400f770 tx=0x7f08b400fb30 comp rx=0 tx=0).stop 2023-11-28T12:12:24.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:24.371+0000 7f08d13ff700 1 -- 172.21.15.45:0/4089888920 shutdown_connections 2023-11-28T12:12:24.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:24.371+0000 7f08d13ff700 1 --2- 172.21.15.45:0/4089888920 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f08ac0682f0 0x7f08ac06a7a0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:24.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:24.371+0000 7f08d13ff700 1 --2- 172.21.15.45:0/4089888920 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f08b8003bc0 0x7f08cc15d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:24.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:24.371+0000 7f08d13ff700 1 --2- 172.21.15.45:0/4089888920 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f08cc1e7900 0x7f08cc149410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:24.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:24.371+0000 7f08d13ff700 1 --2- 172.21.15.45:0/4089888920 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08cc1e7490 0x7f08cc148ed0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:24.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:24.371+0000 7f08d13ff700 1 -- 172.21.15.45:0/4089888920 >> 172.21.15.45:0/4089888920 conn(0x7f08cc072600 msgr2=0x7f08cc0b85c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:24.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:24.371+0000 7f08d13ff700 1 -- 172.21.15.45:0/4089888920 shutdown_connections 2023-11-28T12:12:24.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:24.371+0000 7f08d13ff700 1 -- 172.21.15.45:0/4089888920 wait complete. 2023-11-28T12:12:25.392 INFO:tasks.ceph:Scrubbing osd.0 2023-11-28T12:12:25.392 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-11-28T12:12:25.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.611+0000 7efdc01ff700 1 Processor -- start 2023-11-28T12:12:25.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.611+0000 7efdc01ff700 1 -- start start 2023-11-28T12:12:25.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.612+0000 7efdc01ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7efdb815a760 0x7efdb8161200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:25.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.612+0000 7efdc01ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdb815e0a0 con 0x7efdb815dc30 2023-11-28T12:12:25.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.612+0000 7efdc01ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdb8160d70 con 0x7efdb80cded0 2023-11-28T12:12:25.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.612+0000 7efdc01ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdb815ab30 con 0x7efdb815a760 2023-11-28T12:12:25.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.612+0000 7efdbd79a700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7efdb815dc30 0x7efdb80cd7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44042/0 (socket says 172.21.15.45:44042) 2023-11-28T12:12:25.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.612+0000 7efdbd79a700 1 -- 172.21.15.45:0/4164641019 learned_addr learned my addr 172.21.15.45:0/4164641019 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:12:25.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.613+0000 7efdbdf9b700 1 --2- 172.21.15.45:0/4164641019 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7efdb815a760 0x7efdb8161200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:25.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.613+0000 7efdbcf99700 1 -- 172.21.15.45:0/4164641019 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3582007041 0 0) 0x7efdb815e0a0 con 0x7efdb815dc30 2023-11-28T12:12:25.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.613+0000 7efdbcf99700 1 -- 172.21.15.45:0/4164641019 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efda40035b0 con 0x7efdb815dc30 2023-11-28T12:12:25.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.613+0000 7efdbcf99700 1 -- 172.21.15.45:0/4164641019 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3014107473 0 0) 0x7efdb8160d70 con 0x7efdb80cded0 2023-11-28T12:12:25.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.613+0000 7efdbcf99700 1 -- 172.21.15.45:0/4164641019 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efdb815e0a0 con 0x7efdb80cded0 2023-11-28T12:12:25.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.613+0000 7efdbcf99700 1 -- 172.21.15.45:0/4164641019 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1125336452 0 0) 0x7efda40035b0 con 0x7efdb815dc30 2023-11-28T12:12:25.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.613+0000 7efdbdf9b700 1 -- 172.21.15.45:0/4164641019 >> v1:172.21.15.152:6789/0 conn(0x7efdb80cded0 legacy=0x7efdb80d0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:25.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.613+0000 7efdbdf9b700 1 -- 172.21.15.45:0/4164641019 >> v1:172.21.15.45:6789/0 conn(0x7efdb815dc30 legacy=0x7efdb80cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:25.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.613+0000 7efdbdf9b700 1 -- 172.21.15.45:0/4164641019 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdb80b5390 con 0x7efdb815a760 2023-11-28T12:12:25.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.614+0000 7efdbdf9b700 1 --2- 172.21.15.45:0/4164641019 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7efdb815a760 0x7efdb8161200 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7efdb4009870 tx=0x7efdb4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae1ad3e80e33b8d7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:25.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.614+0000 7efdbcf99700 1 -- 172.21.15.45:0/4164641019 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda8001670 con 0x7efdb815a760 2023-11-28T12:12:25.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.614+0000 7efdbcf99700 1 -- 172.21.15.45:0/4164641019 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdb4004030 con 0x7efdb815a760 2023-11-28T12:12:25.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.614+0000 7efdbcf99700 1 -- 172.21.15.45:0/4164641019 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdb40043a0 con 0x7efdb815a760 2023-11-28T12:12:25.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.614+0000 7efdc01ff700 1 -- 172.21.15.45:0/4164641019 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7efdb815a760 msgr2=0x7efdb8161200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:25.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.614+0000 7efdc01ff700 1 --2- 172.21.15.45:0/4164641019 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7efdb815a760 0x7efdb8161200 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7efdb4009870 tx=0x7efdb4009b80 comp rx=0 tx=0).stop 2023-11-28T12:12:25.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.615+0000 7efdc01ff700 1 -- 172.21.15.45:0/4164641019 shutdown_connections 2023-11-28T12:12:25.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.615+0000 7efdc01ff700 1 --2- 172.21.15.45:0/4164641019 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7efdb815a760 0x7efdb8161200 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:25.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.615+0000 7efdc01ff700 1 -- 172.21.15.45:0/4164641019 >> 172.21.15.45:0/4164641019 conn(0x7efdb8072620 msgr2=0x7efdb80cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:25.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.615+0000 7efdc01ff700 1 -- 172.21.15.45:0/4164641019 shutdown_connections 2023-11-28T12:12:25.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.615+0000 7efdc01ff700 1 -- 172.21.15.45:0/4164641019 wait complete. 2023-11-28T12:12:25.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.616+0000 7efdc01ff700 1 Processor -- start 2023-11-28T12:12:25.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.617+0000 7efdc01ff700 1 -- start start 2023-11-28T12:12:25.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.617+0000 7efdc01ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efdb80cded0 0x7efdb8145c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:25.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.617+0000 7efdc01ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efdb815a760 0x7efdb80c6c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:25.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.617+0000 7efdc01ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7efdb815dc30 0x7efdb806a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:25.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.617+0000 7efdc01ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb80c7720 con 0x7efdb80cded0 2023-11-28T12:12:25.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.617+0000 7efdc01ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb80c7a00 con 0x7efdb815a760 2023-11-28T12:12:25.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.617+0000 7efdc01ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdb8145470 con 0x7efdb815dc30 2023-11-28T12:12:25.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.618+0000 7efdbdf9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efdb80cded0 0x7efdb8145c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:25.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.618+0000 7efdbdf9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efdb80cded0 0x7efdb8145c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56128/0 (socket says 172.21.15.45:56128) 2023-11-28T12:12:25.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.618+0000 7efdbdf9b700 1 -- 172.21.15.45:0/2530506637 learned_addr learned my addr 172.21.15.45:0/2530506637 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:12:25.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.618+0000 7efdbd79a700 1 --2- 172.21.15.45:0/2530506637 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efdb815a760 0x7efdb80c6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:25.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.618+0000 7efdbe79c700 1 --2- 172.21.15.45:0/2530506637 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7efdb815dc30 0x7efdb806a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:25.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.618+0000 7efdbdf9b700 1 -- 172.21.15.45:0/2530506637 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7efdb815dc30 msgr2=0x7efdb806a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:25.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.618+0000 7efdbdf9b700 1 --2- 172.21.15.45:0/2530506637 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7efdb815dc30 0x7efdb806a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:25.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.618+0000 7efdbdf9b700 1 -- 172.21.15.45:0/2530506637 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efdb815a760 msgr2=0x7efdb80c6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:25.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.618+0000 7efdbdf9b700 1 --2- 172.21.15.45:0/2530506637 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efdb815a760 0x7efdb80c6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:25.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.618+0000 7efdbdf9b700 1 -- 172.21.15.45:0/2530506637 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdb40094a0 con 0x7efdb80cded0 2023-11-28T12:12:25.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.618+0000 7efdbe79c700 1 --2- 172.21.15.45:0/2530506637 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7efdb815dc30 0x7efdb806a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:12:25.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.618+0000 7efdbdf9b700 1 --2- 172.21.15.45:0/2530506637 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efdb80cded0 0x7efdb8145c70 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7efdb4000c00 tx=0x7efdb4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:25.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.619+0000 7efdae7fc700 1 -- 172.21.15.45:0/2530506637 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdb4003d90 con 0x7efdb80cded0 2023-11-28T12:12:25.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.619+0000 7efdae7fc700 1 -- 172.21.15.45:0/2530506637 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdb401f070 con 0x7efdb80cded0 2023-11-28T12:12:25.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.619+0000 7efdae7fc700 1 -- 172.21.15.45:0/2530506637 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdb4011870 con 0x7efdb80cded0 2023-11-28T12:12:25.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.619+0000 7efdc01ff700 1 -- 172.21.15.45:0/2530506637 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdb8160720 con 0x7efdb80cded0 2023-11-28T12:12:25.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.619+0000 7efdc01ff700 1 -- 172.21.15.45:0/2530506637 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdb80b5670 con 0x7efdb80cded0 2023-11-28T12:12:25.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.620+0000 7efdc01ff700 1 -- 172.21.15.45:0/2530506637 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efdb80c7b70 con 0x7efdb80cded0 2023-11-28T12:12:25.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.621+0000 7efdae7fc700 1 -- 172.21.15.45:0/2530506637 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7efdb4017020 con 0x7efdb80cded0 2023-11-28T12:12:25.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.621+0000 7efdae7fc700 1 --2- 172.21.15.45:0/2530506637 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7efd9c0682f0 0x7efd9c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:25.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.622+0000 7efdae7fc700 1 -- 172.21.15.45:0/2530506637 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5296+0+0 (secure 0 0 0) 0x7efdb4021070 con 0x7efdb80cded0 2023-11-28T12:12:25.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.622+0000 7efdae7fc700 1 --2- 172.21.15.45:0/2530506637 >> [v2:172.21.15.45:6806/115843,v1:172.21.15.45:6808/115843] conn(0x7efd9c06e760 0x7efd9c070b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:25.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.622+0000 7efdae7fc700 1 -- 172.21.15.45:0/2530506637 --> [v2:172.21.15.45:6806/115843,v1:172.21.15.45:6808/115843] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efd9c071240 con 0x7efd9c06e760 2023-11-28T12:12:25.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.622+0000 7efdae7fc700 1 -- 172.21.15.45:0/2530506637 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7efdb40896f0 con 0x7efdb80cded0 2023-11-28T12:12:25.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.622+0000 7efdbd79a700 1 --2- 172.21.15.45:0/2530506637 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7efd9c0682f0 0x7efd9c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:25.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.622+0000 7efdbe79c700 1 --2- 172.21.15.45:0/2530506637 >> [v2:172.21.15.45:6806/115843,v1:172.21.15.45:6808/115843] conn(0x7efd9c06e760 0x7efd9c070b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:25.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.623+0000 7efdbd79a700 1 --2- 172.21.15.45:0/2530506637 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7efd9c0682f0 0x7efd9c06a7a0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7efdb80b6930 tx=0x7efda8000f10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:25.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.623+0000 7efdbe79c700 1 --2- 172.21.15.45:0/2530506637 >> [v2:172.21.15.45:6806/115843,v1:172.21.15.45:6808/115843] conn(0x7efd9c06e760 0x7efd9c070b70 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:25.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.623+0000 7efdae7fc700 1 -- 172.21.15.45:0/2530506637 <== osd.0 v2:172.21.15.45:6806/115843 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7efd9c071240 con 0x7efd9c06e760 2023-11-28T12:12:25.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.639+0000 7efdc01ff700 1 -- 172.21.15.45:0/2530506637 --> [v2:172.21.15.45:6806/115843,v1:172.21.15.45:6808/115843] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7efdb8160a00 con 0x7efd9c06e760 2023-11-28T12:12:25.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.639+0000 7efdae7fc700 1 -- 172.21.15.45:0/2530506637 <== osd.0 v2:172.21.15.45:6806/115843 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7efdb8160a00 con 0x7efd9c06e760 2023-11-28T12:12:25.641 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-11-28T12:12:25.641 INFO:teuthology.orchestra.run.smithi045.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-28T12:12:25.641 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-11-28T12:12:25.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.639+0000 7efdc01ff700 1 -- 172.21.15.45:0/2530506637 >> [v2:172.21.15.45:6806/115843,v1:172.21.15.45:6808/115843] conn(0x7efd9c06e760 msgr2=0x7efd9c070b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:25.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.639+0000 7efdc01ff700 1 --2- 172.21.15.45:0/2530506637 >> [v2:172.21.15.45:6806/115843,v1:172.21.15.45:6808/115843] conn(0x7efd9c06e760 0x7efd9c070b70 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:25.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.639+0000 7efdc01ff700 1 -- 172.21.15.45:0/2530506637 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7efd9c0682f0 msgr2=0x7efd9c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:25.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.639+0000 7efdc01ff700 1 --2- 172.21.15.45:0/2530506637 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7efd9c0682f0 0x7efd9c06a7a0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7efdb80b6930 tx=0x7efda8000f10 comp rx=0 tx=0).stop 2023-11-28T12:12:25.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.639+0000 7efdc01ff700 1 -- 172.21.15.45:0/2530506637 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efdb80cded0 msgr2=0x7efdb8145c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:25.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.639+0000 7efdc01ff700 1 --2- 172.21.15.45:0/2530506637 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efdb80cded0 0x7efdb8145c70 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7efdb4000c00 tx=0x7efdb4004750 comp rx=0 tx=0).stop 2023-11-28T12:12:25.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.639+0000 7efdbe79c700 1 -- 172.21.15.45:0/2530506637 reap_dead start 2023-11-28T12:12:25.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.640+0000 7efdc01ff700 1 -- 172.21.15.45:0/2530506637 shutdown_connections 2023-11-28T12:12:25.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.640+0000 7efdc01ff700 1 -- 172.21.15.45:0/2530506637 >> 172.21.15.45:0/2530506637 conn(0x7efdb8072620 msgr2=0x7efdb80b2c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:25.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.640+0000 7efdc01ff700 1 -- 172.21.15.45:0/2530506637 shutdown_connections 2023-11-28T12:12:25.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.640+0000 7efdc01ff700 1 -- 172.21.15.45:0/2530506637 wait complete. 2023-11-28T12:12:25.658 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-11-28T12:12:25.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.861+0000 7f57b85ff700 1 Processor -- start 2023-11-28T12:12:25.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.862+0000 7f57b85ff700 1 -- start start 2023-11-28T12:12:25.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.863+0000 7f57b85ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f57b015c9b0 0x7f57b00b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:25.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.863+0000 7f57b85ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57b00d1950 con 0x7f57b00cd7c0 2023-11-28T12:12:25.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.863+0000 7f57b85ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57b00d24f0 con 0x7f57b0161340 2023-11-28T12:12:25.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.863+0000 7f57b85ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57b00b5800 con 0x7f57b015c9b0 2023-11-28T12:12:25.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.863+0000 7f57b6b9c700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f57b00cd7c0 0x7f57b00b5fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44046/0 (socket says 172.21.15.45:44046) 2023-11-28T12:12:25.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.863+0000 7f57b6b9c700 1 -- 172.21.15.45:0/1028098369 learned_addr learned my addr 172.21.15.45:0/1028098369 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:12:25.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.863+0000 7f57b639b700 1 --2- 172.21.15.45:0/1028098369 >> v2:172.21.15.152:3300/0 conn(0x7f57b015c9b0 0x7f57b00b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:25.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.864+0000 7f57b5399700 1 -- 172.21.15.45:0/1028098369 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1305855169 0 0) 0x7f57b00d1950 con 0x7f57b00cd7c0 2023-11-28T12:12:25.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.864+0000 7f57b5399700 1 -- 172.21.15.45:0/1028098369 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f579c0035b0 con 0x7f57b00cd7c0 2023-11-28T12:12:25.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.864+0000 7f57b5399700 1 -- 172.21.15.45:0/1028098369 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4028878942 0 0) 0x7f57b00d24f0 con 0x7f57b0161340 2023-11-28T12:12:25.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.864+0000 7f57b5399700 1 -- 172.21.15.45:0/1028098369 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57b00d1950 con 0x7f57b0161340 2023-11-28T12:12:25.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.864+0000 7f57b639b700 1 -- 172.21.15.45:0/1028098369 >> v1:172.21.15.152:6789/0 conn(0x7f57b0161340 legacy=0x7f57b00d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:25.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.864+0000 7f57b639b700 1 -- 172.21.15.45:0/1028098369 >> v1:172.21.15.45:6789/0 conn(0x7f57b00cd7c0 legacy=0x7f57b00b5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:25.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.864+0000 7f57b639b700 1 -- 172.21.15.45:0/1028098369 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57b00b5520 con 0x7f57b015c9b0 2023-11-28T12:12:25.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.864+0000 7f57b639b700 1 --2- 172.21.15.45:0/1028098369 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57b015c9b0 0x7f57b00b4bf0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f57ac009840 tx=0x7f57ac009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d7b67692b9740e4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:25.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.865+0000 7f57b5399700 1 -- 172.21.15.45:0/1028098369 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57ac011830 con 0x7f57b015c9b0 2023-11-28T12:12:25.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.865+0000 7f57b5399700 1 -- 172.21.15.45:0/1028098369 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57ac011990 con 0x7f57b015c9b0 2023-11-28T12:12:25.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.865+0000 7f57b5399700 1 -- 172.21.15.45:0/1028098369 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57ac011d20 con 0x7f57b015c9b0 2023-11-28T12:12:25.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.865+0000 7f57b85ff700 1 -- 172.21.15.45:0/1028098369 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57b015c9b0 msgr2=0x7f57b00b4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:25.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.865+0000 7f57b85ff700 1 --2- 172.21.15.45:0/1028098369 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57b015c9b0 0x7f57b00b4bf0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f57ac009840 tx=0x7f57ac009b50 comp rx=0 tx=0).stop 2023-11-28T12:12:25.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.865+0000 7f57b85ff700 1 -- 172.21.15.45:0/1028098369 shutdown_connections 2023-11-28T12:12:25.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.865+0000 7f57b85ff700 1 --2- 172.21.15.45:0/1028098369 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57b015c9b0 0x7f57b00b4bf0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:25.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.865+0000 7f57b85ff700 1 -- 172.21.15.45:0/1028098369 >> 172.21.15.45:0/1028098369 conn(0x7f57b0072600 msgr2=0x7f57b00cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:25.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.865+0000 7f57b85ff700 1 -- 172.21.15.45:0/1028098369 shutdown_connections 2023-11-28T12:12:25.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.865+0000 7f57b85ff700 1 -- 172.21.15.45:0/1028098369 wait complete. 2023-11-28T12:12:25.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.868+0000 7f57b85ff700 1 Processor -- start 2023-11-28T12:12:25.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.868+0000 7f57b85ff700 1 -- start start 2023-11-28T12:12:25.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.869+0000 7f57b85ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57b00cd7c0 0x7f57b0156ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:25.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.869+0000 7f57b85ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f57b015c9b0 0x7f57b00ca240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:25.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.869+0000 7f57b85ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57b0161340 0x7f57b0156740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:25.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.869+0000 7f57b85ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57b00ca780 con 0x7f57b00cd7c0 2023-11-28T12:12:25.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.869+0000 7f57b85ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57b0156c80 con 0x7f57b0161340 2023-11-28T12:12:25.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.869+0000 7f57b85ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57b00c7fa0 con 0x7f57b015c9b0 2023-11-28T12:12:25.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.869+0000 7f57b639b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57b00cd7c0 0x7f57b0156ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:25.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.869+0000 7f57b639b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57b00cd7c0 0x7f57b0156ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56134/0 (socket says 172.21.15.45:56134) 2023-11-28T12:12:25.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.869+0000 7f57b639b700 1 -- 172.21.15.45:0/48003416 learned_addr learned my addr 172.21.15.45:0/48003416 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:12:25.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.869+0000 7f57b5b9a700 1 --2- 172.21.15.45:0/48003416 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f57b015c9b0 0x7f57b00ca240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:25.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.869+0000 7f57b6b9c700 1 --2- 172.21.15.45:0/48003416 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57b0161340 0x7f57b0156740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:25.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.869+0000 7f57b639b700 1 -- 172.21.15.45:0/48003416 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f57b015c9b0 msgr2=0x7f57b00ca240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:25.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.869+0000 7f57b639b700 1 --2- 172.21.15.45:0/48003416 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f57b015c9b0 0x7f57b00ca240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:25.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.869+0000 7f57b639b700 1 -- 172.21.15.45:0/48003416 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57b0161340 msgr2=0x7f57b0156740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:25.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.869+0000 7f57b639b700 1 --2- 172.21.15.45:0/48003416 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57b0161340 0x7f57b0156740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:25.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.869+0000 7f57b639b700 1 -- 172.21.15.45:0/48003416 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57ac0094a0 con 0x7f57b00cd7c0 2023-11-28T12:12:25.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.870+0000 7f57b639b700 1 --2- 172.21.15.45:0/48003416 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57b00cd7c0 0x7f57b0156ed0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f57ac014040 tx=0x7f57ac004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:25.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.870+0000 7f57a6ffd700 1 -- 172.21.15.45:0/48003416 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57ac01a860 con 0x7f57b00cd7c0 2023-11-28T12:12:25.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.870+0000 7f57a6ffd700 1 -- 172.21.15.45:0/48003416 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57ac01a9c0 con 0x7f57b00cd7c0 2023-11-28T12:12:25.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.870+0000 7f57a6ffd700 1 -- 172.21.15.45:0/48003416 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57ac01ad30 con 0x7f57b00cd7c0 2023-11-28T12:12:25.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.870+0000 7f57b85ff700 1 -- 172.21.15.45:0/48003416 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57b00d15e0 con 0x7f57b00cd7c0 2023-11-28T12:12:25.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.870+0000 7f57b85ff700 1 -- 172.21.15.45:0/48003416 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57b00d1300 con 0x7f57b00cd7c0 2023-11-28T12:12:25.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.871+0000 7f57b85ff700 1 -- 172.21.15.45:0/48003416 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57b00b5130 con 0x7f57b00cd7c0 2023-11-28T12:12:25.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.872+0000 7f57a6ffd700 1 -- 172.21.15.45:0/48003416 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f57ac00f050 con 0x7f57b00cd7c0 2023-11-28T12:12:25.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.873+0000 7f57a6ffd700 1 --2- 172.21.15.45:0/48003416 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f57940682f0 0x7f579406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:25.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.873+0000 7f57a6ffd700 1 -- 172.21.15.45:0/48003416 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f57ac086880 con 0x7f57b00cd7c0 2023-11-28T12:12:25.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.873+0000 7f57b5b9a700 1 --2- 172.21.15.45:0/48003416 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f57940682f0 0x7f579406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:25.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.874+0000 7f57b5b9a700 1 --2- 172.21.15.45:0/48003416 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f57940682f0 0x7f579406a7a0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f57b00cd490 tx=0x7f57a0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:25.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:25.877+0000 7f57a6ffd700 1 -- 172.21.15.45:0/48003416 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f57ac0533c0 con 0x7f57b00cd7c0 2023-11-28T12:12:26.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.080+0000 7f57b85ff700 1 -- 172.21.15.45:0/48003416 --> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f57b00745c0 con 0x7f57940682f0 2023-11-28T12:12:26.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.081+0000 7f57a6ffd700 1 -- 172.21.15.45:0/48003416 <== mgr.4100 v2:172.21.15.152:6832/115389 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f57b00745c0 con 0x7f57940682f0 2023-11-28T12:12:26.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.083+0000 7f57b85ff700 1 -- 172.21.15.45:0/48003416 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f57940682f0 msgr2=0x7f579406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:26.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.083+0000 7f57b85ff700 1 --2- 172.21.15.45:0/48003416 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f57940682f0 0x7f579406a7a0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f57b00cd490 tx=0x7f57a0009040 comp rx=0 tx=0).stop 2023-11-28T12:12:26.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.083+0000 7f57b85ff700 1 -- 172.21.15.45:0/48003416 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57b00cd7c0 msgr2=0x7f57b0156ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:26.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.083+0000 7f57b85ff700 1 --2- 172.21.15.45:0/48003416 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57b00cd7c0 0x7f57b0156ed0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f57ac014040 tx=0x7f57ac004750 comp rx=0 tx=0).stop 2023-11-28T12:12:26.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.083+0000 7f57b85ff700 1 -- 172.21.15.45:0/48003416 shutdown_connections 2023-11-28T12:12:26.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.083+0000 7f57b85ff700 1 --2- 172.21.15.45:0/48003416 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f57940682f0 0x7f579406a7a0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:26.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.083+0000 7f57b85ff700 1 --2- 172.21.15.45:0/48003416 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f57b0161340 0x7f57b0156740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:26.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.083+0000 7f57b85ff700 1 --2- 172.21.15.45:0/48003416 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57b00cd7c0 0x7f57b0156ed0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:26.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.083+0000 7f57b85ff700 1 --2- 172.21.15.45:0/48003416 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f57b015c9b0 0x7f57b00ca240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:26.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.083+0000 7f57b85ff700 1 -- 172.21.15.45:0/48003416 >> 172.21.15.45:0/48003416 conn(0x7f57b0072600 msgr2=0x7f57b0160460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:26.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.083+0000 7f57b85ff700 1 -- 172.21.15.45:0/48003416 shutdown_connections 2023-11-28T12:12:26.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.083+0000 7f57b85ff700 1 -- 172.21.15.45:0/48003416 wait complete. 2023-11-28T12:12:26.087 INFO:teuthology.orchestra.run.smithi045.stderr:instructed osd(s) 0 to deep-scrub 2023-11-28T12:12:26.103 INFO:tasks.ceph:Scrubbing osd.1 2023-11-28T12:12:26.103 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-11-28T12:12:26.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.309+0000 7f3a2cdff700 1 Processor -- start 2023-11-28T12:12:26.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.309+0000 7f3a2cdff700 1 -- start start 2023-11-28T12:12:26.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.310+0000 7f3a2cdff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f3a2815a760 0x7f3a28161200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:26.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.310+0000 7f3a2cdff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3a2815dc30 0x7f3a280b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:26.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.310+0000 7f3a2cdff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a2815e0a0 con 0x7f3a280cd7c0 2023-11-28T12:12:26.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.310+0000 7f3a2cdff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a2815ab30 con 0x7f3a2815a760 2023-11-28T12:12:26.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.310+0000 7f3a2cdff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a28160d70 con 0x7f3a2815dc30 2023-11-28T12:12:26.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.310+0000 7f3a26d9d700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f3a280cd7c0 0x7f3a280d0d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44050/0 (socket says 172.21.15.45:44050) 2023-11-28T12:12:26.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.310+0000 7f3a26d9d700 1 -- 172.21.15.45:0/597052430 learned_addr learned my addr 172.21.15.45:0/597052430 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:12:26.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.310+0000 7f3a2659c700 1 --2- 172.21.15.45:0/597052430 >> v2:172.21.15.152:3300/0 conn(0x7f3a2815a760 0x7f3a28161200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:26.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.310+0000 7f3a1ffff700 1 --2- 172.21.15.45:0/597052430 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3a2815dc30 0x7f3a280b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:26.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.311+0000 7f3a25d9b700 1 -- 172.21.15.45:0/597052430 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3531501719 0 0) 0x7f3a2815e0a0 con 0x7f3a280cd7c0 2023-11-28T12:12:26.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.311+0000 7f3a25d9b700 1 -- 172.21.15.45:0/597052430 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a140035b0 con 0x7f3a280cd7c0 2023-11-28T12:12:26.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.311+0000 7f3a25d9b700 1 -- 172.21.15.45:0/597052430 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3779569268 0 0) 0x7f3a140035b0 con 0x7f3a280cd7c0 2023-11-28T12:12:26.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.311+0000 7f3a25d9b700 1 -- 172.21.15.45:0/597052430 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3a2815dc30 msgr2=0x7f3a280b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:12:26.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.311+0000 7f3a25d9b700 1 --2- 172.21.15.45:0/597052430 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3a2815dc30 0x7f3a280b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:26.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.311+0000 7f3a25d9b700 1 -- 172.21.15.45:0/597052430 >> v2:172.21.15.152:3300/0 conn(0x7f3a2815a760 msgr2=0x7f3a28161200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:12:26.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.311+0000 7f3a25d9b700 1 --2- 172.21.15.45:0/597052430 >> v2:172.21.15.152:3300/0 conn(0x7f3a2815a760 0x7f3a28161200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:26.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.311+0000 7f3a25d9b700 1 -- 172.21.15.45:0/597052430 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a280b5130 con 0x7f3a280cd7c0 2023-11-28T12:12:26.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.311+0000 7f3a25d9b700 1 -- 172.21.15.45:0/597052430 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3460218165 0 0) 0x7f3a200019f0 con 0x7f3a280cd7c0 2023-11-28T12:12:26.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.311+0000 7f3a25d9b700 1 -- 172.21.15.45:0/597052430 >> v1:172.21.15.45:6789/0 conn(0x7f3a280cd7c0 legacy=0x7f3a280d0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:26.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.311+0000 7f3a25d9b700 1 --2- 172.21.15.45:0/597052430 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3a14003a00 0x7f3a14003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:26.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.311+0000 7f3a25d9b700 1 --2- 172.21.15.45:0/597052430 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a14004430 0x7f3a140048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:26.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.311+0000 7f3a25d9b700 1 --2- 172.21.15.45:0/597052430 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3a2815dc30 0x7f3a14005060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:26.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.311+0000 7f3a25d9b700 1 -- 172.21.15.45:0/597052430 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2815ab30 con 0x7f3a14004430 2023-11-28T12:12:26.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.311+0000 7f3a25d9b700 1 -- 172.21.15.45:0/597052430 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a28160d70 con 0x7f3a14003a00 2023-11-28T12:12:26.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.311+0000 7f3a25d9b700 1 -- 172.21.15.45:0/597052430 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1400ba10 con 0x7f3a2815dc30 2023-11-28T12:12:26.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.311+0000 7f3a1ffff700 1 --2- 172.21.15.45:0/597052430 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a14004430 0x7f3a140048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:26.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.312+0000 7f3a2659c700 1 --2- 172.21.15.45:0/597052430 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3a14003a00 0x7f3a14003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:26.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.312+0000 7f3a26d9d700 1 --2- 172.21.15.45:0/597052430 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3a2815dc30 0x7f3a14005060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:26.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.312+0000 7f3a1ffff700 1 -- 172.21.15.45:0/597052430 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3a2815dc30 msgr2=0x7f3a14005060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:12:26.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.312+0000 7f3a1ffff700 1 --2- 172.21.15.45:0/597052430 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3a2815dc30 0x7f3a14005060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:26.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.312+0000 7f3a1ffff700 1 -- 172.21.15.45:0/597052430 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3a14003a00 msgr2=0x7f3a14003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:12:26.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.312+0000 7f3a1ffff700 1 --2- 172.21.15.45:0/597052430 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3a14003a00 0x7f3a14003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:26.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.312+0000 7f3a1ffff700 1 -- 172.21.15.45:0/597052430 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a140035b0 con 0x7f3a14004430 2023-11-28T12:12:26.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.312+0000 7f3a1ffff700 1 --2- 172.21.15.45:0/597052430 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a14004430 0x7f3a140048f0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f3a10009b90 tx=0x7f3a14005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f023692a8910ee3e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:26.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.312+0000 7f3a25d9b700 1 -- 172.21.15.45:0/597052430 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a1000e6c0 con 0x7f3a14004430 2023-11-28T12:12:26.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.312+0000 7f3a25d9b700 1 -- 172.21.15.45:0/597052430 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a1000e820 con 0x7f3a14004430 2023-11-28T12:12:26.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.312+0000 7f3a25d9b700 1 -- 172.21.15.45:0/597052430 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a1000eb90 con 0x7f3a14004430 2023-11-28T12:12:26.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.313+0000 7f3a2cdff700 1 -- 172.21.15.45:0/597052430 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a14004430 msgr2=0x7f3a140048f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:26.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.313+0000 7f3a2cdff700 1 --2- 172.21.15.45:0/597052430 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a14004430 0x7f3a140048f0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f3a10009b90 tx=0x7f3a14005880 comp rx=0 tx=0).stop 2023-11-28T12:12:26.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.313+0000 7f3a26d9d700 1 -- 172.21.15.45:0/597052430 reap_dead start 2023-11-28T12:12:26.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.313+0000 7f3a2cdff700 1 -- 172.21.15.45:0/597052430 shutdown_connections 2023-11-28T12:12:26.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.313+0000 7f3a2cdff700 1 -- 172.21.15.45:0/597052430 >> 172.21.15.45:0/597052430 conn(0x7f3a28072620 msgr2=0x7f3a280cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:26.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.313+0000 7f3a2cdff700 1 -- 172.21.15.45:0/597052430 shutdown_connections 2023-11-28T12:12:26.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.313+0000 7f3a2cdff700 1 -- 172.21.15.45:0/597052430 wait complete. 2023-11-28T12:12:26.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.315+0000 7f3a2cdff700 1 Processor -- start 2023-11-28T12:12:26.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.315+0000 7f3a2cdff700 1 -- start start 2023-11-28T12:12:26.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.316+0000 7f3a2cdff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3a14004430 0x7f3a280cae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:26.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.316+0000 7f3a2cdff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3a280cb3c0 0x7f3a281f2890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:26.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.316+0000 7f3a2cdff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a281f2dd0 0x7f3a281f3240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:26.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.316+0000 7f3a2cdff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a280ccd30 con 0x7f3a281f2dd0 2023-11-28T12:12:26.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.316+0000 7f3a2cdff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a281f3780 con 0x7f3a14004430 2023-11-28T12:12:26.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.316+0000 7f3a2cdff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a281f3a30 con 0x7f3a280cb3c0 2023-11-28T12:12:26.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.316+0000 7f3a26d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a281f2dd0 0x7f3a281f3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:26.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.316+0000 7f3a26d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a281f2dd0 0x7f3a281f3240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56148/0 (socket says 172.21.15.45:56148) 2023-11-28T12:12:26.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.316+0000 7f3a26d9d700 1 -- 172.21.15.45:0/4111590103 learned_addr learned my addr 172.21.15.45:0/4111590103 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:12:26.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.317+0000 7f3a1ffff700 1 --2- 172.21.15.45:0/4111590103 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3a280cb3c0 0x7f3a281f2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:26.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.317+0000 7f3a2659c700 1 --2- 172.21.15.45:0/4111590103 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3a14004430 0x7f3a280cae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:26.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.317+0000 7f3a26d9d700 1 -- 172.21.15.45:0/4111590103 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3a280cb3c0 msgr2=0x7f3a281f2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:26.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.317+0000 7f3a26d9d700 1 --2- 172.21.15.45:0/4111590103 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f3a280cb3c0 0x7f3a281f2890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:26.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.317+0000 7f3a26d9d700 1 -- 172.21.15.45:0/4111590103 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3a14004430 msgr2=0x7f3a280cae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:26.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.317+0000 7f3a26d9d700 1 --2- 172.21.15.45:0/4111590103 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3a14004430 0x7f3a280cae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:26.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.317+0000 7f3a26d9d700 1 -- 172.21.15.45:0/4111590103 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a280b5670 con 0x7f3a281f2dd0 2023-11-28T12:12:26.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.317+0000 7f3a2659c700 1 --2- 172.21.15.45:0/4111590103 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3a14004430 0x7f3a280cae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:12:26.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.317+0000 7f3a26d9d700 1 --2- 172.21.15.45:0/4111590103 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a281f2dd0 0x7f3a281f3240 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f3a20001330 tx=0x7f3a2000a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:26.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.317+0000 7f3a1effd700 1 -- 172.21.15.45:0/4111590103 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a200133f0 con 0x7f3a281f2dd0 2023-11-28T12:12:26.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.317+0000 7f3a1effd700 1 -- 172.21.15.45:0/4111590103 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a20013590 con 0x7f3a281f2dd0 2023-11-28T12:12:26.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.317+0000 7f3a1effd700 1 -- 172.21.15.45:0/4111590103 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a20013940 con 0x7f3a281f2dd0 2023-11-28T12:12:26.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.317+0000 7f3a2cdff700 1 -- 172.21.15.45:0/4111590103 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a280b5390 con 0x7f3a281f2dd0 2023-11-28T12:12:26.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.318+0000 7f3a2cdff700 1 -- 172.21.15.45:0/4111590103 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a28160720 con 0x7f3a281f2dd0 2023-11-28T12:12:26.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.318+0000 7f3a2cdff700 1 -- 172.21.15.45:0/4111590103 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3a2804e620 con 0x7f3a281f2dd0 2023-11-28T12:12:26.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.320+0000 7f3a1effd700 1 -- 172.21.15.45:0/4111590103 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f3a20013aa0 con 0x7f3a281f2dd0 2023-11-28T12:12:26.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.320+0000 7f3a1effd700 1 --2- 172.21.15.45:0/4111590103 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f3a080682f0 0x7f3a0806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:26.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.320+0000 7f3a1effd700 1 -- 172.21.15.45:0/4111590103 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f3a20086e50 con 0x7f3a281f2dd0 2023-11-28T12:12:26.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.321+0000 7f3a1effd700 1 --2- 172.21.15.45:0/4111590103 >> [v2:172.21.15.45:6800/115842,v1:172.21.15.45:6801/115842] conn(0x7f3a0806e760 0x7f3a08070b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:26.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.321+0000 7f3a1effd700 1 -- 172.21.15.45:0/4111590103 --> [v2:172.21.15.45:6800/115842,v1:172.21.15.45:6801/115842] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3a08071240 con 0x7f3a0806e760 2023-11-28T12:12:26.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.321+0000 7f3a1effd700 1 -- 172.21.15.45:0/4111590103 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3a20087290 con 0x7f3a281f2dd0 2023-11-28T12:12:26.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.321+0000 7f3a2659c700 1 --2- 172.21.15.45:0/4111590103 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f3a080682f0 0x7f3a0806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:26.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.321+0000 7f3a1ffff700 1 --2- 172.21.15.45:0/4111590103 >> [v2:172.21.15.45:6800/115842,v1:172.21.15.45:6801/115842] conn(0x7f3a0806e760 0x7f3a08070b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:26.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.321+0000 7f3a1ffff700 1 --2- 172.21.15.45:0/4111590103 >> [v2:172.21.15.45:6800/115842,v1:172.21.15.45:6801/115842] conn(0x7f3a0806e760 0x7f3a08070b70 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:26.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.322+0000 7f3a2659c700 1 --2- 172.21.15.45:0/4111590103 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f3a080682f0 0x7f3a0806a7a0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f3a280b8680 tx=0x7f3a18008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:26.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.322+0000 7f3a1effd700 1 -- 172.21.15.45:0/4111590103 <== osd.1 v2:172.21.15.45:6800/115842 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f3a08071240 con 0x7f3a0806e760 2023-11-28T12:12:26.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.337+0000 7f3a2cdff700 1 -- 172.21.15.45:0/4111590103 --> [v2:172.21.15.45:6800/115842,v1:172.21.15.45:6801/115842] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f3a2815d6e0 con 0x7f3a0806e760 2023-11-28T12:12:26.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.337+0000 7f3a1effd700 1 -- 172.21.15.45:0/4111590103 <== osd.1 v2:172.21.15.45:6800/115842 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f3a2815d6e0 con 0x7f3a0806e760 2023-11-28T12:12:26.339 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-11-28T12:12:26.340 INFO:teuthology.orchestra.run.smithi045.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-28T12:12:26.340 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-11-28T12:12:26.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.338+0000 7f3a2cdff700 1 -- 172.21.15.45:0/4111590103 >> [v2:172.21.15.45:6800/115842,v1:172.21.15.45:6801/115842] conn(0x7f3a0806e760 msgr2=0x7f3a08070b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:26.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.338+0000 7f3a2cdff700 1 --2- 172.21.15.45:0/4111590103 >> [v2:172.21.15.45:6800/115842,v1:172.21.15.45:6801/115842] conn(0x7f3a0806e760 0x7f3a08070b70 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:26.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.338+0000 7f3a2cdff700 1 -- 172.21.15.45:0/4111590103 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f3a080682f0 msgr2=0x7f3a0806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:26.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.338+0000 7f3a2cdff700 1 --2- 172.21.15.45:0/4111590103 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f3a080682f0 0x7f3a0806a7a0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f3a280b8680 tx=0x7f3a18008040 comp rx=0 tx=0).stop 2023-11-28T12:12:26.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.338+0000 7f3a2cdff700 1 -- 172.21.15.45:0/4111590103 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a281f2dd0 msgr2=0x7f3a281f3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:26.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.338+0000 7f3a2cdff700 1 --2- 172.21.15.45:0/4111590103 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a281f2dd0 0x7f3a281f3240 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f3a20001330 tx=0x7f3a2000a640 comp rx=0 tx=0).stop 2023-11-28T12:12:26.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.338+0000 7f3a26d9d700 1 -- 172.21.15.45:0/4111590103 reap_dead start 2023-11-28T12:12:26.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.338+0000 7f3a2cdff700 1 -- 172.21.15.45:0/4111590103 shutdown_connections 2023-11-28T12:12:26.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.338+0000 7f3a2cdff700 1 -- 172.21.15.45:0/4111590103 >> 172.21.15.45:0/4111590103 conn(0x7f3a28072620 msgr2=0x7f3a280d35f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:26.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.338+0000 7f3a2cdff700 1 -- 172.21.15.45:0/4111590103 shutdown_connections 2023-11-28T12:12:26.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.338+0000 7f3a2cdff700 1 -- 172.21.15.45:0/4111590103 wait complete. 2023-11-28T12:12:26.356 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-11-28T12:12:26.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.560+0000 7f22493ff700 1 Processor -- start 2023-11-28T12:12:26.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.560+0000 7f22493ff700 1 -- start start 2023-11-28T12:12:26.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.560+0000 7f22493ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f224415c9b0 0x7f22440b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:26.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.560+0000 7f22493ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f22440cd7c0 0x7f22440cdc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:26.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.560+0000 7f22493ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22440ce160 con 0x7f2244161340 2023-11-28T12:12:26.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.560+0000 7f22493ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22440b5800 con 0x7f22440cd7c0 2023-11-28T12:12:26.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.560+0000 7f22493ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22440d1950 con 0x7f224415c9b0 2023-11-28T12:12:26.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.560+0000 7f22437fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f22440cd7c0 0x7f22440cdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:26.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.560+0000 7f22427fc700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f2244161340 0x7f22440d1de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44064/0 (socket says 172.21.15.45:44064) 2023-11-28T12:12:26.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.560+0000 7f22427fc700 1 -- 172.21.15.45:0/637254349 learned_addr learned my addr 172.21.15.45:0/637254349 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:12:26.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.561+0000 7f2242ffd700 1 --2- 172.21.15.45:0/637254349 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f224415c9b0 0x7f22440b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:26.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.561+0000 7f22437fe700 1 -- 172.21.15.45:0/637254349 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f224415c9b0 msgr2=0x7f22440b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:12:26.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.561+0000 7f22437fe700 1 --2- 172.21.15.45:0/637254349 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f224415c9b0 0x7f22440b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:26.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.561+0000 7f22437fe700 1 -- 172.21.15.45:0/637254349 >> v1:172.21.15.45:6789/0 conn(0x7f2244161340 legacy=0x7f22440d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:26.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.561+0000 7f22437fe700 1 -- 172.21.15.45:0/637254349 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22440d24f0 con 0x7f22440cd7c0 2023-11-28T12:12:26.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.561+0000 7f2241ffb700 1 -- 172.21.15.45:0/637254349 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2311330564 0 0) 0x7f22440ce160 con 0x7f2244161340 2023-11-28T12:12:26.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.561+0000 7f22437fe700 1 --2- 172.21.15.45:0/637254349 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22440cd7c0 0x7f22440cdc20 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f223c009d90 tx=0x7f223c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4de2a4777dae0788 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:26.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.561+0000 7f2241ffb700 1 -- 172.21.15.45:0/637254349 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f223c00e070 con 0x7f22440cd7c0 2023-11-28T12:12:26.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.561+0000 7f2241ffb700 1 -- 172.21.15.45:0/637254349 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f223c00bb20 con 0x7f22440cd7c0 2023-11-28T12:12:26.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.561+0000 7f2241ffb700 1 -- 172.21.15.45:0/637254349 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f223c012430 con 0x7f22440cd7c0 2023-11-28T12:12:26.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.562+0000 7f22493ff700 1 -- 172.21.15.45:0/637254349 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22440cd7c0 msgr2=0x7f22440cdc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:26.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.562+0000 7f22493ff700 1 --2- 172.21.15.45:0/637254349 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22440cd7c0 0x7f22440cdc20 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f223c009d90 tx=0x7f223c00b330 comp rx=0 tx=0).stop 2023-11-28T12:12:26.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.562+0000 7f22493ff700 1 -- 172.21.15.45:0/637254349 shutdown_connections 2023-11-28T12:12:26.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.562+0000 7f22493ff700 1 --2- 172.21.15.45:0/637254349 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22440cd7c0 0x7f22440cdc20 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:26.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.562+0000 7f22493ff700 1 --2- 172.21.15.45:0/637254349 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f224415c9b0 0x7f22440b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:26.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.562+0000 7f22493ff700 1 -- 172.21.15.45:0/637254349 >> 172.21.15.45:0/637254349 conn(0x7f2244072600 msgr2=0x7f22440cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:26.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.562+0000 7f22493ff700 1 -- 172.21.15.45:0/637254349 shutdown_connections 2023-11-28T12:12:26.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.562+0000 7f22493ff700 1 -- 172.21.15.45:0/637254349 wait complete. 2023-11-28T12:12:26.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.564+0000 7f22493ff700 1 Processor -- start 2023-11-28T12:12:26.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.564+0000 7f22493ff700 1 -- start start 2023-11-28T12:12:26.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.565+0000 7f22493ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22440cd7c0 0x7f2244156620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:26.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.565+0000 7f22493ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f224415c9b0 0x7f2244156e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:26.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.565+0000 7f22493ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2244161340 0x7f22440cc680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:26.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.565+0000 7f22493ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f224415dbc0 con 0x7f22440cd7c0 2023-11-28T12:12:26.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.565+0000 7f22493ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22440a9a20 con 0x7f224415c9b0 2023-11-28T12:12:26.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.565+0000 7f22493ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22440c7c80 con 0x7f2244161340 2023-11-28T12:12:26.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.565+0000 7f2242ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22440cd7c0 0x7f2244156620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:26.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.565+0000 7f2242ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22440cd7c0 0x7f2244156620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56168/0 (socket says 172.21.15.45:56168) 2023-11-28T12:12:26.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.565+0000 7f2242ffd700 1 -- 172.21.15.45:0/3021711143 learned_addr learned my addr 172.21.15.45:0/3021711143 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:12:26.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.566+0000 7f2242ffd700 1 -- 172.21.15.45:0/3021711143 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2244161340 msgr2=0x7f22440cc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:26.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.566+0000 7f22437fe700 1 --2- 172.21.15.45:0/3021711143 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2244161340 0x7f22440cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:26.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.566+0000 7f22427fc700 1 --2- 172.21.15.45:0/3021711143 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f224415c9b0 0x7f2244156e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:26.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.566+0000 7f2242ffd700 1 --2- 172.21.15.45:0/3021711143 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2244161340 0x7f22440cc680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:26.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.566+0000 7f2242ffd700 1 -- 172.21.15.45:0/3021711143 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f224415c9b0 msgr2=0x7f2244156e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:26.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.566+0000 7f2242ffd700 1 --2- 172.21.15.45:0/3021711143 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f224415c9b0 0x7f2244156e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:26.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.566+0000 7f2242ffd700 1 -- 172.21.15.45:0/3021711143 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f223c009a70 con 0x7f22440cd7c0 2023-11-28T12:12:26.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.566+0000 7f22437fe700 1 --2- 172.21.15.45:0/3021711143 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2244161340 0x7f22440cc680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:12:26.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.566+0000 7f22427fc700 1 --2- 172.21.15.45:0/3021711143 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f224415c9b0 0x7f2244156e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:12:26.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.566+0000 7f2242ffd700 1 --2- 172.21.15.45:0/3021711143 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22440cd7c0 0x7f2244156620 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f223400e870 tx=0x7f223400ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:26.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.566+0000 7f222b7fe700 1 -- 172.21.15.45:0/3021711143 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2234009590 con 0x7f22440cd7c0 2023-11-28T12:12:26.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.566+0000 7f222b7fe700 1 -- 172.21.15.45:0/3021711143 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f223400ee70 con 0x7f22440cd7c0 2023-11-28T12:12:26.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.566+0000 7f222b7fe700 1 -- 172.21.15.45:0/3021711143 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f223400ca50 con 0x7f22440cd7c0 2023-11-28T12:12:26.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.566+0000 7f22493ff700 1 -- 172.21.15.45:0/3021711143 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22440d1300 con 0x7f22440cd7c0 2023-11-28T12:12:26.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.566+0000 7f22493ff700 1 -- 172.21.15.45:0/3021711143 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22440b5520 con 0x7f22440cd7c0 2023-11-28T12:12:26.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.567+0000 7f22493ff700 1 -- 172.21.15.45:0/3021711143 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22440d15e0 con 0x7f22440cd7c0 2023-11-28T12:12:26.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.568+0000 7f222b7fe700 1 -- 172.21.15.45:0/3021711143 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f2234019030 con 0x7f22440cd7c0 2023-11-28T12:12:26.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.569+0000 7f222b7fe700 1 --2- 172.21.15.45:0/3021711143 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f22300682f0 0x7f223006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:26.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.569+0000 7f222b7fe700 1 -- 172.21.15.45:0/3021711143 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f2234085820 con 0x7f22440cd7c0 2023-11-28T12:12:26.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.569+0000 7f22427fc700 1 --2- 172.21.15.45:0/3021711143 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f22300682f0 0x7f223006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:26.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.570+0000 7f22427fc700 1 --2- 172.21.15.45:0/3021711143 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f22300682f0 0x7f223006a7a0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f2238007fd0 tx=0x7f2238009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:26.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.573+0000 7f222b7fe700 1 -- 172.21.15.45:0/3021711143 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f22340522b0 con 0x7f22440cd7c0 2023-11-28T12:12:26.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.774+0000 7f22493ff700 1 -- 172.21.15.45:0/3021711143 --> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f224415d680 con 0x7f22300682f0 2023-11-28T12:12:26.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.775+0000 7f222b7fe700 1 -- 172.21.15.45:0/3021711143 <== mgr.4100 v2:172.21.15.152:6832/115389 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f2238001420 con 0x7f22300682f0 2023-11-28T12:12:26.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.778+0000 7f22493ff700 1 -- 172.21.15.45:0/3021711143 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f22300682f0 msgr2=0x7f223006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:26.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.778+0000 7f22493ff700 1 --2- 172.21.15.45:0/3021711143 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f22300682f0 0x7f223006a7a0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f2238007fd0 tx=0x7f2238009040 comp rx=0 tx=0).stop 2023-11-28T12:12:26.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.778+0000 7f22493ff700 1 -- 172.21.15.45:0/3021711143 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22440cd7c0 msgr2=0x7f2244156620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:26.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.778+0000 7f22493ff700 1 --2- 172.21.15.45:0/3021711143 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22440cd7c0 0x7f2244156620 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f223400e870 tx=0x7f223400ec30 comp rx=0 tx=0).stop 2023-11-28T12:12:26.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.778+0000 7f22493ff700 1 -- 172.21.15.45:0/3021711143 shutdown_connections 2023-11-28T12:12:26.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.778+0000 7f22493ff700 1 --2- 172.21.15.45:0/3021711143 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f22300682f0 0x7f223006a7a0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:26.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.778+0000 7f22493ff700 1 --2- 172.21.15.45:0/3021711143 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f2244161340 0x7f22440cc680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:26.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.778+0000 7f22493ff700 1 --2- 172.21.15.45:0/3021711143 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22440cd7c0 0x7f2244156620 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:26.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.778+0000 7f22493ff700 1 --2- 172.21.15.45:0/3021711143 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f224415c9b0 0x7f2244156e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:26.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.778+0000 7f22493ff700 1 -- 172.21.15.45:0/3021711143 >> 172.21.15.45:0/3021711143 conn(0x7f2244072600 msgr2=0x7f224415ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:26.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.778+0000 7f22493ff700 1 -- 172.21.15.45:0/3021711143 shutdown_connections 2023-11-28T12:12:26.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:26.778+0000 7f22493ff700 1 -- 172.21.15.45:0/3021711143 wait complete. 2023-11-28T12:12:26.782 INFO:teuthology.orchestra.run.smithi045.stderr:instructed osd(s) 1 to deep-scrub 2023-11-28T12:12:26.797 INFO:tasks.ceph:Scrubbing osd.2 2023-11-28T12:12:26.798 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-11-28T12:12:27.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.003+0000 7f12081ff700 1 Processor -- start 2023-11-28T12:12:27.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.003+0000 7f12081ff700 1 -- start start 2023-11-28T12:12:27.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.005+0000 7f12081ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f120015a760 0x7f1200161200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:27.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.005+0000 7f12081ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f120015dc30 0x7f12000b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:27.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.005+0000 7f12081ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f120015e0a0 con 0x7f12000cd7c0 2023-11-28T12:12:27.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.005+0000 7f12081ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f120015ab30 con 0x7f120015a760 2023-11-28T12:12:27.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.005+0000 7f12081ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1200160d70 con 0x7f120015dc30 2023-11-28T12:12:27.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.005+0000 7f1205f9b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f120015a760 0x7f1200161200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:27.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.005+0000 7f1205f9b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f120015a760 0x7f1200161200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56178/0 (socket says 172.21.15.45:56178) 2023-11-28T12:12:27.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.005+0000 7f1205f9b700 1 -- 172.21.15.45:0/4229109623 learned_addr learned my addr 172.21.15.45:0/4229109623 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:12:27.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.005+0000 7f120579a700 1 --2- 172.21.15.45:0/4229109623 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f120015dc30 0x7f12000b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:27.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.005+0000 7f1205f9b700 1 -- 172.21.15.45:0/4229109623 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f120015dc30 msgr2=0x7f12000b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:12:27.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.005+0000 7f1205f9b700 1 --2- 172.21.15.45:0/4229109623 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f120015dc30 0x7f12000b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:27.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.005+0000 7f1205f9b700 1 -- 172.21.15.45:0/4229109623 >> v1:172.21.15.152:6789/0 conn(0x7f12000cd7c0 legacy=0x7f12000d0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:27.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.005+0000 7f1205f9b700 1 -- 172.21.15.45:0/4229109623 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12000b5130 con 0x7f120015a760 2023-11-28T12:12:27.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.005+0000 7f1205f9b700 1 --2- 172.21.15.45:0/4229109623 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f120015a760 0x7f1200161200 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f11fc0098f0 tx=0x7f11fc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfbdd71fd1f9053e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:27.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.005+0000 7f1204f99700 1 -- 172.21.15.45:0/4229109623 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11fc011830 con 0x7f120015a760 2023-11-28T12:12:27.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.005+0000 7f1204f99700 1 -- 172.21.15.45:0/4229109623 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11fc011990 con 0x7f120015a760 2023-11-28T12:12:27.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.005+0000 7f1204f99700 1 -- 172.21.15.45:0/4229109623 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11fc011d20 con 0x7f120015a760 2023-11-28T12:12:27.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.006+0000 7f12081ff700 1 -- 172.21.15.45:0/4229109623 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f120015a760 msgr2=0x7f1200161200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:27.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.006+0000 7f12081ff700 1 --2- 172.21.15.45:0/4229109623 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f120015a760 0x7f1200161200 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f11fc0098f0 tx=0x7f11fc009c00 comp rx=0 tx=0).stop 2023-11-28T12:12:27.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.006+0000 7f12081ff700 1 -- 172.21.15.45:0/4229109623 shutdown_connections 2023-11-28T12:12:27.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.006+0000 7f12081ff700 1 --2- 172.21.15.45:0/4229109623 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f120015a760 0x7f1200161200 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:27.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.006+0000 7f12081ff700 1 --2- 172.21.15.45:0/4229109623 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f120015dc30 0x7f12000b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:27.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.006+0000 7f12081ff700 1 -- 172.21.15.45:0/4229109623 >> 172.21.15.45:0/4229109623 conn(0x7f1200072620 msgr2=0x7f12000cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:27.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.006+0000 7f12081ff700 1 -- 172.21.15.45:0/4229109623 shutdown_connections 2023-11-28T12:12:27.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.006+0000 7f12081ff700 1 -- 172.21.15.45:0/4229109623 wait complete. 2023-11-28T12:12:27.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.008+0000 7f12081ff700 1 Processor -- start 2023-11-28T12:12:27.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.008+0000 7f12081ff700 1 -- start start 2023-11-28T12:12:27.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.010+0000 7f12081ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12000cd7c0 0x7f1200155610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:27.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.010+0000 7f12081ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f120015a760 0x7f1200155ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:27.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.010+0000 7f12081ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f120015dc30 0x7f12000c9250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:27.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.010+0000 7f12081ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12000c8dc0 con 0x7f12000cd7c0 2023-11-28T12:12:27.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.010+0000 7f12081ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12000c81b0 con 0x7f120015a760 2023-11-28T12:12:27.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.010+0000 7f12081ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12000c8490 con 0x7f120015dc30 2023-11-28T12:12:27.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.010+0000 7f1205f9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12000cd7c0 0x7f1200155610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:27.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.010+0000 7f1205f9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12000cd7c0 0x7f1200155610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56194/0 (socket says 172.21.15.45:56194) 2023-11-28T12:12:27.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.010+0000 7f1205f9b700 1 -- 172.21.15.45:0/1218529269 learned_addr learned my addr 172.21.15.45:0/1218529269 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:12:27.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.010+0000 7f120679c700 1 --2- 172.21.15.45:0/1218529269 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f120015dc30 0x7f12000c9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:27.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.010+0000 7f120579a700 1 --2- 172.21.15.45:0/1218529269 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f120015a760 0x7f1200155ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:27.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.010+0000 7f1205f9b700 1 -- 172.21.15.45:0/1218529269 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f120015dc30 msgr2=0x7f12000c9250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:27.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.010+0000 7f1205f9b700 1 --2- 172.21.15.45:0/1218529269 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f120015dc30 0x7f12000c9250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:27.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.010+0000 7f1205f9b700 1 -- 172.21.15.45:0/1218529269 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f120015a760 msgr2=0x7f1200155ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:27.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.010+0000 7f1205f9b700 1 --2- 172.21.15.45:0/1218529269 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f120015a760 0x7f1200155ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:27.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.010+0000 7f1205f9b700 1 -- 172.21.15.45:0/1218529269 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11fc009550 con 0x7f12000cd7c0 2023-11-28T12:12:27.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.010+0000 7f1205f9b700 1 --2- 172.21.15.45:0/1218529269 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12000cd7c0 0x7f1200155610 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f11fc000c00 tx=0x7f11fc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:27.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.010+0000 7f11f67fc700 1 -- 172.21.15.45:0/1218529269 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11fc004570 con 0x7f12000cd7c0 2023-11-28T12:12:27.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.010+0000 7f11f67fc700 1 -- 172.21.15.45:0/1218529269 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11fc01f070 con 0x7f12000cd7c0 2023-11-28T12:12:27.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.010+0000 7f11f67fc700 1 -- 172.21.15.45:0/1218529269 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11fc0038c0 con 0x7f12000cd7c0 2023-11-28T12:12:27.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.010+0000 7f12081ff700 1 -- 172.21.15.45:0/1218529269 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12000b5670 con 0x7f12000cd7c0 2023-11-28T12:12:27.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.010+0000 7f12081ff700 1 -- 172.21.15.45:0/1218529269 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12000b5390 con 0x7f12000cd7c0 2023-11-28T12:12:27.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.011+0000 7f12081ff700 1 -- 172.21.15.45:0/1218529269 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1200160720 con 0x7f12000cd7c0 2023-11-28T12:12:27.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.012+0000 7f11f67fc700 1 -- 172.21.15.45:0/1218529269 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f11fc02a020 con 0x7f12000cd7c0 2023-11-28T12:12:27.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.013+0000 7f11f67fc700 1 --2- 172.21.15.45:0/1218529269 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f11e40682f0 0x7f11e406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:27.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.013+0000 7f11f67fc700 1 -- 172.21.15.45:0/1218529269 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f11fc087620 con 0x7f12000cd7c0 2023-11-28T12:12:27.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.013+0000 7f11f67fc700 1 --2- 172.21.15.45:0/1218529269 >> [v2:172.21.15.45:6817/115850,v1:172.21.15.45:6819/115850] conn(0x7f11e406e760 0x7f11e4070b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:27.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.013+0000 7f11f67fc700 1 -- 172.21.15.45:0/1218529269 --> [v2:172.21.15.45:6817/115850,v1:172.21.15.45:6819/115850] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f11e4071240 con 0x7f11e406e760 2023-11-28T12:12:27.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.013+0000 7f11f67fc700 1 -- 172.21.15.45:0/1218529269 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7f11fc087a60 con 0x7f12000cd7c0 2023-11-28T12:12:27.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.013+0000 7f120579a700 1 --2- 172.21.15.45:0/1218529269 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f11e40682f0 0x7f11e406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:27.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.014+0000 7f120679c700 1 --2- 172.21.15.45:0/1218529269 >> [v2:172.21.15.45:6817/115850,v1:172.21.15.45:6819/115850] conn(0x7f11e406e760 0x7f11e4070b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:27.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.014+0000 7f120679c700 1 --2- 172.21.15.45:0/1218529269 >> [v2:172.21.15.45:6817/115850,v1:172.21.15.45:6819/115850] conn(0x7f11e406e760 0x7f11e4070b70 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:27.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.014+0000 7f120579a700 1 --2- 172.21.15.45:0/1218529269 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f11e40682f0 0x7f11e406a7a0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f1200159bd0 tx=0x7f11f0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:27.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.015+0000 7f11f67fc700 1 -- 172.21.15.45:0/1218529269 <== osd.2 v2:172.21.15.45:6817/115850 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f11e4071240 con 0x7f11e406e760 2023-11-28T12:12:27.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.030+0000 7f12081ff700 1 -- 172.21.15.45:0/1218529269 --> [v2:172.21.15.45:6817/115850,v1:172.21.15.45:6819/115850] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f12000c8f00 con 0x7f11e406e760 2023-11-28T12:12:27.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.030+0000 7f11f67fc700 1 -- 172.21.15.45:0/1218529269 <== osd.2 v2:172.21.15.45:6817/115850 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f11f8003a00 con 0x7f11e406e760 2023-11-28T12:12:27.032 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-11-28T12:12:27.032 INFO:teuthology.orchestra.run.smithi045.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-28T12:12:27.033 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-11-28T12:12:27.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.030+0000 7f12081ff700 1 -- 172.21.15.45:0/1218529269 >> [v2:172.21.15.45:6817/115850,v1:172.21.15.45:6819/115850] conn(0x7f11e406e760 msgr2=0x7f11e4070b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:27.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.031+0000 7f12081ff700 1 --2- 172.21.15.45:0/1218529269 >> [v2:172.21.15.45:6817/115850,v1:172.21.15.45:6819/115850] conn(0x7f11e406e760 0x7f11e4070b70 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:27.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.031+0000 7f12081ff700 1 -- 172.21.15.45:0/1218529269 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f11e40682f0 msgr2=0x7f11e406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:27.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.031+0000 7f12081ff700 1 --2- 172.21.15.45:0/1218529269 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f11e40682f0 0x7f11e406a7a0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f1200159bd0 tx=0x7f11f0008040 comp rx=0 tx=0).stop 2023-11-28T12:12:27.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.031+0000 7f12081ff700 1 -- 172.21.15.45:0/1218529269 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12000cd7c0 msgr2=0x7f1200155610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:27.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.031+0000 7f12081ff700 1 --2- 172.21.15.45:0/1218529269 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12000cd7c0 0x7f1200155610 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f11fc000c00 tx=0x7f11fc004750 comp rx=0 tx=0).stop 2023-11-28T12:12:27.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.031+0000 7f120679c700 1 -- 172.21.15.45:0/1218529269 reap_dead start 2023-11-28T12:12:27.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.031+0000 7f12081ff700 1 -- 172.21.15.45:0/1218529269 shutdown_connections 2023-11-28T12:12:27.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.031+0000 7f12081ff700 1 -- 172.21.15.45:0/1218529269 >> 172.21.15.45:0/1218529269 conn(0x7f1200072620 msgr2=0x7f120015d400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:27.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.031+0000 7f12081ff700 1 -- 172.21.15.45:0/1218529269 shutdown_connections 2023-11-28T12:12:27.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.031+0000 7f12081ff700 1 -- 172.21.15.45:0/1218529269 wait complete. 2023-11-28T12:12:27.050 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-11-28T12:12:27.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.255+0000 7f05c69ff700 1 Processor -- start 2023-11-28T12:12:27.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.255+0000 7f05c69ff700 1 -- start start 2023-11-28T12:12:27.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.256+0000 7f05c69ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f05c015c9b0 0x7f05c00b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:27.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.256+0000 7f05c69ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f05c00cd7c0 0x7f05c00cdc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:27.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.256+0000 7f05c69ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05c00ce160 con 0x7f05c0161340 2023-11-28T12:12:27.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.256+0000 7f05c69ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05c00b5800 con 0x7f05c00cd7c0 2023-11-28T12:12:27.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.256+0000 7f05c69ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05c00d1950 con 0x7f05c015c9b0 2023-11-28T12:12:27.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.257+0000 7f05c4f9c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f05c00cd7c0 0x7f05c00cdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:27.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.257+0000 7f05c4f9c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f05c00cd7c0 0x7f05c00cdc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56204/0 (socket says 172.21.15.45:56204) 2023-11-28T12:12:27.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.257+0000 7f05c4f9c700 1 -- 172.21.15.45:0/2982303947 learned_addr learned my addr 172.21.15.45:0/2982303947 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:12:27.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.257+0000 7f05bffff700 1 --2- 172.21.15.45:0/2982303947 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f05c015c9b0 0x7f05c00b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:27.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.257+0000 7f05c4f9c700 1 -- 172.21.15.45:0/2982303947 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f05c015c9b0 msgr2=0x7f05c00b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:12:27.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.257+0000 7f05c4f9c700 1 --2- 172.21.15.45:0/2982303947 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f05c015c9b0 0x7f05c00b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:27.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.257+0000 7f05c4f9c700 1 -- 172.21.15.45:0/2982303947 >> v1:172.21.15.152:6789/0 conn(0x7f05c0161340 legacy=0x7f05c00d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:27.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.257+0000 7f05c4f9c700 1 -- 172.21.15.45:0/2982303947 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05c00d24f0 con 0x7f05c00cd7c0 2023-11-28T12:12:27.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.257+0000 7f05c4f9c700 1 --2- 172.21.15.45:0/2982303947 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05c00cd7c0 0x7f05c00cdc20 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f05b8009e50 tx=0x7f05b800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6469c7bda7cb6485 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:27.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.258+0000 7f05beffd700 1 -- 172.21.15.45:0/2982303947 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b800e070 con 0x7f05c00cd7c0 2023-11-28T12:12:27.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.258+0000 7f05beffd700 1 -- 172.21.15.45:0/2982303947 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05b800b9c0 con 0x7f05c00cd7c0 2023-11-28T12:12:27.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.258+0000 7f05beffd700 1 -- 172.21.15.45:0/2982303947 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b800bd70 con 0x7f05c00cd7c0 2023-11-28T12:12:27.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.258+0000 7f05c69ff700 1 -- 172.21.15.45:0/2982303947 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05c00cd7c0 msgr2=0x7f05c00cdc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:27.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.258+0000 7f05c69ff700 1 --2- 172.21.15.45:0/2982303947 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05c00cd7c0 0x7f05c00cdc20 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f05b8009e50 tx=0x7f05b800b330 comp rx=0 tx=0).stop 2023-11-28T12:12:27.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.258+0000 7f05c69ff700 1 -- 172.21.15.45:0/2982303947 shutdown_connections 2023-11-28T12:12:27.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.258+0000 7f05c69ff700 1 --2- 172.21.15.45:0/2982303947 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f05c015c9b0 0x7f05c00b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:27.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.258+0000 7f05c69ff700 1 --2- 172.21.15.45:0/2982303947 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05c00cd7c0 0x7f05c00cdc20 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:27.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.258+0000 7f05c69ff700 1 -- 172.21.15.45:0/2982303947 >> 172.21.15.45:0/2982303947 conn(0x7f05c0072600 msgr2=0x7f05c00cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:27.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.258+0000 7f05c69ff700 1 -- 172.21.15.45:0/2982303947 shutdown_connections 2023-11-28T12:12:27.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.258+0000 7f05c69ff700 1 -- 172.21.15.45:0/2982303947 wait complete. 2023-11-28T12:12:27.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.260+0000 7f05c69ff700 1 Processor -- start 2023-11-28T12:12:27.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.260+0000 7f05c69ff700 1 -- start start 2023-11-28T12:12:27.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.261+0000 7f05c69ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f05c00cd7c0 0x7f05c01f65b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:27.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.261+0000 7f05c69ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05c015c9b0 0x7f05c00c9120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:27.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.261+0000 7f05c69ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f05c0161340 0x7f05c00c9660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:27.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.261+0000 7f05c69ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c015d8c0 con 0x7f05c015c9b0 2023-11-28T12:12:27.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.261+0000 7f05c69ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c00cabf0 con 0x7f05c0161340 2023-11-28T12:12:27.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.261+0000 7f05c69ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05c00cd3f0 con 0x7f05c00cd7c0 2023-11-28T12:12:27.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.261+0000 7f05bf7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05c015c9b0 0x7f05c00c9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:27.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.262+0000 7f05bf7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05c015c9b0 0x7f05c00c9120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56214/0 (socket says 172.21.15.45:56214) 2023-11-28T12:12:27.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.262+0000 7f05bf7fe700 1 -- 172.21.15.45:0/2093989344 learned_addr learned my addr 172.21.15.45:0/2093989344 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:12:27.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.262+0000 7f05bffff700 1 --2- 172.21.15.45:0/2093989344 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f05c00cd7c0 0x7f05c01f65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:27.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.262+0000 7f05c4f9c700 1 --2- 172.21.15.45:0/2093989344 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f05c0161340 0x7f05c00c9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:27.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.262+0000 7f05bf7fe700 1 -- 172.21.15.45:0/2093989344 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f05c00cd7c0 msgr2=0x7f05c01f65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:27.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.262+0000 7f05bf7fe700 1 --2- 172.21.15.45:0/2093989344 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f05c00cd7c0 0x7f05c01f65b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:27.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.262+0000 7f05bf7fe700 1 -- 172.21.15.45:0/2093989344 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f05c0161340 msgr2=0x7f05c00c9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:27.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.262+0000 7f05bf7fe700 1 --2- 172.21.15.45:0/2093989344 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f05c0161340 0x7f05c00c9660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:27.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.262+0000 7f05bf7fe700 1 -- 172.21.15.45:0/2093989344 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05b8009b30 con 0x7f05c015c9b0 2023-11-28T12:12:27.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.262+0000 7f05bf7fe700 1 --2- 172.21.15.45:0/2093989344 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05c015c9b0 0x7f05c00c9120 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f05b400c450 tx=0x7f05b400c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:27.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.262+0000 7f05bcff9700 1 -- 172.21.15.45:0/2093989344 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b40052d0 con 0x7f05c015c9b0 2023-11-28T12:12:27.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.262+0000 7f05bcff9700 1 -- 172.21.15.45:0/2093989344 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05b4005430 con 0x7f05c015c9b0 2023-11-28T12:12:27.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.262+0000 7f05c69ff700 1 -- 172.21.15.45:0/2093989344 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05c00d1300 con 0x7f05c015c9b0 2023-11-28T12:12:27.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.263+0000 7f05bcff9700 1 -- 172.21.15.45:0/2093989344 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b40038c0 con 0x7f05c015c9b0 2023-11-28T12:12:27.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.263+0000 7f05c69ff700 1 -- 172.21.15.45:0/2093989344 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05c00b5520 con 0x7f05c015c9b0 2023-11-28T12:12:27.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.264+0000 7f05c69ff700 1 -- 172.21.15.45:0/2093989344 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05c00d15e0 con 0x7f05c015c9b0 2023-11-28T12:12:27.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.265+0000 7f05bcff9700 1 -- 172.21.15.45:0/2093989344 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f05b4019030 con 0x7f05c015c9b0 2023-11-28T12:12:27.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.266+0000 7f05bcff9700 1 --2- 172.21.15.45:0/2093989344 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f05ac0682f0 0x7f05ac06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:27.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.266+0000 7f05bcff9700 1 -- 172.21.15.45:0/2093989344 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f05b4084be0 con 0x7f05c015c9b0 2023-11-28T12:12:27.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.266+0000 7f05bffff700 1 --2- 172.21.15.45:0/2093989344 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f05ac0682f0 0x7f05ac06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:27.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.267+0000 7f05bffff700 1 --2- 172.21.15.45:0/2093989344 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f05ac0682f0 0x7f05ac06a7a0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f05b0007a30 tx=0x7f05b0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:27.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.270+0000 7f05bcff9700 1 -- 172.21.15.45:0/2093989344 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f05b4051670 con 0x7f05c015c9b0 2023-11-28T12:12:27.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.472+0000 7f05c69ff700 1 -- 172.21.15.45:0/2093989344 --> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f05c00cce90 con 0x7f05ac0682f0 2023-11-28T12:12:27.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.473+0000 7f05bcff9700 1 -- 172.21.15.45:0/2093989344 <== mgr.4100 v2:172.21.15.152:6832/115389 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f05c00cce90 con 0x7f05ac0682f0 2023-11-28T12:12:27.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.475+0000 7f05c69ff700 1 -- 172.21.15.45:0/2093989344 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f05ac0682f0 msgr2=0x7f05ac06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:27.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.475+0000 7f05c69ff700 1 --2- 172.21.15.45:0/2093989344 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f05ac0682f0 0x7f05ac06a7a0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f05b0007a30 tx=0x7f05b0008040 comp rx=0 tx=0).stop 2023-11-28T12:12:27.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.475+0000 7f05c69ff700 1 -- 172.21.15.45:0/2093989344 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05c015c9b0 msgr2=0x7f05c00c9120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:27.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.475+0000 7f05c69ff700 1 --2- 172.21.15.45:0/2093989344 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05c015c9b0 0x7f05c00c9120 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f05b400c450 tx=0x7f05b400c760 comp rx=0 tx=0).stop 2023-11-28T12:12:27.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.475+0000 7f05c69ff700 1 -- 172.21.15.45:0/2093989344 shutdown_connections 2023-11-28T12:12:27.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.475+0000 7f05c69ff700 1 --2- 172.21.15.45:0/2093989344 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f05ac0682f0 0x7f05ac06a7a0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:27.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.475+0000 7f05c69ff700 1 --2- 172.21.15.45:0/2093989344 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f05c0161340 0x7f05c00c9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:27.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.475+0000 7f05c69ff700 1 --2- 172.21.15.45:0/2093989344 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f05c00cd7c0 0x7f05c01f65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:27.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.475+0000 7f05c69ff700 1 --2- 172.21.15.45:0/2093989344 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05c015c9b0 0x7f05c00c9120 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:27.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.475+0000 7f05c69ff700 1 -- 172.21.15.45:0/2093989344 >> 172.21.15.45:0/2093989344 conn(0x7f05c0072600 msgr2=0x7f05c0154530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:27.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.475+0000 7f05c69ff700 1 -- 172.21.15.45:0/2093989344 shutdown_connections 2023-11-28T12:12:27.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.475+0000 7f05c69ff700 1 -- 172.21.15.45:0/2093989344 wait complete. 2023-11-28T12:12:27.479 INFO:teuthology.orchestra.run.smithi045.stderr:instructed osd(s) 2 to deep-scrub 2023-11-28T12:12:27.494 INFO:tasks.ceph:Scrubbing osd.3 2023-11-28T12:12:27.495 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-11-28T12:12:27.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.720+0000 7f5d43bff700 1 Processor -- start 2023-11-28T12:12:27.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.720+0000 7f5d43bff700 1 -- start start 2023-11-28T12:12:27.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.721+0000 7f5d43bff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f5d3c15a760 0x7f5d3c161200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:27.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.721+0000 7f5d43bff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5d3c0cded0 0x7f5d3c0b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:27.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.721+0000 7f5d43bff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d3c15e0a0 con 0x7f5d3c15dc30 2023-11-28T12:12:27.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.721+0000 7f5d43bff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d3c15ab30 con 0x7f5d3c0cded0 2023-11-28T12:12:27.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.721+0000 7f5d43bff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d3c160d70 con 0x7f5d3c15a760 2023-11-28T12:12:27.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.721+0000 7f5d4219c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5d3c0cded0 0x7f5d3c0b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:27.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.721+0000 7f5d4219c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5d3c0cded0 0x7f5d3c0b4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56224/0 (socket says 172.21.15.45:56224) 2023-11-28T12:12:27.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.721+0000 7f5d4219c700 1 -- 172.21.15.45:0/893181326 learned_addr learned my addr 172.21.15.45:0/893181326 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:12:27.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.721+0000 7f5d4119a700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f5d3c15dc30 0x7f5d3c0cd7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44070/0 (socket says 172.21.15.45:44070) 2023-11-28T12:12:27.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.722+0000 7f5d4199b700 1 --2- 172.21.15.45:0/893181326 >> v2:172.21.15.152:3300/0 conn(0x7f5d3c15a760 0x7f5d3c161200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:27.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.722+0000 7f5d4219c700 1 -- 172.21.15.45:0/893181326 >> v2:172.21.15.152:3300/0 conn(0x7f5d3c15a760 msgr2=0x7f5d3c161200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:12:27.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.722+0000 7f5d4219c700 1 --2- 172.21.15.45:0/893181326 >> v2:172.21.15.152:3300/0 conn(0x7f5d3c15a760 0x7f5d3c161200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:27.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.722+0000 7f5d4219c700 1 -- 172.21.15.45:0/893181326 >> v1:172.21.15.45:6789/0 conn(0x7f5d3c15dc30 legacy=0x7f5d3c0cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:27.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.722+0000 7f5d4219c700 1 -- 172.21.15.45:0/893181326 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d3c0b5130 con 0x7f5d3c0cded0 2023-11-28T12:12:27.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.722+0000 7f5d40999700 1 -- 172.21.15.45:0/893181326 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 668128807 0 0) 0x7f5d3c15e0a0 con 0x7f5d3c15dc30 2023-11-28T12:12:27.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.722+0000 7f5d4219c700 1 --2- 172.21.15.45:0/893181326 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d3c0cded0 0x7f5d3c0b4bf0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c08bff0 tx=0x7f5d3400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3add5076445302a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:27.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.722+0000 7f5d40999700 1 -- 172.21.15.45:0/893181326 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d3400e070 con 0x7f5d3c0cded0 2023-11-28T12:12:27.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.722+0000 7f5d40999700 1 -- 172.21.15.45:0/893181326 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d3400b910 con 0x7f5d3c0cded0 2023-11-28T12:12:27.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.722+0000 7f5d40999700 1 -- 172.21.15.45:0/893181326 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d3400bcc0 con 0x7f5d3c0cded0 2023-11-28T12:12:27.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.723+0000 7f5d43bff700 1 -- 172.21.15.45:0/893181326 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d3c0cded0 msgr2=0x7f5d3c0b4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:27.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.723+0000 7f5d43bff700 1 --2- 172.21.15.45:0/893181326 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d3c0cded0 0x7f5d3c0b4bf0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c08bff0 tx=0x7f5d3400b330 comp rx=0 tx=0).stop 2023-11-28T12:12:27.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.723+0000 7f5d43bff700 1 -- 172.21.15.45:0/893181326 shutdown_connections 2023-11-28T12:12:27.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.723+0000 7f5d43bff700 1 --2- 172.21.15.45:0/893181326 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d3c0cded0 0x7f5d3c0b4bf0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:27.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.723+0000 7f5d43bff700 1 --2- 172.21.15.45:0/893181326 >> v2:172.21.15.152:3300/0 conn(0x7f5d3c15a760 0x7f5d3c161200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:27.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.723+0000 7f5d43bff700 1 -- 172.21.15.45:0/893181326 >> 172.21.15.45:0/893181326 conn(0x7f5d3c072620 msgr2=0x7f5d3c0cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:27.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.723+0000 7f5d43bff700 1 -- 172.21.15.45:0/893181326 shutdown_connections 2023-11-28T12:12:27.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.723+0000 7f5d43bff700 1 -- 172.21.15.45:0/893181326 wait complete. 2023-11-28T12:12:27.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.725+0000 7f5d43bff700 1 Processor -- start 2023-11-28T12:12:27.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.725+0000 7f5d43bff700 1 -- start start 2023-11-28T12:12:27.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.726+0000 7f5d43bff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5d3c0cded0 0x7f5d3c0c9600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:27.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.726+0000 7f5d43bff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5d3c15a760 0x7f5d3c14e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:27.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.726+0000 7f5d43bff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d3c15dc30 0x7f5d3c1f57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:27.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.726+0000 7f5d43bff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d3c0cc4e0 con 0x7f5d3c15dc30 2023-11-28T12:12:27.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.726+0000 7f5d43bff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d3c0c9b40 con 0x7f5d3c0cded0 2023-11-28T12:12:27.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.726+0000 7f5d43bff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d3c0b8d90 con 0x7f5d3c15a760 2023-11-28T12:12:27.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.726+0000 7f5d4219c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d3c15dc30 0x7f5d3c1f57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:27.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.726+0000 7f5d4219c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d3c15dc30 0x7f5d3c1f57b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56240/0 (socket says 172.21.15.45:56240) 2023-11-28T12:12:27.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.726+0000 7f5d4219c700 1 -- 172.21.15.45:0/1740254411 learned_addr learned my addr 172.21.15.45:0/1740254411 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:12:27.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.726+0000 7f5d4119a700 1 --2- 172.21.15.45:0/1740254411 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5d3c15a760 0x7f5d3c14e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:27.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.726+0000 7f5d4199b700 1 --2- 172.21.15.45:0/1740254411 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5d3c0cded0 0x7f5d3c0c9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:27.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.726+0000 7f5d4219c700 1 -- 172.21.15.45:0/1740254411 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5d3c15a760 msgr2=0x7f5d3c14e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:27.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.726+0000 7f5d4219c700 1 --2- 172.21.15.45:0/1740254411 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f5d3c15a760 0x7f5d3c14e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:27.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.726+0000 7f5d4219c700 1 -- 172.21.15.45:0/1740254411 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5d3c0cded0 msgr2=0x7f5d3c0c9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:27.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.726+0000 7f5d4219c700 1 --2- 172.21.15.45:0/1740254411 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5d3c0cded0 0x7f5d3c0c9600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:27.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.726+0000 7f5d4219c700 1 -- 172.21.15.45:0/1740254411 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d34009b30 con 0x7f5d3c15dc30 2023-11-28T12:12:27.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.727+0000 7f5d4219c700 1 --2- 172.21.15.45:0/1740254411 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d3c15dc30 0x7f5d3c1f57b0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c0675d0 tx=0x7f5d34004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:27.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.727+0000 7f5d327fc700 1 -- 172.21.15.45:0/1740254411 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d34004960 con 0x7f5d3c15dc30 2023-11-28T12:12:27.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.727+0000 7f5d327fc700 1 -- 172.21.15.45:0/1740254411 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d340092e0 con 0x7f5d3c15dc30 2023-11-28T12:12:27.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.727+0000 7f5d43bff700 1 -- 172.21.15.45:0/1740254411 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d3c0b5670 con 0x7f5d3c15dc30 2023-11-28T12:12:27.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.727+0000 7f5d327fc700 1 -- 172.21.15.45:0/1740254411 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d3401c640 con 0x7f5d3c15dc30 2023-11-28T12:12:27.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.727+0000 7f5d43bff700 1 -- 172.21.15.45:0/1740254411 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d3c0b5390 con 0x7f5d3c15dc30 2023-11-28T12:12:27.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.728+0000 7f5d43bff700 1 -- 172.21.15.45:0/1740254411 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5d3c160720 con 0x7f5d3c15dc30 2023-11-28T12:12:27.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.729+0000 7f5d327fc700 1 -- 172.21.15.45:0/1740254411 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f5d3402c070 con 0x7f5d3c15dc30 2023-11-28T12:12:27.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.730+0000 7f5d327fc700 1 --2- 172.21.15.45:0/1740254411 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5d200682f0 0x7f5d2006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:27.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.730+0000 7f5d327fc700 1 -- 172.21.15.45:0/1740254411 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f5d34087c30 con 0x7f5d3c15dc30 2023-11-28T12:12:27.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.730+0000 7f5d327fc700 1 --2- 172.21.15.45:0/1740254411 >> [v2:172.21.15.45:6816/115848,v1:172.21.15.45:6818/115848] conn(0x7f5d2006e5f0 0x7f5d20070a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:27.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.730+0000 7f5d327fc700 1 -- 172.21.15.45:0/1740254411 --> [v2:172.21.15.45:6816/115848,v1:172.21.15.45:6818/115848] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5d200710d0 con 0x7f5d2006e5f0 2023-11-28T12:12:27.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.730+0000 7f5d327fc700 1 -- 172.21.15.45:0/1740254411 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5d34087fa0 con 0x7f5d3c15dc30 2023-11-28T12:12:27.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.730+0000 7f5d4199b700 1 --2- 172.21.15.45:0/1740254411 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5d200682f0 0x7f5d2006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:27.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.730+0000 7f5d4119a700 1 --2- 172.21.15.45:0/1740254411 >> [v2:172.21.15.45:6816/115848,v1:172.21.15.45:6818/115848] conn(0x7f5d2006e5f0 0x7f5d20070a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:27.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.731+0000 7f5d4119a700 1 --2- 172.21.15.45:0/1740254411 >> [v2:172.21.15.45:6816/115848,v1:172.21.15.45:6818/115848] conn(0x7f5d2006e5f0 0x7f5d20070a00 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:27.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.731+0000 7f5d4199b700 1 --2- 172.21.15.45:0/1740254411 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5d200682f0 0x7f5d2006a7a0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f5d38009b70 tx=0x7f5d38008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:27.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.732+0000 7f5d327fc700 1 -- 172.21.15.45:0/1740254411 <== osd.3 v2:172.21.15.45:6816/115848 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f5d200710d0 con 0x7f5d2006e5f0 2023-11-28T12:12:27.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.747+0000 7f5d43bff700 1 -- 172.21.15.45:0/1740254411 --> [v2:172.21.15.45:6816/115848,v1:172.21.15.45:6818/115848] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f5d3c0cc620 con 0x7f5d2006e5f0 2023-11-28T12:12:27.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.747+0000 7f5d327fc700 1 -- 172.21.15.45:0/1740254411 <== osd.3 v2:172.21.15.45:6816/115848 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f5d3c0cc620 con 0x7f5d2006e5f0 2023-11-28T12:12:27.748 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-11-28T12:12:27.749 INFO:teuthology.orchestra.run.smithi045.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-28T12:12:27.749 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-11-28T12:12:27.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.748+0000 7f5d43bff700 1 -- 172.21.15.45:0/1740254411 >> [v2:172.21.15.45:6816/115848,v1:172.21.15.45:6818/115848] conn(0x7f5d2006e5f0 msgr2=0x7f5d20070a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:27.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.748+0000 7f5d43bff700 1 --2- 172.21.15.45:0/1740254411 >> [v2:172.21.15.45:6816/115848,v1:172.21.15.45:6818/115848] conn(0x7f5d2006e5f0 0x7f5d20070a00 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:27.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.748+0000 7f5d43bff700 1 -- 172.21.15.45:0/1740254411 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5d200682f0 msgr2=0x7f5d2006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:27.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.748+0000 7f5d43bff700 1 --2- 172.21.15.45:0/1740254411 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f5d200682f0 0x7f5d2006a7a0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f5d38009b70 tx=0x7f5d38008040 comp rx=0 tx=0).stop 2023-11-28T12:12:27.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.748+0000 7f5d43bff700 1 -- 172.21.15.45:0/1740254411 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d3c15dc30 msgr2=0x7f5d3c1f57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:27.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.748+0000 7f5d43bff700 1 --2- 172.21.15.45:0/1740254411 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d3c15dc30 0x7f5d3c1f57b0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c0675d0 tx=0x7f5d34004ad0 comp rx=0 tx=0).stop 2023-11-28T12:12:27.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.748+0000 7f5d4219c700 1 -- 172.21.15.45:0/1740254411 reap_dead start 2023-11-28T12:12:27.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.748+0000 7f5d43bff700 1 -- 172.21.15.45:0/1740254411 shutdown_connections 2023-11-28T12:12:27.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.748+0000 7f5d43bff700 1 -- 172.21.15.45:0/1740254411 >> 172.21.15.45:0/1740254411 conn(0x7f5d3c072620 msgr2=0x7f5d3c0b3850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:27.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.748+0000 7f5d43bff700 1 -- 172.21.15.45:0/1740254411 shutdown_connections 2023-11-28T12:12:27.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.748+0000 7f5d43bff700 1 -- 172.21.15.45:0/1740254411 wait complete. 2023-11-28T12:12:27.766 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-11-28T12:12:27.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.974+0000 7f14e5fff700 1 Processor -- start 2023-11-28T12:12:27.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.974+0000 7f14e5fff700 1 -- start start 2023-11-28T12:12:27.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.975+0000 7f14e5fff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f14e00b20b0 0x7f14e00b0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:27.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.975+0000 7f14e5fff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14e00b0230 con 0x7f14e00d1330 2023-11-28T12:12:27.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.975+0000 7f14e5fff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14e00b4570 con 0x7f14e00d01b0 2023-11-28T12:12:27.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.975+0000 7f14e5fff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14e015cec0 con 0x7f14e00b20b0 2023-11-28T12:12:27.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.975+0000 7f14deffd700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f14e00d1330 0x7f14e00b06c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44082/0 (socket says 172.21.15.45:44082) 2023-11-28T12:12:27.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.975+0000 7f14deffd700 1 -- 172.21.15.45:0/521901119 learned_addr learned my addr 172.21.15.45:0/521901119 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:12:27.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.975+0000 7f14dffff700 1 --2- 172.21.15.45:0/521901119 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f14e00b20b0 0x7f14e00b0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:27.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.976+0000 7f14de7fc700 1 -- 172.21.15.45:0/521901119 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2451759463 0 0) 0x7f14e00b0230 con 0x7f14e00d1330 2023-11-28T12:12:27.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.976+0000 7f14de7fc700 1 -- 172.21.15.45:0/521901119 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14c80035b0 con 0x7f14e00d1330 2023-11-28T12:12:27.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.976+0000 7f14de7fc700 1 -- 172.21.15.45:0/521901119 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3135459937 0 0) 0x7f14e00b4570 con 0x7f14e00d01b0 2023-11-28T12:12:27.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.976+0000 7f14de7fc700 1 -- 172.21.15.45:0/521901119 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14e00b0230 con 0x7f14e00d01b0 2023-11-28T12:12:27.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.976+0000 7f14de7fc700 1 -- 172.21.15.45:0/521901119 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2683425642 0 0) 0x7f14c80035b0 con 0x7f14e00d1330 2023-11-28T12:12:27.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.976+0000 7f14de7fc700 1 -- 172.21.15.45:0/521901119 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f14e00b20b0 msgr2=0x7f14e00b0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:12:27.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.976+0000 7f14de7fc700 1 --2- 172.21.15.45:0/521901119 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f14e00b20b0 0x7f14e00b0dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:27.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.976+0000 7f14de7fc700 1 -- 172.21.15.45:0/521901119 >> v1:172.21.15.152:6789/0 conn(0x7f14e00d01b0 legacy=0x7f14e00d0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:27.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.976+0000 7f14de7fc700 1 -- 172.21.15.45:0/521901119 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14e00b4850 con 0x7f14e00d1330 2023-11-28T12:12:27.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.976+0000 7f14de7fc700 1 -- 172.21.15.45:0/521901119 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3460218165 0 0) 0x7f14d4001670 con 0x7f14e00d1330 2023-11-28T12:12:27.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.976+0000 7f14de7fc700 1 -- 172.21.15.45:0/521901119 >> v1:172.21.15.45:6789/0 conn(0x7f14e00d1330 legacy=0x7f14e00b06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:27.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.976+0000 7f14de7fc700 1 --2- 172.21.15.45:0/521901119 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14c8003bc0 0x7f14c8003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:27.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.976+0000 7f14de7fc700 1 --2- 172.21.15.45:0/521901119 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14c8004850 0x7f14c8004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:27.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.976+0000 7f14de7fc700 1 --2- 172.21.15.45:0/521901119 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f14e00b20b0 0x7f14c8005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:27.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.976+0000 7f14de7fc700 1 -- 172.21.15.45:0/521901119 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14e015cec0 con 0x7f14c8003bc0 2023-11-28T12:12:27.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.976+0000 7f14de7fc700 1 -- 172.21.15.45:0/521901119 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14c800bac0 con 0x7f14c8004850 2023-11-28T12:12:27.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.976+0000 7f14de7fc700 1 -- 172.21.15.45:0/521901119 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14c800bc30 con 0x7f14e00b20b0 2023-11-28T12:12:27.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.976+0000 7f14df7fe700 1 --2- 172.21.15.45:0/521901119 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14c8003bc0 0x7f14c8003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:27.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.977+0000 7f14deffd700 1 --2- 172.21.15.45:0/521901119 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14c8004850 0x7f14c8004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:27.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.977+0000 7f14dffff700 1 --2- 172.21.15.45:0/521901119 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f14e00b20b0 0x7f14c8005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:27.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.977+0000 7f14df7fe700 1 -- 172.21.15.45:0/521901119 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f14e00b20b0 msgr2=0x7f14c8005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:12:27.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.977+0000 7f14df7fe700 1 --2- 172.21.15.45:0/521901119 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f14e00b20b0 0x7f14c8005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:27.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.977+0000 7f14df7fe700 1 -- 172.21.15.45:0/521901119 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14c8004850 msgr2=0x7f14c8004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:12:27.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.977+0000 7f14df7fe700 1 --2- 172.21.15.45:0/521901119 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14c8004850 0x7f14c8004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:27.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.977+0000 7f14df7fe700 1 -- 172.21.15.45:0/521901119 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14c80035b0 con 0x7f14c8003bc0 2023-11-28T12:12:27.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.977+0000 7f14df7fe700 1 --2- 172.21.15.45:0/521901119 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14c8003bc0 0x7f14c8003fb0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f14d0001980 tx=0x7f14c8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40f45153cc3e85dc server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:27.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.977+0000 7f14de7fc700 1 -- 172.21.15.45:0/521901119 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d0001470 con 0x7f14c8003bc0 2023-11-28T12:12:27.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.977+0000 7f14de7fc700 1 -- 172.21.15.45:0/521901119 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14d00052d0 con 0x7f14c8003bc0 2023-11-28T12:12:27.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.977+0000 7f14de7fc700 1 -- 172.21.15.45:0/521901119 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d0003680 con 0x7f14c8003bc0 2023-11-28T12:12:27.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.978+0000 7f14e5fff700 1 -- 172.21.15.45:0/521901119 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14c8003bc0 msgr2=0x7f14c8003fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:27.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.978+0000 7f14e5fff700 1 --2- 172.21.15.45:0/521901119 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14c8003bc0 0x7f14c8003fb0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f14d0001980 tx=0x7f14c8005880 comp rx=0 tx=0).stop 2023-11-28T12:12:27.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.978+0000 7f14dffff700 1 -- 172.21.15.45:0/521901119 reap_dead start 2023-11-28T12:12:27.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.978+0000 7f14e5fff700 1 -- 172.21.15.45:0/521901119 shutdown_connections 2023-11-28T12:12:27.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.978+0000 7f14e5fff700 1 -- 172.21.15.45:0/521901119 >> 172.21.15.45:0/521901119 conn(0x7f14e009c3f0 msgr2=0x7f14e00d3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:27.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.978+0000 7f14e5fff700 1 -- 172.21.15.45:0/521901119 shutdown_connections 2023-11-28T12:12:27.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.978+0000 7f14e5fff700 1 -- 172.21.15.45:0/521901119 wait complete. 2023-11-28T12:12:27.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.980+0000 7f14e5fff700 1 Processor -- start 2023-11-28T12:12:27.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.980+0000 7f14e5fff700 1 -- start start 2023-11-28T12:12:27.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.981+0000 7f14e5fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14c8003bc0 0x7f14e00c9770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:27.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.981+0000 7f14e5fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14e015d000 0x7f14e015d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:27.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.981+0000 7f14e5fff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f14e015f0a0 0x7f14e015f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:27.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.981+0000 7f14e5fff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14e014d260 con 0x7f14e015d000 2023-11-28T12:12:27.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.981+0000 7f14e5fff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14e015d9b0 con 0x7f14c8003bc0 2023-11-28T12:12:27.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.981+0000 7f14e5fff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14e0146e70 con 0x7f14e015f0a0 2023-11-28T12:12:27.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.981+0000 7f14deffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14e015d000 0x7f14e015d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:27.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.981+0000 7f14deffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14e015d000 0x7f14e015d470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56258/0 (socket says 172.21.15.45:56258) 2023-11-28T12:12:27.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.981+0000 7f14deffd700 1 -- 172.21.15.45:0/3430538280 learned_addr learned my addr 172.21.15.45:0/3430538280 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:12:27.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.981+0000 7f14df7fe700 1 --2- 172.21.15.45:0/3430538280 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14c8003bc0 0x7f14e00c9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:27.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.982+0000 7f14dffff700 1 --2- 172.21.15.45:0/3430538280 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f14e015f0a0 0x7f14e015f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:27.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.982+0000 7f14deffd700 1 -- 172.21.15.45:0/3430538280 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f14e015f0a0 msgr2=0x7f14e015f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:27.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.982+0000 7f14deffd700 1 --2- 172.21.15.45:0/3430538280 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f14e015f0a0 0x7f14e015f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:27.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.982+0000 7f14deffd700 1 -- 172.21.15.45:0/3430538280 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14c8003bc0 msgr2=0x7f14e00c9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:27.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.982+0000 7f14deffd700 1 --2- 172.21.15.45:0/3430538280 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14c8003bc0 0x7f14e00c9770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:27.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.982+0000 7f14deffd700 1 -- 172.21.15.45:0/3430538280 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14e00afec0 con 0x7f14e015d000 2023-11-28T12:12:27.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.982+0000 7f14deffd700 1 --2- 172.21.15.45:0/3430538280 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14e015d000 0x7f14e015d470 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f14d4007310 tx=0x7f14d4007620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:27.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.982+0000 7f14c7fff700 1 -- 172.21.15.45:0/3430538280 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d4007800 con 0x7f14e015d000 2023-11-28T12:12:27.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.982+0000 7f14c7fff700 1 -- 172.21.15.45:0/3430538280 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14d400f870 con 0x7f14e015d000 2023-11-28T12:12:27.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.982+0000 7f14e5fff700 1 -- 172.21.15.45:0/3430538280 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14e00afbe0 con 0x7f14e015d000 2023-11-28T12:12:27.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.982+0000 7f14c7fff700 1 -- 172.21.15.45:0/3430538280 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d400fc00 con 0x7f14e015d000 2023-11-28T12:12:27.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.982+0000 7f14e5fff700 1 -- 172.21.15.45:0/3430538280 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14e00b2600 con 0x7f14e015d000 2023-11-28T12:12:27.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.983+0000 7f14e5fff700 1 -- 172.21.15.45:0/3430538280 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14e0068690 con 0x7f14e015d000 2023-11-28T12:12:27.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.984+0000 7f14c7fff700 1 -- 172.21.15.45:0/3430538280 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f14d400fd60 con 0x7f14e015d000 2023-11-28T12:12:27.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.985+0000 7f14c7fff700 1 --2- 172.21.15.45:0/3430538280 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f14cc0682f0 0x7f14cc06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:27.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.985+0000 7f14c7fff700 1 -- 172.21.15.45:0/3430538280 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f14d4085c10 con 0x7f14e015d000 2023-11-28T12:12:27.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.986+0000 7f14df7fe700 1 --2- 172.21.15.45:0/3430538280 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f14cc0682f0 0x7f14cc06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:27.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.987+0000 7f14df7fe700 1 --2- 172.21.15.45:0/3430538280 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f14cc0682f0 0x7f14cc06a7a0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f14d0015040 tx=0x7f14d000a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:27.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:27.989+0000 7f14c7fff700 1 -- 172.21.15.45:0/3430538280 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f14d40526a0 con 0x7f14e015d000 2023-11-28T12:12:28.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.194+0000 7f14e5fff700 1 -- 172.21.15.45:0/3430538280 --> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f14e00c9cb0 con 0x7f14cc0682f0 2023-11-28T12:12:28.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.195+0000 7f14c7fff700 1 -- 172.21.15.45:0/3430538280 <== mgr.4100 v2:172.21.15.152:6832/115389 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f14e00c9cb0 con 0x7f14cc0682f0 2023-11-28T12:12:28.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.197+0000 7f14e5fff700 1 -- 172.21.15.45:0/3430538280 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f14cc0682f0 msgr2=0x7f14cc06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:28.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.197+0000 7f14e5fff700 1 --2- 172.21.15.45:0/3430538280 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f14cc0682f0 0x7f14cc06a7a0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f14d0015040 tx=0x7f14d000a000 comp rx=0 tx=0).stop 2023-11-28T12:12:28.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.197+0000 7f14e5fff700 1 -- 172.21.15.45:0/3430538280 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14e015d000 msgr2=0x7f14e015d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:28.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.197+0000 7f14e5fff700 1 --2- 172.21.15.45:0/3430538280 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14e015d000 0x7f14e015d470 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f14d4007310 tx=0x7f14d4007620 comp rx=0 tx=0).stop 2023-11-28T12:12:28.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.198+0000 7f14e5fff700 1 -- 172.21.15.45:0/3430538280 shutdown_connections 2023-11-28T12:12:28.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.198+0000 7f14e5fff700 1 --2- 172.21.15.45:0/3430538280 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f14cc0682f0 0x7f14cc06a7a0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:28.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.198+0000 7f14e5fff700 1 --2- 172.21.15.45:0/3430538280 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14c8003bc0 0x7f14e00c9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:28.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.198+0000 7f14e5fff700 1 --2- 172.21.15.45:0/3430538280 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f14e015f0a0 0x7f14e015f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:28.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.198+0000 7f14e5fff700 1 --2- 172.21.15.45:0/3430538280 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14e015d000 0x7f14e015d470 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:28.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.198+0000 7f14e5fff700 1 -- 172.21.15.45:0/3430538280 >> 172.21.15.45:0/3430538280 conn(0x7f14e009c3f0 msgr2=0x7f14e006b310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:28.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.198+0000 7f14e5fff700 1 -- 172.21.15.45:0/3430538280 shutdown_connections 2023-11-28T12:12:28.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.198+0000 7f14e5fff700 1 -- 172.21.15.45:0/3430538280 wait complete. 2023-11-28T12:12:28.201 INFO:teuthology.orchestra.run.smithi045.stderr:instructed osd(s) 3 to deep-scrub 2023-11-28T12:12:28.217 INFO:tasks.ceph:Scrubbing osd.4 2023-11-28T12:12:28.217 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-11-28T12:12:28.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.426+0000 7fa07fbff700 1 Processor -- start 2023-11-28T12:12:28.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.427+0000 7fa07fbff700 1 -- start start 2023-11-28T12:12:28.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.428+0000 7fa07fbff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fa07815a760 0x7fa078161200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:28.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.428+0000 7fa07fbff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa0780cded0 0x7fa0780b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:28.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.428+0000 7fa07fbff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa07815e0a0 con 0x7fa07815dc30 2023-11-28T12:12:28.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.428+0000 7fa07fbff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa07815ab30 con 0x7fa07815a760 2023-11-28T12:12:28.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.428+0000 7fa07fbff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa078160d70 con 0x7fa0780cded0 2023-11-28T12:12:28.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.428+0000 7fa07d99b700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fa07815a760 0x7fa078161200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:28.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.428+0000 7fa07e19c700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa0780cded0 0x7fa0780b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:28.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.428+0000 7fa07d99b700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fa07815a760 0x7fa078161200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.45:41404/0 (socket says 172.21.15.45:41404) 2023-11-28T12:12:28.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.428+0000 7fa07e19c700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa0780cded0 0x7fa0780b4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.45:39544/0 (socket says 172.21.15.45:39544) 2023-11-28T12:12:28.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.428+0000 7fa07d19a700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fa07815dc30 0x7fa0780cd7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.45:42774/0 (socket says 172.21.15.45:42774) 2023-11-28T12:12:28.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.428+0000 7fa07d99b700 1 -- 172.21.15.45:0/1266646293 learned_addr learned my addr 172.21.15.45:0/1266646293 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:12:28.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.429+0000 7fa07d99b700 1 -- 172.21.15.45:0/1266646293 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa0780cded0 msgr2=0x7fa0780b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:12:28.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.429+0000 7fa07d99b700 1 --2- 172.21.15.45:0/1266646293 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa0780cded0 0x7fa0780b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:28.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.429+0000 7fa07d99b700 1 -- 172.21.15.45:0/1266646293 >> v1:172.21.15.152:6789/0 conn(0x7fa07815dc30 legacy=0x7fa0780cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:28.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.429+0000 7fa07d99b700 1 -- 172.21.15.45:0/1266646293 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0780b5130 con 0x7fa07815a760 2023-11-28T12:12:28.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.429+0000 7fa07e19c700 1 --2- 172.21.15.45:0/1266646293 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa0780cded0 0x7fa0780b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T12:12:28.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.429+0000 7fa07d99b700 1 --2- 172.21.15.45:0/1266646293 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa07815a760 0x7fa078161200 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa0740098f0 tx=0x7fa074009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ebd3e11417700fd1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:28.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.429+0000 7fa07c999700 1 -- 172.21.15.45:0/1266646293 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa074011830 con 0x7fa07815a760 2023-11-28T12:12:28.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.430+0000 7fa07c999700 1 -- 172.21.15.45:0/1266646293 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa074011990 con 0x7fa07815a760 2023-11-28T12:12:28.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.430+0000 7fa07c999700 1 -- 172.21.15.45:0/1266646293 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa074011d20 con 0x7fa07815a760 2023-11-28T12:12:28.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.430+0000 7fa07fbff700 1 -- 172.21.15.45:0/1266646293 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa07815a760 msgr2=0x7fa078161200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:28.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.430+0000 7fa07fbff700 1 --2- 172.21.15.45:0/1266646293 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa07815a760 0x7fa078161200 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa0740098f0 tx=0x7fa074009c00 comp rx=0 tx=0).stop 2023-11-28T12:12:28.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.430+0000 7fa07fbff700 1 -- 172.21.15.45:0/1266646293 shutdown_connections 2023-11-28T12:12:28.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.430+0000 7fa07fbff700 1 --2- 172.21.15.45:0/1266646293 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa0780cded0 0x7fa0780b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:28.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.430+0000 7fa07fbff700 1 --2- 172.21.15.45:0/1266646293 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa07815a760 0x7fa078161200 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:28.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.430+0000 7fa07fbff700 1 -- 172.21.15.45:0/1266646293 >> 172.21.15.45:0/1266646293 conn(0x7fa078072620 msgr2=0x7fa0780cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:28.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.430+0000 7fa07fbff700 1 -- 172.21.15.45:0/1266646293 shutdown_connections 2023-11-28T12:12:28.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.430+0000 7fa07fbff700 1 -- 172.21.15.45:0/1266646293 wait complete. 2023-11-28T12:12:28.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.432+0000 7fa07fbff700 1 Processor -- start 2023-11-28T12:12:28.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.432+0000 7fa07fbff700 1 -- start start 2023-11-28T12:12:28.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.433+0000 7fa07fbff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0780cded0 0x7fa0781482a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:28.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.433+0000 7fa07fbff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa07815a760 0x7fa0780c9630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:28.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.433+0000 7fa07fbff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa07815dc30 0x7fa0781489f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:28.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.433+0000 7fa07fbff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa07814ba50 con 0x7fa0780cded0 2023-11-28T12:12:28.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.433+0000 7fa07fbff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0780c9b70 con 0x7fa07815a760 2023-11-28T12:12:28.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.433+0000 7fa07fbff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0780b7900 con 0x7fa07815dc30 2023-11-28T12:12:28.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.433+0000 7fa07d99b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0780cded0 0x7fa0781482a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:28.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.433+0000 7fa07d99b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0780cded0 0x7fa0781482a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56260/0 (socket says 172.21.15.45:56260) 2023-11-28T12:12:28.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.433+0000 7fa07d99b700 1 -- 172.21.15.45:0/3904552231 learned_addr learned my addr 172.21.15.45:0/3904552231 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:12:28.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.434+0000 7fa07e19c700 1 --2- 172.21.15.45:0/3904552231 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa07815dc30 0x7fa0781489f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:28.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.434+0000 7fa07d19a700 1 --2- 172.21.15.45:0/3904552231 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa07815a760 0x7fa0780c9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:28.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.434+0000 7fa07d99b700 1 -- 172.21.15.45:0/3904552231 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa07815dc30 msgr2=0x7fa0781489f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:28.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.434+0000 7fa07d99b700 1 --2- 172.21.15.45:0/3904552231 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa07815dc30 0x7fa0781489f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:28.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.434+0000 7fa07d99b700 1 -- 172.21.15.45:0/3904552231 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa07815a760 msgr2=0x7fa0780c9630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:28.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.434+0000 7fa07d99b700 1 --2- 172.21.15.45:0/3904552231 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa07815a760 0x7fa0780c9630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:28.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.434+0000 7fa07d99b700 1 -- 172.21.15.45:0/3904552231 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa070009a70 con 0x7fa0780cded0 2023-11-28T12:12:28.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.434+0000 7fa07e19c700 1 --2- 172.21.15.45:0/3904552231 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa07815dc30 0x7fa0781489f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:12:28.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.434+0000 7fa07d19a700 1 --2- 172.21.15.45:0/3904552231 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa07815a760 0x7fa0780c9630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:12:28.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.434+0000 7fa07d99b700 1 --2- 172.21.15.45:0/3904552231 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0780cded0 0x7fa0781482a0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fa074009c40 tx=0x7fa074004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:28.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.434+0000 7fa06e7fc700 1 -- 172.21.15.45:0/3904552231 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa074004530 con 0x7fa0780cded0 2023-11-28T12:12:28.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.434+0000 7fa06e7fc700 1 -- 172.21.15.45:0/3904552231 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa07401f070 con 0x7fa0780cded0 2023-11-28T12:12:28.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.434+0000 7fa07fbff700 1 -- 172.21.15.45:0/3904552231 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa074009550 con 0x7fa0780cded0 2023-11-28T12:12:28.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.435+0000 7fa06e7fc700 1 -- 172.21.15.45:0/3904552231 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0740038c0 con 0x7fa0780cded0 2023-11-28T12:12:28.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.435+0000 7fa07fbff700 1 -- 172.21.15.45:0/3904552231 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0780b5670 con 0x7fa0780cded0 2023-11-28T12:12:28.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.435+0000 7fa07fbff700 1 -- 172.21.15.45:0/3904552231 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa0780b5390 con 0x7fa0780cded0 2023-11-28T12:12:28.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.437+0000 7fa06e7fc700 1 -- 172.21.15.45:0/3904552231 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fa07402a020 con 0x7fa0780cded0 2023-11-28T12:12:28.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.437+0000 7fa06e7fc700 1 --2- 172.21.15.45:0/3904552231 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fa05c0682f0 0x7fa05c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:28.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.438+0000 7fa06e7fc700 1 -- 172.21.15.45:0/3904552231 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fa0740876d0 con 0x7fa0780cded0 2023-11-28T12:12:28.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.438+0000 7fa06e7fc700 1 --2- 172.21.15.45:0/3904552231 >> [v2:172.21.15.152:6800/116092,v1:172.21.15.152:6801/116092] conn(0x7fa05c06e760 0x7fa05c070b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:28.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.438+0000 7fa06e7fc700 1 -- 172.21.15.45:0/3904552231 --> [v2:172.21.15.152:6800/116092,v1:172.21.15.152:6801/116092] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa05c071240 con 0x7fa05c06e760 2023-11-28T12:12:28.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.438+0000 7fa06e7fc700 1 -- 172.21.15.45:0/3904552231 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa074087a40 con 0x7fa0780cded0 2023-11-28T12:12:28.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.438+0000 7fa07d19a700 1 --2- 172.21.15.45:0/3904552231 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fa05c0682f0 0x7fa05c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:28.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.438+0000 7fa07e19c700 1 --2- 172.21.15.45:0/3904552231 >> [v2:172.21.15.152:6800/116092,v1:172.21.15.152:6801/116092] conn(0x7fa05c06e760 0x7fa05c070b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:28.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.439+0000 7fa07e19c700 1 --2- 172.21.15.45:0/3904552231 >> [v2:172.21.15.152:6800/116092,v1:172.21.15.152:6801/116092] conn(0x7fa05c06e760 0x7fa05c070b70 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:28.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.439+0000 7fa07d19a700 1 --2- 172.21.15.45:0/3904552231 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fa05c0682f0 0x7fa05c06a7a0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fa0781595d0 tx=0x7fa068007df0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:28.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.440+0000 7fa06e7fc700 1 -- 172.21.15.45:0/3904552231 <== osd.4 v2:172.21.15.152:6800/116092 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fa05c071240 con 0x7fa05c06e760 2023-11-28T12:12:28.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.455+0000 7fa07fbff700 1 -- 172.21.15.45:0/3904552231 --> [v2:172.21.15.152:6800/116092,v1:172.21.15.152:6801/116092] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa078160720 con 0x7fa05c06e760 2023-11-28T12:12:28.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.456+0000 7fa06e7fc700 1 -- 172.21.15.45:0/3904552231 <== osd.4 v2:172.21.15.152:6800/116092 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fa078160720 con 0x7fa05c06e760 2023-11-28T12:12:28.458 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-11-28T12:12:28.458 INFO:teuthology.orchestra.run.smithi045.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-28T12:12:28.459 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-11-28T12:12:28.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.456+0000 7fa07fbff700 1 -- 172.21.15.45:0/3904552231 >> [v2:172.21.15.152:6800/116092,v1:172.21.15.152:6801/116092] conn(0x7fa05c06e760 msgr2=0x7fa05c070b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:28.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.456+0000 7fa07fbff700 1 --2- 172.21.15.45:0/3904552231 >> [v2:172.21.15.152:6800/116092,v1:172.21.15.152:6801/116092] conn(0x7fa05c06e760 0x7fa05c070b70 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:28.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.456+0000 7fa07fbff700 1 -- 172.21.15.45:0/3904552231 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fa05c0682f0 msgr2=0x7fa05c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:28.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.456+0000 7fa07fbff700 1 --2- 172.21.15.45:0/3904552231 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fa05c0682f0 0x7fa05c06a7a0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fa0781595d0 tx=0x7fa068007df0 comp rx=0 tx=0).stop 2023-11-28T12:12:28.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.456+0000 7fa07fbff700 1 -- 172.21.15.45:0/3904552231 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0780cded0 msgr2=0x7fa0781482a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:28.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.456+0000 7fa07fbff700 1 --2- 172.21.15.45:0/3904552231 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0780cded0 0x7fa0781482a0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fa074009c40 tx=0x7fa074004750 comp rx=0 tx=0).stop 2023-11-28T12:12:28.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.456+0000 7fa07e19c700 1 -- 172.21.15.45:0/3904552231 reap_dead start 2023-11-28T12:12:28.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.456+0000 7fa07fbff700 1 -- 172.21.15.45:0/3904552231 shutdown_connections 2023-11-28T12:12:28.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.456+0000 7fa07fbff700 1 -- 172.21.15.45:0/3904552231 >> 172.21.15.45:0/3904552231 conn(0x7fa078072620 msgr2=0x7fa07815f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:28.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.456+0000 7fa07fbff700 1 -- 172.21.15.45:0/3904552231 shutdown_connections 2023-11-28T12:12:28.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.456+0000 7fa07fbff700 1 -- 172.21.15.45:0/3904552231 wait complete. 2023-11-28T12:12:28.474 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-11-28T12:12:28.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.677+0000 7f794f3ff700 1 Processor -- start 2023-11-28T12:12:28.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.677+0000 7f794f3ff700 1 -- start start 2023-11-28T12:12:28.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.678+0000 7f794f3ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7948161340 0x7f79480d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:28.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.678+0000 7f794f3ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79480d1950 con 0x7f79480d2320 2023-11-28T12:12:28.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.678+0000 7f794f3ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79480b5520 con 0x7f794815c9b0 2023-11-28T12:12:28.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.678+0000 7f794f3ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79480b5800 con 0x7f7948161340 2023-11-28T12:12:28.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.679+0000 7f794d99c700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f79480d2320 0x7f79480cd7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44090/0 (socket says 172.21.15.45:44090) 2023-11-28T12:12:28.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.679+0000 7f794d99c700 1 -- 172.21.15.45:0/3565299613 learned_addr learned my addr 172.21.15.45:0/3565299613 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:12:28.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.679+0000 7f794c99a700 1 --2- 172.21.15.45:0/3565299613 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7948161340 0x7f79480d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:28.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.679+0000 7f793ffff700 1 -- 172.21.15.45:0/3565299613 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 531822841 0 0) 0x7f79480d1950 con 0x7f79480d2320 2023-11-28T12:12:28.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.679+0000 7f793ffff700 1 -- 172.21.15.45:0/3565299613 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79340035b0 con 0x7f79480d2320 2023-11-28T12:12:28.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.679+0000 7f793ffff700 1 -- 172.21.15.45:0/3565299613 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 350392383 0 0) 0x7f79480b5520 con 0x7f794815c9b0 2023-11-28T12:12:28.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.679+0000 7f793ffff700 1 -- 172.21.15.45:0/3565299613 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79480d1950 con 0x7f794815c9b0 2023-11-28T12:12:28.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.679+0000 7f793ffff700 1 -- 172.21.15.45:0/3565299613 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 863559715 0 0) 0x7f79340035b0 con 0x7f79480d2320 2023-11-28T12:12:28.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.679+0000 7f794c99a700 1 -- 172.21.15.45:0/3565299613 >> v1:172.21.15.152:6789/0 conn(0x7f794815c9b0 legacy=0x7f79480b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:28.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.679+0000 7f794c99a700 1 -- 172.21.15.45:0/3565299613 >> v1:172.21.15.45:6789/0 conn(0x7f79480d2320 legacy=0x7f79480cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:28.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.679+0000 7f794c99a700 1 -- 172.21.15.45:0/3565299613 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79480d1300 con 0x7f7948161340 2023-11-28T12:12:28.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.680+0000 7f794c99a700 1 --2- 172.21.15.45:0/3565299613 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7948161340 0x7f79480d1de0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7938009870 tx=0x7f7938009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7716fae12f07ac16 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:28.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.680+0000 7f793ffff700 1 -- 172.21.15.45:0/3565299613 <== mon.2 v2:172.21.15.152:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7940001670 con 0x7f7948161340 2023-11-28T12:12:28.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.680+0000 7f793ffff700 1 -- 172.21.15.45:0/3565299613 <== mon.2 v2:172.21.15.152:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7938004030 con 0x7f7948161340 2023-11-28T12:12:28.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.680+0000 7f793ffff700 1 -- 172.21.15.45:0/3565299613 <== mon.2 v2:172.21.15.152:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79380043c0 con 0x7f7948161340 2023-11-28T12:12:28.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.680+0000 7f794f3ff700 1 -- 172.21.15.45:0/3565299613 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7948161340 msgr2=0x7f79480d1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:28.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.680+0000 7f794f3ff700 1 --2- 172.21.15.45:0/3565299613 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7948161340 0x7f79480d1de0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7938009870 tx=0x7f7938009b80 comp rx=0 tx=0).stop 2023-11-28T12:12:28.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.681+0000 7f794f3ff700 1 -- 172.21.15.45:0/3565299613 shutdown_connections 2023-11-28T12:12:28.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.681+0000 7f794f3ff700 1 --2- 172.21.15.45:0/3565299613 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7948161340 0x7f79480d1de0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:28.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.681+0000 7f794f3ff700 1 -- 172.21.15.45:0/3565299613 >> 172.21.15.45:0/3565299613 conn(0x7f7948072600 msgr2=0x7f79480cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:28.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.681+0000 7f794f3ff700 1 -- 172.21.15.45:0/3565299613 shutdown_connections 2023-11-28T12:12:28.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.681+0000 7f794f3ff700 1 -- 172.21.15.45:0/3565299613 wait complete. 2023-11-28T12:12:28.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.682+0000 7f794f3ff700 1 Processor -- start 2023-11-28T12:12:28.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.683+0000 7f794f3ff700 1 -- start start 2023-11-28T12:12:28.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.684+0000 7f794f3ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79480d2320 0x7f7948157710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:28.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.684+0000 7f794f3ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f794815c9b0 0x7f79481f2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:28.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.684+0000 7f794f3ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7948161340 0x7f79480c7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:28.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.684+0000 7f794f3ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79481e69a0 con 0x7f79480d2320 2023-11-28T12:12:28.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.684+0000 7f794f3ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79481e8530 con 0x7f794815c9b0 2023-11-28T12:12:28.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.684+0000 7f794f3ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79480c8d50 con 0x7f7948161340 2023-11-28T12:12:28.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.684+0000 7f794d19b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79480d2320 0x7f7948157710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:28.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.684+0000 7f794d19b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79480d2320 0x7f7948157710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56266/0 (socket says 172.21.15.45:56266) 2023-11-28T12:12:28.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.684+0000 7f794d19b700 1 -- 172.21.15.45:0/1531171137 learned_addr learned my addr 172.21.15.45:0/1531171137 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:12:28.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.684+0000 7f794c99a700 1 --2- 172.21.15.45:0/1531171137 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f794815c9b0 0x7f79481f2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:28.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.684+0000 7f794d99c700 1 --2- 172.21.15.45:0/1531171137 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7948161340 0x7f79480c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:28.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.684+0000 7f794d19b700 1 -- 172.21.15.45:0/1531171137 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7948161340 msgr2=0x7f79480c7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:28.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.684+0000 7f794d19b700 1 --2- 172.21.15.45:0/1531171137 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7948161340 0x7f79480c7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:28.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.684+0000 7f794d19b700 1 -- 172.21.15.45:0/1531171137 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f794815c9b0 msgr2=0x7f79481f2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:28.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.684+0000 7f794d19b700 1 --2- 172.21.15.45:0/1531171137 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f794815c9b0 0x7f79481f2c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:28.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.684+0000 7f794d19b700 1 -- 172.21.15.45:0/1531171137 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79380094a0 con 0x7f79480d2320 2023-11-28T12:12:28.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.684+0000 7f794c99a700 1 --2- 172.21.15.45:0/1531171137 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f794815c9b0 0x7f79481f2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:12:28.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.684+0000 7f794d99c700 1 --2- 172.21.15.45:0/1531171137 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7948161340 0x7f79480c7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:12:28.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.685+0000 7f794d19b700 1 --2- 172.21.15.45:0/1531171137 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79480d2320 0x7f7948157710 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f7944001f30 tx=0x7f794400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:28.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.685+0000 7f793dffb700 1 -- 172.21.15.45:0/1531171137 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f794400ada0 con 0x7f79480d2320 2023-11-28T12:12:28.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.685+0000 7f793dffb700 1 -- 172.21.15.45:0/1531171137 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7944003a00 con 0x7f79480d2320 2023-11-28T12:12:28.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.685+0000 7f793dffb700 1 -- 172.21.15.45:0/1531171137 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7944003db0 con 0x7f79480d2320 2023-11-28T12:12:28.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.685+0000 7f794f3ff700 1 -- 172.21.15.45:0/1531171137 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f794815cd80 con 0x7f79480d2320 2023-11-28T12:12:28.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.685+0000 7f794f3ff700 1 -- 172.21.15.45:0/1531171137 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79480d15e0 con 0x7f79480d2320 2023-11-28T12:12:28.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.686+0000 7f794f3ff700 1 -- 172.21.15.45:0/1531171137 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f794815cf10 con 0x7f79480d2320 2023-11-28T12:12:28.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.687+0000 7f793dffb700 1 -- 172.21.15.45:0/1531171137 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f7944010050 con 0x7f79480d2320 2023-11-28T12:12:28.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.688+0000 7f793dffb700 1 --2- 172.21.15.45:0/1531171137 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f792c0682f0 0x7f792c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:28.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.688+0000 7f793dffb700 1 -- 172.21.15.45:0/1531171137 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f7944085a90 con 0x7f79480d2320 2023-11-28T12:12:28.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.688+0000 7f794c99a700 1 --2- 172.21.15.45:0/1531171137 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f792c0682f0 0x7f792c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:28.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.689+0000 7f794c99a700 1 --2- 172.21.15.45:0/1531171137 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f792c0682f0 0x7f792c06a7a0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f79480b8650 tx=0x7f7938008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:28.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.692+0000 7f793dffb700 1 -- 172.21.15.45:0/1531171137 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f7944052570 con 0x7f79480d2320 2023-11-28T12:12:28.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.895+0000 7f794f3ff700 1 -- 172.21.15.45:0/1531171137 --> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f79481e6ae0 con 0x7f792c0682f0 2023-11-28T12:12:28.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.896+0000 7f793dffb700 1 -- 172.21.15.45:0/1531171137 <== mgr.4100 v2:172.21.15.152:6832/115389 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f79481e6ae0 con 0x7f792c0682f0 2023-11-28T12:12:28.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.898+0000 7f794f3ff700 1 -- 172.21.15.45:0/1531171137 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f792c0682f0 msgr2=0x7f792c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:28.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.898+0000 7f794f3ff700 1 --2- 172.21.15.45:0/1531171137 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f792c0682f0 0x7f792c06a7a0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f79480b8650 tx=0x7f7938008030 comp rx=0 tx=0).stop 2023-11-28T12:12:28.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.898+0000 7f794f3ff700 1 -- 172.21.15.45:0/1531171137 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79480d2320 msgr2=0x7f7948157710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:28.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.898+0000 7f794f3ff700 1 --2- 172.21.15.45:0/1531171137 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79480d2320 0x7f7948157710 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f7944001f30 tx=0x7f794400a340 comp rx=0 tx=0).stop 2023-11-28T12:12:28.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.898+0000 7f794f3ff700 1 -- 172.21.15.45:0/1531171137 shutdown_connections 2023-11-28T12:12:28.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.898+0000 7f794f3ff700 1 --2- 172.21.15.45:0/1531171137 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f792c0682f0 0x7f792c06a7a0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:28.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.898+0000 7f794f3ff700 1 --2- 172.21.15.45:0/1531171137 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f7948161340 0x7f79480c7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:28.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.898+0000 7f794f3ff700 1 --2- 172.21.15.45:0/1531171137 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79480d2320 0x7f7948157710 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:28.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.898+0000 7f794f3ff700 1 --2- 172.21.15.45:0/1531171137 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f794815c9b0 0x7f79481f2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:28.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.898+0000 7f794f3ff700 1 -- 172.21.15.45:0/1531171137 >> 172.21.15.45:0/1531171137 conn(0x7f7948072600 msgr2=0x7f794815f110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:28.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.898+0000 7f794f3ff700 1 -- 172.21.15.45:0/1531171137 shutdown_connections 2023-11-28T12:12:28.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:28.898+0000 7f794f3ff700 1 -- 172.21.15.45:0/1531171137 wait complete. 2023-11-28T12:12:28.902 INFO:teuthology.orchestra.run.smithi045.stderr:instructed osd(s) 4 to deep-scrub 2023-11-28T12:12:28.918 INFO:tasks.ceph:Scrubbing osd.5 2023-11-28T12:12:28.918 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-11-28T12:12:29.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.126+0000 7fe4911ff700 1 Processor -- start 2023-11-28T12:12:29.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.126+0000 7fe4911ff700 1 -- start start 2023-11-28T12:12:29.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.127+0000 7fe4911ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fe48c15a760 0x7fe48c161200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:29.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.127+0000 7fe4911ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe48c15dc30 0x7fe48c0b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:29.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.127+0000 7fe4911ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe48c15e0a0 con 0x7fe48c0cd7c0 2023-11-28T12:12:29.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.127+0000 7fe4911ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe48c15ab30 con 0x7fe48c15dc30 2023-11-28T12:12:29.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.127+0000 7fe4911ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe48c160d70 con 0x7fe48c15a760 2023-11-28T12:12:29.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.128+0000 7fe48a59c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe48c15dc30 0x7fe48c0b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:29.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.128+0000 7fe48b59e700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fe48c0cd7c0 0x7fe48c0d0d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44104/0 (socket says 172.21.15.45:44104) 2023-11-28T12:12:29.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.128+0000 7fe48a59c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe48c15dc30 0x7fe48c0b4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56278/0 (socket says 172.21.15.45:56278) 2023-11-28T12:12:29.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.128+0000 7fe48b59e700 1 -- 172.21.15.45:0/1764210256 learned_addr learned my addr 172.21.15.45:0/1764210256 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:12:29.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.128+0000 7fe48ad9d700 1 --2- 172.21.15.45:0/1764210256 >> v2:172.21.15.152:3300/0 conn(0x7fe48c15a760 0x7fe48c161200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:29.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.128+0000 7fe48a59c700 1 -- 172.21.15.45:0/1764210256 >> v2:172.21.15.152:3300/0 conn(0x7fe48c15a760 msgr2=0x7fe48c161200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:12:29.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.128+0000 7fe48a59c700 1 --2- 172.21.15.45:0/1764210256 >> v2:172.21.15.152:3300/0 conn(0x7fe48c15a760 0x7fe48c161200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:29.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.128+0000 7fe48a59c700 1 -- 172.21.15.45:0/1764210256 >> v1:172.21.15.45:6789/0 conn(0x7fe48c0cd7c0 legacy=0x7fe48c0d0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:29.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.128+0000 7fe48a59c700 1 -- 172.21.15.45:0/1764210256 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe48c0b5130 con 0x7fe48c15dc30 2023-11-28T12:12:29.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.128+0000 7fe48a59c700 1 --2- 172.21.15.45:0/1764210256 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe48c15dc30 0x7fe48c0b4bf0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fe48c08bff0 tx=0x7fe480009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=724212bfd6b368f2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:29.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.129+0000 7fe489d9b700 1 -- 172.21.15.45:0/1764210256 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe480011830 con 0x7fe48c15dc30 2023-11-28T12:12:29.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.129+0000 7fe489d9b700 1 -- 172.21.15.45:0/1764210256 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe480011990 con 0x7fe48c15dc30 2023-11-28T12:12:29.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.129+0000 7fe489d9b700 1 -- 172.21.15.45:0/1764210256 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe480011d20 con 0x7fe48c15dc30 2023-11-28T12:12:29.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.129+0000 7fe4911ff700 1 -- 172.21.15.45:0/1764210256 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe48c15dc30 msgr2=0x7fe48c0b4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:29.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.129+0000 7fe4911ff700 1 --2- 172.21.15.45:0/1764210256 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe48c15dc30 0x7fe48c0b4bf0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fe48c08bff0 tx=0x7fe480009b20 comp rx=0 tx=0).stop 2023-11-28T12:12:29.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.129+0000 7fe4911ff700 1 -- 172.21.15.45:0/1764210256 shutdown_connections 2023-11-28T12:12:29.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.129+0000 7fe4911ff700 1 --2- 172.21.15.45:0/1764210256 >> v2:172.21.15.152:3300/0 conn(0x7fe48c15a760 0x7fe48c161200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:29.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.129+0000 7fe4911ff700 1 --2- 172.21.15.45:0/1764210256 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe48c15dc30 0x7fe48c0b4bf0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:29.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.129+0000 7fe4911ff700 1 -- 172.21.15.45:0/1764210256 >> 172.21.15.45:0/1764210256 conn(0x7fe48c072620 msgr2=0x7fe48c0cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:29.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.129+0000 7fe4911ff700 1 -- 172.21.15.45:0/1764210256 shutdown_connections 2023-11-28T12:12:29.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.129+0000 7fe4911ff700 1 -- 172.21.15.45:0/1764210256 wait complete. 2023-11-28T12:12:29.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.132+0000 7fe4911ff700 1 Processor -- start 2023-11-28T12:12:29.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.132+0000 7fe4911ff700 1 -- start start 2023-11-28T12:12:29.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.133+0000 7fe4911ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe48c0cd7c0 0x7fe48c0ca240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:29.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.133+0000 7fe4911ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe48c15a760 0x7fe48c0cfd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:29.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.133+0000 7fe4911ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe48c15dc30 0x7fe48c157290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:29.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.133+0000 7fe4911ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe48c0cb330 con 0x7fe48c0cd7c0 2023-11-28T12:12:29.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.133+0000 7fe4911ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe48c0caa90 con 0x7fe48c15a760 2023-11-28T12:12:29.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.133+0000 7fe4911ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe48c0cad70 con 0x7fe48c15dc30 2023-11-28T12:12:29.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.133+0000 7fe48ad9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe48c0cd7c0 0x7fe48c0ca240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:29.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.133+0000 7fe48ad9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe48c0cd7c0 0x7fe48c0ca240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56288/0 (socket says 172.21.15.45:56288) 2023-11-28T12:12:29.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.134+0000 7fe48ad9d700 1 -- 172.21.15.45:0/2896115414 learned_addr learned my addr 172.21.15.45:0/2896115414 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:12:29.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.134+0000 7fe48a59c700 1 --2- 172.21.15.45:0/2896115414 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe48c15a760 0x7fe48c0cfd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:29.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.134+0000 7fe48b59e700 1 --2- 172.21.15.45:0/2896115414 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe48c15dc30 0x7fe48c157290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:29.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.134+0000 7fe48ad9d700 1 -- 172.21.15.45:0/2896115414 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe48c15dc30 msgr2=0x7fe48c157290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:29.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.134+0000 7fe48ad9d700 1 --2- 172.21.15.45:0/2896115414 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fe48c15dc30 0x7fe48c157290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:29.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.134+0000 7fe48ad9d700 1 -- 172.21.15.45:0/2896115414 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe48c15a760 msgr2=0x7fe48c0cfd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:29.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.134+0000 7fe48ad9d700 1 --2- 172.21.15.45:0/2896115414 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe48c15a760 0x7fe48c0cfd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:29.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.134+0000 7fe48ad9d700 1 -- 172.21.15.45:0/2896115414 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4800094a0 con 0x7fe48c0cd7c0 2023-11-28T12:12:29.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.134+0000 7fe48ad9d700 1 --2- 172.21.15.45:0/2896115414 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe48c0cd7c0 0x7fe48c0ca240 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fe47c00e9b0 tx=0x7fe47c00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:29.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.134+0000 7fe4737fe700 1 -- 172.21.15.45:0/2896115414 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe47c009710 con 0x7fe48c0cd7c0 2023-11-28T12:12:29.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.134+0000 7fe4737fe700 1 -- 172.21.15.45:0/2896115414 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe47c00c850 con 0x7fe48c0cd7c0 2023-11-28T12:12:29.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.134+0000 7fe4737fe700 1 -- 172.21.15.45:0/2896115414 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe47c00cbc0 con 0x7fe48c0cd7c0 2023-11-28T12:12:29.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.134+0000 7fe4911ff700 1 -- 172.21.15.45:0/2896115414 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe48c0b5670 con 0x7fe48c0cd7c0 2023-11-28T12:12:29.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.135+0000 7fe4911ff700 1 -- 172.21.15.45:0/2896115414 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe48c0b5390 con 0x7fe48c0cd7c0 2023-11-28T12:12:29.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.135+0000 7fe4911ff700 1 -- 172.21.15.45:0/2896115414 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe48c160720 con 0x7fe48c0cd7c0 2023-11-28T12:12:29.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.136+0000 7fe4737fe700 1 -- 172.21.15.45:0/2896115414 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fe47c019030 con 0x7fe48c0cd7c0 2023-11-28T12:12:29.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.137+0000 7fe4737fe700 1 --2- 172.21.15.45:0/2896115414 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fe4780682f0 0x7fe47806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:29.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.137+0000 7fe4737fe700 1 -- 172.21.15.45:0/2896115414 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fe47c0859e0 con 0x7fe48c0cd7c0 2023-11-28T12:12:29.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.138+0000 7fe4737fe700 1 --2- 172.21.15.45:0/2896115414 >> [v2:172.21.15.152:6815/116093,v1:172.21.15.152:6817/116093] conn(0x7fe47806e760 0x7fe478070b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:29.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.138+0000 7fe4737fe700 1 -- 172.21.15.45:0/2896115414 --> [v2:172.21.15.152:6815/116093,v1:172.21.15.152:6817/116093] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe478071240 con 0x7fe47806e760 2023-11-28T12:12:29.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.138+0000 7fe4737fe700 1 -- 172.21.15.45:0/2896115414 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe47c08a2a0 con 0x7fe48c0cd7c0 2023-11-28T12:12:29.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.138+0000 7fe48b59e700 1 --2- 172.21.15.45:0/2896115414 >> [v2:172.21.15.152:6815/116093,v1:172.21.15.152:6817/116093] conn(0x7fe47806e760 0x7fe478070b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:29.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.138+0000 7fe48a59c700 1 --2- 172.21.15.45:0/2896115414 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fe4780682f0 0x7fe47806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:29.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.139+0000 7fe48b59e700 1 --2- 172.21.15.45:0/2896115414 >> [v2:172.21.15.152:6815/116093,v1:172.21.15.152:6817/116093] conn(0x7fe47806e760 0x7fe478070b70 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:29.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.139+0000 7fe48a59c700 1 --2- 172.21.15.45:0/2896115414 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fe4780682f0 0x7fe47806a7a0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fe4800090b0 tx=0x7fe48001c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:29.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.140+0000 7fe4737fe700 1 -- 172.21.15.45:0/2896115414 <== osd.5 v2:172.21.15.152:6815/116093 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fe478071240 con 0x7fe47806e760 2023-11-28T12:12:29.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.155+0000 7fe4911ff700 1 -- 172.21.15.45:0/2896115414 --> [v2:172.21.15.152:6815/116093,v1:172.21.15.152:6817/116093] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe48c0b65f0 con 0x7fe47806e760 2023-11-28T12:12:29.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.156+0000 7fe4737fe700 1 -- 172.21.15.45:0/2896115414 <== osd.5 v2:172.21.15.152:6815/116093 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fe48c0b65f0 con 0x7fe47806e760 2023-11-28T12:12:29.157 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-11-28T12:12:29.157 INFO:teuthology.orchestra.run.smithi045.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-28T12:12:29.158 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-11-28T12:12:29.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.156+0000 7fe4911ff700 1 -- 172.21.15.45:0/2896115414 >> [v2:172.21.15.152:6815/116093,v1:172.21.15.152:6817/116093] conn(0x7fe47806e760 msgr2=0x7fe478070b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:29.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.156+0000 7fe4911ff700 1 --2- 172.21.15.45:0/2896115414 >> [v2:172.21.15.152:6815/116093,v1:172.21.15.152:6817/116093] conn(0x7fe47806e760 0x7fe478070b70 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:29.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.156+0000 7fe4911ff700 1 -- 172.21.15.45:0/2896115414 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fe4780682f0 msgr2=0x7fe47806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:29.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.156+0000 7fe4911ff700 1 --2- 172.21.15.45:0/2896115414 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fe4780682f0 0x7fe47806a7a0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fe4800090b0 tx=0x7fe48001c040 comp rx=0 tx=0).stop 2023-11-28T12:12:29.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.156+0000 7fe4911ff700 1 -- 172.21.15.45:0/2896115414 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe48c0cd7c0 msgr2=0x7fe48c0ca240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:29.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.156+0000 7fe4911ff700 1 --2- 172.21.15.45:0/2896115414 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe48c0cd7c0 0x7fe48c0ca240 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fe47c00e9b0 tx=0x7fe47c00ecc0 comp rx=0 tx=0).stop 2023-11-28T12:12:29.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.156+0000 7fe48b59e700 1 -- 172.21.15.45:0/2896115414 reap_dead start 2023-11-28T12:12:29.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.156+0000 7fe4911ff700 1 -- 172.21.15.45:0/2896115414 shutdown_connections 2023-11-28T12:12:29.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.156+0000 7fe4911ff700 1 -- 172.21.15.45:0/2896115414 >> 172.21.15.45:0/2896115414 conn(0x7fe48c072620 msgr2=0x7fe48c15d470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:29.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.156+0000 7fe4911ff700 1 -- 172.21.15.45:0/2896115414 shutdown_connections 2023-11-28T12:12:29.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.156+0000 7fe4911ff700 1 -- 172.21.15.45:0/2896115414 wait complete. 2023-11-28T12:12:29.174 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-11-28T12:12:29.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.377+0000 7fa6947ff700 1 Processor -- start 2023-11-28T12:12:29.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.377+0000 7fa6947ff700 1 -- start start 2023-11-28T12:12:29.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.378+0000 7fa6947ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fa68c161340 0x7fa68c0d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:29.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.378+0000 7fa6947ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa68c0d1950 con 0x7fa68c0d2320 2023-11-28T12:12:29.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.379+0000 7fa6947ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa68c0b5520 con 0x7fa68c15c9b0 2023-11-28T12:12:29.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.379+0000 7fa6947ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa68c0b5800 con 0x7fa68c161340 2023-11-28T12:12:29.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.379+0000 7fa692d9c700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fa68c0d2320 0x7fa68c0cd7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44110/0 (socket says 172.21.15.45:44110) 2023-11-28T12:12:29.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.379+0000 7fa692d9c700 1 -- 172.21.15.45:0/1615423678 learned_addr learned my addr 172.21.15.45:0/1615423678 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:12:29.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.379+0000 7fa691d9a700 1 --2- 172.21.15.45:0/1615423678 >> v2:172.21.15.152:3300/0 conn(0x7fa68c161340 0x7fa68c0d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:29.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.379+0000 7fa691599700 1 -- 172.21.15.45:0/1615423678 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3954761546 0 0) 0x7fa68c0d1950 con 0x7fa68c0d2320 2023-11-28T12:12:29.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.379+0000 7fa691599700 1 -- 172.21.15.45:0/1615423678 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6780035b0 con 0x7fa68c0d2320 2023-11-28T12:12:29.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.379+0000 7fa691d9a700 1 -- 172.21.15.45:0/1615423678 >> v1:172.21.15.152:6789/0 conn(0x7fa68c15c9b0 legacy=0x7fa68c0b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:29.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.379+0000 7fa691d9a700 1 -- 172.21.15.45:0/1615423678 >> v1:172.21.15.45:6789/0 conn(0x7fa68c0d2320 legacy=0x7fa68c0cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:29.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.379+0000 7fa691d9a700 1 -- 172.21.15.45:0/1615423678 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa68c0d1300 con 0x7fa68c161340 2023-11-28T12:12:29.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.380+0000 7fa691d9a700 1 --2- 172.21.15.45:0/1615423678 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa68c161340 0x7fa68c0d1de0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fa67c009840 tx=0x7fa67c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a75b822634244dc server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:29.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.380+0000 7fa691599700 1 -- 172.21.15.45:0/1615423678 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa67c011830 con 0x7fa68c161340 2023-11-28T12:12:29.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.380+0000 7fa691599700 1 -- 172.21.15.45:0/1615423678 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa67c011990 con 0x7fa68c161340 2023-11-28T12:12:29.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.380+0000 7fa691599700 1 -- 172.21.15.45:0/1615423678 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa67c011d00 con 0x7fa68c161340 2023-11-28T12:12:29.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.380+0000 7fa6947ff700 1 -- 172.21.15.45:0/1615423678 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa68c161340 msgr2=0x7fa68c0d1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:29.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.380+0000 7fa6947ff700 1 --2- 172.21.15.45:0/1615423678 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa68c161340 0x7fa68c0d1de0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fa67c009840 tx=0x7fa67c009b50 comp rx=0 tx=0).stop 2023-11-28T12:12:29.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.381+0000 7fa6947ff700 1 -- 172.21.15.45:0/1615423678 shutdown_connections 2023-11-28T12:12:29.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.381+0000 7fa6947ff700 1 --2- 172.21.15.45:0/1615423678 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa68c161340 0x7fa68c0d1de0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:29.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.381+0000 7fa6947ff700 1 -- 172.21.15.45:0/1615423678 >> 172.21.15.45:0/1615423678 conn(0x7fa68c072600 msgr2=0x7fa68c0cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:29.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.381+0000 7fa6947ff700 1 -- 172.21.15.45:0/1615423678 shutdown_connections 2023-11-28T12:12:29.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.381+0000 7fa6947ff700 1 -- 172.21.15.45:0/1615423678 wait complete. 2023-11-28T12:12:29.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.382+0000 7fa6947ff700 1 Processor -- start 2023-11-28T12:12:29.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.383+0000 7fa6947ff700 1 -- start start 2023-11-28T12:12:29.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.383+0000 7fa6947ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa68c0d2320 0x7fa68c156720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:29.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.383+0000 7fa6947ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa68c15c9b0 0x7fa68c06a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:29.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.383+0000 7fa6947ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa68c161340 0x7fa68c06ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:29.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.383+0000 7fa6947ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa68c1e7800 con 0x7fa68c15c9b0 2023-11-28T12:12:29.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.383+0000 7fa6947ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa68c0b8270 con 0x7fa68c0d2320 2023-11-28T12:12:29.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.383+0000 7fa6947ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa68c0b8550 con 0x7fa68c161340 2023-11-28T12:12:29.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.384+0000 7fa691d9a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa68c15c9b0 0x7fa68c06a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:29.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.384+0000 7fa691d9a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa68c15c9b0 0x7fa68c06a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56294/0 (socket says 172.21.15.45:56294) 2023-11-28T12:12:29.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.384+0000 7fa691d9a700 1 -- 172.21.15.45:0/2449467939 learned_addr learned my addr 172.21.15.45:0/2449467939 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:12:29.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.384+0000 7fa691d9a700 1 -- 172.21.15.45:0/2449467939 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa68c161340 msgr2=0x7fa68c06ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:29.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.384+0000 7fa691d9a700 1 --2- 172.21.15.45:0/2449467939 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa68c161340 0x7fa68c06ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:29.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.384+0000 7fa691d9a700 1 -- 172.21.15.45:0/2449467939 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa68c0d2320 msgr2=0x7fa68c156720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:29.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.384+0000 7fa691d9a700 1 --2- 172.21.15.45:0/2449467939 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa68c0d2320 0x7fa68c156720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:29.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.384+0000 7fa691d9a700 1 -- 172.21.15.45:0/2449467939 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa67c0094a0 con 0x7fa68c15c9b0 2023-11-28T12:12:29.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.384+0000 7fa691d9a700 1 --2- 172.21.15.45:0/2449467939 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa68c15c9b0 0x7fa68c06a900 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fa67c0090b0 tx=0x7fa67c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:29.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.384+0000 7fa682ffd700 1 -- 172.21.15.45:0/2449467939 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa67c0036a0 con 0x7fa68c15c9b0 2023-11-28T12:12:29.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.385+0000 7fa682ffd700 1 -- 172.21.15.45:0/2449467939 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa67c01e070 con 0x7fa68c15c9b0 2023-11-28T12:12:29.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.385+0000 7fa682ffd700 1 -- 172.21.15.45:0/2449467939 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa67c003a20 con 0x7fa68c15c9b0 2023-11-28T12:12:29.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.385+0000 7fa6947ff700 1 -- 172.21.15.45:0/2449467939 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa68c15cd80 con 0x7fa68c15c9b0 2023-11-28T12:12:29.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.385+0000 7fa6947ff700 1 -- 172.21.15.45:0/2449467939 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa68c0d15e0 con 0x7fa68c15c9b0 2023-11-28T12:12:29.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.386+0000 7fa6947ff700 1 -- 172.21.15.45:0/2449467939 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa68c15cf10 con 0x7fa68c15c9b0 2023-11-28T12:12:29.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.387+0000 7fa682ffd700 1 -- 172.21.15.45:0/2449467939 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fa67c00f050 con 0x7fa68c15c9b0 2023-11-28T12:12:29.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.388+0000 7fa682ffd700 1 --2- 172.21.15.45:0/2449467939 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fa6700682f0 0x7fa67006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:29.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.388+0000 7fa682ffd700 1 -- 172.21.15.45:0/2449467939 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fa67c086ae0 con 0x7fa68c15c9b0 2023-11-28T12:12:29.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.388+0000 7fa69259b700 1 --2- 172.21.15.45:0/2449467939 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fa6700682f0 0x7fa67006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:29.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.389+0000 7fa69259b700 1 --2- 172.21.15.45:0/2449467939 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fa6700682f0 0x7fa67006a7a0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fa688000f60 tx=0x7fa688007a40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:29.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.393+0000 7fa682ffd700 1 -- 172.21.15.45:0/2449467939 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fa67c053630 con 0x7fa68c15c9b0 2023-11-28T12:12:29.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.593+0000 7fa6947ff700 1 -- 172.21.15.45:0/2449467939 --> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fa68c1e7940 con 0x7fa6700682f0 2023-11-28T12:12:29.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.594+0000 7fa682ffd700 1 -- 172.21.15.45:0/2449467939 <== mgr.4100 v2:172.21.15.152:6832/115389 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa688005080 con 0x7fa6700682f0 2023-11-28T12:12:29.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.596+0000 7fa6947ff700 1 -- 172.21.15.45:0/2449467939 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fa6700682f0 msgr2=0x7fa67006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:29.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.596+0000 7fa6947ff700 1 --2- 172.21.15.45:0/2449467939 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fa6700682f0 0x7fa67006a7a0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fa688000f60 tx=0x7fa688007a40 comp rx=0 tx=0).stop 2023-11-28T12:12:29.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.596+0000 7fa6947ff700 1 -- 172.21.15.45:0/2449467939 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa68c15c9b0 msgr2=0x7fa68c06a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:29.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.596+0000 7fa6947ff700 1 --2- 172.21.15.45:0/2449467939 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa68c15c9b0 0x7fa68c06a900 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fa67c0090b0 tx=0x7fa67c004750 comp rx=0 tx=0).stop 2023-11-28T12:12:29.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.596+0000 7fa6947ff700 1 -- 172.21.15.45:0/2449467939 shutdown_connections 2023-11-28T12:12:29.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.596+0000 7fa6947ff700 1 --2- 172.21.15.45:0/2449467939 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fa6700682f0 0x7fa67006a7a0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:29.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.596+0000 7fa6947ff700 1 --2- 172.21.15.45:0/2449467939 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa68c0d2320 0x7fa68c156720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:29.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.596+0000 7fa6947ff700 1 --2- 172.21.15.45:0/2449467939 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fa68c161340 0x7fa68c06ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:29.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.596+0000 7fa6947ff700 1 --2- 172.21.15.45:0/2449467939 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa68c15c9b0 0x7fa68c06a900 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:29.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.596+0000 7fa6947ff700 1 -- 172.21.15.45:0/2449467939 >> 172.21.15.45:0/2449467939 conn(0x7fa68c072600 msgr2=0x7fa68c0b6e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:29.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.596+0000 7fa6947ff700 1 -- 172.21.15.45:0/2449467939 shutdown_connections 2023-11-28T12:12:29.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.596+0000 7fa6947ff700 1 -- 172.21.15.45:0/2449467939 wait complete. 2023-11-28T12:12:29.599 INFO:teuthology.orchestra.run.smithi045.stderr:instructed osd(s) 5 to deep-scrub 2023-11-28T12:12:29.615 INFO:tasks.ceph:Scrubbing osd.6 2023-11-28T12:12:29.616 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-11-28T12:12:29.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.823+0000 7f21fd3ff700 1 Processor -- start 2023-11-28T12:12:29.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.823+0000 7f21fd3ff700 1 -- start start 2023-11-28T12:12:29.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.824+0000 7f21fd3ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f21f80cded0 0x7f21f8161200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:29.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.824+0000 7f21fd3ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21f8160d70 con 0x7f21f815dc30 2023-11-28T12:12:29.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.824+0000 7f21fd3ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21f80b5390 con 0x7f21f815a760 2023-11-28T12:12:29.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.824+0000 7f21fd3ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21f815e0d0 con 0x7f21f80cded0 2023-11-28T12:12:29.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.825+0000 7f21effff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f21f80cded0 0x7f21f8161200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:29.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.825+0000 7f21f77fe700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f21f815dc30 0x7f21f80d0d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44116/0 (socket says 172.21.15.45:44116) 2023-11-28T12:12:29.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.825+0000 7f21f77fe700 1 -- 172.21.15.45:0/3855782022 learned_addr learned my addr 172.21.15.45:0/3855782022 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:12:29.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.825+0000 7f21effff700 1 -- 172.21.15.45:0/3855782022 >> v1:172.21.15.152:6789/0 conn(0x7f21f815a760 legacy=0x7f21f80cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:29.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.825+0000 7f21effff700 1 -- 172.21.15.45:0/3855782022 >> v1:172.21.15.45:6789/0 conn(0x7f21f815dc30 legacy=0x7f21f80d0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:29.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.825+0000 7f21effff700 1 -- 172.21.15.45:0/3855782022 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21f80b5670 con 0x7f21f80cded0 2023-11-28T12:12:29.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.825+0000 7f21effff700 1 --2- 172.21.15.45:0/3855782022 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21f80cded0 0x7f21f8161200 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f21e0009840 tx=0x7f21e0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fa4b1b3ec8be2bc server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:29.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.826+0000 7f21f67fc700 1 -- 172.21.15.45:0/3855782022 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e0011830 con 0x7f21f80cded0 2023-11-28T12:12:29.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.826+0000 7f21f67fc700 1 -- 172.21.15.45:0/3855782022 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21e0011990 con 0x7f21f80cded0 2023-11-28T12:12:29.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.826+0000 7f21f67fc700 1 -- 172.21.15.45:0/3855782022 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e0011d20 con 0x7f21f80cded0 2023-11-28T12:12:29.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.826+0000 7f21fd3ff700 1 -- 172.21.15.45:0/3855782022 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21f80cded0 msgr2=0x7f21f8161200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:29.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.826+0000 7f21fd3ff700 1 --2- 172.21.15.45:0/3855782022 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21f80cded0 0x7f21f8161200 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f21e0009840 tx=0x7f21e0009b50 comp rx=0 tx=0).stop 2023-11-28T12:12:29.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.826+0000 7f21fd3ff700 1 -- 172.21.15.45:0/3855782022 shutdown_connections 2023-11-28T12:12:29.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.826+0000 7f21fd3ff700 1 --2- 172.21.15.45:0/3855782022 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21f80cded0 0x7f21f8161200 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:29.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.826+0000 7f21fd3ff700 1 -- 172.21.15.45:0/3855782022 >> 172.21.15.45:0/3855782022 conn(0x7f21f8072620 msgr2=0x7f21f80cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:29.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.826+0000 7f21fd3ff700 1 -- 172.21.15.45:0/3855782022 shutdown_connections 2023-11-28T12:12:29.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.826+0000 7f21fd3ff700 1 -- 172.21.15.45:0/3855782022 wait complete. 2023-11-28T12:12:29.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.828+0000 7f21fd3ff700 1 Processor -- start 2023-11-28T12:12:29.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.828+0000 7f21fd3ff700 1 -- start start 2023-11-28T12:12:29.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.829+0000 7f21fd3ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f21f80cded0 0x7f21f8158a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:29.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.829+0000 7f21fd3ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21f815a760 0x7f21f80b89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:29.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.829+0000 7f21fd3ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f21f815dc30 0x7f21f80b5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:29.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.829+0000 7f21fd3ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f8158fa0 con 0x7f21f815a760 2023-11-28T12:12:29.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.829+0000 7f21fd3ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f80cb660 con 0x7f21f815dc30 2023-11-28T12:12:29.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.829+0000 7f21fd3ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21f80c94f0 con 0x7f21f80cded0 2023-11-28T12:12:29.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.829+0000 7f21effff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21f815a760 0x7f21f80b89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:29.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.829+0000 7f21effff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21f815a760 0x7f21f80b89a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56320/0 (socket says 172.21.15.45:56320) 2023-11-28T12:12:29.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.829+0000 7f21effff700 1 -- 172.21.15.45:0/859363024 learned_addr learned my addr 172.21.15.45:0/859363024 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:12:29.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.830+0000 7f21effff700 1 -- 172.21.15.45:0/859363024 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f21f80cded0 msgr2=0x7f21f8158a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:29.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.830+0000 7f21effff700 1 --2- 172.21.15.45:0/859363024 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f21f80cded0 0x7f21f8158a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:29.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.830+0000 7f21effff700 1 -- 172.21.15.45:0/859363024 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f21f815dc30 msgr2=0x7f21f80b5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:29.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.830+0000 7f21effff700 1 --2- 172.21.15.45:0/859363024 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f21f815dc30 0x7f21f80b5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:29.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.830+0000 7f21effff700 1 -- 172.21.15.45:0/859363024 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21e00094a0 con 0x7f21f815a760 2023-11-28T12:12:29.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.830+0000 7f21effff700 1 --2- 172.21.15.45:0/859363024 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21f815a760 0x7f21f80b89a0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f21e00090b0 tx=0x7f21e0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:29.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.830+0000 7f21ef7fe700 1 -- 172.21.15.45:0/859363024 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e00038a0 con 0x7f21f815a760 2023-11-28T12:12:29.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.830+0000 7f21ef7fe700 1 -- 172.21.15.45:0/859363024 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21e001f070 con 0x7f21f815a760 2023-11-28T12:12:29.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.830+0000 7f21ef7fe700 1 -- 172.21.15.45:0/859363024 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e0003c60 con 0x7f21f815a760 2023-11-28T12:12:29.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.830+0000 7f21fd3ff700 1 -- 172.21.15.45:0/859363024 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21f8160a00 con 0x7f21f815a760 2023-11-28T12:12:29.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.831+0000 7f21fd3ff700 1 -- 172.21.15.45:0/859363024 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21f8160720 con 0x7f21f815a760 2023-11-28T12:12:29.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.831+0000 7f21fd3ff700 1 -- 172.21.15.45:0/859363024 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f21f80b4bf0 con 0x7f21f815a760 2023-11-28T12:12:29.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.832+0000 7f21ef7fe700 1 -- 172.21.15.45:0/859363024 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f21e000f050 con 0x7f21f815a760 2023-11-28T12:12:29.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.833+0000 7f21ef7fe700 1 --2- 172.21.15.45:0/859363024 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f21d80682f0 0x7f21d806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:29.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.833+0000 7f21ef7fe700 1 -- 172.21.15.45:0/859363024 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f21e0021070 con 0x7f21f815a760 2023-11-28T12:12:29.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.834+0000 7f21ef7fe700 1 --2- 172.21.15.45:0/859363024 >> [v2:172.21.15.152:6808/116094,v1:172.21.15.152:6809/116094] conn(0x7f21d806e760 0x7f21d8070b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:29.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.834+0000 7f21ef7fe700 1 -- 172.21.15.45:0/859363024 --> [v2:172.21.15.152:6808/116094,v1:172.21.15.152:6809/116094] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f21d8071240 con 0x7f21d806e760 2023-11-28T12:12:29.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.834+0000 7f21ef7fe700 1 -- 172.21.15.45:0/859363024 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7f21e00899a0 con 0x7f21f815a760 2023-11-28T12:12:29.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.834+0000 7f21f6ffd700 1 --2- 172.21.15.45:0/859363024 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f21d80682f0 0x7f21d806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:29.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.834+0000 7f21f77fe700 1 --2- 172.21.15.45:0/859363024 >> [v2:172.21.15.152:6808/116094,v1:172.21.15.152:6809/116094] conn(0x7f21d806e760 0x7f21d8070b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:29.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.835+0000 7f21f6ffd700 1 --2- 172.21.15.45:0/859363024 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f21d80682f0 0x7f21d806a7a0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f21e8000f60 tx=0x7f21e8007a40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:29.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.835+0000 7f21f77fe700 1 --2- 172.21.15.45:0/859363024 >> [v2:172.21.15.152:6808/116094,v1:172.21.15.152:6809/116094] conn(0x7f21d806e760 0x7f21d8070b70 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:29.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.836+0000 7f21ef7fe700 1 -- 172.21.15.45:0/859363024 <== osd.6 v2:172.21.15.152:6808/116094 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f21d8071240 con 0x7f21d806e760 2023-11-28T12:12:29.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.851+0000 7f21fd3ff700 1 -- 172.21.15.45:0/859363024 --> [v2:172.21.15.152:6808/116094,v1:172.21.15.152:6809/116094] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f21f80cdb10 con 0x7f21d806e760 2023-11-28T12:12:29.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.851+0000 7f21ef7fe700 1 -- 172.21.15.45:0/859363024 <== osd.6 v2:172.21.15.152:6808/116094 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f21f80cdb10 con 0x7f21d806e760 2023-11-28T12:12:29.852 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-11-28T12:12:29.852 INFO:teuthology.orchestra.run.smithi045.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-28T12:12:29.852 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-11-28T12:12:29.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.852+0000 7f21fd3ff700 1 -- 172.21.15.45:0/859363024 >> [v2:172.21.15.152:6808/116094,v1:172.21.15.152:6809/116094] conn(0x7f21d806e760 msgr2=0x7f21d8070b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:29.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.852+0000 7f21fd3ff700 1 --2- 172.21.15.45:0/859363024 >> [v2:172.21.15.152:6808/116094,v1:172.21.15.152:6809/116094] conn(0x7f21d806e760 0x7f21d8070b70 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:29.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.852+0000 7f21fd3ff700 1 -- 172.21.15.45:0/859363024 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f21d80682f0 msgr2=0x7f21d806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:29.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.852+0000 7f21fd3ff700 1 --2- 172.21.15.45:0/859363024 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f21d80682f0 0x7f21d806a7a0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f21e8000f60 tx=0x7f21e8007a40 comp rx=0 tx=0).stop 2023-11-28T12:12:29.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.852+0000 7f21fd3ff700 1 -- 172.21.15.45:0/859363024 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21f815a760 msgr2=0x7f21f80b89a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:29.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.852+0000 7f21fd3ff700 1 --2- 172.21.15.45:0/859363024 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21f815a760 0x7f21f80b89a0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f21e00090b0 tx=0x7f21e0004750 comp rx=0 tx=0).stop 2023-11-28T12:12:29.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.852+0000 7f21f77fe700 1 -- 172.21.15.45:0/859363024 reap_dead start 2023-11-28T12:12:29.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.852+0000 7f21fd3ff700 1 -- 172.21.15.45:0/859363024 shutdown_connections 2023-11-28T12:12:29.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.852+0000 7f21fd3ff700 1 -- 172.21.15.45:0/859363024 >> 172.21.15.45:0/859363024 conn(0x7f21f8072620 msgr2=0x7f21f80d0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:29.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.852+0000 7f21fd3ff700 1 -- 172.21.15.45:0/859363024 shutdown_connections 2023-11-28T12:12:29.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:29.852+0000 7f21fd3ff700 1 -- 172.21.15.45:0/859363024 wait complete. 2023-11-28T12:12:29.869 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-11-28T12:12:30.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.074+0000 7feea9bff700 1 Processor -- start 2023-11-28T12:12:30.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.074+0000 7feea9bff700 1 -- start start 2023-11-28T12:12:30.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.075+0000 7feea9bff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7feea4161340 0x7feea40d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:30.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.075+0000 7feea9bff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7feea40d2320 0x7feea40cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:30.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.075+0000 7feea9bff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feea40d1950 con 0x7feea415c9b0 2023-11-28T12:12:30.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.075+0000 7feea9bff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feea40b5800 con 0x7feea4161340 2023-11-28T12:12:30.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.075+0000 7feea9bff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feea40b5300 con 0x7feea40d2320 2023-11-28T12:12:30.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.076+0000 7feea2ffd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7feea4161340 0x7feea40d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:30.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.076+0000 7feea2ffd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7feea4161340 0x7feea40d1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56334/0 (socket says 172.21.15.45:56334) 2023-11-28T12:12:30.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.076+0000 7feea2ffd700 1 -- 172.21.15.45:0/1279248001 learned_addr learned my addr 172.21.15.45:0/1279248001 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:12:30.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.076+0000 7feea3fff700 1 --2- 172.21.15.45:0/1279248001 >> v2:172.21.15.152:3300/0 conn(0x7feea40d2320 0x7feea40cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:30.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.076+0000 7feea2ffd700 1 -- 172.21.15.45:0/1279248001 >> v2:172.21.15.152:3300/0 conn(0x7feea40d2320 msgr2=0x7feea40cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:12:30.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.076+0000 7feea2ffd700 1 --2- 172.21.15.45:0/1279248001 >> v2:172.21.15.152:3300/0 conn(0x7feea40d2320 0x7feea40cd7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:30.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.076+0000 7feea2ffd700 1 -- 172.21.15.45:0/1279248001 >> v1:172.21.15.152:6789/0 conn(0x7feea415c9b0 legacy=0x7feea40b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:12:30.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.076+0000 7feea2ffd700 1 -- 172.21.15.45:0/1279248001 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea40b5520 con 0x7feea4161340 2023-11-28T12:12:30.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.076+0000 7feea2ffd700 1 --2- 172.21.15.45:0/1279248001 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feea4161340 0x7feea40d1de0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7feea406c170 tx=0x7fee98009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f33585a730e0e2e1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:30.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.077+0000 7feea27fc700 1 -- 172.21.15.45:0/1279248001 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee98004230 con 0x7feea4161340 2023-11-28T12:12:30.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.077+0000 7feea27fc700 1 -- 172.21.15.45:0/1279248001 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee98004390 con 0x7feea4161340 2023-11-28T12:12:30.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.077+0000 7feea27fc700 1 -- 172.21.15.45:0/1279248001 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee980036a0 con 0x7feea4161340 2023-11-28T12:12:30.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.077+0000 7feea9bff700 1 -- 172.21.15.45:0/1279248001 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feea4161340 msgr2=0x7feea40d1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:30.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.077+0000 7feea9bff700 1 --2- 172.21.15.45:0/1279248001 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feea4161340 0x7feea40d1de0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7feea406c170 tx=0x7fee98009c00 comp rx=0 tx=0).stop 2023-11-28T12:12:30.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.077+0000 7feea9bff700 1 -- 172.21.15.45:0/1279248001 shutdown_connections 2023-11-28T12:12:30.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.077+0000 7feea9bff700 1 --2- 172.21.15.45:0/1279248001 >> v2:172.21.15.152:3300/0 conn(0x7feea40d2320 0x7feea40cd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:30.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.077+0000 7feea9bff700 1 --2- 172.21.15.45:0/1279248001 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feea4161340 0x7feea40d1de0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:30.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.077+0000 7feea9bff700 1 -- 172.21.15.45:0/1279248001 >> 172.21.15.45:0/1279248001 conn(0x7feea4072600 msgr2=0x7feea40cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:30.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.077+0000 7feea9bff700 1 -- 172.21.15.45:0/1279248001 shutdown_connections 2023-11-28T12:12:30.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.077+0000 7feea9bff700 1 -- 172.21.15.45:0/1279248001 wait complete. 2023-11-28T12:12:30.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.079+0000 7feea9bff700 1 Processor -- start 2023-11-28T12:12:30.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.079+0000 7feea9bff700 1 -- start start 2023-11-28T12:12:30.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.080+0000 7feea9bff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feea40d2320 0x7feea4150550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:30.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.080+0000 7feea9bff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7feea415c9b0 0x7feea41577e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:30.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.080+0000 7feea9bff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feea4161340 0x7feea415f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:30.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.080+0000 7feea9bff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea41e6fa0 con 0x7feea40d2320 2023-11-28T12:12:30.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.080+0000 7feea9bff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea415fa90 con 0x7feea4161340 2023-11-28T12:12:30.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.080+0000 7feea9bff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feea41e6600 con 0x7feea415c9b0 2023-11-28T12:12:30.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.081+0000 7feea37fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feea40d2320 0x7feea4150550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:30.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.081+0000 7feea37fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feea40d2320 0x7feea4150550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56344/0 (socket says 172.21.15.45:56344) 2023-11-28T12:12:30.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.081+0000 7feea37fe700 1 -- 172.21.15.45:0/348986046 learned_addr learned my addr 172.21.15.45:0/348986046 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:12:30.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.081+0000 7feea3fff700 1 --2- 172.21.15.45:0/348986046 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feea4161340 0x7feea415f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:30.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.081+0000 7feea37fe700 1 -- 172.21.15.45:0/348986046 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7feea415c9b0 msgr2=0x7feea41577e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:30.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.081+0000 7feea2ffd700 1 --2- 172.21.15.45:0/348986046 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7feea415c9b0 0x7feea41577e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:30.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.081+0000 7feea37fe700 1 --2- 172.21.15.45:0/348986046 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7feea415c9b0 0x7feea41577e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:30.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.081+0000 7feea37fe700 1 -- 172.21.15.45:0/348986046 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feea4161340 msgr2=0x7feea415f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:30.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.081+0000 7feea37fe700 1 --2- 172.21.15.45:0/348986046 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feea4161340 0x7feea415f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:30.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.081+0000 7feea37fe700 1 -- 172.21.15.45:0/348986046 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee98009550 con 0x7feea40d2320 2023-11-28T12:12:30.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.081+0000 7feea3fff700 1 --2- 172.21.15.45:0/348986046 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feea4161340 0x7feea415f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:12:30.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.081+0000 7feea2ffd700 1 --2- 172.21.15.45:0/348986046 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7feea415c9b0 0x7feea41577e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:12:30.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.081+0000 7feea37fe700 1 --2- 172.21.15.45:0/348986046 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feea40d2320 0x7feea4150550 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fee9400b4d0 tx=0x7fee9400b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:30.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.081+0000 7fee8bfff700 1 -- 172.21.15.45:0/348986046 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee94011830 con 0x7feea40d2320 2023-11-28T12:12:30.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.082+0000 7fee8bfff700 1 -- 172.21.15.45:0/348986046 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee94011990 con 0x7feea40d2320 2023-11-28T12:12:30.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.082+0000 7feea9bff700 1 -- 172.21.15.45:0/348986046 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feea40d15e0 con 0x7feea40d2320 2023-11-28T12:12:30.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.082+0000 7fee8bfff700 1 -- 172.21.15.45:0/348986046 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee94011d40 con 0x7feea40d2320 2023-11-28T12:12:30.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.082+0000 7feea9bff700 1 -- 172.21.15.45:0/348986046 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feea40d1300 con 0x7feea40d2320 2023-11-28T12:12:30.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.083+0000 7feea9bff700 1 -- 172.21.15.45:0/348986046 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feea415cd80 con 0x7feea40d2320 2023-11-28T12:12:30.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.083+0000 7fee8bfff700 1 -- 172.21.15.45:0/348986046 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fee9400f050 con 0x7feea40d2320 2023-11-28T12:12:30.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.084+0000 7fee8bfff700 1 --2- 172.21.15.45:0/348986046 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fee900682f0 0x7fee9006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:30.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.084+0000 7fee8bfff700 1 -- 172.21.15.45:0/348986046 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fee94085680 con 0x7feea40d2320 2023-11-28T12:12:30.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.085+0000 7feea2ffd700 1 --2- 172.21.15.45:0/348986046 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fee900682f0 0x7fee9006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:30.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.085+0000 7feea2ffd700 1 --2- 172.21.15.45:0/348986046 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fee900682f0 0x7fee9006a7a0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7feea4157440 tx=0x7fee98008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:30.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.088+0000 7fee8bfff700 1 -- 172.21.15.45:0/348986046 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fee94052020 con 0x7feea40d2320 2023-11-28T12:12:30.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.291+0000 7feea9bff700 1 -- 172.21.15.45:0/348986046 --> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7feea41e6770 con 0x7fee900682f0 2023-11-28T12:12:30.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.292+0000 7fee8bfff700 1 -- 172.21.15.45:0/348986046 <== mgr.4100 v2:172.21.15.152:6832/115389 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7feea41e6770 con 0x7fee900682f0 2023-11-28T12:12:30.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.294+0000 7feea9bff700 1 -- 172.21.15.45:0/348986046 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fee900682f0 msgr2=0x7fee9006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:30.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.294+0000 7feea9bff700 1 --2- 172.21.15.45:0/348986046 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fee900682f0 0x7fee9006a7a0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7feea4157440 tx=0x7fee98008030 comp rx=0 tx=0).stop 2023-11-28T12:12:30.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.294+0000 7feea9bff700 1 -- 172.21.15.45:0/348986046 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feea40d2320 msgr2=0x7feea4150550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:30.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.294+0000 7feea9bff700 1 --2- 172.21.15.45:0/348986046 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feea40d2320 0x7feea4150550 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fee9400b4d0 tx=0x7fee9400b890 comp rx=0 tx=0).stop 2023-11-28T12:12:30.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.294+0000 7feea9bff700 1 -- 172.21.15.45:0/348986046 shutdown_connections 2023-11-28T12:12:30.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.294+0000 7feea9bff700 1 --2- 172.21.15.45:0/348986046 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fee900682f0 0x7fee9006a7a0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:30.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.294+0000 7feea9bff700 1 --2- 172.21.15.45:0/348986046 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feea4161340 0x7feea415f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:30.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.294+0000 7feea9bff700 1 --2- 172.21.15.45:0/348986046 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feea40d2320 0x7feea4150550 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:30.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.294+0000 7feea9bff700 1 --2- 172.21.15.45:0/348986046 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7feea415c9b0 0x7feea41577e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:30.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.294+0000 7feea9bff700 1 -- 172.21.15.45:0/348986046 >> 172.21.15.45:0/348986046 conn(0x7feea4072600 msgr2=0x7feea40b6f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:30.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.294+0000 7feea9bff700 1 -- 172.21.15.45:0/348986046 shutdown_connections 2023-11-28T12:12:30.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.294+0000 7feea9bff700 1 -- 172.21.15.45:0/348986046 wait complete. 2023-11-28T12:12:30.297 INFO:teuthology.orchestra.run.smithi045.stderr:instructed osd(s) 6 to deep-scrub 2023-11-28T12:12:30.313 INFO:tasks.ceph:Scrubbing osd.7 2023-11-28T12:12:30.313 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-11-28T12:12:30.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.520+0000 7f93ebfff700 1 Processor -- start 2023-11-28T12:12:30.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.520+0000 7f93ebfff700 1 -- start start 2023-11-28T12:12:30.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.521+0000 7f93ebfff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f93e415cb90 0x7f93e40cf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:30.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.521+0000 7f93ebfff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f93e406ba90 0x7f93e40cc330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:30.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.521+0000 7f93ebfff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93e40cbea0 con 0x7f93e40d08b0 2023-11-28T12:12:30.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.521+0000 7f93ebfff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93e40cb5b0 con 0x7f93e415cb90 2023-11-28T12:12:30.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.521+0000 7f93ebfff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93e415cf60 con 0x7f93e406ba90 2023-11-28T12:12:30.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.522+0000 7f93e9d9b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f93e415cb90 0x7f93e40cf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:30.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.522+0000 7f93ea59c700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f93e406ba90 0x7f93e40cc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:30.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.522+0000 7f93e9d9b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f93e415cb90 0x7f93e40cf540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56360/0 (socket says 172.21.15.45:56360) 2023-11-28T12:12:30.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.522+0000 7f93e9d9b700 1 -- 172.21.15.45:0/1655460664 learned_addr learned my addr 172.21.15.45:0/1655460664 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:12:30.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.522+0000 7f93e9d9b700 1 -- 172.21.15.45:0/1655460664 >> v2:172.21.15.152:3300/0 conn(0x7f93e406ba90 msgr2=0x7f93e40cc330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:12:30.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.522+0000 7f93e9d9b700 1 --2- 172.21.15.45:0/1655460664 >> v2:172.21.15.152:3300/0 conn(0x7f93e406ba90 0x7f93e40cc330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:30.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.522+0000 7f93e9d9b700 1 -- 172.21.15.45:0/1655460664 >> v1:172.21.15.152:6789/0 conn(0x7f93e40d08b0 legacy=0x7f93e406b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:30.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.522+0000 7f93e9d9b700 1 -- 172.21.15.45:0/1655460664 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93e40cfbd0 con 0x7f93e415cb90 2023-11-28T12:12:30.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.522+0000 7f93e9d9b700 1 --2- 172.21.15.45:0/1655460664 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93e415cb90 0x7f93e40cf540 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f93e40c7fc0 tx=0x7f93e0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef6fb9f3e2776445 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:30.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.523+0000 7f93e8d99700 1 -- 172.21.15.45:0/1655460664 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e0011830 con 0x7f93e415cb90 2023-11-28T12:12:30.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.523+0000 7f93e8d99700 1 -- 172.21.15.45:0/1655460664 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93e0011990 con 0x7f93e415cb90 2023-11-28T12:12:30.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.523+0000 7f93e8d99700 1 -- 172.21.15.45:0/1655460664 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e0011d20 con 0x7f93e415cb90 2023-11-28T12:12:30.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.523+0000 7f93ebfff700 1 -- 172.21.15.45:0/1655460664 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93e415cb90 msgr2=0x7f93e40cf540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:30.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.523+0000 7f93ebfff700 1 --2- 172.21.15.45:0/1655460664 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93e415cb90 0x7f93e40cf540 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f93e40c7fc0 tx=0x7f93e0009bd0 comp rx=0 tx=0).stop 2023-11-28T12:12:30.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.523+0000 7f93ebfff700 1 -- 172.21.15.45:0/1655460664 shutdown_connections 2023-11-28T12:12:30.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.523+0000 7f93ebfff700 1 --2- 172.21.15.45:0/1655460664 >> v2:172.21.15.152:3300/0 conn(0x7f93e406ba90 0x7f93e40cc330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:30.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.523+0000 7f93ebfff700 1 --2- 172.21.15.45:0/1655460664 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93e415cb90 0x7f93e40cf540 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:30.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.523+0000 7f93ebfff700 1 -- 172.21.15.45:0/1655460664 >> 172.21.15.45:0/1655460664 conn(0x7f93e409a230 msgr2=0x7f93e408afd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:30.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.523+0000 7f93ebfff700 1 -- 172.21.15.45:0/1655460664 shutdown_connections 2023-11-28T12:12:30.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.523+0000 7f93ebfff700 1 -- 172.21.15.45:0/1655460664 wait complete. 2023-11-28T12:12:30.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.525+0000 7f93ebfff700 1 Processor -- start 2023-11-28T12:12:30.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.525+0000 7f93ebfff700 1 -- start start 2023-11-28T12:12:30.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.526+0000 7f93ebfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93e406ba90 0x7f93e40c7460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:30.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.526+0000 7f93ebfff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f93e40d08b0 0x7f93e415f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:30.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.526+0000 7f93ebfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93e415cb90 0x7f93e4145630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:30.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.526+0000 7f93ebfff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e415f0d0 con 0x7f93e406ba90 2023-11-28T12:12:30.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.526+0000 7f93ebfff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e40b4630 con 0x7f93e415cb90 2023-11-28T12:12:30.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.526+0000 7f93ebfff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93e40b3d90 con 0x7f93e40d08b0 2023-11-28T12:12:30.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.526+0000 7f93e9d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93e406ba90 0x7f93e40c7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:30.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.526+0000 7f93e9d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93e406ba90 0x7f93e40c7460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56362/0 (socket says 172.21.15.45:56362) 2023-11-28T12:12:30.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.526+0000 7f93e9d9b700 1 -- 172.21.15.45:0/3743827835 learned_addr learned my addr 172.21.15.45:0/3743827835 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:12:30.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.527+0000 7f93ea59c700 1 --2- 172.21.15.45:0/3743827835 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93e415cb90 0x7f93e4145630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:30.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.527+0000 7f93e959a700 1 --2- 172.21.15.45:0/3743827835 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f93e40d08b0 0x7f93e415f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:30.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.527+0000 7f93e9d9b700 1 -- 172.21.15.45:0/3743827835 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f93e40d08b0 msgr2=0x7f93e415f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:30.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.527+0000 7f93e9d9b700 1 --2- 172.21.15.45:0/3743827835 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f93e40d08b0 0x7f93e415f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:30.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.527+0000 7f93e9d9b700 1 -- 172.21.15.45:0/3743827835 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93e415cb90 msgr2=0x7f93e4145630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:30.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.527+0000 7f93e9d9b700 1 --2- 172.21.15.45:0/3743827835 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93e415cb90 0x7f93e4145630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:30.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.527+0000 7f93e9d9b700 1 -- 172.21.15.45:0/3743827835 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93e0009550 con 0x7f93e406ba90 2023-11-28T12:12:30.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.527+0000 7f93e9d9b700 1 --2- 172.21.15.45:0/3743827835 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93e406ba90 0x7f93e40c7460 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f93e406d870 tx=0x7f93e0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:30.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.527+0000 7f93da7fc700 1 -- 172.21.15.45:0/3743827835 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e0004380 con 0x7f93e406ba90 2023-11-28T12:12:30.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.527+0000 7f93da7fc700 1 -- 172.21.15.45:0/3743827835 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93e001f070 con 0x7f93e406ba90 2023-11-28T12:12:30.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.527+0000 7f93da7fc700 1 -- 172.21.15.45:0/3743827835 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e00036a0 con 0x7f93e406ba90 2023-11-28T12:12:30.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.527+0000 7f93ebfff700 1 -- 172.21.15.45:0/3743827835 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93e40cbb30 con 0x7f93e406ba90 2023-11-28T12:12:30.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.528+0000 7f93ebfff700 1 -- 172.21.15.45:0/3743827835 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93e40cb850 con 0x7f93e406ba90 2023-11-28T12:12:30.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.528+0000 7f93ebfff700 1 -- 172.21.15.45:0/3743827835 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f93e40d0d00 con 0x7f93e406ba90 2023-11-28T12:12:30.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.529+0000 7f93da7fc700 1 -- 172.21.15.45:0/3743827835 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f93e002a020 con 0x7f93e406ba90 2023-11-28T12:12:30.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.530+0000 7f93da7fc700 1 --2- 172.21.15.45:0/3743827835 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f93c80682f0 0x7f93c806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:30.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.530+0000 7f93da7fc700 1 -- 172.21.15.45:0/3743827835 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f93e0086ff0 con 0x7f93e406ba90 2023-11-28T12:12:30.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.530+0000 7f93da7fc700 1 --2- 172.21.15.45:0/3743827835 >> [v2:172.21.15.152:6824/116097,v1:172.21.15.152:6825/116097] conn(0x7f93c806e760 0x7f93c8070b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:30.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.530+0000 7f93da7fc700 1 -- 172.21.15.45:0/3743827835 --> [v2:172.21.15.152:6824/116097,v1:172.21.15.152:6825/116097] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f93c8071240 con 0x7f93c806e760 2023-11-28T12:12:30.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.530+0000 7f93da7fc700 1 -- 172.21.15.45:0/3743827835 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7f93e008c5a0 con 0x7f93e406ba90 2023-11-28T12:12:30.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.531+0000 7f93e959a700 1 --2- 172.21.15.45:0/3743827835 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f93c80682f0 0x7f93c806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:30.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.531+0000 7f93ea59c700 1 --2- 172.21.15.45:0/3743827835 >> [v2:172.21.15.152:6824/116097,v1:172.21.15.152:6825/116097] conn(0x7f93c806e760 0x7f93c8070b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:30.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.531+0000 7f93e959a700 1 --2- 172.21.15.45:0/3743827835 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f93c80682f0 0x7f93c806a7a0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f93e41f56e0 tx=0x7f93d4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:30.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.532+0000 7f93ea59c700 1 --2- 172.21.15.45:0/3743827835 >> [v2:172.21.15.152:6824/116097,v1:172.21.15.152:6825/116097] conn(0x7f93c806e760 0x7f93c8070b70 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:30.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.533+0000 7f93da7fc700 1 -- 172.21.15.45:0/3743827835 <== osd.7 v2:172.21.15.152:6824/116097 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f93c8071240 con 0x7f93c806e760 2023-11-28T12:12:30.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.548+0000 7f93ebfff700 1 -- 172.21.15.45:0/3743827835 --> [v2:172.21.15.152:6824/116097,v1:172.21.15.152:6825/116097] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f93e415f210 con 0x7f93c806e760 2023-11-28T12:12:30.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.548+0000 7f93da7fc700 1 -- 172.21.15.45:0/3743827835 <== osd.7 v2:172.21.15.152:6824/116097 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f93dc00f040 con 0x7f93c806e760 2023-11-28T12:12:30.549 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-11-28T12:12:30.549 INFO:teuthology.orchestra.run.smithi045.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-28T12:12:30.549 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-11-28T12:12:30.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.548+0000 7f93ebfff700 1 -- 172.21.15.45:0/3743827835 >> [v2:172.21.15.152:6824/116097,v1:172.21.15.152:6825/116097] conn(0x7f93c806e760 msgr2=0x7f93c8070b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:30.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.548+0000 7f93ebfff700 1 --2- 172.21.15.45:0/3743827835 >> [v2:172.21.15.152:6824/116097,v1:172.21.15.152:6825/116097] conn(0x7f93c806e760 0x7f93c8070b70 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:30.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.549+0000 7f93ebfff700 1 -- 172.21.15.45:0/3743827835 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f93c80682f0 msgr2=0x7f93c806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:30.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.549+0000 7f93ebfff700 1 --2- 172.21.15.45:0/3743827835 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f93c80682f0 0x7f93c806a7a0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f93e41f56e0 tx=0x7f93d4009040 comp rx=0 tx=0).stop 2023-11-28T12:12:30.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.549+0000 7f93ebfff700 1 -- 172.21.15.45:0/3743827835 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93e406ba90 msgr2=0x7f93e40c7460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:30.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.549+0000 7f93ebfff700 1 --2- 172.21.15.45:0/3743827835 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93e406ba90 0x7f93e40c7460 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f93e406d870 tx=0x7f93e0004750 comp rx=0 tx=0).stop 2023-11-28T12:12:30.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.549+0000 7f93ea59c700 1 -- 172.21.15.45:0/3743827835 reap_dead start 2023-11-28T12:12:30.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.549+0000 7f93ebfff700 1 -- 172.21.15.45:0/3743827835 shutdown_connections 2023-11-28T12:12:30.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.549+0000 7f93ebfff700 1 -- 172.21.15.45:0/3743827835 >> 172.21.15.45:0/3743827835 conn(0x7f93e409a230 msgr2=0x7f93e40ae510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:30.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.549+0000 7f93ebfff700 1 -- 172.21.15.45:0/3743827835 shutdown_connections 2023-11-28T12:12:30.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.549+0000 7f93ebfff700 1 -- 172.21.15.45:0/3743827835 wait complete. 2023-11-28T12:12:30.566 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-11-28T12:12:30.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.772+0000 7f10fcbff700 1 Processor -- start 2023-11-28T12:12:30.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.772+0000 7f10fcbff700 1 -- start start 2023-11-28T12:12:30.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.774+0000 7f10fcbff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f10f815c9b0 0x7f10f80b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:30.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.774+0000 7f10fcbff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f10f80cd7c0 0x7f10f80cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:30.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.774+0000 7f10fcbff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10f80d1950 con 0x7f10f8161340 2023-11-28T12:12:30.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.774+0000 7f10fcbff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10f80b5800 con 0x7f10f815c9b0 2023-11-28T12:12:30.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.774+0000 7f10fcbff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10f80ce140 con 0x7f10f80cd7c0 2023-11-28T12:12:30.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.774+0000 7f10f659c700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f10f815c9b0 0x7f10f80b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:30.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.774+0000 7f10f6d9d700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f10f80cd7c0 0x7f10f80cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:30.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.774+0000 7f10f6d9d700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f10f80cd7c0 0x7f10f80cdc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3301/0 says I am v2:172.21.15.45:39636/0 (socket says 172.21.15.45:39636) 2023-11-28T12:12:30.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.774+0000 7f10f6d9d700 1 -- 172.21.15.45:0/715197426 learned_addr learned my addr 172.21.15.45:0/715197426 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:12:30.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.775+0000 7f10f659c700 1 -- 172.21.15.45:0/715197426 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f10f80cd7c0 msgr2=0x7f10f80cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:12:30.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.775+0000 7f10f659c700 1 --2- 172.21.15.45:0/715197426 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f10f80cd7c0 0x7f10f80cdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:30.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.775+0000 7f10f659c700 1 -- 172.21.15.45:0/715197426 >> v1:172.21.15.152:6789/0 conn(0x7f10f8161340 legacy=0x7f10f80d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:30.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.775+0000 7f10f659c700 1 -- 172.21.15.45:0/715197426 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10f80d24f0 con 0x7f10f815c9b0 2023-11-28T12:12:30.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.775+0000 7f10f659c700 1 --2- 172.21.15.45:0/715197426 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f10f815c9b0 0x7f10f80b4bf0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f10e8009840 tx=0x7f10e8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2317942935a27625 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:30.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.775+0000 7f10f5d9b700 1 -- 172.21.15.45:0/715197426 <== mon.1 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e8011830 con 0x7f10f815c9b0 2023-11-28T12:12:30.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.776+0000 7f10f5d9b700 1 -- 172.21.15.45:0/715197426 <== mon.1 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10e8011990 con 0x7f10f815c9b0 2023-11-28T12:12:30.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.776+0000 7f10f5d9b700 1 -- 172.21.15.45:0/715197426 <== mon.1 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e8011d20 con 0x7f10f815c9b0 2023-11-28T12:12:30.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.776+0000 7f10fcbff700 1 -- 172.21.15.45:0/715197426 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f10f815c9b0 msgr2=0x7f10f80b4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:30.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.776+0000 7f10fcbff700 1 --2- 172.21.15.45:0/715197426 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f10f815c9b0 0x7f10f80b4bf0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f10e8009840 tx=0x7f10e8009b50 comp rx=0 tx=0).stop 2023-11-28T12:12:30.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.776+0000 7f10fcbff700 1 -- 172.21.15.45:0/715197426 shutdown_connections 2023-11-28T12:12:30.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.776+0000 7f10fcbff700 1 --2- 172.21.15.45:0/715197426 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f10f80cd7c0 0x7f10f80cdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:30.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.776+0000 7f10fcbff700 1 --2- 172.21.15.45:0/715197426 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f10f815c9b0 0x7f10f80b4bf0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:30.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.776+0000 7f10fcbff700 1 -- 172.21.15.45:0/715197426 >> 172.21.15.45:0/715197426 conn(0x7f10f8072600 msgr2=0x7f10f80cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:30.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.776+0000 7f10fcbff700 1 -- 172.21.15.45:0/715197426 shutdown_connections 2023-11-28T12:12:30.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.776+0000 7f10fcbff700 1 -- 172.21.15.45:0/715197426 wait complete. 2023-11-28T12:12:30.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.778+0000 7f10fcbff700 1 Processor -- start 2023-11-28T12:12:30.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.778+0000 7f10fcbff700 1 -- start start 2023-11-28T12:12:30.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.779+0000 7f10fcbff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10f80cd7c0 0x7f10f81e6e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:30.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.779+0000 7f10fcbff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f10f815c9b0 0x7f10f815ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:30.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.779+0000 7f10fcbff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f10f8161340 0x7f10f8154080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:30.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.779+0000 7f10fcbff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10f81e7770 con 0x7f10f80cd7c0 2023-11-28T12:12:30.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.779+0000 7f10fcbff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10f81e7a50 con 0x7f10f8161340 2023-11-28T12:12:30.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.779+0000 7f10fcbff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10f81e7d30 con 0x7f10f815c9b0 2023-11-28T12:12:30.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.779+0000 7f10f659c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10f80cd7c0 0x7f10f81e6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:30.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.779+0000 7f10f659c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10f80cd7c0 0x7f10f81e6e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56364/0 (socket says 172.21.15.45:56364) 2023-11-28T12:12:30.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.779+0000 7f10f659c700 1 -- 172.21.15.45:0/2087690202 learned_addr learned my addr 172.21.15.45:0/2087690202 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:12:30.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.780+0000 7f10f6d9d700 1 --2- 172.21.15.45:0/2087690202 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f10f8161340 0x7f10f8154080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:30.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.780+0000 7f10effff700 1 --2- 172.21.15.45:0/2087690202 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f10f815c9b0 0x7f10f815ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:30.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.780+0000 7f10f659c700 1 -- 172.21.15.45:0/2087690202 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f10f815c9b0 msgr2=0x7f10f815ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:30.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.780+0000 7f10f659c700 1 --2- 172.21.15.45:0/2087690202 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f10f815c9b0 0x7f10f815ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:30.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.780+0000 7f10f659c700 1 -- 172.21.15.45:0/2087690202 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f10f8161340 msgr2=0x7f10f8154080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:30.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.780+0000 7f10f659c700 1 --2- 172.21.15.45:0/2087690202 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f10f8161340 0x7f10f8154080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:30.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.780+0000 7f10f659c700 1 -- 172.21.15.45:0/2087690202 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10e80094a0 con 0x7f10f80cd7c0 2023-11-28T12:12:30.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.780+0000 7f10effff700 1 --2- 172.21.15.45:0/2087690202 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f10f815c9b0 0x7f10f815ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T12:12:30.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.780+0000 7f10f659c700 1 --2- 172.21.15.45:0/2087690202 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10f80cd7c0 0x7f10f81e6e60 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f10e8009fd0 tx=0x7f10e8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:30.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.780+0000 7f10eeffd700 1 -- 172.21.15.45:0/2087690202 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e80036a0 con 0x7f10f80cd7c0 2023-11-28T12:12:30.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.780+0000 7f10eeffd700 1 -- 172.21.15.45:0/2087690202 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10e801e070 con 0x7f10f80cd7c0 2023-11-28T12:12:30.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.780+0000 7f10fcbff700 1 -- 172.21.15.45:0/2087690202 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10f80d1300 con 0x7f10f80cd7c0 2023-11-28T12:12:30.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.780+0000 7f10eeffd700 1 -- 172.21.15.45:0/2087690202 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e8003a60 con 0x7f10f80cd7c0 2023-11-28T12:12:30.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.780+0000 7f10fcbff700 1 -- 172.21.15.45:0/2087690202 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10f80b5520 con 0x7f10f80cd7c0 2023-11-28T12:12:30.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.782+0000 7f10fcbff700 1 -- 172.21.15.45:0/2087690202 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10f80d15e0 con 0x7f10f80cd7c0 2023-11-28T12:12:30.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.782+0000 7f10eeffd700 1 -- 172.21.15.45:0/2087690202 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f10e800f050 con 0x7f10f80cd7c0 2023-11-28T12:12:30.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.783+0000 7f10eeffd700 1 --2- 172.21.15.45:0/2087690202 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f10d80682f0 0x7f10d806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:30.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.783+0000 7f10eeffd700 1 -- 172.21.15.45:0/2087690202 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f10e8086b50 con 0x7f10f80cd7c0 2023-11-28T12:12:30.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.784+0000 7f10effff700 1 --2- 172.21.15.45:0/2087690202 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f10d80682f0 0x7f10d806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:30.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.784+0000 7f10effff700 1 --2- 172.21.15.45:0/2087690202 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f10d80682f0 0x7f10d806a7a0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f10f8154d40 tx=0x7f10e0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:30.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.787+0000 7f10eeffd700 1 -- 172.21.15.45:0/2087690202 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f10e8053560 con 0x7f10f80cd7c0 2023-11-28T12:12:30.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.992+0000 7f10fcbff700 1 -- 172.21.15.45:0/2087690202 --> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f10f80745c0 con 0x7f10d80682f0 2023-11-28T12:12:30.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.993+0000 7f10eeffd700 1 -- 172.21.15.45:0/2087690202 <== mgr.4100 v2:172.21.15.152:6832/115389 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f10f80745c0 con 0x7f10d80682f0 2023-11-28T12:12:30.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.995+0000 7f10fcbff700 1 -- 172.21.15.45:0/2087690202 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f10d80682f0 msgr2=0x7f10d806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:30.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.995+0000 7f10fcbff700 1 --2- 172.21.15.45:0/2087690202 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f10d80682f0 0x7f10d806a7a0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f10f8154d40 tx=0x7f10e0009040 comp rx=0 tx=0).stop 2023-11-28T12:12:30.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.995+0000 7f10fcbff700 1 -- 172.21.15.45:0/2087690202 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10f80cd7c0 msgr2=0x7f10f81e6e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:30.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.995+0000 7f10fcbff700 1 --2- 172.21.15.45:0/2087690202 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10f80cd7c0 0x7f10f81e6e60 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f10e8009fd0 tx=0x7f10e8004750 comp rx=0 tx=0).stop 2023-11-28T12:12:30.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.995+0000 7f10fcbff700 1 -- 172.21.15.45:0/2087690202 shutdown_connections 2023-11-28T12:12:30.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.995+0000 7f10fcbff700 1 --2- 172.21.15.45:0/2087690202 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f10d80682f0 0x7f10d806a7a0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:30.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.995+0000 7f10fcbff700 1 --2- 172.21.15.45:0/2087690202 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f10f8161340 0x7f10f8154080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:30.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.995+0000 7f10fcbff700 1 --2- 172.21.15.45:0/2087690202 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10f80cd7c0 0x7f10f81e6e60 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:30.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.995+0000 7f10fcbff700 1 --2- 172.21.15.45:0/2087690202 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f10f815c9b0 0x7f10f815ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:30.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.995+0000 7f10fcbff700 1 -- 172.21.15.45:0/2087690202 >> 172.21.15.45:0/2087690202 conn(0x7f10f8072600 msgr2=0x7f10f806a900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:30.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.995+0000 7f10fcbff700 1 -- 172.21.15.45:0/2087690202 shutdown_connections 2023-11-28T12:12:30.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:30.995+0000 7f10fcbff700 1 -- 172.21.15.45:0/2087690202 wait complete. 2023-11-28T12:12:30.998 INFO:teuthology.orchestra.run.smithi045.stderr:instructed osd(s) 7 to deep-scrub 2023-11-28T12:12:31.014 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T12:12:31.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:31.217+0000 7f741cbff700 1 Processor -- start 2023-11-28T12:12:31.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:31.218+0000 7f741cbff700 1 -- start start 2023-11-28T12:12:31.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:31.219+0000 7f741cbff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f741815c9b0 0x7f74180b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:31.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:31.219+0000 7f741cbff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74180d1950 con 0x7f7418161340 2023-11-28T12:12:31.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:31.219+0000 7f741cbff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74180d24f0 con 0x7f74180cd7c0 2023-11-28T12:12:31.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:31.219+0000 7f741cbff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74180b5800 con 0x7f741815c9b0 2023-11-28T12:12:31.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:31.219+0000 7f740ffff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f7418161340 0x7f74180d1de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44132/0 (socket says 172.21.15.45:44132) 2023-11-28T12:12:31.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:31.219+0000 7f740ffff700 1 -- 172.21.15.45:0/114070932 learned_addr learned my addr 172.21.15.45:0/114070932 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:12:31.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:31.219+0000 7f741659c700 1 --2- 172.21.15.45:0/114070932 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f741815c9b0 0x7f74180b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:31.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:31.220+0000 7f7415d9b700 1 -- 172.21.15.45:0/114070932 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4080851342 0 0) 0x7f74180d1950 con 0x7f7418161340 2023-11-28T12:12:31.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:31.220+0000 7f7415d9b700 1 -- 172.21.15.45:0/114070932 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74040035b0 con 0x7f7418161340 2023-11-28T12:12:31.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:31.220+0000 7f7415d9b700 1 -- 172.21.15.45:0/114070932 <== mon.1 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 345393417 0 0) 0x7f74180d24f0 con 0x7f74180cd7c0 2023-11-28T12:12:31.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:31.220+0000 7f7415d9b700 1 -- 172.21.15.45:0/114070932 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74180d1950 con 0x7f74180cd7c0 2023-11-28T12:12:31.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:31.220+0000 7f7415d9b700 1 -- 172.21.15.45:0/114070932 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 306900968 0 0) 0x7f74040035b0 con 0x7f7418161340 2023-11-28T12:12:31.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:31.220+0000 7f7415d9b700 1 -- 172.21.15.45:0/114070932 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f741815c9b0 msgr2=0x7f74180b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:12:31.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:31.220+0000 7f7415d9b700 1 --2- 172.21.15.45:0/114070932 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f741815c9b0 0x7f74180b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:31.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:31.220+0000 7f7415d9b700 1 -- 172.21.15.45:0/114070932 >> v1:172.21.15.152:6789/0 conn(0x7f74180cd7c0 legacy=0x7f74180b5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:31.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:31.220+0000 7f7415d9b700 1 -- 172.21.15.45:0/114070932 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74180b5520 con 0x7f7418161340 2023-11-28T12:12:31.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:31.220+0000 7f7415d9b700 1 -- 172.21.15.45:0/114070932 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3460218165 0 0) 0x7f7400001670 con 0x7f7418161340 2023-11-28T12:12:31.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:31.220+0000 7f7415d9b700 1 -- 172.21.15.45:0/114070932 >> v1:172.21.15.45:6789/0 conn(0x7f7418161340 legacy=0x7f74180d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:31.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:31.220+0000 7f7415d9b700 1 --2- 172.21.15.45:0/114070932 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f741815c9b0 0x7f7404003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:31.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:31.220+0000 7f7415d9b700 1 --2- 172.21.15.45:0/114070932 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7404004170 0x7f7404004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:31.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:31.220+0000 7f7415d9b700 1 --2- 172.21.15.45:0/114070932 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7404004d90 0x7f7404005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:31.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:31.220+0000 7f7415d9b700 1 -- 172.21.15.45:0/114070932 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74180b5800 con 0x7f7404004d90 2023-11-28T12:12:31.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:31.220+0000 7f7415d9b700 1 -- 172.21.15.45:0/114070932 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f740400bba0 con 0x7f7404004170 2023-11-28T12:12:31.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:31.220+0000 7f7415d9b700 1 -- 172.21.15.45:0/114070932 --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f740400bd60 con 0x7f741815c9b0 2023-11-28T12:12:31.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:31.220+0000 7f7416d9d700 1 --2- 172.21.15.45:0/114070932 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7404004d90 0x7f7404005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:31.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:31.220+0000 7f741659c700 1 --2- 172.21.15.45:0/114070932 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f741815c9b0 0x7f7404003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:31.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:31.220+0000 7f740ffff700 1 --2- 172.21.15.45:0/114070932 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7404004170 0x7f7404004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:31.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:31.221+0000 7f7416d9d700 1 -- 172.21.15.45:0/114070932 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f741815c9b0 msgr2=0x7f7404003bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:12:31.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:31.221+0000 7f7416d9d700 1 --2- 172.21.15.45:0/114070932 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f741815c9b0 0x7f7404003bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:31.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:31.221+0000 7f7416d9d700 1 -- 172.21.15.45:0/114070932 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7404004170 msgr2=0x7f7404004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:12:31.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:31.221+0000 7f7416d9d700 1 --2- 172.21.15.45:0/114070932 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7404004170 0x7f7404004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:31.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:31.221+0000 7f7416d9d700 1 -- 172.21.15.45:0/114070932 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74040035b0 con 0x7f7404004d90 2023-11-28T12:12:31.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:31.221+0000 7f7416d9d700 1 --2- 172.21.15.45:0/114070932 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7404004d90 0x7f7404005200 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f741000c2f0 tx=0x7f7404005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa75ad877dd33bb5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:31.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:31.221+0000 7f7415d9b700 1 -- 172.21.15.45:0/114070932 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7410001f30 con 0x7f7404004d90 2023-11-28T12:12:31.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:31.221+0000 7f7415d9b700 1 -- 172.21.15.45:0/114070932 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f741000ce90 con 0x7f7404004d90 2023-11-28T12:12:31.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:31.221+0000 7f7415d9b700 1 -- 172.21.15.45:0/114070932 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7410003c40 con 0x7f7404004d90 2023-11-28T12:12:31.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:31.222+0000 7f741cbff700 1 -- 172.21.15.45:0/114070932 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7404004d90 msgr2=0x7f7404005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:31.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:31.222+0000 7f741cbff700 1 --2- 172.21.15.45:0/114070932 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7404004d90 0x7f7404005200 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f741000c2f0 tx=0x7f7404005880 comp rx=0 tx=0).stop 2023-11-28T12:12:31.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:31.222+0000 7f7416d9d700 1 -- 172.21.15.45:0/114070932 reap_dead start 2023-11-28T12:12:31.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:31.222+0000 7f741cbff700 1 -- 172.21.15.45:0/114070932 shutdown_connections 2023-11-28T12:12:31.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:31.222+0000 7f741cbff700 1 -- 172.21.15.45:0/114070932 >> 172.21.15.45:0/114070932 conn(0x7f7418072600 msgr2=0x7f74180cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:31.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:31.222+0000 7f741cbff700 1 -- 172.21.15.45:0/114070932 shutdown_connections 2023-11-28T12:12:31.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:31.222+0000 7f741cbff700 1 -- 172.21.15.45:0/114070932 wait complete. 2023-11-28T12:12:31.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:31.224+0000 7f741cbff700 1 Processor -- start 2023-11-28T12:12:31.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:31.224+0000 7f741cbff700 1 -- start start 2023-11-28T12:12:31.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:31.225+0000 7f741cbff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7404004d90 0x7f74181575c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:31.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:31.225+0000 7f741cbff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7418156b20 0x7f74180c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:31.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:31.225+0000 7f741cbff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f74180b8480 0x7f74180b88f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:31.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:31.225+0000 7f741cbff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74181e7160 con 0x7f7404004d90 2023-11-28T12:12:31.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:31.225+0000 7f741cbff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74181e6e50 con 0x7f7418156b20 2023-11-28T12:12:31.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:31.225+0000 7f741cbff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74180c8f10 con 0x7f74180b8480 2023-11-28T12:12:31.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:31.225+0000 7f741659c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7404004d90 0x7f74181575c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:31.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:31.225+0000 7f741659c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7404004d90 0x7f74181575c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56382/0 (socket says 172.21.15.45:56382) 2023-11-28T12:12:31.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:31.225+0000 7f741659c700 1 -- 172.21.15.45:0/1178799123 learned_addr learned my addr 172.21.15.45:0/1178799123 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:12:31.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:31.226+0000 7f741659c700 1 -- 172.21.15.45:0/1178799123 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f74180b8480 msgr2=0x7f74180b88f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:31.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:31.226+0000 7f741659c700 1 --2- 172.21.15.45:0/1178799123 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f74180b8480 0x7f74180b88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:31.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:31.226+0000 7f741659c700 1 -- 172.21.15.45:0/1178799123 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7418156b20 msgr2=0x7f74180c86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:31.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:31.226+0000 7f741659c700 1 --2- 172.21.15.45:0/1178799123 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7418156b20 0x7f74180c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:31.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:31.226+0000 7f741659c700 1 -- 172.21.15.45:0/1178799123 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74180d15e0 con 0x7f7404004d90 2023-11-28T12:12:31.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:31.226+0000 7f741659c700 1 --2- 172.21.15.45:0/1178799123 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7404004d90 0x7f74181575c0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f7408011aa0 tx=0x7f7408011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:31.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:31.226+0000 7f740effd700 1 -- 172.21.15.45:0/1178799123 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740800f900 con 0x7f7404004d90 2023-11-28T12:12:31.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:31.226+0000 7f740effd700 1 -- 172.21.15.45:0/1178799123 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f740800fa60 con 0x7f7404004d90 2023-11-28T12:12:31.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:31.226+0000 7f740effd700 1 -- 172.21.15.45:0/1178799123 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740800fe10 con 0x7f7404004d90 2023-11-28T12:12:31.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:31.226+0000 7f741cbff700 1 -- 172.21.15.45:0/1178799123 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74180d1300 con 0x7f7404004d90 2023-11-28T12:12:31.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:31.226+0000 7f741cbff700 1 -- 172.21.15.45:0/1178799123 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f741815cd80 con 0x7f7404004d90 2023-11-28T12:12:31.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:31.227+0000 7f741cbff700 1 -- 172.21.15.45:0/1178799123 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74181e73d0 con 0x7f7404004d90 2023-11-28T12:12:31.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:31.228+0000 7f740effd700 1 -- 172.21.15.45:0/1178799123 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f7408014440 con 0x7f7404004d90 2023-11-28T12:12:31.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:31.229+0000 7f740effd700 1 --2- 172.21.15.45:0/1178799123 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f73f80682f0 0x7f73f806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:31.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:31.229+0000 7f740effd700 1 -- 172.21.15.45:0/1178799123 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f74080862e0 con 0x7f7404004d90 2023-11-28T12:12:31.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:31.230+0000 7f740ffff700 1 --2- 172.21.15.45:0/1178799123 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f73f80682f0 0x7f73f806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:31.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:31.230+0000 7f740ffff700 1 --2- 172.21.15.45:0/1178799123 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f73f80682f0 0x7f73f806a7a0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f7400001b80 tx=0x7f7400001a50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:31.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:31.233+0000 7f740effd700 1 -- 172.21.15.45:0/1178799123 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f7408052dd0 con 0x7f7404004d90 2023-11-28T12:12:31.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:31.431+0000 7f741cbff700 1 -- 172.21.15.45:0/1178799123 --> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f74180745c0 con 0x7f73f80682f0 2023-11-28T12:12:31.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:31.434+0000 7f740effd700 1 -- 172.21.15.45:0/1178799123 <== mgr.4100 v2:172.21.15.152:6832/115389 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+72772 (secure 0 0 0) 0x7f74180745c0 con 0x7f73f80682f0 2023-11-28T12:12:31.436 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:12:31.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:31.437+0000 7f741cbff700 1 -- 172.21.15.45:0/1178799123 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f73f80682f0 msgr2=0x7f73f806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:31.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:31.437+0000 7f741cbff700 1 --2- 172.21.15.45:0/1178799123 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f73f80682f0 0x7f73f806a7a0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f7400001b80 tx=0x7f7400001a50 comp rx=0 tx=0).stop 2023-11-28T12:12:31.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:31.437+0000 7f741cbff700 1 -- 172.21.15.45:0/1178799123 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7404004d90 msgr2=0x7f74181575c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:31.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:31.437+0000 7f741cbff700 1 --2- 172.21.15.45:0/1178799123 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7404004d90 0x7f74181575c0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f7408011aa0 tx=0x7f7408011e60 comp rx=0 tx=0).stop 2023-11-28T12:12:31.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:31.437+0000 7f741cbff700 1 -- 172.21.15.45:0/1178799123 shutdown_connections 2023-11-28T12:12:31.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:31.437+0000 7f741cbff700 1 --2- 172.21.15.45:0/1178799123 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f73f80682f0 0x7f73f806a7a0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:31.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:31.437+0000 7f741cbff700 1 --2- 172.21.15.45:0/1178799123 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f74180b8480 0x7f74180b88f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:31.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:31.437+0000 7f741cbff700 1 --2- 172.21.15.45:0/1178799123 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7404004d90 0x7f74181575c0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:31.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:31.437+0000 7f741cbff700 1 --2- 172.21.15.45:0/1178799123 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7418156b20 0x7f74180c86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:31.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:31.437+0000 7f741cbff700 1 -- 172.21.15.45:0/1178799123 >> 172.21.15.45:0/1178799123 conn(0x7f7418072600 msgr2=0x7f7418160460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:31.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:31.437+0000 7f741cbff700 1 -- 172.21.15.45:0/1178799123 shutdown_connections 2023-11-28T12:12:31.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:31.437+0000 7f741cbff700 1 -- 172.21.15.45:0/1178799123 wait complete. 2023-11-28T12:12:31.440 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-11-28T12:12:31.455 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":244,"stamp":"2023-11-28T12:12:30.521170+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":109184,"kb_used_data":7424,"kb_used_omap":0,"kb_used_meta":101696,"kb_avail":754865536,"statfs":{"total":773094113280,"available":772982308864,"internally_reserved":0,"allocated":7602176,"data_stored":4039302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":104136704},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.506122"},"pg_stats":[{"pgid":"1.5","version":"0'0","reported_seq":52,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T12:12:19.016795+0000","last_change":"2023-11-28T12:06:23.961595+0000","last_active":"2023-11-28T12:12:19.016795+0000","last_peered":"2023-11-28T12:12:19.016795+0000","last_clean":"2023-11-28T12:12:19.016795+0000","last_became_active":"2023-11-28T12:06:23.961257+0000","last_became_peered":"2023-11-28T12:06:23.961257+0000","last_unstale":"2023-11-28T12:12:19.016795+0000","last_undegraded":"2023-11-28T12:12:19.016795+0000","last_fullsized":"2023-11-28T12:12:19.016795+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:30:40.200095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":55,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T12:12:19.376197+0000","last_change":"2023-11-28T12:06:23.517505+0000","last_active":"2023-11-28T12:12:19.376197+0000","last_peered":"2023-11-28T12:12:19.376197+0000","last_clean":"2023-11-28T12:12:19.376197+0000","last_became_active":"2023-11-28T12:06:23.517151+0000","last_became_peered":"2023-11-28T12:06:23.517151+0000","last_unstale":"2023-11-28T12:12:19.376197+0000","last_undegraded":"2023-11-28T12:12:19.376197+0000","last_fullsized":"2023-11-28T12:12:19.376197+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:30:40.200095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":53,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-11-28T12:12:16.243179+0000","last_change":"2023-11-28T12:06:23.517967+0000","last_active":"2023-11-28T12:12:16.243179+0000","last_peered":"2023-11-28T12:12:16.243179+0000","last_clean":"2023-11-28T12:12:16.243179+0000","last_became_active":"2023-11-28T12:06:23.517495+0000","last_became_peered":"2023-11-28T12:06:23.517495+0000","last_unstale":"2023-11-28T12:12:16.243179+0000","last_undegraded":"2023-11-28T12:12:16.243179+0000","last_fullsized":"2023-11-28T12:12:16.243179+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:51:06.844441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":207,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T12:12:20.477617+0000","last_change":"2023-11-28T12:06:23.513472+0000","last_active":"2023-11-28T12:12:20.477617+0000","last_peered":"2023-11-28T12:12:20.477617+0000","last_clean":"2023-11-28T12:12:20.477617+0000","last_became_active":"2023-11-28T12:06:23.513150+0000","last_became_peered":"2023-11-28T12:06:23.513150+0000","last_unstale":"2023-11-28T12:12:20.477617+0000","last_undegraded":"2023-11-28T12:12:20.477617+0000","last_fullsized":"2023-11-28T12:12:20.477617+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:34:18.653049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":56,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T12:12:19.975955+0000","last_change":"2023-11-28T12:06:23.903708+0000","last_active":"2023-11-28T12:12:19.975955+0000","last_peered":"2023-11-28T12:12:19.975955+0000","last_clean":"2023-11-28T12:12:19.975955+0000","last_became_active":"2023-11-28T12:06:23.903399+0000","last_became_peered":"2023-11-28T12:06:23.903399+0000","last_unstale":"2023-11-28T12:12:19.975955+0000","last_undegraded":"2023-11-28T12:12:19.975955+0000","last_fullsized":"2023-11-28T12:12:19.975955+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:31:13.187145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":57,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T12:12:20.479429+0000","last_change":"2023-11-28T12:06:23.903662+0000","last_active":"2023-11-28T12:12:20.479429+0000","last_peered":"2023-11-28T12:12:20.479429+0000","last_clean":"2023-11-28T12:12:20.479429+0000","last_became_active":"2023-11-28T12:06:23.903354+0000","last_became_peered":"2023-11-28T12:06:23.903354+0000","last_unstale":"2023-11-28T12:12:20.479429+0000","last_undegraded":"2023-11-28T12:12:20.479429+0000","last_fullsized":"2023-11-28T12:12:20.479429+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:02:07.694087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":57,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T12:12:19.019578+0000","last_change":"2023-11-28T12:06:23.903797+0000","last_active":"2023-11-28T12:12:19.019578+0000","last_peered":"2023-11-28T12:12:19.019578+0000","last_clean":"2023-11-28T12:12:19.019578+0000","last_became_active":"2023-11-28T12:06:23.903475+0000","last_became_peered":"2023-11-28T12:06:23.903475+0000","last_unstale":"2023-11-28T12:12:19.019578+0000","last_undegraded":"2023-11-28T12:12:19.019578+0000","last_fullsized":"2023-11-28T12:12:19.019578+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:51:06.844441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":62,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T12:12:19.023127+0000","last_change":"2023-11-28T12:06:23.903983+0000","last_active":"2023-11-28T12:12:19.023127+0000","last_peered":"2023-11-28T12:12:19.023127+0000","last_clean":"2023-11-28T12:12:19.023127+0000","last_became_active":"2023-11-28T12:06:23.903511+0000","last_became_peered":"2023-11-28T12:06:23.903511+0000","last_unstale":"2023-11-28T12:12:19.023127+0000","last_undegraded":"2023-11-28T12:12:19.023127+0000","last_fullsized":"2023-11-28T12:12:19.023127+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:31:13.187145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":62,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-11-28T12:12:19.024167+0000","last_change":"2023-11-28T12:06:23.517246+0000","last_active":"2023-11-28T12:12:19.024167+0000","last_peered":"2023-11-28T12:12:19.024167+0000","last_clean":"2023-11-28T12:12:19.024167+0000","last_became_active":"2023-11-28T12:06:23.516854+0000","last_became_peered":"2023-11-28T12:06:23.516854+0000","last_unstale":"2023-11-28T12:12:19.024167+0000","last_undegraded":"2023-11-28T12:12:19.024167+0000","last_fullsized":"2023-11-28T12:12:19.024167+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:06:22.500165+0000","last_clean_scrub_stamp":"2023-11-28T12:06:22.500165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T16:51:06.844441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574925,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15196,"kb_used_data":1364,"kb_used_omap":0,"kb_used_meta":13824,"kb_avail":94356644,"statfs":{"total":96636764160,"available":96621203456,"internally_reserved":0,"allocated":1396736,"data_stored":948029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14155776},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.68200000000000005,"15min":0.64000000000000001},"min":{"1min":0.42299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.92300000000000004,"5min":1.141,"15min":1.141},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.67700000000000005,"15min":0.69899999999999995},"min":{"1min":0.52000000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.98499999999999999,"5min":2.7469999999999999,"15min":2.7469999999999999},"last":0.77800000000000002}]},{"osd":1,"last update":"Tue Nov 28 12:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.67700000000000005,"15min":0.63100000000000001},"min":{"1min":0.57299999999999995,"5min":0.374,"15min":0.374},"max":{"1min":0.95299999999999996,"5min":1,"15min":1},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.65100000000000002,"15min":0.61399999999999999},"min":{"1min":0.54000000000000004,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.84899999999999998,"5min":1.171,"15min":1.171},"last":0.66000000000000003}]},{"osd":2,"last update":"Tue Nov 28 12:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.71799999999999997,"15min":0.70699999999999996},"min":{"1min":0.50700000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.95499999999999996,"5min":1.819,"15min":1.819},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.76200000000000001,"15min":0.75800000000000001},"min":{"1min":0.58599999999999997,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.91400000000000003,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":0.80400000000000005}]},{"osd":3,"last update":"Tue Nov 28 12:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.71899999999999997,"15min":0.69199999999999995},"min":{"1min":0.56899999999999995,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.95199999999999996,"5min":0.999,"15min":0.999},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.76800000000000002,"15min":0.73599999999999999},"min":{"1min":0.63100000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.008,"5min":1.103,"15min":1.103},"last":0.82799999999999996}]},{"osd":4,"last update":"Tue Nov 28 12:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61099999999999999,"15min":0.61599999999999999},"min":{"1min":0.46300000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.746,"5min":0.878,"15min":0.878},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.90000000000000002,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.81399999999999995}]},{"osd":5,"last update":"Tue Nov 28 12:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.63300000000000001,"15min":0.65700000000000003},"min":{"1min":0.45400000000000001,"5min":0.437,"15min":0.437},"max":{"1min":0.78300000000000003,"5min":1.044,"15min":1.044},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.67900000000000005,"15min":0.71499999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.88400000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.78900000000000003}]},{"osd":6,"last update":"Tue Nov 28 12:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.63500000000000001,"15min":0.66200000000000003},"min":{"1min":0.48899999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.90500000000000003,"5min":1.012,"15min":1.012},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.72599999999999998,"15min":0.75800000000000001},"min":{"1min":0.53400000000000003,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.86299999999999999,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.75600000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574923,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9624,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":8832,"kb_avail":94362216,"statfs":{"total":96636764160,"available":96626909184,"internally_reserved":0,"allocated":802816,"data_stored":357661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9043968},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:11:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.65200000000000002,"15min":0.60299999999999998},"min":{"1min":0.5,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.95399999999999996,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.65400000000000003,"15min":0.61399999999999999},"min":{"1min":0.55300000000000005,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.88600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.67500000000000004}]},{"osd":1,"last update":"Tue Nov 28 12:11:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.68899999999999995,"15min":0.64800000000000002},"min":{"1min":0.54500000000000004,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.93200000000000005,"5min":1.087,"15min":1.087},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.73399999999999999,"15min":0.71599999999999997},"min":{"1min":0.66900000000000004,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.91900000000000004,"5min":1.034,"15min":1.034},"last":0.66300000000000003}]},{"osd":2,"last update":"Tue Nov 28 12:11:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67400000000000004,"15min":0.64400000000000002},"min":{"1min":0.46300000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.97099999999999997,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.67200000000000004,"15min":0.64900000000000002},"min":{"1min":0.52200000000000002,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.84599999999999997,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.64300000000000002}]},{"osd":3,"last update":"Tue Nov 28 12:11:35 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.746,"15min":0.73199999999999998},"min":{"1min":0.67500000000000004,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.024,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.75600000000000001,"15min":0.72999999999999998},"min":{"1min":0.64200000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.99299999999999999,"5min":1.069,"15min":1.069},"last":0.72899999999999998}]},{"osd":4,"last update":"Tue Nov 28 12:11:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.63900000000000001,"15min":0.66400000000000003},"min":{"1min":0.41399999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.86399999999999999,"5min":1.054,"15min":1.054},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.63,"5min":0.66400000000000003,"15min":0.67500000000000004},"min":{"1min":0.441,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.82099999999999995,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.51300000000000001}]},{"osd":5,"last update":"Tue Nov 28 12:11:35 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.67000000000000004,"15min":0.68999999999999995},"min":{"1min":0.51400000000000001,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.92200000000000004,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.495},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.751,"15min":0.76600000000000001},"min":{"1min":0.56499999999999995,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.94599999999999995,"5min":1.111,"15min":1.111},"last":0.68999999999999995}]},{"osd":7,"last update":"Tue Nov 28 12:11:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.70599999999999996,"15min":0.74099999999999999},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.874,"5min":1.008,"15min":1.008},"last":0.629},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.68999999999999995,"15min":0.71799999999999997},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.85199999999999998,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.76700000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574925,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14940,"kb_used_data":1364,"kb_used_omap":0,"kb_used_meta":13568,"kb_avail":94356900,"statfs":{"total":96636764160,"available":96621465600,"internally_reserved":0,"allocated":1396736,"data_stored":948029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13893632},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:11:26 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.42799999999999999,"15min":0.436},"min":{"1min":0.32000000000000001,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.60999999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.48599999999999999,"15min":0.497},"min":{"1min":0.318,"5min":0.309,"15min":0.309},"max":{"1min":0.76100000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.51100000000000001}]},{"osd":2,"last update":"Tue Nov 28 12:11:26 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.46700000000000003,"15min":0.47299999999999998},"min":{"1min":0.34799999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.66200000000000003,"5min":1.111,"15min":1.111},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.5,"15min":0.499},"min":{"1min":0.40100000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.754,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.38400000000000001}]},{"osd":3,"last update":"Tue Nov 28 12:11:26 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.60999999999999999,"15min":0.58699999999999997},"min":{"1min":0.51800000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.80200000000000005,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59399999999999997,"15min":0.56799999999999995},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.77800000000000002,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.441}]},{"osd":4,"last update":"Tue Nov 28 12:11:26 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.72399999999999998,"15min":0.70999999999999996},"min":{"1min":0.50900000000000001,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.89100000000000001,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.749,"5min":0.75,"15min":0.753},"min":{"1min":0.57399999999999995,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.89400000000000002,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.66000000000000003}]},{"osd":5,"last update":"Tue Nov 28 12:11:26 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.76000000000000001,"15min":0.75700000000000001},"min":{"1min":0.64200000000000002,"5min":0.496,"15min":0.496},"max":{"1min":0.93799999999999994,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.56999999999999995,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.97599999999999998,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.67100000000000004}]},{"osd":6,"last update":"Tue Nov 28 12:11:26 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.77400000000000002,"15min":0.77800000000000002},"min":{"1min":0.53400000000000003,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.96099999999999997,"5min":1.21,"15min":1.21},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.79200000000000004,"15min":0.80300000000000005},"min":{"1min":0.57499999999999996,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.997,"5min":1.502,"15min":1.502},"last":0.74199999999999999}]},{"osd":7,"last update":"Tue Nov 28 12:11:26 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.80500000000000005,"15min":0.80700000000000005},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.97299999999999998,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78900000000000003,"15min":0.78300000000000003},"min":{"1min":0.55500000000000005,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.022,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.70999999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574923,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13844,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":13056,"kb_avail":94357996,"statfs":{"total":96636764160,"available":96622587904,"internally_reserved":0,"allocated":798720,"data_stored":356300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13369344},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 12:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.40000000000000002,"15min":0.38700000000000001},"min":{"1min":0.33400000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.46700000000000003,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.47299999999999998,"15min":0.49399999999999999},"min":{"1min":0.315,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.746,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.56999999999999995}]},{"osd":2,"last update":"Tue Nov 28 12:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.33900000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.61799999999999999,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.51300000000000001,"15min":0.53900000000000003},"min":{"1min":0.38,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.70399999999999996,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.51800000000000002}]},{"osd":3,"last update":"Tue Nov 28 12:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52000000000000002,"15min":0.52500000000000002},"min":{"1min":0.35799999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.67400000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.58899999999999997,"15min":0.60499999999999998},"min":{"1min":0.501,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.71599999999999997,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.65700000000000003}]},{"osd":4,"last update":"Tue Nov 28 12:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.79300000000000004,"15min":0.79700000000000004},"min":{"1min":0.625,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.069,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.753,"5min":0.78800000000000003,"15min":0.78100000000000003},"min":{"1min":0.57899999999999996,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.0780000000000001,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.92200000000000004}]},{"osd":5,"last update":"Tue Nov 28 12:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.80200000000000005,"15min":0.82599999999999996},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.101,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.81799999999999995,"15min":0.81599999999999995},"min":{"1min":0.60199999999999998,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.016,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.93500000000000005}]},{"osd":6,"last update":"Tue Nov 28 12:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.81000000000000005,"15min":0.81100000000000005},"min":{"1min":0.64000000000000001,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.044,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.81999999999999995,"15min":0.84499999999999997},"min":{"1min":0.56100000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.145,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.87}]},{"osd":7,"last update":"Tue Nov 28 12:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.84299999999999997,"15min":0.85899999999999999},"min":{"1min":0.58899999999999997,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.022,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.55900000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.0369999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.81299999999999994}]}]},{"osd":2,"up_from":13,"seq":55834574924,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13720,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":12928,"kb_avail":94358120,"statfs":{"total":96636764160,"available":96622714880,"internally_reserved":0,"allocated":802816,"data_stored":357661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13238272},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:11:28 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.45300000000000001,"15min":0.442},"min":{"1min":0.32800000000000001,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.84599999999999997,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.436},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.48599999999999999,"15min":0.46400000000000002},"min":{"1min":0.34399999999999997,"5min":0.317,"15min":0.317},"max":{"1min":0.78200000000000003,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.39400000000000002}]},{"osd":1,"last update":"Tue Nov 28 12:11:28 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.50800000000000001,"15min":0.49299999999999999},"min":{"1min":0.371,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.78800000000000003,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.54400000000000004,"15min":0.52200000000000002},"min":{"1min":0.378,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.876,"5min":1.589,"15min":1.589},"last":0.46899999999999997}]},{"osd":3,"last update":"Tue Nov 28 12:11:28 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.51000000000000001,"15min":0.48999999999999999},"min":{"1min":0.372,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.68899999999999995,"5min":1.762,"15min":1.762},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.56499999999999995,"15min":0.56899999999999995},"min":{"1min":0.44500000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.83999999999999997,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.56999999999999995}]},{"osd":4,"last update":"Tue Nov 28 12:11:28 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.82799999999999996,"15min":0.82999999999999996},"min":{"1min":0.58599999999999997,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0620000000000001,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.83699999999999997,"15min":0.82899999999999996},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.123,"5min":1.534,"15min":1.534},"last":0.61899999999999999}]},{"osd":5,"last update":"Tue Nov 28 12:11:28 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.79800000000000004,"15min":0.76100000000000001},"min":{"1min":0.54200000000000004,"5min":0.497,"15min":0.497},"max":{"1min":1.139,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":0.627},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.79900000000000004,"15min":0.79300000000000004},"min":{"1min":0.66700000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.68300000000000005}]},{"osd":6,"last update":"Tue Nov 28 12:11:28 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.81299999999999994,"15min":0.79600000000000004},"min":{"1min":0.53100000000000003,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.98399999999999999,"5min":1.9219999999999999,"15min":1.9219999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.87,"5min":0.82899999999999996,"15min":0.80100000000000005},"min":{"1min":0.63400000000000001,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.085,"5min":1.698,"15min":1.698},"last":0.59999999999999998}]},{"osd":7,"last update":"Tue Nov 28 12:11:28 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.82899999999999996,"15min":0.81499999999999995},"min":{"1min":0.64800000000000002,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0569999999999999,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.84399999999999997,"15min":0.83299999999999996},"min":{"1min":0.58199999999999996,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0820000000000001,"5min":1.804,"15min":1.804},"last":0.72999999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574923,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14036,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":13248,"kb_avail":94357804,"statfs":{"total":96636764160,"available":96622391296,"internally_reserved":0,"allocated":798720,"data_stored":356300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13565952},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.44,"15min":0.441},"min":{"1min":0.29699999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.505,"5min":0.47899999999999998,"15min":0.45800000000000002},"min":{"1min":0.318,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.76800000000000002,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.48899999999999999}]},{"osd":1,"last update":"Tue Nov 28 12:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.45900000000000002,"15min":0.435},"min":{"1min":0.35699999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.83399999999999996,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.53000000000000003,"15min":0.53400000000000003},"min":{"1min":0.432,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.54600000000000004}]},{"osd":2,"last update":"Tue Nov 28 12:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.54500000000000004,"15min":0.52900000000000003},"min":{"1min":0.41499999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.621,"5min":0.58499999999999996,"15min":0.57699999999999996},"min":{"1min":0.45400000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.83699999999999997,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.68999999999999995}]},{"osd":4,"last update":"Tue Nov 28 12:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.76700000000000002,"15min":0.72299999999999998},"min":{"1min":0.55800000000000005,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.75600000000000001,"15min":0.72599999999999998},"min":{"1min":0.60699999999999998,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.85599999999999998}]},{"osd":5,"last update":"Tue Nov 28 12:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.78500000000000003,"15min":0.76300000000000001},"min":{"1min":0.59199999999999997,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.79600000000000004,"15min":0.78600000000000003},"min":{"1min":0.624,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.0960000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.91200000000000003}]},{"osd":6,"last update":"Tue Nov 28 12:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.79100000000000004,"15min":0.77500000000000002},"min":{"1min":0.54600000000000004,"5min":0.498,"15min":0.498},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.872,"5min":0.81699999999999995,"15min":0.79500000000000004},"min":{"1min":0.65300000000000002,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.89400000000000002}]},{"osd":7,"last update":"Tue Nov 28 12:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.81100000000000005,"15min":0.79800000000000004},"min":{"1min":0.63400000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0349999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.82499999999999996,"15min":0.80600000000000005},"min":{"1min":0.621,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.119,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.93200000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574923,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13976,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":13184,"kb_avail":94357864,"statfs":{"total":96636764160,"available":96622452736,"internally_reserved":0,"allocated":802816,"data_stored":357661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13500416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.68200000000000005,"15min":0.66000000000000003},"min":{"1min":0.497,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.92900000000000005,"5min":1.044,"15min":1.044},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.68000000000000005,"15min":0.66300000000000003},"min":{"1min":0.55600000000000005,"5min":0.37,"15min":0.37},"max":{"1min":0.88600000000000001,"5min":1.042,"15min":1.042},"last":0.78000000000000003}]},{"osd":1,"last update":"Tue Nov 28 12:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.70099999999999996,"15min":0.67700000000000005},"min":{"1min":0.54600000000000004,"5min":0.433,"15min":0.433},"max":{"1min":0.94599999999999995,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.69299999999999995,"15min":0.68899999999999995},"min":{"1min":0.53900000000000003,"5min":0.441,"15min":0.441},"max":{"1min":0.86099999999999999,"5min":1.097,"15min":1.097},"last":0.755}]},{"osd":2,"last update":"Tue Nov 28 12:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.71299999999999997,"15min":0.71699999999999997},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.90100000000000002,"5min":1.125,"15min":1.125},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73699999999999999,"15min":0.74199999999999999},"min":{"1min":0.58999999999999997,"5min":0.435,"15min":0.435},"max":{"1min":0.81799999999999995,"5min":1.143,"15min":1.143},"last":0.89200000000000002}]},{"osd":3,"last update":"Tue Nov 28 12:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69199999999999995,"15min":0.68500000000000005},"min":{"1min":0.55100000000000005,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.879,"5min":1.093,"15min":1.093},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.749,"15min":0.77300000000000002},"min":{"1min":0.56200000000000006,"5min":0.5,"15min":0.5},"max":{"1min":0.92600000000000005,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.80700000000000005}]},{"osd":5,"last update":"Tue Nov 28 12:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.63400000000000001,"15min":0.69999999999999996},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.85699999999999998,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.64400000000000002,"15min":0.69299999999999995},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.81699999999999995,"5min":1.296,"15min":1.296},"last":0.63600000000000001}]},{"osd":6,"last update":"Tue Nov 28 12:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.68300000000000005,"15min":0.73399999999999999},"min":{"1min":0.44500000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.88500000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.72499999999999998,"15min":0.79200000000000004},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.91400000000000003,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.81799999999999995}]},{"osd":7,"last update":"Tue Nov 28 12:11:29 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.71899999999999997,"15min":0.77600000000000002},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.93000000000000005,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.76200000000000001,"15min":0.82999999999999996},"min":{"1min":0.55300000000000005,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.94299999999999995,"5min":1.28,"15min":1.28},"last":0.871}]}]},{"osd":5,"up_from":13,"seq":55834574924,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13848,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":13056,"kb_avail":94357992,"statfs":{"total":96636764160,"available":96622583808,"internally_reserved":0,"allocated":802816,"data_stored":357661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13369344},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:11:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.68700000000000006,"15min":0.65900000000000003},"min":{"1min":0.45000000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.0009999999999999,"5min":1.204,"15min":1.204},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.73399999999999999,"15min":0.70499999999999996},"min":{"1min":0.56599999999999995,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.016,"5min":1.048,"15min":1.048},"last":0.83899999999999997}]},{"osd":1,"last update":"Tue Nov 28 12:11:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.66900000000000004,"15min":0.60999999999999999},"min":{"1min":0.44400000000000001,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.94799999999999995,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.66400000000000003,"15min":0.62},"min":{"1min":0.47299999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.88200000000000001,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.76900000000000002}]},{"osd":2,"last update":"Tue Nov 28 12:11:32 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.68999999999999995,"15min":0.68600000000000005},"min":{"1min":0.60599999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.83899999999999997,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.753},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.70199999999999996,"15min":0.69599999999999995},"min":{"1min":0.48899999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.93300000000000005,"5min":1.298,"15min":1.298},"last":0.82899999999999996}]},{"osd":3,"last update":"Tue Nov 28 12:11:32 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.72499999999999998,"15min":0.70099999999999996},"min":{"1min":0.55700000000000005,"5min":0.438,"15min":0.438},"max":{"1min":0.91200000000000003,"5min":1.093,"15min":1.093},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.75900000000000001,"15min":0.752},"min":{"1min":0.59199999999999997,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.91100000000000003,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.86099999999999999}]},{"osd":4,"last update":"Tue Nov 28 12:11:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.625,"15min":0.68300000000000005},"min":{"1min":0.40600000000000003,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.879,"5min":1.141,"15min":1.141},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.74299999999999999,"15min":0.76100000000000001},"min":{"1min":0.55900000000000005,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.92900000000000005,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.63300000000000001}]},{"osd":6,"last update":"Tue Nov 28 12:11:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67800000000000005,"15min":0.73599999999999999},"min":{"1min":0.45900000000000002,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.0009999999999999,"5min":1.264,"15min":1.264},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.67200000000000004,"15min":0.70999999999999996},"min":{"1min":0.46400000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.65100000000000002}]},{"osd":7,"last update":"Tue Nov 28 12:11:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.68400000000000005,"15min":0.73599999999999999},"min":{"1min":0.49299999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.90500000000000003,"5min":1.173,"15min":1.173},"last":0.879},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.71699999999999997,"15min":0.76700000000000002},"min":{"1min":0.496,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.97499999999999998,"5min":1.008,"15min":1.008},"last":0.67200000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T12:12:31.459 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2023-11-28T12:06:22.500165+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=12, tm_min=6, tm_sec=22, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=12, tm_min=12, tm_sec=24, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T12:12:31.460 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2023-11-28T12:06:22.500165+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=12, tm_min=6, tm_sec=22, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=12, tm_min=12, tm_sec=24, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T12:12:31.460 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2023-11-28T12:06:22.500165+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=12, tm_min=6, tm_sec=22, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=12, tm_min=12, tm_sec=24, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T12:12:31.460 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-11-28T12:06:22.500165+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=12, tm_min=6, tm_sec=22, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=12, tm_min=12, tm_sec=24, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T12:12:31.460 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2023-11-28T12:06:22.500165+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=12, tm_min=6, tm_sec=22, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=12, tm_min=12, tm_sec=24, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T12:12:31.460 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-11-28T12:06:22.500165+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=12, tm_min=6, tm_sec=22, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=12, tm_min=12, tm_sec=24, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T12:12:31.461 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2023-11-28T12:06:22.500165+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=12, tm_min=6, tm_sec=22, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=12, tm_min=12, tm_sec=24, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T12:12:31.461 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2023-11-28T12:06:22.500165+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=12, tm_min=6, tm_sec=22, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=12, tm_min=12, tm_sec=24, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T12:12:31.461 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2023-11-28T12:06:22.500165+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=12, tm_min=6, tm_sec=22, tm_wday=1, tm_yday=332, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=28, tm_hour=12, tm_min=12, tm_sec=24, tm_wday=1, tm_yday=332, tm_isdst=0) 2023-11-28T12:12:31.461 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-28T12:12:31.914 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T12:12:31.919 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T12:12:51.465 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T12:12:51.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:51.680+0000 7f98399ff700 1 Processor -- start 2023-11-28T12:12:51.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:51.680+0000 7f98399ff700 1 -- start start 2023-11-28T12:12:51.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:51.681+0000 7f98399ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f983415c9b0 0x7f98340b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:51.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:51.681+0000 7f98399ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9834161340 0x7f98340d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:51.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:51.681+0000 7f98399ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98340d1950 con 0x7f98340d2320 2023-11-28T12:12:51.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:51.681+0000 7f98399ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98340b5800 con 0x7f983415c9b0 2023-11-28T12:12:51.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:51.681+0000 7f98399ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98340b5520 con 0x7f9834161340 2023-11-28T12:12:51.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:51.682+0000 7f9832ffd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f983415c9b0 0x7f98340b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:51.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:51.682+0000 7f98337fe700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f98340d2320 0x7f98340cd7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:50378/0 (socket says 172.21.15.45:50378) 2023-11-28T12:12:51.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:51.682+0000 7f98337fe700 1 -- 172.21.15.45:0/407864651 learned_addr learned my addr 172.21.15.45:0/407864651 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:12:51.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:51.682+0000 7f98327fc700 1 --2- 172.21.15.45:0/407864651 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9834161340 0x7f98340d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:51.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:51.682+0000 7f9831ffb700 1 -- 172.21.15.45:0/407864651 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2542566192 0 0) 0x7f98340d1950 con 0x7f98340d2320 2023-11-28T12:12:51.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:51.682+0000 7f9831ffb700 1 -- 172.21.15.45:0/407864651 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f981c0035b0 con 0x7f98340d2320 2023-11-28T12:12:51.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:51.682+0000 7f9832ffd700 1 -- 172.21.15.45:0/407864651 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9834161340 msgr2=0x7f98340d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:12:51.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:51.682+0000 7f9832ffd700 1 --2- 172.21.15.45:0/407864651 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9834161340 0x7f98340d1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:51.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:51.682+0000 7f9832ffd700 1 -- 172.21.15.45:0/407864651 >> v1:172.21.15.45:6789/0 conn(0x7f98340d2320 legacy=0x7f98340cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:51.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:51.682+0000 7f9832ffd700 1 -- 172.21.15.45:0/407864651 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98340d1300 con 0x7f983415c9b0 2023-11-28T12:12:51.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:51.683+0000 7f9832ffd700 1 --2- 172.21.15.45:0/407864651 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f983415c9b0 0x7f98340b4bf0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f9824009840 tx=0x7f9824009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1915e34ef3a57d38 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:51.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:51.683+0000 7f9831ffb700 1 -- 172.21.15.45:0/407864651 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9824011830 con 0x7f983415c9b0 2023-11-28T12:12:51.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:51.683+0000 7f9831ffb700 1 -- 172.21.15.45:0/407864651 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9824011990 con 0x7f983415c9b0 2023-11-28T12:12:51.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:51.683+0000 7f9831ffb700 1 -- 172.21.15.45:0/407864651 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9824011d20 con 0x7f983415c9b0 2023-11-28T12:12:51.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:51.683+0000 7f98399ff700 1 -- 172.21.15.45:0/407864651 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f983415c9b0 msgr2=0x7f98340b4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:51.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:51.683+0000 7f98399ff700 1 --2- 172.21.15.45:0/407864651 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f983415c9b0 0x7f98340b4bf0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f9824009840 tx=0x7f9824009b50 comp rx=0 tx=0).stop 2023-11-28T12:12:51.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:51.684+0000 7f98399ff700 1 -- 172.21.15.45:0/407864651 shutdown_connections 2023-11-28T12:12:51.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:51.684+0000 7f98399ff700 1 --2- 172.21.15.45:0/407864651 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f983415c9b0 0x7f98340b4bf0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:51.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:51.684+0000 7f98399ff700 1 --2- 172.21.15.45:0/407864651 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9834161340 0x7f98340d1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:51.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:51.684+0000 7f98399ff700 1 -- 172.21.15.45:0/407864651 >> 172.21.15.45:0/407864651 conn(0x7f9834072600 msgr2=0x7f98340cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:51.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:51.684+0000 7f98399ff700 1 -- 172.21.15.45:0/407864651 shutdown_connections 2023-11-28T12:12:51.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:51.684+0000 7f98399ff700 1 -- 172.21.15.45:0/407864651 wait complete. 2023-11-28T12:12:51.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:51.686+0000 7f98399ff700 1 Processor -- start 2023-11-28T12:12:51.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:51.686+0000 7f98399ff700 1 -- start start 2023-11-28T12:12:51.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:51.687+0000 7f98399ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f98340d2320 0x7f98340c6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:51.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:51.687+0000 7f98399ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f983415c9b0 0x7f98340b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:51.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:51.687+0000 7f98399ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9834161340 0x7f98340b7660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:51.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:51.687+0000 7f98399ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9834151930 con 0x7f983415c9b0 2023-11-28T12:12:51.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:51.687+0000 7f98399ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98340c67c0 con 0x7f98340d2320 2023-11-28T12:12:51.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:51.687+0000 7f98399ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98341557b0 con 0x7f9834161340 2023-11-28T12:12:51.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:51.687+0000 7f98327fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f983415c9b0 0x7f98340b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:51.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:51.687+0000 7f98327fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f983415c9b0 0x7f98340b7120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51798/0 (socket says 172.21.15.45:51798) 2023-11-28T12:12:51.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:51.687+0000 7f98327fc700 1 -- 172.21.15.45:0/1640685701 learned_addr learned my addr 172.21.15.45:0/1640685701 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:12:51.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:51.687+0000 7f9832ffd700 1 --2- 172.21.15.45:0/1640685701 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f98340d2320 0x7f98340c6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:51.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:51.687+0000 7f98337fe700 1 --2- 172.21.15.45:0/1640685701 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9834161340 0x7f98340b7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:51.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:51.687+0000 7f98327fc700 1 -- 172.21.15.45:0/1640685701 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9834161340 msgr2=0x7f98340b7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:51.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:51.687+0000 7f98327fc700 1 --2- 172.21.15.45:0/1640685701 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9834161340 0x7f98340b7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:51.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:51.687+0000 7f98327fc700 1 -- 172.21.15.45:0/1640685701 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f98340d2320 msgr2=0x7f98340c6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:51.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:51.687+0000 7f98327fc700 1 --2- 172.21.15.45:0/1640685701 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f98340d2320 0x7f98340c6280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:51.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:51.687+0000 7f98327fc700 1 -- 172.21.15.45:0/1640685701 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98240094a0 con 0x7f983415c9b0 2023-11-28T12:12:51.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:51.687+0000 7f9832ffd700 1 --2- 172.21.15.45:0/1640685701 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f98340d2320 0x7f98340c6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T12:12:51.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:51.688+0000 7f98327fc700 1 --2- 172.21.15.45:0/1640685701 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f983415c9b0 0x7f98340b7120 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f982800e9e0 tx=0x7f982800eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:51.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:51.688+0000 7f981bfff700 1 -- 172.21.15.45:0/1640685701 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9828009710 con 0x7f983415c9b0 2023-11-28T12:12:51.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:51.688+0000 7f981bfff700 1 -- 172.21.15.45:0/1640685701 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f982800c850 con 0x7f983415c9b0 2023-11-28T12:12:51.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:51.688+0000 7f981bfff700 1 -- 172.21.15.45:0/1640685701 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f982800cbc0 con 0x7f983415c9b0 2023-11-28T12:12:51.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:51.688+0000 7f98399ff700 1 -- 172.21.15.45:0/1640685701 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98340b5130 con 0x7f983415c9b0 2023-11-28T12:12:51.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:51.688+0000 7f98399ff700 1 -- 172.21.15.45:0/1640685701 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98340d15e0 con 0x7f983415c9b0 2023-11-28T12:12:51.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:51.689+0000 7f98399ff700 1 -- 172.21.15.45:0/1640685701 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98340b52c0 con 0x7f983415c9b0 2023-11-28T12:12:51.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:51.690+0000 7f981bfff700 1 -- 172.21.15.45:0/1640685701 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f9828019030 con 0x7f983415c9b0 2023-11-28T12:12:51.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:51.691+0000 7f981bfff700 1 --2- 172.21.15.45:0/1640685701 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f98200682f0 0x7f982006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:51.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:51.691+0000 7f981bfff700 1 -- 172.21.15.45:0/1640685701 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f9828085a20 con 0x7f983415c9b0 2023-11-28T12:12:51.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:51.692+0000 7f9832ffd700 1 --2- 172.21.15.45:0/1640685701 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f98200682f0 0x7f982006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:51.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:51.693+0000 7f9832ffd700 1 --2- 172.21.15.45:0/1640685701 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f98200682f0 0x7f982006a7a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f9824000c00 tx=0x7f9824008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:51.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:51.696+0000 7f981bfff700 1 -- 172.21.15.45:0/1640685701 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f98280524b0 con 0x7f983415c9b0 2023-11-28T12:12:51.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:51.893+0000 7f98399ff700 1 -- 172.21.15.45:0/1640685701 --> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f98340745c0 con 0x7f98200682f0 2023-11-28T12:12:51.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:51.896+0000 7f981bfff700 1 -- 172.21.15.45:0/1640685701 <== mgr.4100 v2:172.21.15.152:6832/115389 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+72983 (secure 0 0 0) 0x7f98340745c0 con 0x7f98200682f0 2023-11-28T12:12:51.897 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:12:51.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:51.898+0000 7f98399ff700 1 -- 172.21.15.45:0/1640685701 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f98200682f0 msgr2=0x7f982006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:51.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:51.898+0000 7f98399ff700 1 --2- 172.21.15.45:0/1640685701 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f98200682f0 0x7f982006a7a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f9824000c00 tx=0x7f9824008030 comp rx=0 tx=0).stop 2023-11-28T12:12:51.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:51.898+0000 7f98399ff700 1 -- 172.21.15.45:0/1640685701 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f983415c9b0 msgr2=0x7f98340b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:51.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:51.898+0000 7f98399ff700 1 --2- 172.21.15.45:0/1640685701 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f983415c9b0 0x7f98340b7120 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f982800e9e0 tx=0x7f982800eda0 comp rx=0 tx=0).stop 2023-11-28T12:12:51.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:51.899+0000 7f98399ff700 1 -- 172.21.15.45:0/1640685701 shutdown_connections 2023-11-28T12:12:51.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:51.899+0000 7f98399ff700 1 --2- 172.21.15.45:0/1640685701 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f98200682f0 0x7f982006a7a0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:51.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:51.899+0000 7f98399ff700 1 --2- 172.21.15.45:0/1640685701 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f98340d2320 0x7f98340c6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:51.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:51.899+0000 7f98399ff700 1 --2- 172.21.15.45:0/1640685701 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f9834161340 0x7f98340b7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:51.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:51.899+0000 7f98399ff700 1 --2- 172.21.15.45:0/1640685701 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f983415c9b0 0x7f98340b7120 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:51.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:51.899+0000 7f98399ff700 1 -- 172.21.15.45:0/1640685701 >> 172.21.15.45:0/1640685701 conn(0x7f9834072600 msgr2=0x7f983415cf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:51.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:51.899+0000 7f98399ff700 1 -- 172.21.15.45:0/1640685701 shutdown_connections 2023-11-28T12:12:51.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:51.899+0000 7f98399ff700 1 -- 172.21.15.45:0/1640685701 wait complete. 2023-11-28T12:12:51.901 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-11-28T12:12:51.917 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":254,"stamp":"2023-11-28T12:12:50.525706+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":109248,"kb_used_data":7424,"kb_used_omap":0,"kb_used_meta":101760,"kb_avail":754865472,"statfs":{"total":773094113280,"available":772982243328,"internally_reserved":0,"allocated":7602176,"data_stored":4039302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":104202240},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002865"},"pg_stats":[{"pgid":"1.5","version":"0'0","reported_seq":68,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T12:12:29.377632+0000","last_change":"2023-11-28T12:12:29.377565+0000","last_active":"2023-11-28T12:12:29.377632+0000","last_peered":"2023-11-28T12:12:29.377632+0000","last_clean":"2023-11-28T12:12:29.377632+0000","last_became_active":"2023-11-28T12:06:23.961257+0000","last_became_peered":"2023-11-28T12:06:23.961257+0000","last_unstale":"2023-11-28T12:12:29.377632+0000","last_undegraded":"2023-11-28T12:12:29.377632+0000","last_fullsized":"2023-11-28T12:12:29.377632+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:12:29.377427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:12:29.377427+0000","last_clean_scrub_stamp":"2023-11-28T12:12:29.377427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:03:33.745396+0000","scrub_duration":0.00361305,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":71,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T12:12:35.290324+0000","last_change":"2023-11-28T12:12:35.290276+0000","last_active":"2023-11-28T12:12:35.290324+0000","last_peered":"2023-11-28T12:12:35.290324+0000","last_clean":"2023-11-28T12:12:35.290324+0000","last_became_active":"2023-11-28T12:06:23.517151+0000","last_became_peered":"2023-11-28T12:06:23.517151+0000","last_unstale":"2023-11-28T12:12:35.290324+0000","last_undegraded":"2023-11-28T12:12:35.290324+0000","last_fullsized":"2023-11-28T12:12:35.290324+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:12:35.290097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:12:35.290097+0000","last_clean_scrub_stamp":"2023-11-28T12:12:35.290097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:58:45.152208+0000","scrub_duration":0.0041562259999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":69,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T12:12:27.230706+0000","last_change":"2023-11-28T12:12:27.230642+0000","last_active":"2023-11-28T12:12:27.230706+0000","last_peered":"2023-11-28T12:12:27.230706+0000","last_clean":"2023-11-28T12:12:27.230706+0000","last_became_active":"2023-11-28T12:06:23.517495+0000","last_became_peered":"2023-11-28T12:06:23.517495+0000","last_unstale":"2023-11-28T12:12:27.230706+0000","last_undegraded":"2023-11-28T12:12:27.230706+0000","last_fullsized":"2023-11-28T12:12:27.230706+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:12:27.230486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:12:27.230486+0000","last_clean_scrub_stamp":"2023-11-28T12:12:27.230486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:04:07.573545+0000","scrub_duration":0.0042133309999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"66'119","reported_seq":224,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T12:12:38.803326+0000","last_change":"2023-11-28T12:12:38.803270+0000","last_active":"2023-11-28T12:12:38.803326+0000","last_peered":"2023-11-28T12:12:38.803326+0000","last_clean":"2023-11-28T12:12:38.803326+0000","last_became_active":"2023-11-28T12:06:23.513150+0000","last_became_peered":"2023-11-28T12:06:23.513150+0000","last_unstale":"2023-11-28T12:12:38.803326+0000","last_undegraded":"2023-11-28T12:12:38.803326+0000","last_fullsized":"2023-11-28T12:12:38.803326+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"66'119","last_scrub_stamp":"2023-11-28T12:12:38.803116+0000","last_deep_scrub":"66'119","last_deep_scrub_stamp":"2023-11-28T12:12:38.803116+0000","last_clean_scrub_stamp":"2023-11-28T12:12:38.803116+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:36:48.836330+0000","scrub_duration":0.0078516100000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":72,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T12:12:33.847658+0000","last_change":"2023-11-28T12:12:33.847586+0000","last_active":"2023-11-28T12:12:33.847658+0000","last_peered":"2023-11-28T12:12:33.847658+0000","last_clean":"2023-11-28T12:12:33.847658+0000","last_became_active":"2023-11-28T12:06:23.903399+0000","last_became_peered":"2023-11-28T12:06:23.903399+0000","last_unstale":"2023-11-28T12:12:33.847658+0000","last_undegraded":"2023-11-28T12:12:33.847658+0000","last_fullsized":"2023-11-28T12:12:33.847658+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:12:33.847480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:12:33.847480+0000","last_clean_scrub_stamp":"2023-11-28T12:12:33.847480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T12:51:32.138902+0000","scrub_duration":0.0043943380000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":72,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T12:12:31.825330+0000","last_change":"2023-11-28T12:12:31.825277+0000","last_active":"2023-11-28T12:12:31.825330+0000","last_peered":"2023-11-28T12:12:31.825330+0000","last_clean":"2023-11-28T12:12:31.825330+0000","last_became_active":"2023-11-28T12:06:23.903354+0000","last_became_peered":"2023-11-28T12:06:23.903354+0000","last_unstale":"2023-11-28T12:12:31.825330+0000","last_undegraded":"2023-11-28T12:12:31.825330+0000","last_fullsized":"2023-11-28T12:12:31.825330+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:12:31.825172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:12:31.825172+0000","last_clean_scrub_stamp":"2023-11-28T12:12:31.825172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T15:54:04.884076+0000","scrub_duration":0.0037066120000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":73,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T12:12:30.966872+0000","last_change":"2023-11-28T12:12:30.966805+0000","last_active":"2023-11-28T12:12:30.966872+0000","last_peered":"2023-11-28T12:12:30.966872+0000","last_clean":"2023-11-28T12:12:30.966872+0000","last_became_active":"2023-11-28T12:06:23.903475+0000","last_became_peered":"2023-11-28T12:06:23.903475+0000","last_unstale":"2023-11-28T12:12:30.966872+0000","last_undegraded":"2023-11-28T12:12:30.966872+0000","last_fullsized":"2023-11-28T12:12:30.966872+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:12:30.966591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:12:30.966591+0000","last_clean_scrub_stamp":"2023-11-28T12:12:30.966591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:03:35.334560+0000","scrub_duration":0.0039826940000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":77,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T12:12:37.786040+0000","last_change":"2023-11-28T12:12:37.785929+0000","last_active":"2023-11-28T12:12:37.786040+0000","last_peered":"2023-11-28T12:12:37.786040+0000","last_clean":"2023-11-28T12:12:37.786040+0000","last_became_active":"2023-11-28T12:06:23.903511+0000","last_became_peered":"2023-11-28T12:06:23.903511+0000","last_unstale":"2023-11-28T12:12:37.786040+0000","last_undegraded":"2023-11-28T12:12:37.786040+0000","last_fullsized":"2023-11-28T12:12:37.786040+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:12:37.785713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:12:37.785713+0000","last_clean_scrub_stamp":"2023-11-28T12:12:37.785713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:25:35.440505+0000","scrub_duration":0.0043396449999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":77,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-11-28T12:12:32.780631+0000","last_change":"2023-11-28T12:12:32.780595+0000","last_active":"2023-11-28T12:12:32.780631+0000","last_peered":"2023-11-28T12:12:32.780631+0000","last_clean":"2023-11-28T12:12:32.780631+0000","last_became_active":"2023-11-28T12:06:23.516854+0000","last_became_peered":"2023-11-28T12:06:23.516854+0000","last_unstale":"2023-11-28T12:12:32.780631+0000","last_undegraded":"2023-11-28T12:12:32.780631+0000","last_fullsized":"2023-11-28T12:12:32.780631+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T12:12:32.780493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T12:12:32.780493+0000","last_clean_scrub_stamp":"2023-11-28T12:12:32.780493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:04:13.123552+0000","scrub_duration":0.0047100220000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574929,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15196,"kb_used_data":1364,"kb_used_omap":0,"kb_used_meta":13824,"kb_avail":94356644,"statfs":{"total":96636764160,"available":96621203456,"internally_reserved":0,"allocated":1396736,"data_stored":948029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":14155776},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.69299999999999995,"15min":0.64400000000000002},"min":{"1min":0.50600000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.92200000000000004,"5min":1.0409999999999999,"15min":1.141},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66700000000000004,"15min":0.69599999999999995},"min":{"1min":0.41899999999999998,"5min":0.38,"15min":0.30499999999999999},"max":{"1min":0.84299999999999997,"5min":0.98499999999999999,"15min":2.7469999999999999},"last":0.65400000000000003}]},{"osd":1,"last update":"Tue Nov 28 12:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69399999999999995,"15min":0.63600000000000001},"min":{"1min":0.47699999999999998,"5min":0.42199999999999999,"15min":0.374},"max":{"1min":0.93899999999999995,"5min":1,"15min":1},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.66700000000000004,"15min":0.61899999999999999},"min":{"1min":0.501,"5min":0.44900000000000001,"15min":0.35599999999999998},"max":{"1min":0.85599999999999998,"5min":0.98299999999999998,"15min":1.171},"last":0.627}]},{"osd":2,"last update":"Tue Nov 28 12:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.72399999999999998,"15min":0.70899999999999996},"min":{"1min":0.51000000000000001,"5min":0.441,"15min":0.441},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.819},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.76600000000000001,"15min":0.76000000000000001},"min":{"1min":0.57199999999999995,"5min":0.54200000000000004,"15min":0.48699999999999999},"max":{"1min":1.014,"5min":1.0680000000000001,"15min":1.7689999999999999},"last":0.68999999999999995}]},{"osd":3,"last update":"Tue Nov 28 12:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73099999999999998,"15min":0.69599999999999995},"min":{"1min":0.45000000000000001,"5min":0.437,"15min":0.40500000000000003},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.78700000000000003,"15min":0.74299999999999999},"min":{"1min":0.60999999999999999,"5min":0.54100000000000004,"15min":0.45000000000000001},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.76200000000000001}]},{"osd":4,"last update":"Tue Nov 28 12:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.61299999999999999,"15min":0.61699999999999999},"min":{"1min":0.42599999999999999,"5min":0.376,"15min":0.36199999999999999},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.878},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.72499999999999998,"15min":0.72399999999999998},"min":{"1min":0.42599999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.67900000000000005}]},{"osd":5,"last update":"Tue Nov 28 12:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.64600000000000002,"15min":0.66100000000000003},"min":{"1min":0.51700000000000002,"5min":0.437,"15min":0.437},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.67800000000000005,"15min":0.71399999999999997},"min":{"1min":0.47999999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.59999999999999998}]},{"osd":6,"last update":"Tue Nov 28 12:12:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.63900000000000001,"15min":0.66300000000000003},"min":{"1min":0.495,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":1.012},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.72599999999999998,"15min":0.75800000000000001},"min":{"1min":0.49199999999999999,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.77100000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574927,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9624,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":8832,"kb_avail":94362216,"statfs":{"total":96636764160,"available":96626909184,"internally_reserved":0,"allocated":802816,"data_stored":357661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9043968},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:12:39 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.66300000000000003,"15min":0.60699999999999998},"min":{"1min":0.37,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.91800000000000004,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.66300000000000003,"15min":0.61699999999999999},"min":{"1min":0.44800000000000001,"5min":0.41199999999999998,"15min":0.39400000000000002},"max":{"1min":0.84199999999999997,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.59799999999999998}]},{"osd":1,"last update":"Tue Nov 28 12:12:39 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.69799999999999995,"15min":0.65100000000000002},"min":{"1min":0.50800000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.84099999999999997,"5min":1.087,"15min":1.087},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.73499999999999999,"15min":0.71599999999999997},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.91300000000000003,"5min":1.034,"15min":1.034},"last":0.623}]},{"osd":2,"last update":"Tue Nov 28 12:12:39 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.67900000000000005,"15min":0.64500000000000002},"min":{"1min":0.503,"5min":0.46300000000000002,"15min":0.46200000000000002},"max":{"1min":0.82299999999999995,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.499},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.67300000000000004,"15min":0.64900000000000002},"min":{"1min":0.49199999999999999,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.88800000000000001,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.70699999999999996}]},{"osd":3,"last update":"Tue Nov 28 12:12:39 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.73999999999999999,"15min":0.72999999999999998},"min":{"1min":0.49099999999999999,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.88900000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.755,"15min":0.72899999999999998},"min":{"1min":0.55600000000000005,"5min":0.53900000000000003,"15min":0.52000000000000002},"max":{"1min":0.875,"5min":1.069,"15min":1.069},"last":0.58199999999999996}]},{"osd":4,"last update":"Tue Nov 28 12:12:39 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.628,"15min":0.66000000000000003},"min":{"1min":0.47199999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.95299999999999996,"5min":1.054,"15min":1.054},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.65400000000000003,"15min":0.67200000000000004},"min":{"1min":0.43099999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.90800000000000003,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.72999999999999998}]},{"osd":5,"last update":"Tue Nov 28 12:12:39 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66200000000000003,"15min":0.68799999999999994},"min":{"1min":0.44400000000000001,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.98099999999999998,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.749,"5min":0.746,"15min":0.76400000000000001},"min":{"1min":0.53800000000000003,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0069999999999999,"5min":1.111,"15min":1.111},"last":0.67000000000000004}]},{"osd":7,"last update":"Tue Nov 28 12:12:39 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.69499999999999995,"15min":0.73699999999999999},"min":{"1min":0.45900000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.93200000000000005,"5min":0.95899999999999996,"15min":1.008},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.68799999999999994,"15min":0.71699999999999997},"min":{"1min":0.45600000000000002,"5min":0.443,"15min":0.443},"max":{"1min":0.88900000000000001,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.76500000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574929,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15004,"kb_used_data":1364,"kb_used_omap":0,"kb_used_meta":13632,"kb_avail":94356836,"statfs":{"total":96636764160,"available":96621400064,"internally_reserved":0,"allocated":1396736,"data_stored":948029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13959168},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.42699999999999999,"15min":0.436},"min":{"1min":0.32600000000000001,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.63200000000000001,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.502,"5min":0.48499999999999999,"15min":0.497},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.70699999999999996,"5min":0.76100000000000001,"15min":1.3540000000000001},"last":0.45300000000000001}]},{"osd":2,"last update":"Tue Nov 28 12:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.46100000000000002,"15min":0.47099999999999997},"min":{"1min":0.313,"5min":0.313,"15min":0.29199999999999998},"max":{"1min":0.57499999999999996,"5min":0.70699999999999996,"15min":1.111},"last":0.432},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.502,"15min":0.5},"min":{"1min":0.378,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.75,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.50800000000000001}]},{"osd":3,"last update":"Tue Nov 28 12:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.622,"15min":0.59099999999999997},"min":{"1min":0.47599999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.80200000000000005,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.62,"5min":0.60699999999999998,"15min":0.57199999999999995},"min":{"1min":0.41299999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.82199999999999995,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.58599999999999997}]},{"osd":4,"last update":"Tue Nov 28 12:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.73499999999999999,"15min":0.71399999999999997},"min":{"1min":0.54700000000000004,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.028,"5min":1.032,"15min":1.1739999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.753,"15min":0.754},"min":{"1min":0.56599999999999995,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0149999999999999,"5min":1.1160000000000001,"15min":1.7350000000000001},"last":0.73799999999999999}]},{"osd":5,"last update":"Tue Nov 28 12:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.76300000000000001,"15min":0.75800000000000001},"min":{"1min":0.622,"5min":0.496,"15min":0.496},"max":{"1min":1.129,"5min":1.129,"15min":1.4750000000000001},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.76400000000000001,"15min":0.76200000000000001},"min":{"1min":0.57999999999999996,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.0820000000000001,"5min":1.22,"15min":1.2410000000000001},"last":0.64300000000000002}]},{"osd":6,"last update":"Tue Nov 28 12:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.77500000000000002,"15min":0.77800000000000002},"min":{"1min":0.56699999999999995,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.071,"5min":1.1399999999999999,"15min":1.21},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.79600000000000004,"15min":0.80400000000000005},"min":{"1min":0.68200000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.083,"5min":1.099,"15min":1.502},"last":0.70199999999999996}]},{"osd":7,"last update":"Tue Nov 28 12:12:29 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.80600000000000005,"15min":0.80800000000000005},"min":{"1min":0.58599999999999997,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.995,"5min":1.155,"15min":1.4139999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.79900000000000004,"15min":0.78600000000000003},"min":{"1min":0.58299999999999996,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.125,"5min":1.1830000000000001,"15min":1.3220000000000001},"last":0.71999999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574927,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13844,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":13056,"kb_avail":94357996,"statfs":{"total":96636764160,"available":96622587904,"internally_reserved":0,"allocated":798720,"data_stored":356300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13369344},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 12:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.40899999999999997,"15min":0.39000000000000001},"min":{"1min":0.28000000000000003,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.54700000000000004,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.46400000000000002,"15min":0.49099999999999999},"min":{"1min":0.30399999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":1.0189999999999999},"last":0.55200000000000005}]},{"osd":2,"last update":"Tue Nov 28 12:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.47499999999999998,"15min":0.47699999999999998},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.66000000000000003,"5min":0.66700000000000004,"15min":0.66900000000000004},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.50800000000000001,"15min":0.53700000000000003},"min":{"1min":0.438,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":1.0620000000000001},"last":0.60999999999999999}]},{"osd":3,"last update":"Tue Nov 28 12:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.52600000000000002,"15min":0.52700000000000002},"min":{"1min":0.35999999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.67400000000000004,"5min":0.78000000000000003,"15min":0.80000000000000004},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.58999999999999997,"15min":0.60499999999999998},"min":{"1min":0.48099999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.80000000000000004,"5min":0.81899999999999995,"15min":0.98799999999999999},"last":0.66600000000000004}]},{"osd":4,"last update":"Tue Nov 28 12:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.79000000000000004,"15min":0.79600000000000004},"min":{"1min":0.55400000000000005,"5min":0.53400000000000003,"15min":0.50800000000000001},"max":{"1min":0.96899999999999997,"5min":1.1859999999999999,"15min":1.9159999999999999},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.78800000000000003,"15min":0.78100000000000003},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.55600000000000005},"max":{"1min":0.92200000000000004,"5min":1.173,"15min":1.2629999999999999},"last":0.89400000000000002}]},{"osd":5,"last update":"Tue Nov 28 12:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.79700000000000004,"15min":0.82499999999999996},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.0820000000000001,"5min":1.1539999999999999,"15min":1.3560000000000001},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81899999999999995,"15min":0.81599999999999995},"min":{"1min":0.622,"5min":0.59299999999999997,"15min":0.56799999999999995},"max":{"1min":1.0209999999999999,"5min":1.2370000000000001,"15min":1.3340000000000001},"last":0.93999999999999995}]},{"osd":6,"last update":"Tue Nov 28 12:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.80200000000000005,"15min":0.80800000000000005},"min":{"1min":0.67300000000000004,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.89200000000000002,"5min":1.1319999999999999,"15min":1.1619999999999999},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.81100000000000005,"15min":0.84199999999999997},"min":{"1min":0.56799999999999995,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.151,"5min":1.157,"15min":1.4330000000000001},"last":0.92000000000000004}]},{"osd":7,"last update":"Tue Nov 28 12:12:31 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.83299999999999996,"15min":0.85499999999999998},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.202,"5min":1.202,"15min":1.3959999999999999},"last":0.98299999999999998},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.81899999999999995,"15min":0.81599999999999995},"min":{"1min":0.68999999999999995,"5min":0.55900000000000005,"15min":0.55700000000000005},"max":{"1min":1.071,"5min":1.071,"15min":1.1859999999999999},"last":0.876}]}]},{"osd":2,"up_from":13,"seq":55834574928,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13720,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":12928,"kb_avail":94358120,"statfs":{"total":96636764160,"available":96622714880,"internally_reserved":0,"allocated":802816,"data_stored":357661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13238272},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:12:28 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.44900000000000001,"15min":0.441},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.28100000000000003},"max":{"1min":0.56299999999999994,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.438,"5min":0.48299999999999998,"15min":0.46300000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.54600000000000004,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.41599999999999998}]},{"osd":1,"last update":"Tue Nov 28 12:12:28 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.51200000000000001,"15min":0.49399999999999999},"min":{"1min":0.35799999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.74399999999999999,"5min":0.78800000000000003,"15min":0.81399999999999995},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.501,"5min":0.54200000000000004,"15min":0.52100000000000002},"min":{"1min":0.39300000000000002,"5min":0.34300000000000003,"15min":0.34100000000000003},"max":{"1min":0.71699999999999997,"5min":1.589,"15min":1.589},"last":0.57399999999999995}]},{"osd":3,"last update":"Tue Nov 28 12:12:28 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.51300000000000001,"15min":0.49099999999999999},"min":{"1min":0.39200000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.59099999999999997,"5min":1.762,"15min":1.762},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56200000000000006,"15min":0.56799999999999995},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.48099999999999998}]},{"osd":4,"last update":"Tue Nov 28 12:12:28 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.81799999999999995,"15min":0.82599999999999996},"min":{"1min":0.64900000000000002,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.008,"5min":1.0900000000000001,"15min":1.1259999999999999},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.75,"5min":0.82199999999999995,"15min":0.82399999999999995},"min":{"1min":0.61899999999999999,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.97299999999999998,"5min":1.534,"15min":1.534},"last":0.871}]},{"osd":5,"last update":"Tue Nov 28 12:12:28 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.80400000000000005,"15min":0.76300000000000001},"min":{"1min":0.627,"5min":0.53300000000000003,"15min":0.497},"max":{"1min":0.997,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79900000000000004,"15min":0.79300000000000004},"min":{"1min":0.65200000000000002,"5min":0.54600000000000004,"15min":0.54200000000000004},"max":{"1min":1.099,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.76000000000000001}]},{"osd":6,"last update":"Tue Nov 28 12:12:28 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.80700000000000005,"15min":0.79400000000000004},"min":{"1min":0.57699999999999996,"5min":0.53100000000000003,"15min":0.52000000000000002},"max":{"1min":0.98299999999999998,"5min":1.9219999999999999,"15min":1.9219999999999999},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.82499999999999996,"15min":0.79900000000000004},"min":{"1min":0.59999999999999998,"5min":0.51700000000000002,"15min":0.46700000000000003},"max":{"1min":1.014,"5min":1.698,"15min":1.698},"last":0.95799999999999996}]},{"osd":7,"last update":"Tue Nov 28 12:12:28 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.81799999999999995,"15min":0.81200000000000006},"min":{"1min":0.59999999999999998,"5min":0.54700000000000004,"15min":0.53200000000000003},"max":{"1min":1.0289999999999999,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":0.97499999999999998},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.84099999999999997,"15min":0.83199999999999996},"min":{"1min":0.66900000000000004,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0489999999999999,"5min":1.804,"15min":1.804},"last":0.91700000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574927,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":14036,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":13248,"kb_avail":94357804,"statfs":{"total":96636764160,"available":96622391296,"internally_reserved":0,"allocated":798720,"data_stored":356300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13565952},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.441,"15min":0.441},"min":{"1min":0.27700000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.48699999999999999,"15min":0.46100000000000002},"min":{"1min":0.34699999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.60399999999999998,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.42999999999999999}]},{"osd":1,"last update":"Tue Nov 28 12:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.46300000000000002,"15min":0.436},"min":{"1min":0.32900000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.64900000000000002,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.53100000000000003,"15min":0.53500000000000003},"min":{"1min":0.36199999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.46800000000000003}]},{"osd":2,"last update":"Tue Nov 28 12:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.54500000000000004,"15min":0.52900000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34599999999999997},"max":{"1min":0.71799999999999997,"5min":1.038,"15min":1.038},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.59199999999999997,"15min":0.57899999999999996},"min":{"1min":0.40999999999999998,"5min":0.38,"15min":0.38},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.73699999999999999}]},{"osd":4,"last update":"Tue Nov 28 12:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.77800000000000002,"15min":0.72599999999999998},"min":{"1min":0.54000000000000004,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.96399999999999997,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76600000000000001,"15min":0.72899999999999998},"min":{"1min":0.59999999999999998,"5min":0.55100000000000005,"15min":0.54100000000000004},"max":{"1min":1.044,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.79300000000000004}]},{"osd":5,"last update":"Tue Nov 28 12:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79300000000000004,"15min":0.76500000000000001},"min":{"1min":0.54200000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.98599999999999999,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.80200000000000005,"15min":0.78800000000000003},"min":{"1min":0.58799999999999997,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.80900000000000005}]},{"osd":6,"last update":"Tue Nov 28 12:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.79400000000000004,"15min":0.77600000000000002},"min":{"1min":0.57399999999999995,"5min":0.498,"15min":0.498},"max":{"1min":1.0229999999999999,"5min":1.161,"15min":1.161},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.82199999999999995,"15min":0.79600000000000004},"min":{"1min":0.65600000000000003,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.119,"5min":1.21,"15min":1.21},"last":0.76000000000000001}]},{"osd":7,"last update":"Tue Nov 28 12:12:34 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.81299999999999994,"15min":0.79900000000000004},"min":{"1min":0.54800000000000004,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.073,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.80900000000000005},"min":{"1min":0.64300000000000002,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.097,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.90700000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574927,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13976,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":13184,"kb_avail":94357864,"statfs":{"total":96636764160,"available":96622452736,"internally_reserved":0,"allocated":802816,"data_stored":357661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13500416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:12:30 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.70199999999999996,"15min":0.66600000000000004},"min":{"1min":0.55300000000000005,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.83799999999999997,"5min":0.94999999999999996,"15min":1.044},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.68899999999999995,"15min":0.66600000000000004},"min":{"1min":0.52900000000000003,"5min":0.37,"15min":0.37},"max":{"1min":0.85599999999999998,"5min":1.042,"15min":1.042},"last":0.58399999999999996}]},{"osd":1,"last update":"Tue Nov 28 12:12:30 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.72099999999999997,"15min":0.68300000000000005},"min":{"1min":0.48999999999999999,"5min":0.433,"15min":0.433},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.70799999999999996,"15min":0.69399999999999995},"min":{"1min":0.626,"5min":0.441,"15min":0.441},"max":{"1min":0.92400000000000004,"5min":0.99199999999999999,"15min":1.097},"last":0.63900000000000001}]},{"osd":2,"last update":"Tue Nov 28 12:12:30 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.501,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.075,"5min":1.075,"15min":1.125},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.74099999999999999,"15min":0.74299999999999999},"min":{"1min":0.51000000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.89200000000000002,"5min":0.99299999999999999,"15min":1.143},"last":0.51900000000000002}]},{"osd":3,"last update":"Tue Nov 28 12:12:30 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.69999999999999996,"15min":0.68799999999999994},"min":{"1min":0.54400000000000004,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.91000000000000003,"5min":1.0109999999999999,"15min":1.093},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.745,"15min":0.77100000000000002},"min":{"1min":0.60399999999999998,"5min":0.50600000000000001,"15min":0.5},"max":{"1min":1.036,"5min":1.0580000000000001,"15min":1.1879999999999999},"last":0.66900000000000004}]},{"osd":5,"last update":"Tue Nov 28 12:12:30 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.60999999999999999,"15min":0.69199999999999995},"min":{"1min":0.46000000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.86499999999999999,"5min":0.90200000000000002,"15min":1.2050000000000001},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.61599999999999999,"15min":0.68400000000000005},"min":{"1min":0.44700000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.77400000000000002,"5min":0.88400000000000001,"15min":1.296},"last":0.747}]},{"osd":6,"last update":"Tue Nov 28 12:12:30 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66500000000000004,"15min":0.72799999999999998},"min":{"1min":0.48999999999999999,"5min":0.44500000000000001,"15min":0.42099999999999999},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":1.2430000000000001},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.70299999999999996,"15min":0.78500000000000003},"min":{"1min":0.47199999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.92100000000000004,"5min":0.98299999999999998,"15min":1.3109999999999999},"last":0.995}]},{"osd":7,"last update":"Tue Nov 28 12:12:30 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69599999999999995,"15min":0.76800000000000002},"min":{"1min":0.49299999999999999,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.85899999999999999,"5min":0.93000000000000005,"15min":1.2230000000000001},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.74399999999999999,"15min":0.82399999999999995},"min":{"1min":0.60299999999999998,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.28},"last":0.82599999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574928,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13848,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":13056,"kb_avail":94357992,"statfs":{"total":96636764160,"available":96622583808,"internally_reserved":0,"allocated":802816,"data_stored":357661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":13369344},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 12:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.70099999999999996,"15min":0.66300000000000003},"min":{"1min":0.41999999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.96499999999999997,"5min":1.0009999999999999,"15min":1.204},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.747,"5min":0.746,"15min":0.70899999999999996},"min":{"1min":0.59099999999999997,"5min":0.50600000000000001,"15min":0.44500000000000001},"max":{"1min":0.96399999999999997,"5min":1.048,"15min":1.048},"last":0.72499999999999998}]},{"osd":1,"last update":"Tue Nov 28 12:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.68799999999999994,"15min":0.61599999999999999},"min":{"1min":0.44500000000000001,"5min":0.44400000000000001,"15min":0.41499999999999998},"max":{"1min":0.92900000000000005,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.68300000000000005,"15min":0.627},"min":{"1min":0.44900000000000001,"5min":0.42999999999999999,"15min":0.39600000000000002},"max":{"1min":1.0049999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.69599999999999995}]},{"osd":2,"last update":"Tue Nov 28 12:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.69599999999999995,"15min":0.68799999999999994},"min":{"1min":0.48899999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.99299999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.70799999999999996,"15min":0.69799999999999995},"min":{"1min":0.55400000000000005,"5min":0.46000000000000002,"15min":0.39900000000000002},"max":{"1min":0.84799999999999998,"5min":1.0129999999999999,"15min":1.298},"last":0.61099999999999999}]},{"osd":3,"last update":"Tue Nov 28 12:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.73799999999999999,"15min":0.70599999999999996},"min":{"1min":0.54500000000000004,"5min":0.44700000000000001,"15min":0.438},"max":{"1min":1.034,"5min":1.093,"15min":1.093},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.76500000000000001,"15min":0.754},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.92600000000000005,"5min":0.94599999999999995,"15min":0.96599999999999997},"last":0.71099999999999997}]},{"osd":4,"last update":"Tue Nov 28 12:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.60599999999999998,"15min":0.67600000000000005},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.86599999999999999,"5min":0.92000000000000004,"15min":1.141},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73699999999999999,"15min":0.75900000000000001},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.92600000000000005,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.89900000000000002}]},{"osd":6,"last update":"Tue Nov 28 12:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.66000000000000003,"15min":0.72999999999999998},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.96699999999999997,"5min":1.264,"15min":1.264},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.66500000000000004,"15min":0.70799999999999996},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.94999999999999996,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.748}]},{"osd":7,"last update":"Tue Nov 28 12:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.67100000000000004,"15min":0.73199999999999998},"min":{"1min":0.42899999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.89800000000000002,"5min":1.173,"15min":1.173},"last":0.874},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.71099999999999997,"15min":0.76500000000000001},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.995,"5min":0.995,"15min":1.008},"last":0.82099999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T12:12:51.920 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-11-28T12:12:52.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.117+0000 7fcb693ff700 1 Processor -- start 2023-11-28T12:12:52.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.117+0000 7fcb693ff700 1 -- start start 2023-11-28T12:12:52.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.118+0000 7fcb693ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcb64161340 0x7fcb640d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:52.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.118+0000 7fcb693ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fcb640d2320 0x7fcb640cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:52.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.118+0000 7fcb693ff700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb640d1950 con 0x7fcb6415c9b0 2023-11-28T12:12:52.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.118+0000 7fcb693ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb640b5800 con 0x7fcb64161340 2023-11-28T12:12:52.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.118+0000 7fcb693ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb640b5300 con 0x7fcb640d2320 2023-11-28T12:12:52.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.118+0000 7fcb627fc700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcb64161340 0x7fcb640d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:52.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.119+0000 7fcb627fc700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcb64161340 0x7fcb640d1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39166/0 (socket says 172.21.15.45:39166) 2023-11-28T12:12:52.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.119+0000 7fcb627fc700 1 -- 172.21.15.45:0/1411286313 learned_addr learned my addr 172.21.15.45:0/1411286313 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:12:52.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.119+0000 7fcb637fe700 1 --2- 172.21.15.45:0/1411286313 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fcb640d2320 0x7fcb640cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:52.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.119+0000 7fcb627fc700 1 -- 172.21.15.45:0/1411286313 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fcb640d2320 msgr2=0x7fcb640cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:12:52.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.119+0000 7fcb627fc700 1 --2- 172.21.15.45:0/1411286313 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fcb640d2320 0x7fcb640cd7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:52.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.119+0000 7fcb627fc700 1 -- 172.21.15.45:0/1411286313 >> v1:172.21.15.152:6789/0 conn(0x7fcb6415c9b0 legacy=0x7fcb640b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:52.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.119+0000 7fcb627fc700 1 -- 172.21.15.45:0/1411286313 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb640b5520 con 0x7fcb64161340 2023-11-28T12:12:52.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.119+0000 7fcb627fc700 1 --2- 172.21.15.45:0/1411286313 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb64161340 0x7fcb640d1de0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fcb580098f0 tx=0x7fcb58009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc1f484ba30d3c40 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:52.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.119+0000 7fcb61ffb700 1 -- 172.21.15.45:0/1411286313 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5800b8a0 con 0x7fcb64161340 2023-11-28T12:12:52.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.119+0000 7fcb61ffb700 1 -- 172.21.15.45:0/1411286313 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb5800ba00 con 0x7fcb64161340 2023-11-28T12:12:52.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.119+0000 7fcb61ffb700 1 -- 172.21.15.45:0/1411286313 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5800bd90 con 0x7fcb64161340 2023-11-28T12:12:52.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.120+0000 7fcb693ff700 1 -- 172.21.15.45:0/1411286313 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb64161340 msgr2=0x7fcb640d1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:52.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.120+0000 7fcb693ff700 1 --2- 172.21.15.45:0/1411286313 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb64161340 0x7fcb640d1de0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fcb580098f0 tx=0x7fcb58009c00 comp rx=0 tx=0).stop 2023-11-28T12:12:52.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.120+0000 7fcb693ff700 1 -- 172.21.15.45:0/1411286313 shutdown_connections 2023-11-28T12:12:52.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.120+0000 7fcb693ff700 1 --2- 172.21.15.45:0/1411286313 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fcb640d2320 0x7fcb640cd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:52.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.120+0000 7fcb693ff700 1 --2- 172.21.15.45:0/1411286313 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb64161340 0x7fcb640d1de0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:52.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.120+0000 7fcb693ff700 1 -- 172.21.15.45:0/1411286313 >> 172.21.15.45:0/1411286313 conn(0x7fcb64072600 msgr2=0x7fcb640cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:52.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.120+0000 7fcb693ff700 1 -- 172.21.15.45:0/1411286313 shutdown_connections 2023-11-28T12:12:52.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.120+0000 7fcb693ff700 1 -- 172.21.15.45:0/1411286313 wait complete. 2023-11-28T12:12:52.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.122+0000 7fcb693ff700 1 Processor -- start 2023-11-28T12:12:52.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.122+0000 7fcb693ff700 1 -- start start 2023-11-28T12:12:52.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.123+0000 7fcb693ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb640d2320 0x7fcb64154720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:52.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.123+0000 7fcb693ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fcb6415c9b0 0x7fcb6406a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:52.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.123+0000 7fcb693ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb64161340 0x7fcb6406ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:52.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.123+0000 7fcb693ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb641f6a00 con 0x7fcb640d2320 2023-11-28T12:12:52.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.123+0000 7fcb693ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb64156e90 con 0x7fcb64161340 2023-11-28T12:12:52.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.123+0000 7fcb693ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb641f3430 con 0x7fcb6415c9b0 2023-11-28T12:12:52.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.123+0000 7fcb62ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb640d2320 0x7fcb64154720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:52.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.123+0000 7fcb62ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb640d2320 0x7fcb64154720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39168/0 (socket says 172.21.15.45:39168) 2023-11-28T12:12:52.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.123+0000 7fcb62ffd700 1 -- 172.21.15.45:0/2098069074 learned_addr learned my addr 172.21.15.45:0/2098069074 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:12:52.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.123+0000 7fcb637fe700 1 --2- 172.21.15.45:0/2098069074 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb64161340 0x7fcb6406ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:52.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.123+0000 7fcb627fc700 1 --2- 172.21.15.45:0/2098069074 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fcb6415c9b0 0x7fcb6406a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:52.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.124+0000 7fcb62ffd700 1 -- 172.21.15.45:0/2098069074 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fcb6415c9b0 msgr2=0x7fcb6406a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:52.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.124+0000 7fcb62ffd700 1 --2- 172.21.15.45:0/2098069074 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fcb6415c9b0 0x7fcb6406a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:52.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.124+0000 7fcb62ffd700 1 -- 172.21.15.45:0/2098069074 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb64161340 msgr2=0x7fcb6406ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:52.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.124+0000 7fcb62ffd700 1 --2- 172.21.15.45:0/2098069074 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb64161340 0x7fcb6406ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:52.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.124+0000 7fcb62ffd700 1 -- 172.21.15.45:0/2098069074 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb58009550 con 0x7fcb640d2320 2023-11-28T12:12:52.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.124+0000 7fcb62ffd700 1 --2- 172.21.15.45:0/2098069074 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb640d2320 0x7fcb64154720 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fcb5400c450 tx=0x7fcb5400c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:52.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.124+0000 7fcb4b7fe700 1 -- 172.21.15.45:0/2098069074 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb540052d0 con 0x7fcb640d2320 2023-11-28T12:12:52.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.124+0000 7fcb4b7fe700 1 -- 172.21.15.45:0/2098069074 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb54005430 con 0x7fcb640d2320 2023-11-28T12:12:52.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.124+0000 7fcb4b7fe700 1 -- 172.21.15.45:0/2098069074 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb540038c0 con 0x7fcb640d2320 2023-11-28T12:12:52.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.124+0000 7fcb693ff700 1 -- 172.21.15.45:0/2098069074 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb640d15e0 con 0x7fcb640d2320 2023-11-28T12:12:52.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.124+0000 7fcb693ff700 1 -- 172.21.15.45:0/2098069074 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb640d1300 con 0x7fcb640d2320 2023-11-28T12:12:52.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.125+0000 7fcb693ff700 1 -- 172.21.15.45:0/2098069074 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb6415cd80 con 0x7fcb640d2320 2023-11-28T12:12:52.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.126+0000 7fcb4b7fe700 1 -- 172.21.15.45:0/2098069074 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7fcb54019030 con 0x7fcb640d2320 2023-11-28T12:12:52.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.127+0000 7fcb4b7fe700 1 --2- 172.21.15.45:0/2098069074 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fcb500682f0 0x7fcb5006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:52.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.127+0000 7fcb4b7fe700 1 -- 172.21.15.45:0/2098069074 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fcb54084c00 con 0x7fcb640d2320 2023-11-28T12:12:52.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.127+0000 7fcb627fc700 1 --2- 172.21.15.45:0/2098069074 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fcb500682f0 0x7fcb5006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:52.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.128+0000 7fcb627fc700 1 --2- 172.21.15.45:0/2098069074 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fcb500682f0 0x7fcb5006a7a0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fcb58009c40 tx=0x7fcb58008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:52.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.131+0000 7fcb4b7fe700 1 -- 172.21.15.45:0/2098069074 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7fcb54051690 con 0x7fcb640d2320 2023-11-28T12:12:52.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.330+0000 7fcb693ff700 1 -- 172.21.15.45:0/2098069074 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7fcb640745c0 con 0x7fcb640d2320 2023-11-28T12:12:52.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.335+0000 7fcb4b7fe700 1 -- 172.21.15.45:0/2098069074 <== mon.0 v2:172.21.15.45:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fcb540011a0 con 0x7fcb640d2320 2023-11-28T12:12:52.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.335+0000 7fcb4b7fe700 1 -- 172.21.15.45:0/2098069074 <== mon.0 v2:172.21.15.45:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v16)=0 v16) v1 ==== 123+0+0 (secure 0 0 0) 0x7fcb540170c0 con 0x7fcb640d2320 2023-11-28T12:12:52.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.338+0000 7fcb693ff700 1 -- 172.21.15.45:0/2098069074 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fcb500682f0 msgr2=0x7fcb5006a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:52.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.338+0000 7fcb693ff700 1 --2- 172.21.15.45:0/2098069074 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fcb500682f0 0x7fcb5006a7a0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fcb58009c40 tx=0x7fcb58008030 comp rx=0 tx=0).stop 2023-11-28T12:12:52.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.338+0000 7fcb693ff700 1 -- 172.21.15.45:0/2098069074 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb640d2320 msgr2=0x7fcb64154720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:52.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.338+0000 7fcb693ff700 1 --2- 172.21.15.45:0/2098069074 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb640d2320 0x7fcb64154720 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fcb5400c450 tx=0x7fcb5400c760 comp rx=0 tx=0).stop 2023-11-28T12:12:52.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.338+0000 7fcb693ff700 1 -- 172.21.15.45:0/2098069074 shutdown_connections 2023-11-28T12:12:52.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.338+0000 7fcb693ff700 1 --2- 172.21.15.45:0/2098069074 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7fcb500682f0 0x7fcb5006a7a0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:52.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.338+0000 7fcb693ff700 1 --2- 172.21.15.45:0/2098069074 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb64161340 0x7fcb6406ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:52.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.338+0000 7fcb693ff700 1 --2- 172.21.15.45:0/2098069074 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb640d2320 0x7fcb64154720 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:52.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.338+0000 7fcb693ff700 1 --2- 172.21.15.45:0/2098069074 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7fcb6415c9b0 0x7fcb6406a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:52.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.338+0000 7fcb693ff700 1 -- 172.21.15.45:0/2098069074 >> 172.21.15.45:0/2098069074 conn(0x7fcb64072600 msgr2=0x7fcb640b7260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:52.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.338+0000 7fcb693ff700 1 -- 172.21.15.45:0/2098069074 shutdown_connections 2023-11-28T12:12:52.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.338+0000 7fcb693ff700 1 -- 172.21.15.45:0/2098069074 wait complete. 2023-11-28T12:12:52.357 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-28T12:12:52.357 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T12:12:52.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.560+0000 7f409c1ff700 1 Processor -- start 2023-11-28T12:12:52.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.560+0000 7f409c1ff700 1 -- start start 2023-11-28T12:12:52.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.561+0000 7f409c1ff700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f4094161340 0x7f40940d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:52.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.561+0000 7f409c1ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f40940d2320 0x7f40940cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:52.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.561+0000 7f409c1ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40940d1950 con 0x7f409415c9b0 2023-11-28T12:12:52.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.561+0000 7f409c1ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40940b5800 con 0x7f40940d2320 2023-11-28T12:12:52.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.561+0000 7f409c1ff700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40940b5300 con 0x7f4094161340 2023-11-28T12:12:52.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.562+0000 7f409a79c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f40940d2320 0x7f40940cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:52.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.562+0000 7f4099f9b700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f409415c9b0 0x7f40940b4bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33018/0 (socket says 172.21.15.45:33018) 2023-11-28T12:12:52.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.562+0000 7f4099f9b700 1 -- 172.21.15.45:0/2313981974 learned_addr learned my addr 172.21.15.45:0/2313981974 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-11-28T12:12:52.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.562+0000 7f409979a700 1 --2- 172.21.15.45:0/2313981974 >> v2:172.21.15.152:3300/0 conn(0x7f4094161340 0x7f40940d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:52.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.562+0000 7f4098f99700 1 -- 172.21.15.45:0/2313981974 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2576991033 0 0) 0x7f40940d1950 con 0x7f409415c9b0 2023-11-28T12:12:52.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.562+0000 7f4098f99700 1 -- 172.21.15.45:0/2313981974 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40800035b0 con 0x7f409415c9b0 2023-11-28T12:12:52.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.562+0000 7f409a79c700 1 -- 172.21.15.45:0/2313981974 >> v2:172.21.15.152:3300/0 conn(0x7f4094161340 msgr2=0x7f40940d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T12:12:52.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.562+0000 7f409a79c700 1 --2- 172.21.15.45:0/2313981974 >> v2:172.21.15.152:3300/0 conn(0x7f4094161340 0x7f40940d1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:52.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.562+0000 7f409a79c700 1 -- 172.21.15.45:0/2313981974 >> v1:172.21.15.45:6789/0 conn(0x7f409415c9b0 legacy=0x7f40940b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:52.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.562+0000 7f409a79c700 1 -- 172.21.15.45:0/2313981974 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40940b5520 con 0x7f40940d2320 2023-11-28T12:12:52.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.563+0000 7f409a79c700 1 --2- 172.21.15.45:0/2313981974 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40940d2320 0x7f40940cd7c0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f40940685c0 tx=0x7f408c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e562087178c8781 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:52.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.563+0000 7f4098f99700 1 -- 172.21.15.45:0/2313981974 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f408c00e070 con 0x7f40940d2320 2023-11-28T12:12:52.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.563+0000 7f4098f99700 1 -- 172.21.15.45:0/2313981974 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f408c00bae0 con 0x7f40940d2320 2023-11-28T12:12:52.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.563+0000 7f4098f99700 1 -- 172.21.15.45:0/2313981974 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f408c012430 con 0x7f40940d2320 2023-11-28T12:12:52.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.563+0000 7f409c1ff700 1 -- 172.21.15.45:0/2313981974 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40940d2320 msgr2=0x7f40940cd7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:52.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.563+0000 7f409c1ff700 1 --2- 172.21.15.45:0/2313981974 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40940d2320 0x7f40940cd7c0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f40940685c0 tx=0x7f408c00b330 comp rx=0 tx=0).stop 2023-11-28T12:12:52.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.563+0000 7f409c1ff700 1 -- 172.21.15.45:0/2313981974 shutdown_connections 2023-11-28T12:12:52.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.563+0000 7f409c1ff700 1 --2- 172.21.15.45:0/2313981974 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40940d2320 0x7f40940cd7c0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:52.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.563+0000 7f409c1ff700 1 --2- 172.21.15.45:0/2313981974 >> v2:172.21.15.152:3300/0 conn(0x7f4094161340 0x7f40940d1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:52.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.563+0000 7f409c1ff700 1 -- 172.21.15.45:0/2313981974 >> 172.21.15.45:0/2313981974 conn(0x7f4094072600 msgr2=0x7f40940cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:52.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.563+0000 7f409c1ff700 1 -- 172.21.15.45:0/2313981974 shutdown_connections 2023-11-28T12:12:52.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.564+0000 7f409c1ff700 1 -- 172.21.15.45:0/2313981974 wait complete. 2023-11-28T12:12:52.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.565+0000 7f409c1ff700 1 Processor -- start 2023-11-28T12:12:52.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.565+0000 7f409c1ff700 1 -- start start 2023-11-28T12:12:52.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.566+0000 7f409c1ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40940d2320 0x7f4094150440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:52.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.566+0000 7f409c1ff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f409415c9b0 0x7f40941e8930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:52.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.566+0000 7f409c1ff700 1 --2- >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4094161340 0x7f4094151570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:52.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.566+0000 7f409c1ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4094153450 con 0x7f40940d2320 2023-11-28T12:12:52.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.566+0000 7f409c1ff700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40941e8e70 con 0x7f409415c9b0 2023-11-28T12:12:52.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.566+0000 7f409c1ff700 1 -- --> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40941536a0 con 0x7f4094161340 2023-11-28T12:12:52.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.567+0000 7f4099f9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40940d2320 0x7f4094150440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:52.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.567+0000 7f4099f9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40940d2320 0x7f4094150440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39184/0 (socket says 172.21.15.45:39184) 2023-11-28T12:12:52.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.567+0000 7f4099f9b700 1 -- 172.21.15.45:0/3530470660 learned_addr learned my addr 172.21.15.45:0/3530470660 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-11-28T12:12:52.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.567+0000 7f409979a700 1 --2- 172.21.15.45:0/3530470660 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f409415c9b0 0x7f40941e8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:52.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.567+0000 7f409a79c700 1 --2- 172.21.15.45:0/3530470660 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4094161340 0x7f4094151570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:52.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.567+0000 7f4099f9b700 1 -- 172.21.15.45:0/3530470660 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4094161340 msgr2=0x7f4094151570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:52.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.567+0000 7f4099f9b700 1 --2- 172.21.15.45:0/3530470660 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4094161340 0x7f4094151570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:52.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.567+0000 7f4099f9b700 1 -- 172.21.15.45:0/3530470660 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f409415c9b0 msgr2=0x7f40941e8930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:52.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.567+0000 7f4099f9b700 1 --2- 172.21.15.45:0/3530470660 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f409415c9b0 0x7f40941e8930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:52.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.567+0000 7f4099f9b700 1 -- 172.21.15.45:0/3530470660 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f408c009a70 con 0x7f40940d2320 2023-11-28T12:12:52.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.567+0000 7f4099f9b700 1 --2- 172.21.15.45:0/3530470660 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40940d2320 0x7f4094150440 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f409000c700 tx=0x7f409000cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:52.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.567+0000 7f408a7fc700 1 -- 172.21.15.45:0/3530470660 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4090005d70 con 0x7f40940d2320 2023-11-28T12:12:52.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.567+0000 7f408a7fc700 1 -- 172.21.15.45:0/3530470660 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f40900070d0 con 0x7f40940d2320 2023-11-28T12:12:52.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.567+0000 7f409c1ff700 1 -- 172.21.15.45:0/3530470660 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40940d15e0 con 0x7f40940d2320 2023-11-28T12:12:52.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.567+0000 7f408a7fc700 1 -- 172.21.15.45:0/3530470660 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4090007480 con 0x7f40940d2320 2023-11-28T12:12:52.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.568+0000 7f409c1ff700 1 -- 172.21.15.45:0/3530470660 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40940d1300 con 0x7f40940d2320 2023-11-28T12:12:52.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.569+0000 7f409c1ff700 1 -- 172.21.15.45:0/3530470660 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f409415cd80 con 0x7f40940d2320 2023-11-28T12:12:52.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.570+0000 7f408a7fc700 1 -- 172.21.15.45:0/3530470660 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 86415+0+0 (secure 0 0 0) 0x7f4090019030 con 0x7f40940d2320 2023-11-28T12:12:52.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.571+0000 7f408a7fc700 1 --2- 172.21.15.45:0/3530470660 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f40780682f0 0x7f407806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T12:12:52.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.571+0000 7f408a7fc700 1 -- 172.21.15.45:0/3530470660 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f4090084fa0 con 0x7f40940d2320 2023-11-28T12:12:52.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.571+0000 7f409979a700 1 --2- 172.21.15.45:0/3530470660 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f40780682f0 0x7f407806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T12:12:52.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.572+0000 7f409979a700 1 --2- 172.21.15.45:0/3530470660 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f40780682f0 0x7f407806a7a0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f4094159de0 tx=0x7f4084008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T12:12:52.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.574+0000 7f408a7fc700 1 -- 172.21.15.45:0/3530470660 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173508 (secure 0 0 0) 0x7f40900519b0 con 0x7f40940d2320 2023-11-28T12:12:52.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.824+0000 7f409c1ff700 1 -- 172.21.15.45:0/3530470660 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f40940745c0 con 0x7f40940d2320 2023-11-28T12:12:52.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.825+0000 7f408a7fc700 1 -- 172.21.15.45:0/3530470660 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+3529 (secure 0 0 0) 0x7f4090017de0 con 0x7f40940d2320 2023-11-28T12:12:52.826 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-11-28T12:12:52.826 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":35,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5423,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6836/735970231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":735970231},{"type":"v1","addr":"172.21.15.152:6836","nonce":735970231}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5797,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/3354918087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6835","nonce":3354918087},{"type":"v1","addr":"172.21.15.152:6837","nonce":3354918087}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5806,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/275804060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":275804060},{"type":"v1","addr":"172.21.15.45:6835","nonce":275804060}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6495,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/4121694812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":4121694812},{"type":"v1","addr":"172.21.15.45:6833","nonce":4121694812}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[]} 2023-11-28T12:12:52.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.827+0000 7f409c1ff700 1 -- 172.21.15.45:0/3530470660 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f40780682f0 msgr2=0x7f407806a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:52.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.827+0000 7f409c1ff700 1 --2- 172.21.15.45:0/3530470660 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f40780682f0 0x7f407806a7a0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f4094159de0 tx=0x7f4084008040 comp rx=0 tx=0).stop 2023-11-28T12:12:52.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.827+0000 7f409c1ff700 1 -- 172.21.15.45:0/3530470660 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40940d2320 msgr2=0x7f4094150440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T12:12:52.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.827+0000 7f409c1ff700 1 --2- 172.21.15.45:0/3530470660 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40940d2320 0x7f4094150440 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f409000c700 tx=0x7f409000cac0 comp rx=0 tx=0).stop 2023-11-28T12:12:52.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.827+0000 7f409c1ff700 1 -- 172.21.15.45:0/3530470660 shutdown_connections 2023-11-28T12:12:52.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.827+0000 7f409c1ff700 1 --2- 172.21.15.45:0/3530470660 >> [v2:172.21.15.152:6832/115389,v1:172.21.15.152:6833/115389] conn(0x7f40780682f0 0x7f407806a7a0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:52.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.827+0000 7f409c1ff700 1 --2- 172.21.15.45:0/3530470660 >> [v2:172.21.15.152:3301/0,v1:172.21.15.152:6790/0] conn(0x7f4094161340 0x7f4094151570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:52.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.827+0000 7f409c1ff700 1 --2- 172.21.15.45:0/3530470660 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40940d2320 0x7f4094150440 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:52.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.827+0000 7f409c1ff700 1 --2- 172.21.15.45:0/3530470660 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f409415c9b0 0x7f40941e8930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T12:12:52.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.827+0000 7f409c1ff700 1 -- 172.21.15.45:0/3530470660 >> 172.21.15.45:0/3530470660 conn(0x7f4094072600 msgr2=0x7f409406a900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T12:12:52.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.827+0000 7f409c1ff700 1 -- 172.21.15.45:0/3530470660 shutdown_connections 2023-11-28T12:12:52.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-11-28T12:12:52.828+0000 7f409c1ff700 1 -- 172.21.15.45:0/3530470660 wait complete. 2023-11-28T12:12:52.830 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 35 2023-11-28T12:12:52.846 DEBUG:tasks.cephfs.filesystem:already dead... 2023-11-28T12:12:52.847 INFO:teuthology.misc:Shutting down mds daemons... 2023-11-28T12:12:52.847 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-28T12:12:52.847 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T12:12:52.860 INFO:tasks.ceph.mds.a:Stopped 2023-11-28T12:12:52.861 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-28T12:12:52.861 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T12:12:52.915 INFO:tasks.ceph.mds.c:Stopped 2023-11-28T12:12:52.915 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-28T12:12:52.915 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T12:12:52.931 INFO:tasks.ceph.mds.b:Stopped 2023-11-28T12:12:52.931 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-28T12:12:52.931 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T12:12:52.988 INFO:tasks.ceph.mds.d:Stopped 2023-11-28T12:12:53.070 INFO:teuthology.misc:Shutting down osd daemons... 2023-11-28T12:12:53.071 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-11-28T12:12:53.071 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T12:12:53.115 INFO:tasks.ceph.osd.0:Stopped 2023-11-28T12:12:53.115 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-11-28T12:12:53.115 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T12:12:53.159 INFO:tasks.ceph.osd.1:Stopped 2023-11-28T12:12:53.159 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-11-28T12:12:53.159 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T12:12:53.203 INFO:tasks.ceph.osd.2:Stopped 2023-11-28T12:12:53.203 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-11-28T12:12:53.203 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T12:12:53.251 INFO:tasks.ceph.osd.3:Stopped 2023-11-28T12:12:53.252 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-11-28T12:12:53.252 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T12:12:53.294 INFO:tasks.ceph.osd.4:Stopped 2023-11-28T12:12:53.294 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-11-28T12:12:53.295 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T12:12:53.348 INFO:tasks.ceph.osd.5:Stopped 2023-11-28T12:12:53.348 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-11-28T12:12:53.348 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T12:12:53.399 INFO:tasks.ceph.osd.6:Stopped 2023-11-28T12:12:53.400 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-11-28T12:12:53.400 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T12:12:53.448 INFO:tasks.ceph.osd.7:Stopped 2023-11-28T12:12:53.449 INFO:teuthology.misc:Shutting down mgr daemons... 2023-11-28T12:12:53.449 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-11-28T12:12:53.449 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T12:12:53.508 INFO:tasks.ceph.mgr.y:Stopped 2023-11-28T12:12:53.508 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-11-28T12:12:53.508 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T12:12:53.573 INFO:tasks.ceph.mgr.x:Stopped 2023-11-28T12:12:53.573 INFO:teuthology.misc:Shutting down mon daemons... 2023-11-28T12:12:53.574 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-11-28T12:12:53.574 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T12:12:53.595 INFO:tasks.ceph.mon.a:Stopped 2023-11-28T12:12:53.595 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-11-28T12:12:53.595 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T12:12:53.613 INFO:tasks.ceph.mon.b:Stopped 2023-11-28T12:12:53.613 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-11-28T12:12:53.613 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T12:12:53.671 INFO:tasks.ceph.mon.c:Stopped 2023-11-28T12:12:53.672 INFO:tasks.ceph:Checking cluster log for badness... 2023-11-28T12:12:53.672 DEBUG:teuthology.orchestra.run.smithi045:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'inode wrongly marked free' | egrep -v 'bad backtrace on inode' | egrep -v 'inode table repaired for inode' | egrep -v 'Scrub error on inode' | egrep -v 'Scrub error on dir' | egrep -v 'Metadata damage detected' | head -n 1 2023-11-28T12:12:53.758 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi045.front.sepia.ceph.com 2023-11-28T12:12:53.758 DEBUG:teuthology.orchestra.run.smithi045:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-11-28T12:12:54.147 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi045.front.sepia.ceph.com 2023-11-28T12:12:54.147 DEBUG:teuthology.orchestra.run.smithi045:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-11-28T12:12:54.304 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi045.front.sepia.ceph.com 2023-11-28T12:12:54.304 DEBUG:teuthology.orchestra.run.smithi045:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-11-28T12:12:54.418 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi045.front.sepia.ceph.com 2023-11-28T12:12:54.419 DEBUG:teuthology.orchestra.run.smithi045:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-11-28T12:12:54.553 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi152.front.sepia.ceph.com 2023-11-28T12:12:54.553 DEBUG:teuthology.orchestra.run.smithi152:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-11-28T12:12:54.783 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi152.front.sepia.ceph.com 2023-11-28T12:12:54.784 DEBUG:teuthology.orchestra.run.smithi152:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-11-28T12:12:54.904 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi152.front.sepia.ceph.com 2023-11-28T12:12:54.904 DEBUG:teuthology.orchestra.run.smithi152:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-11-28T12:12:55.035 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi152.front.sepia.ceph.com 2023-11-28T12:12:55.035 DEBUG:teuthology.orchestra.run.smithi152:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-11-28T12:12:55.171 INFO:tasks.ceph:Archiving mon data... 2023-11-28T12:12:55.173 DEBUG:teuthology.misc:Transferring archived files from smithi045:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/neesingh-2023-11-28_11:27:19-fs-wip-neesingh-testing-231123-distro-default-smithi/7469966/data/mon.a.tgz 2023-11-28T12:12:55.173 DEBUG:teuthology.orchestra.run.smithi045:> mktemp 2023-11-28T12:12:55.222 INFO:teuthology.orchestra.run.smithi045.stdout:/tmp/tmp.ujlS6kJ0dR 2023-11-28T12:12:55.222 DEBUG:teuthology.orchestra.run.smithi045:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.ujlS6kJ0dR 2023-11-28T12:12:55.390 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 0666 /tmp/tmp.ujlS6kJ0dR 2023-11-28T12:12:55.509 DEBUG:teuthology.orchestra.remote:smithi045:/tmp/tmp.ujlS6kJ0dR is 411KB 2023-11-28T12:12:55.609 DEBUG:teuthology.orchestra.run.smithi045:> rm -fr /tmp/tmp.ujlS6kJ0dR 2023-11-28T12:12:55.655 DEBUG:teuthology.misc:Transferring archived files from smithi152:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/neesingh-2023-11-28_11:27:19-fs-wip-neesingh-testing-231123-distro-default-smithi/7469966/data/mon.b.tgz 2023-11-28T12:12:55.655 DEBUG:teuthology.orchestra.run.smithi152:> mktemp 2023-11-28T12:12:55.703 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/tmp.i5kjm3BZRf 2023-11-28T12:12:55.703 DEBUG:teuthology.orchestra.run.smithi152:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.i5kjm3BZRf 2023-11-28T12:12:55.890 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 0666 /tmp/tmp.i5kjm3BZRf 2023-11-28T12:12:56.010 DEBUG:teuthology.orchestra.remote:smithi152:/tmp/tmp.i5kjm3BZRf is 537KB 2023-11-28T12:12:56.113 DEBUG:teuthology.orchestra.run.smithi152:> rm -fr /tmp/tmp.i5kjm3BZRf 2023-11-28T12:12:56.159 DEBUG:teuthology.misc:Transferring archived files from smithi152:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/neesingh-2023-11-28_11:27:19-fs-wip-neesingh-testing-231123-distro-default-smithi/7469966/data/mon.c.tgz 2023-11-28T12:12:56.160 DEBUG:teuthology.orchestra.run.smithi152:> mktemp 2023-11-28T12:12:56.245 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/tmp.sfV3k0JzcH 2023-11-28T12:12:56.246 DEBUG:teuthology.orchestra.run.smithi152:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.sfV3k0JzcH 2023-11-28T12:12:56.464 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 0666 /tmp/tmp.sfV3k0JzcH 2023-11-28T12:12:56.584 DEBUG:teuthology.orchestra.remote:smithi152:/tmp/tmp.sfV3k0JzcH is 537KB 2023-11-28T12:12:56.686 DEBUG:teuthology.orchestra.run.smithi152:> rm -fr /tmp/tmp.sfV3k0JzcH 2023-11-28T12:12:56.732 INFO:tasks.ceph:Cleaning ceph cluster... 2023-11-28T12:12:56.733 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-28T12:12:56.737 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-28T12:12:56.843 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-11-28T12:12:56.843 DEBUG:teuthology.orchestra.run.smithi045:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-28T12:12:56.848 DEBUG:teuthology.orchestra.run.smithi152:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-28T12:12:56.929 INFO:teuthology.orchestra.run.smithi152.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-28T12:12:56.931 INFO:teuthology.orchestra.run.smithi045.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-28T12:12:56.947 INFO:tasks.ceph:Archiving crash dumps... 2023-11-28T12:12:56.949 DEBUG:teuthology.misc:Transferring archived files from smithi045:/var/lib/ceph/crash to /home/teuthworker/archive/neesingh-2023-11-28_11:27:19-fs-wip-neesingh-testing-231123-distro-default-smithi/7469966/remote/smithi045/crash 2023-11-28T12:12:56.950 DEBUG:teuthology.orchestra.run.smithi045:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-28T12:12:57.020 DEBUG:teuthology.misc:Transferring archived files from smithi152:/var/lib/ceph/crash to /home/teuthworker/archive/neesingh-2023-11-28_11:27:19-fs-wip-neesingh-testing-231123-distro-default-smithi/7469966/remote/smithi152/crash 2023-11-28T12:12:57.021 DEBUG:teuthology.orchestra.run.smithi152:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-28T12:12:57.090 INFO:tasks.ceph:Shutting down logrotate 2023-11-28T12:12:57.090 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T12:12:57.095 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T12:12:57.187 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-28T12:12:57.256 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-28T12:12:57.326 INFO:tasks.ceph:Compressing logs... 2023-11-28T12:12:57.326 DEBUG:teuthology.orchestra.run.smithi045:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-28T12:12:57.331 DEBUG:teuthology.orchestra.run.smithi152:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-28T12:12:59.408 INFO:tasks.ceph:Archiving logs... 2023-11-28T12:12:59.408 DEBUG:teuthology.misc:Transferring archived files from smithi045:/var/log/ceph to /home/teuthworker/archive/neesingh-2023-11-28_11:27:19-fs-wip-neesingh-testing-231123-distro-default-smithi/7469966/remote/smithi045/log 2023-11-28T12:12:59.412 DEBUG:teuthology.orchestra.run.smithi045:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-28T12:13:00.049 DEBUG:teuthology.misc:Transferring archived files from smithi152:/var/log/ceph to /home/teuthworker/archive/neesingh-2023-11-28_11:27:19-fs-wip-neesingh-testing-231123-distro-default-smithi/7469966/remote/smithi152/log 2023-11-28T12:13:00.050 DEBUG:teuthology.orchestra.run.smithi152:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-28T12:13:00.334 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-11-28T12:13:00.344 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-11-28T12:13:00.344 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-28T12:13:00.349 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-28T12:13:00.470 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-11-28T12:13:00.479 INFO:teuthology.task.clock:Checking final clock skew... 2023-11-28T12:13:00.480 DEBUG:teuthology.orchestra.run.smithi045:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-28T12:13:00.485 DEBUG:teuthology.orchestra.run.smithi152:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-28T12:13:00.525 INFO:teuthology.orchestra.run.smithi045.stderr:bash: ntpq: command not found 2023-11-28T12:13:00.529 INFO:teuthology.orchestra.run.smithi152.stderr:bash: ntpq: command not found 2023-11-28T12:13:00.532 INFO:teuthology.orchestra.run.smithi045.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-28T12:13:00.533 INFO:teuthology.orchestra.run.smithi045.stdout:=============================================================================== 2023-11-28T12:13:00.533 INFO:teuthology.orchestra.run.smithi045.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 5 +846us[ +846us] +/- 80ms 2023-11-28T12:13:00.533 INFO:teuthology.orchestra.run.smithi045.stdout:^* hv02.front.sepia.ceph.com 3 6 377 7 -566us[ -565us] +/- 64ms 2023-11-28T12:13:00.533 INFO:teuthology.orchestra.run.smithi045.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 5 -185us[ -185us] +/- 63ms 2023-11-28T12:13:00.533 INFO:teuthology.orchestra.run.smithi045.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-11-28T12:13:00.536 INFO:teuthology.orchestra.run.smithi152.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-28T12:13:00.537 INFO:teuthology.orchestra.run.smithi152.stdout:=============================================================================== 2023-11-28T12:13:00.537 INFO:teuthology.orchestra.run.smithi152.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 6 +875us[ +896us] +/- 80ms 2023-11-28T12:13:00.537 INFO:teuthology.orchestra.run.smithi152.stdout:^* hv02.front.sepia.ceph.com 3 6 377 5 -547us[ -526us] +/- 64ms 2023-11-28T12:13:00.537 INFO:teuthology.orchestra.run.smithi152.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 3 -157us[ -157us] +/- 63ms 2023-11-28T12:13:00.537 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-11-28T12:13:00.538 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-11-28T12:13:00.548 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-11-28T12:13:00.549 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-11-28T12:13:00.559 DEBUG:teuthology.orchestra.run.smithi045:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-11-28T12:13:00.751 DEBUG:teuthology.orchestra.run.smithi152:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-11-28T12:13:00.913 DEBUG:teuthology.orchestra.run.smithi045:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-28T12:13:00.991 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T12:13:00.992 DEBUG:teuthology.orchestra.run.smithi152:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-28T12:13:01.068 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T12:13:01.069 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-11-28T12:13:01.079 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-11-28T12:13:01.181 INFO:teuthology.task.internal:Duration was 1514.052726 seconds 2023-11-28T12:13:01.181 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-11-28T12:13:01.220 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-11-28T12:13:01.220 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-28T12:13:01.225 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-28T12:13:01.341 INFO:teuthology.orchestra.run.smithi045.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-28T12:13:01.344 INFO:teuthology.orchestra.run.smithi152.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-28T12:13:01.770 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-11-28T12:13:01.771 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi045.front.sepia.ceph.com 2023-11-28T12:13:01.771 DEBUG:teuthology.orchestra.run.smithi045:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-28T12:13:01.833 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi152.front.sepia.ceph.com 2023-11-28T12:13:01.834 DEBUG:teuthology.orchestra.run.smithi152:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-28T12:13:01.896 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-11-28T12:13:01.897 DEBUG:teuthology.orchestra.run.smithi045:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-28T12:13:01.901 DEBUG:teuthology.orchestra.run.smithi152:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-28T12:13:01.986 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-11-28T12:13:01.987 DEBUG:teuthology.orchestra.run.smithi045:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-28T12:13:01.992 DEBUG:teuthology.orchestra.run.smithi152:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-28T12:13:02.115 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-11-28T12:13:02.126 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-11-28T12:13:02.126 DEBUG:teuthology.orchestra.run.smithi045:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-28T12:13:02.197 DEBUG:teuthology.orchestra.run.smithi152:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-28T12:13:02.268 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-11-28T12:13:02.279 DEBUG:teuthology.orchestra.run.smithi045:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-28T12:13:02.284 DEBUG:teuthology.orchestra.run.smithi152:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-28T12:13:02.351 INFO:teuthology.orchestra.run.smithi045.stdout:kernel.core_pattern = core 2023-11-28T12:13:02.353 INFO:teuthology.orchestra.run.smithi152.stdout:kernel.core_pattern = core 2023-11-28T12:13:02.388 DEBUG:teuthology.orchestra.run.smithi045:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-28T12:13:02.432 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T12:13:02.433 DEBUG:teuthology.orchestra.run.smithi152:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-28T12:13:02.477 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T12:13:02.478 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-11-28T12:13:02.488 INFO:teuthology.task.internal:Transferring archived files... 2023-11-28T12:13:02.489 DEBUG:teuthology.misc:Transferring archived files from smithi045:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/neesingh-2023-11-28_11:27:19-fs-wip-neesingh-testing-231123-distro-default-smithi/7469966/remote/smithi045 2023-11-28T12:13:02.489 DEBUG:teuthology.orchestra.run.smithi045:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-28T12:13:02.572 DEBUG:teuthology.misc:Transferring archived files from smithi152:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/neesingh-2023-11-28_11:27:19-fs-wip-neesingh-testing-231123-distro-default-smithi/7469966/remote/smithi152 2023-11-28T12:13:02.572 DEBUG:teuthology.orchestra.run.smithi152:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-28T12:13:02.652 INFO:teuthology.task.internal:Removing archive directory... 2023-11-28T12:13:02.653 DEBUG:teuthology.orchestra.run.smithi045:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-28T12:13:02.657 DEBUG:teuthology.orchestra.run.smithi152:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-28T12:13:02.703 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-11-28T12:13:02.715 INFO:teuthology.task.internal:Not uploading archives. 2023-11-28T12:13:02.715 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-11-28T12:13:02.768 INFO:teuthology.task.internal:Tidying up after the test... 2023-11-28T12:13:02.768 DEBUG:teuthology.orchestra.run.smithi045:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-28T12:13:02.773 DEBUG:teuthology.orchestra.run.smithi152:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-28T12:13:02.815 INFO:teuthology.orchestra.run.smithi045.stdout: 524293 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 28 12:13 /home/ubuntu/cephtest 2023-11-28T12:13:02.819 INFO:teuthology.orchestra.run.smithi152.stdout: 524301 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 28 12:13 /home/ubuntu/cephtest 2023-11-28T12:13:02.822 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-11-28T12:13:02.834 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-11-28T12:13:02.977 INFO:teuthology.nuke:Checking targets against current locks 2023-11-28T12:13:03.004 DEBUG:teuthology.nuke:shortname: smithi045 2023-11-28T12:13:03.005 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-28T12:13:03.031 DEBUG:teuthology.nuke:shortname: smithi152 2023-11-28T12:13:03.031 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-28T12:13:03.034 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi045.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/neesingh-2023-11-28_11:27:19-fs-wip-neesingh-testing-231123-distro-default-smithi/7469966', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-28 11:34:49.975068', 'locked_by': 'scheduled_neesingh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHtRyX/J4dXuPgQZgnkRgI+j6ljTtxie2rq92X9POlWrfA6Kzs8mueTUo+MwatEEj3SVyJCJZQNKF0ZFSK7Xsmk='} 2023-11-28T12:13:03.057 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi152.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/neesingh-2023-11-28_11:27:19-fs-wip-neesingh-testing-231123-distro-default-smithi/7469966', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-28 11:34:49.976822', 'locked_by': 'scheduled_neesingh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFsEDIPxrgkagg2Jhwa4+SjOQ7xHIEWtHfSMxrtjNX2cprFC975JqW+8AYf+cIfR+qWWqSDVm1y1ZDG3RVOIMPI='} 2023-11-28T12:13:03.091 INFO:teuthology.orchestra.console.smithi045:Power off 2023-11-28T12:13:03.091 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-28T12:13:03.114 DEBUG:teuthology.orchestra.console.smithi045:power off output: Chassis Power Control: Down/Off 2023-11-28T12:13:03.114 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T12:13:03.131 INFO:teuthology.orchestra.console.smithi152:Power off 2023-11-28T12:13:03.131 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-28T12:13:03.141 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is on 2023-11-28T12:13:03.153 DEBUG:teuthology.orchestra.console.smithi152:power off output: Chassis Power Control: Down/Off 2023-11-28T12:13:03.154 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T12:13:03.180 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is on 2023-11-28T12:13:07.142 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T12:13:07.180 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T12:13:07.252 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is on 2023-11-28T12:13:07.294 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is on 2023-11-28T12:13:11.254 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T12:13:11.295 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T12:13:11.365 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is off 2023-11-28T12:13:11.406 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is on 2023-11-28T12:13:11.466 INFO:teuthology.orchestra.console.smithi045:Power off completed 2023-11-28T12:13:15.410 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T12:13:15.521 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is off 2023-11-28T12:13:15.622 INFO:teuthology.orchestra.console.smithi152:Power off completed 2023-11-28T12:13:15.727 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 client.1-kernel-sha1: 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/forward-scrub} duration: 1514.0527257919312 failure_reason: 'Test failure: test_health_status_after_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub)' flavor: default owner: scheduled_neesingh@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=2b1eeb83ffd94519bee1384420e33939 status: fail success: false 2023-11-28T12:13:15.728 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T12:13:15.799 INFO:teuthology.run:FAIL